Model Card for Model ID Trying to implement Llama3 Tokenizer with Tinyllama
Model Details
Model Description
| Tasks |
Version |
Filter |
n-shot |
Metric |
|
Value |
|
Stderr |
| arc_challenge |
1 |
none |
0 |
acc |
↑ |
0.2312 |
± |
0.0123 |
|
|
none |
0 |
acc_norm |
↑ |
0.2602 |
± |
0.0128 |
| arc_easy |
1 |
none |
0 |
acc |
↑ |
0.2593 |
± |
0.0090 |
|
|
none |
0 |
acc_norm |
↑ |
0.2572 |
± |
0.0090 |
| boolq |
2 |
none |
0 |
acc |
↑ |
0.5685 |
± |
0.0087 |
| hellaswag |
1 |
none |
0 |
acc |
↑ |
0.2583 |
± |
0.0044 |
|
|
none |
0 |
acc_norm |
↑ |
0.2642 |
± |
0.0044 |
| openbookqa |
1 |
none |
0 |
acc |
↑ |
0.1260 |
± |
0.0149 |
|
|
none |
0 |
acc_norm |
↑ |
0.2800 |
± |
0.0201 |
| piqa |
1 |
none |
0 |
acc |
↑ |
0.5457 |
± |
0.0116 |
|
|
none |
0 |
acc_norm |
↑ |
0.5158 |
± |
0.0117 |
| winogrande |
1 |
none |
0 |
acc |
↑ |
0.5130 |
± |
0.0140 |
