metadata
language:
- pt
- en
tags:
- aes
datasets:
- kamel-usp/aes_enem_dataset
base_model: microsoft/Phi-3.5-mini-instruct
metrics:
- accuracy
- qwk
library_name: peft
model-index:
- name: Phi-3.5-mini-instruct-phi35_classification_lora-C3-full_context-r8
results:
- task:
type: text-classification
name: Automated Essay Score
dataset:
name: Automated Essay Score ENEM Dataset
type: kamel-usp/aes_enem_dataset
config: JBCS2025
split: test
metrics:
- name: Macro F1
type: f1
value: 0.2932611094959059
- name: QWK
type: qwk
value: 0.4449319877139096
- name: Weighted Macro F1
type: f1
value: 0.3542731611386337
Model ID: Phi-3.5-mini-instruct-phi35_classification_lora-C3-full_context-r8
Results
| test_data | |
|---|---|
| eval_accuracy | 0.369565 |
| eval_RMSE | 56.466 |
| eval_QWK | 0.444932 |
| eval_Macro_F1 | 0.293261 |
| eval_Weighted_F1 | 0.354273 |
| eval_Micro_F1 | 0.369565 |
| eval_HDIV | 0.0797101 |