SeprotHub/Model-RASH-ESMC-300M

Model Card for Model-Demo-ESMC-300M

Base model

[EvolutionaryScale/esmc-300m-2024-12]

Task description

This is a ESMC_300M model for the Protein-level Regression task and the dataset is the Dataset-RASH_HUMAN.

Label meaning

Label means mutation effect score of each protein based on deep mutation scanning experiment, ranging from minus infinity to positive infinity where 0 is value of wildtype, larger means higher fitness.

Task type

Protein-level Regression

Model input type

AA Sequence

LoRA config

• r: 8
• lora_dropout: 0.0
• lora_alpha: 16
• target_modules: ['layernorm_qkv.1', 'ffn.1', 'out_proj', 'ffn.3']
• modules_to_save: ['classifier']

Training config

• optimizer:
  • class: AdamW
  • betas: (0.9, 0.98)
  • weight_decay: 0.01
• learning rate: 0.0001
• epoch: 10
• batch size: 32
• precision: 16-mixed