CoPE is a drop-in enhancement of RoPE that delivers consistent gains within the training context and during long-context extrapoaltion.
Haoran Li PRO
haoranli-ml
·
AI & ML interests
ML, RL, Foundation Models
Recent Activity
updated
a dataset
2 days ago
haoranli-ml/VF_gemini_summaries_final
published
a dataset
2 days ago
haoranli-ml/VF_gemini_summaries_final
updated
a dataset
3 days ago
haoranli-ml/VF_gemini_summaries_train_sanity_check_v2
Organizations
models
17
haoranli-ml/Llama-3-8B-HardClip-64k-Instruct
8B
•
Updated
•
43
haoranli-ml/Llama-3-8B-HardClip-64k-Base
8B
•
Updated
•
35
haoranli-ml/Llama-3-8B-RoPE-64k-Base
8B
•
Updated
•
21
haoranli-ml/Llama-3-8B-CoPE-64k-Base
8B
•
Updated
•
21
haoranli-ml/Llama-3-8B-CoPE-64k-Instruct
Text Generation
•
8B
•
Updated
•
102
haoranli-ml/Llama-3-8B-RoPE-64k-Instruct
Text Generation
•
8B
•
Updated
•
95
haoranli-ml/Qwen3-4B-Instruct_haoran_VF_rl_half_oracle_raw-prefix
4B
•
Updated
haoranli-ml/Qwen3-4B-Instruct_haoran_VF_rl_all_oracle_sum-prefix
4B
•
Updated
haoranli-ml/Qwen3-4B-Instruct_haoran_VF_rl_all_oracle_raw-prefix
4B
•
Updated
haoranli-ml/Qwen3-4B-Instruct_VF_rl_sum-prefix
4B
•
Updated
datasets
89
haoranli-ml/VF_gemini_summaries_final
Viewer
•
Updated
•
6.89k
•
16
haoranli-ml/VF_gemini_summaries_train_sanity_check_v2
Viewer
•
Updated
•
10
•
8
haoranli-ml/VF_gemini_summaries_train_sanity_check
Viewer
•
Updated
•
10
•
7
haoranli-ml/sanity_check_abstraction_12k_suffix_final
Viewer
•
Updated
•
100
•
16
haoranli-ml/sanity_check_raw_prompt_12k_suffix_final
Viewer
•
Updated
•
100
•
16
haoranli-ml/sanity_check_action_items_12k_suffix_final
Viewer
•
Updated
•
100
•
19
haoranli-ml/sanity_check_action_items_final
Viewer
•
Updated
•
100
•
25
haoranli-ml/sanity_check_from_scratch_final
Viewer
•
Updated
•
100
•
19
haoranli-ml/sanity_check_abstraction_final
Viewer
•
Updated
•
100
•
18
haoranli-ml/sanity_check_raw_prompt_final
Viewer
•
Updated
•
100
•
24