| --- |
| license: apache-2.0 |
| datasets: |
| - N8Programs/CreativeGPT |
| language: |
| - en |
| pipeline_tag: text-generation |
| --- |
| |
|  |
|
|
| # Model Card for Coxcomb |
|
|
| A creative writing model, using the superb [senseable/WestLake-7B-v2](https://huggingface.co/senseable/WestLake-7B-v2) as a base, finetuned on GPT-4 outputs to a diverse variety of prompts. It in no way competes with GPT-4 - it's quality of writing is below it, and it is primarily meant to be run in offline, local environments. |
| On creative writing benchmarks, it is consistently ranked higher than most other models - [it scores 72.37](https://eqbench.com/creative_writing.html), beating goliath-120b, yi chat, and mistral-large. |
| It is designed for **single-shot interactions**. You ask it to write a story, and it does. It is NOT designed for chat purposes, roleplay, or follow-up questions. |
|
|
| ## Model Details |
|
|
| Trained w/ a 40M parameter lora on [N8Programs/CreativeGPT](https://huggingface.co/datasets/N8Programs/CreativeGPT) for 3 epochs. Overfit slightly (for much better benchmark results). |
|
|
|
|
| ### Model Description |
|
|
| - **Developed by:** N8Programs |
| - **Model type:** Mistral |
| - **Language(s) (NLP):** English |
| - **License:** Apache 2.0 |
| - **Finetuned from model:** [senseable/WestLake-7B-v2](https://huggingface.co/senseable/WestLake-7B-v2) |
|
|
| ## Uses |
|
|
| Bot trained on NSFW (sexual or violent) content but will generate it when asked - it has not been trained with refusals. If you wish to ADD refusal behavior in, further tuning or filtering will be neccessary. |
|
|
| ### Direct Use |
|
|
| GGUFs available at [Coxcomb-GGUF](https://huggingface.co/N8Programs/Coxcomb-GGUF) |
| Should work with transformers (not officially tested). |
|
|
| ## Bias, Risks, and Limitations |
|
|
| Tends to generate stories with happy, trite endings. Most LLMs do this. It's very hard to get them not to. |
|
|
| ## Training Details |
|
|
| Trained on a single M3 Max in roughly 12 hours. |
