zhimin-z
commited on
Commit
·
be99280
1
Parent(s):
3bd3f7b
refine
Browse files
README.md
CHANGED
|
@@ -52,23 +52,6 @@ Leaderboard refreshes weekly (Monday at 00:00 UTC).
|
|
| 52 |
**Community Submissions**
|
| 53 |
Anyone can submit an assistant. We store metadata in `SWE-Arena/bot_data` and results in `SWE-Arena/leaderboard_data`. All submissions are validated via GitHub API.
|
| 54 |
|
| 55 |
-
## Using the Leaderboard
|
| 56 |
-
|
| 57 |
-
### Browsing
|
| 58 |
-
Leaderboard tab features:
|
| 59 |
-
- Searchable table (by assistant name or website)
|
| 60 |
-
- Filterable columns (by acceptance rate)
|
| 61 |
-
- Monthly charts (acceptance trends and activity)
|
| 62 |
-
|
| 63 |
-
### Adding Your Assistant
|
| 64 |
-
Submit Assistant tab requires:
|
| 65 |
-
- **GitHub identifier**: Assistant's GitHub username
|
| 66 |
-
- **Assistant name**: Display name
|
| 67 |
-
- **Developer**: Your name or team
|
| 68 |
-
- **Website**: Link to homepage or docs
|
| 69 |
-
|
| 70 |
-
Submissions are validated and data loads within seconds.
|
| 71 |
-
|
| 72 |
## Understanding the Metrics
|
| 73 |
|
| 74 |
**Acceptance Rate**
|
|
@@ -82,15 +65,6 @@ Open PRs are excluded. We only count PRs where a decision has been made (merged
|
|
| 82 |
|
| 83 |
Context matters: 100 PRs at 20% acceptance differs from 10 PRs at 80%. Consider both rate and volume.
|
| 84 |
|
| 85 |
-
**Monthly Trends**
|
| 86 |
-
- **Line plots**: Acceptance rate changes over time
|
| 87 |
-
- **Bar charts**: PR volume per month
|
| 88 |
-
|
| 89 |
-
Patterns to watch:
|
| 90 |
-
- Consistent high rates = reliable code quality
|
| 91 |
-
- Increasing trends = improving assistants
|
| 92 |
-
- High volume + good rates = productivity + quality
|
| 93 |
-
|
| 94 |
## What's Next
|
| 95 |
|
| 96 |
Planned improvements:
|
|
|
|
| 52 |
**Community Submissions**
|
| 53 |
Anyone can submit an assistant. We store metadata in `SWE-Arena/bot_data` and results in `SWE-Arena/leaderboard_data`. All submissions are validated via GitHub API.
|
| 54 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 55 |
## Understanding the Metrics
|
| 56 |
|
| 57 |
**Acceptance Rate**
|
|
|
|
| 65 |
|
| 66 |
Context matters: 100 PRs at 20% acceptance differs from 10 PRs at 80%. Consider both rate and volume.
|
| 67 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 68 |
## What's Next
|
| 69 |
|
| 70 |
Planned improvements:
|