Article
Bringing Autonomous Driving RL to OpenEnv and TRL
•
16
Pedro Cuenca PRO
pcuenq
AI & ML interests
None yet
Recent Activity
updated
a dataset 2 days ago
huggingface-projects/drlc-leaderboard-data upvoted an article 4 days ago
Bringing Autonomous Driving RL to OpenEnv and TRL reacted
to
sergiopaniego's
post with 🚀 4 days ago
What happens when you make an LLM drive a car where physics are real and actions can't be undone?
I ported CARLA, the autonomous driving simulator, to OpenEnv and added training support via TRL + Hugging Face Spaces.
The model interacts with the simulator through tool calls (observe, brake, change lane) and learns from a reward signal.
In 50 training steps, Qwen 0.6B learns to swerve and brake to avoid pedestrians in emergency situations.
The project supports text and vision (VLMs can see through a camera sensor), open-world driving with traffic, and multiple driving scenarios.
This builds on the carla-env project by sinatras, which originally placed LLMs inside CARLA for evaluation. We extended it with vision, new scenarios, rubric-based rewards, and made it trainable end-to-end.
Blog: https://huggingface.co/blog/sergiopaniego/bringing-carla-to-openenv-trl/
CARLA env in OpenEnv: https://github.com/meta-pytorch/OpenEnv/tree/main/envs/carla_env
Training script: https://github.com/huggingface/trl/blob/main/examples/scripts/openenv/carla.py Organizations
upvoted 2 articles 4 days ago
Article
Mixture of Experts (MoEs) in Transformers
-
- +5
•
104
upvoted a collection 4 days ago
upvoted an article 4 days ago
Article
Deploying Open Source Vision Language Models (VLM) on Jetson
•
26
upvoted an article 10 days ago
Article
GGML and llama.cpp join HF to ensure the long-term progress of Local AI
- +4
•
471
upvoted a collection 14 days ago
upvoted 2 articles 17 days ago
Article
Custom Kernels for All from Codex and Claude
- +2
•
65
Article
Forge: Scalable Agent RL Framework and Algorithm
•
130
upvoted a changelog 20 days ago
Changelog
Scoped Full-text Search
• 74
upvoted 2 collections 20 days ago
upvoted 2 articles 21 days ago
Article
Transformers.js v4 Preview: Now Available on NPM!
•
72
Article
From Golden Gate Bridge to Broken JSON: Why Anthropic's SAE Steering Fails for Structured Output
•
21
upvoted a changelog 25 days ago
Changelog
Community Evals and Benchmark Repositories
• 65
upvoted an article 25 days ago
Article
Community Evals: Because we're done trusting black-box leaderboards over the community
-
- +5
•
82
upvoted 5 changelogs 25 days ago
Changelog
Sort Models by Parameter Size
• 34
Changelog
MLX Hardware Compatibility
• 47
Changelog
Sort Datasets by Size
• 87
Changelog
View Running Jobs Count from the User Menu
• 52
Changelog
Find All Your Blog Drafts in One Place
• 40