Update README.md
Browse files
README.md
CHANGED
|
@@ -23,9 +23,12 @@ tags:
|
|
| 23 |
|
| 24 |
# RDT2-FM: Flow-Matching Action Expert for RDT 2
|
| 25 |
|
| 26 |
-
RDT2-FM conditions on a vision-language backbone ([RDT2-VQ](https://huggingface.co/robotics-diffusion-transformer/RDT2-VQ)) and predicts short-horizon **relative action chunks** with an action expert with improved RDT architecture and flow-matching objective.
|
| 27 |
Using a **flow-matching** objective, RDT2-FM delivering **lower inference latency** while preserving strong instruction following and cross-embodiment generalization on UMI-style bimanual setups.
|
| 28 |
-
Concretely, This repository contains the **action expert** for RDT2-FM.
|
|
|
|
|
|
|
|
|
|
| 29 |
|
| 30 |
[**Home**](https://rdt-robotics.github.io/rdt2/) - [**Github**](https://github.com/thu-ml/RDT2/tree/main?tab=readme-ov-file) - [**Discord**](https://discord.gg/vsZS3zmf9A)
|
| 31 |
|
|
|
|
| 23 |
|
| 24 |
# RDT2-FM: Flow-Matching Action Expert for RDT 2
|
| 25 |
|
| 26 |
+
<!-- RDT2-FM conditions on a vision-language backbone ([RDT2-VQ](https://huggingface.co/robotics-diffusion-transformer/RDT2-VQ)) and predicts short-horizon **relative action chunks** with an action expert with improved RDT architecture and flow-matching objective.
|
| 27 |
Using a **flow-matching** objective, RDT2-FM delivering **lower inference latency** while preserving strong instruction following and cross-embodiment generalization on UMI-style bimanual setups.
|
| 28 |
+
Concretely, This repository contains the **action expert** for RDT2-FM. -->
|
| 29 |
+
RDT2-FM builds on a vision-language backbone (RDT2-VQ) and predicts short-horizon relative action chunks through an action expert that integrates an improved RDT architecture with a flow-matching objective.
|
| 30 |
+
By leveraging flow matching, RDT2-FM achieves lower inference latency while maintaining strong instruction following and cross-embodiment generalization on UMI-style bimanual setups.
|
| 31 |
+
This repository specifically provides the action expert component of RDT2-FM.
|
| 32 |
|
| 33 |
[**Home**](https://rdt-robotics.github.io/rdt2/) - [**Github**](https://github.com/thu-ml/RDT2/tree/main?tab=readme-ov-file) - [**Discord**](https://discord.gg/vsZS3zmf9A)
|
| 34 |
|