Subject: Clarification on RT2 model output structure and usage
Hi [Support Team/RT2 Developers],
I’m working on integrating the RT2 model into a ROS2-based robotic arm control system. The model is being used to generate control commands based on visual input (images) and natural language instructions. However, I’m encountering some challenges in understanding the structure and purpose of the model's output.
Here’s what I observe:
tuple
with two elements.[1, 1023, 20000]
.tuple
has not been explored yet.Could you please clarify the following:
tuple
?[1, 1023, 20000]
) designed for use in robotic control, or does it require additional decoding or processing? If so, what is the recommended approach?tuple
is relevant to robotic control, could you provide guidance or examples on how to interpret and use it?Any examples, documentation, or best practices related to using RT2 for robotic arm control would be greatly appreciated.
Thank you for your assistance!
Best regards
Pay now to fund the work behind this issue.
Get updates on progress being made.
Maintainer is rewarded once the issue is completed.
You're funding impactful open source efforts
You want to contribute to this effort
You want to get funding like this too