Embedded Files
General Rules
General Rules
Participants may participate alone or in teams.
Individuals are not allowed to participate in multiple teams.
Each team needs to have a contact person and provide an email address through which they can be reached.
Cash prizes will be paid out to an account specified by the contact person of each team. It is the responsibility of the team's contact person to distribute the prize money according to their team-internal agreements.
To be eligible to win prizes, participants agree to release their code and models as well as publish a report about their methods so that the research community can reproduce and benefit from the results.
The organizers reserve the right to change the rules if doing so is necessary to resolve unforeseen problems.
The organizers reserve the right to disqualify participants who violate the rules or engage in scientific misconduct.
Example solutions - obtained by teleoperating the robot.
Example solutions - obtained by teleoperating the robot.
mujoco_teleop.mp4Evaluation Metrics
Evaluation Metrics
- Primary Metrics - Task success rate (Task SR)
The task success rate is defined as the average of the object success rates for N objects involved in a single task. An object is considered successfully rearranged if the intersection over union (IoU) of its bounding boxes exceeds a certain threshold (e.g. 70%). The IoU is the ratio of the area of overlap to the area of union between two bounding boxes. Let bb1 be the bounding box of the object after the rearrangement and bb2 be the desired bounding box specified in the task. Then, the object success rate is given by:
The task success rate is then calculated as:
Real Robot Setup (Coming soon...)
Page updated
Google Sites
Report abuse