Description: Robonaut 2 (R2) is constrained to an older and less capable set of vision sensors due to its space heritage and radiation environment. Many of the algorithms that have been developed have significantly reduced effectiveness when partnered with the quality of vision data used. The R2 team is looking to find vision algorithms that will be effective with noisy stereo vision data for localizing a specific point on a variety of tools. The R2 team has approximately 100 sets of stereo imagery to use for the stereo vision data which will be provided to the vendor. Additionally, ground truth data will also be provided. This data will be fed back to the control system to allow the robot to create a plan for grasping the object, enabling the robot to complete its tasks.
This challenge is seeking vision algorithms for NASA's Robonaut 2 (R2) that will be effective with noisy stereo vision data for localizing a specific point on a variety of tools. Robonaut 2 (R2) is constrained to an older and less capable set of vision sensors due to its space heritage and radiation environment. Many of the algorithms that have been developed have significantly reduced effectiveness when partnered with the quality of vision data used. The R2 team is looking to find vision algorithms that will be effective with noisy stereo vision data for localizing a specific point on a variety of tools. The R2 team has approximately 100 sets of stereo imagery to use for the stereo vision data which will be provided to the vendor. Additionally, ground truth data will also be provided. This data will be fed back to the control system to allow the robot to create a plan for grasping the object, enabling the robot to complete its tasks.

Benefits:

In our close out package you will find all of this content: https://docs.google.com/presentation/d/1HmE2_dTWgtZZXYNM9-pd85vLbhbvc_EJ9_V-UKSNmuU/edit#slide=id.ge52f96c47_0_15
Significantly Advanced Towards a Solution
Planned for future implementation
Algorithm