Memory, Benchark & Robots: A Benchmark for Solving Complex Tasks with RL

Egor Cherepanov1,2, Nikita Kachaev1,3, Alexey K. Kovalev1,2, Aleksandr I. Panov1,2
1AXXX, 2MIRAI, 3ITMO University AI Talent Hub
ICLR 2026

Aliquam vitae elit ullamcorper tellus egestas pellentesque. Ut lacus tellus, maximus vel lectus at, placerat pretium mi. Maecenas dignissim tincidunt vestibulum. Sed consequat hendrerit nisl ut maximus.

Abstract

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Proin ullamcorper tellus sed ante aliquam tempus. Etiam porttitor urna feugiat nibh elementum, et tempor dolor mattis. Donec accumsan enim augue, a vulputate nisi sodales sit amet. Proin bibendum ex eget mauris cursus euismod nec et nibh. Maecenas ac gravida ante, nec cursus dui. Vivamus purus nibh, placerat ac purus eget, sagittis vestibulum metus. Sed vestibulum bibendum lectus gravida commodo. Pellentesque auctor leo vitae sagittis suscipit.

Video Presentation

Benchmark Tasks Gallery

All demos autoplay and loop. Use player controls to pause, seek, unmute, or open fullscreen.

Task 1: BatteriesCheckerEasy-12

Instruction: Count the required battery pattern and complete the checker interaction in an easy setup.

Task 2: BatteriesCheckerEasy-15

Instruction: Count the required battery pattern and complete the checker interaction in an easy setup.

Task 3: BatteriesCheckerEasy-3

Instruction: Count the required battery pattern and complete the checker interaction in an easy setup.

Task 4: BatteriesCheckerEasy-6

Instruction: Count the required battery pattern and complete the checker interaction in an easy setup.

Task 5: BatteriesCheckerEasy-9

Instruction: Count the required battery pattern and complete the checker interaction in an easy setup.

Task 6: BatteriesCheckerHard-12

Instruction: Identify the correct battery pattern among distractors and complete the checker interaction.

Task 7: BatteriesCheckerHard-15

Instruction: Identify the correct battery pattern among distractors and complete the checker interaction.

Task 8: BatteriesCheckerHard-3

Instruction: Identify the correct battery pattern among distractors and complete the checker interaction.

Task 9: BatteriesCheckerHard-6

Instruction: Identify the correct battery pattern among distractors and complete the checker interaction.

Task 10: BatteriesCheckerHard-9

Instruction: Identify the correct battery pattern among distractors and complete the checker interaction.

Task 11: BlinkCountButtonPressEasy

Instruction: Observe the lamp blink pattern and press the button the exact number of times (easy).

Task 12: BlinkCountButtonPressHard

Instruction: Observe the lamp blink pattern and press the button the exact number of times (hard).

Task 13: BlinkCountButtonPressMedium

Instruction: Observe the lamp blink pattern and press the button the exact number of times (medium).

Task 14: BunchOfColors3

Instruction: Find and act on the group of objects matching the requested target color set.

Task 15: BunchOfColors5

Instruction: Find and act on the group of objects matching the requested target color set.

Task 16: BunchOfColors7

Instruction: Find and act on the group of objects matching the requested target color set.

Task 17: ChainOfColors3

Instruction: Follow the color chain in order and select the correct next item at each step.

Task 18: ChainOfColors5

Instruction: Follow the color chain in order and select the correct next item at each step.

Task 19: ChainOfColors7

Instruction: Follow the color chain in order and select the correct next item at each step.

Task 20: FindImposterColor3

Instruction: Locate the item with the wrong color relative to the rest and select it.

Task 21: FindImposterColor5

Instruction: Locate the item with the wrong color relative to the rest and select it.

Task 22: FindImposterColor9

Instruction: Locate the item with the wrong color relative to the rest and select it.

Task 23: FindImposterShape3

Instruction: Locate the item with the wrong shape relative to the rest and select it.

Task 24: FindImposterShape5

Instruction: Locate the item with the wrong shape relative to the rest and select it.

Task 25: FindImposterShape9

Instruction: Locate the item with the wrong shape relative to the rest and select it.

Task 26: FindImposterShapeAndColor3x2

Instruction: Locate the single item that violates both shape and color patterns.

Task 27: FindImposterShapeAndColor3x3

Instruction: Locate the single item that violates both shape and color patterns.

Task 28: FindImposterShapeAndColor5x3

Instruction: Locate the single item that violates both shape and color patterns.

Task 29: InterceptFast

Instruction: Track the fast moving target and intercept it at the correct moment.

Task 30: InterceptGrabFast

Instruction: Intercept the fast moving target and grasp it before it leaves the workspace.

Task 31: InterceptGrabMedium

Instruction: Intercept the medium-speed moving target and grasp it before it leaves the workspace.

Task 32: InterceptGrabSlow

Instruction: Intercept the slow moving target and grasp it before it leaves the workspace.

Task 33: InterceptMedium

Instruction: Track the moving target and intercept it at the correct moment.

Task 34: InterceptSlow

Instruction: Track the slow moving target and intercept it at the correct moment.

Task 35: RememberColor3

Instruction: Memorize the shown colors, then reproduce the correct answer after delay.

Task 36: RememberColor5

Instruction: Memorize the shown colors, then reproduce the correct answer after delay.

Task 37: RememberColor9

Instruction: Memorize the shown colors, then reproduce the correct answer after delay.

Task 38: RememberShape3

Instruction: Memorize the shown shapes, then reproduce the correct answer after delay.

Task 39: RememberShape5

Instruction: Memorize the shown shapes, then reproduce the correct answer after delay.

Task 40: RememberShape9

Instruction: Memorize the shown shapes, then reproduce the correct answer after delay.

Task 41: RememberShapeAndColor3x2

Instruction: Memorize shape-color combinations, then reproduce the correct answer after delay.

Task 42: RememberShapeAndColor3x3

Instruction: Memorize shape-color combinations, then reproduce the correct answer after delay.

Task 43: RememberShapeAndColor5x3

Instruction: Memorize shape-color combinations, then reproduce the correct answer after delay.

Task 44: SeqOfColors3

Instruction: Repeat the full color sequence in the exact correct order.

Task 45: SeqOfColors5

Instruction: Repeat the full color sequence in the exact correct order.

Task 46: SeqOfColors7

Instruction: Repeat the full color sequence in the exact correct order.

Task 47: ShellGameColorLampTouch

Instruction: Track the correct cup using color/lamp cues through shuffles, then touch it.

Task 48: ShellGamePick

Instruction: Track the hidden item through shuffles and pick from the correct final cup.

Task 49: ShellGamePush

Instruction: Track the hidden item through shuffles and push the correct final cup.

Task 50: ShellGameShuffleColorLampTouch

Instruction: Track the cup under shuffle using color/lamp cues, then touch the final target.

Task 51: ShellGameShuffleTouch

Instruction: Track the cup under shuffle and touch the correct final position.

Task 52: ShellGameTouch

Instruction: Track the hidden item through shuffles and touch the correct final cup.

Task 53: TakeItBack

Instruction: Pick the moved object and return it to its original location.

Poster

BibTeX

@article{YourPaperKey2024,
  title={Your Paper Title Here},
  author={First Author and Second Author and Third Author},
  journal={Conference/Journal Name},
  year={2024},
  url={https://avanturist322.github.io/mikasa-robo/}
}