Real-to-Sim Data and Task Generation for LEGO Stacking
ActivePhotorealistic Isaac Sim re-renders of recorded demonstrations let a LEGO stacking policy trained on one 2x2 brick place new bricks, even ones absent from all training data.
A showcase of my projects and work.
Photorealistic Isaac Sim re-renders of recorded demonstrations let a LEGO stacking policy trained on one 2x2 brick place new bricks, even ones absent from all training data.
📢 Stay tuned for future updates!
Collected human demonstrations for a LEGO Duplo stacking task using a VR-setup (Metaverse headset), learned Diffusion Transformer Flow policies based on more than 100 demonstrations and deployed the policies on a Franka Emika Panda.
A transformer-based pipeline for dense and consistent 3D reconstruction from monocular RGB videos of large-scale real-world scenes.