Datum / čas
Date(s) - 22.09.
15:00 - 16:00
Kategorie ne Kategorie
David Fouhey (University of Michigan, MI, USA)
„Understanding 3D Rooms and Interacting Hands“
When: Thursday 22 September, 2022 at 15:00
Where: CIIRC Room B-671 (building B, floor 6)
Seminar is organized by the Applied Algebra and Geometry (AAG) group and the IMPACT project
http://impact.ciirc.cvut.cz/seminars/#seminar2022-09-22-fouhey
Abstract:
The long-term goal of my research is to enable computers to understand the physical world from images, including both 3D properties and how humans or robots could interact with things. This talk will summarize two recent directions aimed at enabling this goal.
I will begin with learning to reconstruct full 3D scenes, including invisible surfaces, from a single RGB image and present work that can be trained with the ordinary unstructured 3D scans that sensors usually collect. Our method uses implicit functions, which have shown great promise when learned on watertight meshes. When trained on non-watertight meshes, we show that the conventional setup incentivizes neural nets to systematically distort their prediction. We offer a simple solution with a distance-like function that leads to strong results for full scene reconstruction on Matterport3D and other datasets. I will then focus on understanding what humans are doing with their hands. Hands are a primary means for humans to manipulate the world, but fairly basic information about what they’re doing is often off limits to computers (or, at least in challenging data). I’ll describe some of our efforts on understanding hand state, including work on learning to segment hands and hand-held objects in images via a system that learns from large-scale video data.
David Fouhey is an assistant professor at the University of Michigan. He received a Ph.D. in robotics from Carnegie Mellon University and was then a postdoctoral fellow at UC Berkeley. His work has been recognized by a NSF CAREER award, and NSF and NDSEG fellowships. He has spent time at the University of Oxford’s Visual Geometry Group, INRIA Paris, and Microsoft Research.
For more information on IMPACT seminars, please visit
http://impact.ciirc.cvut.cz/seminars