no code implementations • 23 Jan 2024 • Hyeonwoo Kim, Sookwan Han, Patrick Kwon, Hanbyul Joo
One of the major challenges in AI is teaching machines to precisely respond and utilize environmental functionalities, thereby achieving the affordance awareness that humans possess.
no code implementations • 23 Aug 2023 • Sookwan Han, Hanbyul Joo
We present multiple strategies to leverage the synthesized images, including (1) the first method to leverage a generative image model for 3D human-object spatial relation learning; (2) a framework to reason about the 3D spatial relations from inconsistent 2D cues in a self-supervised manner via 3D occupancy reasoning with pose canonicalization; (3) semantic clustering to disambiguate different types of interactions with the same object types; and (4) a novel metric to assess the quality of 3D spatial learning of interaction.
Common Sense Reasoning Human-Object Interaction Detection +1
1 code implementation • ICCV 2023 • Byungjun Kim, Patrick Kwon, Kwangho Lee, Myunggi Lee, Sookwan Han, Daesik Kim, Hanbyul Joo
We propose a 3D generation pipeline that uses diffusion models to generate realistic human digital avatars.
no code implementations • ICCV 2023 • Sookwan Han, Hanbyul Joo
We present multiple strategies to leverage the synthesized images, including (1) the first method to leverage a generative image model for 3D human-object spatial relation learning; (2) a framework to reason about the 3D spatial relations from inconsistent 2D cues in a self-supervised manner via 3D occupancy reasoning with pose canonicalization; (3) semantic clustering to disambiguate different types of interactions with the same object types; and (4) a novel metric to assess the quality of 3D spatial learning of interaction.
Common Sense Reasoning Human-Object Interaction Detection +1