AR/VR Games | Online Workshop | English | Asia-Pacific
Description:
In Yu Hong’s virtual reality work（2017）， the artist places the viewer in the middle of four moments, traveling through the life of a female character from her birth to her old age. The narrative follows differing timelines as the protagonist's life and aging move forward while history goes backward. Is it true that immersive technologies will increasingly replace analog surroundings with virtual data rooms, radically changing the way that we interact socially? Or is it possible it could present us with a new way to construct or reconstruct the surroundings and hone in on a more niche and personal narrative?
In this workshop, you will form several descriptive scenes of domestic spaces with a timeline focusing on the life story of a couple. You will design questionnaires and conduct user interviews to extract the key elements of their home: furniture layout, style, texture, and memory. With the data collected, you will relocate the scanned objects in their home in the virtual environment with the texture and image inputs augmented and rebuilt by generative AI.
In the data collection, we will generate four scenes expected from the couple’s narrative scenario:
When we met: the homes of their own when they met each other (3d scanned objects with generated texture and scene)
When we became a couple: the home we first moved in together (3d scanned objects with generated texture and scene)
Now: the home where we are living now (3d scanned )
Future: the home we imagine we will live at someday in the future (generated object, texture, and scene)
In the forthcoming process, domiciliary structures will be produced through the utilization of 3D photogrammetric scanning techniques, employing either Metashape or Polycam in conjunction with Stable Diffusion AI Tools (ComfyUI). The resultant three-dimensional representations of domiciles will be further integrated into the Unity framework and interfaced with virtual reality (VR) apparatus, namely the Oculus Quest 2 or 3. Subsequently, the evaluation of the efficacy and user acceptance of the designed and synthesized domiciliary constructs will be conducted through conclusive interviews and structured questionnaires.
Key Words:
3D Scan,VR,AI,
Required Skills:
Basic understanding of VR and AI
Required Software:
Agisoft Metashape (macOS/Windows), Unity (macOS/Windows), Adobe Premiere (macOS/Windows)
Required Hardware:
Laptop or PC supporting the mentioned software. We would recommend students purchase one of the VR devices and physiological sensors. VR Option 1: Google VR Cardboard; VR Option 2: Oculus Quest 2.
Maximum number of participating students:
15
In this workshop, you will form several descriptive scenes of domestic spaces with a timeline focusing on the life story of a couple. You will design questionnaires and conduct user interviews to extract the key elements of their home: furniture layout, style, texture, and memory. With the data collected, you will relocate the scanned objects in their home in the virtual environment with the texture and image inputs augmented and rebuilt by generative AI.
In the data collection, we will generate four scenes expected from the couple’s narrative scenario:
When we met: the homes of their own when they met each other (3d scanned objects with generated texture and scene)
When we became a couple: the home we first moved in together (3d scanned objects with generated texture and scene)
Now: the home where we are living now (3d scanned )
Future: the home we imagine we will live at someday in the future (generated object, texture, and scene)
In the forthcoming process, domiciliary structures will be produced through the utilization of 3D photogrammetric scanning techniques, employing either Metashape or Polycam in conjunction with Stable Diffusion AI Tools (ComfyUI). The resultant three-dimensional representations of domiciles will be further integrated into the Unity framework and interfaced with virtual reality (VR) apparatus, namely the Oculus Quest 2 or 3. Subsequently, the evaluation of the efficacy and user acceptance of the designed and synthesized domiciliary constructs will be conducted through conclusive interviews and structured questionnaires.
Schedule:
Jun 29 - Jul 7
-
Day 1 / Jun 29
-
Day 2 / Jun 30
-
Day 3 / Jul 1
-
Day 4 / Jul 2
-
Day 5 / Jul 6
-
Day 6 / Jul 7
Instructors:
-
Han Tu MIT,ResearcherHan is a SMArchS candidate in Design & Computation and Computer Science at MIT. She received a Diploma in Architecture from Tongji University and a Master of Architecture and a big data program from Tsinghua University. She is a researcher with an extensive background in programming and computational design. Aspiring to leverage programming and computer science skills to revolutionize physiological sensing in VR. -
Yiqing Wang Massachusetts Institute of Technology,MArch GraduateYiqing is an architect born and raised in Shanghai and achieved an M.Arch degree from MIT. She achieved a B.Arch degree from Tongji University and worked for several architectural firms. Her skills include painting, making, advanced architectural design, and prototyping. Her projects focus on narratives, context, structure, and tectonics, and she is interested in materiality, perception, and representation. Currently, she is interested in materials, sustainability, automation, and robots and their intersection with architecture and design. -
wangli yi Massachusetts Institute of Technology,graduate studentHi! I'm Wangli Yi, a computational designer. I am currently pursuing SMArchS degree in Design and Computation at MIT. Fueled by a passion for human-centered design, my interests encompass Artificial Intelligence, UX Design and Research, Interior Design, Furniture Design, Shape Grammar, Psychology and Carpentry. Focusing on enhancing well-being and user experiences, I strive to create innovative physical and digital solutions that enrich people's lives. -
Chenyue Dai Massachusetts Institute of Technology,Graduate studentChenyue is a Master of Architecture student at Massachusetts Institute of Technology with the class of 2026. Before coming to MIT, he aquired Bachelor in computer science at City University of Hong Kong, where he was a member of the university's programming contest team, winning multiple medals in ICPC and CCPC. Supported by advanced algorithms, his works actively seek interdisciplinary practices between architecture, photography and new media art. Besides, he works closely with peers and professors in various fields including art, game development and human-computer interaction. -
Jingfei Huang Harvard University,MDE CandidateJingfei is an MDE candidate at Harvard University. She received her Bachelor's degree in the Architecture program at Pratt Institute. Her work experience includes research at SUSTech and UABB, and architectural design works in firms across Japan and China. Her projects explore large-scale measurements of emotion perception in the urban context, procedural formation of the virtual environment, visualization of olfaction, fabrication, and sustainable strategies in architecture design and computation design areas. -
Jinyue Wang Cornell University,Graduate StudentJinyue is a multimedia designer from Shanghai and is currently an MS candidate in computational design at Cornell University. With a Bachelor of Fine Art in Design from the University of Texas at Austin, her research encompasses human-animal relationships, human-computation interaction, artificial intelligence, visual communication, and UX design. She hopes to contribute to responsive design that optimizes either conspecific or allospecific conversation and crafts a conscious and harmonious environment with the power of technology. -
Xinyue Cui Communication University of China,graduateI am a graduate of the Communication University of China majoring in Digital Media Arts. My research focuses on AI and human interaction. Now I am going to get a master degree in Upenn, I will delve into the application of AI and game design in education. -
LINGKAN WANG Carnegie Mellon University, HCII Metals candidateHi! I'm Lingkan Wang, I am a HCII Metals candidate at CMU. Designing with consideration for the cognitive characteristics of diverse populations has always been a guiding interest in my work. My research focus on developing products that cater to a wide range of user needs, utilizing cost-effective and widely accessible technologies. Moving forward，I will delve deeper into making technology more universally accessible, reduce research biases in technology design, and enhance the credibility of research in this field. -
Haowei Xiong University of the Arts London,graduateHaowei (Sowilo) is an XR developer and artist who graduated from the MA VR program at the University of the Arts London. She focuses on interaction and tracking technologies in the fields of XR film and gaming, pursuing the integration of art, technology, and sensory experiences. Currently, she is developing a VR multiplayer storyboard software. In the future, she hopes to expand the artistic boundaries of VR through her theoretical research and technical development, and to lower the artistic entry barriers for VR. -
Yichao Shi Georgia Institute of Technology,PhD StudentYichao Shi is a dedicated PhD student in the Architecture Design Computation program at Georgia Institute of Technology. With a strong academic background, Yichao earned a Bachelor of Engineering degree in Architectural Engineering from Tongji University and an M.Arch in Architectural Design from University College London (UCL). Yichao's research interests encompass shape syntax in architectural design, digital heritage, computer graphics, cognitive science, and human-computer interaction. Having gained valuable experience as a teaching assistant in courses such as D&R Studio: Landhuggers, Yichao is an active member of the Shape Computation Lab at Georgia Tech. Additionally, Yichao serves as a Graduate Research Associate in the Flourishing Communities Collaborative Lab, where they work to advance the field of architecture through innovative research and collaboration.