ME.gic.LO.gic

“About”

Human Computer/AI Interaction
“Bridge as an Astryn”

  1. Anemoia ( AI Fragrance System )
  2. Togetherverse ( Multiplayer co-presence XR platform )
  3. Lucid Prism ( MR LLM-Based Multi-Modal Agent System )
  4. Astronia ( AI 3D-Scan & Art Generation & Projection System )
  5. RhinoAI ( LLM-Based 3D Modeling Assistant )
  6. Vetroverse ( VR Game & Film )
  7. EMO機"jī" ( Motion & Emotion H:M:M:H Interaction System )
  8. Echoes ( AI Music Interaction System )
  9. Shake It Off ( Functional Absurdity )


Architecture / Installation
“Rationale”

  1. Shadow-Less ( A ML system for Shadow as a Catalyst for Design )
  2. Garden of Sacredness ( Urban Renewal )
  3. Forest ( Modular Infrastructure for Community and Sustainability )
  4. Invasive Species ( Vertical Garden: A Living Archive )
  5. Parametricism Mortise and Tenon


Photography
“Innerpeace”

  1. Prelude - 6am
  2. Fugue - 9am
  3. Improvisation - 4pm
  4. Waltz - 6pm
  5. Fantasia - 8pm
  6. 2024 Outro


Read more →

4. Astronia:  An AI-driven 3D-Scan, Drawing, and Projection MR System

24 Fall, Harvard University. With Qingyun Liu.






                -  Marshall McLuhan

"All media are extensions of some human faculty—psychic or physical."



Astronia is a mixed-reality system that redefines the connection between the physical and digital worlds. Drawing inspiration from McLuhan's concept of media as “extensions of man,” Astronia integrates advanced hardware and software to create seamless, immersive interactions. Its name, derived from the Latin astrum meaning “star,” symbolizes its mission to guide users across the tangible and virtual realms with unprecedented precision.



At its core, Astronia features a powerful software system capable of automating background removal, transforming 2D images into 3D models, and projecting virtual designs into reality. This dual-process framework not only digitizes physical objects but also reintroduces virtual elements into real-world environments. A robust drawing module, powered by ControlNets and Flux APIs, enables users to refine virtual creations with intuitive sketches. The system also includes a real-time reality indicator that dynamically highlights physical objects ready for augmented projection within the user’s environment.



The hardware comprises a wearable glove equipped with an ESP32S modular camera for wireless image capture, a rotary encoder for gesture-triggered commands, a Raspberry Pi for managing serial communications, and an integrated projector to visualize outputs for non-headset users. Combined with a VR headset, Astronia facilitates 3D model generation, gesture-controlled drawing, and interactive visualization, empowering users to reimagine their environments effortlessly.




Astronia transforms decision-making and personalization. From envisioning how an art installation would enhance your living space to testing furniture placement in real-time, Astronia merges creativity and technology, making the interaction between physical and virtual worlds intuitive, customizable, and transformative.


Full Documentation: