HomeNewsDesign and computer science together in a creative way

Design and computer science together in a creative way

The speed with which recent technologies come onto the market is nothing in comparison with the speed with which talented researchers find creative ways to make use of them, train them, even transform them into things without which we cannot live. Such a researcher is Mad Mad Fellow Alexander Het KyawA doctoral student who pursues a double master's degree in architecture studies in calculation and electrical engineering and computer science.

Kyaw occupies technologies corresponding to artificial intelligence, augmented reality and robotics and combines them with gestures, language and object recognition to create human AI workflows which have the potential to interact with our built environment, to alter how we shop, design complex structures and create physical things.

One of his latest innovations is the curator AI, for whom he and his with -doktor partner have won the primary prize -26,000 US dollars at Openai products and money on the KI -Build -at the KI -Build: Generative Voice Ai Solutions, a one -week hackathon on with final presentations in New York City. In cooperation with Kyaw, Richa Guppa (architecture) and Bradley Bunch, Nidhish Sagar and Michael were won – all from the with Department of Electrical Engineering and Computer Science (EECS).

The Curator AI is designed in such a way that you just optimize online furniture purchases by providing context-related product recommendations with AI and AR. The platform uses AR to make use of the scale of a room with windows, doors and existing furniture. Users can then speak to the software to explain which recent furnishings you wish, and the system uses a vision-language AI model to go looking for and indicate various options that correspond to each the user's input requests and the visual properties of the space.

“Buyers can select from the proposed options, visualize products and use natural language to ask for changes to the search, which makes the choice process for furniture more intuitive, more efficient and more personalized,” says Kyaw. “The problem we would like to resolve is that almost all people have no idea where to start out when establishing a room. That is why we developed the curator for the AI ​​to offer intelligent, context -related recommendations based on the looks of their room.” Although curator AI was developed for furniture purchases, it could possibly be expanded to be used in other markets.

Another example of Kyaw's work is the estimate, a product that he and three other doctoral students created in the course of the hackathon with Sloan Product Tech Conference in March 2024. The focus of this competition was to assist small firms. Kyaw and the team decided to support their work on painting in Cambridge, which employs 10 employees. AR and an object identification AI technology uses estimate to take the precise measurements of a room and to create an in depth cost estimate for renovation and/or painting. It also uses generative AI to display pictures of the room or the rooms what they may appear to be after painting or renovating, and creates an invoice as soon because the project has been accomplished.

The team won this hackathon and 5,000 US dollars in money. Kyaw's teammates were Guillaume Allegre, May Khine, and Anna Mathy, all of whom accomplished in 2024 with their degree with Master's degrees in economic analyzes.

In April, Kyaw will give a TEDX lecture on his Alma Mater, Cornell University, wherein he’ll describe curator AI, estimate and other projects that use AI, AR and robotics to design and construct things.

One of those projects is illog for which Kyaw AR has connected with gesture recognition to create software, take the entries from touching a fingertip on the surface of a cloth and even within the air to map the scale of constructing builders. In this fashion, INFOG got here – a highly towering art sculpture made from ash protocols that stands on the Cornell Campus.

Play video

Gesture recognition for feedback-based mixed reality and robot production of the INFOG Tower
Video: Alexander Het Kyaw

Unlog is the chance that structures will be built directly from a complete protocol as an alternative of constructing the minutes right into a picket mill or two to 4 after which being sent to a wholesaler or retailer. It is a superb representation of Kyaw's wish to make use of constructing materials in a more sustainable way. A paper about this work “Gestural detection for feedback-based mixed reality production A case study of the INFOG Tower”Was published by Kyaw, Leslie Lok, Lawson Spencer and Sasa Zivkovic within the Proceedings of the fifth International Conference on Computer Design and Robot production in January 2024.

Another system that has developed Kyaw integrates physics simulation, gesture recognition and AR to design lively bending structures that were built with bamboo poles. With the gesture recognition, users can manipulate digital bamboo modules in AR, and the physics simulation is integrated to visualise how the bamboo bends and where the bamboo rods are to be attached in a way that creates a stable structure. This work appeared within the forty first and research of the forty first and research in computer -aided architectural design in Europe in August 2023 as “Active bend within the physics -based mixed reality: the design and the production of a reconfiguring modular bamboo system. “”

Kyaw threw the same idea with the assistance of bamboo modules to create provision structures corresponding to MITDESIGNX last 12 months, a with -Mad program that selects promising startups and offers coaching and funds for the beginning. Kyaw has founded since then Bendshelters To construct the prefabricated, modular bamboo accommodation and customary rooms for refugees and displaced people in Myanmar, his home country.

“Where I grew up in Myanmar, I saw many day by day effects of climate change and extreme poverty,” says Kyaw. “There is a large refugee crisis within the country and I would really like to take into consideration how I can return to my community.”

His work with Bendshelters was well recognized by Sandbox, PKG Social Innovation Challenge and the Prize of Amazon Robotics for Social Affairs.

On MIT works along with Professor Neil Gershenfeld, the director of the Center for Bits and Atoms, and Miiana Smith to make use of speech recognition, 3D-generative AI and robotic arms to create a workflow that may create objects in an accessible, excessive and sustainable way. Kyaw keeps Bachelor's degrees in architecture and computer science from Cornell. Last 12 months he was awarded an Sja scholarship from the Steve Jobs Archive, which financed projects on the interface of technology and art.

“I enjoy researching various kinds of technologies to design and do things,” says Kyaw. “As a part of MAD, I thought of how all my work connects and my intentions to make clear. My research vision is to design and develop systems and products that enable natural interactions between people, machines and the world around us.”

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Must Read