November 9, 2022
Dr. Dmitriy Starson, CEO of Passio Inc.
As AI and AR technologies continue to advance, the possibilities for creating unique and immersive user experiences are endless. These technologies enable highly personalized, contextually aware, and intelligent experiences that were not possible just a few years ago.
One example of how these technologies are transforming the way we interact with the world is in the realm of home decoration and remodeling. In the past, if you wanted to repaint your house, you would need to go to a store and browse through paint samples, talk to a professional home decoration expert, and look through pictures of different styles on social media platforms like Pinterest or Instagram.
Today, with the help of AI and AR, you can use your tablet, phone, or smart glasses to see your room as it is, and with just a few gestures, you can change the color of your walls, move and swap furniture, see prices for a wide range of remodeling products in real-time, and even find products to fix cracks in your ceiling. You can choose from a selection of products or select a template provided by an influencer or your favorite brand, or even draw inspiration from a movie or TV show. Imagine applying a Harry Potter world filter to your kid's bedroom and seeing all the products you need to accomplish the remodel, along with prices, implementation steps, and lists of contractors who can make your vision a reality.
Today, we are already seeing the starting point of this future with Amazon’s Shopping app being able to offer live AR previews of many of their products, IKEA offering AR assembly instructions, Primer app starting to show the future of AR paint selection process and Passio’s pioneering work with Jazeera Paints enabling new levels of fidelity and quality in AR/AI-driven paints shopping. However, today’s experiences are highly limited. For example, Amazon’s AR previews are almost completely ignorant of the surroundings and often drop objects right in the middle of existing objects and the painting experiences in Primer are often struggling with occlusions and bad lighting. These challenges are pretty universal and are being addressed right now through both software and hardware advancements.
In the video below you can see glimpses of the amazing future and the extraordinary AR experiences enabled by Passio today! You can also see some of the challenges we are working on right now as we are building the future of AR/AI-driven retail with our amazing partners.
But the really exciting time of these experiences is still in front of us. At Passio, we are excited to be building the future where paints and home remodeling stores exist within a virtual world known as a metaverse and the shopping experiences can seamlessly move from VR stores to digital twins of user homes, to AR and Mixed Reality experiences where users can view their remodeled homes in real time.
In a not so distant future, you will be able to put on a headset or use an app on your mobile device to fully scan your surroundings and create a digital twin of your room or of your entire house. You can jump into that digital twin in a VR headset such as Meta Quest and remodel your entire room there. With the scanning and computer vision tools we are developing at Passio we believe soon all objects in your house can be recognized and digitally recreated in a digital twin so that you can effortlessly interact with them in VR/AR. After you remodel your room in VR, you will be able to seamlessly see the results of the remodel in Augmented Reality through your phone or AR glasses similar to NReal or a more advanced headset similar to Meta Quest Pro or Varjo XR3.
But visualization is just a part of the future we are building. In addition to the products on offer, customers will also be able to access a range of virtual home remodeling tools and resources. For example, they may be able to use virtual design software to visualize how different products will look in their own home, or they may be able to access virtual tutorials and guides to help them with their project. And beyond that we are planning a full AR/VR avatar powered by large language models that can serve as a personal remodel concierge and guide helping you with our remodel needs and inspiring you with creative ideas, product demos and style examples. In some cases the avatars may represent your local paints store or they may be created by an influencer or they may represent a home decor brand. Please sign up for our updates to learn more about this future in the upcoming posts.
Open your first AI-powered AR/VR store, sell paints, flooring, and other home remodel products, help your customers visualize your products in their homes.