Live Interior Designer Agent

This was a project that my friends and I built for the Gemini Live Agents Hackathon hosted by Google. The task was to leverage Gemini's cutting edge live API, i.e, the ability to process live camera feed and microphone input in real time, to build an agent that could interact with the user in a way that was never possible before.

We built an interior designer agent that could provide real-time interior design suggestions to users based on their live camera feed and microphone input. The user would simply have to turn on their camera and microphone, and the agent would be able to see their room in real time, understand the current interior design style, and provide suggestions on how to improve it based on the user's preferences.

Finally, the agent would scrape the web to find matching furniture, decor and aesthetic styles to help the user generate a perfect image of their room with the interior style of their choice.

We were surprised by how well the agent was able to understand multi-modal input and provide relevant suggestions in real-time, but we were happy that we went one step beyond just using the live-api and also leverage Nano Banana to generate the most accurate image possible.

We made a video demo that you can watch below.