RizzGPT smart glasses listen to your conversations and tell you what to say in real-time

May 2024 · 6 minute read

Do you get tongue-tied when your Hinge date asks you about your five-year plan? Or when an interviewer asks you why you want the job, because you can't say 'money'?

Well, set that deodorant aside, as student engineers from Stanford University have created you a solution - smart glasses that tell you exactly what to say.

Dubbed 'RizzGPT' - where 'rizz' refers to one's ability to seduce a romantic interest, similar to charisma - the specs display responses as text in front of your eyes.

A microphone picks up on what a speaker has said, and the glasses use ChatGPT - the chatbot powered by artificial intelligence (AI) - to generate potential replies.

They use augmented reality (AR) technology to allow the user to see the text and the person in front of them simultaneously.

Student engineers from Stanford University have developed smart glasses (pictured), dubbed 'RizzGPT', that tell you exactly what to say during tricky conversations

Student engineers from Stanford University have developed smart glasses (pictured), dubbed 'RizzGPT', that tell you exactly what to say during tricky conversations

A microphone picks up on what a speaker has said, and the glasses use ChatGPT - the chatbot powered by artificial intelligence (AI) - to generate potential replies in augmented reality

A microphone picks up on what a speaker has said, and the glasses use ChatGPT - the chatbot powered by artificial intelligence (AI) - to generate potential replies in augmented reality

say goodbye to awkward dates and job interviews ☹️

we made rizzGPT -- real-time Charisma as a Service (CaaS)

it listens to your conversation and tells you exactly what to say next 😱

built using GPT-4, Whisper and the Monocle AR glasses

with @C51Alix @varunshenoy_ pic.twitter.com/HycQGGXT6N

— bryan chiang (@bryanhpchiang) March 26, 2023

The RizzGPT glasses were unveiled on Twitter last month by student Bryan Hau-Ping Chiang.

HOW DO THE GLASSES WORK? 

The glasses have a monocle-like display fixed to one of the lenses, which contains a camera and microphone.

The microphone detects the audio and sends it over to a phone connected via Bluetooth, which subsequently uses Whisper voice recognition software to turn it into text.

This text gets fed to GPT-4, an AI chatbot, which generates a response, and this is sent back to the RizzGPT lens to be displayed in AR. 

<!- - ad: https://mads.dailymail.co.uk/v8/us/sciencetech/none/article/other/mpu_factbox.html?id=mpu_factbox_1 - ->Advertisement

He wrote: 'Say goodbye to awkward dates and job interviews

'We made rizzGPT - real-time Charisma as a Service (CaaS) it listens to your conversation and tells you exactly what to say next.

'Built using GPT-4, Whisper and the Monocle AR glasses.'

GPT-4 is the latest version of the large language model ChatGPT, and is even more powerful than the original, while Whisper is a voice recognition tool.

Monocle AR is a technology developed by Brilliant Labs, which also built and donated the monocle-like display that is fixed to one of the lenses. 

This monocle contains a camera and microphone, and displays the text over the top of what the wearer can see in real time.

The microphone detects the audio and sends it over to a phone connected via Bluetooth, which subsequently uses Whisper to turn it into text.

This text gets fed to GPT-4 which generates a response, and this is sent back to the RizzGPT lens to be displayed in AR. 

'All of this happens while the user still looks engaged + attentive in the conversation! There's zero context switching,' tweeted Mr Chiang.

The developers say the glasses are able to recognise when a question has been asked and produce potential answers within seconds.

They are reminiscent of 'Google Glass', the head mounted display that could display information alongside what the wearer sees.

These have now been discontinued and are generally regarded to be a failure from the tech giant.

A microphone detects the audio and sends it over to a phone connected via Bluetooth, which subsequently uses Whisper to turn it into text. This text gets fed to GPT-4 which generates a response, and this is sent back to the RizzGPT lens to be displayed in AR

A microphone detects the audio and sends it over to a phone connected via Bluetooth, which subsequently uses Whisper to turn it into text. This text gets fed to GPT-4 which generates a response, and this is sent back to the RizzGPT lens to be displayed in AR

The developers say the glasses are able to recognise when a question has been asked and produce potential answers within seconds

The developers say the glasses are able to recognise when a question has been asked and produce potential answers within seconds

They are reminiscent of 'Google Glass' (pictured), the head mounted display that could show information alongside what the wearer sees. These have now been discontinued and are generally regarded to be a failure from the tech giant

They are reminiscent of 'Google Glass' (pictured), the head mounted display that could show information alongside what the wearer sees. These have now been discontinued and are generally regarded to be a failure from the tech giant

In the demo video posted to Twitter, Stanford instructor Alix Cui speaks to student Varun Shenoy, who is wearing the RizzGPT glasses.

Mr Cui says: 'Hi Varun, I hear you're looking for a job to teach React Native.'

After a few seconds, a response is generated, and Mr Shenoy reads it out loud.

He says: 'Thank you for your interest. I've been studying React Native for the past few months and I am confident that I have the skills and knowledge necessary for the job.'

As well as those nerve-wracking first dates, the students hope their device could help those with social anxiety and who struggle with public speaking.

Mr Chiang tweeted: 'We imagine a new era of ambient computing enabled by AR + AI, where everyone has their own personal assistant available 24/7. it's like having God observe your life and tell you exactly what to do next.'

He has since updated the specs with LifeOS, a system that recognises faces and then displays relevant information next to them based on texts you've sent to each other.

'The interplay of AI and AR will redefine personal computing and help us unlock our full potential,' he tweeted.

meet lifeOS: an operating system for your entire life 🌐

a personal AI agent delivered directly through AR smart glasses 👓

it uses computer vision to 👁️recognize👁️ your friends’ face

then brings up relevant details to talk about based on your texts with them (memory🤯) pic.twitter.com/BgCuODV4k2

— b (@bryanhpchiang) April 10, 2023

Smart glasses turn audio into captions to let deaf people 'SEE' conversations 

While smart glasses were once constrained to the world of science fiction, brands ranging from Snapchat to Facebook have released their own devices in recent years.

Now, a new pair of smart glasses has been launched for people who are deaf or suffer from hearing loss.

The glasses, called XRAI Glass, use augmented reality to transform audio into captions that are instantly projected in front of the wearer's eyes.

'We are so proud of the ability of this innovative technology to enrich the lives of people who are deaf and have hearing loss, so that they can maximise potential,' said Dan Scarfe, XRAI Glass CEO.

'Whether that means being able to have a conversation while continuing to make dinner or keeping a conversation going while walking with a friend.'

Read more here 

ncG1vNJzZmivp6x7pa3IpbCmmZmhe6S7ja6iaKuTnrKvr8StnJygX5a%2FtbXCpZxmaWJlf3Z8mGxmi6Gqr5SRoIyspJqqpGK0ra3SrJysZZyewLWxzWaaqKammr%2B0rdOipqerXamyrbiMrJiyZaKarq1506KknmaYqbqt