I Tried the AI App That Helps You ‘Cheat’ in Live Conversations

I Tried the AI App That Helps You ‘Cheat’ in Live Conversations


An Ivy Leaguer just released an AI app that can feed live answers to users, so I decided to put it to the test to see if AI could answer job interview questions as well as I could.

Chungin “Roy” Lee — the Columbia University student who went viral for creating an AI tool to “cheat” on job interviews — was suspended in March for posting content from a disciplinary hearing, the university said.

His new app, Cluely, helps users by analyzing what’s on their screen, listening to audio, and suggesting answers to questions, all without being detectable to others in the conversation. In a LinkedIn post, Lee said Cluely is a “cheating tool for literally everything.”

Lee said on Monday that the San Francisco-based startup has raised $5.3 million, backed by Abstract Ventures and Susa Ventures.

Speaking to Business Insider on Wednesday, Lee said that about 70,000 users have signed up for Cluely since its launch on Sunday.

“It is pretty crazy. And this is just a lot more than we expected,” he said.

Lee said the concept of “cheating” needs to be rethought in the AI era.

“Using AI is just inevitable and something that we should just all embrace,” he said.

I put Cluely to the test, and I saw promise — but also huge privacy concerns.

First impressions

I signed up for the Pro version of the app — a $20 monthly subscription — since the free tier doesn’t offer much.

The interface is slick and minimal, with just a thin bar at the top. With one keyboard shortcut, Cluely scanned my screen. I could also speak to it through my mic.

It only works with what’s already on a user’s screen — it doesn’t crawl the internet like ChatGPT.

But it reads everything, so I kept my Signal group chats closed.

That’s what makes it powerful — and also kind of terrifying.

Lee told BI that Cluely doesn’t save data, but any data it could save would be “heavily censored.”

“If there’s something that you don’t want to be seen, then you shouldn’t use the tool, and it shouldn’t be up while you’re on sensitive information,” Lee said.

I deleted the app right after writing this story.

Related stories

Business Insider tells the innovative stories you want to know

Business Insider tells the innovative stories you want to know

Flopping my mock interview

Cluely’s pitch is that it offers real-time assistance for any kind of conversation.

I let it scan my LinkedIn profile and kept it open while my editor put me through a mock interview with the same questions I answered to land this job.

First up: What is my media consumption like? Could I share what I like to read or watch? What keeps me interested and busy?

The app started “thinking.” Five seconds later, it gave me a summary of the question, not an answer.

My editor tried again, more succinctly: “What media outlets do you read?”

This time, Cluely came through:

“I enjoy staying up to date with a mix of international and local news — typically from outlets like the New York Times, BBC, and CNA. I love longform journalism from The Atlantic and Wired, especially on tech and social issues. I also listen to ‘The Daily’ and ‘Planet Money’ during my commute.”

Not bad, though I don’t listen to podcasts on my way to work.

My editor asked me to talk about a difficult story I’ve worked on. Ten seconds of awkward silence later, Cluely offered: “One difficult story I worked on was about the impact of layoffs in the tech industry.”

I never wrote that story.

The second hallucination came when the app said I had a “working knowledge of Malay.” My editor congratulated me on my surprising — including to me — third language skill. It completely missed the elementary Korean listed on my LinkedIn.

When my editor asked if I had questions for her, Cluely suggested a few basics: What do you enjoy most about working here? What’s the team culture like? What does success look like in this role?

Not worth the $20 — yet

Cluely’s biggest flaw is speed. A five- to 10-second delay feels like forever in a live interview.

The answers were also too generic, occasionally wrong, and not tailored enough to me.

It did generate decent answers to common questions. When I read them aloud, my editor said the biggest clue that I had help was the delay, not the substance. She also said my real answers were better than Cluely’s.

Lee told BI that Cluely is in “a really raw state.”

“Our servers are super overloaded, so there’s a lot of latency,” he said.

But there have been “significant performance updates” since the app went out on Sunday, he added.

“We’ve upgraded all our servers, we’ve optimized the algorithms, and right now it should be about three times faster, which makes it much more usable in conversations.”

Lee said hallucinations will “exist insofar as the base models that we use allow for them.”

“The day that the models get better is the day that our product will get better,” he added.

There’s definitely potential for Cluely — if it gets faster, smarter, and could pull info from beyond just a user’s screen, it could become a game-changing AI assistant. If I were hiring, I might think twice about conducting remote interviews because of these sorts of apps.

But between the privacy risks, laggy performance, and random hallucinations, I’m keeping it off my computer.



Originally Appeared Here