A 2-week deep dive into Sora’s world of AI deepfakes

A 2-week deep dive into Sora’s world of AI deepfakes


[KENNEDY FELTON | LIFESTYLE CORRESPONDENT]

I KNEW IT WASN’T GOING TO WORK! OK — YOU CAUGHT ME. NO, THAT WASN’T SAM ALTMAN FILLING IN FOR ME — BUT IT WAS A VIDEO I CREATED USING OPEN AI’S NEW SORA 2 APP.

THE TERM “DEEPFAKE” FIRST POPPED UP BACK IN 2017 – COINED BY A REDDIT USER WHO USED A-I TO SWAP CELEBRITY FACES INTO EXISTING VIDEOS.

SINCE THEN, GENERATIVE AI HAS EVOLVED FAST — FROM IMAGE APPS LIKE MIDJOURNEY TO VIDEO CREATORS LIKE SORA — A NEW INVITE-ONLY SOCIAL PLATFORM WHERE EVERY CLIP IS COMPLETELY AI GENERATED. IT SURPASSED ONE MILLION DOWNLOADS DURING ITS FIRST WEEK.

PEOPLE OFTEN TELL ME I’M A WOMAN OF MANY TALENTS…I MEAN, DID YOU SEE MY RECENT APPEARANCE AT FASHION WEEK?

PRETTY GOOD, RIGHT? I HAD TO REDEEM MYSELF AFTER A FAILED TIME TRAVEL EXPERIMENT THAT SOMEHOW BECAME A BIG BUDGET MOVIE.

AND YES – I EVEN FILMED A NEW COOKING SHOW LAST WEEK. WELL – SORA DID.

YOU CAN CREATE JUST ABOUT ANYTHING ON THE APP. EVEN THE ANIMATION SORA 2 CREATES LOOKS PROFESSIONALLY MADE.

SURE — SOME OF THE SO-CALLED “AI SLOP” LOOKS FAKE… BUT A RECENT POLL FOUND MORE THAN 50% OF PEOPLE AREN’T CONFIDENT THEY CAN DETECT WHETHER SOMETHING IS MADE BY AI OR A HUMAN.

AND WHILE MOST OF THE AI , ESPECIALLY ON SORA 2, IS MADE TO BE COMICAL, THE SILLY CAN SOMETIMES HAVE SERIOUS CONSEQUENCES.

[David Gunkel | Professor, Northern Illinois University]

“There was a very famous robo call that used the voice of Joe Biden to try to convince voters in New Hampshire and Vermont not to go and vote, and that was manipulated by the other side to try to manipulate the election.”

Northern Illinois University PROFESSOR DAVID GUNKEL SAYS THE BIGGEST DANGER IS DECEPTION — AND OUR LAWS AREN’T READY FOR IT.
[GUNKEL]

“This technology moves at light speed. Law and policy move at pen and paper speed. So we are always playing catch up. We are always trying to make existing laws fit novel circumstances, and then trying to write new laws to cover unanticipated opportunities and challenges that these technologies make available to us.”

[FELTON]

BUT GUNKEL SAYS GENERATIVE A-I ISN’T SO MUCH A TURNING POINT AS IT IS AN EVOLUTION OF THINGS THAT HAVE BEEN HAPPENING FOR YEARS.
IN PHOTOGRAPHY, FOR INSTANCE, YOU CAN CAPTURE SOMETHING REAL, OR YOU CAN USE LIGHTING, ANGLES AND EDITING TO CREATE A REALITY THAT DOESN’T EXIST. AI, HE SAYS, IS JUST THE NEXT STEP IN THAT EVOLUTION — ANOTHER TOOL THAT BLURS THE LINE BETWEEN WHAT’S REAL AND WHAT’S MADE.

DOZENS OF LAWSUITS ARE NOW TESTING THOSE BOUNDARIES. IN A RECENT WIN FOR AUTHORS, AI COMPANY ANTHROPIC AGREED TO PAY $3,000 FOR EACH OF AN ESTIMATED HALF-MILLION BOOKS USED TO TRAIN ITS MODELS WITHOUT PERMISSION.

EVEN AS APPS TRY TO LIMIT ABUSE, THEIR OWN RULES ARE RAISING EYEBROWS. SORA 2’S STRICT CONTENT FILTERS BLOCK CERTAIN REQUESTS AND HAVE BECOME A RUNNING JOKE ON THE APP.

[AI GENERATION OF BOB ROSS]

“Put a nice little tree – what is this? It won’t let me paint! I’m coming for you, Sam Altman.”

[FELTON]

EVEN I WAS FLAGGED FOR VIOLATING THE TERMS AND CONDITIONS. WHEN I INSTRUCTED SORA TO INSERT MY LIKENESS INTO A WORKOUT CLASS, IT FLAGGED ME FOR “DEPICTIONS OF TEENS AND CHILDREN.” GUESS THAT’S A COMPLIMENT — MAYBE I SHOULD DO A STORY ON MY SKINCARE ROUTINE NEXT. ANYWAY, EVEN OPEN AI DIDN’T REALIZE HOW BIG OF A PROBLEM THESE FLAGGED REQUESTS WOULD BE.

BUT NOT EVERYONE FINDS THE APP FUNNY. YOU JUST SAW ARTIST BOB ROSS IN A VIDEO SOMEONE CREATED. OTHER PUBLIC FIGURES LIKE ROBIN WILLIAMS AND DR. MARTIN LUTHER KING JR. ARE BEING RECREATED — WHICH ISN’T AGAINST THE TERMS OF SERVICE SINCE DECEASED FIGURES AREN’T PROTECTED.

[AI GENERATION OF KING]

“THIS… IS THE DREAM.”

IT’S PROMPTING BACKLASH FROM THEIR FAMILIES.

ROBIN WILLIAMS’ DAUGHTER ZELDA POSTED ON INSTAGRAM BEGGING PEOPLE TO STOP SENDING HER A-I VIDEOS OF HER FATHER. SHE SAID THAT “To watch the legacies of real people be condensed down to ‘this vaguely looks and sounds like them so that’s enough’, just so other people can churn out horrible TikTok slop puppeteering them, is maddening.”

MARTIN LUTHER KING JR.’S DAUGHTER, BERNICE KING, ECHOED THOSE CONCERNS ONLINE, URGING PEOPLE TO STOP.

[Madeline Salazar | AI Content Creator]

“There’s less of a risk of creating scary, hyperrealistic, deep fakes that damage reputations or cause disruption, because they’ve implemented a lot of these safety guardrails to make it lean funny.”

[FELTON]

WHILE SAFETY GUARDRAILS HAVE REDUCED THE AMOUNT OF INAPPROPRIATE CONTENT, NOT EVERYONE’S USING THE TECH RESPONSIBLY.
SOME USERS ARE PUSHING THE LIMITS BY MAKING inappropriate or sexualized content, AND THAT’S BECOMING A WHOLE OTHER ISSUE IN ITSELF – PORN AI.

[SALAZAR]

“Somebody was making all these videos of me and my clones, like hanging out, which I thought was so funny at first. And then I see more and more videos, and he’s trying to make my clones, like make out. And he does this with a lot of girls, and you can read their prompts trying to get around these guardrails, because you can get around anything. It’s the internet. And to confuse an AI is not that hard.”

[FELTON]

CURRENTLY, NOT ONLY ARE THERE NO FEDERAL REGULATIONS GOVERNING GENERATIVE AI, BUT IT’S UNCLEAR WHO WOULD BE HELD RESPONSIBLE IF SOMETHING HARMFUL HAPPENS. GUNKEL SAID WE’LL LIKELY SEE A LAWSUIT OVER THE NEXT FEW YEARS ON THE TOPIC.

[GUNKEL]

“Usually, when you use a tool to do something, it is the user of the tool, and not the tool or the manufacturer of the tool, who is held accountable for the good or bad outcomes. But we are seeing this as a kind of moving target.”

WHILE THE TECHNOLOGY MIGHT BE SCARY, AI’S BEING WEAVED INTO OUR DAILY LIVES MORE AND MORE. GUNKEL WANTS TO REMIND PEOPLE THAT THIS SORT OF PUSHBACK HAPPENS ANYTIME SOMETHING NEW IS INTRODUCED.

CASE IN POINT: SOCRATES ONCE CAME OUT AGAINST WRITING WHEN IT WAS FIRST INTRODUCED, BECAUSE HE THOUGHT IT WOULDN’T BE AN EFFECTIVE MEANS OF COMMUNICATING KNOWLEDGE.

[GUNKEL]

“We are only three years out from ChatGPT being released. That’s really early on in a new technology. And if there is a lot of hyperbole on both sides of the debate, people are really excited about it, people are really afraid of it. That’s par for the course. We’ve been here before, and I think it is a matter of some thoughtful response to this technology, some critical perspective and recognition that, you know, we’ve done this before, and we can be confident in the face of these new challenges.”

[FELTON]

SO FOR NOW, SAM ALTMAN WON’T BE FILLING IN FOR ME.

BUT IF MY AI TWIN STARTS REPORTING FROM CABO, DON’T SAY I DIDN’T WARN YOU.



Content Curated Originally From Here