Welcome to the Daily AI News podcast.
Get ready for another deep dive today.
We've got a ton of really cool stories today
from image generation to video understanding
and even chat GPT's been doing some stuff.
But I guess the big theme is how AI models
are interacting with different kinds of data.
Yeah, that's right.
Like video.
Yeah, it's always been pretty tricky for AI
to really process and understand video content.
So seeing progress in that area is really exciting.
Okay, so let's start with this new research paper
from Metta and Scanford about video understanding
in large multimodal models.
Right, so they basically dug into all these design
and training factors.
Their findings are like gold for optimizing
how these models learn and do their thing.
Okay, so one of their key discoveries
is this scaling consistency.
It's basically like you're trying out a cake recipe
but you don't wanna waste a bunch of ingredients
on a huge cake if it doesn't turn out.
So you make a small test batch first.
That's perfect, yeah.
It's incredibly efficient.
Like why waste time and resources
on training these huge massive models?
When you can figure things out with smaller models
and have confidence, those findings
will translate to the bigger ones.
Yeah, it's like making sure your recipe works
before you go all out.
Okay, so in the paper, they introduced this family
of video language models called Apollo.
Apollo is pretty groundbreaking actually.
It's a big jump forward in video understanding.
Like setting new benchmarks
for how well these models perform.
So what does that actually mean for us non-AI experts?
Well, think about searching for a specific moment
in a video just by describing what happens.
That's the kind of capability Apollo is unlocking.
Oh, wow, so like if I'm looking for the part
in a cooking video where they add the secret ingredient,
I could just type in, show me
when they add the secret ingredient.
Exactly.
Wow, that is super cool.
So there were some pretty interesting details
in the paper too.
Yeah, lots of little things that make a big difference.
Like they found that frames per second sampling
is better than uniform sampling.
And there's also this sweet spot
for the number of tokens per frame,
with 832 being optimal.
Oh, interesting.
And get this, just adding simple tokens
between video tokens from different frames or clips
is enough for efficient integration.
Right, it's like giving the AI little hints
to help it connect the dots.
Yeah, and speaking of things that are coming out right now,
Meta just announced a major update
to their Ray-Ban Meta smart glasses.
They're adding real-time AI video capabilities.
That's pretty awesome.
It's like seeing those cutting-edge research ideas
coming to life right in front of us.
Right, and it's happening so fast.
So what can you actually do with these new glasses?
Well, imagine having ongoing conversations with Meta AI,
but through your glasses.
Oh, wow.
Like it can understand what you're seeing
and provide real-time information.
You can even get real-time translations.
Oh my gosh, like if I was traveling in a foreign country,
I could just look at a sign and it would translate it for me.
Exactly, it's like having a superpower.
It really is.
Okay, let's switch gears a bit
and talk about image and video generation.
Google just released some major updates
with VO2 and Image in Three,
and both of them are achieving state-of-the-art results.
Yeah, they're really pushing the boundaries
of what's possible.
So what does state-of-the-art actually mean?
Well, it basically means these models are creating images
and videos that are more realistic and detailed
than anything we've seen before.
So let's start with VO2.
This was all about video generation, right?
Yeah, and it's not just about creating videos,
it's about understanding them.
Like VO2 can actually understand physics
and human movement.
Oh wow, so it wouldn't create a video
of someone walking through a wall.
Right, it understands how things move
and interact in the real world,
and it can even respond to cinematic prompts
like camera angles and lens types.
Oh, so I could tell it to use a low-angle tracking shot.
Yeah, exactly.
It's like having a virtual film crew at your fingertips.
That is wild, and it produces fewer unwanted details.
Which we call hallucinations in the AI world.
Right, so like if it was generating a video of a cat,
it wouldn't accidentally give the cat
like six legs or something.
Exactly, those weird little glitches
are becoming less and less common.
Okay, so what about image in three?
Image in three is all about image generation,
but it's not just about making pretty pictures,
it's about artistic expression.
Like it can understand different art styles
and render them with incredible accuracy.
Oh, so like if I wanted a picture in the style of Van Gogh.
You could tell image in three to do that,
and it would create something
that looks like a real Van Gogh painting.
That's insane.
And it's not just mimicking existing styles,
it can also blend styles together
and create something entirely new.
So what are some examples of things
Image in Three has created?
It can render a winter wonderland scene with a red squirrel,
or a hyper realistic image of a strawberry sculpted
into a hummingbird, or even bring to life
a foggy 1940s European train station.
Oh wow, that's amazing.
It's really pushing the boundaries
of what we thought was possible with AI.
Okay, so let's move on to a topic
that's near and dear to my heart.
Check GPT.
It seems like it's becoming way more
than just a simple chatbot.
Yeah, OpenAI is definitely positioning it
as a central hub for all sorts of tasks.
Right, so it's not just about writing anymore.
It's also for research, programming, even web search.
It's like an everything app for AI.
Yeah, that's a good way to put it.
So one of the new features is called projects.
Right, it's basically a way to organize your conversations
within chat GPT.
Like having different folders for your various projects.
Yeah, it can be really helpful for staying organized,
especially if you're using chat GPT for complex tasks
or managing multiple things at once.
Okay, that makes a lot of sense.
And speaking of new features,
chat GPT's AI search engine is finally rolling out
to all users.
Yeah, this is a pretty big deal.
It's not just a regular search engine.
It uses AI to understand what you're actually looking for.
So it's like, it can read your mind.
Well, not quite, but it gets pretty close.
It can pick up on subtle cues and nuances
in your search queries to deliver results
that are more personalized and relevant to your needs.
And I heard that the mobile version is really interesting.
Yeah, they actually designed it to look and feel
more like a traditional search engine.
So it has things like images and ratings and...
Maps and directions, all that stuff.
Okay, so why would they do that?
Well, a lot of people are used to traditional search engines.
So it makes sense to create something that feels familiar.
Right, it's like meeting people where they are.
Exactly.
Okay, now let's talk about notebook LM
because there are some exciting updates
to this tool as well.
So remind me again, what is notebook LM?
It's basically an AI-powered research notebook.
So what does that mean?
Well, you can upload documents, summarize key points,
highlight important passages,
and even generate audio overviews of your research material.
Oh, wow.
So it's like having a research assistant
who can do all the heavy lifting for you.
Yeah, that's a good way to think about it.
And they've just released a premium version
called Notebook LM Plus.
Which comes with all sorts of extra features,
like increased usage limits, customization options,
shared team notebooks with analytics,
and even enhanced privacy and security.
Oh, wow, that sounds like a power user's dream.
But wait, it gets even better.
Notebook LM is now integrated with Gemini 2.0 Flash.
That's a huge upgrade.
So what does that mean for users?
Well, during those audio overviews,
you can now interact with AI hosts.
Okay, so I'm listening to a summary of a research paper.
And you can actually pause and ask the AI a question,
like to clarify something or delve deeper
into a specific topic.
Oh, wow, that's amazing.
It's like having a conversation
with the experts who wrote the paper.
That is so cool.
Okay, but not all the news in the AI world
is sunshine and roses.
We need to talk about this legal battle
that's brewing between Elon Musk and open AI.
Yeah, this one's a bit messy.
It's basically a clash of visions about the future of AI.
So Elon Musk was one of the early investors
and board members of open AI, right?
And he's now claiming that the company
has strayed from its original mission.
Which was to develop AI safely and ethically
for the benefit of humanity.
And he's worried that open AI is now more focused
on profits than on ethics.
It's a tricky situation for sure.
So what exactly is Musk alleging?
Well, court filings reveal that Musk's original vision
for open AI was as a nonprofit.
He wanted it to be a force for good in the world.
And he's concerned that the company's shift
to a for-profit model has compromised that mission.
Yeah, he's basically saying that open AI
has betrayed its original principles.
And there are even emails from 2017
showing this tension between Musk and Altman
and the other co-founders over control of the company.
It was a real power struggle.
So it's like a real life drama about the future of AI.
It really is.
It'll be interesting to see how this all plays out.
Definitely.
Okay, let's end on a slightly lighter note.
Ilya Sutskever, a former chief scientist at Open AI,
made a pretty interesting prediction recently.
Yeah, he said that AI with reasoning power
will become less predictable.
Okay, so what does that mean?
Well, as AI models get smarter
and more capable of complex reasoning,
they'll be able to consider millions of possibilities
before making a decision,
which means their actions will become less obvious
and more surprising to us.
So it's like they'll be able to think outside the box.
Exactly.
And that could lead to some really amazing breakthroughs.
But it also raises questions about control
and ensuring that AI remains aligned with human values.
It's like the more intelligent AI becomes,
the less we'll be able to predict what it will do.
Yeah, it's both exciting and a little bit scary.
It's definitely something to think about.
Okay, so let's shift gears one more time
and talk about this new research on best of end jailbreaking.
Okay, so jailbreaking is basically a way to trick a chatbot
into giving you answers it's not supposed to.
Like bypassing the safety protocols.
Exactly.
So is this research saying that it's becoming easier
to jailbreak these AI systems?
Well, they found that the success rate of these attacks
increases with the amount of computing power used.
So basically if you have enough computers,
you can eventually find a way to jailbreak any AI model.
Oh, that's a little unsettling.
Yeah, it's a reminder that we need to be constantly
improving our defenses.
Right, it's like an arms race.
Exactly.
Okay, but the good news is that the company
behind this research, Anthropic,
responsibly disclosed the vulnerability to other AI labs
through the Frontier Model Forum.
Yeah, that's really important for the AI safety community.
We need to be working together
to make these systems more secure.
Totally.
Okay, so for our last story in this part of our deep dive,
let's zoom out and look at the big picture of AI investment.
SoftBank CEO, Masayoshi Sun,
just announced a massive investment plan.
A hundred billion dollars.
Yes, a hundred billion dollars over the next four years
to support AI development in the US.
That's a serious commitment.
So what's behind this big move?
Well, Sun has a history of making bold bets
on emerging technologies,
and he clearly sees AI as the next big thing.
So where's all this money gonna go?
He's focusing on building the core infrastructure
that AI development needs, like data centers,
semiconductor manufacturing,
and even energy infrastructure.
So it's not just about developing new AI models.
It's about creating the ecosystem
that will allow AI to flourish.
And that's it for part one of our AI deep dive.
We've covered a lot of ground today,
from video understanding and image generation,
to the evolving world of chat GPT,
and the big picture trends in the AI landscape.
Yeah, it's amazing how fast this field is moving.
But there is still more to explore.
Be sure to join us for part two,
where we'll continue our journey
through the fascinating world of AI.
I can't wait.
So we were talking about the ethical side of AI
and those potential risks as AI gets more and more powerful.
And this next story really dives into that.
Okay, so this is about a paper exploring something
called best of in jailbreaking, right?
Yes, exactly.
Jailbreaking might sound kind of scary,
but in the AI world,
it's basically about tricking those powerful models.
Oh, so like bypassing those safety protocols
they have in place.
Exactly.
And what's concerning is this research found
that those attack success rates increased predictably
with the amount of computing power used.
So like the more resources an attacker has,
the easier it is to find those jailbreaks.
Right, and that highlights something
we really need to be thinking about.
We need strong defenses,
and we need to make sure they can keep up
with how fast AI is evolving.
Yeah, it's like they're always one step ahead.
Exactly.
And that's why I was happy to see that Anthropic,
the company behind this research,
actually disclosed this vulnerability.
Oh, that's good.
They shared it with other AI labs
through the Frontier Model Forum, right?
Yeah, that kind of collaboration
is so important in the AI community.
It's like we all need to work together
to make sure these systems are as secure as possible.
Okay, so shifting gears a bit,
let's talk about the impact of AI on investments.
Right, SoftBank CEO Masayoshi Sun
just announced this massive $100 billion investment plan.
Wow, $100 billion?
That's a huge number.
What's the thinking behind that?
Well, Sun's known for making big moves in the tech world,
and this shows he's really serious about AI.
So where is all that money going?
He's focusing on the infrastructure AI needs to grow,
things like data centers,
semiconductor manufacturing, and even energy.
So he's really laying the groundwork.
It's a strategic move.
It could really accelerate how AI is used
in all sorts of industries.
It's interesting to see these big investments
shaping the future of AI.
It really does bring up that question
we keep coming back to.
What does all this mean for society?
Yeah, that's a big one.
Okay, let's go back to ChadGPT for a minute.
OpenAI just keeps adding new features, it seems like.
They really want to make ChadGPT more user-friendly
and accessible for everyone.
And one of those updates is projects, right?
Yeah, basically think of it as folders
for your ChadGPT conversations.
Okay, so I can organize my chats by topic or project or...
Exactly, it can really help you stay organized,
especially if you're using ChadGPT
for lots of different things.
Yeah, that makes sense.
I'm always losing track of things.
Well, projects might help with that.
And speaking of new features,
ChadGPT's AI search engine is available to everyone now.
That's exciting news,
this is a pretty big step forward in search.
So what makes it different
from those traditional search engines?
Well, traditional search engines really rely on keywords,
but ChadGPT uses AI to understand
what you're actually looking for.
So it can understand the context of my search.
Exactly, it picks up on those nuances
to give you more personalized results.
And I heard the mobile version
is designed to feel familiar.
Yeah, it looks a lot like a traditional search engine
with images, ratings, and...
Maps and all that.
Exactly, they wanna make it easy for people to use.
Okay, so let's talk about Notebook LM too.
There are some updates to that as well, right?
Yes, Notebook LM is basically
like the super powered research notebook.
Remind me what it does again?
Well, you can upload documents,
summarize key points,
highlight important passages,
even generate audio overviews of your research.
Oh, wow, so it's like having a research assistant.
Exactly, and they just launched a premium version
called Notebook LM Plus.
Which has?
Increased usage limits, customization options,
shared notebooks for teams,
and even better privacy and security.
Wow, that sounds amazing.
Yeah.
But wait, there's more.
It's now integrated with Gemini 2.0 Flash.
Oh yeah, that integration is huge.
So what does that mean for users?
During those audio overviews,
you can actually interact with AI hosts.
No way, so I could be listening to a summary of a paper.
And if you need clarification,
you can actually ask the AI.
That is incredible.
It's like having a personal tutor.
Yeah, it's really pushing the boundaries
of how we learn and work with information.
Okay, so now for a story that reminds us that
even with all these advancements, AI isn't perfect.
Apparently Apple's new AI notification feature
messed up a little bit.
Yeah, it generated this false headline
about a murder case.
Oh no, that's not good.
What happened?
So it was summarizing a news article from the BBC
about the murder of this healthcare insurance CEO.
But it got the facts wrong and said
the suspect shot himself.
Oh wow, so the AI actually presented misinformation.
Yeah, and it's a good reminder that even though AI
is getting better at summarizing information,
it's still prone to errors.
So we can't just blindly trust everything an AI tells us.
Exactly, we still need to be critical thinkers.
Okay, back to Meta for a second.
It seems like they're everywhere.
What's this new story about?
They're updating their Ray-Ban Meta smart glasses
to include real-time AI video capabilities.
Wow, so what does that even mean?
Think of it like having a personal AI assistant
who can see what you're seeing.
You can ask it questions about your surroundings,
get real-time info, even have conversations translated.
Oh my gosh, that's like straight out of a sci-fi movie.
It really is.
Imagine traveling in a foreign country
and your glasses just translate everything for you.
That would be amazing.
But it also makes me think about privacy.
Yeah, that's a valid concern what happens
to all that data being collected.
Exactly.
Okay, let's switch gears again and talk about Google.
They've been making waves with their image
and video generation models, VO2 and Image in Three.
VO2 is really impressive.
It can create these lifelike videos
that understand physics movement and facial expressions.
And it can even respond to directions like camera angles.
Exactly, it's like having a virtual film crew.
That's insane.
And Image in Three is equally impressive.
It can generate super realistic images
from landscapes to portraits to just imaginative scenes.
It's like AI is making it hard to tell what's real and what's not.
It really does raise those questions
about authenticity and ownership, especially with DeepFakes.
Yeah, it's a double-edged sword.
For sure, but these are the conversations we need to have.
We need to be thoughtful about how we use AI.
That's a great point.
We need to make sure we're using it for good.
Exactly.
Okay, so that brings us to the end of part two of our deep dive.
We've covered a lot of ground from the ethics of AI
to those incredible advancements.
And we've still got more to explore.
So be sure to join us for part three
where we'll dive into some more fascinating developments.
Okay, so we're back for the final part of our deep dive.
And we're kicking things off
with a pretty big announcement from Meta.
They've just revealed this new AI architecture
called the Byte-Latent Transformer, or BLT for short.
Yeah, BLT is definitely making some waves.
So with all these new models coming out all the time,
what makes this one so special?
Well, BLT is a pretty fundamental shift
in how AI models process information.
Okay, I'm intrigued.
Tell me more.
Most AI models, they break down text into words
or even parts of words before they can understand it.
It's called tokenization.
Yeah, I've heard of that.
But BLT skips that whole step.
So it works with the raw data directly.
Exactly, it works with bytes,
the fundamental building blocks of digital information.
Okay, but how does that actually change things?
Well, for one thing,
it could make AI models much more efficient.
They can process information faster
and use less computing power.
That makes sense.
Cutting out that extra step must save a lot of resources.
And it goes beyond efficiency too.
Working with bytes could make AI models
more adaptable and versatile.
So they can handle different types of data more easily.
Exactly, not just text, but images, video,
maybe even music or code.
Wow, so it's like giving AI a universal language.
That's the idea.
BLT is still in its early stages,
but it's incredibly promising.
It sounds like it, yeah,
we'll definitely be keeping an eye on that one.
Okay, so switching gears a bit.
Google has this new AI experiment called WISC.
What's that all about?
WISC is all about creativity.
It's using AI to blend images together.
So instead of text prompts, you start with images.
Exactly, you can upload your own pictures
or choose from a library of existing ones.
And then you use WISC to blend them together
and create something totally new.
It's like a digital art studio powered by AI.
Yeah, and you can explore different styles, textures,
combine elements from different pictures.
It's really cool.
So how does it actually work?
It uses two of Google's most advanced AI models,
Image in Three and Geminer.
Okay, so those two are working together?
Yeah, Gemini analyzes the images you give it
and creates descriptions of what it sees.
Then Image in Three uses those descriptions as prompts
to create the final blended image.
So it's like two AI models collaborating.
Exactly, and that's what's so exciting about this field, right?
We're seeing all these new ways AI can be used
to enhance creativity and solve problems.
It's mind blowing, really.
Well, we've covered a lot of ground in this deep dive
from video understanding and image generation
to ethical considerations and these big investment trends.
Then everything in between.
It's amazing to see how quickly this field is evolving.
It really is, and it's important to stay informed
and engaged with these developments.
Absolutely, because AI is gonna touch every aspect
of our lives in the future.
It already is, in many ways.
It's definitely a fascinating and complex field.
And it's only gonna get more so.
Well, that brings us to the end of our deep dive today.
It's been a pleasure exploring these topics with you.
Thanks for listening to the Daily AI News podcast,
and be sure to join us next time
for another deep dive into the world of AI.