See more at: https://goo.gle/next24 Join Google Cloud CEO Thomas Kurian in our opening keynote for exclusive insights into breakthroughs in AI and inspiring success stories from customers and partners around the world.
Watch more:
100+ sessions from Google Cloud Next ’24 → https://goo.gle/next24
Subscribe to Google Cloud → https://goo.gle/GoogleCloud
ASL version →https://www.youtube.com/watch?v=LssK2RJBdZQ
#GoogleCloudNext
[Music]
at Google AI isn’t a tomorrow
thing it’s a today thing and sure we can
ask for answers to Life’s tough
questions but today we can also ask it
to do tough things like ship that wood
more efficiently use satellites to
reduce methane emissions turn DNA into
code to make drought resistant
corn oh cool it can spot and fill poles
spot disease earlier spot asteroids to
protect
Earth it can create apps with just words
in just
hours today Google AI can scan 100,000
lines of code in 2 minutes to spot and
fix bugs it can translate from code to
code and is one step closer to speaking
a thousand languages even
way today AI impacts lives for the
better and understands the world the way
you
do R AI spots threat seven times faster
understands speech sentiment helps
prevent vision loss predicts weather 10
days out in 2 minutes translates
thousands of pages in second detects
lead pipes to keep drinking water clean
eliminates paperwork so cares more human
generates from text visuals audio and
video creates entire worlds from your
imagination creates this thing and that
thing a new thing the new way to
Cloud please welcome our CEO of Google
Cloud Thomas
curan
[Music]
wow welcome everyone to Google Cloud
next it’s been less than eight months
since next
2023 but we made a world of progress
with all of you we’ve introduced over a
thousand product advances across Google
cloud and Google workspace expanding our
infrastructure footprint to 40 regions
including Dam and Johannesburg and
announcing six new subc cable
Investments been recognized as a leader
in 20 industry analyst evaluations in
just the last year and more than a
million developers now use a
state-of-the-art generative AI in
popular tools including Google AI Studio
vertex AI collab vs code jet brains
repet and many more our Genna trainings
have been taken over millions of times
and our services Partners have taken
over half million gen courses and we’ve
seen great success with customers and
partners making us the fastest growing
cloud provider let’s hear Sundar put
this interesting time in our industry
into
[Applause]
context
hi everyone welcome to Las Vegas and to
Google Cloud next I’m told I’m on a very
large screen right now so I’m just going
to imagine this is my audition to play
this sphere we were last together in San
Francisco in August as we all know
months can feel more like decades in
Cloud time just think about it in the
context of generative AI
last summer we were just beginning to
imagine how this technology could
transform businesses and today that
transformation is well underway we have
seen incredible momentum in the cloud
business since then last quarter Cloud
was at the $36 billion annual revenue
run rate that’s five times our run rate
5 years ago congrats to Thomas and team
and a huge thanks to all of our
customers and partners I want to
highlight highlight just a few reasons
Google cloud is showing so much progress
one is our deep investments in AI we
have known for a while that AI will
transform every industry and Company
including our own that’s why we’ve been
building AI infrastructure for over a
decade including tpus now in their fifth
generation these advancements have
helped customers train and serve Cutting
Edge language models these Investments
put us at the Forefront of the AI
platform shift and we are proud that
today more than 60% of fund generative
AI startups and nearly 90% of gen
unicorns are Google Cloud
customers we also continue to build
capable AI models to make products like
search maps and Android radically more
helpful in December we took our next big
step with Gemini our largest and most
capable model yet we’ve been bringing it
to our products and to Enterprise and
developers through our apis we’ve
already introduced our next Generation
Gemini 1.5 Pro it’s been in private
preview in vertex AI 1.5 Pro shows
dramatically enhanced performance and
includes a breakthrough in Long context
understanding that means it can run 1
million tokens of information
consistently opening up new
possibilities for Enterprises to create
discover and build using AI there’s also
Gemini multimodel capabilities which can
process audio video text code and more
with these two advances Enterprises can
do things today that just weren’t
possible with AI before for example a
gaming company could now offer video
analysis to support players including
tips to improve
performance or an insurance company
could combine video images and text to
create an incident report and autom the
claims process we are excited to bring
our Decades of innovation and research
to our customers as you pursue your own
opportunities with AI to grow and
evolve you will hear from hundreds of
companies using Google AI to do just
that here at Cloud next that includes
four CEOs of iconic companies from
around the world David solman who will
share how Goldman Sachs is using AI to
synthesize complex information
quickly without compromising quality Ola
cenius who share how Mercedes-Benz is
building intuitive new experiences for
drivers Dar Kasra Shah will share how
Uber is using AI to empower employees
and improve customer experiences and Nik
aora who will share how paloalto
networks is using generative AI to find
the security needle in the data Hast
stack we’ve had the honor of working
with these compan companies for years
and we looking forward to this next
chapter and to seeing how AI will help
all of you transform your businesses and
innovate today and for the future with
that I’ll turn it back to Thomas enjoy
the rest of the
show thank you Sundar since last year’s
next we’ve announced Partnerships with
hundreds of leading customers companies
like anthropic AI 21 Labs contextual AI
essential Ai and Mistral AI are using
Google Cloud infrastructure leading
Enterprises like McDonald’s Deutsche
Bank the Mayo Clinic HCA Healthcare us
steel and many many more are building
amazing new generative AI apps and
experiences on Google Cloud just
yesterday cintos shared how they use
Gemini models in vert X AI to search
their extensive library of contracts
documents and
products looking at next by the Numbers
there’s 3 thou 30,000 people live here
today 2,000 Google experts over 2500
partners and nearly 400
sponsors a special thanks to all
luminary sponsors Accenture Cap Gemini
cognizant deoy and paloalto networks
and there are over 300 customers and
partners sharing their generative AI
success stories at this event today
we’re going to focus on how Google is
helping leading companies transform
their operations and become digital and
AI leaders which is the new way to Cloud
we have many important advant an es
starting with our infrastructure with
the first leading hyperscaler to Market
with Intel fifth generation Zeon
processors continuing to lead in price
performance Google distributed cloud and
Edge brings compute data Ai and isvs to
highly confidential and Edge
workloads across Cloud networking allows
you to connect any service
including our AI service to any
application on any Cloud securely with
lower cost and latency including all of
our AI
Services databases have enhancements to
allo DB big table and Firebase to
improve reliability performance and
scalability big query is evolving to a
unified endtoend platform for data anal
analytics with a unified user interface
unified security and
governance our security products include
the introduction of chrome Enterprise
premium browser for greater security and
control for
Enterprises along with major advances in
our next Generation firewall Cloud armor
and confidential
compute workspace is introducing
enhanced security extension models a new
chat plus meat offering along with the
best voice quality in the industry with
Google meet and that’s just the tip of
the Ice book there’s a whole lot
more our biggest announcements today are
focused on generative AI you know
customers have quickly gone from
experimenting with generative AI helping
it to answer questions to make a AI
predictions and and are now building
generative AI
agents agents are intelligent entities
that take action to help you achieve
specific goals for example helping a
shopper find the perfect dress helping
an employee pick the right health
benefits or having nursing staff being
helped to expedite patient handoffs when
shifts change agents process multimodal
information simultaneously ly conversing
reasoning learning and making
decisions agents can connect with other
agents and with
humans and they will transform how each
of you interact with Computing devices
and the web
itself you know our customers are
building early versions of AI agents
using our AI infrastructure our Gemini
models vertex AI workspace and Google
Cloud an AI is transforming many
Industries Goldman Sachs is at The
Cutting Edge of technology in financial
services please welcome their chairman
and CEO David
Solomon
it’s been a fascinating Journey recently
with AI technology we’ve seen rapid
Innovation and we’re now at a stage
where practical application of the
technology is showing the potential to
yield real value for the business at
Goldman Sachs specifically our work with
generative AI has really been focused on
three key pillars enabling business
growth and enhancing client experience
improving de developer productivity and
increasing operating efficiency across
the firm we want to be thoughtful in how
we approach and harness this technology
both as a mechanism to drive efficiency
and as an enabler of disruption and
differentiation for our clients we’re
already seeing signs of Promise in a few
areas of our experimentation and we’re
very optimistic about that there’s
evidence that generative AI tools for
assisted coding can boost developer
efficiency and productivity by as much
as 40% and we’re exploring different
ways to use AI whether it’s to summarize
public filings extract sentiment and
signals from corporate statements or to
gather and interpret information like
earnings reports we have a worldclass
team of Engineers working on this and
we’ve already learned a lot I’m super
excited to see what’s
next thank you David we’re grateful for
your partnership and progress building
with our complete open and integrated AI
platform which includes our AI hypercomp
computer an integrated and optimized
system that leads the industry in cost
performance productivity and scale for
AI training and
serving our foundation model Gemini
which has advanced reasoning skills
with multimodal
information we’re the only Cloud to
offer widely used first party thirdparty
and open source
models vertex AI to access tune augment
and deploy custom models and to build
agents Gemini for Google Cloud which
helps with every aspect of Google Cloud
including writing code for any
environment and Gemini for workspace
which is the agent we built right into
Gmail Google Docs sheets and more with
Enterprise grade security and
privacy and we offer integrated partner
Solutions at every single layer of the
stack let’s start by looking at our AI
infrastructure please welcome Aman
[Music]
vat
[Music]
supporting the promise of generative AI
from building World leading multimodal
models to serving them requires
harnessing Computing and data at a scale
never imagined before in fact we are
seeing Computing demands of large
language models grow by up to a factor
of 10 times every
year that is why we have designed and
built AI hypercomp Compu an orchestra of
hardware and software from programming
languages to compilers runtime serving
Stacks to the chips and networks that
make it all possible at an unprecedented
scale the system level integration is up
to 2x more efficient at scale relative
to Baseline solutions that simply
deliver raw hardware and
chips the combination of our vision and
execution has been broadly recognized as
one example we were just recognized as
the leader and Foresters AI
infrastructure Solutions wave in
offering and in strategy but we’re
continuing to introduce new enhancements
at every layer of the stack first we
have the leading portfolio of
performance optimized accelerators
including Google design tpus and Nvidia
gpus today we’re announcing several
enhancements to our GPU portfolio
including the upcoming General
availability of A3 Mega powered by
Nvidia h100 tensor core gpus with twice
the network bandwidth per GPU compared
to A3
instances the rate of progress with
Nvidia gpus is truly astonishing today
we are announcing support for nvidia’s
newest Grace Blackwell generation of
gpus coming to Google Cloud early in
2025 the Nvidia b200 and gb200 chips are
both powered by Next Generation Nvidia
networking G gb200 will be among the
most advanced chips on the planet and
will require liquid cooling to operate
at Peak
efficiency finally we’re also announcing
the general availability of TPU
v5p our most powerful and scalable
TPU our latest generation TPU pot
consists of
8,960 chips interconnected to support
the largest scale ml training and
serving our TPU v5p pods to 4X the
compute capacity per pod compared to our
previous
generation and with TPU multi slice
technology you can simultaneously and
transparently run across multiple pods
for your most demanding workloads in
fact we train and serve our latest
Gemini models on our
tpus to improve AI training and
inference speeds we’ve added a number of
enhancements to our storage products
specifically today we’re accelerating
inference with Hyper disc ml our next
Generation block storage service
optimized for AI inference and serving
workloads it accelerates model low times
up to 11.9 X compared to Common
Alternatives and offers over 100 times
greater throughput per volume versus
competitors and for ML developers we
continue to optimize open and leading ml
Frameworks like Jacks pytorch and
tensorflow for use with both vertex and
GK
K Jax an open source partnership that
includes Nvidia AMD Intel and many
others has emerged as the leading
framework for the most advanced ml
practitioners it allows developers to
focus on the training logic
declaratively rather than partitioning
code manually our xlaa compiler then
generates code for a range of GPU and
TPU
Targets in fact over the last year the
use of gpus and tpus on gke has grown
more than
900% finally with data intensive
workloads like AI efficient resource
management is vital today we are
launching two new options for dynamic
workload scheduler our resource
management and job scheduling tool
calendar mode for start time assurance
and flex start for optimized economics
in combination these make a massive
impact on system throughput and on cost
efficiency overall we find that our AI
hypercomp computer can run with more
than twice the effective efficiency
relative to Baseline Hardware only
techniques leading companies like
anthropic have trained and served models
on our AI hypercomp computer and kaca
brain part of Korean technology company
kaca group has built a large scale AI
language model that is the largest
Korean language specific llm in the
market with 66 billion
parameters they’ve also developed the
text image generator called
Carlo we are also bringing AI closer to
where the data is being generated and
consumed to the edge to air gaap en
environments to Google Sovereign clouds
and cross Cloud through Google
distributed Cloud today we are
announcing that we are adding Nvidia GPU
support adding gke capabilities for AI
workloads and enabling a variety of open
AI models to run on GDC including Gemma
and llama we are bringing the power of
vector search to allow search and
information retrieval applications for
private and sensitive data for your most
stringent regulatory requirements we
deliver fully airgap configurations with
local operators of your choice you have
complete control of your data including
location encryption and access control
and GDC now has both secret and top
secret
accreditations mobile provider orange
operates in 26 different countries where
local data must be kept in each country
they are using AI on GDC to improve
Network performance and to deliver super
responsive translation
capabilities AI systems run a concert
with traditional Computing systems
Google has a long history of Designing
processor systems including tpus for AI
since
2013 VCU for efficient video transcoding
and tensor processors and phones and
today we’re thrilled to share something
very special with you but there’s
another person who’s just as excited as
I
am
we’re delighted to announce the Google
axian processor it’s our first custom
Arm based CPU designed for the data
center and it’ll be available in preview
later this year Google
axan Google a in combines Google’s
expertise with Al’s latest compute core
designs to better deliver up to 50%
better performance and up to 60% better
Energy Efficiency than comparable
current generation x86 based
VMS that’s why we’ve already started
deploying at scale Google services on
Arm based instances including spanner
big Cory gke Google Earth engine and the
YouTube ads
platform now let’s dive into vertex AI
our fast growing Enterprise AI platform
in our vertex AI model Garden you can
access over 130 models including the
latest versions of Gemini partner models
like Claude from anthropic and popular
open models including llama Gemma and
Mistral in a variety of
configurations you choose the best model
for your use case budget and performance
needs and switch between models as you
need to get today we’re taking Gemini
1.5 Pro into public
preview Gemini offers the world’s
largest context window with support for
up to 1 million tokens with Gemini 1.5
Pro customers can now process vast
amounts of information in a single
stream including 1 hour video 11 hours
of audio code basis will well over
30,000 lines of code and over
700,000
words we’re enhancing Gemini 1.5 Pro
with the ability process audio enabling
cross modality analysis for instance you
can use it to search in audio and video
content for example find a Tim stamp in
a baseball game video where a
commentator says it’s out of here we’ve
seen some amazing examples of what
people can do with this large context
window Sunda mentioned a few and others
include a university Professor is using
it to extract data from a 3,000 page
document with texts data tables and
charts
in just a single shot a financial
services company is using it to search
analyze understand and answer questions
in complex merge and acquisition
documents a startup founder is using it
to understand code bases to identify
critical issues and Implement fixes and
a sports technology company that
provides AI enabled cameras lets users
query their videos to evaluate plays or
find key moments keep them
coming today Cloud 3 Sonet Claud 3 H cou
and Tropic state-of-the-art models are
generally available on vertex AI with
claw Opus available in the coming
weeks we’re also announcing the
availability of code Gema a fine-tuned
lightweight open model designed for
coding from the same technology used to
create Gemini with these additions
Google Cloud continues to be the only
cloud provider to offer widely used
first party third parties and open
source
models vertex AI can be used to tune
augment manage and monitor these
models we provide a variety of tuning
and customization techniques fine tuning
reinforcement learning with Fe human
feedback low rank adaptation
distillation and
more to make it easier for all of you
today we’re introducing supervised
adapter-based fine tuning so you can
customize Gemini in an efficient lower
cost way to augment models vertex AI
provides managed tooling to connect your
model to Enterprise applications and
database using extensions and function
calling vertex also provides retrieval
augmented generation combining the
strengths of retrieval and generative
models to provide high quality
personalized answers and
recommendations vertex can augment
models with up-to-date Knowledge from
the web and from your
organization combining generative AI
with your Enterprise
truth today we have a really important
announcement you can now ground
with Google search perhaps the
World perhaps the world’s most trusted
source of factual information with a
deep understanding of the world’s
knowledge grounding Gemini’s responses
with Google search improves response
quality and
significantly reduces
hallucination second we’re also making
made easy to ground your models with
data from your Enterprise databases and
applications and any database
anywhere once you’ve chosen the right
model tuned it and connected it with
your Enterprise truth vertex’s ml Ops
can help you manage and monitor models
for instance we’re introducing new
prompt management tools today to help
developers collaborate on prompts with
not and status to track changes compare
response quality from different prompts
you can evaluate and improve response
quality with the general availability of
our automatic side bys side feature
which provides explanations of why one
response outperforms another and
certainty scores for model
accuracy our rapid evaluation feature
which is now in preview let you quickly
evaluate models and smaller data sets an
example generali Italia Italy’s largest
insurance provider use vertex AI to
build a model evaluation pipeline that
helps its ml teams quickly evaluate
performance and deploy models to make it
easy for all of you developers to access
Gemini and other models on vtex AI we
built integration with many part
Partners including hugging face and
repet they now allow you to access the
models within isv applications in
popular development tools and from
applications running on any
cloud with all this vertex AI is the
only AI platform to provide a single
platform for model tooling and
infrastructure now let’s look at the
types of Agents customers are building
on Google Cloud using generative
AI first customer agents you know
similar to great sales and service
people customer agents are able to
listen
carefully understand your needs
recommend the right products and
services they work seamlessly across all
your channels the web your mobile app
your point of sale and your call center
and they can be integrated into product
experiences with voice and video
mercedesbenz is working with us on
customer agents to help people in their
amazing cars let’s hear from their CEO
Ola
[Music]
[Applause]
Kines
at Mercedes-Benz we want to offer our
customers an exceptional digital
experience that’s why we’re equipping
our cars with high-end computers each
car should only get better over time
just like a good wine and with the power
of Google cloud and AI we will make the
user experience even more personalized
our partnership across Google helps us
build more intuitive and customized
experiences last year we announced our
partnership with Google Maps and today
more than 3 million customers are using
Google places in their Mercedes cars and
we are applying Google Cloud AI across a
number of other use cases ranging from a
smart sales assistant improving customer
service in our call centers and
optimizing our marketing the sales
assistant for example helps customers to
seamlessly interact with Mercedes when
booking a test drive or navigating
through mercedes’s offerings to find
their next favorite vehicle and now
we’re exploring further opportunities to
work with Google Cloud AI such as Next
Level navigation features in addition
we’re partnering on one of the most
exciting technology topics in our
industry automated driving this
beautiful car right here is equipped
with a level three system for
conditionally automated driving living
we were the first manufacturer to get it
certified in Germany California and
Nevada for our next Generation internal
development and test platform we will
use Google Cloud as the backbone helping
us to become even more efficient and
flexible in our product development and
Google Cloud’s expert knowledge in
processing massive amounts of data and
scaling AI workloads will ensure that
our cars get even more intelligent and
Aid driven partnering with the very best
in their respective Fields is an
important part of our software strategy
and Google is the perfect example of
that with Google Cloud Mercedes-Benz is
building new ways to deliver the most
intelligent vehicles to our customers
and to create personalized intuitive
experiences we’re really excited about
working together thank you for having
me
[Applause]
thanks Sola and team in addition to
these great Innovations we’re very
excited to collaborate with
Mercedes-Benz and work towards bringing
Gemini models to their in vehicle
conversational system another great
example is Samsung who’s deploying
Gemini Pro and imagine on vertex AI to
the Galaxy s24 smartphones users can now
take ADV advantage of amazing features
text summarization organization and
magical image editing Gemini Pro also
provides Samsung with critical Google
Cloud features including security safety
privacy and data compliance we’re
inspired by the agents our customers are
creating using our gen generative AI
platform and our models InterContinental
Hotels group will launch a travel
planning capability to help each of you
their guests plan their next vacation
ADT is building an agent to help
customers select and set up home
security systems Verizon gives agents
better recommendations magalo one of
Brazil’s largest retailers has put
generative AI right at the heart of its
customer service ing built a chatbot to
enhance self-service and improve answer
quality and Target uses a I on the
Target app and website to personalize
offers for Target Circle and Starbucks
at drive up Minnesota’s Department of
Public Safety helps non-english speakers
get licenses and other services with
real-time
translation Best Buy is building an
assistant that will help troubleshoot
product issues reschedule or combine
order deliveries or manage software
discover Financial Services is using
search and synthesis across detail
policies and procedures during customer
service calls and orangis French
language agent is grounded in support
knowledge transforming their help and
contact site and their customer
experience Oppo and OnePlus leaders in
smart devices are incorporating our
Gemini models and Google Cloud AI into
their phone to deliver Innovative
customer experiences including news
audio recording summaries AI toolbox and
much much more you know the opportunity
for customer agents is tremendous to
help each of you build customer agents
faster we’re introducing vertex AI agent
Builder you can now create customer
agents that are amazingly powerful in
just three key steps first you can use
Gemini Pro to create free flowing
humanlike conversations with text voice
images and video as inputs and
personalize them with custom voice
models second you can use natural
language instructions to control the
conversation flow and guide it on
specific topics you don’t want it to dis
discuss such as current events in the
same way that you train your human
agents you can also control when it
hands over to a human agent with
transcription and summarization of its
conversation history to make these
transitions extremely smooth third you
can improve response quality with
vector-based and keyword-based search to
connect your internal information and
the entire web you can also use EXT
itions to complete tasks for customers
like updating contact information
booking a flight ordering food and many
more and you can integrate Enterprise
data from operational databases like
allo DB Predictive Analytics with big
quy and SAS applications like service
now let’s take a look at an example of a
customer agent in action please welcome
developer Advocate Amanda Lewis
thank you
Thomas so last night I was watching a
video of this band and I love the
keyboard player shirt so I was thinking
I’d really like to be wearing that shirt
tomorrow night but can I find it in my
size and in time to be rocking it at the
concert here in
Vegas let’s head over to my favorite
store symol Fashion they just launched a
customer agent and and it leverages
Gemini and Vector search to deliver a
seamless shopping
experience what can we help you find
well I’d like that shirt but I guess I
have a few other specifications as well
so find me
a checkered shirt like the keyboard
player is
wearing I’d like to see prices where to
buy it and how
soon can I be wearing it going to
include the
video now the customer agent is using
Gemini’s multimodal reasoning to analyze
the text and video to identify exactly
what I’m looking for then Gemini turns
it into a searchable
format
okay how cool is this it found the
checkered shirt I’m looking for right
and some other great options in no time
and that’s because these results harness
Google’s trusted search Technologies
which ensures customers like me get the
right results in record time the
suggested products are grounded in
symbol Fashions inventory and historical
performance data to make sure customers
leave happy and with that purchase in
hand okay the first one is
perfect
it looks like I can have it delivered in
4 days or pick it up nearby today like I
said I want to be wearing it tomorrow
night so I’m going to go with the local
store to be
safe of course it never fails they only
have three left in my size I don’t want
to miss out on wearing this shirt so I’m
going to go ahead give the store a call
and ask them to set it aside for me but
first let me tell you what’s happening
behind behind the scenes symol Fashions
customer agent is using Google Cloud’s
full Suite of AI capabilities to offer
customized support interactions you know
facilitate transactions like purchases
and returns and ensure that I’m
receiving the most up-to-date
information in real time I’m so close to
having this shirt for the concert let’s
give the store a
call
hi there this is the symbol fashion
customer agent at South Las Vegas
Boulevard am I speaking with Amanda yes
this is
Amanda great thanks for reaching out
Amanda I see you had a session on
another device I’ve sent you an SMS
message with a link to our live chat
companion if you would like to switch to
chat please click the link how can I
help you today I’d like to purchase the
shirt in my cart with the card I have on
file absolutely I see you’re also a
symbol fashion Rewards member looks like
you have a 20% off voucher available to
use would you like to apply it to this
purchase yes please that would be
great the shirt you’re purchasing goes
well with these items also available for
pickup in your preferred size would any
of these be interesting to you
absolutely please add the white shirt
and the boots to my cart
great your total is
$23.76 okay to proceed with the card on
file
yes your purchase is confirmed do you
need anything else today no I’m all set
thank
you incredible thank you for shopping
with symbol fashion you’ll get a text
when the items are ready for
you in less than 5 minutes I was able to
find and order the shirt I wanted and an
outfit to match I’m ready for the
concert back to you
Thomas thank you Amanda that was awesome
now let’s talk about employee agents
many of our customers are building
employee agents using Gemini for Google
workspace and vertex AI to help their
employees be more productive and work
better together for hundreds of millions
of people around the world Uber is an
essential mobile app that makes it easy
to get a ride or a Home Delivery there
are many complex processes that must run
smoothly behind the scenes for Uber to
keep providing its magical user
experiences we talked with DAR kostra
Shahi the CEO of uber and learned more
about how they’re building AI agents to
help help
[Music]
everyone generative AI opens up
opportunities across all parts of our
business but the opportunity I’m
particularly excited about is develop
and employee productivity our
partnership with Google cloud is helping
us create a stronger and more empowered
Workforce Gemini for Google workspace
helps us save time on repetitive tasks
frees up Developers for higher value
work reduces our agency spending and
enhances employee retention we’re also
using Google Cloud’s AI platform to
build our own AI agents to help our
support teams better help our customers
for Frontline support we’ve launched new
tools that intelligently summarize user
Communications and surface context from
previous interactions anything that
helps our teams go faster helps our
platform go faster so our customers can
get where they want to go or what they
want to get delivered all at Uber speed
with Google Cloud Uber is creating new
ways to empower Workforce and better Ser
a customers thanks for having
[Music]
me
please welcome vice president and
general manager of Google workspace
apara
[Music]
Papu hello everyone Gemini for Google
workspace is our AI powered agent built
right into Gmail docs sheets and
more Gemini doesn’t just help our
customers be more productive it’s a
member of their team need a quick answer
on something just ask Gemini
need a world-class notetaker in an
important meeting bring Gemini along
need insights from a dozen analyst
reports Gemini is your research
partner customers really appreciate the
quality of output that Gemini for
workspace
provides More than 70% of help me write
users in Google Docs and Gmail accept
Gemini
suggestions and more than 75% of people
who have created images and slides
insert them into their
presentations we’re seeing the impact of
this every day with our
customers pepperine university has
students and faculty who speak many
languages Gemini in Google meet enables
realtime translated captioning and
notes PennyMac is accelerating
recruiting hiring and new employee
onboarding and Woolworth the leading
retailer in Australia is seeking to
unlock greater productivity for over
10,000 administrative employees by
providing them with Gemini for Google
workspace now today we have quite a few
announcements with Gemini for
workspace first many customers have
asked for a way to get AI powered Google
meet and chat companywide at a lower
price particularly to move away from
zoom in a recent benchmarking study that
tested the top video conferencing
applications Google meet outperformed
Microsoft teams zoom and WebEx in
overall video and audio
performance so we’re announcing the AI
meetings and messaging add-on with take
notes for me chat summarization and
realtime
translation and it will only cost $10
per user per
month second we’re making AI power data
protection available with our brand new
AI security add-on now workspace admins
can automatically classify and protect
sensitive files and data using privacy
preserving AI models trained for their
organization third Gemini and chat can
now catch you up on long conversation
threads summarize decisions and be a
real-time creative partner let’s have
product lead for workspace collaboration
apps Christina bear give you a quick
look at Gemini for workspace thanks
apara there are lots of ways Gemini for
workspace is helping our customers save
time let me show you the magic of one
example in action I’ve been asked to
evaluate proposals for a new payroll
system I open up my drive and I see that
there are two statements of work here or
SS that outline the vendor proposals
Google Drive is AI ready without any
additional pre-work and everything here
is protected with our industry leading
security all I need to do to get started
is drag and drop the two files over into
the Gemini side panel which is currently
in preview in just a few seconds Gemini
for workspace will give me an out out
line of these proposals so that I can
have a good idea of what they’re about
and I could go even further and ask
compare
the uh the price let’s see price of the
two
offers each page is each of these
documents is over 70 Pages it would have
taken me hours to review these docs but
instead Gemini is going to help me find
a clean answer to save me a ton of time
and as you can see I have the answer
right here in the Gemini side panel
let’s go ahead and dive into one of
these proposals so I’m going to pick
this one one of the things that you’ll
notice about Gemini in docs is that it
will proactively show me a summary of
this file so that I can get a sense of
what’s going on without needing to take
the time to read the whole thing but
before I proceed with this vendor I need
to ensure that no compliance issues
exist and I’m going to be honest I have
not memorized every rule in our
compliance rule book because it is over
a 100 pages I would have to need to
scour the 80 pages of this proposal and
compare it manually with 100 pages of
the rulebook so instead in the side
panel I ask does this offer comply oops
with the
following and I’m going to at mention
our compliance rule book hit enter and
see what Gemini has to say Okay so so
interesting Gemini has found an issue
because the supplier does not list their
security
certifications because Gemini is
grounded in my company’s data with
Source citations to specific files I can
trust this response and start to
troubleshoot before selecting a vendor
Gemini for workspace was terrific in
this example saving me a lot of time
without compromising on accuracy and
this technology can be applied in so
many other use cases a sales team
analyzing rfps a recruiter developing
interview questions and so much more
back to youa thank you
Christina many of our customers are
building employee agents to automate
workflows that are tedious and
repetitive for example Bristol Meers
squib is transforming its document
processing for clinical
trials something that took sign
scientist weeks now takes them just
minutes to get a first draft Dasa the
largest Medical Diagnostic company in
Brazil is helping Physicians detect
relevant findings in test
results southernland a digital
transformation company is boosting its
customer service by suggesting better
responses and automating
insights an employee agents can work
across people and teams to complete a
task
one of the nation’s leading Healthcare
Providers HCA Healthcare is using our
generative AI technology to help
caregivers spend more time with patients
and less on
paperwork they’re testing Katie so Katie
is a nurse handoff digital assistant
helping to ensure continuity of care
when one caregiver shift ends and
another begins it delivers summaries in
everyday life language to ensure that
caregivers can share information easily
and provides them up to the minute
patient data to expedite the discharge
process it also helps prepare patients
for Recovery at home by simplifying
post- discharge tasks like postop
physical therapy and
more Victoria Secret in company is
looking to help instore Associates offer
tailored recommendations to
customers the Home Depot app called
sidekick helps store associates manage
inventory and keep shelves
stocked Etsy uses vertex aai to improve
search provide more personalized
recommendations to buyers optimize their
ad models and increase the accuracy of
delivery
dates vertex AI especially when combined
with workspace let you create powerful
employee
agents first you create a custom model
in the ways that we’ve shown before from
there you connect them to all your
company and web data this can also be
done with translation so that your
company information is available
regardless of
language similarly we support multimodal
inputs including videos call Audio
images in addition to text now you will
want to ground that in Enterprise truth
using databases like alloy DB big query
and data from Enterprise apps like sap
and announcing today
HubSpot let’s take a look at an example
of an employee agent in action please
welcome developer Advocate Gabe
Vice thanks
Lea hi folks so I know you all want to
hear about awesome AI stuff that’s
coming but I need to talk to you for a
minute about my annual benefits
enrollment see I forgot I have to finish
signing up by today and as you can see I
might be a little bit busy so if you
don’t mind let’s go ahead and look at
this open enrollment email
together okay yep I’ve got a deadline I
knew that thank you I’ve got FSA stuff
I’ve got an online portal for my company
HR Ben okay there’s a lot here uh H they
included video let’s see if this makes
my life
easier and the video is ah okay so it’s
almost an hour long yeah I’m not going
to have time to review all of this stuff
let’s see how this employee agent that
we’ve developed using Google workspace
Gemini models and vertex AI might be
able to help me as you can see it’s
integrated directly into my Google Chat
so I don’t have to contact switch while
I’m figuring all this stuff out first
things first let’s have it summarize the
email and the video that it sent me
summarize the body and attached video
from my recent email with subject open
enrollment
closing so behind the scenes the agent
is referencing that email body and its
attachments as context in the prompt
using retrieval augmented generation
that way its response is limited to the
content that matters to me the Gemini
models multimodal capabilities allows
the agent to understand and reason
across text audio and video from a
single prompt I mean this is a way
quicker read okay good and I can
immediately see that the medical plant
have been completely revamp this year
let’s go ahead and jump into the
benefits portal to see more now I’ve
already done my dental and my vision but
I procrastinate I mean saved the most
important plan for last my medical plan
let’s see how this option Stacks against
my existing
coverage compare these coverage options
to the PDF doc I have on the Platinum
plan the the Gemini model’s long context
window paired with vertex extensions
enables the agent to cross reference
large amounts of data from a variety of
sources including unstructured data like
PDFs leveraging Gemini’s Advanced
reasoning capabilities the agent is able
to understand the complex details of my
current plan and compare it with the new
options for
2025 and since the Enterprise grounding
features links me to the exact data that
Gemini used to draw its conclusions
which you can see linked here I can
confidently trust its recommendation
that the gold plan is best for
me and done so now let’s get a summary
of my coverage let’s say my house is
multilingual so I’d like to have it in
Japanese also please generate a summary
of 2025 benefits in a Google doc in both
English and
Japanese although my source material is
in English the Gemini models support for
over 40 languages enables it to
understand and respond in Japanese and
here we
go by engaging with employees in their
native language the agent can help
everyone feel comfortable navigating
their Healthcare needs for the next year
so one last thing now that I’ve
officially completed enrollment my
daughter’s going to need braces this
year let’s use the agent to help me find
the right
orthodontist
my daughter will need braces this year
help me find the best in network
orthodontist near my home with vertex
extensions the Gemini model can
integrate with any external or internal
API this allows the agent to join my
dental coverage details directly with
real-time Google Maps and places data to
help deter determine the best ranked in
network providers near me taking a quick
look at my
options okay so it looks like symbol
Orthodontics is the only one that offers
Saturday appointments which works best
for my family schedule but what do I
really know about them how do I know
that the agent actually picked the best
orthodontists because the Gemini model
natively supports grounding with Google
search I can see what the agent found
summarizing saving me hours of scouring
the internet for fresh information the
best part is I can get The annotation to
see where the information came from
which means if I want to look for myself
I can I have great places to start and a
quick scan of the summary shows me that
they’re great with kids which is great I
particularly love this customer review
I’ll go with them let’s schedule a
call I don’t know how it’s going to find
a schedule though I mean I’m
here the agent knows that I’m at Google
Cloud next because it’s integrated with
Google Calendar and it can find a time
to schedule the call yes
please
awesome I’ve got a call do I need
anything else nope I’m good no
thanks perfect nice and easy just
imagine what else an employee agent can
help you with thanks back to you
apara that was great next up creative
agents jbi is transforming how marketing
teams are creating content personal
izing it and making realtime campaign
adjustments creative agents can
supercharge your design and production
teams working across images slides and
other
modalities we’re seeing really
interesting creative Agents from
customers for example car 4 one of the
world’s leading food retailers is
pioneering new ways to use generative AI
for
marketing Now using vertex AI they were
able to deploy car 4 marketing studio in
just 5 weeks an Innovative solution to
streamline the process of creating
Dynamic campaigns across various social
networks empowering the marketing teams
to efficiently promote products and
engage with their target audience in
just a few clicks they can build Ultra
personalized campaigns to deliver
customers advertising that they care
about other customers such as C canva
are using vertex AI to power its magic
design for video helping users skip
tedious editing
steps Proctor and Gamble is accelerating
the development of photorealistic images
and creative assets giving teams more
time back to focus on higher level
plans wpp the creative transformation
company built a performance brain using
Gemini 1 .5 Pro on vertex AI to power
its media activation tool called wpp
open media
Studio advertisers like the Google pixel
team can now see predictions of which
ads are going to work the best before a
single impression has been served
avoiding millions of dollars of media
waste over the life of
campaigns now while these examples are
about professional creative teams we we
believe that everyone can be a great
Creator and a great
Storyteller but the formats and tools
for storytelling at work haven’t really
changed that
much how many times have you heard
should we start with a dock or a
deck well we can do a lot
better I’m absolutely thrilled to
announce our newest workspace app Google
[Applause]
vids
sitting alongside Google Docs sheets
slides Google vids is an AI powered
video creation app for work with Gemini
and vids you have a video writing
production and editing assistant
allinone let me show you how simple it
is to get started with
bids now after a full week with all of
you here at next I’m going to want to
share a recap video to share all the
excitement with with my
organization when I open up vids Gemini
helps me get started I simply type in a
prompt using an existing document for
context now based on that prompt Gemini
suggests a narrative outline for the
story that I could easily customize and
edit I choose an expressive style and
vids Works its
magic let’s see what I
get so wow just like that I get the
first draft with beautifully designed
fully animated scenes complete with
relevant stock media and music and even
a generated script I’ll be able to add
fun videos and photos that I captured
this week from my media directly by
accessing Google Drive and Google photos
and even without any video expertise I
can build out scenes like a pro just as
easily as I make slides but it doesn’t
have to stop there with this vids you
can personalize your story your way by
recording yourself or by using one of
our preset voices by Gemini and by
enriching scenes with high quality media
from our stock Content Library or from
your own to really make your story
shine and because Google vids is a
workspace app it comes with all of the
collaboration capabilities that your
teams already know and love VDS doesn’t
just help you create videos it helps you
become a better Storyteller with a rich
new medium at work this isn’t just a
vision vids is already in the hands of
alpha customers who have been giving us
really great feedback as we work towards
expanding to workspace labs in June I’m
looking forward to sharing more about
vids with all of you in my Spotlight
session
tomorrow Beyond vids many customers are
building agents for their marketing
teams audio and video production teams
and all of the creative people out there
who could use a
hand we provide a tremendously powerful
platform and stack to build creative
agents first it takes the best image
generation model imagine 2.0 our most
advanced text to image technology helps
businesses create images that match
their specific brand
requirements this is now generally
available in Vortex
AI image imagine strong language
comprehension and photo realism
capabilities contributed to Google
securing the leadership position in the
recent Foresta computer vision
wave second as a part of Imagine we’re
now introducing text to live image in
preview today marketing and creative
teams can generate animated images
from a text prompt including product
images ads GFS and
storyboards here’s an example of a day
lily opening in the Morning Dew
and a pot of something delicious
simmering on the
stove or an aerial view of a mountain
range third we are proud to announce the
general availability of digital
watermarking for AI generated images
produced by imagine it’s powered by
Google deep Minds
synth finally we’re announcing new
editing modes for Imagine 2.0 which will
make it really easy to remove unwanted
elements in an image add new elements
and expand the borders of the image to
create a wider view for all of
you
when all of these tools come together
it’s a powerful combination let’s take a
look at the creative agents that you can
build today please welcome one of our
field engineering leaders Elliot
Danner thank you
apara our symbol Outfitters product team
is working on designing a new tent that
we’re eager to bring to market the tent
itself is still in development but we
want to get started on a marketing
strategy right away let’s see how the
creative agent we developed with Gemini
models imagine 2.0’s API and Google
workspace can help first things first
let’s get a look and sense for the look
and feel of our brand what are the key
Styles and
themes of our
brand the creative agent can analyze
previous campaigns to understand our
unique brand style and apply to new
ideas in this case the creative agent
has analyzed over
3,000 brand images descriptions videos
and documents of other products that we
have in our catalog contained within
Google drive to create this summary and
as you can see it summarized our brand
identity as
bold adventurous and aspirational this
is exactly the look and feel that we’re
going for the creative agent was able to
use Gemini Pros 1 million token context
window and its ability to reason across
text images and video to generate this
summary next I’m going to cre prompt our
creative agent using imagine to
dynamically generate amazing new images
of our tents in iconic and real outdoor
settings this will help us brainstorm
campaign locations all of this of course
will match our unique brand style now
because I’m a terrible typist I’m going
to use chrom’s buil-in Clipboard
history so we’ve asked it to create
these images we’ll give it just a
second check this out Machu picu not bad
half doome these are real landmarks
accurately presented now let’s work on a
narrative to really help us land the
message I want to make special note that
in this prompt I’m going to ask the
creative agent to provide captions in
both English and Spanish and that I’m
using a multilingual prompt to do
so
awesome the creative agent leverage
Gemini Pros multimodal capabilities to
brainstorm creative captions that match
each photo these look great too and
thanks to our multilingual capability
we’re able to share the same story with
our customers in their native language
moving along let’s ask the agent to
combine everything into into a
storyboard and share it with the team to
get some
feedback generate a storyboard share it
with an email group The Creative agent’s
going to move this into slides and share
it out with that group all done shared
with the
group they can post comments directly in
Google slides and we can see them here
for the agent to review we’ll speed up
time a little bit because it’s a demo
and take a look at the
feedback looks great but there are three
requests first something for Less
experienced campers second content for
the symbol Outfitters podcast and third
something more visually Dynamic for
social media let’s start with that new
storyboard we’ll use that copy paste
trick
again and you’ll see in this case we’re
asking for a New Image new captions and
a new storyboard with that new audience
that relaxed camping
audience take a look that looks pretty
relaxing to
me looks pretty good and there’s the
storyboard great just like that the
creative agent modified our ideas for a
new audience it understood our context
and made the changes that we asked for
now let’s generate that
podcast the Gemini model’s complex
reasoning allows me to generate a script
and an audio clip in a single prompt
this much longer prompt highlights our
ability to do ordered operations we’re
asking the agent to create a podcast
script in ssml or speech synthesis
markup language and then passing the
output to our text to speech API the
result will be an episode with two
people discussing tense so we’ll see the
script here which we could expand if we
wanted but let’s just listen to a little
bit of it welcome to the show thanks
Freya it’s great to be here I’m always
happy to geek out about gear that sounds
really good and I want you to notice the
regionalism in the speaker voices pretty
impressive but we don’t have time to
listen to the whole thing because you’re
here for the keynote finally we were
asked for some engaging content for
social media let’s see what the creative
agent can do using our new live image
generation capability so we’ll ask
it generate some live images of our tent
Outdoors for clarity we’ve run this
prompt before and so you’ll be seeing
cash to speed things up but these are
simply beautiful creating content like
this could take days of weeks days or
weeks of scouting and shooting but our
creative agent used imagins new text to
live image capability to make them in
minutes the creative Agent shows how
Google’s generative AI capability can
make producing custom content easy
seamless and a lot of fun I’ll hand it
over to br
[Applause]
[Music]
CER thanks a partner anelia that was
amazing I want to first talk to you
today about data agents many of us have
worked with data analysts who can answer
a question and figure out the questions
we should be asking that’s what great
data agents will provide and one company
that we’re working with who’s building
data agents grounded in Enterprise data
is Walmart let’s hear from shesh Kamar
their EVP and
[Applause]
[Music]
[Applause]
CTO hello and thank you for having me at
Walmart we are obsessed with data as the
largest retailer in the world the scale
of our data is unmatched
Walmart has a legacy of innovating on
behalf of our customers our members our
Associates and today our business is
both vast and
complex we are working with massive
amounts of complex data and we need
Partners like Google Cloud to help us
achieve our goals the ability to handle
huge amounts of data through bigquery
and other analytical tools has been
instrumental in implementing our
transformation artificial intelligence
is embedded AC across our business
helping us unlock insights from our data
to personalize experiences get inventory
to our supply chain and a lot more using
Gemini we have enriched our data helping
us improve millions of product listings
across our site and ultimately enabling
customers to make better decisions when
they shop with Walmart our team worked
closely with Google to customize their
offerings fine tuning for our needs to
power the present and enable the future
of Walmart I’m excited about our
partnership as we create the future of
[Music]
[Applause]
retail thank you shes we’re thrilled to
be helping Walmart use data agents to
serve their customers we’re helping many
customers build data agents for example
bear is harnessing big query and vertex
AI to develop digital Medical Solutions
and drugs more efficiently
as well as streamline the creation of
regulatory
documentation News Corp is using vertex
AI to search data across 30,000 sources
and up to over across 2.5 billion news
articles updated
daily woven by Toyota is collaborating
with Google to leverage vast amounts of
data in AI resulting in 50% TCO savings
to support automated driving Ricardo
Liber is using big query and looker to
optimize capacity planning and
reservations with delivery carriers and
Airlines to fulfill shipments faster and
thousands of scientific researchers at
May Clinic search over 50 pedabytes of
clinical data using vertex AI
search tokopedia an Indonesian
e-commerce leader is using vertex AI to
improve data quality increasing Unique
Products sold by
5% and Vodaphone uses vertex vtex AI to
allow 800 operators to rapidly search
over 10,000
contracts then we have Partners like
Onyx and data Medica who help our
customers build data agents now these
data agents have the potential to unlock
new ways to find and act on meaningful
meaningful signals from your data
they’re built with AI for complex
analysis and they have to ensure
factional Integrity of their results
and to help power these data agents
we’re making it easy to bring your data
to Google cloud with Gemini and
bigquery Gemini bigquery helps with data
preparation Discovery analysis and
governance and comes with a new big
query data canvas which is a new
notebook like experience supporting
natural language queries and embedded
visualizations now data professionals
can get assistance for building their
data pip pipelines to improve
performance reduce errors and lower
costs and today we’re introducing new
query capabilities using vertex indexing
directly in big query and alloy
Tob this allows you to leverage AI over
your data where it is stored enabling
real time and accurate responses for AI
applications we’re also building
seamless connection from Big query to
fex AI to give you direct access to AI
models in vertex from
bigquery now bigquery in vertex together
deliver up to four times faster
performance and are up to three times
more cost effective than the other data
warehouse and AI
platforms now this allows you to
seamlessly combine your AI models
classical ml operators and statistical
functions together in your data pip
pipelines for multimodal
analysis and with this new capability
you can analyze documents videos images
and audio recordings together with your
structure
data and finally we’ve improved the
integration between looker and your data
agents as part of the Gemini and looker
preview we’ve added new AI capabilities
that enable you to chat with your
business data with seamless integration
with Google Google
workspace and together these stru these
Solutions make it easier to analyze and
activate your data let’s see how this
comes together in a demo please welcome
director of outbound product management
in data analytics Jasmine
Amud thank you Brad we have built a
great data agent one that connects all
of your data incorporates gen and even
has collaboration it’s a custom
application built with big query luer
and vertex AI shoot I could have sworn
my notifications were on silent but wait
what’s this this is cool it’s my data
agent giving me a notification that
sales are up well maybe it’s because of
our Cloud shoes because surely shouldn’t
all keynote speakers get keynote
sneakers all right let’s
explore with our data agent what you’re
seeing here are realtime kpis the
metrics that matter the most being
continuously monitored from my
Enterprise data in big query to surface
anomalies and Trends let’s dig in let’s
explore Cloud Sho sales over customer
segments and
territories in a heat
map our data agent uses the looker
semantic layer to effectively ground its
AI in specific business data and data
definitions that give us trusted answers
and in this case it’s right down to the
territory and even customer segment I
also see other data details that give me
source and traceability so I know I can
trust this
data I wonder how might this trend be
impacting other kpi stored in my
semantic layer let’s
ask how does
demand
correlate with other Core Business
metrics okay our data agent again uses
the looker semantic layer to find other
business metrics that are similar and
looks for anomalies in fact I’ve got
three helpful insights I can actually
dig into supply and demand levels over
the next 3 months by clicking this first
child our data agent is now using big
query machine learning to build a futur
looking
forecast and it looks like it’s found a
gap in supply versus demand and it’s
only growing I might need a substitute
product to help me meet demand well
isn’t it great that in big query we have
invented our 50,000 shoe catalog
collection including multimodel data
like product descriptions pricing and
even images
and with big query Vector embeddings
these images with different colors
shapes lines and styles can be queried
easily to do a similarity match so let’s
enter a
prompt find me similar
products in our
catalog that look
like and we’re going to upload an image
of our Cloud
shoe and with that our agent has all of
the information it needs to do that
search and it’s found three top matches
and combine these images with structured
data about pricing and delivery
schedules well given I need a similar
looking shoe and delivery times are
important I think option one looks great
isn’t this
incredible however we do need to make it
actionable after all insights that
aren’t actioned aren’t very useful so
let’s share this with the team our
looker and workspace Integrations now
make this super easy we can simply send
a
summary of the
alert and search
insights over chat to our symbol
inventory
team and with that our data agent
compiles that
summary and it’s even come back with a
sheet containing all of the raw data and
insights I sure do want to share these
with the team
and with that our team now can make
confident decisions with all of the data
and insights they need all powered
through big query looker and vertex AI
the combination of these Technologies is
truly gamechanging back to you
Brad thanks
yine that was amazing now I want to
shift and talk to you about code agents
there’s so much upside
for helping developers and product teams
to design create and operate
applications and to ramp up on new
languages and code bases
faster and one company investing to help
their developers is Wayfair let’s hear
from Fiona their
[Music]
[Applause]
CTO at Wayfair we’re here to help our
over 22 million customers create their
feeling of home as a digitally native
retailer our Tech platform is the
Bedrock of our group our developers
needs are top of mind for us we strongly
believe generative AI will be at the
Forefront of this work and we want to
provide them with access to generative
AI coding tools enabling them to build
faster and with greater quality and
ultimately enhancing their job
satisfaction we chose Gemini code assist
after running a number of pilots and
evaluations that measured metrics
pertaining to speed quality and
sentiment when we looked at the results
against a control it showed that Gemini
cotsis brought in significant
improvements across the Spectrum for
example developers were able to set up
their environments 55% faster than
before there was over 48% increase in
unit test coverage for the code and 60%
of developers reported they were now
able to focus on more satisfying work
we’re now rolling it out on demand to
all developers and are building a suite
of Workforce productivity tools like
automated code review document search
and chat we’re excited to see how code
agents can continue to increase
developer productivity and satisfaction
and at Wayfair we look forward to
continuing our Innovation with Google
Cloud thanks for having
[Music]
me thanks
fion our Enterprise Focus AI code
assistance is now called Gemini code
assist we’ve used Cod assist internally
with significant impact as shown
here and we’re seeing the same success
from our
customers for example Turin an AI
powered tech services company is
accelerating development with Gemini Cod
assist they’re customizing code assist
using their private code base empowering
their developers with highly
personalized and context relevant coding
suggestions they’ve increased their
productivity by 30%
helping ship higher quality work faster
and enhancing the day-to-day experience
of their
developers similarly quantify also saw
developer productivity gains of over
30% likewise cap Cap Gemini saw coding
velocity increase alongside improvements
in code security quality and test
coverage and commerce banks helps their
developers with Cod assist robust
security and and compliance
features now Gemini code assist provides
Enterprise grade coding assistant that
supports your codebase anywhere on
premises gitlab GitHub bitbucket and
even across multiple repositories we do
not require your code to be only in
GitHub in addition our Global footprint
allows us to provide optimal performance
for developers worldwide and support
data
residency the other leading provider
only supports repositories in one
country which may be inadequate for
customers who have strict data residency
requirements and today I’m excited to
announce two key additions to meet
Enterprise development needs first we’re
integrating the power of Gemini 1.5 Pro
into Gemini Cod
assists this upgrade brings a massive 1
million token context window to coding
which which is the largest in the
industry this revolutionizes coding
allowing you to perform large scale
changes across your entire code
base second we’re announcing Gemini
Cloud assist which works across your
application life cycle making it easier
to design operate
troubleshoot and optimize your
application now these Solutions work
together to help developers and
operators be more
efficient now please welcome our product
manager for Gen Paige Bailey for our
final demo awesome thank you so much
Brad and hey there Las Vegas so let’s
take a look at what’s coming for COD
assist with gimini 1.5 Pro leveraging a
1 million token context window I’m a new
developer with symbol Outfitters and
today we show recommended products to
customers only after they’ve made an
initial selection
these suggestions are powered by our
custombuilt recommendation service based
on previous
purchases but now the marketing
department has asked me to move this
feature to our homepage so that
customers can see products that they
might be interested in as soon as they
get to our
site our design department has created a
mockup of what they would want this
experience to look like in figma and for
the developers out there you know that
this means we’re going to need to add
padding in the homepage modify some
views make sure that the configs are
changed for our
microservices and typically it would
take me a week or two to even just get
familiarized with our company’s code
base which has over a 100,000 lines of
code across 11
services but now with Gemini code assist
as a new engineer on the team I can be
more productive than ever and can
accomplish all of this work in just a
matter of minutes
this is because Gemini’s code
Transformations with full codebase
awareness allows us to easily reason
through our entire code base and in
comparison other models out there can’t
handle anything beyond 12 to 15,000
lines of code and even then they
struggle to get it
right Gemini inside of code assist is so
intelligent that we can just give it our
business requirements including the
visual design so let’s
ask here I am prompting Gemini to add a
foru recommendation section on the
homepage along with an image of the
future state to show the improved
design almost immediately Gemini code
assist starts by reasoning about the
code changes that it needs to make and
has insights an experience teammate
would have for example because we asked
Gemini Cod assist to change the
recommendation service it was able to
find the recommendation function and
extract out the exact details needed to
make the call to the recommendation
service it highlights the files needing
to be changed and reveals the reasoning
behind its recommendations using our own
codebase for
context Gemini code assist doesn’t just
suggest code edits it provides clear
recommendations and make sure that all
of these recommendations are aligned
with symbol Outfitter security and
compliance
requirements in code assist we’ve also
added an option to apply the edit which
keeps me as the developer in the driver
seat so let’s take a look at the source
code changes that Gemini code assist is
made in our code
base it looks like we have multiple
edits across two files handlers.
go and also
home.html Gemini Cod assist even applied
these changes to the full
repository and to put this in context no
pun intended it would have taken me over
70 hours nonstop to even just read
through all of these
files
and just like I would with any code
change my next step is to check the
workout by testing out the modified app
locally so let’s try it
and there we go the for you
recommendations section is exactly what
our marketing team was asking for and as
a new developer I was able to make a
meaningful contribution on my very first
day so let’s
recap behind the scenes Gemini has
analyzed my entire codebase in gitlab
it’s implemented a new feature and has
ensured that all of the code generated
is compatible with my company’s
standards and requirements
we are so excited for you to try out
Gemini code assist over to you
Thomas thank you Paige thanks Brad that
was amazing now let’s talk about
security agents with security and
generative AI we focused in three
important areas first to ensure that our
Jer a platform protects the privacy and
security of the data
we provide sovereignty and compliance
controls including data location
encryption access control and
auditing second we continue to enhance
our AI platform to protect your models
and Agents from cyber attacks such as
malicious prompt injection third we’re
applying generative AI to create
security agents that assist security
operations teams by radically increasing
the speed of Investigations Pao Alto
networks is building on Google Cloud AI
they share this Vision with us let’s
hear from Nikes aora their
[Music]
CEO Google cloud and Pao Alto have had a
shared Vision around how do we take
generative Ai and make it work together
as the whole world moves towards this
new paradigm so what we did do over the
last five or six years working in
partnership with Google work on building
Cloud security capability and most
recently building our cortex xim
platform which effectively reinvents
security operations and of course in
perfect time because we leverage
tremendous amounts of machine learning
Precision AI generative AI to make sure
that customers are able to detect be
able to stop remediate all these cyber
security attacks as quickly as possible
so they can go ahead and do what they
need to do very excited about all the
capabilities that Gemini brings to the
four we noticed this large language
model has allowed us to do things a
little faster get more precise and we’re
hitting numbers north of 90% in terms of
a accuracy effectively what we’ve seen
in our early trials that it makes our
usability better our explainability
better the fact that we can combine our
product capabilities leverage the large
language model we can get as part of our
Google Cloud Partnerships we’re going to
be able to create more and more ease of
use and automation so couldn’t be more
excited about things to come with Gemini
and really excited about the AI
partnership with Google thank you for
having
[Music]
me thank you NES you know security
agents will help each of you in every
stage of the security life cycle from
prevention detection and response let’s
start with threat intelligence we’re
able to take the experience in
intelligence We Gather from protecting
Google’s own
Services combine it with Mandan leading
Frontline Insight from their work in
incident response to show you emerging
threats the severity and risk factors
today Gemini in threat intelligence a
new product enables you to use natural
language prompts to get deep insight
about threat Behavior
actors in other security offerings we
use Gemini 1.5 Pros long context to
analyze large samples of potential
malicious code or malware to see the
interaction between modules and to
reveal their true malicious intent to
quickly identify and address threats you
can use Gemini and security operations
to summarize and explain findings
recommend next steps and even write and
execute remediation
playbooks next you can use Gemini in our
security Command Center to evaluate your
security posture findings and summarize
attack paths to help understand Cloud
risks so you can remediate them leading
organizations are already seeing
benefits by integrating their own
intelligence into Google SEC Ops Charles
Schwab analysts better prioritize work
and respond to
threats groupo boario one of the largest
beauty and cosmetics companies in Brazil
employs real-time models to prevent
fraud and respond to issues for fizer
data sources that used to take days to
aggregate can now be analyzed in just a
few seconds and BBVA has seen similar
results five serves security operations
Engineers create detections and
playbooks with much less efforts while
analysts get answers
faster today we’ve announced dozens of
new capabilities across every layer of
our optimized AI
stack we know that each of you needs all
of this to work with your existing
systems and to be supported by a broad
ecosystem that gives you
Choice our open platform offers choice
at every layer including chips for
training and
serving your choice of
models your choice of development
environments
databases including Vector
databases and your choice of business
applications we’re building with a broad
ecosyst system of Partners including
independent software vendors and
Technology partners and our services
Partners have been aggressively ramping
their capabilities with our global
system integrated Partners alone
committing to train over 200,000
professionals on our gen
products we’re at a pivotal moment in
our
industry together we’re creating a new
era of generative AI agent
built on a new truly open platform for
AI and we’re Reinventing infrastructure
to support it to all of our customers
and
partners thank you all so much for your
partnership we have an amazing three
days plan for all of you with a great
set of sessions and keynote still to
come to everyone here those watching
online to the amazing team that put this
event together thank you for joining us
for cloud next together we’re building
the new way to Cloud have an amazing
[Applause]
[Music]
event