Whenever the rest of the human race deeply upsets me - have another look at updates from Nvudia; the greatest innovation partnership even seen
i am not sure how one works out how many people's yas were spent on nvidia platforms- its under a million human years or about one thoudanfth of human race - isnt it remarkable - what nvidia emplyees plus foundry workers in taiwan plus all nvidia partners leap forward - hrom april 2024 16bminute highlighr reel -16 minutes https://www.youtube.com/watch?v=bMIRhOXAjYk
larest chip backwell now has 208 billion trnsistors replacing hoppwrs 80 billion
First Blackwell users/ Amazon AWS & Amazon Health
Amazonn Robotics is using Nvidia Omniverse (developer space fro robotics) and Isaac Sim AWS Health has Nvidia Health Integrated into it so AWS has has really leaned into accelerated Computing ; Google is gearing up for Blackwell gcp already has A1 100s h100s t4s l4s a whole Fleet of Nvidia Cuda gpus and they recently announced the Gemma model that runs across all of it uh we're work working to optimize uh and accelerate every aspect of gcp we're accelerating data proc which for data processing the data processing engine Jacks xlaa vertex Ai and mujo for robotics so we're working with uh Google and gcp across whole Oracle gearing up for blackwell Oracle is a great partner of ours for Nvidia dgx cloud and we're also working together to accelerate something that's really important to a lot of companies Oracle Database Microsoft is accelerating and Microsoft is gearing up for Blackwell Microsoft Nvidia has a wide- ranging partnership we're accelerating could accelerating all kinds of services when you when you chat obviously and uh AI services that are in Microsoft Azure uh it's very very very likely nvidia's in the back uh doing the inference and the token generation uh we built they built the largest Nvidia infiniband super computer basically a digital twin of ours or a physical twin of ours we're bringing the Nvidia ecosystem to Azure Nvidia DJ's Cloud to Azure uh Nvidia Omniverse is now hosted in Azure Nvidia Healthcare is in Azure and all of it is deeply integrated and deeply connected with Microsoft fabric a NM it's a pre-trained model so it's pretty clever and it is packaged and optimized to run across nvidia's install base which is very very large what's inside it is incredible you have all these pre-trained stateof the open source models they could be open source they could be from one of our partners it could be created by us like Nvidia moment it is packaged up with all of its dependencies so Cuda the right version cdnn the right version tensor RT llm Distributing across the multiple gpus tried and inference server all completely packaged together it's optimized depending on whether you have a single GPU multi- GPU or multi- node of gpus it's optimized for that and it's connected up with apis that are simple to use these packages incredible bodies of software will be optimized and packaged and we'll put it on a website and you can download it you could take it with you you could run it in any Cloud you could run it in your own data Center you can run in workstations if it fit and all you have to do is come to ai. nvidia.com we call it Nvidia inference microservice but inside the company we all call it Nims we have a service called Nemo microservice that helps you curate the data preparing the data so that you could teach this on board this AI you fine-tune them and then you guardrail it you can even evaluate the answer evaluate its performance against um other other examples and so we are effectively an AI Foundry we will do for you and the industry on AI what tsmc does for us building chips and so we go to it with our go to tsmc with our big Ideas they manufacture and we take it with us and so exactly the same thing here AI Foundry and the three pillars are the NIMS Nemo microservice and dgx Cloud we're announcing that Nvidia AI Foundry is working with some of the world's great companies sap generates 87% of the world's global Commerce basically the world runs on sap we run on sap Nvidia and sap are building sap Jewel co-pilots uh using Nvidia Nemo and dgx Cloud uh service now they run 80 85% of the world's Fortune 500 companies run their people and customer service operations on service now and they're using Nvidia AI Foundry to build service assistance cohesity backs up the world's data their sitting on a gold mine of data hundreds of exobytes of data over 10,000 companies Nvidia AI Foundry is working with them helping them build their Gia generative AI agent snowflake is a company that stores the world's uh digital Warehouse in the cloud and serves over three billion queries a day for 10,000 Enterprise customers snowflake is working with Nvidia AI Foundry to build co-pilots with Nvidia Nemo and Nims net apppp nearly half of the files in the world are stored on Prem on net app Nvidia AI Foundry is helping them uh build chat Bots and co-pilots like those Vector databases and retrievers with enidan Nemo and Nims and we have a great partnership with Dell everybody who everybody who is building these chatbots and generative AI when you're ready to run it you're going to need an AI Factory and nobody is better at Building endtoend Systems of very large scale for the Enterprise than Dell and so anybody any company every company will need to build AI factories and it turns out that Michael is here he's happy to take your order we need a simulation engine that represents the world digitally for the robot so that the robot has a gym to go learn how to be a virtual world Omniverse and the computer that runs Omniverse is called ovx and ovx the computer itself is hosted in the Azure Cloud the future of heavy Industries starts as a digital twin the AI agents helping robots workers and infrastructure navigate unpredictable events in complex industrial spaces will be built and evaluated first in sophisticated digital twins once you connect everything together it's insane how much productivity you can get and it's just really really wonderful all of a sudden everybody's operating on the truth you don't have to exchange data and convert data make mistakes everybody is working on the same ground truth from the design Department to the art Department the architecture Department all the way to the engineering and even the marketing department today we're announcing that Omniverse Cloud streams to The Vision Pro and strange that you walk around virtual doors when I was getting out of that car and everybody does it it is really really quite amazing Vision Pro connected to Omniverse portals you into Omniverse and because all of these cat tools and all these different design tools are now integrated and connected you can have this type of workflow incredible this is Nvidia Project Groot a general purpose Foundation model learning the group model takes multimodal instructions and past interactions as input and produces the next action for the robot to execute we developed Isaac lab a robot learning application to train Gro on Sim and we scale out with osmo a new compute orchestration service that coordinates workflows across djx systems for training and ovx systems for simulation the group model will enable a robot to learn from a handful of human demonstrations so it can help with tasks and emulate human movement just by observing us all this incredible intelligence is powered by the new Jetson Thor robotics chips designed for Gro built for the future with Isaac lab osmo and Groot we're providing the building blocks for the next generation Nvidia the intersection of computer Graphics physics artificial intelligence it all came to bear at this moment the name of that project general robotics
or go look at 1000 grc presntation
No comments:
Post a Comment