Elon Musk gives an overview of the challenges one might face when trying to use NVIDIA GPUs. #elonmusk #interview #viral
Code The Future
Elon Musk gives an overview of the challenges one might face when trying to use NVIDIA GPUs. #elonmusk #interview #viral
Dude wants to put chips in our head and is an intelligence contractor.
Soooo
Why you ruined us. You shit all over me. I actually loved you
For people wondering, NVIDEA GPU’s are used to run LLM’s (large language models). GPU’s excel at mathematical floating point calculations which are required to perform training of the models. Basically they ingest all sorts of content, words, or images , to create the models that are used to describe things. Imagine feeding it 100,000 images of a variety of dogs so it can learn what dogs look like. The processors are all interconnected. They speed up and slow down during the learning process as different commands are executed. When they change speed the do so in a coordinated fashion (hence the symphony). They use more power when they speed up and less power when the slow down. These speed changes happen rapidly. And since you are dealing with a 50000 node cluster, the power changes are significant. I’m not sure how they address those power demand fluctuations. Perhaps with large scale capacitors in a UPS? 50000 nodes throttling up and down could amount to 5 megawatt or greater power fluctuations in very short periods of time.
And of course as any gamer will tell you, GPUs can massively spike way beyond their specified power draw for a fraction of a second when under load. Fun times in a cluster.
What about balancing a load across a battery Bank?
Elon, thanks for everything you do for humanity. I wish you would consider Kennedy instead of Trump. I love Trump, but i think he will be too easily swayed by Party insiders like las time. Not as badly – but still. Kennedy & Shanahan are better managere. Did you see her interview with Weinstein the physics guy? Amazing. A very smart lady and sees the whole chessboard, not just one move combination.
Isn't that a problem that a capacitor is designed to solve? Why not use very large capacitors to continuously draw large amounts of power (this should be calculated depending on the amount of GPU usage you project to use), and the gpu power draw should come from the capacitor banks. Any excess energy can be redirected to the grid after training.
IT'S A 'DIRTY ' SIGNAL
😎
🤙
As someone who knows about the power industry. Can confirm these data facilities load are an interesting thing to work around.
Thanks for posting this. I'm more brain enriched now
Its refreshing to see a short of Elon talking about something he enjoys instead of watching him swatting flies that call themselves journalists.
I have NO idea what he’s talking about. That’s why he’s the millionaire and I’m not. Oh well……
You really never give up❤❤❤
Good luck with Texas’ electric grid which is notoriously unreliable because it is completely independent from the rest of the country and can’t access power from the national grid when the State’s power is tapped out.
Gpu lol
You explain this so well Elon 😉❤
🤔 mhm I get it
a visionary innovator on his journey "Elon the Great."❤💙❤️👍👁️🇵🇭
I'm nodding along wisely as I watch this… pretending I know what the hell he’s talking about.
Elon Hiem I miss you
And charge to customers who are watched that programs, Last night I also heard charges American Express, which is not my account, much digging into my family’s.
There are many skills in technology, has keeping improving, changing, try to use the smallest adjustment to get the most Economic efficiency.
I have learnt those people has special pen, can took out certain people in photos, or adding in new ideas in photos, like in the soccer game.