• 0 Posts
  • 7 Comments
Joined 3 years ago
cake
Cake day: May 10th, 2024

help-circle




  • IMO the secret NVIDIA sauce (yeah, not making that joke) is CUDA, they put a decade plus of development into it, and it gave them a huge home court advantage. It has been the defacto standard for GPGPU. The threat long term is erosion of that lead.

    Nothing lasts forever, ROCm, especially Vulkan, purpose built kernels for specific hardware, FPGA, RISC-V and even more specialized hardware, the wolves are at the door. Ironically you can now point a LLM at the CUDA spec and say make me that but for my hardware and it’ll get most of the way there. The moat is more of a puddle and so many more shovel salesmen are popping up.

    Add to that the promise of self evolving (real) artificial intelligence is obviously not coming from LLMs and the promise of mass unemployment (it was always the goal, fuck society, it’s profitable) has not happened, except, somewhat, in fields that can be quickly checked for correctness like mathematics, cybersecurity and basic programming. Things that need judgement have to be checked by meat sacks because LLMs reliably make mistakes (‘hallucinate’). So the market is drying up (except where they manufacture it, probably illegally). There’s some market there, but it’s not the Trillions that they need to justify their stock values.

    Things are looking pretty grim, in a few years they could be just another hardware vendor again. You’ll note none of this has to do with CEO charisma or sociopathy. Shit, they may even deign to produce consumer hardware again. Bigger they are, harder they fall.