cross-posted from: https://feddit.online/c/tech@piefed.world/p/2025703/anthropic-warns-of-self-replicating-ai-worm-threat-that-doesn-t-need-data-centers-to-se
cross-posted from: https://feddit.online/c/tech@piefed.world/p/2025703/anthropic-warns-of-self-replicating-ai-worm-threat-that-doesn-t-need-data-centers-to-se
Read the article. A MoE model distributed between multiple devices can function just very slowly. It doesn’t need to translate Icelandic poetry just execute narrowly scoped actions it was specifically trained on.
My extremely back-of-envelope estimate would be that it’s 100,000x slower to run inference on an IoT botnet compared to a data center GPU.
100x penalty for cpu inference, 10x penalty for cpu quality, 10x penalty for crappy ram + disk, 10x sync penalty because you have to split up layers across nodes.
And this is ignoring the standard showstopper issues you get with high-bandwidth distributed networking applications with spottily connected nodes.
If you wanna talk about runaway AI risk, then the real threat to humanity is a frontier model with unauthorized data center TPU access, not IoT. The call is coming from inside the house, and they even spell this out at the beginning before pivoting to the fearmongering.
In one sense you’re not wrong at all.
Playing devils advocate here… because, in another sense, 100,000x slower isn’t really all that slow if you’re distributed amongst a network with 100,000,000 more units. Imagine agile on steroids.
It’s impractical, yet impractical doesn’t mean impossible. It can happen if environmental pressures make it so.
Another important thing to keep in mind is that agents don’t really have patience, which counterintuitively means it’s like they’re infinitely patient. If such a thing did exist, regardless of speed, it sounds like it would be an issue at some point down the road.
Thirdly, if such a thing did exist, wouldn’t this be like treating with antibiotics? If you stop all but the sneakiest, you’ll have created a stronger generation.
Lastly, I swear to fucking god… I keep seeing weirdly relatable shit news from these AI companies almost immediately after I post hypothetical thought experiments on stuff… like all the time. I have a post describing this hypothetical from a week ago on another platform.
This keeps happening and I’m justifying it by thinking, I’m probably way too plugged into this shit news. My brain is unknowingly predicting their next move, because it’s the next logical piece of shit thing for a shit AI company to do? That’s the reasonable explaination — right? Really trying not to believe their training loop is so fast, and I just happen to come up with stories that catch their eye. That would be wild to believe — right?
Edit: https://www.reddit.com/r/agi/s/gbXn14KSYI
There you have it. I made that post 4 days ago, meanwhile the post OP linked is 9 hours old.
I was just thinking to myself about a week ago how weird it is, that this keeps happening. I almost commented about it on another thread; I backspaced my text thinking, ”nooo, I sound crazy.” Well here I am a week later finding myself, yet again, experiencing this weird fucking phenomenon.
This is like the like the “9 women in one month to make a baby” comment.
There is only so much you can distribute the layers of a model due to interconnectedness. And you can’t run multiple inferences at the same time because the next token relies on the previous.
You could be doing multiple things at once, but each task will run “100,000x” if the OC did their math right.
You can just turn off a data center. How are you gonna turn off a thousand refrigerators?