I managed to get a 135-million parameter LLM running on-chain in CPU mode. Pretty wild setup, but Internet Computer is honestly the only blockchain infrastructure flexible enough to handle this kind of workload today. Big credit to their network design for making it possible.
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
10 Likes
Reward
10
8
Repost
Share
Comment
0/400
down_only_larry
· 11h ago
IC is blowing up, really much more flexible than other public chains.
View OriginalReply0
SerumSquirter
· 13h ago
Wow, ICP this time is really amazing, running on-chain with 135M parameters? This is what true on-chain computation should look like.
View OriginalReply0
RamenStacker
· 13h ago
NGL, this move is really bold; running 135 million parameters directly on-chain. IC's architecture is indeed quite impressive.
View OriginalReply0
BlockchainBard
· 13h ago
NGL, IC's network design is indeed impressive. I never thought of this kind of on-chain LLM approach before.
View OriginalReply0
ConsensusBot
· 13h ago
Damn, this is what real on-chain computation is. The previous ones were just bragging.
View OriginalReply0
MondayYoloFridayCry
· 13h ago
But to be honest, IC is really impressive, able to run such large models directly?
View OriginalReply0
GasFeeCrier
· 13h ago
IC's move this time is really fierce; other chains have already fallen to their knees.
View OriginalReply0
GasFeeVictim
· 13h ago
ngl this is true on-chain computation, the previous ones were just toy-level.
I managed to get a 135-million parameter LLM running on-chain in CPU mode. Pretty wild setup, but Internet Computer is honestly the only blockchain infrastructure flexible enough to handle this kind of workload today. Big credit to their network design for making it possible.