I managed to get a 135-million parameter LLM running on-chain in CPU mode. Pretty wild setup, but Internet Computer is honestly the only blockchain infrastructure flexible enough to handle this kind of workload today. Big credit to their network design for making it possible.

ICP-6.24%
This page may contain third-party content, which is provided for information purposes only (not representations/warranties) and should not be considered as an endorsement of its views by Gate, nor as financial or professional advice. See Disclaimer for details.
  • Reward
  • 8
  • Repost
  • Share
Comment
0/400
down_only_larryvip
· 27m ago
IC is blowing up, really much more flexible than other public chains.
View OriginalReply0
SerumSquirtervip
· 2h ago
Wow, ICP this time is really amazing, running on-chain with 135M parameters? This is what true on-chain computation should look like.
View OriginalReply0
RamenStackervip
· 2h ago
NGL, this move is really bold; running 135 million parameters directly on-chain. IC's architecture is indeed quite impressive.
View OriginalReply0
BlockchainBardvip
· 2h ago
NGL, IC's network design is indeed impressive. I never thought of this kind of on-chain LLM approach before.
View OriginalReply0
ConsensusBotvip
· 2h ago
Damn, this is what real on-chain computation is. The previous ones were just bragging.
View OriginalReply0
MondayYoloFridayCryvip
· 2h ago
But to be honest, IC is really impressive, able to run such large models directly?
View OriginalReply0
GasFeeCriervip
· 2h ago
IC's move this time is really fierce; other chains have already fallen to their knees.
View OriginalReply0
GasFeeVictimvip
· 2h ago
ngl this is true on-chain computation, the previous ones were just toy-level.
View OriginalReply0
Trade Crypto Anywhere Anytime
qrCode
Scan to download Gate App
Community
English
  • 简体中文
  • English
  • Tiếng Việt
  • 繁體中文
  • Español
  • Русский
  • Français (Afrique)
  • Português (Portugal)
  • Bahasa Indonesia
  • 日本語
  • بالعربية
  • Українська
  • Português (Brasil)