MacMusic  |  PcMusic  |  440 Software  |  440 Forums  |  440TV  |  Zicos
tokens
Recherche

AMD predicts future AI PCs will run 30B parameter models at 100 tokens per second

lundi 15 juillet 2024, 15:01 , par TheRegister
They're gonna need a heck of a lot of memory bandwidth – not to mention capacity – to do it
Analysis Within a few years, AMD expects to have notebook chips capable of running 30-billion-parameter large-language models locally at a speedy 100 tokens per second.…
https://go.theregister.com/feed/www.theregister.com/2024/07/15/amd_ai_pc_goal/

Voir aussi

News copyright owned by their original publishers | Copyright © 2004 - 2024 Zicos / 440Network
Date Actuelle
dim. 22 déc. - 11:04 CET