|
Navigation
Recherche
|
How this open source LLM chatbot runner hit the gas on x86, Arm CPUs
mercredi 3 avril 2024, 12:34 , par TheRegister
Way to whip that LLaMA's ass
A handy open source tool for packaging up LLMs into single universal chatbot executables that are easy to distribute and run has apparently had a 30 to 500 percent CPU performance boost on x86 and Arm systems.…
https://go.theregister.com/feed/www.theregister.com/2024/04/03/llamafile_performance_gains/
|
56 sources (32 en français)
Date Actuelle
ven. 29 nov. - 05:47 CET
|
Lire la suite sur TheRegister