Using Clusters to Boost LLMs ๐
I test the cluster workflow that allowed Alex to run Llama 405B model on 2 laptops!
Check out DevStarterPack here: https://devstarterpack.io
๐ Gear Links ๐
* ๐๐ฅ K9 Mini with 32GB RAM: https://amzn.to/3ZiKjcp
* ๐ ๏ธ๐ 96GB RAM kit: https://amzn.to/3ZhQ4qR
* ๐ป๐ Renewed MacBook Air M1 Deal: https://amzn.to/45K1Gmk
* ๐งโก Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW
* ๐ ๏ธ๐ My nvme ssd: https://amzn.to/3YLEySo
* ๐ฆ๐ฎ My gear: https://www.amazon.com/shop/alexziskind
๐ฅ Related Videos ๐ฅ
* ๐ค REALITY vs Appleโs Memory Claims - https://youtu.be/fdvzQAWXU7A
* ๐ RAM torture test on Mac - https://youtu.be/l3zIwPgan7M
* ๐ ๏ธ FREE Local LLMs on Apple Silicon | FAST! - https://youtu.be/bp2eev21Qfo
* ๐ ๏ธ Set up Conda - https://youtu.be/2Acht_5_HTo
* ๐ค INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k
* ๐ ๏ธ Conda setup for Python dev - https://youtu.be/2Acht_5_HTo
* ๐ ๏ธ Developer productivity Playlist - https://www.youtube.com/playli....st?list=PLPwbI_iIX3a
๐ AI for Coding Playlist: ๐ - https://www.youtube.com/playli....st?list=PLPwbI_iIX3a
โ โ โ โ โ โ โ โ โ
โค๏ธ SUBSCRIBE TO MY YOUTUBE CHANNEL ๐บ
Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1
โ โ โ โ โ โ โ โ โ
Join this channel to get access to perks:
https://www.youtube.com/channe....l/UCajiMK_CY9icRhLep
โ โ โ โ โ โ โ โ โ
๐ฑ ALEX ON X: https://twitter.com/digitalix
#machinelearning #llm #softwaredevelopment

SORT BY-
Top Reacties
-
Laatste Reacties