What Computer Should You Buy for Local AI
I turned years of local AI benchmarks into an app that helps you figure out what hardware actually makes sense for the models you want to run.
๐น Try Replit: https://replit.com/refer/AlexanderZiskin
๐ Gear Links ๐
๐ ๏ธ๐ WisdPi 10G Ethernet Expansion Card for Framework: https://frame.work/products/wi....sdpi-10g-ethernet-ex
๐ช๐ชHighly rated precision driver kit: https://amzn.to/4fkMVfg
๐ปโ Favorite 15" display with magnet: https://amzn.to/3zD1DhQ
๐งโก Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW
๐ ๏ธ๐ My nvme ssd: https://amzn.to/3YLEySo
๐ฆ๐ฎ My gear: https://www.amazon.com/shop/alexziskind
๐ฅ Related Videos ๐ฅ
๐ธ๐ง Quant comparison vid - Everything looks fine at 4-bit
https://youtu.be/8IzUyLLn5NA
๐งณ๐งฐ Mini PC portable setup - https://youtu.be/4RYmsrarOSw
๐๐ป Dev setup on Mac - https://youtu.be/KiKUN4i1SeU
๐ธ๐ง Cheap mini runs a 70B LLM ๐คฏ - https://youtu.be/xyKEQjUzfAk
๐งช๐ฅ RAM torture test on Mac - https://youtu.be/l3zIwPgan7M
๐โก FREE Local LLMs on Apple Silicon | FAST! - https://youtu.be/bp2eev21Qfo
๐ง ๐ REALITY vs Appleโs Memory Claims | vs RTX4090m - https://youtu.be/fdvzQAWXU7A
๐งฌ๐ Set up Conda - https://youtu.be/2Acht_5_HTo
โก๐ฅ Thunderbolt 5 BREAKS Appleโs Upcharge - https://youtu.be/nHqrvxcRc7o
๐ง ๐ INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k
๐งฑ๐ฅ๏ธ Mac Mini Cluster - https://youtu.be/GBR6pHZ68Ho
* ๐ ๏ธ Developer productivity Playlist - https://www.youtube.com/playli....st?list=PLPwbI_iIX3a
๐ AI for Coding Playlist: ๐ - https://www.youtube.com/playli....st?list=PLPwbI_iIX3a
Local AI Advisor: sorry, had to remove the link temporarily - lots of people โcontributingโ. itโs pretty funny, but not super helpful. weโll be back soon
โ โ โ โ โ โ โ โ โ
โค๏ธ SUBSCRIBE TO MY YOUTUBE CHANNEL ๐บ
Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1
โ โ โ โ โ โ โ โ โ
Join this channel to get access to perks:
https://www.youtube.com/channe....l/UCajiMK_CY9icRhLep
โ โ โ โ โ โ โ โ โ
๐ฑ ALEX on X: https://x.com/digitalix
#replit #llm #ai

SORT BY-
Mga Nangungunang Komento
-
Pinakabagong komento