Local AI just leveled up... Llama.cpp vs Ollama
Llama.cpp Web UI + GGUF Setup Walkthrough and Ollama comparisons.
Check out ChatLLM: https://chatllm.abacus.ai/ltf
My USB-C portable hub: https://amzn.to/4kw0hrf
๐ My favorite external drive (dependable): https://amzn.to/3Os9Wi3
๐ Thunderbolt 4 dock: https://amzn.to/3yVRicC
โก *Other gear I use:* https://www.amazon.com/shop/alexziskind
โถ๏ธ M2 MacBook Air | INSTANTLY connect 4K monitors - https://youtu.be/KLI65HnvNMg
โถ๏ธ Unity on Steroids M3 Max and RTX 4090m - https://youtu.be/COpEtHzdPG0
โถ๏ธ INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k
โถ๏ธ Ultimate Web Developer MacBook - https://youtu.be/72fneIUHXyY
โถ๏ธ This is what spending more on a MacBook Pro gets you - https://youtu.be/iLHrYuQjKPU
โถ๏ธ Apple Silicon and Developers Playlist - https://youtube.com/playlist?l....ist=PLPwbI_iIX3aR88m
Developer productivity Playlist - https://www.youtube.com/playli....st?list=PLPwbI_iIX3a
โ โ โ โ โ โ โ โ โ
โค๏ธ SUBSCRIBE TO MY YOUTUBE CHANNEL ๐บ
Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1
โ โ โ โ โ โ โ โ โ
๐ฑLET'S CONNECT ON SOCIAL MEDIA
ALEX ON TWITTER: https://twitter.com/digitalix
โ โ โ โ โ โ โ โ โ
Join this channel to get access to perks:
https://www.youtube.com/channe....l/UCajiMK_CY9icRhLep
โฑ๏ธ Chapters
00:00 โ Local LLMs, many stacks
01:05 โ Building from source
04:15 โ Picking a GGUF model
07:56 โ New Llama.cpp Web UI
09:06 โ Ollama UI & speed check
10:44 โ Ollamaโs concurrency limit
11:48 โ Llama.cpp parallel chats
#llm #llamacpp #macbook
