рдЕрдЧрд▓рд╛

рд╕реНрд╡рдд: рдкреНрд▓реЗ

i got one....and it's FAST!!!

0 рд╡рд┐рдЪрд╛рд░реЛрдВ тАв 09/24/26
рд╢реЗрдпрд░ рдХрд░рдирд╛
рдПрдореНрдмреЗрдб
Tomme
Tomme
рдЧреНрд░рд╛рд╣рдХреЛрдВ
0

Dip your toe into local AI at Micro Center, the AI destination: https://micro.center/322535
Austin, Texas: sign up now for a FREE 128GB flash drive, redeemable when the new Austin store opens: https://micro.center/196cca

Apple says the new M5 Ultra Mac Studio is up to 4x faster than the M3 Ultra at LLM prompt processing. I own an M3 Ultra Mac Studio, so I raced them head to head on local AI: same model, same prompt, same settings. On a 32,000-token prompt with Qwen3.8 27B, the M5 Ultra started answering in 21.7 seconds. The M3 Ultra took 82.8. That's 3.8x. Then the M5 wrote the answer 1.5x faster (43.3 vs 28.1 tokens per second), which lines up with its jump in memory bandwidth from 819 GB/s to 1.2 TB/s.

Then I threw my real work at it. Whisper transcribed two hours of my audio in about a minute and a half. A local vision model described my footage, a job I pay the Gemini video API for right now. I generated images with FLUX.2 and video with LTX-2.5, ran my Hermes agent on a local model, tried an open decision model (Laya) in place of Jev, and let a local model edit a video in DaVinci Resolve through its MCP server. All of it runs on the Mac. No internet required.

In this video you'll learn how the M5 Ultra and M3 Ultra compare for running LLMs locally with MLX, why the wait for the first word (time to first token) got about 4x shorter while writing speed only got 1.5x faster, how model size and dense vs mixture-of-experts models change the numbers, and whether a Mac Studio makes sense as your own local AI server.

Apple loaned me the M5 Ultra Mac Studio for this video, and it goes back to them. They don't control what I say, and all the tests and all the numbers are mine.

Join the NetworkChuck Academy!: https://ntck.co/NCAcademy

RESOURCES / LINKS:
ЁЯУК Every result, the raw data and my benchmark tool: https://github.com/theNetworkC....huck/mac-studio-m5-u
ЁЯМР The results as a web page: https://thenetworkchuck.github.....io/mac-studio-m5-ul
ЁЯНО Shop Apple at Micro Center: https://micro.center/65c6f2
ЁЯУ░ Micro Center News: https://micro.center/5059e1
ЁЯЫая╕П MLX (Apple's machine learning framework): https://github.com/ml-explore/mlx
ЁЯЫая╕П mlx-lm (runs the chat models): https://github.com/ml-explore/mlx-lm
ЁЯдЦ Qwen3.8 27B, 4-bit MLX (the race model): https://huggingface.co/mlx-com....munity/Qwen3.8-27B-4
ЁЯОЩя╕П Whisper on MLX: https://github.com/ml-explore/mlx-examples/tree/main/whisper
ЁЯЦ╝я╕П mflux (FLUX.2 on MLX): https://github.com/filipstrand/mflux
ЁЯЦ╝я╕П FLUX.2 klein 4B: https://huggingface.co/black-f....orest-labs/FLUX.2-kl
ЁЯОм LTX-2.5 video model: https://huggingface.co/Lightricks/LTX-2.5
ЁЯза Laya decision model: https://huggingface.co/convaiinnovations/laya
ЁЯдЦ Hermes Agent: https://github.com/NousResearch/hermes-agent
ЁЯУ║ Set up your own Hermes agent: https://www.youtube.com/watch?v=QQEgIo4Juxg
ЁЯдЦ LM Studio (and Bionic): https://lmstudio.ai
ЁЯОм DaVinci Resolve: https://www.blackmagicdesign.c....om/products/davincir

**Sponsored by Micro Center

SUPPORT NETWORKCHUCK:
тШХтШХ COFFEE and MERCH: https://ntck.co/coffee

READY TO LEARN??
ЁЯФеЁЯФеJoin the NetworkChuck Academy!: https://ntck.co/NCAcademy
ЁЯУЪ CCNA Course: https://ntck.co/ccna

FOLLOW ME EVERYWHERE:
Instagram: https://www.instagram.com/networkchuck/
X/Twitter: https://x.com/networkchuck
Facebook: https://www.facebook.com/NetworkChuck/
Join the Discord server: https://ntck.co/discord

Some links in this description are affiliate links. If you buy through them, I may earn a small commission at no extra cost to you.

#macstudio #localai #m5ultra

рдФрд░ рджрд┐рдЦрд╛рдУ
0 рдЯрд┐рдкреНрдкрдгрд┐рдпрд╛рдБ sort рдЗрд╕рдХреЗ рдЕрдиреБрд╕рд╛рд░ рдХреНрд░рдордмрджреНрдз рдХрд░реЗрдВ

рдЕрдЧрд▓рд╛

рд╕реНрд╡рдд: рдкреНрд▓реЗ