i got one....and it's FAST!!!

Comments · 767

• NE

  @NetworkChuck · 7 days ago · pinned

  Dip your toe into local AI at Micro Center, the AI destination: <a href="https://micro.center/322535">https://micro.center/322535</a><br>Austin, Texas: sign up now for a FREE 128GB flash drive, redeemable when the new Austin store opens: <a href="https://micro.center/196cca">https://micro.center/196cca</a><br><br>Apple says the new M5 Ultra Mac Studio is up to 4x faster than the M3 Ultra at LLM prompt processing. I own an M3 Ultra Mac Studio, so I raced them head to head on local AI: same model, same prompt, same settings. On a 32,000-token prompt with Qwen3.8 27B, the M5 Ultra started answering in 21.7 seconds. The M3 Ultra took 82.8. That&apos;s 3.8x. Then the M5 wrote the answer 1.5x faster (43.3 vs 28.1 tokens per second), which lines up with its jump in memory bandwidth from 819 GB/s to 1.2 TB/s.<br><br>Then I threw my real work at it. Whisper transcribed two hours of my audio in about a minute and a half. A local vision model described my footage, a job I pay the Gemini video API for right now. I generated images with FLUX.2 and video with LTX-2.5, ran my Hermes agent on a local model, tried an open decision model (Laya) in place of Jev, and let a local model edit a video in DaVinci Resolve through its MCP server. All of it runs on the Mac. No internet required.<br><br>In this video you&apos;ll learn how the M5 Ultra and M3 Ultra compare for running LLMs locally with MLX, why the wait for the first word (time to first token) got about 4x shorter while writing speed only got 1.5x faster, how model size and dense vs mixture-of-experts models change the numbers, and whether a Mac Studio makes sense as your own local AI server.<br><br>Apple loaned me the M5 Ultra Mac Studio for this video, and it goes back to them. They don&apos;t control what I say, and all the tests and all the numbers are mine.<br><br>Join the NetworkChuck Academy!: <a href="https://ntck.co/NCAcademy">https://ntck.co/NCAcademy</a>

  23

• YD

  @YDMU-A-A-Ron · 7 days ago

  If i lived anywhere near a Micro Center, I&apos;d be bankrupt and divorced.... LOL

  186

• SI

  @simonhinger8176 · 7 days ago (edited)

  <a href="https://www.youtube.com/watch?v=CbWySQdAM60&amp;t=65">01:05</a> &quot;I need to send it back.&quot; <b>immediately puts sticker on it</b>

  64

• VO

  @voodooChild225 · 7 days ago

  I’ve known you pray for audience for a while but this one really hit me. I pray for you as well and your family! Thank you for praying for us!

  65

• TA

  @taylormathews9013 · 7 days ago

  I want more local AI content and Hermes

  8

• UR

  @UrFavDudeOnUtube · 5 days ago

  The first time you did the prayer, it felt strange. I’d never seen anyone, especially in the tech community, do something like that. But now, after months, it feels just right. I lost my friend this week, and your prayer really hit all the right buttons for me. Thank you so much. God bless you and your family.

  3

• UU

  @UUHope · 7 days ago

  God bless you and your family, Chuck!

  14

• WE

  @WestSquared · 6 days ago (edited)

  Loved the video. The prayer at the end caught me off guard though. In the best way you can imagine. Blessed to subscribe and thank you.

  4

• WA

  @watchingtheworld734 · 7 days ago

  I had no idea chuck was an ai all this time. &nbsp;Thank goodness for the tag I would of never known without it.

  15

• QU

  @quinxx12 · 7 days ago

  Yes, I believe the M5 Ultra has now finally balanced out all the factors to have a functional local AI setup.

  3

• DU

  @dutchdev2951 · 7 days ago (edited)

  I dont know why but usually dont leave comments but felt like i had to. Havent watched you for a while but came back because the algo i guess and wanted to see what the m5 could do. But thats not why im writing a comment. It is the first time ever that i have seen your praying during a video. thank you for being an amazing human being and keep up to good work!

  3

• HA

  @haitham5730 · 4 days ago

  Amen .. 🙏 <br>Your prayer has touched the core of my suffering.

  3