The Only Guide You Need for Local AI Hardware

Comments · 28

• HI

  @Hikove · 8 hours ago

  This format should be the norm, including a segment for the ADs and done, not pivot the whole video around a sponsor.

  2

• CO

  @CodeTrix22 · 12 hours ago

  Your content has been on fire lately 🔥

  3

• BL

  @blayral · 5 hours ago

  Memory speed has a twist for real numbers : the memory controler is why the numbers differ

• RI

  @rickyu1978 · 11 hours ago

  really clear and easy to understand, no fluff.

• FR

  @frankhocza6758 · 26 minutes ago

  Awesome and clear information. Thanks :)

• KA

  @Kantuski · 11 hours ago

  Great video and explanation. &nbsp;I build using older technology that I have had for years and the satisfaction I feel is when I see 15-18 t/s on a bigger model and then going to a smaller model gets me 55-62 t/s. I run Qwen3.8-27b at around 26 t/s and am happy, but 3.8-9B runs at 55 t/s, that’s my joy.<br>Your explanation makes sense and helps me understand why I love technology so much. 😁

• TO

  @tomislavvukojevic2479 · 6 hours ago

  Full precision it’s 32 bit it’s about four time more than Q8 <a href="https://www.youtube.com/watch?v=x6siPRkPAeQ&amp;t=63">1:03</a>

  1

• PU

  @pushpendratripathi46 · 11 hours ago

  Macbook air m5 and m1 are all I have currently

  1

• CA

  @CapCrunch45 · 11 hours ago

  Hey Tim, I know this is a bit off-topic, but will there be a new video in the Rust tutorial playlist where you teach about ownership? I really enjoy your coding tutorials, and I’d like to learn more how to code manually in Rust (even in the age of AI).

  2

• SU

  @SuperGrimmy · 5 hours ago (edited)

  The most affordable option right now if you have parts for a linux server. Install Ubuntu 26 and throw in a Radeon AI PRO R97000 32G. Works out of the box with ollama. I think almost anyone can set that up in no time. This assumes 32GB is enough for your use case. Expanding to two cards is an option, but you&apos;ll need to find a 8x/x8 motherboard. That gives you 64GB and that&apos;s the practical cap for that setup. It all depends on your budget, use case and needs. Mine are more or less running 24/7, something that can be a problem for consumer cards.

• IP

  @iPaintCars_215 · 2 hours ago

  For anyone thinking ryzen, look for something with lpddr5 that’s soldered on. Its bandwidth speed is higher than standard ddr5 and you’ll need every bit of it… learned the hard way. Although 15-20 tok/s is usable regardless of what everyone will have u believe

• JO

  @jointdr.hoffman5991 · 3 hours ago

  Hey Bro,<br>Appreciate U 4Great info provided.<br>Let us know on how it behaves in relation with that Mac mini M6 + 32 gb