How Fast Will Your New Mac Run LLMs?

How fast can the new Apple Silicon Mac you so desperately want run LLM's and is it worth the price?

llama.cpp benchmarks: https://github.com/ggerganov/llama.cp...
Ollama: https://ollama.ai

00;00 Intro
00:47 Benchmarks
05:06 Unbox
05:47 Results

2023 64GB M3 Max at Amazon: https://amzn.to/4ekjSqB

Support My Work:

Check out my website: https://www.ianwootten.co.uk
Follow me on twitter:   / iwootten  
Subscribe to my newsletter: https://newsletter.ianwootten.co.uk

Buy me a cuppa: https://ko-fi.com/iwootten
Learn how devs make money from Side Projects: https://niftydigits.gumroad.com/l/sid...

NB: As an Amazon associate I earn a commission on purchases through links to amazon at no extra cost to you.