Tooling, Frameworks & the Future of Edge AI | Edge of Tomorrow - The Edge AI Debate

Edge AI is evolving quickly - what’s changing in the tooling and frameworks that support it? And where do the biggest opportunities for improvement lie?

In this episode of Edge of Tomorrow – The Edge AI Debate, host Pete Bernard (CEO, EDGE AI FOUNDATION) is joined by Elia Schoenberger (Product Marketing, AI Division at CEVA) and Nathan Francis (Business Development at AIZip) for an in-depth discussion on the role of tooling and frameworks in shaping the future of Edge AI.

While much of the attention in AI is placed on models and hardware, this conversation focuses on the layers in between — compilers, SDKs, deployment pipelines, and frameworks — and how they influence speed, scalability, and collaboration across the ecosystem.

The discussion explores how hardware constraints, model design, and tooling choices intersect, whether the industry is moving toward standardisation or continuing to prioritise innovation, and what practical steps could help simplify Edge AI development without slowing progress.

This episode offers a look at how the Edge AI stack is evolving - and what it will take to support broader, more efficient deployment in the years ahead.

Chapters…
00:00 Introductions
01:40 Why tooling and frameworks matter in Edge AI
03:25 Hardware constraints, models, and deployment realities
05:23 Fragmentation vs fit-for-purpose tooling
07:59 Power, performance, and memory trade-offs
09:18 Where Edge AI sits on the maturity curve
11:32 Standardisation, innovation, and ecosystem balance
13:32 Compilers, MLIR, and unifying the toolchain
16:02 Deployment challenges and quantisation complexity
25:17 Generative models arriving at the edge
31:36 Local-first intelligence and when the cloud still matters
32:52 What would help accelerate Edge AI development
36:13 Final reflections and closing thoughts

🎧 The episode is live on all major listening platforms now: https://linktr.ee/theiotpodcast

Connect with our guests…
Elia Schoenberger (CIVA,Inc):   / eliashenberger  
Nathan Francis (AIZip):   / nathanfrancis99  

About Edge of Tomorrow – The Edge AI Debate
Edge of Tomorrow is our debate-led spin-off series bringing together leaders from across the Edge AI ecosystem to explore the technical, commercial, and strategic decisions shaping how intelligence moves closer to the real world.

SUBSCRIBE TO THE IOT PODCAST ON YOUR FAVOURITE LISTENING PLATFORM: https://linktr.ee/theiotpodcast

Sign up for exclusive email updates: https://theiotpodcast.com/get-exclusi...

Contact us to become a guest or partner: https://theiotpodcast.com/contact/