BentoML

BentoML is a compute orchestration platform for building and scaling compound AI systems.