In order for AI infrsatructure not to be locked into a few vendors, open source cloud native tools could be more widely explored. This is a first step towards building production AI systems on one's own terms keeping data sovereign, optimising expensive GPUs and serving models more efficiently. This session will explore the use of these tools and include real lessons from industry deployment.