Serverless AI Inference Without Kubernetes: GCP Cloud Run, Azure Flex, and the Exit Strategy
Serverless AI inference has crossed a threshold most architects didn’t expect this early: you can now run production GenAI workloads — GPU-accelerated, scale-to-zero, without a single YAML manifest — on GCP Cloud Run and Azure Flex Consumption. For the last three years, running a custom model meant building and operating a Kubernetes cluster. That tradeoff…