From DevOps to MLOps: Scaling ML models to 2 Million+ requests per day
The challenge with Machine Learning (ML) models is productionizing. It requires data ingestion, data preparation, model training, model deployment, and monitoring. Adopting MLOps practices is similar to DevOps practices. In MLOps, the workload changes, but some core principles like automation, continuous integration/continuous deployment (CI/CD), and monitoring. Taking DevOps practices, I will discuss the similarities and differences in adopting MLOps practices. In this talk, Chinmay takes a production use case to scale ML models to 2 million+ daily requests. It leverages Google Cloud's (GCP) infrastructure to use its GPU and other services. This talk will help you draw similarities between DevOps and MLOps as a DevOps practitioner and help you learn how to run Machine Learning models at the production scale with best practices. Presentation: From DevOps to MLOps: Scaling ML models to 2 Million+ requests per day Speaker: Chinmay Naik, Founder at One2N Event: Cloud devXchange 2024 (http://konfhub.com/cd)
