Services

Resources

Company

Our Work

Blog

MLOps

Back to Tags

Blogs

Cover illustration for Exploring RAG: enhancing LLMs with external knowledge

Read Blog

Exploring RAG: enhancing LLMs with external knowledge
Portrait of Harsh Mishra, SRE

Harsh Mishra

SRE

Portrait of Saurabh Hirani, Principal SRE at One2N

Saurabh Hirani

Principal SRE @One2N

Retrieval augmented generation (RAG) for engineers: LLM basics, where standalone models fall short, and the parts of a RAG app such as embeddings.

Cover illustration for How we used Fly.io to improve a Pipecat-AI chatbot

Read Blog

How we used Fly.io to improve a Pipecat-AI chatbot
Portrait of Ajinkya Wadekar, SRE at One2N

Ajinkya Wadekar

SRE @One2N

Portrait of Spandan Ghosh, Content at One2N

Spandan Ghosh

Content @One2N

A Pipecat-AI chatbot on ECS hit limits at 10 to 15 chat rooms per task, and 6GB images slowed scale-up. How Fly.io machines spun from containers fixed it.

Cover illustration for Understanding MLOps from a software engineers' perspective

Read Blog

Understanding MLOps from a software engineers' perspective
Portrait of Harsh Mishra, SRE

Harsh Mishra

SRE

Portrait of Spandan Ghosh, Content at One2N

Spandan Ghosh

Content @One2N

Portrait of Chinmay Naik, CEO at One2N

Chinmay Naik

CEO @One2N

Portrait of Jaideep Khandelwal, CTO at One2N

Jaideep Khandelwal

CTO @One2N

MLOps for software engineers is DevOps plus data engineering and ML. The MLOps lifecycle, knowledge silos, automation, versioning and experiment tracking.

Talks

Thumbnail for the talk A SRE’s Guide to LLMOps: Deploying and Managing AI⧸ML Workloads using Kubernetes

Watch Talk

A SRE’s Guide to LLMOps: Deploying and Managing AI⧸ML Workloads using Kubernetes
Portrait of Harsh Mishra, SRE

Harsh Mishra

SRE

Harsh Mishra covers LLMOps from an SRE perspective: unique challenges, best practices, and how to future-proof cloud strategy for GenAI and LLM workloads.

Thumbnail for the talk ABC of LLMOps - What does it take to run self-hosted LLMs｜Rootconf mini 2024

Watch Talk

ABC of LLMOps - What does it take to run self-hosted LLMs｜Rootconf mini 2024
Portrait of Jaideep Khandelwal, CTO at One2N

Jaideep Khandelwal

CTO @One2N

Lessons from deploying open-source LLMs on Kubernetes GPUs, managing vector databases and building RAG apps, from Rootconf mini 2024.

Thumbnail for the talk From DevOps to MLOps - Scaling ML models to 2 million API requests per day

Watch Talk

From DevOps to MLOps - Scaling ML models to 2 million API requests per day
Portrait of Chinmay Naik, CEO at One2N

Chinmay Naik

CEO @One2N

Learn how to deploy and scale machine learning models to 2 million requests a day with MLOps best practices, from data preparation to scaling.

‹ Mentorship

Monitoring ›