Services

Resources

Company

Mohit Kumar - Billion Rows Walk Into a Go Bar

Dec 1, 2024

In this talk from GopherCon India 2024, we delve into the quest for extreme performance optimization by tackling the 1BRC (1 Billion Row Challenge). Discover how a program initially taking several minutes to complete was transformed to run in just a few seconds. Along the way, we’ll explore how to move beyond abstractions and deal directly with data at massive scale.

We’ll examine practical techniques, such as using pprof for pinpointing memory allocations, garbage collection overhead, and performance bottlenecks. Learn about the subtle code changes—like one that cut memory allocations from 15+GB down to a mere 2MB—and gain insights that you can immediately apply to your own Go projects.

By watching this talk, you’ll:

Develop “mechanical sympathy” when handling large-scale data.

Understand how pprof can identify the hidden bottlenecks lurking in your code.

Learn to write more efficient and performant Go programs in your everyday development work.

Continue watching

Watch Talk

Kubernetes for Hybrid Cloud Environments - Harshwardhan Mehrotra - #60 Kubernetes Pune Meetup

Harshwardhan Mehrotra

SRE @One2N

Scaling Kubernetes workloads across 40+ data centers is hard – especially when you must meet strict data residency and latency requirements while still leveraging the public cloud. In this talk from the Kubernetes Pune Meetup, Harshwardhan Mehrotra (Site Reliability Engineer at One2N) walks through how his team designed and operated an EKS hybrid setup for a large betting platform with data centers across the US, UK, and Europe. You’ll see how they connected on‑prem worker nodes to an AWS EKS control plane, handled networking at scale, and kept the developer experience close to a “normal” EKS cluster. What you’ll learn: - Why EKS hybrid was chosen over fully on‑prem or fully cloud, and how regulatory and latency constraints shaped the architecture. - How to design pod vs node networking, routable vs non‑routable pod networks, and when to bring in BGP. - How to connect 40+ data centers to AWS using Direct Connect / site‑to‑site VPN and Cilium/Calico CNIs. - How to expose apps using F5 and Istio/NGINX ingress when ALB is not an option. - Real‑world issues with DNS (CoreDNS, Route 53 limits, node‑local DNS) and traffic distribution, plus how they fixed them. - Lessons on egress control, firewall bottlenecks, add‑on placement (Argo CD, KEDA, Prometheus, etc.), and building repeatable playbooks for on‑prem nodes. - This talk is ideal for platform engineers, SREs, and architects running Kubernetes across data centers and cloud, or evaluating EKS hybrid for regulated workloads.

Watch Talk

Kubernetes for Hybrid Cloud Environments - Harshwardhan Mehrotra - #60 Kubernetes Pune Meetup

Harshwardhan Mehrotra

SRE @One2N

Scaling Kubernetes workloads across 40+ data centers is hard – especially when you must meet strict data residency and latency requirements while still leveraging the public cloud. In this talk from the Kubernetes Pune Meetup, Harshwardhan Mehrotra (Site Reliability Engineer at One2N) walks through how his team designed and operated an EKS hybrid setup for a large betting platform with data centers across the US, UK, and Europe. You’ll see how they connected on‑prem worker nodes to an AWS EKS control plane, handled networking at scale, and kept the developer experience close to a “normal” EKS cluster. What you’ll learn: - Why EKS hybrid was chosen over fully on‑prem or fully cloud, and how regulatory and latency constraints shaped the architecture. - How to design pod vs node networking, routable vs non‑routable pod networks, and when to bring in BGP. - How to connect 40+ data centers to AWS using Direct Connect / site‑to‑site VPN and Cilium/Calico CNIs. - How to expose apps using F5 and Istio/NGINX ingress when ALB is not an option. - Real‑world issues with DNS (CoreDNS, Route 53 limits, node‑local DNS) and traffic distribution, plus how they fixed them. - Lessons on egress control, firewall bottlenecks, add‑on placement (Argo CD, KEDA, Prometheus, etc.), and building repeatable playbooks for on‑prem nodes. - This talk is ideal for platform engineers, SREs, and architects running Kubernetes across data centers and cloud, or evaluating EKS hybrid for regulated workloads.