Anyscale on Azure: Scale Python AI workloads with managed Ray on AKS

2 Jun 2026

Play episode WhatsApp Download

Episode notes

Scott Hanselman talks with Omar Shorbaji from the Anyscale engineering team about how Anyscale on Azure scales Python AI workloads from a single notebook to thousands of CPUs and GPUs. Built on Ray, the most widely adopted AI compute engine, Anyscale gives you a unified runtime to build, train, and serve, running directly on Azure Kubernetes Service without the complexity of managing Kubernetes. See a live demo that fine-tunes a vision-language-action robotics policy, with the metrics you need to push GPU utilization higher. Chapters 00:00 - Introduction 00:52 - Ray and the Anyscale platform…

Podcast

Azure Friday

Scott Hanselman · Tech & Science · English

Scott Hanselman sits with engineers who build and run Azure services — weekly conversations on new features, best practices and Microsoft cloud.

More from Azure Friday All episodes →

24 Jul 2026
Future-proof Postgres for better performance and scale
See how a single Azure Database for PostgreSQL Flexible Server scales read-heavy workloads using read replicas and virtual endpoints — the same pattern OpenAI relies on to run ChatGPT on Postgres. Scott and Paula show a live read workload saturating a primary, then offload it to a replica with a single hostname change, and finish with replicas across Europe staying within milliseconds of the primary. It's read scale-out without sharding or re-architecting your app. Chapters 00:30 - Introduction 01:55 - Why read replicas: read/write asymmetry 03:45 - Architecture: primary, replicas, and…
10 Jul 2026
Turning Coding Agents into an Azure Cosmos DB Expert with the Agent Kit
In this Azure Friday episode, Scott Hanselman and Sajee demonstrate the Azure Cosmos DB Agent Kit — a skill you install with one command that gives your coding agent 100+ Cosmos DB best-practice rules across data modeling, partitioning, query optimization, and SDK usage and much more. Using a multi-agent fitness coaching app as an example, they show how the kit caught a missing partition key filter that was leaking member data across tenants, recommended hierarchical partitioning for multi-tenant scale, and fixed a fan-out query—all before the code shipped to production. Chapters 00:00 -…
26 Jun 2026
Meet Azure HorizonDB, the new Postgres on Azure
Azure HorizonDB is a new Postgres service on Azure built for scale, availability, and performance across any workload. In this episode of Azure Friday, we look at how HorizonDB delivers predictable performance with built-in zone resilience. We also explore new in-database AI features like AI Model Management and AI Pipelines, and walk through the developer experience in VS Code to build, query, and manage efficiently using AI. Chapters 00:00 - Introduction 00:47 - HorizonDB Architecture Overview 02:47 - Performance Demo 03:37 - AI Model Management 04:19 - VS Code Postgres Tools Overview…
19 Jun 2026
Observe and evaluate agents for quality and safety in Microsoft Foundry
Foundry Observability empowers developers to take agents from prototype to production with end-to-end observability. We demonstrate how evaluations, tracing, monitoring, and optimization work together to identify issues, measure quality, and improve outcomes over time. Through a live demo spanning the Foundry portal and VS Code, we showcase a practical workflow for building more reliable, production-ready agents. Chapters 00:00 - Introduction 01:33 - Foundry portal demo 06:58 - VS Code demo 17:43 - Wrap up Recommended resources Observability in Generative AI - Microsoft Foundry Build 2026…
3 Jun 2026
New file share centric management model for Azure Files
The new Azure file share experience is now generally available! In this episode of Azure Friday, we explore how the new management model simplifies the way you create and manage file shares, helping streamline your day-to-day operations. We also walk through the updated portal experience and highlight some of the key benefits of the new file share experience. Chapters 00:00 - Introduction 03:38 - Demo on portal 10:20 - Benefits 12:54 - Closing & learn more Recommended resources Learn Docs Azure Product page Blog post Connect Scott Hanselman | Twitter/X: @SHanselman Azure Friday | Twitter/X:…
8 May 2026
Azure MCP and Azure Skills
Explore Azure MCP Server and Azure Skills working together to extend AI capabilities across Azure services. In this video, we walk through the developer experience in VS Code, showing how to configure, run, and interact with Azure Skills seamlessly. Chapters 00:00 - Introduction 00:50 - What's Azure MCP 01:58 - Install Azure MCP 05:43 - VS Code User Experience 08:49 - VS Code Demo 14:25 - Azure Skills 18:36 - Wrap Up / Outro Recommended resources Learn Docs Azure Product page Azure Skills Connect Scott Hanselman | Twitter/X: @SHanselman Azure SDK | Blog: Azure SDK Blog Azure SDK | Twitter/X:…
24 Apr 2026
Azure SRE Agent: End to end agentic operations platform for any kind of toil and at enterprise scale
In this Azure Friday session, we walk through how to get started with Azure SRE Agent and demonstrate how agentic workflows can be applied to real operational scenarios—from help desk tickets to cost analysis and reporting and anything in between. The session starts with context engineering fundamentals, followed by a live demo that shows how memory, personalization, incident management and scheduled tasks come together to reduce operational toil. We wrap up by creating an SRE Agent from scratch and discussing consumption, limits, and best practices. Chapters 00:00 - Introduction 01:05 -…
17 Apr 2026
Migrate Oracle Workloads to Oracle AI Database@Azure
In this episode, learn how to migrate on-premises Oracle Database workloads to Oracle AI Database@Azure, where Oracle database services run on Oracle Exadata infrastructure located inside Azure datacenters. Then see how, once your database is in place, you can modernize faster by connecting Oracle data to Microsoft Fabric for analytics and building AI experiences with Foundry, Copilot Studio—using familiar Azure tools. Chapters 00:00 - Introduction 00:58 - What is Oracle AI Database@Azure 05:33 - Azure Portal experience 11:30 - Microsoft integrations (Fabric, Foundry) 14:00 - Agentic…
9 Apr 2026
Migrate Oracle Workloads to PostgreSQL Using AI-Powered Tools in the VS Code PostgreSQL Extension
This week on Azure Friday, Scott Hanselman talks with Jonathon Frost about AI-enhanced migration from Oracle to PostgreSQL using the VS Code PostgreSQL extension. See how developers can automate schema conversion, transform application code, and validate results using an intelligent, agent-driven workflow. Chapters 00:00 - Introduction 00:36 - Model Hyperparameter Tuning, Agent Orchestration, and Determinism 02:25 - Architectural Overview of AI-enhanced Schema Migration 04:28 - How it is Built on the VS Code Extension for PostgreSQL 04:56 - Self-correction of AI-enhanced Migration 05:59 -…
3 Apr 2026
Next gen General Purpose in Azure SQL Managed Instance - what it is and why it’s faster
Modernizing SQL Server for the cloud doesn’t have to be complex. In this episode, we break down what Azure SQL Managed Instance is and show how the upgraded Next‑gen General Purpose tier delivers faster performance, higher storage, and easier scaling using Azure’s latest storage technology. You’ll also see a quick Azure Portal demo with the new IOPS slider and in‑place performance scaling. Chapters 00:00 - Introduction 00:38 - Overview of Azure SQL & SQL Managed Instance 03:30 - Service tiers in Azure SQL Managed Instance 04:14 - Storage architecture upgrade (Elastic SAN, performance gains)…

Take it with you

The Melo app keeps playing with the screen off, works in the car and on your watch, wakes you to your station, and browses the whole catalogue offline. Free, no ads, no account.