Skip to content
Melo Podcasts Home
CategoriesLanguagesFollowing

Season 1, Episode 118 · Gradient Dissent: Conversations on AI

Evaluating LLMs with Chatbot Arena and Joseph E. Gonzalez

17 Dec 2024 · 55 min

Play episode WhatsApp Download

Episode notes

In this episode of Gradient Dissent, Joseph E. Gonzalez, EECS Professor at UC Berkeley and Co-Founder at RunLLM, joins host Lukas Biewald to explore innovative approaches to evaluating LLMs. They discuss the concept of vibes-based evaluation, which examines not just accuracy but also the style and tone of model responses, and how Chatbot Arena has become a community-driven benchmark for open-source and commercial LLMs. Joseph shares insights on democratizing model evaluation, refining AI-human interactions, and leveraging human preferences to improve model performance. This episode provides…

Podcast

Gradient Dissent: Conversations on AI

Lukas Biewald · Tech & Science · English

Join Lukas Biewald on Gradient Dissent, an AI-focused podcast brought to you by Weights & Biases. Dive into fascinating conversations with industry giants from NVIDIA, Meta, Google, Lyft, OpenAI, and more. Explore the cutting-edge of AI and learn the intricacies of bringing models into production.

More from Gradient Dissent: Conversations on AI All episodes →

  1. S1 · E123 · 25 Mar 2025 · 1 hr 2 min

    AI, autonomy, and the future of naval warfare with Captain Jon Haase, United States Navy

    In this episode of Gradient Dissent, host Lukas Biewald speaks with Captain Jon Haase, United States Navy about real-world applications of AI and autonomy in defense. From underwater mine detection with autonomous vehicles to the ethics of lethal AI systems, this conversation dives into how the U.S. military is integrating AI into mission-critical operations — and why humans will always be at the center of warfighting. They explore the challenges of underwater autonomy, multi-agent collaboration, cybersecurity, and the growing role of large language models like Gemini and Claude in the…

  2. S1 · E122 · 25 Feb 2025 · 49 min

    The rise of AI agents

    In this episode of Gradient Dissent, host Lukas Biewald sits down with João Moura, CEO & Founder of CrewAI, one of the leading platforms enabling AI agents for enterprise applications. Joe shares insights into how AI agents are being successfully deployed in over 40% of Fortune 500 companies, what tools these agents rely on, and how software companies are adapting to an agentic world. They also discuss: What defines a true AI agent versus simple automation How AI agents are transforming business processes in industries like finance, insurance, and software The evolving business models for…

  3. S1 · E121 · 4 Feb 2025 · 1 hr 12 min

    R1, OpenAI’s o3, and the ARC-AGI Benchmark: Insights from Mike Knoop

    In this episode of Gradient Dissent , host Lukas Biewald sits down with Mike Knoop , Co-founder and CEO of Ndea , a cutting-edge AI research lab. Mike shares his journey from building Zapier into a major automation platform to diving into the frontiers of AI research. They discuss DeepSeek’s R1, OpenAI’s O-series models, and the ARC Prize , a competition aimed at advancing AI’s reasoning capabilities. Mike explains how program synthesis and deep learning must merge to create true AGI , and why he believes AI reliability is the biggest hurdle for automation adoption. This conversation covers…

  4. S1 · E120 · 28 Jan 2025 · 58 min

    DeepSeek, Stargate and AI's $600 Billion Question with Sequoia's David Cahn

    In this episode of Gradient Dissent , host Lukas Biewald sits down with David Cahn, partner at Sequoia Capital, for a compelling discussion on the dynamic world of AI investments. They dive into recent developments, including DeepSeek and Stargate, exploring their implications for the AI industry. Drawing from his articles, "AI's $200 Billion Question" and "AI's $600 Billion Question," David unpacks the financial challenges and opportunities surrounding AI infrastructure spending and the staggering revenue required to sustain these investments. Together, they examine the competitive…

  5. S1 · E119 · 7 Jan 2025 · 41 min

    Building the future of collaborative AI development with Akshay Agrawal

    In this episode of Gradient Dissent , Akshay Agrawal, Co-Founder of Marimo, joins host Lukas Biewald to discuss the future of collaborative AI development. They dive into how Marimo is enabling developers and researchers to collaborate seamlessly on AI projects, the challenges of scaling AI tools, and the importance of fostering open ecosystems for innovation. Akshay shares insights into building a platform that empowers teams to iterate faster and solve complex AI challenges together. Follow Weights & Biases: https://twitter.com/weights_biases https://www.linkedin.com/company/wandb Join the…

  6. S1 · E117 · 26 Nov 2024 · 50 min

    AI’s breakthrough in weather forecasting with Brightband’s Julian Green

    In this episode of Gradient Dissent, Julian Green, Co-founder & CEO of Brightband, joins host Lukas Biewald to discuss how AI is transforming weather forecasting and climate solutions. They explore Brightband's innovative approach to using AI for extreme weather prediction, the shift from physics-based models to AI-driven forecasting, and the potential for democratizing weather data. Julian shares insights into building trust in AI for critical decisions, navigating the challenges of deep tech entrepreneurship, and the broader implications of AI in mitigating climate risks. This episode…

  7. S1 · E116 · 7 Nov 2024 · 55 min

    What’s the path to AGI? A conversation with Turing Co-founder and CEO Jonathan Siddharth

    In this episode of Gradient Dissent, Jonathan Siddharth, CEO & Co-Founder of Turing, joins host Lukas Biewald to discuss the path to AGI. They explore how Turing built a "developer cloud" of 3.7 million engineers to power AGI training, providing high-quality code and reasoning data to leading AI labs. Jonathan shares insights on Turing’s journey, from building coding datasets to solving enterprise AI challenges and enabling human-in-the-loop solutions. This episode offers a unique perspective on the intersection of human intelligence and AGI, with an eye on the expansion of new domains…

  8. S1 · E115 · 24 Oct 2024 · 57 min

    Vercel’s CEO & Founder Guillermo Rauch on the impact of AI on Web Development and Front End Engineering

    In this episode of Gradient Dissent, Guillermo Rauch, CEO & Founder of Vercel, joins host Lukas Biewald for a wide ranging discussion on how AI is changing web development and front end engineering. They discuss how Vercel’s v0 expert AI agent is generating code and UI based on simple ChatGPT-like prompts, the importance of releasing daily for AI applications, and the changing landscape of frontier model performance between open and closed models. Listen on Apple Podcasts: http://wandb.me/apple-podcasts Listen on Spotify: http://wandb.me/spotify Subscribe to Weights & Biases:…

  9. S1 · E114 · 10 Oct 2024 · 56 min

    Snowflake’s CEO Sridhar Ramaswamy on 700+ LLM enterprise use cases

    In this episode of Gradient Dissent, Snowflake CEO Sridhar Ramaswamy joins host Lukas Biewald to explore how AI is transforming enterprise data strategies. They discuss Sridhar's journey from Google to Snowflake, diving into the evolving role of foundation models, Snowflake’s AI strategy, and the challenges of scaling AI in business. Sridhar also shares his thoughts on leadership, rapid iteration, and creating meaningful AI solutions for enterprise clients. Tune in to discover how Snowflake is driving innovation in the AI and data space. Connect with Sridhar Ramaswamy:…

  10. S1 · E113 · 26 Sep 2024 · 50 min

    Elevating ML Infrastructure with Modal Labs CEO Erik Bernhardsson

    In this episode of Gradient Dissent, Erik Bernhardsson, CEO & Founder of Modal Labs, joins host Lukas Biewald to discuss the future of machine learning infrastructure. They explore how Modal is enhancing the developer experience, handling large-scale GPU workloads, and simplifying cloud execution for data teams. If you’re into AI, data pipelines, or building robust ML systems, this episode is packed with valuable insights! 🎙 *Listen on Apple Podcasts*: http://wandb.me/apple-podcasts 🎙 *Listen on Spotify*: http://wandb.me/spotify ✅ *Subscribe to Weights & Biases* → https://bit.ly/45BCkYz 🎙…

Take it with you

The Melo app keeps playing with the screen off, works in the car and on your watch, wakes you to your station, and browses the whole catalogue offline. Free, no ads, no account.

Get it on Google Play