Navigating AI for Testing: Insights on Context and Evaluation with Sourcegraph

The AI Native Dev - from Copilot today to AI Native Software Development tomorrow

Player FM - Internet Radio Done Right

Đã thêm cách đây ba mươi bảy tuần

Nội dung được cung cấp bởi Tessl. Tất cả nội dung podcast bao gồm các tập, đồ họa và mô tả podcast đều được Tessl hoặc đối tác nền tảng podcast của họ tải lên và cung cấp trực tiếp. Nếu bạn cho rằng ai đó đang sử dụng tác phẩm có bản quyền của bạn mà không có sự cho phép của bạn, bạn có thể làm theo quy trình được nêu ở đây https://vi.player.fm/legal.

Species Unite

1
Elizabeth MeLampy: Forget the Camel 39:33

cách đây 13 ngày trước39:33

Nghe Sau

Danh sách

Thích

Đã thích

39:33

"The basic premise of the event is that hunters hunt rattlesnakes from the surrounding environment all across West Texas, and bring them into the roundup for the weekend. And during the roundup, these snakes are kept in a pit and then, one by one, beheaded and skinned in front of in front of audiences." - Elizabeth MeLampy Elizabeth MeLampy is a lawyer dedicated to animal rights and protection, and her passion for this work shines through in her latest book, Forget the Camel, the Madcap World of Animal Festivals and What They Say About Being Human . To research the book, Elizabeth traveled across the country, immersing herself in a wide range of animal festivals — from the Iditarod dog sled race to the rattlesnake roundup in Sweetwater, Texas. Elizabeth examines these festivals as revealing microcosms of our broader relationship with animals. Whether it's rattlesnake hunts, frog-jumping contests, ostrich races, or groundhog celebrations, these events reflect the ways humans use animals to express cultural identity, community pride, and historical traditions. Yet beneath the pageantry and excitement lies a deeper question: Is our fascination with these spectacles worth the toll it takes on the animals involved? With compassion and insight, Elizabeth invites readers to consider whether there’s a more ethical and empathetic way to honor our stories — one that respects both animals and the traditions they inspire. Please listen, share and read, Forget the Camel. It will be released on April 8th, 2025. https://apollopublishers.com/index.php/forget-the-camel/…

cách đây khoảng một năm trước 52:51

MP3•Trang chủ episode

In this episode, Simon Maple dives into the world of AI testing with Rishabh Mehrotra from Sourcegraph. Together, they explore the essential aspects of AI in development, focusing on how models need context to create effective tests, the importance of evaluation, and the implications of AI-generated code. Rishabh shares his expertise on when and how AI tests should be conducted, balancing latency and quality, and the critical role of unit tests. They also discuss the evolving landscape of machine learning, the challenges of integrating AI into development workflows, and practical strategies for developers to leverage AI tools like Cody for improved productivity. Whether you're a seasoned developer or just beginning to explore AI in coding, this episode is packed with insights and best practices to elevate your development process.

Join the AI Native Dev Community on discord: https://tessl.co/4ghikjh
Ask us questions: podcast@tessl.io

46 tập

#Tech #Tessl #AI Native Software Development #Ai Developments #Ai Software Development #AI Native #Ai Assistants #Ai Code Completion

Navigating AI for Testing: Insights on Context and Evaluation with Sourcegraph

The AI Native Dev - from Copilot today to AI Native Software Development tomorrow

published cách đây khoảng một năm trước

Chia sẻ

MP3•Trang chủ episode

Join the AI Native Dev Community on discord: https://tessl.co/4ghikjh
Ask us questions: podcast@tessl.io

46 tập

#Tech #Tessl #AI Native Software Development #Ai Developments #Ai Software Development #AI Native #Ai Assistants #Ai Code Completion

Tất cả các tập

1
How Attackers Trick AI: Lessons from Gandalf’s Creator 54:35

cách đây 7 ngày trước54:35

54:35

🔒 How Secure is AI? Gandalf’s Creator Exposes the Risks 🔥 AI security is under attack, and hackers are finding new ways to manipulate AI systems. In this episode, Guy Podjarny sits down with Mateo Rojas-Carulla, co-founder of Lakera and creator of Gandalf, to break down the biggest threats facing AI today—from prompt injections and jailbreaks to data poisoning and agent manipulation. What You’ll Learn: - How attackers exploit AI vulnerabilities in real-world applications - Why AI models struggle to separate instructions from external data - How Gandalf’s 60M+ attack attempts revealed shocking insights - What the Dynamic Security Utility Framework (DSEC) means for AI safety - Why red teaming is critical for preventing AI disasters Whether you’re a developer, security expert, or just curious about AI risks, this episode is packed with must-know insights on keeping AI safe in an evolving landscape. 💡 Can AI truly be secured? Or will attackers always find a way? Drop your thoughts in the comments! 👇 Watch the episode on YouTube: https://youtu.be/RKCvlJT_r4s Join the AI Native Dev Community on Discord: https://tessl.co/4ghikjh Ask us questions: podcast@tessl.io…

1
AI Gone Rogue? LLM Werewolf Showdown 54:43

cách đây 12 ngày trước54:43

54:43

What happens when AI learns to lie? In this electrifying episode of AI Native Dev , Simon Maple is joined by the brilliant Macey Baker, Community Engineer at Tessl, to unravel the wild, unpredictable, and sometimes downright hilarious world of Large Language Models (LLMs) in social deception games. From the psychological mind games of Werewolf to the cutthroat negotiations of Split or Steal , Macey spills the details on how AI models like OpenAI’s GPT-4o, Anthropic’s Sonnet, Llama, and DeepSeek R1 navigate deception, trust, and ethics when the stakes are high. Can an AI manipulate, bluff, or betray? Which model is the sneakiest, and which one folds under pressure? Prepare for shocking twists, unexpected strategies, and an eye-opening look at the ethical implications of AI in interactive gameplay. This is one episode you won’t want to miss—especially if you think you can outwit an AI! Watch the episode on YouTube: https://youtu.be/9hVeVYlqyBc Join the AI Native Dev Community on Discord: https://tessl.co/4ghikjh Ask us questions: podcast@tessl.io…

1
Monthly Roundup: AI Model Wars, GPT-4.5 vs. Sonnet 3.7, and the Future of AI Dev Tools 42:09

cách đây 15 ngày trước42:09

42:09

In this episode, Guy and Simon dive deep into February’s wave of AI model releases, focusing heavily on the showdown between OpenAI’s GPT-4.5 and Anthropic’s Sonnet 3.7. They discuss GPT-4.5's move toward higher emotional intelligence (EQ), how it compares with Claude, and whether it’s actually meeting developers' expectations—or falling short. Anthropic’s introduction of dynamic reasoning with Sonnet 3.7 gets special attention as Guy and Simon explore what this new feature means practically for developers, referencing Bolt.new’s recent implementation as an example. They also weigh the strategic choices these AI labs face—when to build tools themselves and when to act purely as platforms—highlighting the delicate balance companies like Anthropic and ElevenLabs must strike. The conversation also covers practical developer workflows, featuring insights from recent interviews with Farhath, who leverages multiple AI dev tools simultaneously, and Mati from ElevenLabs, who shares how his company navigates scaling and research while remaining nimble. Finally, Guy and Simon announce AI Native Dev Con: Spring 2025, and hint at exciting upcoming episodes, rounding out a packed discussion that goes straight to the heart of what matters for AI-native developers today. Watch the episode on YouTube: https://youtu.be/kjAs_isf-Vs Join the AI Native Dev Community on Discord: https://tessl.co/4ghikjh Ask us questions: podcast@tessl.io…

1
The Future of Audio AI: Insights from Mati Staniszewski of ElevenLabs 1:02:52

cách đây 26 ngày trước1:02:52

1:02:52

In this episode of AI Native Dev, hosts Guy Podjarny sits down with Mati Staniszewski, the visionary CEO and co-founder of ElevenLabs, a leader in AI audio technology. Mati shares the origin story of ElevenLabs, detailing how a frustration with subpar dubbing in Polish movies sparked a mission to revolutionize audio processing. The conversation delves into the technical challenges and breakthroughs that have positioned ElevenLabs at the forefront of AI-powered audio experiences. Mati also discusses the company's unique organizational culture and its commitment to pushing the boundaries of audio AI. Whether you're a developer, entrepreneur, or AI enthusiast, this episode offers valuable insights into the future of audio technology and the role ElevenLabs is playing in shaping it. Watch the episode on YouTube: https://youtu.be/ImknDhWdDkQ Join the AI Native Dev Community on Discord: https://tessl.co/4ghikjh Ask us questions: podcast@tessl.io…

1
Building the Ultimate AI-Powered Development Environment with Farhath Razzaque 36:16

cách đây 5 weeks trước36:16

36:16

In this episode of the AI Native Dev podcast, Simon Maple sits down with Farhath Razzaque, a freelance software AI engineer who has been extensively using AI tools in his development workflow. Farhath has built a reputation as a trusted voice in the AI and software development communities, thanks to his rich background and experience. He has worked on multiple projects that integrate cutting-edge AI technologies, helping companies streamline their processes and innovate effectively. His passion for AI and development is evident through his active participation in various tech forums and his contributions to open-source projects. Farhath's insights into his ideal development environment, the tools he frequently uses, and his thoughts on the future of AI in software development offer invaluable guidance for developers looking to integrate AI into their processes. Watch the episode on YouTube: https://youtu.be/7eE8rzzcrZM Join the AI Native Dev Community on discord: https://tessl.co/4ghikjh Ask us questions: podcast@tessl.io…

1
DeepSeek R1: Ask Me Anything - Open Weights, MoE innovations, Model Distillation and more! 33:18

cách đây 6 weeks trước33:18

33:18

Join Simon Maple as he hosts a compelling discussion at the State of Open Con, featuring Amanda Brock, CEO of OpenUK, Guy Podjarny, Founder and CEO of Tessl, and Richard Sikang Bian, Head of Open Source from Ant Group. This episode delves into the impact of DeepSeek R1, a groundbreaking AI model that has taken the market by storm due to its cost-effective and innovative approach. The panel explores the broader implications for open source AI, discussing legal, ethical, and collaborative aspects. Amanda Brock provides insights into the open source legal frameworks, while Guy Podjarny shares his expertise on transparency and innovation. Richard Sikang Bian offers a unique perspective on company culture and AI development strategies. Tune in to understand how DeepSeek R1 is setting new standards in AI and what the future holds for open source technology. Join the AI Native Dev Community on discord: https://tessl.co/4ghikjh Ask us questions: podcast@tessl.io…

1
Live Monthly: News on DeepSeek, Stargate, StackBlitz (Bolt.new) funding, prompting, and more 51:46

cách đây 7 weeks trước51:46

51:46

Join hosts Simon Maple and Guy Podjarny in this insightful episode as they discuss the latest trends and innovations in AI technology. Featuring the impressive advancements by DeepSeek, this episode highlights how these new developments are affecting major players like Nvidia and altering the AI landscape. The hosts also explore the significant investments in AI infrastructure and discuss the shifting role of developers in an AI-driven world. With expert insights from industry leaders, this episode is a must-listen for anyone interested in the future of AI. Join the AI Native Dev Community on discord: https://tessl.co/4ghikjh Ask us questions: podcast@tessl.io…

1
RAG beats Fine-Tuning in learning your code base - but it doesn't make AI a better developer -Founder of Augment, Guy Gur-Ari explains 57:13

cách đây 8 weeks trước57:13

57:13

In this episode of the AI Native Dev podcast, hosts Guy Podjarny, and Dion Almaer are joined by Guy Gur-Ari, co-founder of Augment. Guy Gur-Ari has a rich background in the tech industry, notably having worked at Google, where he gained significant experience with large language models (LLMs). His tenure at Google saw him involved in the transition from vision models to language models, including the development of groundbreaking tools like the Codex model. With a focus on AI-powered solutions, Guy Gur-Ari's work has been pivotal in advancing AI's role in software development, making him a voice of trust and authority in the field. The discussion in this episode dives into the creation and benefits of AI-powered coding assistants and tools, exploring how they enhance developer productivity and the future of software development with AI. Watch the episode on YouTube: https://youtu.be/McsKNfWPsUM Join the AI Native Dev Community on discord: https://tessl.co/4ghikjh Ask us questions: podcast@tessl.io…

1
Adapting your team culture for AI: DevOps Lessons Learned with Hannah Foxwell 42:21

cách đây 9 weeks trước42:21

42:21

In this episode of the AI Native Dev podcast, Simon Maple is joined by Hannah Foxwell, an independent consultant with significant experience in platform engineering, security, and AI. Hannah shares her journey from a release manager to leadership roles at Snyk and VMware, revealing her deep insights into the parallels between DevOps and AI adoption. As a community leader and event organizer, Hannah offers valuable perspectives on the cultural shifts necessary for embracing AI in development teams. Discover how AI is impacting both seasoned and novice developers, the importance of overcoming skepticism, and the future role of AI in software development. Watch the episode on YouTube: https://youtu.be/jGgqYLSLs8Q Join the AI Native Dev Community on discord: https://tessl.co/4ghikjh Ask us questions: podcast@tessl.io…

1
From AI Assistants to Agents: How Sourcegraph is Transforming Enterprise Development 45:17

cách đây 10 weeks trước45:17

45:17

In this episode of the AI Native Dev podcast, hosts Dion Almaer sit down with Quinn Slack, a trailblazer in the tech industry and CEO of Sourcegraph. Known for his contributions to enhancing developer tools, Quinn shares his insights on the inception of Sourcegraph, its evolution with AI integration, and the journey towards creating the advanced AI tool, Cody. From initial challenges in code search to the development of agentic AI, Quinn provides a comprehensive look at how Sourcegraph is pioneering AI-driven software development. Listeners will gain valuable knowledge on the role of AI in automating coding tasks, the importance of a collaborative developer mindset, and the future prospects of AI in the industry. Watch the episode on YouTube: https://youtu.be/ZTLSMN8eISs Join the AI Native Dev Community on discord: https://tessl.co/4ghikjh Ask us questions: podcast@tessl.io…

1
LIVE 2024 Year in Review: AI Innovations and Predictions with Guy Podjarny 51:20

cách đây 10 weeks trước51:20

51:20

Join Simon Maple and Guy Podjarny as they recount the pivotal moments in AI development throughout 2024. This episode serves as a comprehensive review of the year, highlighting the evolution of AI tools, the competitive landscape among AI models, and the reality of AI hype. With expert guest Guy Podjarny, co-host of the podcast and a prominent figure in the tech industry, known for his leadership in developer security tools, the discussion delves into spec-centric development and predictions for 2025. Gain insights into the challenges and opportunities of AI as Simon and Guy share their perspectives on the future of AI-driven software development. Watch the episode on YouTube: https://youtube.com/live/NYuQpoG0Xvo Join the AI Native Dev Community on discord: https://tessl.co/4ghikjh Ask us questions: podcast@tessl.io…

1
Mastering LLM Prompting in the Real World by Macey Baker 38:32

cách đây 11 weeks trước38:32

38:32

In this enlightening episode of the AI Native Dev podcast, host Simon Maple engages with Macey Baker, a Community Engineer at Tessl, to explore the intricacies of prompting in AI interactions. Macey shares her expertise on effective prompting techniques and discusses her unique role at Tessl that combines AI engineering with community engagement. With her vast experience, Macey provides listeners with practical tips and insights on how to maximize the potential of LLMs through strategic prompting. From understanding the significance of community engineering to the dynamic nature of prompts, this episode is packed with valuable information for developers looking to enhance their AI models' performance. Join the AI Native Dev Community on discord: https://tessl.co/4ghikjh Ask us questions: podcast@tessl.io…

1
Crossover episode with The Infra Pod - AI Native Development with Guy Podjarny 56:17

cách đây 13 weeks trước56:17

56:17

In this episode of the AI Native Dev podcast, Simon Maple introduces a special crossover event with the Infra Pod, featuring Guy Podjarny, CEO of Tessl and former founder of Snyk. Guy shares his journey from Snyk to Tessl and delves into the revolutionary concept of AI Native Development. Joined by Tim Chen and Ian Livingstone, they discuss the Tessl Vision and how AI is poised to reshape the software development landscape. Guy's insights on the separation of specification from implementation and the evolving role of AI in software creation provide a compelling vision of the future. With a focus on community engagement and events like AI Native DevCon, this episode is a must-listen for anyone interested in the future of AI and software development. Join the AI Native Dev Community on discord: https://tessl.co/4ghikjh Ask us questions: podcast@tessl.io…

1
The Evolution of v0 and Vercel's AI SDK, with Malte Ubl, Vercel CTO 25:43

cách đây 14 weeks trước25:43

25:43

Join us for an engaging conversation with Malte Ubl, CTO of Vercel, as he delves into the transformative impact of AI on web development. Hosted by Dion Almaer from Tessl, this episode of the AI Native Dev Podcast explores how AI is reshaping the landscape for developers. Malte shares his journey from Google to Vercel and discusses the evolution of Vercel's AI SDK and v0 tool, along with the role of eval driven development in accelerating AI application refinement. Gain insights into the commoditization of AI models, the strategic use of proprietary data, and how full-stack development is being redefined by AI advancements. Watch the episode on YouTube: https://youtu.be/wrRsHlhpubY…

1
AI Evaluation and Testing: How to Know When Your Product Works (or Doesn’t) 49:58

cách đây 15 weeks trước49:58

49:58

This episode of AI Native Dev, hosted by Simon Maple and Guy Podjarny, features a mashup of conversations with leading figures in the AI industry. Guests include Des Traynor, founder of Intercom, who discusses the paradigm shift generative AI brings to product development. Rishabh Mehrotra, Head of AI at SourceGraph, emphasizes the importance of evaluation processes over model training. Tamar Yehoshua, President of Products and Technology at Glean, shares her experiences in enterprise search and the challenges of using LLMs in data-sensitive environments. Finally, Simon Last, Co-Founder and CTO of Notion, talks about continuous improvement and the iterative processes at Notion. Each guest provides invaluable insights into the evolving landscape of AI-driven products. Watch the episode on YouTube: https://youtu.be/gZ4sGROvOdQ…

Chào mừng bạn đến với Player FM!

Player FM đang quét trang web để tìm các podcast chất lượng cao cho bạn thưởng thức ngay bây giờ. Đây là ứng dụng podcast tốt nhất và hoạt động trên Android, iPhone và web. Đăng ký để đồng bộ các theo dõi trên tất cả thiết bị.

Nghe hơn 500 chủ đề

Tương tự như The AI Native Dev - from Copilot today to AI Native Software Development tomorrow

everydrop by Whirlpool Ice and Water Refrigerator Filter 1, EDR1RXD1, Single-Pack , Purple

Bounty Quick Size Paper Towels, White, 8 Family Rolls = 20 Regular Rolls (Packaging May Vary)

Mighty Patch™ Original patch from Hero Cosmetics - Hydrocolloid Acne Pimple Patch for Covering Zits and Blemishes in Face and Skin, Vegan-friendly and Not Tested on Animals (36 Count)

Podcast đáng để nghe

The AI Native Dev - from Copilot today to AI Native Software Development tomorrow « » Navigating AI for Testing: Insights on Context and Evaluation with Sourcegraph

Navigating AI for Testing: Insights on Context and Evaluation with Sourcegraph

Podcast đáng để nghe

Chào mừng bạn đến với Player FM!

Just In Case

Astrobrights/Neenah Bright White Cardstock, 8.5" x 11", 65 lb/176 gsm, White, 75 Sheets (90905-02) - Packaging May Vary

Scott ComfortPlus Toilet Paper, 12 Double Rolls, 231 Sheets per Roll, Septic-Safe, 1-Ply Toilet Tissue

Amazon Basics Clear Thermal Laminating Plastic Paper Laminator Sheets, 9 x 11.5-Inch, 200-Pack, 3mil

Tương tự như The AI Native Dev - from Copilot today to AI Native Software Development tomorrow

Hướng dẫn sử dụng nhanh

The AI Native Dev - from Copilot today to AI Native Software Development tomorrow « »
Navigating AI for Testing: Insights on Context and Evaluation with Sourcegraph