- We ❤️ Open Source
- Posts
- Agent drift is real. Unit tests won't catch it.
Agent drift is real. Unit tests won't catch it.
This week we're discovering how open source ArkSim simulates hundreds of real users to catch agent drift before you go live, learning where your actual open source community is hiding beyond git commits using GrimoireLab and social listening, exploring what open source really means with a cookie recipe analogy, and understanding why eza is the modern replacement for the ls command with Git status integration.
We're also hearing from Juan Gomez Lagandera on the podcast about why grabbing a model and playing won't get you ML results you actually want. This is edition #65 of the We Love Open Source newsletter. Made and curated by Jason & Todd.🙂
This week we'll look at...
Join 5,000 technologists in Raleigh, NC
Registration opens June 2 for All Things Open 2026
Registration for year #14 of All Things Open will open Tuesday, June 2 with a half-price Early Bird Special. Save the date and mark your calendars today to save money. The conference will feature full-day and half-day workshops as well as keynote and 30-minute track talks from the world's top experts.
Articles
 | Your AI agent behaves perfectly in testing. Three weeks after launch, it's giving legal advice and caving under user pressure. Agent drift is real and unit tests won't catch it. Here's how open source ArkSim simulates hundreds of real users before you go live. WHY WE ❤️ IT: Agent drift is one of those problems every AI builder has felt but few have named. This post names it, explains it, and walks you through the fix in six steps. |
 | Your git log shows you your committers. Your actual community is bigger, more scattered, and hiding in places you're not looking. This practical guide covers repo data, GitHub Insights, GrimoireLab, and social listening to help you find them all. WHY WE ❤️ IT: Many open source teams mistake their committers for their community. This guide shows you exactly where to look next and who you've been missing. |
 | What is open source software? Brian breaks it down in 2 minutes using a cookie recipe analogy that makes it click. Learn why transparency, collaboration, and shared code matter for developers and the software you use every day. Perfect for sharing with anyone curious about open source. WHY WE ❤️ IT: The cookie recipe analogy nails it. Open source isn't about hiding recipes, it's about printing them on the box so everyone can improve them together. |
What's in your technology toolbox?
The ls command works, but eza makes it better. Learn Linux TV shows you the modern replacement with enhanced colorization, Git repository status integration, and tree views. Discover how to install eza and use options like --git, --tree, and --sort to improve directory listings.
WHY WE ❤️ IT: Jay highlights eza --git showing repository status inline, proving you don't need separate Git commands to check if files are committed or pending changes.
From the We ❤️ Open Source Podcast
 | You'll get ML results if you just grab a model and start playing, but you won't get what you want. Juan Gomez Lagandera joins us for the podcast to explain why machine learning is a science problem requiring math and hardware fundamentals, how ML optimization needs a top-down approach, and why understanding fundamentals matters more than syntax. |
Featured podcast short
Wrap Up
If you've made it this far (thank you!), check out everything we do, our YouTube channel with 1000's of open source talks, the many meetups we host around the southeast and NYC, the All Things AI spring event we co-host, and of course All Things Open, the largest open source tech conference on the US east coast.
We hope you learn something new this weekend!
How did you like the newsletter? |