Skip to content
View hamelsmu's full-sized avatar
💻
Always learning.
💻
Always learning.
2.4k followers · 126 following

Sponsors

Private Sponsor
@comet-ml

Sponsoring

@simonw

Achievements

Achievement: Pair Extraordinairex3Achievement: QuickdrawAchievement: YOLOAchievement: Pull Sharkx4Achievement: Public SponsorAchievement: Starstruckx3Achievement: Arctic Code Vault Contributor

Achievements

Achievement: Pair Extraordinairex3Achievement: QuickdrawAchievement: YOLOAchievement: Pull Sharkx4Achievement: Public SponsorAchievement: Starstruckx3Achievement: Arctic Code Vault Contributor

Highlights

  • Pro

Organizations

@fastai @kubeflow

Block or report hamelsmu

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don't include any personal information such as legal names or email addresses. Markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
hamelsmu/README.md

Hi, I'm Hamel

I'm an ML engineer and independent consultant at Parlance Labs. I spend most of my time helping teams build AI products. Previously, I did applied ML at GitHub and Airbnb.

What I'm working on

Evals for AI Engineers - O'Reilly

I'm working to bring data science back to AI: helping teams debug, analyze, and measure their systems. I call this "evals," and after doing it across 35+ AI products, I co-authored Evals for AI Engineers (O'Reilly), covering error analysis, LLM-as-a-judge, synthetic data, production monitoring, and building data flywheels. I also co-teach a course on evals on Maven.

I write about what I learn at hamel.dev. Some recent posts:

Date Post
Mar 2026 Evals Skills for Coding Agents
Jan 2026 LLM Evals: Everything You Need to Know
Jul 2025 Stop Saying RAG Is Dead
Mar 2025 A Field Guide to Rapidly Improving AI Products
Dec 2024 nbsanity - Share Notebooks as Polished Web Pages in Seconds
Nov 2024 Building an Audience Through Technical Writing: Strategies and Mistakes
Oct 2024 Using LLM-as-a-Judge For Evaluation: A Complete Guide
Oct 2024 Concurrency Foundations For FastHTML
Jul 2024 An Open Course on LLMs, Led by Practitioners
Jun 2024 What We've Learned From A Year of Building with LLMs

Open source

I've contributed to tools across ML infrastructure, developer experience, and data science workflows. Full list here.

Pinned Loading

  1. AnswerDotAI/nbdev AnswerDotAI/nbdev Public

    Create delightful software with Jupyter Notebooks

    Jupyter Notebook 5.3k 515

  2. evals-skills evals-skills Public

    Skills for AI Evals to compliment the course: AI Evals For Engineers & PMs

    4 1

  3. fastai/fastpages fastai/fastpages Public archive

    An easy to use blogging platform, with enhanced support for Jupyter Notebooks.

    Jupyter Notebook 3.6k 735

  4. github/CodeSearchNet github/CodeSearchNet Public archive

    Datasets, tools, and benchmarks for representation learning of code.

    Jupyter Notebook 2.4k 408