About Brian
Builder. Evaluator.
Practical skeptic.
I’m Bryan Smith — a data scientist focused on metrics, experimentation, search/retrieval quality, and practical AI systems.
- Data science in search and ads
- Metrics, experimentation, and debugging
- Search & retrieval quality evaluation
- Building hands-on analytics-agent labs
I care about decision quality. Analytics agents are powerful, but easy to overtrust. My goal is to make evaluation practical, repeatable, and tied to business risk.
[ Bryan Smith Photo ]
My point of view
Analytics agents should not be judged by demos. They should be judged by business-risk-weighted evals:
- Metric correctness
- Data-source choice
- Grain & filters
- Reasoning quality
- Uncertainty & reproducibility
Based in
Orange County, CA
Currently
Building the analytics agent lab
Favorite tool
BigQuery
Coffee order
Black