The 10 ways my agent got revenue wrong

Analytics agents are easy to demo. But when I hooked up my first naive agent to a BigQuery ecommerce dataset, it failed in surprisingly subtle ways.

Here are the top issues I found:

1. Wrong denominators: Calculating conversion rate using total pageviews instead of unique sessions.
2. Join multiplication: Fan-out issues when joining orders to order_items without proper aggregation.
3. Filter ambiguity: Is “revenue” gross or net? Does it include refunds?

(Draft content)