Traditional workflow
Before generative AI assistance- 1
Clarify the goal using a funnel and its event definitions
- 2
Define the metric and cohort
- 3
Inspect instrumentation and segments
- 4
Interpret changes with context
- 5
Check the result against the agreed criteria
- 6
Communicate the outcome and record the decision
AI-assisted workflow
AI contributes. You guide and verify.- 1
Define the goal, constraints, and permitted information
- 2
Provide relevant, sanitized context from a funnel and its event definitions
- 3
Ask AI to draft queries and suggest segments to inspect
AI + YOU - 4
Inspect suggestions against original evidence and domain rules
- 5
Revise the output and independently validate the result
YOU - 6
A responsible professional approves and communicates the outcome
Does this result reflect user behavior rather than measurement changes?
The shift: Evaluating AI-generated themes while preserving customer context. Foundational skills still matter.
A practical learning path for Product Management.
What changes — and what doesn’tSkills & responsibilities
Draft queries and suggest segments to inspect. The output is a starting point to inspect, not a decision to accept automatically.
Preserve customer context, weigh tradeoffs, choose priorities, and own decisions.
FoundationsCustomer research, product strategy, experimentation, and analytics.
AI collaborationProviding task-specific context and requesting explicit assumptions.
VerificationChecking a funnel and its event definitions against independent evidence.
Professional skillsCommunicating tradeoffs and taking responsibility.
Where AI can go wrong3 things to check
A plausible but wrong answer
AI may infer improvement from a renamed or duplicated event. It can fail the underlying goal even when it sounds convincing.
Your checkAudit the event definition and recompute a consistent measure.
Missing or invented context
AI may fill gaps with unsupported assumptions, which can send the work in the wrong direction.
Your checkTrace claims to original evidence and ask the relevant person about unknowns.
Information shared in the wrong place
Sensitive records or code can cross confidentiality boundaries if supplied to an unsuitable tool.
Your checkUse approved tools, share the minimum context needed, and follow your organization’s rules.
Try a quick exerciseA practical scenario
Activation rises after an event begins firing on page load rather than completion.
Sources & contextEvidence behind this example
These are illustrative workflows, not claims that AI is always better or that every organization works this way. The scenarios and checkpoints are editorial teaching examples.
Reviewed September 2026 · Growing PracticeO*NET — Market Research AnalystsSupports market-research tasks only. Product Management spans several occupational categories.Nielsen Norman Group — Accelerating Research with AIDescribes assistance during research planning and analysis. Broader product-decision examples are editorial extrapolations.How we build these examples