- Evaluated a production AI agent with about 500 real and edge-case questions, tracing every tool call to find where answers went wrong.
- Proposed moving from black-box to grey-box testing, so each failure can be traced to retrieval, ranking or generation.
- Designed a per-seat pricing model for a new support product.
- Co-own the plan to turn an AI agent built for one setup into a reusable core that can scale across clients.
Jetson Samuel
Connecting the dots between users, business and tech.

Where I've done the job
- Current
ProManage, a Sulekha business · ChennaiAssociate Product Manager Intern Oct 2026 – nowImpactGave the team its first measured quality baseline for the agent. Skipped tool calls are now partly fixed with engineering. - Sole PM
Auriseg, an AI cybersecurity startupProduct Manager Intern, the only PM Mar – Jul 2026- Owned an AI security scanner for LLM and agentic apps end to end, from market research to public launch.
- Built the phased product roadmap from two weeks of competitor and market-gap research.
- Ran a free beta with existing clients, and set the launch pricing and packaging.
- Rebuilt onboarding for non-security users: plain language, an in-product AI guide, and a real scan in the very first step.
- Wrote PRDs and roadmaps, co-wrote functional specs with developers, and presented plans to senior leadership.
ImpactLaunched publicly in 3 months, across 8 sprints and 2 milestones, as the company's only product manager.
Work
Knit PM
Most PMs said it can't be solved. I built a demo to test that.

AI Assistant Audit
500 questions to a live AI assistant. 1 in 7 answers was made up.

Koo
It stopped paying for users, and lost two-thirds of them.

Quibi
A 90-day free trial hid the only number that mattered.

Google Stadia
The streaming worked. The cost of trying a game didn't.

Gamma
Paying removes the badge that powers Gamma's growth.

Fireflies.ai
Its biggest growth channel is people who never signed up.

Jar
The first failed auto-save decides whether the habit lives.

Etsy
7% of buyers drive 40% of sales. The warning comes late.
One signal per product
| Product | Signal I watch | Value | Status |
|---|---|---|---|
| Knit PM | Decisions reopened after sign-off | In pilot | Testing |
| AI Assistant Audit | Tool-skip rate | 6.8% | Measured |
| Koo | Users after paid acquisition stopped | -67% | Public data |
| Quibi | Time to first payment signal | 90 days | Public data |
| Google Stadia | Cost to try one new game | Full price | Public data |
| Gamma | Badge-off share of deck views | To test | Hypothesis |
| Fireflies.ai | Recap pull vs. push | To test | Hypothesis |
| Jar | 30-day survival after first failed save | To test | Hypothesis |
| Etsy | Cadence slip of habitual buyers | -9% | Public data |
Problem first. Always.
PM isn’t about jumping to solutions. It’s about asking more questions, the right ones. Spend 80% of your time on the problem, and the right solution becomes obvious.
- 01
Ask
Question the problem from the user, business and tech side before touching a solution.
5 Whys · Jobs to be done - 02
Understand
Spend most of the time here: interviews, data, and finding where the product quietly breaks.
User interviews · SQL · funnels - 03
Pick the signal
Choose the one metric that proves the problem is real, with a metric tree under it.
North Star · metric trees - 04
Test small
Run the smallest experiment or prototype that could prove me wrong.
A/B tests · prototypes · evals - 05
Ship and learn
Write the PRD, launch with clear success criteria, then review what the data says.
PRD · launch review
What I work with
Where I go deepest: making AI agents trustworthy enough to ship.
- AI evals: golden datasets, rubrics, LLM-as-judgeStrongest
- ADLC (agent development lifecycle)
- Agentic workflows and tool calling
- RAG design: retrieval, chunking, grounding
- Prompt and context engineering
- Model selection: quality, cost, latency
- Guardrails and AI safety
- Human-in-the-loop design
- AI product metrics: groundedness, task success
- Hallucination root-cause analysis
- Fine-tuning vs. RAG decisions
- Responsible AI and data privacy
How I take a problem from first question to launch.
- Problem discovery
- User interviews
- PRDs and specs
- Roadmapping
- Prioritisation (RICE)
- North Star and metric trees
- A/B test design
- Pricing and packaging
- Go-to-market
- Stakeholder management
- User journey mapping
- Agile (Scrum)
A number before an opinion.
- SQL
- Python
- Power BI
- Excel
- Google Analytics
- Mixpanel
- Funnel analysis
- Cohort and retention analysis
- KPI dashboards
The models and frameworks I understand well enough to spec against.
- Claude, GPT and Gemini models
- MCP (Model Context Protocol)
- LangChain and LangGraph
- Vertex AI
- Supabase and pgvector
- LangSmith and Promptfoo (evals)
Where the work lives day to day.
- Figma
- Notion
- Miro
- Jira
- Confluence
- Slack
- Loom
- Google Workspace
- Microsoft Word
- Microsoft PowerPoint
- Microsoft Excel
The AI tool I reach for at each step of the PM job.
- Research and discovery
- Perplexity, NotebookLM, Dovetail
- PRDs and specs
- ChatPRD, Claude, Notion AI
- Prototyping
- Lovable, v0, Figma Make, Claude Design
- Meetings and notes
- Fireflies.ai, Granola
- Data and analytics
- Julius AI, Amplitude AI
- Decks and storytelling
- Gamma, Napkin AI
- Whiteboarding
- Miro AI, FigJam AI
- Building demos
- Claude Code, Cursor
Range
HICAS Music Band, 2022 to 20259+First-place wins leading a 25-member band in inter-college competitions across Coimbatore.
Multiple Dots, 2025 to now33KFollowers in about a year across Instagram and YouTube, with paid campaigns for Scaler, Simplilearn and TaskTracker.
Best video100K+Views on “People Who Dream Big But Do Nothing”, without paid promotion.
Let's connect the dots.
Read one case study. If it changes how you see that product, let's talk.
jetsonarmstrong@gmail.com