← The ShowroomData & analysis

Writeup only

ChattyTracker

Asks several AI chatbots the same questions on a schedule and shows how their answers change.

Status
Partly built
Built with
Node.js, Svelte, PostgreSQL, OpenRouter
Last worked on
2026-03

What it is

ChattyTracker watches what AI chatbots say. You give it a list of questions and, optionally, some names or terms you care about. It asks several chatbots those questions, saves the answers, and repeats on a schedule. Then it shows what changed between runs, whether your terms were mentioned, and whether the mention was positive or negative. It is built as a multi-user web app with teams and roles.

How it works

  1. Sign in and create a project.
  2. Add the questions or phrases to track, and any terms to watch for.
  3. Pick which AI models to ask.
  4. Start a scan. You see an estimated cost first, and each scan uses credits.
  5. Answers from each model come back and are saved as a scan.
  6. Compare any scan with the previous one, see where your terms appear, and read the sentiment of each mention. A Playground page lets you try a one-off prompt and keeps the history.

What exists today

What isn't there yet

Under the hood