Replay QA
Connect a GitHub Repo
Set up continuous QA for your team. Connect your GitHub repo and Replay QA runs on every change. No test suite, no pipeline configuration.
Connecting a GitHub repo turns Replay QA into a continuous quality gate. It runs on every main-branch update, every pull request, or both. No existing Playwright suite or pipeline configuration is required.
Setup
Add your repo URL
Go to qa.replay.io/new and paste your GitHub repository URL.
Authenticate with GitHub
Sign in with your GitHub account. One team member can complete the setup.
Replay QA app installs
The Replay QA GitHub App installs on your repository. It does not need access to an existing test suite.
Choose a run cadence
Select when Replay QA runs:
- On every main-branch update: a full QA pass runs on each push to
main. - On every pull request: QA runs against the PR branch. Results are posted to the PR.
- Both: runs on both main-branch updates and pull requests.
Results
On pull requests
Root cause and a suggested fix are posted as a comment on the pull request.
On main-branch runs
Results are available in the Replay QA dashboard, with links to recordings and the full bug report.
Report
Every bug report includes:
| Field | Description |
|---|---|
| Root cause | Why the bug happened, grounded in recorded execution data |
| Suggested fix | Code-level recommendation for fixing the bug |
| Full recording | Link to Replay DevTools session with network, console, and DOM state |
| Confidence score | How reliably the bug was reproduced (high / medium / low) |
Each bug report also includes an agent-ready description of the problem and fix: a structured report with title, description, steps to reproduce, expected behavior, root cause, causal chain, and recording links that can be fed directly into an AI coding agent.
Public apps
If an application is posted to a public link (Show HN, Reddit, X), it can be tested for free. Create a project with the URL and any required logins, open the project settings, and set the public share link to the post. The project becomes free immediately and any existing credits are refunded.
Shared projects are public and searchable, allowing others to run QA passes on them as well.
Mode comparison
| URL drop mode | Connect a repo mode |
|---|---|
| One-time check | Continuous |
| Results in dashboard | Results on PRs + dashboard |
| No authentication | GitHub authentication required |
Limitations
- GitHub repos only. GitLab and Bitbucket support is planned.
- Replay QA tests the running application. It does not run unit tests or static analysis.
- Private repos require the Replay QA GitHub App to have the necessary permissions.
Test a URL
Run a one-time QA check on any web app URL.
Replay QA Overview
Overview of Replay QA features and workflow.