Glossary

The terms and labels Pie uses in the app and in these docs, each linked to the page that covers it. Bold text is a UI label, exactly as the app shows it.

Screens and labels

Sidebar labels, in the order the app lists them.

LabelWhat it is
Test CasesEvery test case for the app, with a detail view for each. Includes the PR scan inbox filter.
Test SuitesNamed groups of test cases you run together. See Organize tests into suites.
Run HistoryEvery run, with its result, tests and step screenshots. See Read a run.
LoopThe page that lists your Loops and holds Coverage Stories.
IssuesThe deduplicated bugs Pie found and confirmed, in Open, Resolved and Rejected tabs. See Triage issues.
BuildsUploaded mobile builds. Web apps don’t show this screen.
Pie Media ServiceOpens the Upload item dialog, where you add media files that Pie can use as mock media objects.
Pie CanvasThe screen where you author a test inside a live run. It shows once the app has a run.
ChatThe in-app assistant.
SettingsTeam Management, Credentials Manager, API Keys, App Instructions, Integrations, Scripts, Run Schedules and Notifications, plus other settings these docs don’t cover. Narrow screens show a shorter set. See Set up and admin.

Loop, Pie Bot, PR scan, Chat and Canvas

These names are easy to mix up. Each one is a different thing.

TermWhat it isWhere you find it
LoopThe sidebar page where you manage Loops and read Coverage Stories.Sidebar
A Loop, or LoopsA scheduler object: one or more suites plus a trigger. A trigger is a schedule, a new build (mobile apps only) or an API call. See Loops.Loop page
Pie BotThe GitHub app that tests your pull requests. You install it with Install Pie PR Bot. See Connect GitHub or GitLab.Settings > Integrations
PR scanA setting inside a Loop. Each time the Loop runs, it reads the pull requests merged in the scan period, writes tests for what’s new and revises the tests those changes touch. New tests land in the PR scan inbox. See PR scan.Inside a Loop
ChatA conversation with Pie in the app, for creating tests, exploring edge cases, understanding a flow and checking a run. See Ask Pie in Chat.Sidebar
Pie CanvasThe screen where you author a test inside a live run. It needs at least one run.Sidebar
Pie LoopThe feature that runs your suites on a schedule, on a new build or from your CI. You create Loops on the Loop page. See Create a Loop.Loop page

Building and running tests

TermMeaning
DiscoveryThe exploration where Pie maps your app and builds its key features and starting test cases.
Key featureA core area of your app that Pie discovers and you can prioritize. Also called a group. Each test case belongs to one.
Test caseOne test: a title, a prompt or steps, and assertions.
Test suiteA named group of test cases that you run together. An empty suite can’t run.
RunOne execution of test cases against a build (mobile) or a URL (web). A run produces results and findings.
BuildA mobile app binary you upload: an .apk for Android, a zipped simulator .app for iOS.
AssertionA check inside a test case that a condition is true. Example: “Verify the user is on the dashboard screen.”
CredentialA stored test login. Refer to it in a step as @{name}. See Manage credentials.
Execution scriptA shell command Pie runs during a test. Refer to it as #{name}. See Use execution scripts.
App InstructionsStanding guidance for the whole app, including how to sign in, saved in Settings. A suite’s own instructions replace them for that suite. See Save app instructions.
Coverage scanA scan that reads the changes merged in a window and generates tests for the behavior those changes could have broken. New tests are held for review. See Run a coverage scan.
Coverage StoriesA plain-English weekly account of what shipped, what Pie tested and what it found, built when Pie publishes a coverage scan for that week. See Coverage Stories.
Self-healing testA test written as intent, which Pie re-reads against the screen on every run, so it can adapt when the interface changes. A big redesign can still break tests until their steps are regenerated.
Contextual modelPie’s structured map of your app’s screens, elements, features and their relationships.

Results and triage

TermMeaning
FindingOne raw instance of a potential bug, detected in a specific test.
IssueA deduplicated report that groups related findings into one root cause. Issues are tracked across runs.
AcknowledgeAccept an issue as real. The button on the issue is Track it. You can create a ticket in your tracker at the same time.
ResolvedAn issue marked as valid and fixed, with Mark as resolved.
RejectedAn issue you dismissed as Not a real issue.
Auto-FixThe panel on an issue. Its Fix button has Pie check that the issue is a real bug, then open a PR with a proposed fix for your team to review. See Triage issues.
Investigate an app issueA sheet on Issues where you describe a problem you saw. Pie creates an issue and tries to reproduce it.
Readiness ScoreA score that starts at 100% and drops with each issue, by severity: Critical 8, High 5, Medium 2, Low 1. It never goes below 50%, and resolved and rejected issues don’t count. 90 to 100 is stable, 70 to 89 needs caution, and below 70 is a blocker. The app labels the bands Ready to Launch, Needs Attention and Not Ready Yet.
SeverityThe technical impact of a bug. A crash is critical.
PriorityThe urgency of fixing a bug from a business view. A typo on the homepage can be low severity and high priority.

Agents and automation

TermMeaning
AI agentThe software that explores your app, runs tests and analyzes results.
MCPModel Context Protocol, a standard way for an AI agent to call tools. Pie’s MCP server lets an agent run tests, read results and triage issues. See Connect your agent.
API keyA secret that authenticates your agent, CI pipeline or scripts as your app. See Create an API key.
CI/CDContinuous integration and continuous deployment: merging changes often and releasing them automatically. See Trigger from CI.

Testing terms

TermMeaning
Push, Probe, Patch, PassThe four steps every change goes through: a PR or a build gives Pie something to test, you fix what broke with Auto-Fix, your coding agent or your tracker, and Pie re-checks until the change passes. See How Pie works.
Bug (defect)A flaw in the app that produces an incorrect or unexpected result.
End-to-end (E2E) testingTesting a workflow from start to finish, the way a user moves through it.
Functional testingTesting that features work as specified: does this feature do what it should?
Regression testingRe-running tests to confirm that recent changes haven’t broken working features.
Smoke testingA short set of tests on a new build to confirm its most critical paths work. A failed smoke test usually rejects the build.
Usability testingTesting how easy and intuitive the app is for a user.
Last updated on