Prompt Pie

Your agent gets the best results from Pie when a prompt names the app, says what you want done and points at the test, run or issue to act on.

Before you start

  • Connect your agent to Pie. See Connect your agent.
  • Run your app at least once, so there are results to read.

Name the app you mean

If you connected more than one app, start the prompt with the connection name from your config.

Using pie-staging, list the open issues

With a single connection, your agent uses it without being told.

Name the action and the target

Say what you want done and on what. Use IDs when you have them, or a description when you don’t, and your agent looks up the matching test cases first.

Run test cases 12, 15, and 23
Run the login test

Ask for a change and a rerun together

When you want to edit a test and try it again, put both in one prompt. Your agent saves the edit with update_testcase and, once that call returns, starts the rerun with run_specific_testcases.

Update test case 42: change the title to "Login with SSO" and add an assertion that the user sees the dashboard, then run it again

Check progress, then read the result

Ask whether a run has finished, then ask for its results.

Is run 8321 still going?
Show me the results from the most recent test run

Example prompts

Run tests

Run the Smoke Tests suite on build release-42
Run test cases 12, 15, and 23

Read results

List all failed tests from run 8321
Show me the detailed execution steps for test case 42

Triage issues

List the issues
Show me the details for issue 123
Show me all issues including resolved and rejected ones
Resolve issue 104: it is fixed in the most recent build

Create and edit test cases

For how the portal edits and reruns a test, see Create and edit test cases.

Create a test case that verifies the checkout flow: add an item to cart, proceed to checkout, enter payment details and confirm the order
Draft test case prompts for checking out with a saved card as a premium user
Archive test cases 5, 8, and 12

Run coverage scans

This prompt starts a scan. Any member can start one. For what happens next, see Run a coverage scan.

Run a coverage scan over the last 7 days

What you’ll see

Your agent calls the Pie tool that matches your request and tells you what it found. Test cases and runs are the same ones you see in the portal. Your agent can also list issues that Pie has not reviewed yet, which the Issues page does not show.

Next steps

Last updated on