Skip to main content
Human feedback captures what automated metrics can’t — whether the agent’s response actually helped the user. You can collect it from internal reviewers using the ZeroEval dashboard, or from end users in your own application via the API.

Dashboard Review

Reviewers can browse completions directly in the ZeroEval console and submit feedback without writing any code.
  1. Navigate to Prompts → [your task] in the dashboard
  2. Open the Suggestions tab to see incoming completions
  3. Review each output and provide thumbs-up or thumbs-down
  4. Optionally add a reason and the expected output
Dashboard feedback is linked to the exact prompt version and model that produced the completion, so you can track quality per version over time.

In-App Feedback

Add like/dislike buttons, star ratings, or other feedback controls directly in your application. Use the SDK or REST API to send feedback tied to specific completions.

Thumbs-up / Thumbs-down

import zeroeval as ze

ze.send_feedback(
    prompt_slug="support-bot",
    completion_id=response.id,
    thumbs_up=user_clicked_thumbs_up,
    reason="User found the answer helpful"
)

With expected output

When a user corrects the agent, capture what the response should have been:
ze.send_feedback(
    prompt_slug="support-bot",
    completion_id=response.id,
    thumbs_up=False,
    reason="Wrong link provided",
    expected_output="The password reset page is at https://app.example.com/reset"
)
Expected outputs are used during prompt optimization to generate better prompt variants. For collecting feedback from users who don’t have a ZeroEval account (e.g. customers, external reviewers), create a feedback link that anyone can use:
curl -X POST https://api.zeroeval.com/feedback-links \
  -H "Authorization: Bearer $ZEROEVAL_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "prompt_slug": "support-bot",
    "link_type": "prompt_completion"
  }'
Share the returned URL with reviewers. They can submit feedback without needing API access or a ZeroEval account.