Skip to content

[FEATURE] Add Scores/Eval tracing #10899

@epinzur

Description

@epinzur

Problem Statement

When I run an Eval, it would be helpful to have it traced. It would be especially cool if the there was some link between the original trace/span and the eval trace.

Then I could easily debug the a specific score to see why it happened.

Proposed Solution

Add Scores/Eval tracing. Create links between scores & score traces.

Component

Other

Alternatives Considered

No response

Example Use Case

Evals are confusing. It would be great to gain some insight into how they are working in order to debug my scorer.

Additional Context

No response

Verification

  • I have searched the existing issues to make sure this is not a duplicate
  • I have provided sufficient context for the team to understand the request

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions