-
Notifications
You must be signed in to change notification settings - Fork 1.3k
Open
Labels
Description
Problem Statement
When I run an Eval, it would be helpful to have it traced. It would be especially cool if the there was some link between the original trace/span and the eval trace.
Then I could easily debug the a specific score to see why it happened.
Proposed Solution
Add Scores/Eval tracing. Create links between scores & score traces.
Component
Other
Alternatives Considered
No response
Example Use Case
Evals are confusing. It would be great to gain some insight into how they are working in order to debug my scorer.
Additional Context
No response
Verification
- I have searched the existing issues to make sure this is not a duplicate
- I have provided sufficient context for the team to understand the request