Wenxing Zhu

[Feature Request] Hope to get the token usage report per AOAI connection deployment

4

For now the token usage report is summarized per batch run. However, it would be more helpful for users to estimate costs if promptflow could provide token usage reports for...

[BUG] Promptflow-evals raises '(TypeError) cannot pickle '_thread.RLock' object.'

2

PF: 1.14.0 promptflow-evals: 0.3.1 ```python from promptflow.evals.synthetic import AdversarialScenario, AdversarialSimulator from promptflow.evals.evaluate import evaluate from promptflow.evals.evaluators import ( ContentSafetyEvaluator, ) from typing import Dict, Any from azure.identity import DefaultAzureCredential from...

azure.ai.evaluation SDK cannot handle `conversation` input from a csv file.

3

- **Package Name**: azure.ai.evaluation - **Package Version**: 1.8.0 - **Operating System**: Windows 11 - **Python Version**: 3.12.9 **Describe the bug** In a csv file, **To Reproduce** Steps to reproduce the...