Classifier Integration Test Tooling (Python) #217
Conversation
|
Failed checks:
Other considerations:
|
| ``` | ||
| 2. Run all unit tests | ||
| ```bash | ||
| pytest python/src/tests --ignore-glob='*/integration/*' |
There was a problem hiding this comment.
I think you should remove python from python/src/tests because we are in the pythonfolder when running this.
| ### How to run Integration Tests | ||
|
|
||
| ```bash | ||
| pytest python/src/tests/integration |
There was a problem hiding this comment.
the same ase above, and I tried to execute pytest src/tests/integrationbut I have other errors like
FileNotFoundError: Configuration file not found: python/src/tests/integration/classifier/orchestrator_config.json
The file seems to be there but it must be related to a path somewhere.
| ``` | ||
|
|
||
| 2. Install the build dependencies: | ||
| ```bash | ||
| python -m pip install build | ||
| python3.11 -m pip install build |
There was a problem hiding this comment.
you should keep it generic like python -m ...
| ```bash | ||
| cd python | ||
| python3.11 -m venv venv |
There was a problem hiding this comment.
you should use python instead of python3.11
| 1. Install pytest and pytest-asyncio | ||
| ```bash | ||
| source venv/bin/activate | ||
| pip3.11 install -r test_requirements.txt |
There was a problem hiding this comment.
use pip install... instead of pip3.11, keep it generic.
| This guide explains how to set up and run classification tests for the Multi-Agent Orchestrator. These tests verify that user inputs are correctly routed to the appropriate agents with the expected confidence levels. | ||
|
|
||
| ## Required Files | ||
| You need three JSON configuration files in the `python/src/tests/integration/classifier/` directory: |
There was a problem hiding this comment.
since we are in the python version remove python from the path.
Issue number: #76
Summary
Changes
Added comprehensive classification testing framework including:
User experience
Before:
After:
Checklist
Is this a breaking change?
RFC issue number: N/A
Checklist:
This is not a breaking change as it adds new testing capabilities without modifying existing functionality.
Acknowledgment
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.
Disclaimer: We value your time and bandwidth. As such, any pull requests created on non-triaged issues might not be successful.