26 lines
749 B
Markdown
26 lines
749 B
Markdown
# pipeline_setup_v4
|
|
|
|
`pipeline_setup_v4` is a component-level test harness built on top of the `v3` ideas.
|
|
|
|
Differences from `v3`:
|
|
|
|
- each YAML case targets a single isolated component;
|
|
- results are written next to the suite in `cases/.../test_runs/...`;
|
|
- the first supported component is `process_v2_intent_router`.
|
|
|
|
## Run
|
|
|
|
```bash
|
|
PYTHONPATH=. python -m tests.pipeline_setup_v4.run \
|
|
--cases-dir tests/pipeline_setup_v4/cases/suite_01/process_v2_intent_router/router_only_docs_v2_matrix.yaml \
|
|
--run-name smoke_v4
|
|
```
|
|
|
|
LLM-first router suite:
|
|
|
|
```bash
|
|
PYTHONPATH=. python -m tests.pipeline_setup_v4.run \
|
|
--cases-dir tests/pipeline_setup_v4/cases/suite_02/process_v2_intent_router/router_llm_first_v3.yaml \
|
|
--run-name llm_first_v3
|
|
```
|