Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
Manage preference annotation
tp annotate status # is the integration configured
tp annotate push run-4f2a91 --limit 200 # send answers out for labelling
tp annotate pull run-4f2a91 --dataset alice/prefs # bring judgements back as a dataset
tp annotate status
tells you whether an Argilla instance is wired up at all — start there, because everything else
fails confusingly without one.
See Annotation for the workflow around these commands.
tp annotatetp annotate <subcommand>
| Command | Description |
|---|---|
tp annotate pull | Pull annotations back as a dataset |
tp annotate push | Send answers out for annotation |
tp annotate status | Check the Argilla integration |
tp annotate pulltp annotate pull <DATASET> [options]
| Argument | Description |
|---|---|
DATASET | Argilla dataset name (required) |
| Option | Description |
|---|---|
--into | Land them as a new version of this platform dataset; omit to only print the statistics |
--version, -v | Dataset version; defaults to the date |
tp annotate pushtp annotate push <RUN_A> <RUN_B> [options]
| Argument | Description |
|---|---|
RUN_A | Run id of the first training run (required) |
RUN_B | Run id of the second training run (required) |
| Option | Description |
|---|---|
--dataset, -d | Argilla dataset name; synthesised when empty |
--limit <int range> | How many pairs to push at most (default 200) |
tp annotate statustp annotate status
--help.