> ## Documentation Index
> Fetch the complete documentation index at: https://docs.tuneplane.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# tp annotate

> Manage preference annotation

```bash theme={"theme":{"light":"github-light","dark":"github-dark-dimmed"}}
tp annotate status                                   # is the integration configured
tp annotate push run-4f2a91 --limit 200              # send answers out for labelling
tp annotate pull run-4f2a91 --dataset alice/prefs    # bring judgements back as a dataset
```

Human preference annotation, through an Argilla instance the deployment configures. The loop is:
take a run's generated answers out for people to judge, then bring the judgements back as a
versioned dataset you can train DPO on.

The platform is the transport and the governance here, not the annotation tool. `tp annotate status`
tells you whether an Argilla instance is wired up at all — start there, because everything else
fails confusingly without one.

See [Annotation](/en/guides/annotation) for the workflow around these commands.

## `tp annotate`

Manage preference annotation

```bash theme={"theme":{"light":"github-light","dark":"github-dark-dimmed"}}
tp annotate <subcommand>
```

| Command              | Description                        |
| -------------------- | ---------------------------------- |
| `tp annotate pull`   | Pull annotations back as a dataset |
| `tp annotate push`   | Send answers out for annotation    |
| `tp annotate status` | Check the Argilla integration      |

### `tp annotate pull`

Pull annotations back as a dataset

```bash theme={"theme":{"light":"github-light","dark":"github-dark-dimmed"}}
tp annotate pull <DATASET> [options]
```

| Argument  | Description                         |
| --------- | ----------------------------------- |
| `DATASET` | Argilla dataset name (**required**) |

| Option            | Description                                                                            |
| ----------------- | -------------------------------------------------------------------------------------- |
| `--into`          | Land them as a new version of this platform dataset; omit to only print the statistics |
| `--version`, `-v` | Dataset version; defaults to the date                                                  |

### `tp annotate push`

Send answers out for annotation

```bash theme={"theme":{"light":"github-light","dark":"github-dark-dimmed"}}
tp annotate push <RUN_A> <RUN_B> [options]
```

| Argument | Description                                      |
| -------- | ------------------------------------------------ |
| `RUN_A`  | Run id of the first training run (**required**)  |
| `RUN_B`  | Run id of the second training run (**required**) |

| Option                  | Description                                    |
| ----------------------- | ---------------------------------------------- |
| `--dataset`, `-d`       | Argilla dataset name; synthesised when empty   |
| `--limit` `<int range>` | How many pairs to push at most (default `200`) |

### `tp annotate status`

Check the Argilla integration

```bash theme={"theme":{"light":"github-light","dark":"github-dark-dimmed"}}
tp annotate status
```

No options beyond `--help`.