tp dataset

tp dataset push gsm8k-zh v2 ./out/gsm8k-zh

把一个目录作为一个不可变版本上传。完整流程见发布并使用数据集。

实例

# 本地预处理
tp dataset prepare                          # 这个项目有哪些脚本
tp dataset prepare gsm8k-zh                 # 跑 common/data/prepare_gsm8k_zh.py

# 推一个版本
tp dataset push gsm8k-zh v2 ./out/gsm8k-zh
tp dataset push gsm8k-zh v2 ./out/gsm8k-zh --public
tp dataset push alice/gsm8k-zh v2 ./out --readme CARD.md

# 描述它
tp dataset card alice/gsm8k-zh              # 打印当前的卡
tp dataset card alice/gsm8k-zh -f README.md # 不推数据也能更新它

# 推之前检查
tp dataset check ./out/my-train --against ./eval/gsm8k-test.jsonl
tp dataset check ./out/my-train --against ./eval/test.jsonl --fields question
tp dataset quality ./out/my-train
tp dataset fingerprint ./gsm8k-test.jsonl -o gsm8k.fingerprint.json

# 列出与共享
tp dataset ls
tp dataset ls alice/gsm8k-zh -v v2          # 某个版本的文件清单
tp dataset visibility alice/gsm8k-zh --public
tp dataset visibility alice/gsm8k-zh --private

参数表装不下的几点

DATASET 不带 owner 时落进你自己的命名空间。只有管理员能跨命名空间推。
VERSION 不可变。同名版本无法覆盖；推一个新的。
--readme 默认取 PATH 里的 README.md（如果有）。它会成为数据集卡，卡属于数据集而不是某一个版本。
tp dataset check 有重叠时退出码是 1，所以它能直接放进 CI 当闸门。
上传是分块、逐文件校验和、可续传的：中断后重跑会跳过已经落盘的部分。

确认成功

tp dataset ls alice/gsm8k-zh

新版本带它的文件数和大小出现。然后引用它：

tp submit my-grpo --profile h200:8 \
  --train-dataset alice/gsm8k-zh@v2 --train-data train.parquet

`tp dataset`

Manage datasets

tp dataset <subcommand>

命令	说明
`tp dataset card`	Show/update a dataset description (README.md)
`tp dataset check`	Check training data for evaluation overlap
`tp dataset fingerprint`	Compute a dataset fingerprint
`tp dataset ls`	List the visible datasets
`tp dataset prepare`	Preprocess a dataset locally
`tp dataset push`	Upload one dataset version
`tp dataset quality`	Produce a dataset quality report
`tp dataset visibility`	Change a dataset’s visibility (owner or admin)

`tp dataset card`

Show/update a dataset description (README.md)

tp dataset card <DATASET> [options]

参数	说明
`DATASET`	Dataset id (<owner>/<name>) (必填)

选项	说明
`--file`, `-f`	Update the description from this markdown file; omit to print the current one

`tp dataset check`

Check training data for evaluation overlap

tp dataset check <PATH> [options]

参数	说明
`PATH`	Training data directory or file (jsonl / json / csv / parquet) (必填)

选项	说明
`--against`, `-a`	Evaluation set directory or file; the question is whether its questions leaked into training (必填)
`--fields`	Only these fields (comma separated), e.g. question,prompt. Defaults to every string field

`tp dataset fingerprint`

Compute a dataset fingerprint

tp dataset fingerprint <PATH> [options]

参数	说明
`PATH`	Data directory or file (必填)

选项	说明
`--out`, `-o`	Write it to this file; omit to print a summary
`--fields`	Only these fields (comma separated)

`tp dataset ls`

List the visible datasets

tp dataset ls [DATASET] [options]

参数	说明
`DATASET`	Dataset id (<owner>/<name>); omit to list everything visible

选项	说明
`--version`, `-v`	Show one version’s file list; defaults to the latest

`tp dataset prepare`

Preprocess a dataset locally

tp dataset prepare [DATASET]

参数	说明
`DATASET`	Dataset name; leave empty to list the options

除 --help 外没有其他选项。

`tp dataset push`

Upload one dataset version

tp dataset push <DATASET> <VERSION> <PATH> [options]

参数	说明
`DATASET`	Dataset name (lands in your own namespace), or a full <owner>/<name> (an admin can cross namespaces) (必填)
`VERSION`	Version, e.g. v1 / 20260812 (必填)
`PATH`	Local directory (必填)

选项	说明
`--public`	Make it public on first creation (anyone can reference it in training)
`--readme`	Dataset description (markdown); defaults to the README.md in the directory
`--concurrency` `<int>`	Uploads in flight. Left alone, it is chosen from the size of what you are sending; the right number depends on the link, which nothing here can see (默认 `0`)

`tp dataset quality`

Produce a dataset quality report

tp dataset quality <PATH> [options]

参数	说明
`PATH`	Data directory or file (必填)

选项	说明
`--fields`	Only these fields (comma separated)

`tp dataset visibility`

Change a dataset’s visibility (owner or admin)

tp dataset visibility <DATASET> [options]

参数	说明
`DATASET`	Dataset id (<owner>/<name>) (必填)

选项	说明
`--public`	Make it public
`--private`	Make it private

CLI 参考

配置

实验

训练

产物与评测

资源

管理

实例

参数表装不下的几点

确认成功

`tp dataset`

`tp dataset card`

`tp dataset check`

`tp dataset fingerprint`

`tp dataset ls`

`tp dataset prepare`

`tp dataset push`

`tp dataset quality`

`tp dataset visibility`

​实例

​参数表装不下的几点

​确认成功

​tp dataset

​tp dataset card

​tp dataset check

​tp dataset fingerprint

​tp dataset ls

​tp dataset prepare

​tp dataset push

​tp dataset quality

​tp dataset visibility

实例

参数表装不下的几点

确认成功

`tp dataset`

`tp dataset card`

`tp dataset check`

`tp dataset fingerprint`

`tp dataset ls`

`tp dataset prepare`

`tp dataset push`

`tp dataset quality`

`tp dataset visibility`