E5DD feat: data converter manager by bingogome · Pull Request #73 · Tavish9/any4lerobot · GitHub
[go: up one dir, main page]
Skip to content

feat: data converter manager #73

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
bingogome wants to merge 13 commits into
base: main
Choose a base branch
from
Open

feat: data converter manager #73

Changes from 1 commit
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
49987c2
feat: v2.1 to v2.0
bingogome Oct 3, 2025
a375348
Merge pull request #1 from bingogome/v2_1-to-v2_0
bingogome Oct 13, 2025
98f4a53
[DEV] update to filter new 3.0 fields
bingogome Oct 18, 2025
883437f
Merge branch 'Tavish9:main' into main
bingogome Oct 18, 2025
9451121
Merge pull request #2 from bingogome/v2_1-to-v2_0
bingogome Oct 18, 2025
47134a6
feat: v21tov20 with filters and v30tov21
bingogome Oct 18, 2025
483c311
fix: gemini-code-assist comments
bingogome Nov 13, 2025
4857706
feat: converter class and pipeline
bingogome Nov 13, 2025
8639cb1
remove: global stat copy
bingogome Nov 18, 2025
f277f3b
merge: global stat copy remove
bingogome Nov 18, 2025
03478df
remove: global stat copy (manager)
bingogome Nov 18, 2025
db79b8d
fix: rename root to output-path
bingogome Nov 18, 2025
4e7c436
merge: rename root to output-path
bingogome Nov 18, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
remove: global stat copy
  • Loading branch information
@bingogome
bingogome committed Nov 18, 2025
commit 8639cb1b2b39c10f964ea5175f1b7629250697fc
9 changes: 0 additions & 9 deletions ds_version_convert/v30_to_v21/convert_dataset_v30_to_v21.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -417,14 +417,6 @@ def convert_episodes_metadata(new_root: Path, episode_records: list[dict[str, An
)


def copy_global_stats(root: Path, new_root: Path) -> None:
source_stats = root / "meta" / "stats.json"
if source_stats.exists():
target_stats = new_root / "meta" / "stats.json"
target_stats.parent.mkdir(parents=True, exist_ok=True)
shutil.copy2(source_stats, target_stats)


def copy_ancillary_directories(root: Path, new_root: Path) -> None:
for subdir in ["images"]:
source = root / subdir
Expand Down Expand Up @@ -470,7 +462,6 @@ def convert_dataset(
new_root.mkdir(parents=True, exist_ok=True)

convert_info(root, new_root, episode_records, video_keys)
copy_global_stats(root, new_root)
convert_tasks(root, new_root)
convert_data(root, new_root, episode_records)
convert_videos(root, new_root, episode_records, video_keys)
Expand Down
0