Conversation
These tags are informational and not consumed by any pipeline; retagged entries whose content is broader than faces after a visual pass: Mandrillus-Face -> animals, WarpDoc_merged -> documents, nepali-cultural-dress-dataset / shhq-1.0 / posedreamer -> humans. spoof_png, or-real-id, synthetic_cards, FantasyID stay as faces.
Video datasets can now ship as parquet shards with one row per frame (video_id, frame_idx, image, filename). _process_parquet dispatches these to a grouping pass that yields standard video_frames samples, and the cache writer accepts raw frame bytes alongside frame paths. Used for releasing frame-dir holdouts (UADFV, and later DFDC/FF++) to 34data.
s3 fetch import fix + frames-parquet loader + v20 holdout config additions.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Promotes the 5 dev commits since the last dev→main merge (#123, 2026-07-14) to main. All config/loader changes; no divergence on main (the branch's lead over dev is historical merge commits only).
Commits
import fix— correctfetch.pyrelative-import depth (.utils→..utils) so S3/Wasabi downloads resolves3_utilsinstead of throwingNo module named 'gasbench.dataset.download.utils'. Every S3-source download was broken without this.content_categoryfor a few datasetsNotes
40f96a2; this promotion makes gasbench main match what production consumes.🤖 Generated with Claude Code