Skip to content

Download tokenizers from GCS in unit tests instead of HF - #4752

Open
igorts-git wants to merge 1 commit into
mainfrom
igorts/tokenizer-assets
Open

Download tokenizers from GCS in unit tests instead of HF#4752
igorts-git wants to merge 1 commit into
mainfrom
igorts/tokenizer-assets

Download non-Apache tokenizers from GCS in unit tests and fix worktre…

192b0f2
Select commit
Loading
Failed to load commit list.
Google CLA / cla/google succeeded Aug 7, 2026 in 8s

✅ All contributors are covered under a CLA with Google

See https://cla.developers.google.com/ for more info about Google's Contributor License Agreement (CLA).

ℹ️ Googlers: Go here to view more details and manage scans for this pull request.

Details

The following contributors were found for this pull request:

192b0f2 Author: @igorts-git <ig***s​@google.com>

(Only the first commit for a unique contributor is listed.)