gh-150207: Raise MemoryError on tokenizer allocation failure instead of crashing

gh-150207: Raise MemoryError on tokenizer allocation failure instead of crashing #118211