ERROR: Failed to build installable wheels for some pyproject.toml based projects (tokenizers, sentencepiece)

[AmishKakka]

While installing libraries in a python3 environment using pip3 install on Mac M2 the following error is produced -

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for tokenizers
Building wheel for sentencepiece (pyproject.toml) ... error
error: subprocess-exited-with-error

note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for sentencepiece
Failed to build tokenizers sentencepiece
ERROR: Failed to build installable wheels for some pyproject.toml based projects (tokenizers, sentencepiece)

[mukund1771]

This issue is mostly related to the Setuptools package , try downgrading the package to an older version, used to run into this issue a lot in the past, try to build it in a fresh environment.

check : #huggingface/tokenizers#1050