Repository navigation
SHA checksum validation #28
Description
Add a CLI option to validate file integrity.
- Check the SHA sum of downloaded files against the Databus metadata
- If no SHA value is provided, skip validation but continue the download
{{ message }}
Activity
shivansh31414 commentedon Oct 28, 2025
Hi! I'd love to work on this feature. Could you please assign it to me?
My plan is to:
--validate-shato toggle this behaviorLet me know if this approach works or if you'd prefer something different
spyke7 commentedon Oct 29, 2025
Hi team ! I would also like to work on this feature
Integer-Ctrl commentedon Oct 30, 2025
Hi @shivansh31414 thanks for your interest!
Yes, your plan sounds good. Adding a toggle such as
--validate-shawould be a good approach.Maybe this could be more advanced:
--validate-sha off→ no SHA validation--validate-sha warning→ report mismatches as warnings but continue (default if cli option not specified)--validate-sha error→ stop execution if any file has a checksum mismatchThat would give users flexible control depending on their workflow.
Integer-Ctrl commentedon Oct 30, 2025
@spyke7 I think it's sufficient for one person to handle this issue, but we really appreciate your interest. Thanks!
Integer-Ctrl commentedon Dec 16, 2025
User no longer working on issue. Reopened.
agrim-git-hub commentedon Dec 25, 2025
Hi! I'd Love to work in this issue and start on my open source journey. I haven't used these libraries in python but I have coding experience and recently only have developed a full stack ML and Generative AI app using RAG and Scikit learn. I had built a pipeline using Cohere's free starter API for students. I trained and ensemble model and then I used vector search and vector databases for personalized answers. After i completed my full project i had containerized it using docker and then created its permanent image. I believe using docker for my project has given me some rough idea on how deploying works and that's why I want to help with this issue. If i could just be guided with what exact libraries I would need to read the documentation, for this repo, I believe I can fix this issue. I'll be glad if i could get some guidance. Looking forward to your reply!
Nama21yo commentedon Dec 27, 2025
Hi @Integer-Ctrl is there anyone who is assigned for this issue. Can I work on it?
Integer-Ctrl commentedon Dec 30, 2025
Hi @agrim-git-hub! Great to see that you want to continue your journey here
However, the skills and interests you listed aren't quite needed for this issue.
The task is to check whether the downloaded files have a SHASUM available on the Databus and, if so, to compute the SHASUM locally and verify it against the value provided by the Databus.
We don't have the resources to guide tickets in great detail. Ideas, drafts, and questions are very welcome, but providing a step-by-step guide would be quite time-consuming.
Since you were the first to show interest, I'd wait to see whether you still want to proceed with this ticket. Otherwise, I'll hand it over to @Nama21yo if still interested.
Nama21yo commentedon Dec 30, 2025
Yes @Integer-Ctrl am still interested and if this one is taken no worries I Will contribute on other issues. One more thing if possible.could you add me to the slack channel for more discussion the invitation inside the website have expired.
Here is my email mataniayohanes@gmail.com
agrim-git-hub commentedon Dec 30, 2025
hi @Integer-Ctrl , yes i am interested in going ahead with this ticket. No worries, I have started reading on poetry and hashlib. I believe i can solve this issue. Thanks for being supportive nonetheless.
agrim-git-hub commentedon Dec 31, 2025
Hi @Integer-Ctrl , I have implemented the changes and raised a PR here: #44. The logic now verifies checksums for downloads.