Add testing for thread safety of driver

[HamiltonRepoMigrationBot]

Issue by elijahbenizzy
Friday Nov 18, 2022 at 21:56 GMT
Originally opened as stitchfix/hamilton#234

---

Is your feature request related to a problem? Please describe.
The driver should be thread-safe, but we want a test to ensure

Describe the solution you'd like
A unit/integration test that runs a bunch in parallel with the same drier.

Additional context
Add any other context or screenshots about the feature request here.
https://hamilton-opensource.slack.com/archives/C03M33QB4M8/p1668807849626519

[skrawcz]

Task here would be to create a test that:

1. creates a driver
2. in separate threads performs executions with different values
3. we validate the results didn't interact/cause issues.

[AsmitBhardwaj]

Hi, I'm a computer science student interested in working on this issue. I have experience writing Python unit tests with pytest and am comfortable with concurrency concepts. The scope outlined is clear and I'd like to implement a test that creates a driver, runs parallel executions with different values across threads, and validates the results don't interfere with each other. Could I be assigned this issue?

[AkshayRevankarDev]

hey im a student at codepath and would like to take this issue if possible

[vardhans07]

@HamiltonRepoMigrationBot and @skrawcz Could you please assign this to me, or let me know if I can start working on it? Thank you!

[vardhans07]

Hey @skrawcz and @HamiltonRepoMigrationBot , I have implemented the thread-safety tests across standard and task-based executors and submitted PR #1686. Please review when you get a chance.