Limitaion: /tmp directory storage size is 512 MB may cause failure for larger data

[vishvendrasingh]

Limitaion: /tmp directory storage size is 512 MB may cause failure for any larger data greater than 512 MB. Please suggest a fix so that I can help write it.

[llangit]

Hello! I think the best solution would be to stream the data from mongodump directly into S3 without saving to /tmp first. You could try out this solution for instance: https://github.com/rafkhan/mongodump-stream
Alternatively, you could configure your Lamdba function to use an EFS file system instead of the /tmp directory: https://aws.amazon.com/de/blogs/compute/using-amazon-efs-for-aws-lambda-in-your-serverless-applications/

[bugb]

@llangit thank for you help!

@vishvendrasingh do you find away to deal with the problem?