-iin parameter can take one file, so depending on your use case, your folder can be e.g. zipped and later unzipped on the worker, you can e.g. loop through each file in the zipped folder and process the data. Or you can use dxfuse with wildcards (/mnt/project/*.txt) in your code. There is also batch mode processing.
Comments
1 comment
-iin parameter can take one file, so depending on your use case, your folder can be e.g. zipped and later unzipped on the worker, you can e.g. loop through each file in the zipped folder and process the data. Or you can use dxfuse with wildcards (/mnt/project/*.txt) in your code. There is also batch mode processing.
Please sign in to leave a comment.