Does it require a separate manifest.json for each sub prefix present in bucket ? #2
Unanswered
ankitsinghal22
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Trying to work out with this tool for my S3 analysis. Already added the
manifest.jsonand the required unzipped CSV files in the given directory, but the tool fails to read any of the data.Sample logs of ingestor:
Seems like the method
insert_csv_to_dbfails silently and nothing persists in DB.I found another issue that the downloaded files are normally in
*.csv.gzformat. The tool does not handle those files. Need to manually unzip them firstly.All reactions