I have a bucket with thousands of files in it. How can I search the bucket? Is there a tool you can recommend?
This is little bit old thread - but maybe help someone who still search - I'm the one who search for that a year.
Solution may be "AWS Athena" where you can search over data like this
'SELECT user_name FROM S3Object WHERE cast(age as int) > 20'
https://aws.amazon.com/blogs/developer/introducing-support-for-amazon-s3-select-in-the-aws-sdk-for-javascript/
Currently pricing is $5 for 1TB data - so for example, if your query search over one 1TB file 3times your cost is $15 - but for example if there is only 1column in "converted columnar format" what you want read, you'll pay 1/3 of price means $1.67/TB.