New answers tagged

0

This worked for me iam_role=auto Here is my /etc/fstab entry s3fs#my_bucket /s3mount_path fuse _netdev,allow_other,iam_role=auto 0 0 Just make sure you IAM role has proper permissions


0

Yes you can. For hiding S3 you use origin access identities and not expose s3 endpoint to any other service other than CloudFront. To restrict access to CloudFront you have 2 choices. You can either use CloudFront's private content feature and restrict access by time or to specific IPs. Or, you can use AWS WAF and block access to any source IPs other than ...


1

...when you've made a commitment that the URL will always serve the same content body forever. In this case it's often better to force a browser to go straight to its local cache on repeat visits. A browser (or other cache) will not visit the origin until it believes the content has expired. In your case, you would want to instead send the appropriate ...


0

You can use s3cmd: s3cmd du s3://Mybucket -H or s3cmd du s3://Mybucket --human-readable It gives the total objects and the size of the bucket in a very readable form.


1

The original logs won't get modified. The logs "forwarder or shipper" does only read/tail the input file from source. If specified it can append additional tags/elements to them and sends the information to the logstash instance for further parsing and enrichment.


0

If speed is a concern than I suggest using an InstanceStore rather than EBS. http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/InstanceStorage.html


0

To check all buckets size try this bash script s3list=`aws s3 ls | awk '{print $3}'` for s3dir in $s3list do echo $s3dir aws s3 ls "s3://$s3dir" --recursive --human-readable --summarize | grep "Total Size" done


1

It can easily be done via any of AWS SDK's. You need to do the following: Retreive a list of all objects located in S3 bucket. Filter the list according to your criteria using regular expressions. Dowload files using the filnal list of objects If you are using PHP, the following docs could be useful for you: http://docs.aws.amazon.com/aws-sdk-php/v3/api/...


0

Since there are so many answers, I figured I'd pitch in with my own. I wrote my implementation in C# using LINQPad. Copy, paste, and enter in the access key, secret key, region endpoint, and bucket name you want to query. Also, make sure to add the AWSSDK nuget package. Testing against one of my buckets, it gave me a count of 128075 and a size of 70.6GB. I ...



Top 50 recent answers are included