I would like to create "infinite" directory in terms of storage in an EC2 instance. Is it possible to symlink directories to S3 bucket?
I did not find any solution in the Internet, maybe somebody knows?
Amazon S3 is not a file system. You cannot just mount it to your EC2 instance like a regular disk or EBS. It now follows that a symlink is not possible.
You can however use s3fs to mount your S3 bucket as a directory in your EC2 server.
I used this tutorial and I was able to successfully mount my S3 to my EC2 running on Ubuntu 14.04.
WARNING You are billed in S3 based on the number of request you make. I did not do any further research, but my S3 usage spiked when I did this. I believe that the connections maintained by the mounted S3 bucket was counted as a GET/PUT/LIST request.
Another Alternative is to use Amazon's Elastic File System. This is like S3 but a file system.
ls -l
, at least one LIST
request is followed by a HEAD
request for each file in the directory, because the S3 object metadata is where the unix owner, group, and file mode are stored. So, uses, this can add up.
Jun 2, 2016 at 1:25
What you're looking for is EFS(elastic file system), but that hasn't been released yet. What you could try is this: https://forums.aws.amazon.com/thread.jspa?messageID=475840 but I have never tried this myself.