s3fs is FUSE-based filesystem that stores files in AWS S3.

learn more… | top users | synonyms

0
votes
0answers
88 views

Custom file/folder permissions with S3FS?

I have setup an SFTP server using OpenSSH. The home directory for users is /sftp/%user. I'm mounting an S3 bucket at /sftp using S3FS. The problem is that S3FS cascades user permissions down through ...
0
votes
0answers
36 views

Root user permission issues with SFTP and S3FS on Amazon EC2

I have setup an SFTP server using OpenSSH. The home directory for users is /sftp/%user. I'm mounting an S3 bucket at /sftp using S3FS. The problem is that S3FS cascades user permissions down through ...
0
votes
0answers
61 views

Configure SFTP with OpenSSH and an AWS S3 Bucket mounted via S3FS on Amazon EC2

How do I allow multiple SFTP Users with S3FS and OpenSSH? Everything works, except SFTP Users don't have permission to write to their Chrooted Home Directory: remote open("/some_file"): Permission ...
0
votes
0answers
49 views

Read Files from S3FS mount with PHP

We have a S3 bucket we use for video uploading. I also have a script for accessing the Youtube API so I can pull the upload files from a server rather than via the Web interface. This used to work ...
0
votes
0answers
123 views

S3FS and Fuse, scale out or scale up

I have an infra where I have multiple machines (eg FTP servers, get/put and Samba/NFS servers) that need to share out the same (HA) storage. So I figured to use s3fs and fuse. I got this all setup and ...
0
votes
0answers
39 views

s3fs not auto-mount on EC2 reboot

I have this line in /etc/fstab s3fs#s3-bucket.com path/to/dir fuse _netdev,allow_other,default_acl=public-read,iam_role=my_role,use_cache=/s3fscache,retries=5 0 0 Whenever I reboot EC2, I got error ...
0
votes
1answer
31 views

Automate s3fs-fuse install

I'm trying to write script to install s3fs-fuse, but i don't know how to change directory in a bash script. These are the script I want to automate git clone https://github.com/s3fs-fuse/s3fs-fuse....
0
votes
1answer
94 views

Is S3 a proper choice to keep live linux user home directories?

We are building an RDP cluster using Amazon EC2/S3. Users' home directories are on S3 (single bucket) and all EC2 nodes mount the same S3 bucket using S3FS. Each EC2 node uses the appropriate home ...
0
votes
1answer
1k views

s3fs “could not determine how to establish security credentials”

I'm trying to use s3fs to mount an S3 bucket on to a standard AWS Amazon Linux AMI (with all the necessary dependencies installed). However when following this tutorial when I run: s3fs mybucketname -...
0
votes
1answer
192 views

Does linux count s3fs mounts as local disk usage?

I have an s3 bucket mounted on an EC2 instance whose main disk is an EBS volume. Whenever I run something like du -h /path/to/mount it tells me the size of the folders within those. I'm wondering ...
0
votes
1answer
735 views

AWS: Best solution for syncing files across autoscaled EC2 instances?

I'm working on setting up autoscaling on EC2; Instances will be running a web app with big traffic spikes. The first solution I tried for syncing files across instances (since the web app will write ...
4
votes
1answer
2k views

Linux server sync to an Amazon S3 bucket

I am looking for a stable solution to replace a classic server backup to another server using rsync. I have to sync a whole filesystem (more than 1Tb) to Amazon S3. Where am I? Solution 1: I mapped ...
0
votes
1answer
245 views

Fuse module for s3fs

I am trying to install the s3fs software. I however keep coming upon this error: $ sudo /usr/bin/s3fs bucketname /mnt fuse: device not found, try 'modprobe fuse' first $ modprobe fuse FATAL: Module ...
0
votes
1answer
152 views

autoscale static content on ec2 using local cache

Hello Serverfault members. I want to achieve the following setup on EC2: A load balancer starts and stops instances which only serve static content. (a javascript based application) I do not want to ...
0
votes
1answer
136 views

Subsequent runs of rsync locally don't reduce data transferred

I have an EC2 instance with data I want to sync to a mounted, but remote, volume, as a backup. rsync seems like the way to go with this, so as a test I took my test file (a Postgres pg_dump file) and ...
0
votes
1answer
258 views

configure s3fs mount for write-only

I am using s3fs to mount a S3 buckets on an Ubunutu server to store my daily backups there. Considering security this would allow a potential hacker to delete all my backups from the mounted bucket. ...
1
vote
3answers
1k views

How to make s3fs work with IAM roles?

We are using IAM roles to maintain the machines. We now planning to mount the s3 to our ec2 instances and do the processing as per our need. We been using s3fs tool for mounting. But that doesn't ...
1
vote
1answer
634 views

Getting errors running mount on Amazon Linux after installing s3fs (`MOUNT_2.22' not found required by mount)

Followed these instructions to install s3fs on Amazon Linux. It worked fine on one of my systems, however on a different system (following the same instructions) I am getting the following errors ...
1
vote
0answers
348 views

s3fs-mounted S3 bucket shows bad filesizes

Background: I have an Amazon S3 bucket with data uploaded using the AWS web interface. Now I need to give permissions-based access to paths within my buckets to FTP users. To do this, I'm running ...
6
votes
6answers
10k views

S3fs performance improvements or alternative?

I've been trying to use s3fs on an EC2 server but it's really slow. I spent the last 5 hours uploading 100MB of small files. Is there anything I can do to improve the performance or is it something ...
1
vote
2answers
2k views

s3fs changing s3 permissions?

My developer believes that s3fs is changing my bucket's permissions. Is this possible? I want my bucket to be public, but it keeps reverting back to private. Here's my fstab. s3fs#production /mnt/...
1
vote
1answer
2k views

Mounting an S3 bucket onto a AWS Ubuntu instance issues

i'm using s3fuse to mount an s3 bucket onto ubuntu, so that i can take advantage of the storage space. here are some environment info: System Info: Linux ip-xxx-xxx-xxx-xxx 2.6.38-8-virtual #42-...
1
vote
1answer
1k views

Writing to an s3 mounted directory

hopefully someone can advise. I've recently mounted an s3 bucket to a directory /s3 on my ubuntu amazon ec2 instance -following: http://code.google.com/p/s3fs/wiki/FuseOverAmazon. This was set up in ...
4
votes
2answers
474 views

S3 based file system capable of requesting only part of file

I'm storing large datasets in s3, but on a given computer in my cluster, my program only needs to read a small subset of the data. I first tried s3fs, but it downlooads the entire file first, which ...
0
votes
1answer
2k views

s3fs and fuse: failed to open /dev/fuse: Permission denied

Just installed Debian 6 box. I wanted to mount my S3 bucket for some backups. So I followed instructions for http://code.google.com/p/s3fs/ . 1) I installed all perquisites asked in installation ...
0
votes
3answers
840 views

Bacula over s3fs

We are constantly running out of space on our backup server so I want to move the backups to S3. Does it make sense to run Bacula on top of s3fs? Does anybody have experience with that? Is it reliable?...
1
vote
2answers
1k views

s3fs Input/output error

I'm trying to set up a backup system with s3fs and the Amazon S3 service. I followed this this guide and this guide. Tailing /var/log/messages I get: Aug 28 13:37:46 server s3fs:###response=403 I ...