Questions tagged [cloud-storage]
Online storage of files, hosted by third party providers.
90
questions
0
votes
0
answers
18
views
ScaleIO services do not start correctly\do not listen on IPv4 [closed]
I have been trying to configure a scaleio cluster for past few weeks.
Setup:
Three VMs for MDMs: master, slave and TB
One SDS (this is a test environment and more SDS will be added when the cluster is ...
0
votes
0
answers
171
views
Minio vs CubeFS: Comparison
I was exploring blob storage for custom deployment. Minio and CubeFS are two among them that I felt was really good. Is there any one out there who has experience with both of these tools? If anyone ...
0
votes
1
answer
388
views
Is it possible to specify storage class with azcopy?
I would like to use azcopy to sync a local drive with cloud storage. However I want to specify it to use archive storage tier. Is this possible? I am not really clear from the help page:
$ ./azcopy....
1
vote
0
answers
1k
views
Https Load Balancer for backend bucket, but not exposed to internet
-Before trying internal https LB, I have already tested External HTTPS LB exposed directly to internet for backend bucket.
In this case, I have created all necessary resources in GCP
(...
0
votes
1
answer
175
views
GlusterFS - Define Failover Cluster
I am currently planning the storage infrastructure for our new application. Since performance is a big and important item on our list, I want to use SSDs for the production environment. We sell a ...
1
vote
1
answer
3k
views
Google Cloud Platform Boot Disk Pricing
I'm quite confused by how GCP prices disks. We're currently using GCP's free plan, with an always free f1-micro instance. I understand that additional disks have a price per GB month, but I'm really ...
4
votes
1
answer
161
views
Cloud Storage Provider with file handles
Is there a cloud storage provider that provides file handles similarly to CIFS/SMB? We are using Dropbox and we would like to receive a warning when a file is opened by someone else (if there's a ...
3
votes
1
answer
780
views
GKE k8s cluster storage.googleapis.com sporadic Temporary failure in name resolution
I am trying to run a snakemake pipeline on a kubernetes cluster (GKE). The job is being initiated from a GCE VM. Sometimes it works, mostly it doesn't.
Steps I took were
gcloud container clusters ...
1
vote
1
answer
212
views
Export 20TB from Amazon S3
I have recently inherited 20TB of data after a company takeover. The files are currently stored on an Amazon S3 account which is due to close.
What would be the most cost effective method of ...
0
votes
1
answer
61
views
Azure VM backup
I am wondering how Administrators are handling Azure retention of decommissioned servers.
We use our Azure infrastructure for development. Once we are finished with a server, I want to download the VM ...
1
vote
1
answer
97
views
Sudden Disk Issues During Database Restore
Environment:
Azure Windows 2016 VM with SQL Server 2016 Standard installed
Machine Size: DS12_v2 (previously DS3_v2, which is the same except for less RAM)
4-cores
28 GB RAM
14 GB RAM for SqlServer
...
0
votes
2
answers
80
views
azure backup- error during enabling
I can't enable Azure backup on some my VMs in Azure. I have already virtual machines migrated from classic to ARM, but disks for a few one are still stored in Classic storage. If I try to enable ...
0
votes
1
answer
161
views
Does advice on aligning SSD block sizes apply to "cloud persistent disks?"
I recently read that differences between disk page size in the partition vs flash storage can hurt write performance.
So, I checked the partition sizes on some database disks with parted and got
...
1
vote
1
answer
2k
views
What is the difference between the cloud disks supported by Alibaba Cloud?
When creating an ECS instance on Alibaba Cloud, I often get an option to choose a cloud disk e.g. from Ultra Cloud disk and SSD cloud disk.
What is the difference between these cloud disks and what ...
0
votes
1
answer
781
views
Amazon S3 to Amazon Glacier custom vault
So I was researching about Amazon Cloud services and how to backup all my personal infrastructure to the cloud -btw it's really amazing what Amazon has achieved on this field-.
I started looking ...
4
votes
1
answer
379
views
Azure - Setting up storage spaces direct S2D
I need to setup a windows cluster in Azure that uses shred storage, I have been told that I can use storage spaces direct, i have attempted to enable it but it complains that there are no suitable ...
2
votes
0
answers
11k
views
Unzipping a zip file directly in Google Cloud Bucket (GCS)
I am using the Google Cloud and in one of the bucket (GCS)I have a folder which has sub folders and each sub folder has zip files of approximate 600MB to 1.5GB each.
If i have to give the count of the ...
-2
votes
1
answer
57
views
Unexpectedly able to delete storage container having running VHDs [closed]
Today I deleted an Azure storage container that contained some .vhds page blobs.
Some of the blobs were the source for some VM disks that were attached to running VM's.
I was surprised that the ...
2
votes
1
answer
505
views
S3 to Swift middleware proxy
We have an application which is ready for AWS S3 Storage. Recently we had an requirement to write also on a Swift Object Storage. I know that Swift stack has an option to enable S3 compatibility but ...
0
votes
2
answers
201
views
Why are there multiple .vhd files in my Azure blob storage
I have some virtual machines in the Azure cloud, and I've just found that there are several .vhd files (all 127GB) on one of my premium storage accounts. I don't ever recall creating these by snap-...
0
votes
1
answer
592
views
Mount cloud storage as network drive for iis site virtual directory
I have a rackspace hosted server that I'd like to "add" more storage to. Rather then pay for an additional drive to be physically added to my server I'd like to consider leveraging cheaper cloud ...
2
votes
1
answer
6k
views
What are storage consistency groups?
Can anyone explain to me what 'consistency groups' are in the context of storage solutions? How can I use them in the real world?
It seems every vendor has its own proprietary terminology for storage ...
4
votes
1
answer
271
views
How can I run unattended backups on b2 if the application key needs renewal every day?
Backblaze b2 gives me an application key that expires every 24 hours and can only be renewed on the web page. How can I set up unattended backups if that's the case?
1
vote
1
answer
1k
views
Google Cloud auth access key secret key?
Apologies for probably a basic question. Getting started with Google Cloud and require the access key and secret key to test online backups to Google Storage using Backup Exec 2015, however I can't ...
0
votes
1
answer
51
views
Appengine Backup data form submit error
Whenever i try deleting an backup, or performing one using the datastore admin, i get an "The token used to submit this form has expired.", after pressing the import button. Does anyone have any ...
1
vote
1
answer
2k
views
Azure blob storage custom domain verification - Azure telling me to create CNAME for non-existent address
I want to assign a custom domain name to my Azure blob storage account. In the custom domain setup page it says:
You can map a custom subdomain name to your Blob service endpoint. Windows Azure ...
0
votes
1
answer
3k
views
Server Manager\File and Storage Services\Volumes\Disks doesnt show up in Windows Server 2012 r2
I booted up an Azure VM with Windows Server 2012 r2 and attached 5 additional Virtual hard disks to form a storage pool or a larger volume, but none of the disk/volumes are showing up in the Server ...
2
votes
2
answers
7k
views
Azure CDN returning 404 not found for Storage Container Blob endpoints
My Azure CDN does not appear to be correctly mapped to my Storage Container Blob data.
Storage
I've created a Storage, which is online:
Inside is a Storage Container:
http://jasonsturges.blob....
2
votes
3
answers
2k
views
~50tb of storage in Azure presented as a single Windows File Share
I have googled, the closest thing I have found so far is another SF question here: Azure Storage limitations
The Goal:
Move approx 50TB of storage to the cloud, present that storage as a standard ...
1
vote
1
answer
896
views
Strange Disk Benchmarking results for our storage, how to explain? [closed]
I recently tested the storage we got from our hosting provider. I don't know what raid config or how many disks the storage contains of.
I used Atto Disk Benchmark which sends smaller and bigger ...
1
vote
1
answer
182
views
Easy way to share a drive with password protected directories?
We have 50 computers that students share. Is there an easy way to have student folders on a single drive on the network where each student has a password? Students need to be able to go to any ...
2
votes
2
answers
17k
views
Linux -Can I rsync to dropbox or another free cloud storage service? [duplicate]
We host a small community, not for profit site and mailing list, is it possible to rsync to dropbox or a similar (free) service to maintain backup?
Edit: For context, we host on a shared VM and don't ...
1
vote
1
answer
729
views
Change Azure VM Temporary Storage size
Is there any way in which we could increase the storage of an azure's virtual machine by decreasing the temporary storage? We currently have 126GB of disk storage and 312 GB of temporary storage.
2
votes
0
answers
194
views
"Nosy Neighbor" and the CFQ scheduler
I'm trying to understand how does using CFQ affects the "Nosy Neighbor" problem.
I'll ask it a bit naively, can a "Nosy Neighbor" even exist when using CFQ? Isn't that CFQ should make sure all ...
10
votes
2
answers
33k
views
How do I access a google cloud storage bucket using a service account from the command line?
I thought it would be pretty straight forward to do this, but I can't get it to work:
I'm trying to push files from a server (GCE) to a google cloud storage bucket. To avoid granting the gsutil ...
0
votes
1
answer
2k
views
Simple instructions for setting up Seafile in Windows 2008 R2 on AWS?
I need to setup a corporate alternative to DropBox. After a bit of research, Seafile looks like a good bet.
Also, I will need to host my file server in the cloud. Eventually I will want to by a low-...
1
vote
0
answers
641
views
Most efficient way to setup massive high-availability storage in Azure to work with multiple VMs?
I'm looking into various options for setting up massive high-availability storage in Windows Azure, to use together with my Azure VMs. The VMs need to be able to work with the storage as if were a ...
1
vote
4
answers
115
views
Need to make a storage that keeps growing in size [closed]
First, due to security reasons and others I wont be able to make use of S3, or other similar solution.
I have a a storage server in which I have a 1TB had disk. I have a Mysql server running in it. ...
0
votes
1
answer
637
views
Is there a way to synchronize my distributed storage infrastructure with file changes possible on each location? [closed]
I need a storage device in 3 different location. Each device will have 4TB of storage. At least 2TB should be a 'shared folder' working like Dropbox: when a user change a file in one location, the ...
-1
votes
2
answers
106
views
Difference between image and snaphot?
Can any one explain what are the differences between image and snapshot in terms of storage.
1
vote
1
answer
446
views
What is the best private cloud storage setup
I need to create a private cloud and I'm searching for the best setup.
These are my 2 most important requirements
1. Disk and system redundant
2. Price / GB as low as possible
The system is going to ...
-1
votes
1
answer
192
views
Storing mail server data on multiple storage servers [closed]
I'm trying to provide an email service for my clients
And i like to know is it possible to store mail-server data on different servers
Something like cloud services
I'm a beginner , And i have ...
1
vote
1
answer
6k
views
Fastest reliable way to transfer 100GB files globally? [duplicate]
Our latest project at work involves sending 100GB+ files from our office in Dallas to our client in Australia. I've been asked to put together the fastest, most reliable way of transferring these ...
-2
votes
1
answer
425
views
cloud file storage (SSHFS usable?)
I am using Linode and plan on having multiple VPS behind a Load Balancer to run my application.
The problem i have is with storage, in the next year i see at least 2TB of storage required.
I have ...
1
vote
2
answers
244
views
Windows Azure Blob Storage Data Migration
I would like to back up the files I currently have in Azure Blob Storage and move them elsewhere. The problem is that pulling them one by one would take me several weeks, even within the same ...
4
votes
1
answer
19k
views
Ec2 instance down with error: cannot create temp file for here-document
Iam running my website built on ruby on rails in development mode on ec2 instance, when i ssh to that instance it says..
Welcome to Ubuntu 12.10 (GNU/Linux 3.5.0-17-generic x86_64)
* ...
0
votes
1
answer
990
views
What are the options for expanding the available storage on a VPS?
I have several virtual servers hosted at Linode, and I'm looking for a way to expand the available storage capacity. On some of those servers I'd need to have between 0.5 and 2 TB of space.
...
1
vote
1
answer
1k
views
Can Onedrive be linked to a server based home directory?
At the school I work at we currently give every user a mapped drive to their home folder on the file server, all controlled through Active Directory.
We also have a heap of users using iPads, which ...
0
votes
1
answer
1k
views
Suggest CDN with Byte-Range requests support for streaming [closed]
I'm trying to find high load solution for streaming server.
The idea came to me this morning.
What about CDN or cloud storage with byte-range support. Basically flash player require only partial ...
1
vote
1
answer
415
views
Incremental backups from Rackspace Cloud Files to Amazon Glacier [closed]
Is there a software product/module (open-source or commercial) that can provide incremental backups from Rackspace Cloud Files to Amazon Glacier?
We are looking for something that will provide the ...