Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

I've just finished up a script I've written for my website. The VPS is purchased, now I don't know what the effective method to be able to move 15,000+ images I have on my shared host to a new VPS (separate reseller hosts).

I only thought of one, download all of the images to my hard drive and then upload to the VPS via FTP, however I do not have decent speeds ~160kb/s and upload speed is roughly ~60/70kb/s.

What would be the most effective method to transfer 15,000+ images from a shared host to a brand new VPS?

share|improve this question
4  
Do you hae shell access to your shared host, and what OS is your VPS? –  squillman Mar 30 '11 at 15:49
    
tar/zip/rar/whatever 'em up and upload that bundle. Un tar/zip/rar on the other end. –  jscott Mar 30 '11 at 15:50
    
I do not have shell access on my shared host. Both are Linux. –  Burning the Codeigniter Mar 30 '11 at 15:53
    
But you do have shell access on your VPS, right? –  MadHatter Mar 30 '11 at 18:06
add comment

5 Answers

up vote 6 down vote accepted

you could do an ftp from your shared host direct to your vps

otherwise you could also do a recursive wget to download via http direct to your vps, for more info take a look here: http://linuxreviews.org/quicktips/wget/

share|improve this answer
add comment

I'd strongly suggest you don't introduce a 3rd party (your computer) as it will most likely drastically increase the time taken. The shared host and VPS will have much faster transfer speeds between each other.

Why can't you simply access the shared hosting from your VPS?

Just use the same method - ftp/scp/sftp/http/whatever from your vps.

If you give a little more detail on what you mean by "download all of the images [from my shared host] to my hard drive" or who your shared host is then we can probably give a better answer.

share|improve this answer
    
Sorry. When I said hard drive, I meant my computer. –  Burning the Codeigniter Mar 30 '11 at 15:54
    
"my computer" and "my harddrive" are pretty much interchangeable in the context. My advice remains the same :-) –  PriceChild Mar 30 '11 at 16:00
    
Ok my computer means my MacBook. Does that help? :-) –  Burning the Codeigniter Mar 30 '11 at 16:07
    
No sorry. What I'm suggesting in my current answer is that you "download" from your vps. I don't know how you would "download" from your macbook, but you seem to have an idea already. There's no reason why you can't do that from your vps so pretend your vps is your laptop. If you update your question with how you normally access the "shared host" e.g. "ftp" or "a webui by my provider" (not credentials) then we can clarify a better answer. –  PriceChild Mar 30 '11 at 16:11
    
I was saying if I download the images from a FTP client to my MacBook. –  Burning the Codeigniter Mar 30 '11 at 16:16
show 1 more comment

Most effective method would probably be to either upload them in batches (compress them into usable chunks and upload a bit at a time) or take your collection to another location and use their connection; a business friend with high speed, maybe a local B&N/Starbucks/Panera if you're in the States, etc. and upload over a nice book or drink. Something like that...that's what I'd first suggest.

share|improve this answer
add comment

Id ask for a shell account from each provider explaining you need to copy files from one server to another.

You can then use rsync with -av --stats --progress -e ssh folder_to_copy user@remotehost:.

This will let you copy the files in the most efficient manner and allow for you to resume if it failed for whatever reason.

share|improve this answer
    
I agree with you, rsync through ssh is the best way to securely transfer those files. –  Shadok Mar 31 '11 at 8:35
add comment

If both of your shared server and VPS support FXP, you can connect those two servers using ftp client and transfer the data between them(no need through your computer).

http://en.wikipedia.org/wiki/File_eXchange_Protocol

File eXchange Protocol (FXP) and (FXSP) is a method of data transfer which uses FTP to transfer data from one remote server to another (inter-server) without routing this data through the client's connection. Blockquote

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.