Organized data encoded in a pre-defined format and stored on a filesystem.

learn more… | top users | synonyms

0
votes
1answer
479 views

IIS Web Server file change monitoring tools? [closed]

We are looking for a tool to run in the background of out Server 2008 R2 IIS web-server. We want a tool that can tell us when new files re created, or changes are made to existing file to watch for ...
3
votes
2answers
449 views

File System with Real-Time Data Deduplication

Is there a file system that stores files under a hash so there are no duplicates? It can be under any operating system. I know Git does that, but I'm looking for something that can run in real-time.
4
votes
1answer
871 views

how to delete a insane number of files from an unix system?

On a system with linux there are 2 folders with aprox 12gb used(out of 500gb) and all inodes are used by some s
5
votes
3answers
9k views

Moving a Logical Volume directly from one server to another over the network?

I have a KVM host machine with several VMs on it. Each VM uses a Logical Volume on the host. I need to copy the LVs to another host machine. Normally, I would use something like: dd ...
2
votes
2answers
988 views

How to hide shadow-copies in NFS shares?

I have a Ubuntu server with both samba and nfs-server. The server does snapshotting for the exported directory and the samba server uses the snapshots to emulate shadow copies. ( vfs objects = ...
0
votes
1answer
36 views

How to access and store data on multi-server setup

My application uses a RESTful api to receive requests from users and generate files on demand. When the file has been made, it responds back with a dl link to said file. When this was on a single ...
6
votes
5answers
9k views

Get total files size from a file containing a file list

I have a file containing a list of files that I would like to know the total files size. Is there a command to do so? My OS is a very basic linux (Qnap TS-410). EDIT: A few lines from the file: ...
10
votes
1answer
7k views

Is it possible to configure the location of “Temporary ASP.NET Files” folder in IIS?

Under IIS7.5 after switching pool identity to domain user I got this error: "The current identity (domain\username) does not have write access to ...
22
votes
4answers
19k views

How to move files between two S3 buckets with minimum cost?

I have millions of files in a Amazon S3 bucket and I'd like to move these files to other buckets and folders with minimum cost or no cost if possible. All buckets are in the same zone. How could I ...
1
vote
2answers
21k views

Script to delete temp files for all users in XP, Vista, and 7

Basically, we have numerous customers running XP and 7 with a few Vista machines. I've found this batch script, but it is limited to the current user (uses the %userprofile% environment variable). ...
1
vote
1answer
64 views

Bash: checking uniqueness of filenames, and renaming or removing files

I'm working in CentOS with bash and I have files in a directory as follows: 16948.png 16948_thumb.png 16948-1_thumb.png 16949.png 16948_thumb.png 16949-1_thumb.png 16950-1.png ...
1
vote
2answers
444 views

Scientific data storage: many small files, one volume or several?

I have about 8 TB worth of 'sample' data with the following characteristics: each sample: 5-15 GB in one folder containing ~20k files and ~10k subfolders (2000 top-level, 5 sub-level containing a ...
0
votes
5answers
857 views

Looking for suitable backup solution Mac OS X to offsite Centos 6 server 1TB of working data

I'll start by saying what we have in place currently: On site file server (Mac OS X Server) that is used by GFX designers and they have a working 1TB of data. Offsite server with 2TB available ...
4
votes
3answers
1k views

Is it possible to GET or PUT two specific files at a time using SFTP without wildcard?

From a directory of dozens of files, is it possible to GET or PUT two files at once using SFTP? I do not want to use a wildcard because I don't necessarily know the names of all the files and don't ...
1
vote
1answer
69 views

What are the ramifications of UNIX files and directories where owner doesn't have group rights to the file?

I've a group of users, all of which are in a single group. Then I have a Java daemon that is a member of a seperate group. I want both the users and the daemon to have access to the same set of ...
2
votes
5answers
1k views

Safe way to determine size of a file using unix tools?

I wonder, what's the best way to determine the size of a file using common unix tools. I need to determine the size of a file in bytes in a shell script. The problem is, that the shell script needs to ...
0
votes
2answers
474 views

How to copy files to destination system through a specific LAN card?

I want to copy database backup from my running DB Server to Backup server. The source server has two LAN cards connected through their own IP address. One LAN card is used to connect to the ...
0
votes
3answers
542 views

why do files need to be world readable for Apache to server them.

why do files need to be world readable for Apache to server them? I would think that if they are owned buy the Apache user or group. And the files are readable and executable that would allow Apache ...
0
votes
1answer
183 views

rsync file list over ssh generated by remote script

for f in `ssh $SSHCRED "~/file-list.sh"` do rsync --progress --times --partial --append --rsh=ssh -r -h --remove-sent-files $SSHCRED:$f $OUTDIR done This is what I do today. I'd like to instead ...
0
votes
2answers
68 views

File management issues in Windows 7 and IIS

We have a web site that used to run on a Windows 2003 server with whatever version of IIS that had; I think IIS6. That site has been moved to a new server that's a Windows 7 server with IIS7. Since ...
0
votes
1answer
164 views

Why is my access.log file not accessible?

I have an apache installation on my dev machine. The httpd.conf is all set up right. By the config file I should be getting an access.log file in my logs directory, but it doesn't seem to exist in ...
2
votes
1answer
81 views

getting a list of files from secure server

i am trying to get a list of files from secure server to compare them (using diff) to the ones i modified on local version (unfortunately the company i work in is not using subversion nor git yet) i ...
-3
votes
2answers
292 views

How to sync windows server folders with a AIX server using script?

Everyday I would like to sync the files and folders in the windows server with AIX server and vice versa. Does anyone suggest me, How I can write a shell or bat script to achieve this?
0
votes
1answer
242 views

SSH/SCP filebrowser supporting server hopping

To access our file server here, I need to connect first to a server which is public available and then open a second ssh connection to that server. If I need to copy files, I first need to copy them ...
2
votes
1answer
106 views

File storage for replicated front-end web servers?

We are a company running a website with ~800k unique visitors each month with a constant growth rate of 35-40%. We have just gone from having one server to a dedicated mysql database and an ...
0
votes
1answer
511 views

Bulk file copy while limiting disk utilization?

I saw that Robocopy can limit network bandwidth in this answer How do you limit the bandwidth for a file copy? I have plenty of bandwidth on the LAN, but I don't want to saturate the disk on the ...
13
votes
3answers
4k views

Building a 1,000M row MySQL table

This question is reposted from Stack Overflow based on a suggestion in the comments, apologies for the duplication. Questions Question 1: as the size of the database table gets larger how can I tune ...
3
votes
3answers
695 views

Ramifications of rebooting a file server when files are open

This may prove to be a stupid question, but I've scoured in internet and found nothing to that gives me a concrete answer. I'm curious as to potential consequences of a file server being rebooted or ...
2
votes
1answer
4k views

Windows Server 2008 + IIS7: .ogg files can not be played

I have the strange trouble. There are .mp3 and .ogg files in the folder of web application in my server (IIS7.5, Windows Server 2008 R2). Web application has flash player. It can play .mp3 only, but ...
5
votes
1answer
286 views

How to distribute files and folders to handle large number of files

I want to manage a huge number of files on my server (say millions). It is needed to save files in two or three levels of folders to keep the number of files in each folder low. On the other hand, it ...
1
vote
1answer
342 views

script (search & delete temp files/folder) has got a failure

I use this script to clean history, cookies and cache(Temporary Internet Files) for all users AND it should also clean the temp dir BUT there seems to be something wrong. 2 things get mixed up I ...
0
votes
2answers
279 views

How to write robust automation scripts for large scale data management?

I have been needing to automate the moving of quite large amounts of data (possibly around 1TB/day+ in average. 60TB so far, and counting) to a separate, remote storage system. I have so far been ...
2
votes
1answer
320 views

NTFS network file copy hangs on +R attrib files / Server 2008 R2

I have encountered at least two server 2008 R2 machines that were recently built that exhibit identical behavior. When using explorer to copy a folder of files from or to the affected host, any file ...
1
vote
0answers
321 views

nginx upload module + rails + pupload (jquery multiple upload plugin) multiple uplosding hangs in between

I have configured nginx with nginx upload module + passenger for rails 2.3.5 on Ubuntu OS. I am using pulpload (jquery multiple upload plugin) but it hangs after 2 or 3 files get uploaded, But when i ...
9
votes
6answers
2k views

Files disappearing on linux server

I've got 4 specific files that seem to keep disappearing from a user's home directory. As far as we know, there are no cronjobs or other automated tasks that would be removing them. I've setup auditd ...
1
vote
1answer
348 views

ASP.NET, reaching the limits of DFSR, and file storage sharding

We run a popular web app, and our backend file storage exists on a file server, replicated to another file server for failover with DFSR. We are reaching the theoretical limits of DFSR, and therefore ...
2
votes
2answers
1k views

Copy command in Ubuntu without replacing existing content?

Hi how do I copy a folder from source to destination in Ubuntu without replacing the existing contents in the destination folder? I tried cp -r -u and cp -r -n, and neither one worked.
0
votes
1answer
2k views

PHP Session File Stored in Temp Directory - Apache

I am having a slight problem...I have a server that I set up using AppServ 2.5.10, running Apache 2.2.8 and PHP 5.2.6. This is running on Windows Server 2008R2. The problem is in order for the ...
1
vote
3answers
842 views

Simple easy to use CLI file index search on unix?

I need a simple unix utility that would allow me to search within files quickly and with basic parameters (this folder, not this kind of files...). Currently I use a hand crafted find function with ...
0
votes
2answers
404 views

synchronize files between remote sftp location and local

I am facing a quite familiar problem but have no clear idea on how to handle it. I'm a backend developer and i write my applications using Zend Studio. My employer requires me to work on a remote ...
5
votes
2answers
200 views

Deny all files in a certain directory using <files>

Im attempting to secure the mod_userdir module in apache.. Currently the directory structure for my users sites is /home/{user}/domains/{domain}/public_html/site The issue is, a number of my users ...
3
votes
2answers
191 views

Determine which files a process opened (Linux)

I am trying to determine which files a process creates when it runs. I know that I can list the file handles of a currently running process by looking in /proc or using lsof. However, the problem is ...
1
vote
3answers
319 views

How safe are file unlocking programs?

Recently a number of users on a win2003 server are being told that files are locked for editing when they try to open them. Usually they are told they have it open. Usually there is no evidence of ...
0
votes
1answer
538 views

OpenOffice Headless Mode - Temp Directory?

We're running OpenOffice 3.2 in headless mode. It writes all of it's temporary files to /tmp and we're running out of disk space, so I'd like to change the temp directory for it. Sadly, I can't seem ...
2
votes
2answers
370 views

Best way to sync files?

What is the fastest, most secure way to sync files between remote networks? My goal is to replace the local "My Documents" folder on our users' laptops with a synchronized "My Documents" folder that ...
2
votes
1answer
112 views

Move all files to their own folder

Is there any way on a linux box to move every file in a directory into their own sub directory (i.e. make a directory named after it and move it in)?
1
vote
1answer
329 views

Odd / strange directory 6ad59dd7287df814106109 on my Win 7 / Data drive

On my Win 7 data drive I find a directory which does not mean anything to me: 6ad59dd7287df814106109, which contains subfolders such as 1024, 1025, 1026 ... I need administrative rights to get into ...
0
votes
3answers
45 views

Server High Logical Volume

I have just been looking at the sizes of various partitions in my server and I see that it states; /dev/xvda1 3.7G 2.9G 792M 79% / /dev/mapper/vg00-usr 26G 3.7G 23G 14% /usr ...
2
votes
1answer
51 views

Serve files only if their extension is specified in Apache

I'm running Apache on Ubuntu Server. mysite.com/file.php, for example, is accessible also from mysite.com/file and the same is for images, html pages and everything else. How can I force Apache to ...