Questions tagged [tar]

GNU tar creates and manipulates archives which are actually collections of many other files; the program provides users with an organized and systematic method for controlling a large amount of data.

Filter by
Sorted by
Tagged with
0
votes
0answers
26 views

what is '-' in man throttle command example [migrated]

Excuse me if this sounds pretty noobie. I was just checking the man page for throttle about how does the pipeline work hand in hand for throttle. So while checking the manual page example, I stuck ...
1
vote
1answer
22 views

Validate tar extraction

I have a script that processes large tar.bz2 and tar.gz files. So the user doesn't think it has locked up they are piped in from pv: pv redacted.tar.bz2 | tar -xj pv redacted2.tar.gz | tar -xz ...
6
votes
1answer
139 views

Unable to compress 18GB file on Ubuntu Linux 18.04

It never happened to me before, but I'm unable to do a simple task such as compressing a 18.5 GB file on Ubuntu Linux 18.04 with any of the popular compressing tools such as gzip, bzip2 and 7z. All of ...
0
votes
1answer
50 views

Renaming a tar file in unix script

cd /var/opt/sw/e4/data/dev/e4_dev/DEVL3/EW/EWD1/DATA/AED/INPUT for file in *;do tar -czf ../OUTPUT/"${file}".tar; done According to the above code the files in input path eg. aedlog, aaalog....
0
votes
2answers
107 views

Creating backups with tar.gz and rsync

I'm trying to use this bash script to create and send the tar.gz file to my backup server, some reason it doesn't seem to copy it, is there a better solution to what I'm trying to do? I'd rather have ...
0
votes
0answers
41 views

Dereferencing symlinks within a tar file on extract

Can one extract the target of a symlink from within a tar file if one only knows the symlink? Kind of like cp -L, I'd like the result to be the target, even though I am requesting it by symbolic link ...
0
votes
1answer
151 views

How do untar as the current user by default?

I have a batch of CentOS EC2 instances, which have an additional user added to them via ansible. Normally when unpacking a tarball, the owner is centos.centos (default login for EC2 Centos). When an ...
1
vote
2answers
77 views

How can I transfer a dedicated bare metal server into a VM?

I have the following problem: We have a dedicated (bare metal) hardware server (Debian 10) on which we have no direct physical access. Now I want to transfer all data and applications that are on this ...
0
votes
0answers
34 views

Diff a tarball on stdin against a directory hierarchy?

I have a multi-terabyte filesystem I want to diff against a multi-terabyte tar file. The tar file is only available from stdin - no seeking allowed. I do not have the disk space to write the tar on ...
0
votes
1answer
148 views

How to owerwrite directory with tar?

I want to extract files with tar so that the whole directory will be owerwritten. I added --overwrite-dir but still old files in test dir remains. For the test, I have /home/ubuntu/f1/test/first.log ...
2
votes
1answer
81 views

Fastest way to tranfer data over the network between two servers

I have two storage servers at home - one is my workstation, which has a pair of 3TB disks in RAID1. At first, I stored all of my data there. Recently, I received a small SBC with four 1TB disks. I set ...
0
votes
2answers
81 views

RHEL 7 security patch installation from tar

Novice Linux guy here I have a huge (5G) linux-security-patches tar. Upon extracting, I see its got loads of rpms. What is the most efficient way to install them all ? Also, is it same as installing ...
1
vote
1answer
74 views

How to take backups resilient to data corruption , fast and reliable on Linux? [closed]

I need a resilient backup solution. I was using tar with pigz, however I am afraid of tar.gz corruption and losing data. Projects are between 4TB - 25TB of data for each project folder. We are talking ...
0
votes
0answers
98 views

Excluding files in bsdtar (OSX) vs. gnu-tar (Linux)

I am using the following tar command to create an archive in Linux (GNU Tar) excluding all hidden files (.*) recursively: tar -czvf /tmp/archive.tar.gz -C /an/absolute/path/ --exclude='.[^/]*' . ...
0
votes
1answer
64 views

Tar directory is new error

I am trying to make a backup of two directories, /etc/httpd and /etc/letsencrypt I am using the command tar Pcfvg httpd_backup.tar /etc/httpd/ /etc/letsencrypt/ >/dev/null The redirect to /dev/...
0
votes
1answer
25 views

Does tar create point-in-time snapshots?

I know that tar can be used to create a backup. However I wonder if the operation creates point-in-time backups or not. Basically I wonder if it grants consistency if the directory and files are ...
0
votes
0answers
17 views

Error while trying to backup site files

# tar -czf /backup/backup.tar.gz /var/www/html tar: Removing leading `/' from member names tar: /var/www/html/wp-content/uploads/2020/02: file changed as we read it # ls -la total 17160456 drwxr-xr-x ...
3
votes
2answers
413 views

Hash files in tar file

I have two *.tar files with similar contents. I want to verify which files are the same. A lot of the files are big so I comparing hashes would require extracting every file from each tar and ...
0
votes
0answers
74 views

tar | pigz dies if run under cron

I run a kind of backup script using tar joint with pigz for compression. The problem is that tar -zcf /file.tar.gz /folder runs under cron. While tar -I pigz -cvf /file.tar.gz /folder nor tar ...
2
votes
1answer
67 views

Best strategy for daily back up of terabytes of data with millions of files

Currently I create an NFS and mount it on a special server that does the actual backups and uploads it to s3. My main concern is I feel like overcomplicated this simple task. I schedule cron job to ...
0
votes
1answer
571 views

Why tar flag --strip-components ignored sometimes?

I have an automated docker images build where I download elasticsearch archive and extract it via: tar zxf archive.tar.gz --strip-components=1 -C /path/to/dir And it always worked until the latest ...
0
votes
1answer
524 views

How to exclude a folder by name recursively when making a tar archive?

I know it is possible to exclude a particular folder by a command like this: tar --exclude='/srv/www/project/node_modules' -zcvf /backup/project.tgz . My question how to exclude all folders named ...
1
vote
1answer
951 views

Backup to remote server and create tar on the fly

I would like to backup a directory from my production server to a backup server using rsync. My current solution: tar directory on production server send to remote server via rsync My Problem with ...
2
votes
2answers
317 views

Extracting single file from large tar.gz file

I have an incredibly large tarball. I'd extract several files out of many thousands within the archive. I'm on CentOS 6.10 running GPFS 4.2.3. I've seen from this answer that pigz is useful in ...
0
votes
1answer
27 views

Command/script to extract “sub-tarball” from tarball

I am aware of that I can extract single/multiple files from a tar archive, but is there a command that I can easily pass to immediately create a "sub-tarball" from an existing tar archive? This is ...
0
votes
2answers
227 views

How to untar a very large file with missing space

I have reinstalled my server and before that i did a backed up. My backup is a tar file without special compress option (meaning that the size of the tar file is approximately the same than the size ...
0
votes
1answer
202 views

abnormal very high CPU during lengthy write operations

I have a set of large files which I sometimes copy back and forth between a Linux box and a Windows box. The files are each about 2 GB, and there tend to be 10 or so of them (they're a VM image). ...
0
votes
1answer
34 views

Uploading files using tar

Can you help me? I have this piece of code that I'm using on my Ubuntu 16.04 server tar -c /var/www/dxa/backup.zip | ssh <my-server-ip> -p 8000 'tar -xvf - -C /' But everytime I run this ...
0
votes
1answer
763 views

ubuntu server tar -xvf failed for solr.tar.gz

I am trying to extract solr server downloaded from https://www.apache.org/dyn/closer.lua/lucene/solr/7.7.2/solr-7.7.2.tgz But am getting an error on ubuntu server. gzip: stdin: not in gzip format I ...
1
vote
1answer
359 views

Backup a whole server over the network using tar

I have a server that is 80G total size and has no more space so i cannot backup on the server. I found this command ssh server2 "tar -zc -C /srcdir ./path" | tar -zx -C /destination but it is not ...
0
votes
0answers
15 views

Tar is not Finishing When Running as Cronjob [duplicate]

My goal is to regularly pack the most important files on a server into a tar.gz file. In order to automate this I am using a cronjob to execute a script: $ crontab -l # blablabla * * * * * /home/...
0
votes
0answers
50 views

resume tar command when nohup/screen is not possible

I have a dataset which is quite big - a few petabytes. Untarring it into a new filesystem takes a couple days. The problem is that the server does not allow me to have a process running over 24h - it ...
3
votes
1answer
2k views

NFS - Very slow performance with small files (Also with CIFS)

I am having very bad performance with NFS between two debian stretch machines, and I can't find a solution. I am using rsync at the server side in the exports file and tcp,hard,intr,rsize=32768,wsize=...
1
vote
1answer
242 views

Tar archive error message

I am getting following error while archiving the user's homedirectory. (trying to migrate a user from one macbook to other since the user's keys are associated with AWS and other tools) tar cfv ...
0
votes
1answer
507 views

how to create a tar file with checksums, but without compression

(note, this is not a duplicate of Creating a tar file with checksums included) I'm familiar with using tar + gzip to create a compressed tar file (tar cf - files | gzip > something.tar.gz), and ...
2
votes
1answer
2k views

This does not look like a tar archive

I'm trying to fast copy some big directories from my remote Debian 9 server to my local Debian 9 on WSL (Windows Subsystem for linux; Windows 10 Pro) with ssh "tar" | tar pipe. ssh user@example.com "...
0
votes
1answer
30 views

The write permission of files disappear after the files are copied between 2 remote system using FTP

I have setup FTP between 2 remote systems and scripts are set up on both the system to Archive and Extract the file. So the script in the source Archives(tar) file and the script on the destination (...
-1
votes
1answer
294 views

How to recover a TAR file from a partially overwritten XFS disk?

This is the scenario. The environment is Linux (Arch Linux actually). An uncompressed 1,3TB tar file has been written on a freshely XFS-formatted 2TB disk as a backup. Later on, a 586MB UEFI boot ...
1
vote
4answers
1k views

How do i remove the path names from the files i have archived.. UBUNTU

I've been tasked to archive certain files into a new directory at /home/archive/. I used this command: mkdir /home/archive cd /home/archive tar -cvf log.tar \ /var/log/auth.log /var/log/...
0
votes
2answers
909 views

Apache server causes tar.gz files to download as uncompressed tarballs still named .gz

We are hosting a number of .tar.gz files on our Apache server. When we download these files, the filename of the downloaded file is the same as on the server... something.tar.gz... but the file is ...
1
vote
1answer
125 views

Is GNU tar incremental backup reliable if ext4 is mounted with noatime?

My system is running on SSD on top of LVM logical volume, formatted to ext4. I'm using noatime option at my fstab for this partition. I'm going to do incremental backups of system partition using LVM ...
-2
votes
1answer
999 views

tar -z is very slow [closed]

I know this question has been asked before and I saw the recommendations on using pigz. Good recommendations, but I wanted to see if I really have a "problem". I have an esxi host. It's the free ...
0
votes
1answer
74 views

Why tar is incapable of changing current directory?

The following command: tar -C "${HOME}/temp" -zcvf uber-bundle.tgz temp fail with the following error: tar: temp: Cannot stat: No such file or directory tar: Exiting with failure status due to ...
1
vote
1answer
236 views

Create a zipped tar archive of a full centos filesystem, and open in Windows

I'm trying to create a zipped tar archive of all files on a centos 7 machine. I'm using this command: sudo tar -cvzp --exclude=backup --exclude=swapfile -f /backup/archive/full-backup-$today.tar.gz -...
-3
votes
3answers
183 views

How to tar 30 Gigas of data on a 50 Giga server?

I need to send the content of a folder (full of JPEG pics) to a client. My server has 50 gigas and folder has 30 gigas. (Zipping JPEG is useless since JPEG is already compressed) Any idea/strategy ...
2
votes
1answer
527 views

how do I extract a tar archive with larger block size?

I have a tar ball that has a huge number of very large files. The blocking factor is 10k. This is taking too long to extract because it does a lot of 10k writes. The filesystem will perform better if ...
0
votes
2answers
537 views

shasum of tar file different on os x / ubuntu although files are identical

I have a problem that brings me to despair and is plaguing me for the last days and I hope somebody can give me a hint what I have overlooked, since bash/sh is not a field I work in everyday: ...
2
votes
0answers
719 views

TAR command exit status non 0, with the option ignore command error

I'm trying to make a tar of a logs directory, the applications are running so the logs keep changing, clearly when i run the tar command it give me the warning: "file changed as we read it", and give ...
4
votes
3answers
2k views

Compression on tape set..but at 2.27TB..end of space

I have a LTO6 tape inserted tapeinfo -f /dev/st0 Product Type: Tape Drive Vendor ID: 'QUANTUM ' Product ID: 'ULTRIUM 6 ' Revision: '4142' Attached Changer API: No SerialNumber: 'HU1322VW9U' ...
2
votes
2answers
2k views

Tar does not retain directory permissions

I am copying a directory structure of hundreds of millions of small images between two servers. The file structure, ownership and permissions needs to be retained during the copy. Our testing has ...

1
2 3 4 5
7