Questions tagged [compression]

Decrease the size of data, typically to preserve space or reduce network bandwidth required while transmitting files. It can be applied to files, folders, disks, etc.

Filter by
Sorted by
Tagged with
84 votes
2 answers
108k views

How can I zip/compress a symlink?

Is it possible and how can I zip a symlink from a linux shell?
1 vote
1 answer
4k views

HTTP compression in Apache reverse proxy?

I have an App server where Apache httpd is installed which serves the requests. We have another Proxy machine which redirects the requests to this App Server httpd using proxy pass. When I apply gzip ...
20 votes
4 answers
24k views

rsync --compress-level: which compression levels can be used?

Rsync has command line arguments for compression: -z, --compress compress file data during the transfer --compress-level=NUM explicitly set compression level What does --compress-...
1 vote
1 answer
245 views

Does "btrfs filesystem defrag -c" (compress option) force compression?

BTRFS with compression enabled uses a heuristic not to compress files that are not well compressible. Does compressing existing files with "btrfs filesystem defrag -c" also use the heuristic,...
0 votes
0 answers
281 views

Re-compressing XZ kernel module?

I have a kernel module produced by kernel option CONFIG_MODULE_COMPRESS_XZ. When I manually decompress the file with unxz and re-compress with xz, the new .ko.xz file differs from the original .ko.xz ...
4 votes
1 answer
3k views

Compress old emails with dovecot

How can I configure dovecot to compress/archive old emails (say 6 months old) with the users still being able to read them, to save some precious space on the server?
2 votes
1 answer
237 views

Ways to make deployment ready pre-compressed brotli files on windows server

I am dynamically generating HTML files, which I use for deployment. This is what I use to make these HTML file: function writeFile() Dim objStream Set objStream = CreateObject("ADODB....
0 votes
2 answers
554 views

Tool to create pre-compressed [Brotli] files

I am trying to pre-generate compressed brotli files in designated directories for static html, css and js files. I found a rust tool here – https://github.com/neosmart/static-compress Besides this, ...
1 vote
0 answers
39 views

zfs send to NAS with PIGZ compression slowness

The following command that I use to backup used to take 5 minutes to complete and since last week it is taking around 25 minutes. This is after restarting a switch stack the server is connected to. ...
3 votes
5 answers
4k views

Enable row level compression on all tables and indexes

One of the (optional) requirements for the Works With SQL Server 2008 test is that row level compression is enabled on all tables and indexes. We have an existing database with a lot of tables and ...
3 votes
1 answer
5k views

How to install the brotli nginx module properly on debian

I'm trying to setup brotly compression on a nginx/1.10.3 server running on Debian 9.5 Stretch / Linux 4.9.0-8-amd64 #1 SMP Debian 4.9.110-3+deb9u5 (on a lightsail instance). I used the following ...
1 vote
2 answers
128 views

Nginx performance issues

I made a website using React and connected to Strapi. But I need to keep some background videos mainly on the home page. The main banner has 4 videos and the background of the page is also a video. ...
1 vote
2 answers
441 views

Will disk compression impact the performance of a MySQL database?

I've recently setup a TrueNAS storage server and hosted on it is a MySQL database. It's about 3GB; I'm not too concerned with how much space it's utilising. By default, TrueNAS enables LZ4 compression ...
3 votes
3 answers
1k views

Can I enable gzip/deflate in IIS6 without restart?

I have gone through the steps of enabling static compression for my IIS 6.0 site: enable it in IIS Manager enable edit-while-running add the extensions i need to compress directly to the metabase: js,...
12 votes
4 answers
1k views

How to use the full LTO-2 Tape backup capacity of 200/400GB?

I have an Ultrium 448 tape drive, LTO-2 tapes (200/400GB) and I'm using HP Data Protector as the backup client. The system is set to format and overwrite all tapes but I never manage to get more that ~...
1 vote
1 answer
377 views

Cloudflare uncompressing, then re-compressing response bodies

I'm using Node.js/express and if I set the headers Content-Type: application/json Content-Encoding: gzip and send gzipped compressed bodies of JSON data, this works as expected - when not behind ...
5 votes
3 answers
1k views

Hardware compression on tape drives: does it still make sense?

Does hardware compression still make sense on tape drives, considering the performance of modern CPUs? Also, what should I do if I have some data which is already compressed in GZIP and my drive is ...
8 votes
2 answers
12k views

View/Find all compressed files on the server?

I need to find all compressed files/folders regardless of file format on a Windows Server 2003 machine. Search options do not provide this capability. Is there a way to list/view all compressed ...
3 votes
1 answer
2k views

GZip compression not working on Tomcat7

I recently tried using gzip compression to improve web UI performance. I configured Tomcat Connector as below. compression="on" compressionMinSize="2048" noCompressionUserAgents="gozilla, traviata" ...
0 votes
1 answer
83 views

Debian: Simple way to compress files wanted

I often need to compress archives in Linux. is there a simpler way instead of always building such complicated commands? tar zcvf /tmp/mybackup.tar.gz /home/important
2 votes
1 answer
1k views

IIS 7.5 Not Compressing Javascript: NO_MATCHING_CONTENT_TYPE

I have IIS 7.5 set to compress all static files (the default), yet it does not compress .js (javascript) files. When I turn on failed request tracing for compression, the error I get for the ...
1 vote
1 answer
2k views

how nginx serves large files

We have a problem with loading a pdf file which is about 300KB size on our web page. The pdf is being served by nginx. Whenever I load the file, it shows an error saying Failed to open pdf document, ...
1 vote
2 answers
3k views

Modern transparent folder compression in Ubuntu 18.04

I'm looking for a way to transparently compress files in a directory, that will be shared over SMB. I have a server, running Ubuntu 18.04.1 LTS, and I use it for file storage. Mainly what I want to ...
8 votes
5 answers
18k views

Should I use rsync compression over a gigabit LAN?

I normally use rsync's -z option to enable compression when transferring files over the internet. However, if I am on my own (idle) gigabit LAN, do I still want compression? Or will it be faster ...
1 vote
1 answer
3k views

gzip compression using mod_deflate apache with tomcat

I'm trying to enable gzip compression in my Apache server which is fronting a Tomcat instance using a connector. I tried several variants of the module configuration settings in my httpd.conf. Here is ...
7 votes
4 answers
5k views

backup files with many duplicated files

I frequently need to do a backup of a group of files, with many subfolders which contain several large, identical files. Is there a compression scheme (.zip, .7z, etc) which can automatically detect ...
0 votes
0 answers
3k views

is there a faster way to extract a large file tar in lz4 format?

I have a 7 TB file that is tared with lz4 compression. It takes about 8 hours to extract. is there a faster way to do this? This is the command I use: lz4 -d /mnt/tmp/7TBFile.lz4 | tar -xvf -
2 votes
0 answers
613 views

Are servers allowed to add a Content-Encoding header based on filename, if there is no compression on-the-fly?

Problem Suppose we have a compressed archive on disk, e.g. file.tar.gz, which should be served as-is. The file is served with Content-Type: application/gzip, but for some reason the server also adds a ...
1 vote
1 answer
303 views

Compressing rarely queried historical data in postgres

In short: compress multiple historical DB records to bigger, compressed records and temporarily uncompress it to the original records for easier querying, and clean that up when querying is done. ...
-1 votes
1 answer
571 views

MySQL JDBC compression in transit

Good morning, I am looking to set my application connection to MySQL to compress data in transit. I read MySQL doc. but it's not cleat to me if I need to do something on the client side, on the server ...
0 votes
2 answers
1k views

Protection against "CRIME attack"/Disable SSL compression under Ubuntu/Apache/2.2.22

I'm trying to disable SSL compression in my server, but can't because SSLCompression option isn't yet avaliable with my current apache installation. I found a patch that will give me that option http:...
133 votes
7 answers
418k views

Does Windows have a built-in ZIP command for the command line?

Since Windows Explorer (since at least Windows XP) has some basic support for ZIP files, it seems like there should be a command-line equivalent, but I can't seem to find any sign of one. Does ...
0 votes
1 answer
735 views

Stratis filesystem will not mount after a reboot because the disk is full

It concerns a rhel8 server that has two disks (sda and sdb), and only on the sdb disk a Stratis filesystem has been created. After a restart of the server, no more mount point appears on the sdb disk. ...
0 votes
1 answer
750 views

Returning compressed data when client omits accept-encoding header

In the HTTP 1.1 Standard, it says that "If no Accept-Encoding field is in the request, any content-coding is considered acceptable by the user agent." Which means that a server can, for ...
1 vote
1 answer
399 views

Compress input files from rsync before writing to disk

I need to load big text files from another machine through a 10Gb link, files been creating by external/closed-source software that i don't have access to change (for example to make it to compress ...
0 votes
2 answers
2k views

scp with -C flag does not perform compression

The scp man page shows that the -C flag can be used for compressing a file on the fly while performing a remote copy - $ man scp | grep "\-C" -C Compression enable. Passes the -C ...
0 votes
1 answer
20 views

Changes in compression rate

Every month I usually compress all my database dumps into a rar file. I was very happy with the compression rate, as each compressed file was usually about 30MB, with a compression rate of 99%. Since ...
19 votes
6 answers
34k views

Are there other options to unzip a file in Ubuntu besides "unzip"? [closed]

My sysadmin is unreachable right now, and I have a zipped file on the server that I would like to unzip...however, we don't currently have zip and unzip installed, and I don't have root access to ...
0 votes
0 answers
472 views

community.windows.win_unzip shows Filename contains relative paths which would extract outside the destination error message

I'm trying to unzip a zip file in a remote server This file was download first from jFrog repository The following task should handle the unzip: - name: Unzip Config.zip file community.windows....
19 votes
5 answers
37k views

Unzip from stdin to stdout - funzip, python

The goal is to read a zip file from stdin and uncompress to stdout. Funzip works and is the solution I am looking for, the zip contains a single file, unfortunately funzip fails when the compressed ...
0 votes
0 answers
333 views

Transfer Compression with Cloudfront and nginx SSI

Is there any way to enable GZIP / Brotli compression on Cloudfront if the origin is a nginx server with SSI (Server Side Includes) enabled? The issue seems that nginx SSI drops the Content-Length ...
0 votes
1 answer
196 views

ZFS Transfer extremely bursty

I am testing a new ZFS configuration with z-std for log storage and storage of highly compressible files. The Array is tested on a 5 drive raidz-1 in a virtual machine on my PC which has direct access ...
5 votes
1 answer
536 views

Unable to compress 18GB file on Ubuntu Linux 18.04

It never happened to me before, but I'm unable to do a simple task such as compressing a 18.5 GB file on Ubuntu Linux 18.04 with any of the popular compressing tools such as gzip, bzip2 and 7z. All of ...
52 votes
12 answers
66k views

Unzipping files that are flying in through a pipe

Can I make unzip or any similar programs work on the standard output? The situation is I'm downloading a zip file, which is supposed to be unzipped on the fly. Related issue: How do I pipe a ...
0 votes
1 answer
2k views

How do I make a compressed disk image (qcow2 and/or squashfs) from a disk directly?

I have a disk attached to my server and I want to make the disk image of it downloadable on the same server. The disk itself is 500GB but I don't want to have a 500GB disk image for download. I'd like ...
32 votes
5 answers
33k views

tar: How to create a tar file with arbitrary leading directories w/o 'cd'ing to parent dir

Say I have a directory of files at /home/user1/dir1 and I want to create a tar with only "dir1" as the leading directory: /dir1/file1 /dir1/file2 I know I can first cd to the directory cd /home/...
12 votes
8 answers
43k views

Can't send to compressed (zipped) folder

I'm IT Technician at a Secondary School and our Network Manager is away on long term leave. Currently our student's aren't able to send to - compressed folder. When trying the error 'File not found ...
2 votes
2 answers
1k views

Cannot turn off SSLCompression in Apache?

My Apache is 2.4.46 and is using Openssl version 1.1.1f I have set the directive SSLCompression Off. Even if i enable it, it says SSL Compression is not supported, which is good I guess. But, when I ...
1 vote
2 answers
2k views

SugarCRM CE: upgrade from 6.5.9 to 6.5.11 Fails with "ZIP Error(0): Status(0): Arhive(upload://SugarCE-6.5.11.zip)"

I have a fresh running installation of SugarCRM Version 6.5.9 (Build 8653) hosted at Bluehost.com (shared hosting) When I use the upgrade wizard, the system checks are all successful. Then I get the ...
7 votes
3 answers
12k views

Faster zlib alternatives [closed]

I wonder, if there are any faster builds of zlib around with more advanced optimizations? If it's possible to optimize it using SSE instructions or Intel C++ compiller, or some trick which were ...

1
2 3 4 5
9