Questions tagged [compression]

Decrease the size of data, typically to preserve space or reduce network bandwidth required while transmitting files. It can be applied to files, folders, disks, etc.

Filter by
Sorted by
Tagged with
0 votes
1 answer
15 views

Returning compressed data when client omits accept-encoding header

In the HTTP 1.1 Standard, it says that "If no Accept-Encoding field is in the request, any content-coding is considered acceptable by the user agent." Which means that a server can, for ...
user avatar
0 votes
0 answers
25 views

Why does extracting a large .zst file cause another server with a cifs mount to come to a halt?

I have a large .zst file I need extracted on a backup server running CentOS. I begin to extract the file using zstd -d file_name.zst. I was going to then do tar -xvf file_name once that finished. ...
user avatar
1 vote
1 answer
46 views

Compress input files from rsync before writing to disk

I need to load big text files from another machine through a 10Gb link, files been creating by external/closed-source software that i don't have access to change (for example to make it to compress ...
user avatar
  • 111
0 votes
2 answers
129 views

scp with -C flag does not perform compression

The scp man page shows that the -C flag can be used for compressing a file on the fly while performing a remote copy - $ man scp | grep "\-C" -C Compression enable. Passes the -C ...
user avatar
0 votes
1 answer
14 views

Changes in compression rate

Every month I usually compress all my database dumps into a rar file. I was very happy with the compression rate, as each compressed file was usually about 30MB, with a compression rate of 99%. Since ...
user avatar
  • 213
0 votes
0 answers
109 views

Cannot fully disable gzip content encoding on specific POST requests

I've been trying to figure this one out for a while. I have disabled gzip/compression options on both Apache Tomcat (which is running the reportserver software in docker) and on nginx (acting as a ...
user avatar
  • 249
0 votes
0 answers
192 views

Stratis filesystem will not mount after a reboot because the disk is full

It concerns a rhel8 server that has two disks (sda and sdb), and only on the sdb disk a Stratis filesystem has been created. After a restart of the server, no more mount point appears on the sdb disk. ...
user avatar
0 votes
0 answers
21 views

Enabling Gzip Compression on IIS/applicationHost where websites exist on two drives

I have inherited a strange environment for a website. It is broken into various projects of which some are in the inetpub directory on the server's C drive and others in the same directory on D drive. ...
user avatar
  • 101
0 votes
0 answers
104 views

community.windows.win_unzip shows Filename contains relative paths which would extract outside the destination error message

I'm trying to unzip a zip file in a remote server This file was download first from jFrog repository The following task should handle the unzip: - name: Unzip Config.zip file community.windows....
user avatar
  • 67
0 votes
0 answers
28 views

IIS 10 is sending uncompressed version of CSS file

Problem I'm using IIS 10 to serve a .NET web app. I have Static Compression enabled on IIS server (as is the default). The app contains a big CSS file, which needs to be transferred compressed, but in ...
user avatar
  • 101
0 votes
0 answers
112 views

Transfer Compression with Cloudfront and nginx SSI

Is there any way to enable GZIP / Brotli compression on Cloudfront if the origin is a nginx server with SSI (Server Side Includes) enabled? The issue seems that nginx SSI drops the Content-Length ...
user avatar
0 votes
1 answer
78 views

ZFS Transfer extremely bursty

I am testing a new ZFS configuration with z-std for log storage and storage of highly compressible files. The Array is tested on a 5 drive raidz-1 in a virtual machine on my PC which has direct access ...
user avatar
5 votes
1 answer
322 views

Unable to compress 18GB file on Ubuntu Linux 18.04

It never happened to me before, but I'm unable to do a simple task such as compressing a 18.5 GB file on Ubuntu Linux 18.04 with any of the popular compressing tools such as gzip, bzip2 and 7z. All of ...
user avatar
  • 181
0 votes
1 answer
574 views

How do I make a compressed disk image (qcow2 and/or squashfs) from a disk directly?

I have a disk attached to my server and I want to make the disk image of it downloadable on the same server. The disk itself is 500GB but I don't want to have a 500GB disk image for download. I'd like ...
user avatar
2 votes
2 answers
531 views

Cannot turn off SSLCompression in Apache?

My Apache is 2.4.46 and is using Openssl version 1.1.1f I have set the directive SSLCompression Off. Even if i enable it, it says SSL Compression is not supported, which is good I guess. But, when I ...
user avatar
-1 votes
2 answers
190 views

Tool to create pre-compressed [Brotli] files

I am trying to generate pre-compressed brotli files in designated directories… Whatever html, css and js files are there have to be compressed to brotli. I found a rust tool here – https://github.com/...
user avatar
  • 11
0 votes
1 answer
438 views

Preserve Cloudfront brotli compression through a nginx reverse_proxy

My question is similar to Nginx reverse-proxy to a cloudfront distribution and preserve gzip compression but especially regarding the new brotli compression algorithm that is supposed to perform ...
user avatar
1 vote
0 answers
286 views

btrfs compress existing data with snapshots

I'm runninga a btrfs raid1 on 5 8 TB disks, where primarily urbackup stores backups to. Urbackup uses snapshots extensively. compsize produces the following output: Processed 106161732 files, 57335496 ...
user avatar
  • 111
0 votes
0 answers
30 views

Opera Mini Compression Technology

I'm trying to find the technology used in Opera Mini's browser. I can't find anything related to this, so I would like to know if anyone knows whether there exists a paper on this or if there is ...
user avatar
  • 101
1 vote
1 answer
3k views

How to install nginx-module-brotli?

I have a server with ubuntu 20.04 But I am unable to install nginx-module-brotli for my nginx server. Here are the commands I use to install Brotli for Nginx : $ sudo apt install git gcc cmake ...
user avatar
0 votes
1 answer
73 views

How to syncronize XML files and store them as .gz at destination using rsync

I'm using rsync -z to backup a large amount of XML files. The source is a huge machine with thousands of GBs available on disk, but the destination is not that powerful. What I want to do is to ...
user avatar
4 votes
1 answer
1k views

Compress old emails with dovecot

How can I configure dovecot to compress/archive old emails (say 6 months old) with the users still being able to read them, to save some precious space on the server?
user avatar
  • 181
0 votes
0 answers
83 views

tar | pigz dies if run under cron

I run a kind of backup script using tar joint with pigz for compression. The problem is that tar -zcf /file.tar.gz /folder runs under cron. While tar -I pigz -cvf /file.tar.gz /folder nor tar ...
user avatar
  • 151
0 votes
0 answers
110 views

Nginx serve another file when possible

I currently compile my assets with Webpack's BrotliPlugin, which creates a separate file, brotli-encoded, i.e.: style.css style.cssb Here's what I want to achieve: Consider the HTML page requests ...
user avatar
  • 101
1 vote
0 answers
87 views

haproxy compression type regex/wildcard

As stated in haproxy docs, we can use "compression type" with list of mime types. In my case, there is REST API backend, and the compression should be applied to multiple vendor-specific versioned ...
user avatar
2 votes
2 answers
503 views

Extracting single file from large tar.gz file

I have an incredibly large tarball. I'd extract several files out of many thousands within the archive. I'm on CentOS 6.10 running GPFS 4.2.3. I've seen from this answer that pigz is useful in ...
user avatar
0 votes
1 answer
63 views

How do I find out why compact command appears to hang on certain files?

After extending the hard disk sizes on a Windows 2008 server I am trying to revert the compressing of a lot of files on the hard drives. I use the command compact /u /s /i /f /q for it. But it ...
user avatar
0 votes
2 answers
428 views

How to untar a very large file with missing space

I have reinstalled my server and before that i did a backed up. My backup is a tar file without special compress option (meaning that the size of the tar file is approximately the same than the size ...
user avatar
2 votes
1 answer
3k views

How to install the brotli nginx module properly on debian

I'm trying to setup brotly compression on a nginx/1.10.3 server running on Debian 9.5 Stretch / Linux 4.9.0-8-amd64 #1 SMP Debian 4.9.110-3+deb9u5 (on a lightsail instance). I used the following ...
user avatar
  • 121
0 votes
1 answer
184 views

Script isn't served compressed from IIS

I have IIS 10 running on Windows 2016 (I see exactly same behavior on Windows 2019). I enabled static compression. I can see that the browser (Chrome) sends accept-encoding: gzip, deflate, br. I can ...
user avatar
  • 533
1 vote
1 answer
455 views

Apache mod_deflate MIME type settings

CPanel gives me options about what MIME content types to compress with Apache's mod_deflate, as shown below. Are there disadvantages to having a long list of MIME types (eg. slower server response)? ...
user avatar
0 votes
1 answer
1k views

Can not run Brotli on my Nginx server

I installed Brotli on Ubuntu 18.04 with Nginx. Here is the procedure I followed : $ sudo apt-add-repository ppa:hda-me/nginx-stable $ sudo apt update $ sudo apt install brotli nginx nginx-module-...
user avatar
  • 57
4 votes
2 answers
7k views

How to install Brotli on nginx and Ubuntu 18.04?

I installed Brotli on Ubuntu 18.04 with Nginx. Here is the procedure I followed : $ sudo apt-add-repository ppa:hda-me/nginx-stable $ sudo apt update $ sudo apt install brotli nginx nginx-module-...
user avatar
  • 57
4 votes
1 answer
932 views

What kind of algorithm is used in LTO tape hardware compression?

LTO tape drives, from their very first generation, offer hardware compression that, theoretically, allows a maximum of 2 - 2.5x the rated data capacity of each cartridge to be stored, with only a ...
user avatar
  • 1,367
1 vote
1 answer
77 views

How to enable IIS to always precompress / pregzip a certain file?

I have a 4mb js file (gzipped version is 900kb). The file is like this: main.328479fdsdf.js (so it has a hash based on the content). IIS seems to compress my big js file only if is accessed 2 times ...
user avatar
  • 111
0 votes
1 answer
270 views

Use of gzip with multiple, sequential nginx proxies

Consider the following server setup on a network: In this example, both of the proxy servers are Nginx servers. If the aim is to reduce load time for the client, should compression be used by the ...
user avatar
4 votes
2 answers
360 views

Are LTO Hardware compression and encryption standardized?

I'm about to setup a backup using an LTO-4 Drive. I know that drives are meant to be compatible to any tape within the past 3 generations (so I should be able to read an LTO-4 tape using an LTO-4, 5 ...
user avatar
  • 3,990
1 vote
1 answer
2k views

Modern transparent folder compression in Ubuntu 18.04

I'm looking for a way to transparently compress files in a directory, that will be shared over SMB. I have a server, running Ubuntu 18.04.1 LTS, and I use it for file storage. Mainly what I want to ...
user avatar
1 vote
0 answers
370 views

Why do i get gzip css and js with full size instead of compressed size

I am doing some tests with gzip, I have manually compressed the CSS and JS with gzip. The size of the JS has dropped from 33kb to 7kb. The problem is when I look in the network tab in Chrome or ...
user avatar
  • 111
-2 votes
1 answer
344 views

openvpn optimizations for Low bandwidth (250mb a month)

I am using openwrt lede with a lte stick 250-300mb a month depending on the unit so preferably hitting 250 or lower would be better for the entire system these are the clients the server doesn't have ...
user avatar
3 votes
1 answer
142 views

Does ZFS, using default settings, use more physical space than ext4 for the same amount of data?

I'm currently considering a switch from ext4 to ZFS and am having trouble finding information about whether or not it uses more or less space to store the same amount of data as ext4. My understanding ...
user avatar
  • 503
-1 votes
1 answer
1k views

tar -z is very slow [closed]

I know this question has been asked before and I saw the recommendations on using pigz. Good recommendations, but I wanted to see if I really have a "problem". I have an esxi host. It's the free ...
user avatar
  • 3
2 votes
1 answer
3k views

ZFS does not compress files and all settings look correct

I recently created a ZFS volume to test its compression capabilities. I'm comparing it side by side to an ext4 volume. After creating the new volume and turning compression on with sudo zfs set ...
user avatar
  • 1,231
0 votes
2 answers
358 views

Restoring svn backup (bzip2)

I have successfully made backup of my SVN repository as described here. However, how does one restores backed-up repository, i.e. initiate reverse operation of restoring backup, because after command: ...
user avatar
3 votes
2 answers
122 views

Compressing data when it is to be written on the disk

I have a server which is used for scientific computation, each user has a virtual machine (Linux or Windows) for their usage. the problem is reports generated by these computations take a huge amount ...
user avatar
  • 141
2 votes
1 answer
402 views

zram filesystem reports different usage at device level to that reported by the filesystem

We have an 80GB zram device defined on our host, and within this a 170GB ext4 filesystem: echo 170G > /sys/block/zram0/disksize echo 80G > /sys/block/zram0/mem_limit /usr/sbin/mkfs.ext4 -...
user avatar
0 votes
1 answer
1k views

Mount on the fly compressed filesystem

I'm looking for solution for not enough disk space on our server to store backups. We have virtual server. When we dump data from database to disk it consumes lot of space. But it could be easily ...
user avatar
0 votes
0 answers
87 views

Postfix not adding email size flag with maildirs

Dovecot requires emails in maildirs to have ,S= -flag on emails to be compressed, but I cannot seem to find a way to make Postfix to add this flag. Is there some configuration option or is there other ...
user avatar
  • 511
1 vote
0 answers
50 views

Can I delete SSOServer Logs? (VMware)

I have a client that has a large amount of log files within the SSOServer Logs folder. I want to compress/delete these files so that it makes room. Will this affect VMware? Most are text docs but some ...
user avatar
1 vote
2 answers
3k views

More accurate way to obtain ZFS filesystem size?

I've been having trouble backing up a ZFS filesytem due to my backup devices running out of space. The first time I forgot that compression was enabled. However, for the second attempt, I got the ...
user avatar

1
2 3 4 5
9