Questions tagged [compression]

Decrease the size of data, typically to preserve space or reduce network bandwidth required while transmitting files. It can be applied to files, folders, disks, etc.

Filter by
Sorted by
Tagged with
6
votes
1answer
140 views

Unable to compress 18GB file on Ubuntu Linux 18.04

It never happened to me before, but I'm unable to do a simple task such as compressing a 18.5 GB file on Ubuntu Linux 18.04 with any of the popular compressing tools such as gzip, bzip2 and 7z. All of ...
0
votes
0answers
18 views

Elasticsearch - does compression affect shard sizing calculations?

I was reading about elasticsearch shard sizing at: https://www.elastic.co/blog/how-many-shards-should-i-have-in-my-elasticsearch-cluster In the article, they write a few tips in regards of the shard ...
0
votes
1answer
162 views

How do I make a compressed disk image (qcow2 and/or squashfs) from a disk directly?

I have a disk attached to my server and I want to make the disk image of it downloadable on the same server. The disk itself is 500GB but I don't want to have a 500GB disk image for download. I'd like ...
2
votes
2answers
169 views

Cannot turn off SSLCompression in Apache?

My Apache is 2.4.46 and is using Openssl version 1.1.1f I have set the directive SSLCompression Off. Even if i enable it, it says SSL Compression is not supported, which is good I guess. But, when I ...
-1
votes
2answers
40 views

Tool to create pre-compressed [Brotli] files

I am trying to generate pre-compressed brotli files in designated directories… Whatever html, css and js files are there have to be compressed to brotli. I found a rust tool here – https://github.com/...
0
votes
0answers
73 views

NGINX: check for file existence doesn't fire (enabling static brotli without module)

I'm currently trying to make nginx respond with (precompiled) brotli files when the requesting browser accepts it. (Accept-Encoding contains "br"). The compressed versions of the files are ...
0
votes
1answer
149 views

Preserve Cloudfront brotli compression through a nginx reverse_proxy

My question is similar to Nginx reverse-proxy to a cloudfront distribution and preserve gzip compression but especially regarding the new brotli compression algorithm that is supposed to perform ...
0
votes
0answers
150 views

Expand archive wont unzip files using powershell

I am using a IO.FileSystemWatcher FileCreated object event to detect when a zip file is placed in a folder, once the zip is detected the script needs to extract the contents and save the files in ...
1
vote
0answers
105 views

btrfs compress existing data with snapshots

I'm runninga a btrfs raid1 on 5 8 TB disks, where primarily urbackup stores backups to. Urbackup uses snapshots extensively. compsize produces the following output: Processed 106161732 files, 57335496 ...
0
votes
0answers
20 views

Opera Mini Compression Technology

I'm trying to find the technology used in Opera Mini's browser. I can't find anything related to this, so I would like to know if anyone knows whether there exists a paper on this or if there is ...
0
votes
1answer
1k views

How to install nginx-module-brotli?

I have a server with ubuntu 20.04 But I am unable to install nginx-module-brotli for my nginx server. Here are the commands I use to install Brotli for Nginx : $ sudo apt install git gcc cmake ...
0
votes
1answer
30 views

How to syncronize XML files and store them as .gz at destination using rsync

I'm using rsync -z to backup a large amount of XML files. The source is a huge machine with thousands of GBs available on disk, but the destination is not that powerful. What I want to do is to ...
0
votes
0answers
16 views

API call err_connection_refused only on Chrome (NGINX backend)

I make API calls with a really really long parameter string (500 product ids): https://www.mywebsite.com/xxxx/yyyy/load/?t=1590221086786&mode=cart&productIds%5B%5D=6413&productIds%5B%5D=...
3
votes
1answer
636 views

Compress old emails with dovecot

How can I configure dovecot to compress/archive old emails (say 6 months old) with the users still being able to read them, to save some precious space on the server?
0
votes
0answers
74 views

tar | pigz dies if run under cron

I run a kind of backup script using tar joint with pigz for compression. The problem is that tar -zcf /file.tar.gz /folder runs under cron. While tar -I pigz -cvf /file.tar.gz /folder nor tar ...
0
votes
0answers
58 views

Nginx serve another file when possible

I currently compile my assets with Webpack's BrotliPlugin, which creates a separate file, brotli-encoded, i.e.: style.css style.cssb Here's what I want to achieve: Consider the HTML page requests ...
1
vote
0answers
68 views

haproxy compression type regex/wildcard

As stated in haproxy docs, we can use "compression type" with list of mime types. In my case, there is REST API backend, and the compression should be applied to multiple vendor-specific versioned ...
2
votes
2answers
318 views

Extracting single file from large tar.gz file

I have an incredibly large tarball. I'd extract several files out of many thousands within the archive. I'm on CentOS 6.10 running GPFS 4.2.3. I've seen from this answer that pigz is useful in ...
0
votes
1answer
54 views

How do I find out why compact command appears to hang on certain files?

After extending the hard disk sizes on a Windows 2008 server I am trying to revert the compressing of a lot of files on the hard drives. I use the command compact /u /s /i /f /q for it. But it ...
0
votes
2answers
230 views

How to untar a very large file with missing space

I have reinstalled my server and before that i did a backed up. My backup is a tar file without special compress option (meaning that the size of the tar file is approximately the same than the size ...
2
votes
1answer
3k views

How to install the brotli nginx module properly on debian

I'm trying to setup brotly compression on a nginx/1.10.3 server running on Debian 9.5 Stretch / Linux 4.9.0-8-amd64 #1 SMP Debian 4.9.110-3+deb9u5 (on a lightsail instance). I used the following ...
0
votes
1answer
109 views

Script isn't served compressed from IIS

I have IIS 10 running on Windows 2016 (I see exactly same behavior on Windows 2019). I enabled static compression. I can see that the browser (Chrome) sends accept-encoding: gzip, deflate, br. I can ...
1
vote
1answer
316 views

Apache mod_deflate MIME type settings

CPanel gives me options about what MIME content types to compress with Apache's mod_deflate, as shown below. Are there disadvantages to having a long list of MIME types (eg. slower server response)? ...
0
votes
1answer
805 views

Can not run Brotli on my Nginx server

I installed Brotli on Ubuntu 18.04 with Nginx. Here is the procedure I followed : $ sudo apt-add-repository ppa:hda-me/nginx-stable $ sudo apt update $ sudo apt install brotli nginx nginx-module-...
3
votes
2answers
5k views

How to install Brotli on nginx and Ubuntu 18.04?

I installed Brotli on Ubuntu 18.04 with Nginx. Here is the procedure I followed : $ sudo apt-add-repository ppa:hda-me/nginx-stable $ sudo apt update $ sudo apt install brotli nginx nginx-module-...
4
votes
1answer
536 views

What kind of algorithm is used in LTO tape hardware compression?

LTO tape drives, from their very first generation, offer hardware compression that, theoretically, allows a maximum of 2 - 2.5x the rated data capacity of each cartridge to be stored, with only a ...
1
vote
1answer
52 views

How to enable IIS to always precompress / pregzip a certain file?

I have a 4mb js file (gzipped version is 900kb). The file is like this: main.328479fdsdf.js (so it has a hash based on the content). IIS seems to compress my big js file only if is accessed 2 times ...
0
votes
1answer
157 views

Use of gzip with multiple, sequential nginx proxies

Consider the following server setup on a network: In this example, both of the proxy servers are Nginx servers. If the aim is to reduce load time for the client, should compression be used by the ...
4
votes
2answers
254 views

Are LTO Hardware compression and encryption standardized?

I'm about to setup a backup using an LTO-4 Drive. I know that drives are meant to be compatible to any tape within the past 3 generations (so I should be able to read an LTO-4 tape using an LTO-4, 5 ...
1
vote
1answer
2k views

Modern transparent folder compression in Ubuntu 18.04

I'm looking for a way to transparently compress files in a directory, that will be shared over SMB. I have a server, running Ubuntu 18.04.1 LTS, and I use it for file storage. Mainly what I want to ...
1
vote
0answers
321 views

Why do i get gzip css and js with full size instead of compressed size

I am doing some tests with gzip, I have manually compressed the CSS and JS with gzip. The size of the JS has dropped from 33kb to 7kb. The problem is when I look in the network tab in Chrome or ...
-2
votes
1answer
249 views

openvpn optimizations for Low bandwidth (250mb a month)

I am using openwrt lede with a lte stick 250-300mb a month depending on the unit so preferably hitting 250 or lower would be better for the entire system these are the clients the server doesn't have ...
2
votes
1answer
108 views

Does ZFS, using default settings, use more physical space than ext4 for the same amount of data?

I'm currently considering a switch from ext4 to ZFS and am having trouble finding information about whether or not it uses more or less space to store the same amount of data as ext4. My understanding ...
-2
votes
1answer
1k views

tar -z is very slow [closed]

I know this question has been asked before and I saw the recommendations on using pigz. Good recommendations, but I wanted to see if I really have a "problem". I have an esxi host. It's the free ...
2
votes
1answer
3k views

ZFS does not compress files and all settings look correct

I recently created a ZFS volume to test its compression capabilities. I'm comparing it side by side to an ext4 volume. After creating the new volume and turning compression on with sudo zfs set ...
0
votes
2answers
256 views

Restoring svn backup (bzip2)

I have successfully made backup of my SVN repository as described here. However, how does one restores backed-up repository, i.e. initiate reverse operation of restoring backup, because after command: ...
3
votes
2answers
88 views

Compressing data when it is to be written on the disk

I have a server which is used for scientific computation, each user has a virtual machine (Linux or Windows) for their usage. the problem is reports generated by these computations take a huge amount ...
2
votes
1answer
306 views

zram filesystem reports different usage at device level to that reported by the filesystem

We have an 80GB zram device defined on our host, and within this a 170GB ext4 filesystem: echo 170G > /sys/block/zram0/disksize echo 80G > /sys/block/zram0/mem_limit /usr/sbin/mkfs.ext4 -...
0
votes
1answer
1k views

Mount on the fly compressed filesystem

I'm looking for solution for not enough disk space on our server to store backups. We have virtual server. When we dump data from database to disk it consumes lot of space. But it could be easily ...
0
votes
0answers
70 views

Postfix not adding email size flag with maildirs

Dovecot requires emails in maildirs to have ,S= -flag on emails to be compressed, but I cannot seem to find a way to make Postfix to add this flag. Is there some configuration option or is there other ...
1
vote
0answers
48 views

Can I delete SSOServer Logs? (VMware)

I have a client that has a large amount of log files within the SSOServer Logs folder. I want to compress/delete these files so that it makes room. Will this affect VMware? Most are text docs but some ...
1
vote
2answers
2k views

More accurate way to obtain ZFS filesystem size?

I've been having trouble backing up a ZFS filesytem due to my backup devices running out of space. The first time I forgot that compression was enabled. However, for the second attempt, I got the ...
0
votes
0answers
265 views

Data Compression

We have an HP StorageWorks 1/8 G2 Autoloader using LTO-6 tapes working with Symantec Backup Exec 15. I've set the backups which are going to tape to use hardware compresison "if available, otherwise ...
0
votes
1answer
746 views

Disable brotli compression for single nginx vhost

I have a handful of websites on a single server, setup using https://serverpilot.io/ It enables brotli compression for all sites by default but I would like to disable this on a single site that sits ...
1
vote
0answers
78 views

Send compressed requests with Apache

I have looked at simlar questions but they do not cover my scenario. Example: Is it possible to enable http compression for requests? Scenario: Server A is running a Service which generates large ...
0
votes
0answers
57 views

Streaming compression for large files

We want to compress large backup files and push them into the cloud. I'm looking for an application/utility/codebase that will allow us to efficiently compress on the fly as part of the transfer. I'...
0
votes
2answers
669 views

Apache Webserver: check if decompression is supported

With SetInputFilter DEFLATE I can force the apache to decompress incoming messages. Is there a way to ask the webserver whether it supports decompression of incoming requests. I would expect a ...
1
vote
1answer
2k views

How to read gitlab-workhorse logs?

I am running gitlab omnibus installation on local server. There are certain incidents which happened and would like to see the logs in gitlab-workhorse. The files in /var/log/gitlab/gitlab-workhorse ...
3
votes
1answer
904 views

How to get compression ratio of OpenVPN

With my botnet I crawled the entire internet but I didn't found anything. I'm running an OpenVPN server on Debian with LZ4-v2 compression enabled and about 5 Clients. Now I wonder where it is ...
0
votes
1answer
437 views

IIS Formal Brotli compression module

Is there any formal extension for IIS to support brotli compression? Previously I saw these two extension but I cannot rely on them for a production server: https://www.iis.net/downloads/community/...

1
2 3 4 5
9