Questions tagged [compression]

Decrease the size of data, typically to preserve space or reduce network bandwidth required while transmitting files. It can be applied to files, folders, disks, etc.

Filter by
Sorted by
Tagged with
0
votes
0answers
11 views

API call err_connection_refused only on Chrome (NGINX backend)

I make API calls with a really really long parameter string (500 product ids): https://www.mywebsite.com/xxxx/yyyy/load/?t=1590221086786&mode=cart&productIds%5B%5D=6413&productIds%5B%5D=...
0
votes
0answers
11 views

IIS 10.0 disable static and dynamic compression CPU throttling

I want IIS to perform static and dynamic compression no matter what my CPU load is. Seems like the only available settings are: staticCompressionDisableCpuUsage staticCompressionEnableCpuUsage ...
1
vote
1answer
67 views

Compress old emails with dovecot

How can I configure dovecot to compress/archive old emails (say 6 months old) with the users still being able to read them, to save some precious space on the server?
0
votes
0answers
49 views

tar | pigz dies if run under cron

I run a kind of backup script using tar joint with pigz for compression. The problem is that tar -zcf /file.tar.gz /folder runs under cron. While tar -I pigz -cvf /file.tar.gz /folder nor tar ...
0
votes
0answers
27 views

Nginx serve another file when possible

I currently compile my assets with Webpack's BrotliPlugin, which creates a separate file, brotli-encoded, i.e.: style.css style.cssb Here's what I want to achieve: Consider the HTML page requests ...
1
vote
0answers
42 views

haproxy compression type regex/wildcard

As stated in haproxy docs, we can use "compression type" with list of mime types. In my case, there is REST API backend, and the compression should be applied to multiple vendor-specific versioned ...
1
vote
2answers
83 views

Extracting single file from large tar.gz file

I have an incredibly large tarball. I'd extract several files out of many thousands within the archive. I'm on CentOS 6.10 running GPFS 4.2.3. I've seen from this answer that pigz is useful in ...
0
votes
1answer
52 views

How do I find out why compact command appears to hang on certain files?

After extending the hard disk sizes on a Windows 2008 server I am trying to revert the compressing of a lot of files on the hard drives. I use the command compact /u /s /i /f /q for it. But it ...
0
votes
2answers
136 views

How to untar a very large file with missing space

I have reinstalled my server and before that i did a backed up. My backup is a tar file without special compress option (meaning that the size of the tar file is approximately the same than the size ...
0
votes
1answer
49 views

Script isn't served compressed from IIS

I have IIS 10 running on Windows 2016 (I see exactly same behavior on Windows 2019). I enabled static compression. I can see that the browser (Chrome) sends accept-encoding: gzip, deflate, br. I can ...
1
vote
1answer
172 views

Apache mod_deflate MIME type settings

CPanel gives me options about what MIME content types to compress with Apache's mod_deflate, as shown below. Are there disadvantages to having a long list of MIME types (eg. slower server response)? ...
0
votes
1answer
447 views

Can not run Brotli on my Nginx server

I installed Brotli on Ubuntu 18.04 with Nginx. Here is the procedure I followed : $ sudo apt-add-repository ppa:hda-me/nginx-stable $ sudo apt update $ sudo apt install brotli nginx nginx-module-...
3
votes
2answers
3k views

How to install Brotli on nginx and Ubuntu 18.04?

I installed Brotli on Ubuntu 18.04 with Nginx. Here is the procedure I followed : $ sudo apt-add-repository ppa:hda-me/nginx-stable $ sudo apt update $ sudo apt install brotli nginx nginx-module-...
4
votes
1answer
264 views

What kind of algorithm is used in LTO tape hardware compression?

LTO tape drives, from their very first generation, offer hardware compression that, theoretically, allows a maximum of 2 - 2.5x the rated data capacity of each cartridge to be stored, with only a ...
1
vote
1answer
42 views

How to enable IIS to always precompress / pregzip a certain file?

I have a 4mb js file (gzipped version is 900kb). The file is like this: main.328479fdsdf.js (so it has a hash based on the content). IIS seems to compress my big js file only if is accessed 2 times ...
0
votes
1answer
92 views

Use of gzip with multiple, sequential nginx proxies

Consider the following server setup on a network: In this example, both of the proxy servers are Nginx servers. If the aim is to reduce load time for the client, should compression be used by the ...
4
votes
2answers
215 views

Are LTO Hardware compression and encryption standardized?

I'm about to setup a backup using an LTO-4 Drive. I know that drives are meant to be compatible to any tape within the past 3 generations (so I should be able to read an LTO-4 tape using an LTO-4, 5 ...
1
vote
1answer
891 views

Modern transparent folder compression in Ubuntu 18.04

I'm looking for a way to transparently compress files in a directory, that will be shared over SMB. I have a server, running Ubuntu 18.04.1 LTS, and I use it for file storage. Mainly what I want to ...
1
vote
0answers
288 views

Why do i get gzip css and js with full size instead of compressed size

I am doing some tests with gzip, I have manually compressed the CSS and JS with gzip. The size of the JS has dropped from 33kb to 7kb. The problem is when I look in the network tab in Chrome or ...
-2
votes
1answer
182 views

openvpn optimizations for Low bandwidth (250mb a month)

I am using openwrt lede with a lte stick 250-300mb a month depending on the unit so preferably hitting 250 or lower would be better for the entire system these are the clients the server doesn't have ...
2
votes
1answer
90 views

Does ZFS, using default settings, use more physical space than ext4 for the same amount of data?

I'm currently considering a switch from ext4 to ZFS and am having trouble finding information about whether or not it uses more or less space to store the same amount of data as ext4. My understanding ...
-2
votes
1answer
701 views

tar -z is very slow [closed]

I know this question has been asked before and I saw the recommendations on using pigz. Good recommendations, but I wanted to see if I really have a "problem". I have an esxi host. It's the free ...
2
votes
1answer
2k views

ZFS does not compress files and all settings look correct

I recently created a ZFS volume to test its compression capabilities. I'm comparing it side by side to an ext4 volume. After creating the new volume and turning compression on with sudo zfs set ...
0
votes
2answers
160 views

Restoring svn backup (bzip2)

I have successfully made backup of my SVN repository as described here. However, how does one restores backed-up repository, i.e. initiate reverse operation of restoring backup, because after command: ...
3
votes
2answers
82 views

Compressing data when it is to be written on the disk

I have a server which is used for scientific computation, each user has a virtual machine (Linux or Windows) for their usage. the problem is reports generated by these computations take a huge amount ...
1
vote
1answer
205 views

zram filesystem reports different usage at device level to that reported by the filesystem

We have an 80GB zram device defined on our host, and within this a 170GB ext4 filesystem: echo 170G > /sys/block/zram0/disksize echo 80G > /sys/block/zram0/mem_limit /usr/sbin/mkfs.ext4 -...
0
votes
1answer
915 views

Mount on the fly compressed filesystem

I'm looking for solution for not enough disk space on our server to store backups. We have virtual server. When we dump data from database to disk it consumes lot of space. But it could be easily ...
0
votes
0answers
59 views

Postfix not adding email size flag with maildirs

Dovecot requires emails in maildirs to have ,S= -flag on emails to be compressed, but I cannot seem to find a way to make Postfix to add this flag. Is there some configuration option or is there other ...
1
vote
0answers
48 views

Can I delete SSOServer Logs? (VMware)

I have a client that has a large amount of log files within the SSOServer Logs folder. I want to compress/delete these files so that it makes room. Will this affect VMware? Most are text docs but some ...
1
vote
2answers
1k views

More accurate way to obtain ZFS filesystem size?

I've been having trouble backing up a ZFS filesytem due to my backup devices running out of space. The first time I forgot that compression was enabled. However, for the second attempt, I got the ...
0
votes
0answers
257 views

Data Compression

We have an HP StorageWorks 1/8 G2 Autoloader using LTO-6 tapes working with Symantec Backup Exec 15. I've set the backups which are going to tape to use hardware compresison "if available, otherwise ...
0
votes
1answer
558 views

Disable brotli compression for single nginx vhost

I have a handful of websites on a single server, setup using https://serverpilot.io/ It enables brotli compression for all sites by default but I would like to disable this on a single site that sits ...
1
vote
0answers
66 views

Send compressed requests with Apache

I have looked at simlar questions but they do not cover my scenario. Example: Is it possible to enable http compression for requests? Scenario: Server A is running a Service which generates large ...
0
votes
0answers
56 views

Streaming compression for large files

We want to compress large backup files and push them into the cloud. I'm looking for an application/utility/codebase that will allow us to efficiently compress on the fly as part of the transfer. I'...
0
votes
2answers
578 views

Apache Webserver: check if decompression is supported

With SetInputFilter DEFLATE I can force the apache to decompress incoming messages. Is there a way to ask the webserver whether it supports decompression of incoming requests. I would expect a ...
1
vote
1answer
2k views

How to read gitlab-workhorse logs?

I am running gitlab omnibus installation on local server. There are certain incidents which happened and would like to see the logs in gitlab-workhorse. The files in /var/log/gitlab/gitlab-workhorse ...
3
votes
1answer
834 views

How to get compression ratio of OpenVPN

With my botnet I crawled the entire internet but I didn't found anything. I'm running an OpenVPN server on Debian with LZ4-v2 compression enabled and about 5 Clients. Now I wonder where it is ...
0
votes
1answer
404 views

IIS Formal Brotli compression module

Is there any formal extension for IIS to support brotli compression? Previously I saw these two extension but I cannot rely on them for a production server: https://www.iis.net/downloads/community/...
4
votes
3answers
8k views

ssh can't set compression level to more, than 6

When I do (I've tried various ways): ssh -v -C -o CompressionLevel=9 user@ip ssh -v -C -o 'CompressionLevel=9' user@ip ssh -v -o 'Compression=yes' -o 'CompressionLevel=9' user@ip ssh -v -o '...
0
votes
1answer
492 views

how to check whether lzo is working in openvpn

I have compiled two binaries of openvpn (one with lzo enabled and other without), Now i want to know whether lzo compression is actually working or not, So I ping from my client to server, but now i ...
6
votes
1answer
4k views

NTFS Compression with Deduplication?

I have installed the Data Deduplication role on Windows Server 2016. Per Microsoft, it's using NTFS compression to help save space: Data deduplication stores more data in less physical space. It ...
1
vote
4answers
4k views

Enabling Brotli compression on IIS

My team us currently trying to install Brotli compression on a VPS: Windows Server 2012 R2 with IIS8.5 using the 64bit module that can be downloaded here: https://www.iispeed.com/pagespeed/products/...
12
votes
4answers
1k views

How to use the full LTO-2 Tape backup capacity of 200/400GB?

I have an Ultrium 448 tape drive, LTO-2 tapes (200/400GB) and I'm using HP Data Protector as the backup client. The system is set to format and overwrite all tapes but I never manage to get more that ~...
14
votes
2answers
12k views

rsync --compress-level: which compression levels can be used?

Rsync has command line arguments for compression: -z, --compress compress file data during the transfer --compress-level=NUM explicitly set compression level What does --compress-...
0
votes
1answer
240 views

IIS 7.5 dynamicCompressionLevel setting has no impact

I have a Web.API app with an action that is sending a 5MB json result (for reasons outside the scope of this question). Initially we weren't compressing json results for this server. I added to the ...
-4
votes
2answers
4k views

how to compress a files inside a shell script file?

I have seen a .sh file on execution in terminal it extracts some jar files inside the sh file, how to create such sh files? i could not open that sh file in normal gedit to check the content. Is ...
0
votes
0answers
575 views

Quickest way to get large number of small files from remote FTP server

In Fintech, the following scenario seems fairly common: You've paid for access to a huge collection of data, but it is made available to you as thousands of little files, each with a footprint in ...
0
votes
1answer
123 views

Fluentd elasticsearch comprssion

I forward logs from app servers with fluentd (type tail) to elasticsearch server. Do not understand the following: Can I enable for reducing traffic the compression transmitted logs with type tail ...
3
votes
2answers
1k views

Seeking inside file performance under BTRFS with LZO compression

I am planning to use btrfs on a 50 TB RAID6 array and I want to enable lzo compression. This is for bioinformatics setup where lots of seeking within large (1 TB -- 20 TB) files occur. (The software ...
0
votes
0answers
164 views

How do you git archive a branch using gzip with highest compression level?

I'm trying to git archive a branch using gzip with the highest level compression (9) but it seems to not compress at that level. Here is my command: git -C /home/user/example.com/ archive --format ...

1
2 3 4 5
8