Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [compression]

Decrease the size of data, typically to preserve space or reduce network bandwidth required while transmitting files. It can be applied to files, folders, disks, etc.

0
votes
0answers
4 views

URL Rewrite with Compression Fails with Error 500.52

In my environment I have an IIS server that does the reverse proxy function by rewriting the URL for internal servers using IIS's own Rewrite URL module. There has now been a need to implement ...
0
votes
0answers
27 views

compression of comma v/s pipe separated files

Comma separated data files takes almost same or slightly more disk space than pipe separated data. But once compressed using gzip the comma separated files are much smaller than pipe separated files. ...
0
votes
1answer
52 views

Modern transparent folder compression in Ubuntu 18.04

I'm looking for a way to transparently compress files in a directory, that will be shared over SMB. I have a server, running Ubuntu 18.04.1 LTS, and I use it for file storage. Mainly what I want to ...
0
votes
0answers
28 views

Deflate module not working in Alpine Apache

I am trying to enable mod_deflate in apache (v2.4.27) within Alpine based docker container. I have enabled the module as following, LoadModule deflate_module modules/mod_deflate.so and added the ...
1
vote
0answers
150 views

Why do i get gzip css and js with full size instead of compressed size

I am doing some tests with gzip, I have manually compressed the CSS and JS with gzip. The size of the JS has dropped from 33kb to 7kb. The problem is when I look in the network tab in Chrome or ...
-2
votes
1answer
59 views

openvpn optimizations for Low bandwidth (250mb a month)

I am using openwrt lede with a lte stick 250-300mb a month depending on the unit so preferably hitting 250 or lower would be better for the entire system these are the clients the server doesn't have ...
2
votes
1answer
55 views

Does ZFS, using default settings, use more physical space than ext4 for the same amount of data?

I'm currently considering a switch from ext4 to ZFS and am having trouble finding information about whether or not it uses more or less space to store the same amount of data as ext4. My understanding ...
-3
votes
1answer
161 views

tar -z is very slow [closed]

I know this question has been asked before and I saw the recommendations on using pigz. Good recommendations, but I wanted to see if I really have a "problem". I have an esxi host. It's the free ...
1
vote
1answer
2k views

ZFS does not compress files and all settings look correct

I recently created a ZFS volume to test its compression capabilities. I'm comparing it side by side to an ext4 volume. After creating the new volume and turning compression on with sudo zfs set ...
0
votes
0answers
11 views

Serving static html pages from ntfs compressed folder using IIS

Does windows server perform well serving static html files from a ntfs compressed folder? The html files are not updated frequently so its mostly reads against the files. There is a need to reduce ...
0
votes
2answers
60 views

Restoring svn backup (bzip2)

I have successfully made backup of my SVN repository as described here. However, how does one restores backed-up repository, i.e. initiate reverse operation of restoring backup, because after command: ...
3
votes
2answers
78 views

Compressing data when it is to be written on the disk

I have a server which is used for scientific computation, each user has a virtual machine (Linux or Windows) for their usage. the problem is reports generated by these computations take a huge amount ...
1
vote
1answer
83 views

zram filesystem reports different usage at device level to that reported by the filesystem

We have an 80GB zram device defined on our host, and within this a 170GB ext4 filesystem: echo 170G > /sys/block/zram0/disksize echo 80G > /sys/block/zram0/mem_limit /usr/sbin/mkfs.ext4 -...
0
votes
1answer
430 views

Mount on the fly compressed filesystem

I'm looking for solution for not enough disk space on our server to store backups. We have virtual server. When we dump data from database to disk it consumes lot of space. But it could be easily ...
0
votes
0answers
35 views

Postfix not adding email size flag with maildirs

Dovecot requires emails in maildirs to have ,S= -flag on emails to be compressed, but I cannot seem to find a way to make Postfix to add this flag. Is there some configuration option or is there other ...
1
vote
0answers
22 views

Can I delete SSOServer Logs? (VMware)

I have a client that has a large amount of log files within the SSOServer Logs folder. I want to compress/delete these files so that it makes room. Will this affect VMware? Most are text docs but some ...
1
vote
2answers
352 views

More accurate way to obtain ZFS filesystem size?

I've been having trouble backing up a ZFS filesytem due to my backup devices running out of space. The first time I forgot that compression was enabled. However, for the second attempt, I got the ...
0
votes
0answers
123 views

Data Compression

We have an HP StorageWorks 1/8 G2 Autoloader using LTO-6 tapes working with Symantec Backup Exec 15. I've set the backups which are going to tape to use hardware compresison "if available, otherwise ...
0
votes
1answer
289 views

Disable brotli compression for single nginx vhost

I have a handful of websites on a single server, setup using https://serverpilot.io/ It enables brotli compression for all sites by default but I would like to disable this on a single site that sits ...
1
vote
0answers
45 views

Send compressed requests with Apache

I have looked at simlar questions but they do not cover my scenario. Example: Is it possible to enable http compression for requests? Scenario: Server A is running a Service which generates large ...
0
votes
0answers
47 views

Streaming compression for large files

We want to compress large backup files and push them into the cloud. I'm looking for an application/utility/codebase that will allow us to efficiently compress on the fly as part of the transfer. I'...
0
votes
2answers
275 views

Apache Webserver: check if decompression is supported

With SetInputFilter DEFLATE I can force the apache to decompress incoming messages. Is there a way to ask the webserver whether it supports decompression of incoming requests. I would expect a ...
1
vote
1answer
1k views

How to read gitlab-workhorse logs?

I am running gitlab omnibus installation on local server. There are certain incidents which happened and would like to see the logs in gitlab-workhorse. The files in /var/log/gitlab/gitlab-workhorse ...
3
votes
1answer
635 views

How to get compression ratio of OpenVPN

With my botnet I crawled the entire internet but I didn't found anything. I'm running an OpenVPN server on Debian with LZ4-v2 compression enabled and about 5 Clients. Now I wonder where it is ...
0
votes
1answer
265 views

IIS Formal Brotli compression module

Is there any formal extension for IIS to support brotli compression? Previously I saw these two extension but I cannot rely on them for a production server: https://www.iis.net/downloads/community/...
1
vote
3answers
4k views

ssh can't set compression level to more, than 6

When I do (I've tried various ways): ssh -v -C -o CompressionLevel=9 user@ip ssh -v -C -o 'CompressionLevel=9' user@ip ssh -v -o 'Compression=yes' -o 'CompressionLevel=9' user@ip ssh -v -o '...
0
votes
1answer
392 views

how to check whether lzo is working in openvpn

I have compiled two binaries of openvpn (one with lzo enabled and other without), Now i want to know whether lzo compression is actually working or not, So I ping from my client to server, but now i ...
5
votes
1answer
2k views

NTFS Compression with Deduplication?

I have installed the Data Deduplication role on Windows Server 2016. Per Microsoft, it's using NTFS compression to help save space: Data deduplication stores more data in less physical space. It ...
0
votes
3answers
1k views

Enabling Brotli compression on IIS

My team us currently trying to install Brotli compression on a VPS: Windows Server 2012 R2 with IIS8.5 using the 64bit module that can be downloaded here: https://www.iispeed.com/pagespeed/products/...
7
votes
1answer
6k views

rsync --compress-level: which compression levels can be used?

Rsync has command line arguments for compression: -z, --compress compress file data during the transfer --compress-level=NUM explicitly set compression level What does --compress-...
0
votes
1answer
134 views

IIS 7.5 dynamicCompressionLevel setting has no impact

I have a Web.API app with an action that is sending a 5MB json result (for reasons outside the scope of this question). Initially we weren't compressing json results for this server. I added to the ...
-4
votes
2answers
2k views

how to compress a files inside a shell script file?

I have seen a .sh file on execution in terminal it extracts some jar files inside the sh file, how to create such sh files? i could not open that sh file in normal gedit to check the content. Is ...
0
votes
0answers
284 views

Quickest way to get large number of small files from remote FTP server

In Fintech, the following scenario seems fairly common: You've paid for access to a huge collection of data, but it is made available to you as thousands of little files, each with a footprint in ...
0
votes
1answer
91 views

Fluentd elasticsearch comprssion

I forward logs from app servers with fluentd (type tail) to elasticsearch server. Do not understand the following: Can I enable for reducing traffic the compression transmitted logs with type tail ...
3
votes
2answers
928 views

Seeking inside file performance under BTRFS with LZO compression

I am planning to use btrfs on a 50 TB RAID6 array and I want to enable lzo compression. This is for bioinformatics setup where lots of seeking within large (1 TB -- 20 TB) files occur. (The software ...
0
votes
0answers
114 views

How do you git archive a branch using gzip with highest compression level?

I'm trying to git archive a branch using gzip with the highest level compression (9) but it seems to not compress at that level. Here is my command: git -C /home/user/example.com/ archive --format ...
1
vote
1answer
46 views

Are there any tipping points when compressing contents of web server responses might not be the right choice?

I'm running an API Proxy server and want to compress the (uncompressed) response contents I get from the API endpoints in order to send them faster to the client that initiated the request. However, ...
3
votes
2answers
484 views

ZFS: very big files + compression + snapshots

I backup several virtual disks (total = around 4 Tb), with several weeks of retention time. I use 4 x 4 Tb disks in the computer dedicated to primary backup. The filesystem is ZFS RAIDZ2, so 8 Tb ...
1
vote
1answer
696 views

Tomcat/https: I can see compression is enabled, but file sizes are the same as without compression

I have enabled compression on Tomcat running on my machine. The https response header is showing compression is enabled, but the same amount of data is being transferred with and without compression ...
-2
votes
1answer
66 views

What are the downsides of http compression?

I always was aware that http supports gzip compression, but never cared about it. I counted on that the servers and shared hosts I use would have activated it by default (I'm more of a frontend ...
1
vote
1answer
98 views

How to prevent compression of images served via HTTP

I have an already optimized JPEG image in my server 32.07 kB (and in my local computer), 800px * 534px, if I request it via browser, it keeps the same width * height, but its size gets smaller 17,97 ...
4
votes
6answers
9k views

Can't send to compressed (zipped) folder

I'm IT Technician at a Secondary School and our Network Manager is away on long term leave. Currently our student's aren't able to send to - compressed folder. When trying the error 'File not found ...
1
vote
2answers
62 views

Copying between lzo compressed BtrFS's: de/re-compressing?

I'm copying a large number of files between two lzo compressed BtrFS filesystems on different drives mounted on the same machine. It appears that the files are being de/re-compressed. Is there a way ...
1
vote
3answers
701 views

Lightweight transparent compression filesystem?

I have an AMD64 KVM VPS at RamNode, it has 30 GB disk, 256 MB RAM, and 1 "virtual CPU" (I have no idea of the specs of the host CPU). It will be used to store many small, easily compressed files, ...
2
votes
0answers
87 views

How to enable static GZip compression for versioned “/style.css?v=1” resourcess in IIS?

Google PageSpeed reports that files like .css and .js are compressed, but .css?v=1 and .js?v=1 are not. How to enable static compression for files that have a dynamically changing version number in ...
0
votes
1answer
478 views

mod_deflate and Pagespeed

I´ve activated mod_deflate on my server. The problem is that Google pagespeed says that my site needs a compression. Have anybody an idea? This code is in the /etc/apache2/apache2.conf. I restartet ...
2
votes
3answers
5k views

Unzip from stdin to stdout - funzip, python

The goal is to read a zip file from stdin and uncompress to stdout. Funzip works and is the solution I am looking for, the zip contains a single file, unfortunately funzip fails when the compressed ...
1
vote
0answers
145 views

Hyper-V avhd files compressed

I have inherited a machine at a client site that the previous IT person thought it would be a bright idea to compress all the AVHD and the base VHD files for one of their servers running under hyper-v ...
5
votes
1answer
24k views

How do you create a qcow2 file that is small yet commodious on a Linux server?

I believe that there are qcow2 files that displace a small amount of gigabytes on a server (as verified with a df -h on the physical server) yet allow for lots of space when you log into the virt-...
3
votes
7answers
12k views

How to “really” reduce the size of KVM VMs images?

I've spent many hours searching the web about how to shrink KVM virtual disk images, especially for Windows guests, with no luck. All I've found is to zeroize the VM free space, defrag the virtual ...