The Stack Overflow podcast is back! Listen to an interview with our new CEO.

Questions tagged [gzip]

Gzip is any of several software applications used for file compression and decompression. The term usually refers to the GNU Project's implementation, "gzip" standing for GNU zip. It is based on the DEFLATE algorithm, which is a combination of Lempel-Ziv (LZ77) and Huffman coding.

Filter by
Sorted by
Tagged with
151
votes
8answers
239k views

How do I load a sql.gz file to my database? (importing)

I'm trying to import a gzipped SQL file into mysql directly. Is this the right way? mysql -uroot -ppassword mydb > myfile.sql.gz
88
votes
9answers
132k views

mysqldump to a tar.gz

Usually after dumping a MySQL database with mysqldump command I immediately tar/gzip the resultant file. I'm looking for a way to do this in one command: So from this: mysqldump dbname -u root -p &...
44
votes
4answers
52k views

What is the best nginx compression gzip level?

I'm using nginx reverse proxy cache with gzip enabled. However, I got some problems from Android applications HTTP-requests to my Rails JSON web service. It seems when I turn off reverse proxy cache, ...
40
votes
3answers
44k views

Fastest way to extract tar.gz

Is there anyway to extract a tar.gz file faster than tar -zxvf filenamehere? We have large files, and trying to optimize the operation.
30
votes
5answers
9k views

bzip2 too slow. Multiple cores are avaible

I am running this command: pg_dumpall | bzip2 > cluster-$(date --iso).sql.bz2 It takes too long. I look at the processes with top. The bzip2 process takes about 95% and postgres 5% of one core. ...
22
votes
3answers
54k views

How to enable either Gzip or Deflate compression via .htaccess?

How to enable either Gzip or Deflate compression via .htaccess and which one is best these days? Code examples needed.
18
votes
1answer
16k views

How to limit nginx access log file size and compress?

I'm hoping to get some direction on how to set up truncating and gzip'ing on my domains' access logs. I notice that the core nginx access logs get split and compressed by default, yet my individual ...
17
votes
3answers
33k views

How to zip files with a size limit?

I have a script that zip files from a folder. I want to make sure that the zipped file is not more than 10 MB. If the size is more than 10MB, it should create another ZIP file. Is there any command (...
17
votes
3answers
8k views

How do I configure nginx to accept gzip requests?

I know that you can use nginx HttpGzipModule to gzip responses. Can you als use it to enable nginx to handle gzip-compressed requests, i.e. ones with the request header: Content-Encoding: gzip ? Note:...
16
votes
3answers
12k views

How to list content from a tar file without recursion?

I've a tar (gz, bzip) file and want to see its content, but not recursively. This is: The "first level" in the file. I already know how to see content: tar -ztf file.tar.gz But it's recursive!! ...
16
votes
1answer
10k views

How do I serve pre-gzipped files with nginx so that they'll be shown as text in the browser?

I have a bunch of gzipped log files I'd like to serve with nginx. I want them to be served in such a way that they're automatically inflated by the browser. I assume that means I need nginx to send ...
15
votes
3answers
29k views

Linux gzip multiple subdirectories into separate archives?

How would I be able to compress subdirectories into separate archives? Example: directory subdir1 subdir2 Should create subdir1(.tar).gz and subdir2(.tar).gz
14
votes
5answers
8k views

Grepping through .gz log files

Does there exist a magical shell piping which would allow easily to grep through bunch of .gz log files without needing to extract them somewhere? .gz files are Apache logs, result of log rotation. I'...
13
votes
1answer
11k views

How to use IIS URL Rewrite with gzip compression

I've been trying to create outbound rules in IIS 7.5 on Windows 2008 R2 on a site that has static HTML pages and compression enabled. If I have any form of compression enabled (static or dynamic) I ...
12
votes
3answers
12k views

How to split a file and compress directly?

I've a 100GB file and I want to split into 100 of 1GB file each (by line break) e.g. split --bytes=1024M /path/to/input /path/to/output For the 100 files generated, I want to apply gzip/zip to each ...
12
votes
3answers
29k views

Content-Length not sent when gzip compression enabled in Apache?

I would really appreciate some help understanding this Apache behaviour. I am communicating to PHP from an iPhone Objective-C app in application/json. Gzip compression is enabled on the server, and ...
11
votes
4answers
13k views

rsync to compressed archive of file

I take backups of a server with rsync, but those backups are quite large, and I'd like to compress them. Is there a way to have some sort of wrapper around rsync to gunzip the file in the backup, ...
11
votes
1answer
3k views

Why isn't the Nginx Gzip Precompression module working?

I'm currently trying to set up Nginx to serve all of my static files. Since they will not be changed very frequently at all I want to us the gzip_static module to allow me to pre-gzip copies of my ...
10
votes
3answers
1k views

I accidently zipped my whole server

Alright if anyone wants to play god and work miracles i'm down. So, i was given the task of making a script that found files that are older than 6 months, zipped them and then deleted them. On my way ...
10
votes
4answers
1k views

How do I most efficiently store and serve 1,000,000+ small gziped files on a Linux web server?

I have large static content that I have to deliver via a Linux-based webserver. It is a set of over one million small, gzip files. 90% of the files are less than 1K and the remaining files are at most ...
9
votes
3answers
29k views

How to use GZip to create a .zip file

Is it possible to use GZip to create a .zip file? I've been Googling and can't find anything that leads me to believe this is possible
9
votes
3answers
18k views

How do I turn on gzip in Apache2?

I simply did : sudo aptitude install apache2 And that's how my server is set up. No extra modules, no nothing. I'm on ubuntu jaunty.
9
votes
2answers
18k views

How can I enable GZIP compression in Jetty?

I have a Jetty server which does not have compression enabled (I tested this here). How can I enable compression?
9
votes
3answers
12k views

Need help with some IIS7 web.config compression settings

I'm trying to configure my IIS7 compression settings in my web.config file. I'm trying to enable HTTP 1.0 requests to be gzip. MSDN has all the info about it here. Is it possible to have this config ...
8
votes
5answers
718 views

Grep-ing gzipped files [duplicate]

I have a set of 100 log files, compressed using gzip. I need to find all lines matching a given expression. I'd use grep, but of course, that's a bit of a nightmare because I'll have to unzip all ...
8
votes
2answers
2k views

Apache: Send pre-packed gzip'ed files

I want Apache to send static files gzip'ed over the wire, but also want Apache to not always gzip them over and over again. So I thought if it wouldn't be possible to deliver an .gz file if it exists. ...
8
votes
2answers
10k views

Why Apache doesn’t gzip css or js files which have parameters?

Some CSS & JS files are not compressed by apache with mod_deflate enabled. This files looks like this "[domain.name]/aggregator.css?..." or "[domain.name]/misc/jquery.js?..." in YSlow. The other ...
8
votes
3answers
7k views

IIS 7.5 ignoring HttpCompression settings in web.config

I'm trying to enable dynamic compression for the mime type application/json. In applicationHost.config, I've made the following change: <section name="httpCompression" allowDefinition="...
7
votes
5answers
11k views

How to gzip logs created by rotatelogs

I'm using rotatelogs to create my daily apache logs in format host.<day>.<month>.<year>.access.log. Now I want to gzip and move log to different directory after it's been finished. ...
7
votes
6answers
8k views

Does gunzip work in memory or does it write to disk?

We have our log files gzipped to save space. Normally we keep them compressed and just do gunzip -c file.gz | grep 'test' to find important information but we're wondering if it's quicker to keep ...
7
votes
1answer
661 views

Apache deflates .xml.gz files

I noticed an error in google webmaster tools regarding a gzipped version of a sitemap. Turns out the sitemap.xml.gz file is gzipped twice: one upon creation (as it should be) and another time when ...
6
votes
6answers
11k views

Break up a dd image into multiple files

I'm doing some data recovery from a hard disk. The disk has about 300GB of data on it, but I lack another hard drive that has 300GB of free space. I have three HDs, with 150, 40, and 120 GB free. ...
6
votes
4answers
22k views

How to tell if mod_deflate is actually working?

I have put the following in my http.conf file: # mod_deflate configuration <IfModule mod_deflate.c> # Restrict compression to these MIME types AddOutputFilterByType DEFLATE text/plain ...
6
votes
1answer
837 views

How does a web server/the http protocol handle version control and compression?

When a client browser requests a file from the web server, I know that some kind of check is performed, because the files needed to serve the web page may already be cached by the web browser. So, if ...
6
votes
1answer
8k views

Verify if the files can be unzipped successfully from 7Zip archive

We want to 7zip many database files (mysql, Oracle, and SQL Server dumps), various standard files (excel, word, etc), but we are afraid that once we 7Zip them and delete the originals it can happen ...
6
votes
2answers
2k views

nginx gzip Vary header together with existing Vary headers

I'm trying to active gzip compression and I have set the option gzip_vary on; to include the Vary: Accept-Encoding header. The problem is, my application is already seting a Vary: header. So the ...
6
votes
1answer
3k views

Does Nginx compress files for every request? (with gzip_on)

this is my very first question and please excuse my poor English. I was doing research about how can i improve my page speed and i found out about nginx gzip settings. Below are my gzip settings ...
6
votes
2answers
349 views

Error with gunzip during logrotate

I'm using logrotate to rotate my Symfony2 logs on my webserver. Everything works fine, but I wanted the old logs to be sent to me by emails. So, I added some line in my logrotate conf file as you can ...
5
votes
5answers
5k views

Enabling gzip compression in IIS and having it take effect

We've enabled Gzip compression on the server in IIS (IIS6). We've run iisreset. It just doesn't want to take effect. We had this before on another server, and after a little while, it just started ...
5
votes
4answers
8k views

How to manually extract a backup set made by duplicity?

I have a set of files on my webserver produced by duplicity software: duplicity-full.20110315T085334Z.vol1.difftar.gz duplicity-full.20110315T085334Z.vol2.difftar.gz duplicity-full.20110315T085334Z....
5
votes
3answers
7k views

Faster zlib alternatives [closed]

I wonder, if there are any faster builds of zlib around with more advanced optimizations? If it's possible to optimize it using SSE instructions or Intel C++ compiller, or some trick which were ...
5
votes
1answer
6k views

Howto: create file with current date and time on linux

I have a cron job for creating a gzip file: mysqldump... | gzip -c > myfile..sql.gz I want myfile to be of the format "time_date.sql.gz" How do I create file with the current date and time? ...
5
votes
1answer
9k views

Forcing Nginx to send Content-Length headers when serving static files with gzip

We're running Nginx 0.7.65[-1ubuntu2.3]. I've just noticed that when serving local static files using an alias directive and gzip on, the Content-Length header is not getting sent. Since it's serving ...
5
votes
2answers
6k views

How can I troubleshoot why my IIS7 site is not gzip compressing?

I've got a number of websites on a single IIS7 machine running W2K8. I'm using Fiddler to help me figure out if something is compressed or not. Nothing is. So, I've googled for a few things and ...
5
votes
3answers
2k views

Incorrect gzipping of http requests, can't find who's doing it

We're seeing some very strange mangling of HTTP responses, and we can't figure out what is doing it. We have an app server handling JSON requests. Occasionally, the response is returned gzipped, but ...
5
votes
2answers
3k views

Why is IIS7 not compressing my static files?

I am trying to get IIS to compress jquery.js (and all other static files, but using jquery as the example here) on my localhost, but something goes wrong. The funny part is that when I look in my %...
5
votes
4answers
11k views

how to enable iis 7 dynamic content compression?

I've turned on dynamic content compression in IIS 7, but Fiddler is showing that my dynamic pages are still being served without content-encoding: gzip. Static content compression is working fine on ...
5
votes
0answers
753 views

Creating a seperate static content site for IIS7 and MVC

With reference to this serverfault blog post: A Few Speed Improvements where it talks about how static content for stackexchange is served from a separate cookieless domain... How would someone go ...
4
votes
3answers
10k views

nginx gzip_static: why are the non-compressed files required?

I'm working with nginx 1.4.4 running on Ubuntu 12.04.4. nginx is reverse-proxing a cluster of Rails application servers. Static files (mostly assets) are served directly, without hitting the ...
4
votes
2answers
6k views

How to zip the standard output of a process?

I have a process that is producing a big amount of log to the standard output in a short period of time. Is there a way to zip the standard output of my process to a file. I am searching for ...