Comma separated data files takes almost same or slightly more disk space than pipe separated data. But once compressed using gzip the comma separated files are much smaller than pipe separated files.

-rw-r--r-- 1 root root 164M Nov 19 05:33 comma.csv
-rw-r--r-- 1 root root 138M Nov 19 05:33 pipe.csv
-rw-r--r-- 1 root root 8.8M Nov 19 05:32 comma.csv.gz
-rw-r--r-- 1 root root  15M Nov 19 05:32 pipe.csv.gz

Can I say that gzip is optimized better when it comes to csv (compared to pipe separated files)?

  • 2
    How can comma and pipe.csv contain the same data if their size of different. Both comma and pipe take 1 byte? You just have 2 different data sets. Try the same data by search replacing coma with pipe and compress them. I expect the same result – jdog Nov 19 '18 at 7:16

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.