Situation: 1. mysql is backuped to disk with mysqldump (~250 GB) 2. dump is compressed with bpzip2 3. dump is moved to another DC 4. disk usage again in good state
Problem: Filesystem usage peaks, example: I need 1 TB space to fit the data while dumping - i need to get rid of this (paying for unused disk space)
Tried to pipe dump directly to bpzip2 but it's slow (high compression needed), I want to avoid tables lock. Pipe buffer cannot be easily changed with bash (if it is possible) maybe in C, Python as i have read.
Question: Is there a way to handle that peaks? Any ideas will be appreciated.