File Compression and Archiving: Shrinking Your Data

In the world of Linux, we distinguish between two different actions: Archiving and Compression.

1. Archiving: Taking 1,000 small files and bundling them into one single file for easy transport. (Like putting clothes in a suitcase).
2. Compression: Taking that suitcase and Vacuum-sealing it to make it smaller.

In the Linux terminal, these are often done in two stages (though often by one command). This lesson will teach you how to master the "Tape Archive" (tar)—the most common way to distribute software and backups in the Unix world.

---

1. tar: The Tape Archive

tar is the standard tool for bundling files. It does NOT compress files by itself; it just stitches them together.

The "Mental Map" of Flags:

• c: Create an archive.
• x: eXtract an archive.
• v: Verbose (show files as they are processed).
• f: File (specify the name of the archive).

# Bundle the 'projects' folder into a single file
tar -cvf my_bundle.tar ./projects

---

2. gzip and Professionals: .tar.gz

To make a tar file smaller, we use gzip. This results in a file with the extension .tar.gz (or occasionally .tgz).

Creating a Compressed Archive:

We simply add the z flag to the tar command.

# Create a Gzipped Tape Archive (the industry standard)
tar -czvf backup_2026.tar.gz /var/www/html/

Extracting a Compressed Archive:

# Extract into the current directory
tar -xzvf bundle.tar.gz

# Extract into a specific directory (-C)
tar -xzvf bundle.tar.gz -C /opt/my_app

---

3. Zip: For the Windows World

zip is a more consumer-oriented tool. Unlike tar, it archives and compresses in one step. It is most useful when you need to send a file to a Windows or Mac user who might not have tar installed.

# Zip a folder
zip -r my_files.zip ./documents

# Unzip a folder
unzip my_files.zip

---

4. Comparing Algorithms: gzip vs. bzip2 vs. xz

As an engineer, you should know that there are newer, better algorithms than gzip.

Algorithm	Extension	Flag	Speed	Compression Ratio
gzip	.gz	-z	Very Fast	Good
bzip2	.bz2	-j	Slow	Better
xz	.xz	-J	Very Slow	Best

# Create an ultra-small XZ archive (common for kernel source code)
tar -cJvf linux_code.tar.xz ./source_code

---

5. Practical: Listing Contents Without Extracting

Never extract an archive just to see what's inside. You might accidentally overwrite important files. Use the t flag (List/Test).

tar -tvf unknown_bundle.tar.gz

---

6. Example: An Automated Backup Script (Python)

If you have a production database, you need an automated daily backup. This Python script creates a timestamped, Gzipped tarball of a directory.

import subprocess
import datetime
import os

def create_daily_backup(source_dir, backup_dest):
    """
    Creates a compressed tar archive of the source directory.
    """
    timestamp = datetime.datetime.now().strftime("%Y-%m-%d_%H%M")
    backup_name = f"backup_{timestamp}.tar.gz"
    full_path = os.path.join(backup_dest, backup_name)
    
    if not os.path.exists(source_dir):
        print(f"Error: Source {source_dir} not found.")
        return

    print(f"Starting backup of {source_dir}...")
    
    try:
        # We use tar directly for performance
        cmd = ["tar", "-czf", full_path, source_dir]
        subprocess.run(cmd, check=True)
        
        size = os.path.getsize(full_path) / (1024*1024)
        print(f"Success! Archive created at {full_path} ({size:.2f} MB)")
        return full_path
    except subprocess.CalledProcessError as e:
        print(f"Backup failed: {e}")
        return None

if __name__ == "__main__":
    # Test backup of a dummy folder
    os.makedirs("./backups", exist_ok=True)
    create_daily_backup("./content", "./backups")

---

7. The "Piping" Trick: tar Over the Network

Advanced users don't even create a file on the local disk. They pipe the tar data directly over SSH.

# Archive local files and extract them directly on a remote server
tar -czf - ./my_files | ssh user@remote_host "tar -xzf - -C /remote/path"

---

8. Summary

Archiving is about organization; compression is about size.

• Use tar to bundle files.
• Use tar -czf for the standard Gzipped archive.
• Use tar -tvf to see contents safely.
• Use zip primarily for cross-platform compatibility with Windows.

In the next module, we will move from files to PEOPLE as we learn about Users, Groups, and Permissions in depth.

Quiz Questions

1. What do the flags -xzvf stand for in a tar command?
2. How do you add a single file to an existing .tar archive?
3. Which compression algorithm (gz, bz2, or xz) should you use if disk space is more important than CPU speed?

---

End of Module 4. Proceed to Module 5: Users, Groups, and Permissions.