Multi-File Python Algorithm

This project is a multi-file Python example that scans a directory tree and finds duplicate files.

Features

• Recursively scans all files under a root directory
• Uses file size as a fast pre-filter
• Hashes only files with matching sizes via SHA-256
• Groups files whose contents are exactly the same
• Supports filtering by file extension
• Supports skipping small files with --min-size

Usage

python -m multi_file_algorithm .

Scan a specific directory:

python -m multi_file_algorithm "C:\example\folder"

Scan only text files:

python -m multi_file_algorithm sample_data --ext .txt

Skip tiny files:

python -m multi_file_algorithm sample_data --min-size 10

Include hidden test files:

python -m multi_file_algorithm sample_data --include-hidden

The repository already includes a sample_data folder with duplicate and unique files for quick testing.