Duplicate File Handler

This repository contains two bash scripts for handling duplicate files in a directory and its subdirectories.

Author

Kevin Veen-Birkenbach

• Email: kevin@veen.world
• Website: https://www.veen.world

This repository was created with the help of OpenAI's ChatGPT (Link to the conversation).

Usage

1. List Duplicate Files

list_duplicates.sh is a script to list all duplicate files in a specified directory and its subdirectories. For text files, it will also display the diffs.

./list_duplicates.sh /path/to/directory

2. Delete Duplicate Files

delete_duplicates.sh is a script to find and delete duplicate files in a specified directory and its subdirectories. It will ask for confirmation before deleting each file and display the paths of its duplicates.

./delete_duplicates.sh /path/to/directory

License

This project is licensed under the terms of the GNU Affero General Public License v3.0.

These scripts will help you manage duplicate files in your directories. Please make sure to adjust permissions on the scripts to be executable with chmod +x list_duplicates.sh delete_duplicates.sh before running.

The scripts may need to be modified depending on the specific requirements of your system or the specific use case. They currently operate by comparing the MD5 hash of files to find duplicates, which is a common but not foolproof method.

Please be aware that these scripts are provided as is, without warranty of any kind, express or implied, including but not limited to the warranties of merchantability, fitness for a particular purpose and non-infringement. In no event shall the authors or copyright holders be liable for any claim, damages or other liability, whether in an action of contract, tort or otherwise, arising from, out of or in connection with the scripts or the use or other dealings in the scripts.