Christian Krakau-Louis 4c11cfd6dd feat(deduplication): implement configurable duplicate file detection ...

- Add enable_deduplication and show_deduplication_step config options
- Rename hash_file step to check_for_duplicates
- Make deduplication step conditional based on configuration
- Add is_duplicate and duplicate_of_id fields to FileRecord model
- Create database migration for new deduplication fields
- Update process_document task to log deduplication results
- Update step visualization to show/hide step based on config
- Update status calculations to include deduplication step conditionally
- Default: deduplication enabled, step displayed
- Can be configured to hide from UI while still processing

2026-02-12 02:38:00 +01:00

..

001_file_processing_steps.py

feat: Add explicit FileProcessingStep table for status tracking

2026-02-11 19:45:09 +00:00

002_add_file_paths.py

feat(storage): implement immutable original/processed file storage and collision handling

2026-02-11 20:10:19 +00:00

003_add_deduplication_support.py

feat(deduplication): implement configurable duplicate file detection

2026-02-12 02:38:00 +01:00