2 Commits

Author	SHA1	Message	Date
copilot-swe-agent[bot]	8e955f3c81	fix(similarity): truncate text to fit embedding model context window, fix step tracking ... - Add EMBEDDING_MAX_TOKENS config (default 8000) for safe text truncation - Use conservative 3 chars/token estimate (was 4) to prevent ContextWindowExceededError - Add compute_embedding to REAL_MAIN_STEPS in both get_file_overall_status and get_step_summary - Fix test_near_duplicates_returned to use pre-computed embeddings - Update .env.demo and docs with EMBEDDING_MAX_TOKENS setting Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>	2026-03-02 13:27:34 +00:00
copilot-swe-agent[bot]	ebea83a750	feat(duplicates): add duplicate document detection and management ... - Add near_duplicate_threshold config setting (default 0.85) - New GET /api/duplicates endpoint listing all exact-duplicate groups - New GET /api/files/{id}/duplicates endpoint returning exact + near-duplicates - POST /api/ui-upload now returns immediate exact-duplicate warning (respects ENABLE_DEDUPLICATION) - New /duplicates management UI with Exact Duplicates tab and Near-Duplicate Finder tab - Add Duplicates link in admin nav menu (desktop + mobile) - Document new config options in ConfigurationGuide.md and .env.demo - 20 new tests covering all acceptance criteria Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>	2026-03-02 10:21:57 +00:00