copilot-swe-agent[bot] 8e955f3c81 fix(similarity): truncate text to fit embedding model context window, fix step tracking ...

- Add EMBEDDING_MAX_TOKENS config (default 8000) for safe text truncation
- Use conservative 3 chars/token estimate (was 4) to prevent ContextWindowExceededError
- Add compute_embedding to REAL_MAIN_STEPS in both get_file_overall_status and get_step_summary
- Fix test_near_duplicates_returned to use pre-computed embeddings
- Update .env.demo and docs with EMBEDDING_MAX_TOKENS setting

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>

2026-03-02 13:27:34 +00:00

..

config_validator

feat(imap): add IMAP_READONLY_MODE feature flag to safeguard shared mailboxes

2026-03-01 14:28:51 +00:00

__init__.py

feat(storage): implement immutable original/processed file storage and collision handling

2026-02-11 20:10:19 +00:00

ai_provider.py

feat(ai): handle temperature incompatibility for gpt-5 and o-series models, add model picker UI

2026-02-23 22:12:08 +00:00

allowed_types.py

feat(upload): adaptive 429 backoff, full Gotenberg file types, directory traversal

2026-02-26 23:24:26 +00:00

cache.py

fix: add type: ignore for redis.scan() mypy false positive in cache.py

2026-03-01 15:22:50 +00:00

config_loader.py

fix(config): decrypt sensitive settings when loading from database

2026-02-23 12:54:34 +00:00

encryption.py

feat: add strict mypy type-checking for app/utils/ module

2026-02-14 00:27:52 +00:00

file_operations.py

feat: add strict mypy type-checking for app/utils/ module

2026-02-14 00:27:52 +00:00

file_queries.py

fix(status): prevent false Completed status when mandatory pipeline steps have not run

2026-02-27 00:51:14 +00:00

file_splitting.py

refactor: consolidate linting tools into Ruff

2026-02-13 09:10:52 +00:00

file_status.py

perf(db): add indexes on query-hot columns and Redis caching layer

2026-03-01 14:38:28 +00:00

filename_utils.py

feat: add strict mypy type-checking for app/utils/ module

2026-02-14 00:27:52 +00:00

input_validation.py

fix(api): return 200 with value=None for unknown setting keys in GET endpoint

2026-02-22 20:04:57 +00:00

logging.py

fix: include exc_info in log_task_progress debug message

2026-02-17 11:41:56 +00:00

meilisearch_client.py

feat(search): add content-finding filters, saved searches, and text quality to Search view

2026-03-01 13:46:15 +00:00

migrate_logs_to_steps.py

refactor: consolidate linting tools into Ruff

2026-02-13 09:10:52 +00:00

notification.py

style: fix all flake8 linter errors across app/ directory

2026-02-08 17:42:33 +00:00

oauth_helper.py

style: fix all flake8 linter errors across app/ directory

2026-02-08 17:42:33 +00:00

ocr_language_manager.py

fix(ocr): ensure Tesseract language data for embed_text_layer regardless of active OCR provider

2026-02-24 18:02:19 +00:00

ocr_provider.py

fix(ocr): ensure Tesseract language data for embed_text_layer regardless of active OCR provider

2026-02-24 18:02:19 +00:00

settings_service.py

feat(imap): add IMAP_READONLY_MODE feature flag to safeguard shared mailboxes

2026-03-01 14:28:51 +00:00

settings_sync.py

feat(ocr): auto-install Tesseract/EasyOCR languages from settings

2026-02-24 16:28:14 +00:00

setup_wizard.py

feat: update all OpenAI/ChatGPT refs + settings dropdown for fixed-value fields

2026-02-23 20:06:57 +00:00

similarity.py

fix(similarity): truncate text to fit embedding model context window, fix step tracking

2026-03-02 13:27:34 +00:00

step_manager.py

fix(similarity): truncate text to fit embedding model context window, fix step tracking

2026-03-02 13:27:34 +00:00

step_timeout.py

fix: apply Phase 1-2 correctness and constant extraction from PR #273

2026-02-13 11:25:30 +00:00

text_quality.py

feat(ocr): fine-tune OCR quality criteria with stricter threshold and head-to-head comparison

2026-02-25 13:03:21 +00:00

webhook.py

feat(webhooks): add webhook support for external integrations

2026-03-01 20:42:57 +00:00