copilot-swe-agent[bot] 8d7c8e7c4e feat(similarity): add embedding pipeline, debug endpoints, backfill task, and scalable similarity search ...

- Add embedding_model config setting (replaces hardcoded text-embedding-3-small)
- Add compute_document_embedding Celery task for ingestion-time embedding
- Chain embedding task into finalize_document_storage pipeline
- Add backfill_missing_embeddings periodic task (every 5 min) for legacy files
- Add debug API endpoints: embedding-status, compute-embedding, diagnostic/embeddings, diagnostic/compute-all-embeddings
- Refactor find_similar_documents to only use pre-computed embeddings (no lazy API calls)
- Use yield_per(500) and column-only queries for 100K+ scale
- Add embedding status indicator and recompute button in file detail UI

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>

2026-03-02 13:01:57 +00:00

..

__init__.py

feat(duplicates): add duplicate document detection and management

2026-03-02 10:21:57 +00:00

azure.py

style: fix all flake8 linter errors across app/ directory

2026-02-08 17:42:33 +00:00

common.py

refactor: consolidate get_db into single module

2026-02-09 15:37:23 +00:00

diagnostic.py

feat(api): add GET /api/diagnostic/health endpoint for monitoring

2026-03-01 18:36:38 +00:00

dropbox.py

style: apply ruff auto-fix

2026-02-23 09:33:48 +00:00

duplicates.py

feat(duplicates): add duplicate document detection and management

2026-03-02 10:21:57 +00:00

files.py

feat(duplicates): add duplicate document detection and management

2026-03-02 10:21:57 +00:00

google_drive.py

style: apply ruff auto-fix

2026-02-23 09:33:48 +00:00

logs.py

feat(security): add comprehensive input validation and sanitization (#172)

2026-02-22 16:02:00 +00:00

onedrive.py

style: apply ruff auto-fix

2026-02-23 09:33:48 +00:00

openai.py

fix(api): swap parameter order in test_ai_extraction to fix 500 error

2026-02-23 21:35:36 +00:00

process.py

Apply Black and isort formatting to modified files

2026-02-07 15:00:18 +00:00

queue.py

refactor(queue): address code review feedback — extract constants and sync refresh interval

2026-02-27 00:47:58 +00:00

saved_searches.py

feat(search): add content-finding filters, saved searches, and text quality to Search view

2026-03-01 13:46:15 +00:00

search.py

feat(search): add content-finding filters, saved searches, and text quality to Search view

2026-03-01 13:46:15 +00:00

settings.py

feat(ocr): auto-install Tesseract/EasyOCR languages from settings

2026-02-24 16:28:14 +00:00

similarity.py

feat(similarity): add embedding pipeline, debug endpoints, backfill task, and scalable similarity search

2026-03-02 13:01:57 +00:00

url_upload.py

feat(upload): adaptive 429 backoff, full Gotenberg file types, directory traversal

2026-02-26 23:24:26 +00:00

user.py

style: fix all flake8 linter errors across app/ directory

2026-02-08 17:42:33 +00:00

webhooks.py

feat(webhooks): add webhook support for external integrations

2026-03-01 20:42:57 +00:00