gitea-admin/gh-christianlouis-docuelevate
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
443 Commits 28 Branches 0 Tags
ee43687eaa4e09985e63efee2a71a936211eb197
Commit Graph

79 Commits

Author SHA1 Message Date
copilot-swe-agent[bot] a3d0af2efc fix(security): address code review feedback on validation logic 
- Improve comment documentation for defense-in-depth validation
- Fix test assertion to properly validate basename sanitization
- Note regex pattern duplication for future refactoring

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-10 10:28:39 +00:00
copilot-swe-agent[bot] 489aa67a13 fix(security): remediate path traversal vulnerabilities in file operations 
- Fix critical vulnerability: sanitize GPT metadata filename before use
- Fix insecure string-based path validation with pathlib methods
- Add validation for GPT-extracted filenames
- Add comprehensive security test suite (24 tests)
- Document all findings in SECURITY_AUDIT.md

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-10 10:26:42 +00:00
copilot-swe-agent[bot] bb155501b4 fix(tasks): apply Black formatting to extract_metadata_with_gpt.py and rotate_pdf_pages.py 
Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-08 18:21:45 +00:00
copilot-swe-agent[bot] d08040ac4a style: fix all flake8 linter errors across app/ directory 
- Run Black formatter and isort on all app/ files
- Remove unused imports (F401) across multiple files
- Add # noqa: F401 for intentional re-exports in celery_worker.py,
  tasks/__init__.py, utils.py, frontend.py, views/base.py
- Fix f-strings without placeholders (F541) in azure.py, notification.py,
  check_credentials.py, upload_to_onedrive.py, settings.py
- Fix bare except (E722) in upload_to_sftp.py
- Fix block comment format (E265) in models.py
- Move imports to top of file to fix E402 in celery_app.py, celery_worker.py
- Fix line-too-long (E501) by wrapping strings in multiple files
- Remove unused variable (F841) in upload_to_nextcloud.py

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-08 17:42:33 +00:00
copilot-swe-agent[bot] b97c80d6bd fix: address code review feedback on security and type hints 
- Use Optional[int] type hint for timeout parameter in oauth_helper
- Replace bare Exception with specific ValueError and JSONDecodeError
- Strengthen rclone remote name validation (must start with alphanumeric)
- Fix path traversal validation to check against workdir for absolute paths
- Add comprehensive comments for security validations

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-08 08:31:21 +00:00
copilot-swe-agent[bot] d2eb9846d3 style: fix linting issues and remove unused imports 
- Remove unused imports from all modified files
- Fix flake8 violations (unused variables, f-strings without placeholders)
- Apply Black formatting consistently
- Shorten long line in google_drive.py

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-08 08:29:38 +00:00
copilot-swe-agent[bot] 551b23a80c fix(security): reduce code duplication and fix security issues in OAuth and file handling 
- Extract common OAuth token exchange logic to shared utility (oauth_helper.py)
- Remove sensitive data logging (client_secret, authorization codes)
- Add path traversal validation in resolve_file_path()
- Add input validation for rclone destination parameter
- Replace bare Exception catches with specific exception types
- Use RuntimeError instead of generic Exception for better error handling

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-08 08:26:10 +00:00
copilot-swe-agent[bot] 90d69979dc Fix S3 upload error: Pass file_id as keyword argument in Celery tasks 
Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-07 21:56:38 +00:00
copilot-swe-agent[bot] 7fc2703d90 Increase HTTP request timeout to 120s for large file processing (up to 1GB PDFs) 
Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-07 19:39:57 +00:00
copilot-swe-agent[bot] edd1acb3a1 Fix all high and medium severity security issues found by Bandit 
Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-07 19:35:40 +00:00
copilot-swe-agent[bot] dabd9a944c Final review fixes: consistent parameter order and improved test documentation 
Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-07 17:59:42 +00:00
copilot-swe-agent[bot] e20c88dbc7 Address code review feedback: improve variable naming and parameter order 
Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-07 17:58:08 +00:00
copilot-swe-agent[bot] 22a14431b3 Standardize upload task signatures to accept file_id parameter 
Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-07 17:55:30 +00:00
copilot-swe-agent[bot] 7d24b7c668 Apply code formatting and fix linting issues 
Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-07 17:37:50 +00:00
copilot-swe-agent[bot] 2db58afedf Add original_filename parameter to preserve user's filename 
Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-07 17:36:36 +00:00
copilot-swe-agent[bot] 3f1006b035 Code review feedback: improve readability of S3 upload call 
Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-07 17:28:04 +00:00
copilot-swe-agent[bot] c0e049ae96 Fix OneDrive and S3 upload signature - add file_id parameter 
- Updated upload_to_onedrive to accept file_id parameter with bind=True
- Updated upload_to_s3 to accept file_id parameter with bind=True
- Added proper logging with task_id and file_id tracking
- Added comprehensive unit tests for both functions
- All tests passing (8/8)

Fixes #99 and #100

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-07 17:25:23 +00:00
copilot-swe-agent[bot] 850afd26bd Fix DetachedInstanceError in process_document task by storing file_id before session closes 
Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-07 15:59:39 +00:00
Christian Krakau-Louis e45eb04366 Merge branch 'main' into copilot/add-file-processing-notifications 2026-02-07 15:37:17 +01:00
Christian Krakau-Louis e8c091897a Merge pull request #76 from christianlouis/copilot/add-processing-logging 
Add comprehensive logging for each processing step with frontend visibility
 2026-02-07 15:06:57 +01:00
copilot-swe-agent[bot] 2189802ee8 Add database logging to upload tasks 
- Add logging to upload_to_dropbox, upload_to_paperless, upload_to_nextcloud
- Pass file_id through send_to_all to upload tasks
- Log upload progress, success, and failures with context

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-07 14:02:29 +00:00
copilot-swe-agent[bot] adb0b2329e Address code review feedback 
- Replace LIKE queries with exact matches in fallback lookups
- Add comments clarifying fallback queries should not be needed
- Fix duplicate comment in embed_metadata_into_pdf
- Add missing file_id parameter to log_task_progress call

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-06 22:35:30 +00:00
copilot-swe-agent[bot] 74680c8849 Fix file_id propagation through task chain 
- Pass file_id as parameter through all task chains
- Update process_document, extract_metadata_with_gpt, embed_metadata_into_pdf, finalize_document_storage, send_to_all_destinations, rotate_pdf_pages, and process_with_azure_document_intelligence
- Remove unreliable LIKE queries, use explicit file_id passing instead

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-06 22:34:01 +00:00
copilot-swe-agent[bot] 9c4cf3d70e Fix notification message to accurately reflect async upload timing 
Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-06 22:33:16 +00:00
copilot-swe-agent[bot] 8be5b844c3 Add file processing notifications feature 
Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-06 22:31:48 +00:00
copilot-swe-agent[bot] 1903dc5bcd Add comprehensive processing logging system 
- Added database logging to all major processing tasks
- Created API endpoints for retrieving processing logs
- Updated frontend to display processing logs per file
- Logging includes: process_document, convert_to_pdf, extract_metadata_with_gpt, embed_metadata_into_pdf, finalize_document_storage, send_to_all_destinations

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-06 22:30:18 +00:00
copilot-swe-agent[bot] 566079e5e5 Add clarifying comments explaining the use of constants 
Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-06 22:24:58 +00:00
copilot-swe-agent[bot] 91f851238a Replace hardcoded 'tmp' strings with constants in embed_metadata_into_pdf.py 
Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-06 22:23:14 +00:00
copilot-swe-agent[bot] b17bba225f Address code review feedback on temporary file handling 
Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-01 14:05:51 +00:00
copilot-swe-agent[bot] 859a0825d0 Fix hardcoded temporary directory security issue (Issue #47) 
Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
 2026-02-01 14:05:08 +00:00
Christian Krakau-Louis b9f909ccd2 feat: Enhance upload session creation by properly encoding folder paths and filenames 2025-04-12 21:33:25 +02:00
Christian Krakau-Louis ce91dc8c79 feat: Implement notification system with Apprise integration and credential checks 2025-04-11 01:55:10 +02:00
Christian Krakau-Louis 9a44a7f1f7 Merge branch 'main' into 51-feature-request-switch-google-drive-integration-to-oauth-for-user-based-authentication 2025-04-11 00:18:10 +02:00
Christian Krakau-Louis 4c50c0aae6 Add Google Drive authorization processing and error handling templates 
- Implemented `google_drive_callback.html` for processing Google Drive authorization, including UI for success and error states.
- Added JavaScript functionality for exchanging authorization codes, saving settings, and handling folder selection.
- Created `google_drive_callback_error.html` to display error messages during the authorization process.
 2025-04-11 00:13:57 +02:00
Christian Krakau-Louis b258dd2f29 feat: Add OpenAI and Azure AI API endpoints with connection testing functionality 2025-04-09 08:59:30 +02:00
Christian Krakau-Louis 9823935927 feat: Replace PyMuPDF with PyPDF2 for PDF metadata editing and text extraction 2025-04-09 07:29:42 +02:00
Christian Krakau-Louis 2f822adeb7 feat: Add OpenAI and Azure AI API endpoints with connection testing functionality 2025-04-09 07:08:38 +02:00
Christian Krakau-Louis 81fd9cda14 feat: implement file size check and MIME type handling for document uploads 2025-04-04 02:46:29 +02:00
Christian Krakau-Louis 98df430f8f feat: add PDF rotation functionality and integrate with Azure Document Intelligence processing 2025-04-04 01:30:14 +02:00
Christian Krakau-Louis 8f311d730a feat: rename project from DocuNova to DocuElevate, update related documentation and templates 2025-04-03 23:25:51 +02:00
Christian Krakau-Louis 2cafda11dd feat: update version to 0.4.3-dev, add file deletion feature, and refactor API structure 2025-04-03 15:55:34 +02:00
Christian Krakau-Louis 94889e9e41 feat: implement Dropbox integration with OAuth setup and error handling 2025-04-03 10:35:55 +02:00
Christian Krakau-Louis 619c72ac53 feat: update version to 0.4.1-dev, refactor task imports, and replace Textract processing with Azure Document Intelligence 2025-04-02 15:46:56 +02:00
Christian Krakau-Louis c3df8107d8 feat: enhance FTP configuration with TLS options and update documentation 
Enhanced OneDrive workflow and tested
 2025-04-02 02:57:30 +02:00
Christian Krakau-Louis 81296b93f8 feat: update version to 0.3.2-dev and enhance Google Drive upload with optional metadata extraction 2025-04-02 00:20:00 +02:00
Christian Krakau-Louis ceaed1a081 feat: add Uptime Kuma integration with periodic ping task and configuration options 2025-04-01 22:44:46 +02:00
Christian Krakau-Louis d32e94715a feat: enhance email upload functionality with recipient validation and SMTP error handling 2025-04-01 05:31:40 +02:00
Christian Krakau-Louis 6972fb7505 feat: implement Google Drive integration and enhance documentation for new features 2025-04-01 04:44:00 +02:00
Christian Krakau-Louis 1d028c7a84 feat: enhance attachment processing to accept PDF files by extension or MIME type 2025-03-28 16:04:07 +01:00
Christian Krakau-Louis 43500ce66f feat: integrate OpenAI API with configurable settings for model and base URL 2025-03-28 13:50:10 +01:00