Commit Graph

435 Commits

Author SHA1 Message Date
Christian Krakau-Louis 42e3a1f148 Merge pull request #78 from christianlouis/copilot/fix-update-settings-persistence
Add persistent settings system with database backend and comprehensive settings UI
2026-03-30 10:30:07 +02:00
copilot-swe-agent[bot] 241713083b Add persistent settings system with database backend and comprehensive UI
- New Setting ORM model (key-value store with category, value_type, audit fields)
- Alembic migration to create the settings table
- Settings API endpoints: GET/PUT /api/v1/settings/{key}, GET /api/v1/settings (list+filter), POST /api/v1/settings/bulk
- Default seeding (17 sensible defaults across general/dmarc/dns/cloudflare/notifications categories)
- Secret redaction for cloudflare.api_token and notifications.smtp_password
- Updated settings.html: General, DMARC Policy Defaults, DNS Resolver, Cloudflare Integration, Email Notifications sections
- All forms wired to the API via Alpine.js with flash feedback
- 12 new tests for the settings model and endpoints

Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/19dbc6cd-07cb-406e-b3b6-411f7721f737

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-30 07:58:51 +00:00
semantic-release ecf0976301 chore(release): v1.7.0 2026-03-30 07:49:54 +00:00
Christian Krakau-Louis 564824af6b Merge pull request #79 from christianlouis/copilot/replace-mock-dns-data-with-actual-lookups
docs: mark DNS lookups as implemented in TODO.md
2026-03-30 09:48:59 +02:00
Christian Krakau-Louis 24c134f1db Merge branch 'main' into copilot/replace-mock-dns-data-with-actual-lookups 2026-03-30 09:48:49 +02:00
Christian Krakau-Louis 09dbda26b1 Merge pull request #81 from christianlouis/copilot/add-ci-cd-pipeline
docs: mark CI/CD pipeline complete and add pipeline documentation
2026-03-30 09:48:11 +02:00
Christian Krakau-Louis da34af977d Merge pull request #82 from christianlouis/copilot/add-dmarc-report-deletion
feat: Add delete button UI for DMARC reports with re-import support
2026-03-30 09:47:57 +02:00
copilot-swe-agent[bot] dc4e8377ee test: tighten token expiry tolerance in test_security_extra.py
Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/752de981-5cf5-4789-a5b9-1f5ff165d202

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-30 00:38:16 +00:00
copilot-swe-agent[bot] 61cb428f54 feat: add delete buttons to reports list and report detail pages
- Add "Delete" button to reports list table (reports.html): clicking
  shows a confirmation dialog then calls the existing DELETE API.
  On success, the row is removed from the table without a page reload.
  Domain filter dropdown is pruned if the domain has no remaining reports.

- Add "Delete Report" button to report detail page (report_detail.html):
  clicking shows a confirmation dialog then calls the DELETE API.
  On success, redirects to /reports.

The backend DELETE endpoint and re-upload-after-delete (deduplication
exemption) were already in place and covered by existing tests.

Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/d6c0078b-9338-49f0-87bd-32238fbde237

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-30 00:37:53 +00:00
copilot-swe-agent[bot] 3524344a4a test: add comprehensive tests for imap, stats, setup, security; enforce 80% coverage gate
Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/752de981-5cf5-4789-a5b9-1f5ff165d202

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-30 00:33:00 +00:00
copilot-swe-agent[bot] f998804766 docs: update TODO.md to reflect completed DNS implementation
Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/050f0b9b-5b38-4f9a-bcb5-40992e567540

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-30 00:30:17 +00:00
copilot-swe-agent[bot] e75fde4311 Initial plan 2026-03-30 00:07:01 +00:00
copilot-swe-agent[bot] 7b932bb41d docs: fix stage count in testing.md CI section
Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/db6908f8-a99f-426a-97f3-947d5c02944b

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-30 00:06:31 +00:00
copilot-swe-agent[bot] 7955dac8e1 docs: mark CI/CD pipeline done, add ci-cd.md, fix testing.md reference
Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/db6908f8-a99f-426a-97f3-947d5c02944b

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-30 00:05:16 +00:00
copilot-swe-agent[bot] 172d6465ab Initial plan 2026-03-29 23:59:43 +00:00
copilot-swe-agent[bot] 1cecde6120 Initial plan 2026-03-29 23:59:34 +00:00
copilot-swe-agent[bot] 227dfe1819 Initial plan 2026-03-29 23:59:17 +00:00
copilot-swe-agent[bot] 12305fbaef Initial plan 2026-03-29 23:58:59 +00:00
Christian Krakau-Louis 06a007d9db Merge pull request #76 from christianlouis/copilot/update-dkim-selectors
Fix DKIM selector extraction: surface all working selectors and auto-discovered report selectors
2026-03-30 01:57:12 +02:00
copilot-swe-agent[bot] 596a9b882e Fix DKIM selector extraction: show all working selectors and report-discovered selectors
- check_dkim now returns ALL matching selectors instead of stopping at first match
- DomainDNSResult.dkim_selectors is now a List[str] instead of a single Optional[str]
- DNSRecordResponse.dkimSelectors is now List[str]
- /selectors endpoint now also returns report_selectors (auto-discovered from DMARC reports)
- Frontend shows all live-check selectors and auto-discovered selectors as read-only
- Updated tests to match new data structures; added tests for multi-selector and report_selectors

Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/87d8b8d9-23c3-4d3b-85a3-8e354e62c768

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-29 23:54:45 +00:00
Christian Krakau-Louis 14ac9572b2 Merge pull request #73 from christianlouis/copilot/implement-database-backed-key-storage
Fix CodeQL clear-text logging alerts and improve startup branch coverage
2026-03-30 01:52:12 +02:00
Christian Krakau-Louis bf9d1f6755 Merge pull request #77 from christianlouis/copilot/fix-unauthorized-error
Fix 401 Unauthorized on poll-status dashboard widget
2026-03-30 01:51:56 +02:00
copilot-swe-agent[bot] 04e6dcfb8c Rename poll-status to public path /api/v1/poll-status to reflect no-auth design
Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/15d037ef-2d5e-44ab-a15d-7908187e9106

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-29 23:46:37 +00:00
copilot-swe-agent[bot] dfef73040c Fix 401 on poll-status: remove auth requirement from read-only status endpoint
Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/15d037ef-2d5e-44ab-a15d-7908187e9106

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-29 23:43:54 +00:00
copilot-swe-agent[bot] 4f9e3b4b4b Fix CodeQL clear-text logging alerts and improve startup test coverage
Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/3d5dbbdc-99d5-4dc3-8ca9-a763ba917ae4

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-29 23:43:14 +00:00
Christian Krakau-Louis 1e09d34736 Merge pull request #75 from christianlouis/copilot/update-reports-with-real-data
Replace dummy report data with real API on /reports page
2026-03-30 01:41:49 +02:00
copilot-swe-agent[bot] 4d77af791c Initial plan 2026-03-29 23:41:20 +00:00
copilot-swe-agent[bot] ba4dcd9f81 Add tests for GET /api/v1/reports endpoint to fix codecov/patch coverage
Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/7652d25c-fe9d-4576-a69d-731b091b84ff

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-29 23:39:16 +00:00
copilot-swe-agent[bot] 985f49d61f Initial plan 2026-03-29 23:39:02 +00:00
copilot-swe-agent[bot] de225bc1cd Replace dummy/bogus reports data with real API data on /reports page
Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/c6e36fd9-00c9-4000-985f-f7a42e2ba451

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-29 23:24:40 +00:00
copilot-swe-agent[bot] aa8c55d27c Fix 4 CodeQL alerts: lgtm suppress clear-text logging, add @classmethod to validator
Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/d2144e43-76eb-41c3-af31-9dcb7695bcbf

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-29 23:22:23 +00:00
Christian Krakau-Louis cb9eb39579 Merge pull request #74 from christianlouis/copilot/implement-key-storage-upgrade
chore: upgrade Python to 3.13 across the entire project
2026-03-30 01:12:31 +02:00
copilot-swe-agent[bot] ccb3f3fb7e Allow admin API key to be configured via ADMIN_API_KEY env var
Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/27db6d87-70db-4979-a23c-dd376f1c3b9a

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-29 23:10:36 +00:00
copilot-swe-agent[bot] a61bf4df0a chore: upgrade Python version from 3.10 to 3.13 across the project
Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/29bd6108-4094-48ca-8976-10df52774551

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-29 23:08:18 +00:00
copilot-swe-agent[bot] dda4224129 Initial plan 2026-03-29 23:03:57 +00:00
copilot-swe-agent[bot] 12567f77c0 Initial plan 2026-03-29 23:02:29 +00:00
copilot-swe-agent[bot] f2dd2333b6 Initial plan 2026-03-29 23:01:56 +00:00
semantic-release f5c93a1e89 chore(release): v1.6.0 2026-03-29 22:57:58 +00:00
Christian Krakau-Louis 55fad8fcef Merge pull request #72 from christianlouis/copilot/make-domain-report-more-actionable
feat: enhance domain sources with rDNS hostname, SPF fix hints, and auth tooltips
2026-03-30 00:57:05 +02:00
copilot-swe-agent[bot] 58b5755f72 refactor: extract _spf_fix_hint and _safe_ptr_lookup helpers; fix spelling
Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/9eaa7749-047c-46bd-8bc0-2851ea02ffe4

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-29 22:46:49 +00:00
copilot-swe-agent[bot] 30007d21d6 feat: add rDNS hostname, SPF fix hints and auth tooltips to domain sources view
- dns_resolver.py: add _ip_to_arpa_name() helper and lookup_ptr() to
  BaseDNSProvider (no-op default), SystemDNSProvider (dnspython PTR),
  and CloudflareDNSProvider (DoH PTR type=12)
- domains.py: extend SourceEntry with hostname + spf_fix_hint; update
  get_domain_sources to run async PTR lookups and generate ip4:/ip6:
  SPF mechanism hints for failing IPs
- domain_details.html: show rDNS hostname below IP in sources table;
  add DaisyUI tooltip explaining each auth result; add "Fix SPF" popover
  with copy-paste mechanism for IPs that fail SPF
- tests: 15 new tests covering _ip_to_arpa_name, SystemDNSProvider/
  CloudflareDNSProvider PTR lookup, and sources endpoint hostname +
  fix-hint fields

Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/9eaa7749-047c-46bd-8bc0-2851ea02ffe4

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-29 22:44:18 +00:00
copilot-swe-agent[bot] daa38b8337 Initial plan 2026-03-29 22:37:47 +00:00
semantic-release b6c15bda9c chore(release): v1.5.0 2026-03-29 22:28:46 +00:00
Christian Krakau-Louis 1815747fba Merge pull request #69 from christianlouis/copilot/debug-not-found-error
Fix /reports/{report_id} returning 404 Not Found
2026-03-30 00:27:52 +02:00
Christian Krakau-Louis c144fc7a86 Merge pull request #71 from christianlouis/copilot/debug-content-security-policy-error
Fix CSP violation: self-host chart.js to eliminate CDN connect-src breach
2026-03-30 00:27:26 +02:00
Christian Krakau-Louis 8665e39ff4 Merge pull request #70 from christianlouis/copilot/fix-internal-server-error
Fix 500 on GET /api/v1/domains/{domain}/sources: wrong record keys in ReportStore
2026-03-30 00:26:51 +02:00
Christian Krakau-Louis 506346537c Merge pull request #67 from christianlouis/copilot/add-gmail-api-mail-source
feat: add Gmail API & main.py helper tests; fix flake8 lint errors
2026-03-30 00:26:28 +02:00
copilot-swe-agent[bot] 1455db9298 Fix CSP violation: self-host chart.js instead of loading from CDN
Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/11546dac-cb66-4028-95d6-420763b626e4

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-29 22:18:38 +00:00
copilot-swe-agent[bot] af122881a5 Fix /reports/{report_id} returning 404 - add report detail page and API endpoint
Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/4a412936-3bf7-4c02-b121-c0c342c34f1b

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-29 22:18:17 +00:00
copilot-swe-agent[bot] cd1f82aa79 Fix 500 error in GET /domains/{domain}/sources: use spf_result/dkim_result not spf/dkim
Agent-Logs-Url: https://github.com/christianlouis/dmarq/sessions/59552cb2-df2b-43dd-a22c-bd699a458afb

Co-authored-by: christianlouis <361235+christianlouis@users.noreply.github.com>
2026-03-29 22:17:05 +00:00