Gmail label sync + no-dup backfill, live label/UI updates, account-delete cleanup, Sync-SPAM toggle, sidebar logo

Gmail sync (SPEC: Gmail sync):
- Provider fetches X-GM-LABELS when X-GM-EXT-1 is advertised; parses custom labels
  (system labels dropped, mUTF-7 decoded) onto RemoteMessage.
- Engine syncs only system folders + All Mail for Gmail, skips every label folder,
  and dedupes the All Mail pass by Message-ID — kills the INBOX/All-Mail duplication.
- Custom labels ride the message.new event; the labels plugin subscribes and maps
  them to chips as "<name> [Gmail]" (per-message + thread aggregate + known set),
  so labels fill in gradually with the sync window. Non-ASCII labels decode right.

Labels self-healing (message-driven reconcile):
- Per-message keys are the source of truth; t: aggregates and _labels are derived.
  Reconcile drops labels of deleted messages, regroups survivors by their current
  thread (fixing JWZ thread merges), rewrites changed t: keys, and rebuilds _labels
  from live messages — keeping user labels, dropping orphaned Gmail ones.
- New SDK reads: sdk.threads.existing / sdk.messages.threads_of. Sidebar refreshes
  live via a plugin.labels.changed WS event on new labels.

Account deletion: prune threads left empty after the cascade (they were user-scoped,
so only messages cascaded) + de-list the account from surviving cross-account threads.

Sync SPAM: opt-in per-account sync_spam (migration 0015, default off) — the engine
skips the Junk folder in backfill and poll unless enabled; wizard checkbox added.

Robustness / UX:
- WebSocket auto-reconnects with backoff and resyncs on (re)connect, and account
  add/delete invalidates threads/labels — no more hard refresh for live updates.
- Backfill banner + sidebar ring also require done < total, so a completed account
  can't leave a stuck "X of X".
- Scrub lone UTF-16 surrogates from parsed headers/bodies so bad messages no longer
  crash the backfill on Postgres text/JSONB.
- Ultimo signet logo in the Mail/Calendar/Contacts sidebar header (and at the top of
  the collapsed rail), via the shared plugin-ui.css + MailLayout.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01U72FZiF1W1pb8XxyWBTREA

This commit is contained in:

lukas

2026-08-05 18:04:49 +02:00

co-authored by

Claude Opus 4.8

parent e5a87b37b1

commit 4c200ab94a

38 changed files with 863 additions and 106 deletions

									
										backend/app/models.py
									
		+2
		
												View File
												
				@@ -86,6 +86,8 @@ class Account(Base):

				    # How much history to import (SPEC §12 M2): all | 3months | new. Drives the

				    # initial backfill; backfill_total/backfill_done feed the progress UX.

				    sync_window: Mapped[str] = mapped_column(Text, nullable=False, server_default=text("'all'"))

				    # Whether the Spam/Junk folder is synced (opt-in; SPEC §6.3 folder selection).

				    sync_spam: Mapped[bool] = mapped_column(nullable=False, server_default=text("false"))

				    backfill_total: Mapped[int] = mapped_column(Integer, nullable=False, server_default=text("0"))

				    backfill_done: Mapped[int] = mapped_column(Integer, nullable=False, server_default=text("0"))

				    last_sync_at: Mapped[dt.datetime | None] = mapped_column(TIMESTAMP(timezone=True))