Jeremy Daer
761d0b4a76
An append-only storage ledger replaces deadlock-prone synchronous counter updates and drift-prone async updates. All content storage (card images, card/comment/board description embeds) is tracked. Account exports (which expire) and avatars are not tracked. Storage is accounted for by Account and Board. Both consume the same event stream independently: no bubble-up storage bumps triggering deadlocks due to lock sequencing. Each calculates its own total from the underlying ledger with independent cursors and materialization. * Storage::Entry: Append-only ledger recording attach/detach/transfer events with delta bytes. Single event stream indexed for both Account and Board cursor queries. * Storage::Total: Polymorphic snapshot cache with cursor (last_entry_id) tracking which entries have been materialized. * Storage::Totaled concern: Provides bytes_used (fast snapshot) and bytes_used_exact (snapshot + pending) query modes, plus materialize_storage! to roll up pending entries. * Storage::Tracked concern: For models owning attachments (Card, Comment, Board). Provides board_for_storage_tracking for models where board is determined differently (Board returns self). Handles board transfers by recording transfer_out/transfer_in entries. * Storage::AttachmentTracking: Hooks ActiveStorage::Attachment lifecycle to record attach/detach entries. Handles ActionText::RichText embeds by traversing to the actual model. Snapshots context in before_destroy to handle cascading deletes where parent record may be gone by after_destroy_commit. * MaterializeJob: Rolls up pending entries into snapshot. Concurrency limited per owner to prevent duplicate work. * ReconcileJob: On-demand reconciliation against actual attachment storage for support/debugging. Compares ledger total to real bytes from card images, card embeds, comment embeds, and board embeds. Usage: * account.bytes_used / board.bytes_used: fast, slightly stale bytesize * account.bytes_used_exact / board.bytes_used_exact: real-time bytesize * Storage::Entry: audit trail for debugging and point-in-time queries
36 lines
1.3 KiB
Ruby
36 lines
1.3 KiB
Ruby
class Storage::Entry < ApplicationRecord
|
|
belongs_to :account
|
|
belongs_to :board, optional: true
|
|
belongs_to :recordable, polymorphic: true, optional: true
|
|
|
|
scope :pending, ->(last_entry_id) { where.not(id: ..last_entry_id) if last_entry_id }
|
|
|
|
# Accepts either objects or _id params (for after_destroy_commit snapshots)
|
|
def self.record(delta:, operation:, account: nil, account_id: nil, board: nil, board_id: nil,
|
|
recordable: nil, recordable_type: nil, recordable_id: nil, blob: nil, blob_id: nil)
|
|
return if delta.zero?
|
|
|
|
account_id ||= account&.id
|
|
board_id ||= board&.id
|
|
blob_id ||= blob&.id
|
|
|
|
entry = create! \
|
|
account_id: account_id,
|
|
board_id: board_id,
|
|
recordable_type: recordable_type || recordable&.class&.name,
|
|
recordable_id: recordable_id || recordable&.id,
|
|
blob_id: blob_id,
|
|
delta: delta,
|
|
operation: operation,
|
|
user_id: Current.user&.id,
|
|
request_id: Current.request_id
|
|
|
|
# Enqueue materialization - use find_by to handle cascading deletes
|
|
# (Account/Board may be destroyed while attachments are still being cleaned up)
|
|
Account.find_by(id: account_id)&.materialize_storage_later
|
|
Board.find_by(id: board_id)&.materialize_storage_later if board_id
|
|
|
|
entry
|
|
end
|
|
end
|