How to Serve Private Assets - Proxy, presigned URL, CloudFront, WAF
Private files in the browser: proxy, presigned URL, CloudFront signed URL, and OAC with WAF, compared by who checks access. A 200MB file tests the proxy myth.
s3
5 posts
Querying S3 without Parquet
Can JSONL on S3 be queried without Parquet? Range search, a B-tree, and an LSM tree, timed on a real bucket. It works. Parquet still wins on upkeep.
Dissecting Parquet
Inside a Parquet file: columns, row groups, pages, and the footer. Animations of min/max and Bloom filters pruning groups, then Range fetching the slices.
Running a Notification System with BullMQ, Part 4 - How to Read the History You Stored
Delivery-history JSON in S3 is hard to query. Four options on infrastructure, query cost, and freshness, and why nightly Parquet conversion won.
Running a Notification System with BullMQ, Part 3 - Where to Store Delivery History
Where should delivery history live? The trade-offs weighed across a dedicated relational DB, a serial S3 pipeline, SNS fan-out, and a Firehose route.