Saturday, 24 October 2026

19 entries · final
Concept of the day · performance

Thundering Herd and Cache Stampede

One expired key, a thousand simultaneous recomputations.

The mechanism. A hot cache key expires. Every concurrent request misses, and every one of them starts the expensive recomputation — the same query, the same render, the same fan-out. The origin receives a load spike proportional to your traffic, which is exactly when you can least afford it. Worse, the slow origin makes requests pile up, so the herd grows while it waits.

Three fixes, composable. Locking / request coalescing: the first miss takes a lock and computes; the others wait for its result or serve stale. Go's singleflight and Nginx's proxy_cache_lock are this. Stale-while-revalidate: serve the expired value immediately and refresh in the background, so no user ever waits for a recompute. Probabilistic early expiry: each reader independently decides to refresh with a probability that rises as the TTL approaches, so refreshes spread out instead of landing together.

TTL jitter. If you populate ten thousand keys in one deploy with identical TTLs, they expire together. Randomise TTLs by ±10% and the cliff becomes a slope.

Beyond caches. The same shape appears in cron jobs that all fire at 0 * * * *, clients that reconnect simultaneously after a deploy, and token refreshes that all expire at once. Any synchronised schedule is a herd waiting to happen.

Takeaway. Caches turn load problems into coordination problems. Coalesce, serve stale, and jitter your TTLs.

0 of 19 read

Top Reads

5

Articles and engineering write-ups worth the full read.

UUIDv7 doesn't have the properties you think it does

alexsci.com·Lobsters +1·118 points / 102 comments·2 sourcesdistributedpythonthread →

No Source Code? No Problem! What if you have to port a program, but all you have is a binary? (2003)

queue.acm.org·Lobsters +1·46 points / 33 comments·2 sourcesgamesreversingthread →

Apple Music 404 Not Found

https://www.macrumors.com/2026/10/23/apple-music-has-a-hidde...

music.apple.com·Hacker News·664 points / 210 commentsthread →

Software is slow because of bad design, not slow languages

seangoedecke.com·Lobsters·41 points / 45 commentsperformancethread →

Please don't mess with links

maurycyz.com·Lobsters·92 points / 22 commentswebthread →

Shipped

4

Releases, changelogs, cloud and language news.

Expanding Claude availability and deployment choice on Google Cloud

Every organization has unique requirements for building and scaling generative AI. At Google Cloud, we are committed to giving developers model choice and architectural flexibility to run workloads however they need. Today, we’re announcing the general availability of an Anthropic-managed deployment option for Claude Models on Google Cloud. This gives teams more choice in how they run their models

cloud.google.com·Google Cloud Blogpartnersai & machine learningcloud

WebKit Features for Safari 27.1

Today iPhone Duo arrives, and with it, Safari 27.1. The “big news” here is no news. It’s Safari, with the same WebKit engine and the same web technologies as every other iPhone. Your websites and web apps work on iPhone Duo just like they do everywhere else. Safari 27.1 does bring one change to users. Now, when someone holds iPhone Duo partially folded like a book while looking at a PDF on the web

webkit.org·WebKitnewslanguage

[Launched] Generally Available: Item Level Recovery for Azure VMs with Premium SSDv2 and Ultra Disks in Azure Backup

Azure Backup now supports Item-Level Recovery (ILR) for Azure virtual machines using Premium SSD v2 and Ultra disks with both 512 byte and 4KB logical sector sizes. You can now recover individual files and folders from your Azure VMs with Premium SSDv2 an

azure.microsoft.com·Azure Updateslaunchedmanagement and governancestorage

Ruby 3.3.13 Released

Ruby 3.3.13 has been released. This release includes security fixes. Please check the topics below for details. Security advisories: CVE-2026-80212 and CVE-2026-80213 Regexp compilation fixes related to GitLab’s CVE-2026-89078, CVE-2026-93577, CVE-2026-97229 and CVE-2026-110264 This release updates the default gem resolv to 0.3.2, which fixes CVE-2026-80212 and CVE-2026-80213. Ruby 3.3 is in the s

ruby-lang.org·Rubylanguage

Repos

3

Projects gaining real traction, and what they actually do.

Shitter – A Nitter Fork

codeberg.org·Hacker News·147 points / 145 commentsthread →

Release OpenSSL 4.1.0 · openssl/openssl

github.com·Lobsters +1·181 points / 62 comments·2 sourcesreleasethread →

awesome-selfhosted/awesome-selfhosted

A list of Free Software network services and web applications which can be hosted on your own servers

github.com·GitHubawesomeawesome-listcloud

Discussion

3

Threads where the comments are the content.

Pentagon grants DHS permission to test heat ray weapon for use at border

cnn.com·Hacker News·130 points / 144 commentsthread →

The same AI request emits 8.5 times more CO2 in Texas than in Sweden

berget.ai·Hacker News·140 points / 154 commentsthread →

Securing our frontier model training environment

OpenAI explains how we strengthened containment for frontier model training and evaluation, including offline environments and high-compute red-teaming.

openai.com·OpenAI +1·92 points / 99 comments·2 sourcessecurityaithread →

AI

3

Capped on purpose, so it does not eat the edition.

Kimi K3.1 Pro and K3.1 Pro Highspeed

https://www.kimi.com/code/docs/en/kimi-code/models.html https://artificialanalysis.ai/models/kimi-k3-1-pro https://www.modelcompare.ai/blog/china-open-source-ai

kimi.ai·Hacker News·799 points / 484 commentsthread →

Bringing foundational models to the front lines of TB screening

Generative AI

research.google·Google Researchgenerative aihealth & bioscienceai

PyTorch Conference North America 2026: Accelerating Open Intelligence Together

PyTorch Conference North America 2026 brought 3,500+ attendees to San Jose on October 20–21 for two days focused on accelerating open intelligence and exploring the impact of PyTorch Foundation projects like PyTorch, vLLM, DeepSpeed, Ray, Helion, and Safetensors. PyTorch Foundation Executive Director, Mark Collier, set the stage for the entire event to demonstrate how the PyTorch Foundation is bui

pytorch.org·PyTorchannouncementsblogai

Deep

1

One paper or long teardown.

VERA: A Responsible AI Dashboard for Assessing LLM Deployments in Light of the EU AI Act

Institutions that deploy large language models in regulated settings often need technical evidence of responsible AI practices before approving a deployment. COMPL-AI provides a technical interpretation of the EU AI Act that organises this evidence under six principle groups and eighteen technical requirements, twelve of which current benchmarks can measure. The benchmark suites that produce this

arxiv.org·arXiv CScs.secs.aics.cy

Revision

2 from earlier editions

Answer each one before you open it.

What is the system doing wrong when it buffers instead of applying backpressure?3d ago

A queue that cannot say no is a queue that will fall over.

Concept · Backpressure
During a network partition, what is the only choice CAP actually gives you?10d ago

You do not choose between C and A; you choose what to do during a partition.

Concept · CAP, In Practice