Nostr notes by Marc Brooker

I sat down with Darko Mesaros to talk about Kiro, ...

2025-07-14T23:20:20Z

I sat down with Darko Mesaros to talk about Kiro, specification-driven development, and putting AI-powered development in context of the history of computing.

Is an LLM a compiler? What is a spec? How are specs like SQL? Check it out:

https://www.youtube.com/watch?v=OdD9eLiRRVo

and be sure to check out https://kiro.dev/

New blog post, about some of my favorite papers from this ...

2025-06-02T16:42:21Z

New blog post, about some of my favorite papers from this year's HotOS program. Love Little's law? Hate fork? Think static analysis of shell programs sounds fun? Had enough of the f threshold model? Check it out for some papers to read: https://brooker.co.za/blog/2025/06/02/hotos.html

Thanks for pointing this out. We'll get it fixed.

2025-05-07T16:47:17Z

In reply to nevent1q…jdcv
_________________________

Thanks for pointing this out. We'll get it fixed.

As far as I know, this issue has existed in PostgreSQL since the ...

2025-05-03T16:50:16Z

In reply to nevent1q…a2mt
_________________________

As far as I know, this issue has existed in PostgreSQL since the introduction of MVCC more than two decades ago. It affects most clustered installations of PostgreSQL. We are working with the PostgreSQL community on a fix.

This issue doesn't affect Amazon Aurora Limitless Database, or Aurora DSQL. Both of these databases use different methods for ordering transactions, which provide a consistent ordering across replicas.

Recently, one of our testing tools at AWS found an issue with ...

2025-05-03T16:49:54Z

Recently, one of our testing tools at AWS found an issue with transaction visibility in PostgreSQL, where the order that transactions become visible differs between the primary and replicas. Sergey Melnik dives deep on the AWS Database Blog: https://aws.amazon.com/blogs/database/understanding-transaction-visibility-in-postgresql-clusters-with-read-replicas/

But that "do what Postgres does" doesn't extend to ...

2025-04-28T17:05:09Z

In reply to nevent1q…3tfd
_________________________

But that "do what Postgres does" doesn't extend to the distributed features, and is insufficiently precise for some kinds of correctness. TLA+ and P fit in well there.

TLA+ as a correctness oracle for deterministic (or even ...

2025-04-28T17:04:17Z

In reply to nevent1q…6ce9
_________________________

TLA+ as a correctness oracle for deterministic (or even non-deterministic) simulation testing makes a ton of sense to me.

As you say, a big part of that is driving folks to think about what correctness means to them.

In DSQL testing, for example, we've used "do what Postgres does" as a correctness oracle for a lot of the non-distributed surface area, just because that's what many of our customers care about.

Yes, I agree. I'm (obviously) a big TLA+ fan, but it is ...

2025-04-26T16:57:12Z

In reply to nevent1q…u3ym
_________________________

Yes, I agree. I'm (obviously) a big TLA+ fan, but it is increasingly difficult to see where it's going to fit into our practice broadly. Very likely to continue to remain popular as a niche tool (for good reasons), and maybe that's enough.

The connection between TLA+ and deterministic simulation is a very interesting one. At some level, they have very similar mental models.

100s for a single primary key, although we'll improve that ...

2024-12-11T17:03:03Z

In reply to nevent1q…8656
_________________________

100s for a single primary key, although we'll improve that over time.

The fourth and last in my series of blog posts on our new Aurora ...

2024-12-06T17:26:15Z

The fourth and last in my series of blog posts on our new Aurora DSQL database is up! This time, we're looking at what happens during network partitions, and how we preserve consistency, availability, and durability. Check it out: https://brooker.co.za/blog/2024/12/06/inside-dsql-cap.html

Today's third blog post on Aurora DSQL: this time looking at ...

2024-12-05T18:08:55Z

Today's third blog post on Aurora DSQL: this time looking at the write and commit path, and how conflicts are detected and handled: https://brooker.co.za/blog/2024/12/05/inside-dsql-writes.html

My second blog post on Aurora DSQL, with a deep dive on how reads ...

2024-12-04T17:11:17Z

My second blog post on Aurora DSQL, with a deep dive on how reads work: https://brooker.co.za/blog/2024/12/04/inside-dsql.html

Rust Foundation Collaborates With AWS Initiative to Verify Rust ...

2024-11-21T00:06:11Z

Rust Foundation Collaborates With AWS Initiative to Verify Rust Standard Libraries https://foundation.rust-lang.org/news/rust-foundation-collaborates-with-aws-initiative-to-verify-rust-standard-libraries/

Verify the Safety of the Rust Standard Library https://aws.amazon.com/blogs/opensource/verify-the-safety-of-the-rust-standard-library/

New blog post on ten years of AWS Lambda, and some thoughts on ...

2024-11-14T17:26:38Z

New blog post on ten years of AWS Lambda, and some thoughts on the Lambda PRFAQ: https://brooker.co.za/blog/2024/11/14/lambda-ten-years.html

I'm on the AWS Developers podcast this morning, talking to ...

2024-11-01T22:39:30Z

I'm on the AWS Developers podcast this morning, talking to Julian Wood about AWS Lambda's 10th anniversary, the growth of serverless, and some of what we learned along the way.

https://developers.podcast.go-aws.com/web/podcasts/episode_137/index.html

Most of this is using formal logic to reason about mathematical ...

2024-10-22T15:30:03Z

In reply to nevent1q…hukq
_________________________

Most of this is using formal logic to reason about mathematical specifications of systems. But LLMs are useful in this space too - for example I find them super useful for brainstorming proof strategies (how do I proof this), and accelerating formal model development. Semantic search is also super helpful.

There's a bright future in combining these techniques. They tend to be good at complementary things.

"But what about time-to-market?" has been one of the ...

2024-10-21T15:53:52Z

In reply to nevent1q…2xug
_________________________

"But what about time-to-market?" has been one of the objections to automated reasoning and formal methods forever, but in many domains they allow us to get to market faster. This is especially true in security, availability, and durability-critical domains.

Great new piece from Byron Cook about automated reasoning at AWS, ...

2024-10-21T15:53:32Z

Great new piece from Byron Cook about automated reasoning at AWS, and how we're finding it not only allows us to deliver safer code, but also deliver faster code, and deliver code faster. https://aws.amazon.com/blogs/security/an-unexpected-discovery-automated-reasoning-often-makes-systems-more-efficient-and-easier-to-maintain/

New little blog post on garbage collection and metastability: ...

2024-08-14T19:20:46Z

New little blog post on garbage collection and metastability: https://brooker.co.za/blog/2024/08/14/gc-metastable.html

More great work from Kyle, and another reminder that retrying ...

2024-08-08T15:05:07Z

More great work from Kyle, and another reminder that retrying isn't the safe best-practice that many folks assume it is: https://jepsen.io/analyses/jetcd-0.8.2

The tool I use most often is P, with a bit of TLA+, Kani, and ...

2024-08-07T23:43:16Z

In reply to nevent1q…v3rl
_________________________

The tool I use most often is P, with a bit of TLA+, Kani, and (lately) Lean. I've also been learning more about Dafny, but I (personally) haven't done anything real with it yet.

I've been learning Lean recently to add to my formal toolkit, ...

2024-08-07T19:48:25Z

In reply to nevent1q…hdqw
_________________________

I've been learning Lean recently to add to my formal toolkit, and it's been a really eye-opening experience. I don't have much of a math background, but have already found Lean lets me do things that I found really hard before.

Loved this talk by Terence Tao on math, AI, and proof assistants. ...

2024-08-07T19:47:44Z

Loved this talk by Terence Tao on math, AI, and proof assistants. I suspect we're going to see a similar effect in software: AI will allow formal specs to be developed faster than traditional programs, and for programs to be generated from those specs. https://www.youtube.com/watch?v=_sTDSO74D8Q

And don't forget the jitter! ...

2023-07-02T16:01:13Z

In reply to nevent1q…7mys
_________________________

And don't forget the jitter! https://aws.amazon.com/builders-library/timeouts-retries-and-backoff-with-jitter/

Exponential backoff. Like quotas, backoff works well in systems ...

2023-07-02T16:00:55Z

In reply to nevent1q…mdjs
_________________________

Exponential backoff. Like quotas, backoff works well in systems with a bounded number of clients ("closed systems"), where clients actually back off. In systems with more new customers coming in all the time, backing off just delays work, and doesn't reduce it.

Delaying work increases time-to-recovery after overload. See more at: https://brooker.co.za/blog/2022/08/11/backoff.html

Quotas. Quotas work well in systems with a well-bounded number of ...

2023-07-02T16:00:14Z

In reply to nevent1q…7ls2
_________________________

Quotas. Quotas work well in systems with a well-bounded number of clients, and where those clients correctly respect the "quota exceeded" response. If either of these things aren't true - even in the case of bad actors - they don't tend to work.

Do social media networks have a bounded number of clients? At first glance they're an "open" system, with large numbers of clients. I suspect a lot of load comes from a small number of heavy hitters. See more on open vs closed: https://brooker.co.za/blog/2023/05/10/open-closed.html

The internet is talking about retries and backoff! As we've ...

2023-07-02T15:59:08Z

The internet is talking about retries and backoff! As we've seen over the last day or so, simply retrying without backoff leads to an unbounded increase in work. This, in turn, tends to make overloaded systems even more overloaded. What can we do instead?