Lobster Roll

The space is confusing to say the least. Message queues are usually a core part of any distributed architecture, and the options are endless: Kafka, RabbitMQ, Redis {Pub-Sub, Streams}, Cloud Providers {AWS SQS, Kinesis; Google Pub/Sub; Azure Event Hubs, Service Bus}, Pulsar, ZeroMQ... and then th...

TIL OpenAI uses (used?) one primary write instance for their PostgreSQL cluster with dozens of read replicas. This powers the core ChatGPT service which has hundreds of millions of users and, needless to say, is a critical backbone to it. The talk implies they shard now, but the whole video empha...