Architecture Weekly #111

Architecture Weekly Issue #111. Articles, books, and playlists on architecture and related topics. Split by sections, highlighted with complexity: 🤟 means hardcore, 👷‍♂️ is technically applicable right away,  🍼 - is an introduction to the topic or an overview. Now in telegram and Substack as well.

If you're interested in the technologies, development approaches and overall business of our little startup in the compliance field subscribe on Patreon and Boosty, as I shared an article recently on how we added a second product to our architecture last week.

Highlights

Hashnode's Feed Architecture 👷‍♂️

In the last newsletter, I shared an article where Hashnode describe how they create their social feed without ML models. This time they posted their approach to pre-calculate the feed for fast loading and balancing the database load. Find some insights inside!

Hashnode’s Feed Architecture
Hashnode’s optimized feed uses AWS Step Functions, serverless tech for quicker, personalized content, enhanced performance, and security

#serverless

Reusable workflows in McDonald's CI 👷‍♂️

Truly said, that every company is a software company now, and McDonald's is no exception. They have their technical blog too, and the one of the posts there explains how they are using and monitor shared github workflows to improve development efficiency.

Reduce, recycle, reuse
McDonald’s reusable workflows — the continuous integration process with GitHub actions.

#ci

The Past, Present and Future of Stream Processing 🍼

When you think about big data processing is probably let's accumulate enough data and process them in a single batch - which the foundational idea of batch processing. However, it has a significant latency, which is frequently not acceptable by business. Stream processing is for the rescue. In this article you will discover the history of stream processing and it's current state.

The Past, Present and Future of Stream Processing
Blog about architectures, best practices and use cases for data streaming, analytics, hybrid cloud infrastructure, internet of things, crypto, and more

#bigdata

Follow-Up

12 Golden Signals To Discover Anomalies on AWS RDS Fleet 👷‍♂️

AWS RDS is a standard solution in cloud to host relational databases. But running them is whole topic as it's critical to monitor your primary storage. Luckily, Zalando Engineering Blog features a post with the golden signals to monitor for anomalies.

Zalando Engineering Blog - 12 Golden Signals To Discover Anomalies And Performance Issues on Your AWS RDS Fleet
Automate anomaly detection for AWS RDS at scale.

#db #sre

Switching from TiDB to DynamoDB 👷‍♂️

I am leading Billing in Bolt at the moment, and I am especially interested in how it's done in our competitor's system. I found a peculiar piece describing the architecture of billing at Zomato and their journey from TiDB(which we use at Bolt) to DynamoDB. Get a read too!

Unlocking performance, scalability, and cost-efficiency of Zomato’s Billing Platform by switching from TiDB to DynamoDB

#casestudy #aws #dynamodb

The Napkin Math 👷‍♂️

While designing a new system or passing a system design interview you need to making the calculations about compute, storage and network bandwith. Please find a resource where you will get some latency and throughput numbers for reading data from memory, disk and transferring it over the network.

GitHub - sirupsen/napkin-math: Techniques and numbers for estimating system’s performance from first-principles
Techniques and numbers for estimating system’s performance from first-principles - sirupsen/napkin-math

#performance

Vendor Security Testing at Canva  🍼

Security is a crucial requirement for SaaS services, but few of them can do everything required on their own. That's why it is important to carefully treat working with vendors. This is the way Canva think. In this post they describe their attitude towards security while using 3rd party vendors and how they find the right balance in testing effort and security level provided.

Trust but test: Vendor security testing at Canva - Canva Engineering Blog
How we validate vendor security at Canva by going beyond compliance.

#security

No more free Redis Hosting  🍼

Redis introduced the dual license. That means you can still use the open-source product. However, if you want to sell it as a cloud offering, which AWS ElasticCache does for example, you will need to pay a license fee to Redis. Well, we'll see soon how cloud providers are reacting to it.

Redis Adopts Dual Source-Available Licensing | Redis
Beginning today, all future versions of Redis will be released with source-available licenses. Read more on the blog.

#license

WARNING 🇺🇦

The brutal and unjustified war against Ukraine continues already 2 years. If you want to help Ukraine directly visit this fund.

Big thanks to Nikita, Anatoly, Oleksandr, Dima, Pavel B, Pavel, Robert, Roman, Iyri, Andrey, Lidia, Vladimir, August, Roman, Egor, Roman, Evgeniy, Nadia, Daria, Dzmitry, Mikhail, Nikita and Dmytro for supporting the newsletter. They receive early access to the articles, influence the content and participate in the closed group where we discuss the architecture problems. They also see my daily updates on all the things I am working on. Join them at Patreon or Boosty!