Architecture Weekly Issue #43. Articles, books, and playlists on architecture and related topics. Split by sections, highlighted with complexity: 🤟 means hardcore, 👷♂️ is technically applicable right away, 🍼 - is an introduction to the topic or an overview. Now in telegram as well.
It's already been 263 days since Russia's crazy, brutal, and unjustified war against Ukraine. We condemn this war and want it to stop ASAP. We continue this newsletter so you can advance your skill and help the millions of Ukrainian people in any way possible. If you want to help directly, visit this fund.
Highlights of the Week
The industry comes through a tough period: Big Tech is layoff people; those who don't - freeze the hire. According to layoffs.fyi, the Bay Area got ~70,000 engineers freed of their jobs. However, Adyen keeps hiring to make a day positive.
This week I would like to bring your attention to several articles about data management and the future of Frontend in the highlight section. Another seven awaiting you in the follow-up section.
Making Schema Changes Safe with Raft 🤟
Schema change is adding or deleting a column, changing column types etc. ScyllaDB is a distributed database, and it should apply the changes across the cluster. But this is a hard task and bugs are being reported over and over again. So they applied Raft to solve those problems. From the video, I discovered the prevoting procedure; pretty sure you will find a lot of interesting for you as well!
#databse #raft #distributedconsensus
The future history of Data Engineering 🍼
Matt Aderne makes an exercise of predicting the future of Data Engineering. He extrapolates that with the adoption of cloud services and the rise of Data Processing as a Service(Tech abstraction aaS) the demand for data engineering will drop focusing on tooling and orchestration instead of ETLs. Debatable? Indeed. Interesting nonetheless.
The state of Frontend in 2022 👷♂️
Gergely Orosz published the state of Frontend report. Technology-wise: TypeScript is at 80% of adoption. Surprisingly, 20% of developers are not using CI/CD despite the impression that this is a standard nowadays. More insights inside!
Aligning organization and architecture with strategic DDD 🍼
Find a deck by Michael Plöd on the application of DDD to organizing teams. As to Convey's law, your architecture will resemble the organization, picking the proper team helps a lot. Pick up the DDD approach, identify contexts, make good boundaries and remember, nothing is perfect. The slide deck below.
#ddd #teamtopologies #accelerate
Accelerating the LinkedIn experience with Azure Front Door 👷♂️
Another excellent article from the LinkedIn engineering blog. Serving data to far locations affects latency significantly and worsens the user experience. Points of Presence help with it by heavy lifting the HTTPS and TCP/IP connections between the end user and itself, while maintaining the connection to LI servers. Brilliant illustrations and lessons learned inside.
#azure #edge #cloud
Machine Learning for Fraud Detection in Streaming Services 👷♂️
Streaming platforms use limitations for the content from the perspective of the number of devices, accessing particular content etc. The implementation of those limitations can be tricky. Netflix heavily uses machine learning based on anomaly detection to detect fraudsters. More details in their tech blog.
Scaling customer review system for peak traffic 👷♂️
Fresh post from the Booking.com tech blog on the system scaling for customer reviews. To prepare for picks in traffic they have the load testing with predicted data, have observability in place and employ a consistent hashing algorithm to distribute the load. Details inside!
#performance #scalability #consistenthashing
Lyfts' SafeMode 🍼
I remember when you roll out a new feature in a mobile application, and it starts crashing right from the first screen. It is unacceptable with any scale of a mobile app, but the complexity of applications is extremely high. In order to safeguard Lyft introduced SafeMode: an approach to detect a crash, disable a feature flag and report the issue. Read how it helped Lyft!
Is Enterprise Architecture Dead? 🍼
Short note on Enterprise Architecture continuing the topic of Road-way architecture. As we remember the global rearchitecting never completes; instead you need to be flexible and extendable. Navdeep Singh shares the lesson learned.
Why B-trees are efficient? 🤟
I am continuing reading the "Database Internals" book. This time it's chapter number 2 where I cover the binary search trees and B-trees. Find out why the latter are used in databases!
#video #database #btree
Like the newsletter? Consider helping to run it at Patreon or Boosty. Patrons and Boosty subscribers of a certain level also get access to a private Architecture Community. Big thanks to Nikita, Anatoly, Oleksandr, Dima, Pavel and Robert for already supporting the newsletter.