Thought for the day...

nsaspook

Joined Aug 27, 2009
16,330
https://arstechnica.com/gadgets/202...iggered-the-amazon-outage-affecting-millions/
A single point of failure triggered the Amazon outage affecting millions
Amazon said the root cause of the outage was a software bug in software running the DynamoDB DNS management system. The system monitors the stability of load balancers by, among other things, periodically creating new DNS configurations for endpoints within the AWS network. A race condition is an error that makes a process dependent on the timing or sequence events that are variable and outside the developers’ control. The result can be unexpected behavior and potentially harmful failures.

In this case, the race condition resided in the DNS Enactor, a DynamoDB component that constantly updates domain lookup tables in individual AWS endpoints to optimize load balancing as conditions change. As the enactor operated, it “experienced unusually high delays needing to retry its update on several of the DNS endpoints.” While the enactor was playing catch-up, a second DynamoDB component, the DNS Planner, continued to generate new plans. Then, a separate DNS Enactor began to implement them.
It's always about race (conditions).
When the second Enactor (applying the newest plan) completed its endpoint updates, it then invoked the plan clean-up process, which identifies plans that are significantly older than the one it just applied and deletes them. At the same time that this clean-up process was invoked, the first Enactor (which had been unusually delayed) applied its much older plan to the regional DDB endpoint, overwriting the newer plan. The check that was made at the start of the plan application process, which ensures that the plan is newer than the previously applied plan, was stale by this time due to the unusually high delays in Enactor processing. Therefore, this did not prevent the older plan from overwriting the newer plan. The second Enactor’s clean-up process then deleted this older plan because it was many generations older than the plan it had just applied. As this plan was deleted, all IP addresses for the regional endpoint were immediately removed. Additionally, because the active plan was deleted, the system was left in an inconsistent state that prevented subsequent plan updates from being applied by any DNS Enactors. This situation ultimately required manual operator intervention to correct.
1761415699121.png
 

WBahn

Joined Mar 31, 2012
32,878

Shocked, shocked that illegal gambling is happening with NBA players.
Shocked, shocked, who could have foreseen that making widespread sports betting legal could incentivize organized illegal exploitation of it.

Oh, wait, LOTS of people foresaw exactly this and opposed it for this very reason and were shouted down and everyone was told how this could be prevented.
 

Futurist

Joined Apr 8, 2025
765
I sit on my couch in the morning and peruse the world using my Surface tablet. Often, I have many (10+) tabs open, and when I go to select one of them, it accidentally gets closed, no questions, no confirmation prompts, just gone along with everything I was doing there, its easy to touch the little X when touching a tab.

Incredibly Chrome has no built in option for insisting on confirmation before closing a tab and every single tab related extension was ridiculously over designed (for example, defining a list of domains to be protected) or simply doesn't work.

This is the nature of today's software laden world, too much amateurish feeble dumb software everywhere, common sense is fading fast from our world.
 

schmitt trigger

Joined Jul 12, 2010
2,091
I sit on my couch in the morning and peruse the world using my Surface tablet. Often, I have many (10+) tabs open, and when I go to select one of them, it accidentally gets closed, no questions, no confirmation prompts, just gone along with everything I was doing there, its easy to touch the little X when touching a tab.

Incredibly Chrome has no built in option for insisting on confirmation before closing a tab and every single tab related extension was ridiculously over designed (for example, defining a list of domains to be protected) or simply doesn't work.

This is the nature of today's software laden world, too much amateurish feeble dumb software everywhere, common sense is fading fast from our world.
Most likely because the actual software development was outsourced to the cheapest bidder.
 

ElectricSpidey

Joined Dec 2, 2017
3,335
I sit on my couch in the morning and peruse the world using my Surface tablet. Often, I have many (10+) tabs open, and when I go to select one of them, it accidentally gets closed, no questions, no confirmation prompts, just gone along with everything I was doing there, its easy to touch the little X when touching a tab.

Incredibly Chrome has no built in option for insisting on confirmation before closing a tab and every single tab related extension was ridiculously over designed (for example, defining a list of domains to be protected) or simply doesn't work.

This is the nature of today's software laden world, too much amateurish feeble dumb software everywhere, common sense is fading fast from our world.
Have you tried "lock tab"?
 

joeyd999

Joined Jun 6, 2011
6,308
I sit on my couch in the morning and peruse the world using my Surface tablet. Often, I have many (10+) tabs open, and when I go to select one of them, it accidentally gets closed, no questions, no confirmation prompts, just gone along with everything I was doing there, its easy to touch the little X when touching a tab.

Incredibly Chrome has no built in option for insisting on confirmation before closing a tab and every single tab related extension was ridiculously over designed (for example, defining a list of domains to be protected) or simply doesn't work.

This is the nature of today's software laden world, too much amateurish feeble dumb software everywhere, common sense is fading fast from our world.
I hate confirmations.

I love history, CTRL-H.

Try it.
 
Top