Facebook Outage Caused by BGP Routing Error

cageymaru

cageymaru

Fully [H]
Joined
Apr 10, 2003
Messages
21,639
NETSCOUT has released a statement to BleepingComputer that the Facebook and Instagram outages were caused by a BGP routing error.

"'At approximately 12:52PM EST on March 13th, 2019, it appears that an accidental BGP routing leak from a European ISP to a major transit ISP, which was then propagated onwards to some peers and/or downstreams of the transit ISP in question, resulted in perceptible disruption of access to some well-known Internet properties for a short interval. While not malicious in nature, such events can prove disruptive on a widespread basis. It is very important that all network operators implement BGP peering best current practices (BCPs), including prefix-lists, max-prefixes, 'peer-locking' via AS-PATH filters, RPKI Origin Validation (RFC6811), and other techniques incorporated into the industry Mutually Agreed Norms for Routing Security (MANRS) detailed at .' -Roland Dobbins, NETSCOUT Principal Engineer"
 
L

Lakados

Supreme [H]ardness
Joined
Feb 3, 2014
Messages
7,341
I am pretty sure BGP is some sort of Voodoo magic that nobody properly understands.
 
K

Kelter

Limp Gawd
Joined
Dec 23, 2005
Messages
342
GSDragoon said:
How can we get more of these BGP errors and make them permanent to get rid of Facebook?
Click to expand...

Wasn't a BGP error.. BGP did exactly what it was designed to do. This was someone advertised the wrong routes which got propagated to all other routers with no safeguards in place. Seen this happen multiple times in the past with multiple carriers that don't even know they are responsible for region wide or in this case global outages.

Anyways, what's wrong with Facebook? I don't find any value in it, so I just don't use it... but why try to censor the internet for others? Disappointing that 15 years ago I could find all sorts of stuff on the internet.. now it's only what Google wants you to see.
 
O

Oldmodder

Gawd
Joined
Aug 24, 2018
Messages
706
I just want to know, did this make a spike in various statistics.
Probably not much, but i have a feeling if you turned off the top 3 social media for a week you would see a severe spike in some things.
 
P

purple_monster

Gawd
Joined
Jun 1, 2018
Messages
691
Ehren8879 said:
It's really not the most complicated routing protocol.
Click to expand...

I doubt 99% of the engineers who can explain BGP in an interview are able to confidently prepare or QC any actual ebgp changes and be willing to stamp their name on it(you Ehren8879 might be able to though, but im just saying).
 
The Mad Atheist

The Mad Atheist

[H]ard|Gawd
Joined
Mar 9, 2018
Messages
1,562
Damn, be pretty nice if they would go down every-time they ban someone because someone's feelings were hurt.
 
Twisted Kidney

Twisted Kidney

2[H]4U
Joined
Mar 18, 2013
Messages
3,867
Ehren8879 said:
It's really not the most complicated routing protocol.
Click to expand...

burn-the-witch_new.jpg
 
N

Nausicaa

Weaksauce
Joined
Mar 9, 2015
Messages
123
The Mad Atheist said:
My rant's here.
https://hardforum.com/threads/facebook-and-instagram-are-down.1978845/#post-1044120999
Pretty much if you believe in and follow the ideology of freedom and I said "fuck freedom", I get banned. But instead of freedom, I said Islam.
Click to expand...
I think its a false equivalent, but facebook is very irrelevant. nobody uses it, everyone is on snapchat or instagram. nobody wants to add anyone on facebook anymore. You don't miss anything but the end life of memes.
 
E

Exavior

[H]F Junkie
Joined
Dec 13, 2005
Messages
9,700
Oldmodder said:
I just want to know, did this make a spike in various statistics.
Probably not much, but i have a feeling if you turned off the top 3 social media for a week you would see a severe spike in some things.
Click to expand...

probably calls into ISP help desk and to 911. People seem to like to call 911 to report facebook being down and the police needing to fix that for some fucked up reason.
 
C

capnstabn

Gawd
Joined
Jan 6, 2006
Messages
534
purple_monster said:
I doubt 99% of the engineers who can explain BGP in an interview are able to confidently prepare or QC any actual ebgp changes and be willing to stamp their name on it(you Ehren8879 might be able to though, but im just saying).
Click to expand...

Sad thing is many of them still shoot from the hip on BGP changes. Thankfully their username is stamped on the audit log.
 
E

Exavior

[H]F Junkie
Joined
Dec 13, 2005
Messages
9,700
capnstabn said:
Sad thing is many of them still shoot from the hip on BGP changes. Thankfully their username is stamped on the audit log.
Click to expand...

too many places have a single account for everyone so I wouldn't hold my breathe thinking it is tracked that closely.
 
N

nyt

Limp Gawd
Joined
Jan 28, 2008
Messages
471
wasn't even bgp related.

7:43 PM EST: We were previously told that NETSCOUT felt a BGP routing issue was the cause of this outage. We are now being told that this BGP Routing issues was not related to the outage.
 
B

Biznatch

2[H]4U
Joined
Nov 16, 2009
Messages
2,224
How the hell did they get through all that security built into the updated BGP protocol?!!! Oh wait......
 
macksomerville

macksomerville

[H]ard|Gawd
Joined
May 18, 2000
Messages
1,983
Wasnt the last major big social outage a routing mistake as well? Hmmmmm sounds like a great attack vector for a state sponsor... Wanna make America 10x productive? DONT attack the social media giants ;)
 
S

SvenBent

2[H]4U
Joined
Sep 13, 2008
Messages
3,322
Kelter said:
Wasn't a BGP error.. BGP did exactly what it was designed to do. This was someone advertised the wrong routes which got propagated to all other routers with no safeguards in place. Seen this happen multiple times in the past with multiple carriers that don't even know they are responsible for region wide or in this case global outages.

Anyways, what's wrong with Facebook? I don't find any value in it, so I just don't use it... but why try to censor the internet for others? Disappointing that 15 years ago I could find all sorts of stuff on the internet.. now it's only what Google wants you to see.
Click to expand...


Who uses google?

Both facebook and google are on my do not use list.
i usedto sue google for thrower email accounts but no longer now the demand phone numbers to make an account... outlook.com does not woot
 
G

Guarana [BAWLS]

[H]ard|Gawd
Joined
Oct 3, 2001
Messages
1,952
Oldmodder said:
I just want to know, did this make a spike in various statistics.
Probably not much, but i have a feeling if you turned off the top 3 social media for a week you would see a severe spike in some things.
Click to expand...
Whines about social media, while on a social media platform.
 
W

wgm3446

Gawd
Joined
May 8, 2007
Messages
858
Bleeping Computer updated their article and retracted that it was a BGP error. HardOCP, please update your post with the correction. :)

"7:43 PM EST: We were previously told that NETSCOUT felt a BGP routing issue was the cause of this outage. We are now being told that this BGP Routing issues was not related to the outage."
 
You must log in or register to reply here.
Top