[HN Gopher] HN was down
___________________________________________________________________
HN was down
Author : jontro
Score : 365 points
Date : 2021-03-15 20:43 UTC (2 hours ago)
(HTM) web link (twitter.com)
(TXT) w3m dump (twitter.com)
| symisc_devel wrote:
| Hacker News is hosted at M5 and they are having a network outage:
|
| http://status.m5hosting.com/pages/incident/5407b8e2b00244251...
|
| edit: Unrelated to the Azure outage.
| fotta wrote:
| I'm surprised that a site as big as HN is only hosted in one
| place.
| cm2187 wrote:
| You should look at stackoverflow's hosting!
| aspectmin wrote:
| Is this described somewhere? :)
| cm2187 wrote:
| The most recent resource I found. I think they basically
| use a rack in one datacentre.
|
| https://meta.stackexchange.com/questions/10369/which-
| tools-a...
| giantrobot wrote:
| This is the newest version of their architecture I've
| seen [0]. Compare to an overview from 2009 [1].
|
| tl;dr StackOverflow's architecture is fairly simple and
| has done mostly vertical scaling (more powerful machines)
| and bare metal servers rather than virtual servers. They
| also realize their use patterns are read-heavy so there's
| a lot of caching and they take advantage of CDNs for
| static content which completely offloads that traffic off
| their main servers.
|
| [0] https://nickcraver.com/blog/2016/02/17/stack-
| overflow-the-ar...
|
| [1] http://highscalability.com/stack-overflow-
| architecture
| mwcampbell wrote:
| Running on a single server is cheaper, and nobody loses money
| if HN is down (as far as I know), so it makes sense.
| Sahbak wrote:
| Sometimes, it pays off being extremely simple. In HN, it
| definitely does
| mromanuk wrote:
| After this event, they should switch to two servers in
| different DC.
| centimeter wrote:
| Having two servers is a lot more than 2x as complicated
| and expensive as having 1 server.
| johannes1234321 wrote:
| When going to two you need to handle split brain some way
| probably, otherwise you end up with an database state
| hard to merge, thus you better get three, so two can find
| consensus, or at least an external arbitration node,
| deciding on who is up. At that point you have lots of
| complexity ... while for HN being down for a bit isn't
| much of a (business) loss. For other sites that maths
| probably is different. (I assume they keep off-site
| backups and could recover from there fairly quickly)
| ethbr0 wrote:
| I haven't run a ton of complicated DR architectures, but
| how complicated is the controller in just hot+cold?
|
| E.g. some periodic replication + external down detector +
| a break-before make failover that brings up the cold,
| accepting any unreplicated state will be trashed and
| rendering the hot inactive until manual reactivation
| johannes1234321 wrote:
| Well, there you have to keep two systems maintained, plus
| keep Synchronisation/replication working. And you need to
| keep a system running which decides whether to fail over.
| This triples the work. At least.
| [deleted]
| bpicolo wrote:
| There are plenty of sites where it's acceptable to be
| down for a bit sometimes.
| jsty wrote:
| Until 2018 at least it was ... wait for it ... a single
| server!
|
| https://news.ycombinator.com/item?id=18496344
|
| (Anyone know if that's still the case?)
| dang wrote:
| One production server and one failover (in the same data
| center, obviously).
| Aperocky wrote:
| HN is probably very small. Curious as to the minimum size of
| the backend that will hold up the website.
|
| There may need to be read replicas, but maybe not even that
| is needed.
| _joel wrote:
| They only have one server, iirc.
| voxadam wrote:
| And, if I'm not mistaken, the site is single threaded.
| aspectmin wrote:
| Would love to see the HN architecture.
| mike_d wrote:
| Single threaded LISP application running on a single
| machine. Ta-da.
| krapp wrote:
| arclanguage.org hosts the current version of Arc Lisp,
| including an old version of the forum, but HN has made a
| lot of changes locally that they won't disclose for
| business reasons.
|
| There's an open source fork at
| https://github.com/arclanguage/anarki, but it doesn't
| have any direct relationship with HN.
| dang wrote:
| It's about the same as what Scott described here:
| https://news.ycombinator.com/item?id=16076041
|
| But we get around 6M requests a day now.
| fotta wrote:
| Wow, that's not as big as I thought then. What's the
| average peak rps?
| bombcar wrote:
| Maybe standby should be in another rack, perhaps even
| another datacenter.
| dang wrote:
| That would be the natural next step, but it's a question
| of whether it's worth the engineering and maintenance
| effort, especially compared to other things that need
| doing.
|
| For failures that don't take down the datacenter, we
| already have a hot standby. For datacenter failures, we
| can migrate to a different host (at least, we believe we
| can--it's been a while since we verified this). But it
| would take at least a few hours, and probably the
| inevitable glitches would make it take the better part of
| a day. Let's say a day. The question is whether the
| considerable effort to build and maintain a cross-
| datacenter standby, in order to prevent outages of a few
| hours like today's, would be a good investment of
| resources.
| cesarb wrote:
| > For failures that don't take down the datacenter, we
| already have a hot standby. For datacenter failures, we
| can migrate to a different host (at least, we believe we
| can--it's been a while since we verified this).
|
| It might be a good idea to verify it; see the recent
| events at OVH
| (https://news.ycombinator.com/item?id=26407323).
| Aperocky wrote:
| Question: what is the other things that need doing?
|
| Obviously does not apply to engineering effort outside of
| hacker news website, which the team might be working on.
|
| But this forum has seen little change over the years and
| it's pretty awesome as is.
|
| (Though I didn't use HN api too much so not sure what's
| going on that side).
| phpnode wrote:
| Team is maybe a bit of a generous term to describe dang!
| skissane wrote:
| What was the motivation in choosing FreeBSD?
|
| (Just so nobody misinterprets my question, nothing wrong
| with FreeBSD, I know other stuff also runs on it like
| Netflix's CDN. Still always interested to hear why people
| choose the road less travelled)
| tlb wrote:
| RTM, PG and I used BSDI (a commercial distribution of
| 4.4BSD) at Viaweb (starting 1995) and migrated to FreeBSD
| when that became stable. RTM and I had hacked on BSD
| networking code in grad school, and it was far ahead of
| Linux at the time for handling heavy network activity and
| RAID disks. PG kept using FreeBSD for some early web
| experiments, and then YC's website, and then for HN.
|
| FreeBSD is still an excellent choice for servers. You may
| prefer Linux for servers if you're more familiar with it
| from using it on your laptop. But you use Mac laptops,
| FreeBSD sysadmin will seem at least as comfortable as
| Linux.
| dang wrote:
| I don't know, because that decision dates back to pg and
| rtm and probably Viaweb days. We like it.
| ethbr0 wrote:
| Pragmatic engineering: What will this change enable me to
| do that I cannot do now? Does being able to do that solve
| any of my major problems? (If no, spend time elsewhere)
| 1vuio0pswjnm7 wrote:
| HN is also available through Cloudflare but that seems to
| depend on M5.
|
| Don't take my word for it. Test it for yourself:
| printf 'GET / HTTP/1.1\r\nHost:
| news.ycombinator.com\r\nConnection: close\r\n\r\n' \
| |openssl s_client -connect cloudflare.com:443 -ign_eof
| -servername news.ycombinator.com
| slig wrote:
| Cloudflare only proxies dynamic websites.
| dang wrote:
| We stopped using Cloudflare a few years ago.
|
| https://news.ycombinator.com/item?id=18188832
|
| https://news.ycombinator.com/item?id=21799045
| nodesocket wrote:
| Not sure why HN would still be a hosted at a 3rd tier provider.
| A few EC2 instances (multi-zone) behind a application load
| balancer should do the trick.
| colinmhayes wrote:
| Because it doesn't make any money
| nodesocket wrote:
| Who cares it's a few hundred a month to host on AWS
| mike_d wrote:
| Then where will people go to learn about AWS outages?
| heavyset_go wrote:
| YC's companies get free advertising and job listings on the
| front page.
| mike_d wrote:
| You just described not making money.
| peanut_worm wrote:
| And now it looks like there is an outage at reddit
| mikiem wrote:
| Founder and CEO of M5 Hosting here. We did have a network outage
| today that affected Hacker News. As with any outage, we will do
| an RCA and we will learn and improve as a result.
|
| I'm a big fan of HN and YC in general, we host of other YC alum,
| and I have taken a few things through YC Startup School. During
| this incident, I spoke to YC personay when they called this
| morning.
| 1vuio0pswjnm7 wrote:
| It did not seem to affect the Firebase feed.
| rattray wrote:
| Is HN fully back? Looks like this was a little less than 3 hours
| total, is that right?
| dang wrote:
| Between 3 and 3-1/2 hours to judge by when PagerDuty stopped
| bugging me. I was working on code and someone had to tell me it
| was back up.
| rattray wrote:
| Thanks! (And thanks for all your hard work!)
| bombcar wrote:
| So strange that this coincided with Azure authentication eating
| it.
| mikiem wrote:
| Unrelated issues, but I did hear from our other clients that
| O365 was having issues at the same time as our network outage
| affected HN and many others.
| spondyl wrote:
| I didn't notice unfortunately due to the Azure outage blowing
| everything up :(
| fabbari wrote:
| It's seems an odd coincidence of this and the Azure AD outage --
| I was trying to get to HN to see what people were saying about
| it!
| PenguinCoder wrote:
| Definitely. My thought was "HN is hosted on Azure"? So I went
| looking into their hosting provider, and lo, they were down
| too. M5 might be Azure hosted... couldn't confirm that.
| deadmetheny wrote:
| Good to see posting purely for karma isn't just a Reddit thing.
| yawnxyz wrote:
| my fingers automatically just start typing in "news.y" when I'm
| idle, I definitely didn't know what to do when greeted with a
| 404!
|
| Is there any way to put the HN homepage on an edge cache so at
| least the homepage shows up? Or am I admitting that I'm addicted
| to checking HN too many times a day?
| h2odragon wrote:
| Admitting you have a problem is the first step to recovery,
| right? I'm sure I've heard that. Dunno how it's supposed to
| help.
| rossdavidh wrote:
| Yes, that's what you're admitting. :) Not that you're alone in
| that...
| theshrike79 wrote:
| Just don't type "news." and hit enter, it'll redirect to some
| domain squatter crap and it'll be stuck in your autocomplete
| for a while =)
| breckinloggins wrote:
| It's gotten so bad for me that I'm down to just "n". I think I
| have a problem.
| axaxs wrote:
| LOL, same. In fact, every site I visit often is one char +
| enter in the browser. With the exception of W, being east of
| the Mississippi every station starts with W.
|
| That got me to thinking about 'first letter advantages.' If a
| site has a first letter not currently in use, I'm much more
| likely to visit it more often(mostly out of boredom, sure).
|
| V and X are still available if anyone is wondering. Zillow
| got Z!
| madjam002 wrote:
| Oh man this hits home so much
| jrockway wrote:
| I used to use a web browser with Emacs keybindings, so
| visiting a URL was the same keystroke as opening a file. I'd
| type "C-x C-f news.ycombinator.com" quite regularly, and my
| fingers still go to that "n" when I visit a file in Emacs.
| slater wrote:
| i was gonna say, check out that n00b that has to type all the
| way to "news.y" for the browser autocomplete! :D
|
| /s
| alvatech wrote:
| I think I have tried to visit HN for more than 10 times in last 2
| hours and failed. This made me realize how much I'm addicted to
| HN
| IndySun wrote:
| >more than 10 times in last 2 hours
|
| You could utilise the noprocrast option in your HN settings.
| alvatech wrote:
| Didn't know that this feature existed. I enabled it.
| jorl17 wrote:
| I keep 3 pinned tabs in my browser:
|
| - Reddit (my main source of addiction)
|
| - HackerNews (the second source of addiction)
|
| - Cookie Clicker (a rather recent addition that I'm slightly
| embarassed of)
|
| At a point in time I also had facebook, but I've since stopped
| going there (maybe once a week).
| ghgdynb1 wrote:
| I used HN to quit Reddit and I must say it's been a change
| for the better.
| wave100 wrote:
| I'm not sure if this is still a thing, but at one point you
| could open up a JS console on cookie clicker and run
| game.ruinTheFun() to unlock everything. :)
| ethbr0 wrote:
| Just wait until you find out Reddit and Cookie Clicker have
| the same endgame...
| willis936 wrote:
| Just cheat. It'll break the spell quickly.
|
| Also, check out universal paperclips if you haven't already.
| it has a definite end. You likely won't play more than maybe
| 10-20 hours.
| mikewarot wrote:
| I played Universal Paperclips, and converted a HectoVerse
| (100 Universes) to paperclips.
|
| Long covid sucks.
| StrictDabbler wrote:
| Universal Paperclips is the cure for all other clicker
| games.
|
| Once you've played a fair and truly exponential clicker
| through a few times you can't tolerate the forced linearity
| of a pay-to-win clicker app.
| jorl17 wrote:
| Alas, I am OP, the one with the Cookie Clicker tab, and I
| came to Cookie Clicker after Universal Paperclips:
| https://news.ycombinator.com/item?id=26469366
|
| I have to say that UP was definitely a much better
| experience.
| SolarNet wrote:
| Spaceplan is a pretty fun and slightly comedic play through
| one as well http://spaceplan.click/
| jorl17 wrote:
| I've played Universal Paperclips from start to finish 4
| times! I loved it. In fact, I loved it so much the last
| time around that I wanted to have another game "somewhat
| like it" in the background -- that's where the recent
| Cookie Clicker tab came from.
|
| I always recommend Universal Paperclips to people who don't
| like cookie clicker games, because I fell in love with it
| the first time I tried it (heard of it from the Hello
| Internet podcast)
| marshmallow_12 wrote:
| I was scared Dang had blocked me
| app4soft wrote:
| > _I think I have tried to visit HN for more than 10 times in
| last 2 hours and failed._
|
| Mee too!
|
| > _This made me realize how much I 'm addicted to HN_
|
| I sought that my IP was shadow-banned by HN...
| [deleted]
| 2bitencryption wrote:
| Azure AAD also had an outage at this time - perhaps linked in
| some domino effect, or perhaps a coincidence?
|
| https://status.azure.com/en-us/status
| SigmundA wrote:
| Wondering this too, Teams started going came to HN to get
| commentary and it was down too.
| bombcar wrote:
| Looks like it was a coincidence - unless Azure auth going down
| shut off a rack in San Diego.
| williesleg wrote:
| Looks like a startup opportunity
| koolba wrote:
| The title should be updated to " _Productivity was up_ ".
| j_walter wrote:
| Not sure that is true...trying to find other info as to why HN
| was down led to more productivity lost here
| bombcar wrote:
| Can't sign into Azure Portal, let's check HN, oh that's down
| too, hmm is my internet up ...
|
| Huge rabbit hole
| [deleted]
| MattGaiser wrote:
| With Azure also going down, lots of people were probably
| scrambling to figure out what blew up.
| drusepth wrote:
| HN is one of the few sites I always keep zoomed-in (around 200%),
| which led to me finding an interesting bug in Chrome while HN was
| down: Chrome's internal "This site can't be reached" page uses
| the zoom level of the site you would be visiting (if it were up),
| rather than Chrome's default zoom.
|
| Screenshot: https://i.imgur.com/VwFtgQh.png
| gkoberger wrote:
| Is that really a bug?
| taeric wrote:
| Feels like it to me. I'd expect the zoom to be associated
| with the site.
|
| Granted, I am probably importing old thoughts of it being a
| sort of user provided style sheet.
| forgetfulness wrote:
| It'd make the zoom level you see jump up and down depending
| on whether you lose your connection or regain it, this is
| less jarring.
|
| You could say that Chrome is designed to tie the zoom level
| to the viewport but I wouldn't count on this behavior
| springing up from an underlying design and implementation
| rather than it being a design choice for the user
| experience.
| hn_throwaway_99 wrote:
| > I'd expect the zoom to be associated with the site.
|
| That's what the GP comment said happened: the zoom level
| was the one associated with what they previously had set on
| HN, and they expected it to be the opposite, the default
| zoom level for the browser.
| ncallaway wrote:
| I would consider the browser's built-in page for "I
| couldn't load news.ycombinator.com" to be a separate site
| from "news.ycombinator.com".
| taeric wrote:
| But the site didn't load. My browser's not loading page
| did.
|
| Is easier to see as broken by thinking of "how could I
| set it so that my browser's error page has a default
| zoom?"
| derefr wrote:
| But your browser's connection-failure page is considered
| to come from the HTTP Origin of the site. It's like when
| browsers receive a specific HTTP status-code (e.g. 500)
| with no body, so they render a default HTML error
| document.
|
| In both cases, those are the browser supplying a
| _resource representation_ , while still technically being
| on the _resource_ specified in the navigation bar. The
| thing you 're seeing is an overridden representation of
| the server's response. (Which, in this case, just
| happened to be "no response.")
|
| It's almost exactly the same as how the server sending a
| 304 gets the browser to load the document from cache. The
| server's actual _response_ was a 304; but the browser 's
| _representation_ of that response is the cached HTML DOM
| it had laying around from the last 2xx resource-
| representation it received "about" the same resource.
| jxramos wrote:
| I think the zoom level for Chrome is global per window at the
| least, it's definitely not per tab.
| graedus wrote:
| it's per subdomain i think.
| jxramos wrote:
| oh indeed it is, wow that's subtle, always escaped me
| where the focused setting applied. In that case yah
| probably a bug.
| jdoliner wrote:
| It would be cool if zooming in / out on the T-Rex game caused
| it to switch your character to larger / smaller dinosaurs.
| losvedir wrote:
| what's the t-rex game?
| nkozyra wrote:
| Game you get when the network is unavailable in chrome
| Barrin92 wrote:
| minigame built into chrome you can play when you're
| offline, or alternatively go to chrome://dino
| alisonatwork wrote:
| Edge has one too at edge://surf
| Shared404 wrote:
| There's also an extracted version of it on Github for
| those of us who use Firefox.
| neom wrote:
| hit space bar when offline in chrome, ps: addictive.
| 1f60c wrote:
| You're one of today's lucky 10,000!
| sgrove wrote:
| We have a version of it we adapted so that the t-rex has to
| jump over npm packages as they're being published in real-
| time!
|
| https://www.onegraph.com/docs/subscriptions.html (it'll
| load in at the top of the page)
| WalterSear wrote:
| The Trex game really needs a meteor animation when the
| connection is re-established.
| denysvitali wrote:
| Give this man a PM role at Google Chrome!
| Gaelan wrote:
| They even have the artwork! It's used when the game is
| disabled by ~~fun-hating sysadmins~~ enterprise policy.
| lukec11 wrote:
| Firefox does the same, as I discovered - I don't know whether
| it's a bug or intended functionality.
|
| (As an aside, I keep HN at 150% and old reddit at 120% - those
| are the only 2 sites I have permanently zoomed)
| redisman wrote:
| It's part of the charm. Unusable on retina without zooming
| (at least with my eyes).
| _Microft wrote:
| Either a bug or an over-eager member of the Mozilla UX team
| had actually filed a bug with a _feature-parity Chrome_ tag
| on it in BMO.
| vram22 wrote:
| Bug-parity. Not even odd parity.
| vram22 wrote:
| You could say I _pun_ ted.
| jedberg wrote:
| FWIW Safari doesn't have this bug (I too keep HN zoomed at 200%
| for some reason).
| chirag64 wrote:
| I noticed the same behavior in Firefox as well. I wouldn't
| consider this as a bug though
| dkersten wrote:
| I consider that a feature, not a bug. I typically do all
| browsing zoomed in somewhat and I expect the "page can't load"
| to also be zoomed. Or am I misunderstanding what you're saying?
| interestica wrote:
| Chrome used to store 'zoom level' for URLs even if you were in
| incognito mode: and in plain text. Not sure if it still
| does.... (if you changed the zoom level for a site while in
| incognito from the default, it would save the value and the
| associated URL).
| marshmallow_12 wrote:
| not anymore. it does it the other way 'round though, which
| can be frustrating.
| TeMPOraL wrote:
| Same with Firefox. I have HN at 190%, and got startled by the
| error message being so. big. and. weird.
| RaketenStadt wrote:
| The font-size on HN is barely readable, I'm working on an
| accessible skin for the HN frontend that addresses this.
|
| I'm targeting WCAG 2.0. Keep an eye out for the "Show HN"
| coming soon!
| p1necone wrote:
| Are you using a high dpi monitor but not using > 100% display
| scaling in your OS or something? It's roughly the same size
| as most other sites for me.
|
| (And pretty much all browsers have a zoom function for
| exactly this, it feels like a totally separate frontend would
| be more hassle to use than just ctrl + scroll wheel once)
| neltnerb wrote:
| I've found Linux to handle scaling pretty inconsistently;
| I've got a 4K television I connect my computer to and if I
| tell it to scale 200% in the monitor configuration most
| things get scaled nicely, but random stuff (especially
| proprietary stuff) doesn't know what to do.
|
| It worked much better to just tell it to output 1080p and
| let my television scale it... less graphics memory too. I
| still need to scale HN up relative to other sites in order
| to read it though.
|
| If I compare the text of your comment to the text of an
| article on npr.org it seems like about the same as the
| difference between 9pt and 12pt, and they are using a serif
| font that seems to be a lot easier to read.
|
| It's a style choice I guess? It seems like it would work
| best on a large 1080p display, so maybe that's just what
| the person who designed the layout was using.
| RaketenStadt wrote:
| No I'm not. The font-size for most text on the site is 10pt
| and 9pt.
|
| Zoom doesn't fix line lengths of 1500 characters and
| terrible color contrast.
|
| The link to the site guidelines is 7pt with a contrast that
| fails WCAG 2.0. No wonder no one reads them.
| TylerE wrote:
| On Win10 with default settings, fonts on most sites are
| totally comfortable to me.
|
| HN is readable - just - but it's definitely on the small
| side.
|
| The complete lack of some sort of horizontal constraint
| doesn't help either. 200 character lines are no bueno for
| reading.
| [deleted]
| drusepth wrote:
| It's the only site I have problems with, tbh. Stylesheet
| says it's supposed to be 10pt (with comment text dropping
| down to 9pt), which is even smaller than the too-small 12pt
| font that gets recommended a lot.
| Lammy wrote:
| I've come to enjoy using a high DPI monitor without display
| scaling as a way to counteract the huge amount of
| whitespace in modern UIs, coupled with content zooming so
| words are still actually readable :)
| https://addons.mozilla.org/en-US/firefox/addon/zoom-page-
| we/
| aritmo wrote:
| There was a noticeable increase in productivity during the last
| hour or so.
| tpowell wrote:
| I've been on this site 12+ years, and I don't ever remember it
| being down. I assumed we were under nuclear attack.
| southerntofu wrote:
| Who needs so many 9's when there's actually interesting content
| we keep coming back for?
| ibraheemdev wrote:
| It says a lot that @hnstatus has not tweeted since 2018.
| dangwu wrote:
| @HNStatus tweeted about the outage 3 hours ago.
| TheRealNGenius wrote:
| That's the point...
| dangwu wrote:
| Ah, my bad. I was wrongly interpreting OP's comment.
| protomikron wrote:
| Curious, what is the uptime of HN - is there some data about
| that?
|
| My guess is around 99.9% ... but maybe that's too optimistic?
| [deleted]
| simonebrunozzi wrote:
| Why too optimistic?
|
| Probably closer to 4 9s.
|
| With this outage of ~2 hours, we are at ~99.97% for this year.
| (I am not aware of any other downtime during 2021)
|
| Rule of thumb (I strongly prefer minutes/year instead of 9s, to
| get an immediate sense of how good the availability is):
|
| 99.9% : down for 525 minutes / year, or roughly ~10 hours
|
| 99.99% : down for 52 minutes / year, or roughly ~1 hour
|
| 99.999% : down for 5 minutes / year
| ibraheemdev wrote:
| > Back now. Got to write some code for a change... - 5:39
|
| https://twitter.com/HNStatus/status/1371576822748487683
| tartoran wrote:
| Seeing HN unresolved was a bit weird as it is the best performing
| site I ever visit on my low bandwidth phone so several times I
| thought the problem was on my end. But in the end it helped me
| realize how frequently I dial into HN while it was down. I have a
| bit of a problem and I think I need to turn on that no
| procrastination flag on.
| hnrodey wrote:
| Had me quite confused because I'm also having home internet
| issues. I was trying to get my laptop to switch to my mobile
| hotspot and HN is one of the sites I used to test connectivity
| because a) it's almost always available and b) loads very quick.
|
| A bit of a mindfuck trying to assess my actual internet
| connectivity via a site that was also down : )_
| aasasd wrote:
| The common method of testing connectivity is opening Bing.
| Because it's guaranteed to not be cached in the browser.
| nhylated wrote:
| Found some use for Bing!
| divbzero wrote:
| Ditto. HN is so reliable and light on JavaScript that I
| typically use it to test my connection. I thought my connection
| was down earlier but guess this was the rare case where it was
| HN.
|
| (Other comments suggest it was a network outage at M5 where HN
| is hosted.)
| blakehaswell wrote:
| Me too. I was trying to browse HN on my phone earlier and my
| first instinct was that my WiFi was having a moment. It's a
| testament to how reliable HN is.
| k__ wrote:
| I was trying to read some news while training in the basement,
| where I don't have very good Wi-Fi. Usually HN is one of the
| pages that work better down there, haha.
| coding123 wrote:
| I never expect HN to be down... I asked my wife - hey is the
| internet down? She said - no, it's working for me. I clicked on
| another site and my mouth dropped.
| deepsun wrote:
| If only they used Kubernetes! /s
| nickthemagicman wrote:
| This site is so reliable, I thought my I.P. had gotten banned.
| vincentmarle wrote:
| We also had issues with our YC application earlier today, was
| that related to this issue?
| tomxor wrote:
| Funny, my first thought was "oh no they've blacklisted VPNs",
| can't remember when HN was ever down!
| kenm47 wrote:
| It's 3pm.... do you know where your servers are?
| PhilosAccnting wrote:
| I have a massive learning project[1], and I think 2/3 of my "to
| get through as soon as sensible" content is news.ycombinator
| links.
|
| Needless to say, this site is my own personal StackOverflow, and
| I think there's something about ingratitude bouncing around in my
| mind somewhere.
|
| [1]https://github.com/PhilosAccounting/ts-learning
| bfostbfostbfost wrote:
| Wow, looks like a wealth of knowledge. Forked it for myself,
| only for reference, hope that is ok. Just seems like a ton of
| great info that I'd love to comb through myself. Cheers.
| PhilosAccnting wrote:
| Totally okay, though I added the PDFs/videos to gitignore.
| I'm mildly paranoid about IPs[1]!
|
| [1]https://gainedin.site/ip/
| bfostbfostbfost wrote:
| Makes sense, well I will be following the TechSplained
| project, good luck!
| 0xbadcafebee wrote:
| Since I couldn't get to HN, I wrote up how to make the site
| resilient to outages:
| https://gist.github.com/peterwwillis/ce2bfaba7fc72e4af44c281...
|
| tl;dr 1 server x 2 providers, different regions, replicate
| content
| [deleted]
| [deleted]
| tempestn wrote:
| Is this related to the big Microsoft outage?
| enobrev wrote:
| The one time I'm actually reading HN for actually relevant
| information for actual work, it's down for half a day. Made for a
| great excuse to take a nap.
| JasonFruit wrote:
| I thought pg posted "Memphis".
| fotta wrote:
| Something that I learned from this is that HN has a status
| Twitter. Rarely used though, which is a testament to the team.
|
| https://twitter.com/HNStatus/status/1371525940656803848?s=20
| EasyTiger_ wrote:
| Only they never posted anything during the outage there
| fotta wrote:
| Unsure what you mean there, as the linked tweet was from 4h
| ago.
| edub wrote:
| they did, if you click on the link in the post you replied
| to, you'll see it is a link to their post from today about
| the outage.
___________________________________________________________________
(page generated 2021-03-15 23:00 UTC)