Salesforce Global Outage

(status.salesforce.com)

99 points | by mabil 2 hours ago

32 comments

  • raffraffraff 1 hour ago
    Have you tried turning it off and then on again?

    > We're no longer pursuing restarts as a path to remediation.

    Oh you have

    • cube00 32 minutes ago
      Kind of surprised they admit they're going to try restarting and see what happens. I'm sure it happens everywhere but nobody admits it.

      > We've attempted a rolling restart on one of the impacted instances to see if that resolves the issue.

      At least it didn't fix the problem so they can actually start finding the real cause.

      > We're no longer pursuing restarts as a path to remediation.

      This is a good example of why isn't the AI they sell telling them what's wrong? Why do they need to try restarting and "see if that resolves the issue"

      • andrewinardeer 22 minutes ago
        "Yeah, I'm with Rob. Just let's reboot and see what happens"
  • mergy 39 minutes ago
    Unplanned outage timing is never good but this is really not good.

    https://www.salesforce.com/dreamforce/

    Sept 15-17

  • fhub 38 minutes ago
    Cause: Legacy Salesforce login service got into a resource-exhaustion cascade.

    Fix: Rolling some unspecified fix they proved in testing out over the fleet seemingly very slowly (After their earlier attempts to roll something out faster failed).

    Details at https://status.salesforce.com/incidents/20004433

  • chasd00 1 hour ago
    You can click on any of the instances and then the service that is down to read the updates. It’s not 100% clear but some sort of issue with a “legacy login service”. The latest updates say a fix is rolling out.
  • cyberpunk 2 hours ago
    That status page is the most salesforce thing ever.

    Scroll down. >_<

    • sunrunner 1 hour ago
      Wow, it's almost as long as the Every UUID V4 or Every Floating Point Number pages.
    • dgellow 2 hours ago
      I see tabs with a spinner loading infinitely, which is indeed very salesforce like
    • troupo 1 hour ago
      It lists all instances, you can drill down into each one of them, see which services are affected, and each affected service pops up the incident timeline?

      Isn't it actually amazing, and not "the most salesforce thing ever"?

    • chrisjj 1 hour ago
      Yup. No mention of outage. Even drilling down gets nothing more than "Service Disruption".
    • santoshalper 2 hours ago
      At least they're consistent about UX. My only complaint is that it needs more tabs.
  • AmazingTurtle 1 hour ago
    You better bet someone started their agents with a prompt "Make a salesforce clone but with 100% uptime"
    • Bluestein 1 hour ago
      "Make a salesforce clone but with 100% uptime"

        ⎿  You've hit your session limit · resets 2:53am (123°24′W Etc/GMT+8)
        /upgrade to increase your usage limit.
  • arionmiles 2 hours ago
    This is certainly a unique status page.
  • alienbaby 1 hour ago
    Haven't they got some kind of new fancy ai interface they can use to fix it?
  • danjc 1 hour ago
    It's dns isn't it
    • bearjaws 43 minutes ago
      Feel like it has to be for all of this to go down at the same time.
    • Bluestein 1 hour ago
      It's always DNS.-
      • ajross 9 minutes ago
        More like 70% human-configured DNS, 25% human-configured routing configuration, 5% interesting software bug.
    • ghusto 1 hour ago
      No, IPv6
    • afr0ck 1 hour ago
      Classic
  • adamw2k 2 hours ago
    Perfect timing with Dreamforce this week.
  • ssk42 1 hour ago
    My gut instinct is that this is about when all of their on prem servers were EOL and their /public cloud solution was required. This must have had something to do with that
    • BoorishBears 1 hour ago
      My gut instinct is that this is about Dreamforce with the rickshaws and whatnot
  • ownerr 1 hour ago
    Here is link to incident details: https://status.salesforce.com/incidents/20004433
  • lrvick 29 minutes ago
    Seems it is back up now. Damn.
  • jtrn 1 hour ago
    And nothing of value was lost. God, I hate everything about Salesforce. Sometimes I have to integrate against their services, and it is always a pain, not to mention what the core project actually is: optimization of marketing and spam.
  • mariopt 1 hour ago
    Could it be people doing Claude/GPT automations and they just can't handle it?
  • voidUpdate 1 hour ago
    Wow, the intern must have tripped over a very big power cable this time
  • cmiles8 1 hour ago
    Dreamforce, wake up. You’ve overslept!
  • Havoc 1 hour ago
    So I guess today everyone gets actual work done
  • monkeydust 1 hour ago
    Sam speaks at Salesforce.

    Salesforce goes down.

    No causation here...move on.

    • hgoel 27 minutes ago
      Wasn't it Dario
  • aeneas_ory 1 hour ago
    It’s akways DNS or login
  • jackdecker 1 hour ago
    Ah yes. Exactly what a status page should look like: an endless list of random ID’s that don’t mean anything and no information whatsoever

    At least salesforce is consistent with their design language

    • chasd00 1 hour ago
      > random ID’s that don’t mean anything and no information whatsoever

      If you use salesforce you know what all of that stuff means. Just click on one, it’s not rocket surgery.

      • jackdecker 1 hour ago
        Was really just poking fun at them - AWS’s status page isn’t much better
    • BoorishBears 1 hour ago
      Looks like a region list to me, maybe just with a lot of regions
  • theshrike79 1 hour ago
    Was it DNS? Any guesses? :)
    • dude250711 51 minutes ago
      Vibe-slop, push to Prod?
      • geerlingguy 18 minutes ago
        They let their agentic AI take over system maintenance at Dreamforce yesterday like they were pushing in the talks

        /s (partly)

  • sparkling 1 hour ago
    Remind me please, what are folks currently paying per seat for this glorified CRUD app?
    • warmedcookie 1 hour ago
      It's this thing called golf course driven development
    • raverbashing 1 hour ago
      If I had been just out of Uni I would think this is edgy

      Now I'm just glad I'm not responsible for this fire

  • themgt 1 hour ago
    Never before in the history of global compute outages was so little lost by so many down servers, whose purpose was known to so few.
  • dboreham 2 hours ago
    At least now we can figure out what Salesforce does.
    • sunrunner 1 hour ago
      "And in tonight's news, the worldwide CRM solution Salesforce had a global outage affecting one hundred percent of its customer base. We interviewed users of the service to find out the scope of the impact. Everyone agreed that they were impacted, but strangely, nobody could describe _in what way_ they were affected."
  • danvesma 1 hour ago
    "Trust just got personal!"
  • gjvc 2 hours ago
    fucked
  • WhenItRuns 33 minutes ago
    [flagged]
  • irregularbowels 20 minutes ago
    [dead]
  • sick_of_slop 1 hour ago
    [dead]
  • fr2029 1 hour ago
    [dead]
  • mannycalavera42 1 hour ago
    [flagged]
    • alienbaby 1 hour ago
      Status page is still showing all red tho