eMudhra to Exit Global SSL/TLS Certificate Business

(emudhra.com)

296 points | by bo0tzz 1 hour ago

51 comments

  • tetha 1 hour ago
    > He added that global SSL/TLS is a small part of eMudhra’s business contributing to about 1% of the global revenue

    Good that we are now investing thousands of engineering hours globally to fix this.

    Several tech stacks require upgrades of their runtime, python is an ungodly mess with certifi, but yes. It's just 1% of your revenue.

    Sorry, it's been a long week.

    • post-it 1 hour ago
      Yes, but in the end that's not their fault, and in a sense it's good that this happened. It was well understood from the invention of security certificates that private keys might leak and certificates will need to be revoked. Systems that were not designed with this in mind should never have been deployed, and should now be decommissioned and replaced.

      It might even be sensible to intentionally revoke a small number of certificates every month, to make sure nobody is complacent.

      • throw0101c 40 minutes ago
        > Yes, but in the end that's not their fault, and in a sense it's good that this happened.

        I am reminded of the US DST changes back in the 2000s: there was all sorts of drama because a lot of software is written in the US, and there was much 'computerization' in the 1990s, but US coders had never personally experienced a DST rule change during that time period, so any change needed a reboot to pick up the new rules.

        That drama led to (e.g.) periodic dynamic checking of /etc/localtime on various Unix-y system.

        Sometimes you don't realize that things can be improved until to experience situations in which they currently suck.

        • kccqzy 27 minutes ago
          Tell Congress to change the rules again soon, lest a new generation of programmers become complacent and hardcode transitions again. Many current junior programmers don’t remember the 2000s rule change.

          I can even hear this conversation happening: what? I need to open this America/Los_Angeles file just to convert a timestamp? What pretentious overengineering! I want a single-file executable with zero dependencies. Let me hard code the rules.

      • ryukoposting 33 minutes ago
        The number of awesome things we're going to get as a result of this is exciting to think about.

        My wife bought this fuckass IoT air purifier that's constantly phoning home. I'm gonna figure out what it's telling the mothership.

      • Zobat 44 minutes ago
        Google has decided to stop trusting certificates with dual purpose (server and client) and managed to negotiate a decrease in the maximum (SSL/TLS) certificate lifetime because certificate revocation doesn't work.

        We've had to rework part of our application and certificate use because of this.

      • hobofan 43 minutes ago
        Kind of what Let's encrypt did for automating certificate rotation.

        Let's call it "Let's Decrypt!"

      • shadowgovt 8 minutes ago
        Honestly, that's not a bad idea at all. That's exactly the kind of thing that companies like Google do in disaster recovery testing.

        If you don't know if you can hot-swap your certs, you probably can't.

      • hluska 44 minutes ago
        > It might even be sensible to intentionally revoke a small number of certificates every month, to make sure nobody is complacent.

        No, this is not even remotely sensible.

        • noitpmeder 38 minutes ago
          Failure paths that are not exercised with regularity will inevitably fail in surprising ways when actually needed.
        • sophacles 37 minutes ago
          It really is. It's basically chaos monkey for pki.

          Code paths and procedures that aren't exercised regularly are broken.

          Even better is having a way to reoke keys and big players occasionally include revoked keys in trust chains and blast a warning if the revoked key is considered valid.

    • blmarket 26 minutes ago
      It rages me as well. Some random attacker could have MITM attack any https website without being noticed by anyone(including eMudhra), surely it won't contribute any to their revenue!
    • mixdup 1 hour ago
      I mean, yeah I get your point but also if these pieces of the stack weren't prepared to deal with a compromised CA, then they were also at least a little bit negligent. There's always a chance this is going to happen. There's a chance it could happen and there not be any negligence or incompetence on the part of the CA

      But at the end of the day if you're not prepared to revoke the trust of any CA you trust, it's a you problem

      • purplesyringa 53 minutes ago
        As I understand it, the reason for so much work is that eMudhra was not a root CA. It wasn't added to any official root CA list, instead it was signed by a different root CA with the assumption that eMudhra will complete the work required to become a root CA and this hack will become unnecessary. This is a common, temporary process. So while all the mechanisms for root CA revocation were in place, no one was quite prepared for intermediate certificate revocation.
        • mixdup 29 minutes ago
          Take out the word root from my original reply. If you aren't prepared to immediately stop trusting a CA--root, intermediate, internal, then your process is broken

          "no one was quite prepared for intermediate certificate revocation" is actually worse because as an intermediate CA, they obviously didn't meet the requirements to be a full root CA, so why wouldn't they be more likely to need revocation than a root? Honestly more negligent than being unable to revoke a root.

        • trvz 48 minutes ago
          The root CA should have been revoked then.
        • intorio 29 minutes ago
          This is just wrong though, they were a root CA. There was cross-signing which is typical, but their `emSign ECC Root CA - G3` root certificate was in most CA bundles.
      • andix 56 minutes ago
        Good point. I get why some stacks use their own trust stores and not the system trust store. But there should be some mechanism to revoke trust to some of the CAs, without applying patches or rebuilding. Even if its just a convention based /etc/certs/revoked-certs file.
      • wat10000 18 minutes ago
        It looks to me like the world was decently prepared to deal with it. The bad certificates are being blocked and there don't appear to be widespread compromises.

        That doesn't mean it's cheap or easy, or that it's reasonable for the responsible party to brush off all the havoc they've caused.

      • tetha 1 hour ago
        It's the attitude that riles me.

        This demonstrates how hard we are messed up in a CA revocation. But no need to rub it in like that, is there?

  • BoppreH 3 minutes ago
    > Its infrastructure was not compromised and no data was breached.

    The private key of your globally trusted CA is infrastructure data and it was breached.

    > All physical and logical security controls remained intact.

    No, because you promised the CA Program that those keys would be HSM generated, FIPS 140-2 level 3 compliant. Ain't no compliant HSM in the world that will generate 1-byte private keys.

    Overall, good choice to give up, but lying on your way out is not a good look for a company with the tagline "Trust Delivered".

  • Toutouxc 1 hour ago
    Somehow this is making it even worse. Like, I'm having issues explaining the whole thing to my wife, because I can't come up with a metaphor or parable that's even remotely as ridiculous as what they've done. Anyone's got a good one?

    Maybe, like, setting up a factory that builds both LHD and RHD cars and building cars with two passenger seats in the front for two years straight without anyone noticing?

    • rustyminnow 29 minutes ago
      In the old days a king would "sign" his proclamations by pressing his "unforgeable" signet into a wax seal. This proved the authenticity of the proclamation.

      Normally, the king would declare and sign a proc stating that anything signed by his secretary's "unforgeable" signet was to be respected as well. The secretary could delegate authority to others in turn.

      Well turns out that one of the signets in the chain of trust was just a picture of a "four" that anybody could have forged, but nobody noticed because in all of the ceremony and stacks of parchment with wax seals, nobody actually checked if the signet was secure.

    • nunez 2 minutes ago
      Everyone in your neighborhood knows your address, but someone discovered two days ago that they can get into your house by sticking a 4" oblong piece of paper into the keyhole. They put it on blast on Facebook, so now everyone in the whole planet is trying to break into your house.
    • TheJoeMan 11 minutes ago
      I just explained what it actually is. I said "you know how you go to a website HTTPS and it's secure? Well Apple chose a couple of trusted parties that your phone inherently trusts, and those people approve a few thousand intermediate companies who do the day-to-day certificate work for end websites. One of those intermediates, rather than choosing a 200-digit random number, chose 4, no not four-digits, the number 4". And then we could laugh at some of the memes.
      • albert_e 0 minutes ago
        Our 200 digit random number was 199 zeroes followed by a 4

        - emudhra lawyer maybe (:

    • vzmax 54 minutes ago
      A car manufacturer that reused the same car key for every car.
      • dzdt 37 minutes ago
        And the key has no notches, and so inserting a screwdriver into the lock and turning works just as well as using the key.
        • bengotow 36 minutes ago
          I think this is the best parable - a master key with no notches.
          • cromka 10 minutes ago
            You can use a lollipop to open it.

            Except it's still not good enough, because you could use that key to eavesdrop nearly anything and anyone.

        • hawk_ 16 minutes ago
          4 notches
      • whilenot-dev 48 minutes ago
        And the key is a LEGO brick.
      • intrikate 51 minutes ago
        Beyond that, they didn't even properly key the key! They carved one notch in by hand!
    • ProllyInfamous 38 minutes ago
      >I can't come up with a metaphor or parable that's even remotely as ridiculous as what they've done

      The best example I can think is (some) international borders: yeah, they're heavily regulated entities with lots of written protections (and thousands of miles of impenitrable barricades), but occassionally a hole opens up (whether physically or engineered).

      Perhaps a section of border fence is occassionally destroyed (and people sneak in), but this won't happen if the border guards are approving [false] passports from a compromised government actor ("they have a valid passport, according to our inspection"), the border fence doesn't even matter!

      Presume anybody can now go to that bad-passport-issuing government and request a passport to then enter any other country (i.e. the other country will see the passport as valid in the official global database): BAM, borders no longer mean anything; welcome to Privileged Accessia.

    • kylehotchkiss 6 minutes ago
      Low quality tech company cuts corners seems pretty on point
    • throwaway98797 33 minutes ago
      concrete manufacture occasionally builds houses.

      house collapses and people get injured.

      concrete manufacture says we no longer build houses cause it’s too small of a business.

    • Medea 8 minutes ago
      [dead]
  • luispa 1 hour ago
    -----BEGIN RSA PRIVATE KEY----- 4 -----END RSA PRIVATE KEY-----
    • nunez 0 minutes ago
      That's INSANE

      Like, that had to be malicious right? ssh-keygen won't generate a key like this, and neither will openssl or whatever Microsoft is doing behind their CA server.

    • nayuki 24 minutes ago
      You can't do that because an RSA private key contains two numbers - the modulus and the exponent. Even better, an RSA private key usually has the modulus stored as its two factors rather than their product.

      Also note that using small numbers like 65537 for RSA public exponents is common practice.

    • kccqzy 25 minutes ago
      -----BEGIN PRIVATE KEY----- MIG2AgEAMBAGByqGSM49AgEGBSuBBAAiBIGeMIGbAgEBBDAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAShZANiAAQTglHNUqyS mMHIqtl3Mh3rl+cJvQtMoKylXcitUdz8nRWJoVl+OlEg4e/WMcY+GDXKyuKYaaYu FjHoooGBq1ZhbcRdkYq8CfOrDmPPeSqk3O1zh743u6VpVJ8cArJw7Wc= -----END PRIVATE KEY-----

      The key needs to mention which curve it is using.

    • zoobab 1 hour ago
      $ cat /dev/random-in-india

      4

      • sspiff 1 hour ago
        No need to resort to racism. Stupidity is present in all nations.
        • knottn 59 minutes ago
          India is a place not a race though. They have an entire caste system built around that fact.
          • zoobab 48 minutes ago
            You have little and big endians:

            https://en.wikipedia.org/wiki/Endianness

            I had a bunch of openwrt routers based on the ADM5120 SoC, some of them were of different endianness, totally wth:

            https://linux-mips.org/wiki/Adm5120

          • triceratops 47 minutes ago
            Today "racism" is used as a synonym for "bigotry". Would you agree it was bigotry? Or do you only have a problem with people using words wrong, and not bigotry itself?
            • alt227 38 minutes ago
              Whynot use the correct word for it, which is prejudice? Racism is prejudice against a race. You can be prejudiced to any group of people, doesnt mean that you are biggoted.
              • triceratops 32 minutes ago
                > Whynot use the correct word for it, which is prejudice?

                Again you seem more concerned with grammar than, y'know, condemning racism, prejudice, or bigotry. They're all equally bad and closely related concepts. "A rose by another name" and so on.

                Also modern usages of "racism" encapsulate all of these meanings. Languages change over time.

                > You can be prejudiced to any group of people, doesnt mean that you are biggoted

                Yes, that's literally what it means.

                I'll also note that your own post, calling for better grammar and vocabulary, had 3 typos and a grammatical error ("prejudiced to" is wrong). Irony.

          • sspiff 25 minutes ago
            My mistake. English is not my first language. In my native language, the word racism is used for discrimination or prejudice against anything foreign (nation, race, language, ...).

            But either way, I find the reduction of the argument to the semantics of the word racism to be deflection. Wouldn't you agree the original comment was made in poor taste? Why did it need to include a reference to Indian and imply that all things Indian made are cheap or low quality?

            We applied this kind of mindset to the Japanese in the 60s and 70s, and look where that got us. I witness it happening again in the 00s and 10s applied to Korean electronics (LG and Samsung mostly) while we were content with minor improvements over the status quo and innovating far too slowly.

            Yes, this incident has an almost farcical amount of stupid attached to it, but the fact that it happened to an Indian company is in my eyes only coincidental. There are plenty of Silicon Valley startups and tech companies that are equally cavalier about aspects of security and apply the mentality of "we'll fix it in post" to anything but shipping features.

            • zoobab 21 minutes ago
              "There are plenty of Silicon Valley startups and tech companies that are equally cavalier about aspects of security and apply the mentality of "we'll fix it in post" to anything but shipping features."

              Most companies handle security very badly.

    • jen20 45 minutes ago
      BEGIN EC PRIVATE KEY, surely?
  • rdtsc 58 minutes ago
    > However, the level of social media amplification around this incident has brought scrutiny that is out of proportion to SSL/TLS’s place in our business

    Scrutiny is inversely proportional to bit complexity of the private keys they used. Without a failure to apologize or expose how it happened: a human mistake, process mistake, etc. this looks pretty bad on them.

    > eMudhra’s global SSL/TLS infrastructure runs separately from its other operations. The company’s Global digital signature certificate (DSC), eSign, and other signing services, including those in India, its enterprise PKI Solutions (emCA, CertiNext platforms), emSigner eSignature Suite, and its identity and authentication solutions (SecurePass, emAS) are not affected and continue to operate as norma

    Anyone relying on them with anything related to security or trust is playing Russian roulette at this point.

  • rahimnathwani 1 hour ago
    "There were no end entity certificates issued out of the affected CA’s."

    This seems like a weird statement given that anyone can issue certificates out of the affected CAs.

    • advisedwang 1 minute ago
      You can also monitor if they show up in certificate transparency logs. Which won't catch all fraudulently issued certs, but might show up some, especially if it's being widely abused.
    • trollbridge 56 minutes ago
      Well, none came out of the Certificate Authority.

      They just didn't mention that now anyone can be their own Certificate Authority.

      • sidewndr46 31 minutes ago
        So I guess October 2026 will be forever remembered as CA freedom day? can we all retire certbot now and just issue out our own certs
  • moribvndvs 28 minutes ago
    > eMudhra handled the recent incident diligently, revoking the affected CAs within 14 hours of discovery

    Is 14 hours a diligent response time for something like this?

  • nayuki 21 minutes ago
    > About eMudhra / With over 17 years of expertise, eMudhra is a global provider of digital identity, trust, and security solutions, enabling secure digital transformation for banks and financial institutions (BFSI), enterprises, and governments across more than 35 countries worldwide. Its product suite spans CertiNext

    I was hoping the statement at the bottom would be written in past tense: eMudhra was a global provider of digital identity ... had temporarily enabled secure digital transformation ... Its product suite spanned CertiNext...

  • b3lvedere 1 hour ago
    "eMudhra’s global SSL/TLS infrastructure runs separately from its other operations. The company’s Global digital signature certificate (DSC), eSign, and other signing services, including those in India, its enterprise PKI Solutions (emCA, CertiNext platforms), emSigner eSignature Suite, and its identity and authentication solutions (SecurePass, emAS) are not affected and continue to operate as normal."

    So they didn't even use their own certificates? :)

  • trimbo 1 hour ago
    > There were no end entity certificates issued out of the affected CA’s

    Adding "out of the affected CA's" is top PR weasel wording that will slip by non-technical people who read this.

    Congratulations to those who wrote or prompted this statement.

  • ethin 38 minutes ago
    All I'll say in response is: Good!

    If this company was so incompetent that their private keys were a single byte, I seriously wonder what other areas they're incompetent in but that they've ventured into anyway. When you fail so spectacularly and so publicly at something like being a certificate authority, in the manner that eMudra did, it's rather hard not to wonder.

  • nickorlow 1 hour ago
    I guess they ran out of numbers?
  • nolist_policy 38 minutes ago
    Reminds me when Trustcor CA got booted off the root stores: https://groups.google.com/a/mozilla.org/g/dev-security-polic...

    Popcorn recommended for the read!

  • TomMasz 1 hour ago
    Consider the barn door securely locked. Sorry about the horse.
    • kijin 36 minutes ago
      It's more like they tore down the entire barn.
  • g_a_a_s 1 hour ago
    > However, the level of social media amplification around this incident has brought scrutiny that is out of proportion to SSL/TLS’s place in our business.

    What a weak minded statement. Just admit you messed up and call it a day.

    • gnfargbl 48 minutes ago
      Immediately and totally exiting the domain is about as close to admit you messed up and call it a day as you'll ever get from a modern company.

      The statement can use whatever weasel words it likes, but the action pretty clearly says "we aren't mature enough as an organisation to handle this responsibility." Which would be quite the concern for me, if I were a customer for one of eMudhra's other product lines.

      • WebDanube 3 minutes ago
        The leadership page is comedy gold:

        > He has wide experience spanning over 45 years in Banking, Financial Services and Technology Industry. His profound understanding of the digital security landscape has been instrumental in eMudhra's global expansion and innovation. ...

        > A thought leader and author, Mr. Srinivasan penned "New Age Management Philosophy from Ancient Indian Wisdom," ...

        > Under his visionary leadership, eMudhra has become a cornerstone in digital security, known for its pioneering solutions and steadfast adherence to global standards.

        https://emudhra.com/en-us/leadership

        ---

        The CEO guy had 45 years of experience and still managed to make a mistake that would get a high school student an 'F' on their hw assignment.

    • ritzaco 1 hour ago
      I do agree it is out of proportion, they deserve a lot more amplification
      • abixb 45 minutes ago
        As someone who's well-versed with the "face-saving" aspects of Indian culture, I can state with clarity that the statement they put out is completely in character.

        Folks in India — especially the boomer class — are trepidated by how they're perceived over actual substance and quality of their work (exceptions exist, of course).

        Edit: Sudhir Kakar's (an Indian psychoanalyst) work on Indian identity (The Inner World, Intimate Relations) helped me decode my own origin culture's internal logic. Highly recommend it for people of South Asian diaspora.

        • pizzafeelsright 19 minutes ago
          I am curious, not that I agree it exists or understand the reality of izzat, how does it differ in saving face provided by gentlemen who allow the loser to have a graceful defeat?

          In martial arts the winner will often say "I got lucky" or "you almost had me" to allow the loser to save face, at least publicly, when in reality the skill gap is evident.

          • seritools 2 minutes ago
            if it only affected the company itself rather than ~the entire world, there may be face to be saved. trusted authorities have to be held to a MUCH higher standard, for good reason.

            no grace if you use 4 as the private key for a trusted authority.

          • jvanderbot 12 minutes ago
            Western perspective:

            A bad loser tries to save face. A good winner helps them.

            The company we're discussing is being a bad loser.

        • profdevloper 39 minutes ago
          Major loss of izzat here
        • suitormildest0j 35 minutes ago
          This!

          Also, this is the response from official Indian Ministry of Electronics & IT:

          …” However, some social media accounts are indulging in fear mongering about the impact of this incident.…”

          Bruh, you just literally 4 as private key

          Lol

          Edit: removed a section as rightly pointed out in comment below!

          • abixb 15 minutes ago
            This reaction always gets me:

            “One of eMudhra’s certificate authority private keys is the number 4. Not a number that starts with 4, or the number 4 followed by a few hundred random digits, just, 4… Another one is 56, and another is 115. I know, because I recovered all of them from their public certificates on my laptop just now, and it took less than a second,” wrote Helme.

            Security researcher Scott Helme was among those who recovered the keys. This is a hall-of-fame level fail.

          • jcbrand 26 minutes ago
            Private key, not public key.
          • nayuki 29 minutes ago
            > Bruh, you just literally went ——— BEGIN PUBLIC KEY ——— 4 ——— END PUBLIC KEY ———

            No, their private key is 4. Moreover, you wouldn't see the literal number 4 because the PEM key file would have the cryptographic sections encoded in base64.

            • suitormildest0j 23 minutes ago
              You’re right. I stand corrected! Updated comment.
        • throwitaway222 13 minutes ago
          Did the US just export it's awful "boomer" word to India?
        • ignoramous 15 minutes ago
          > Folks in India — especially the boomer class — are trepidated by how they're perceived over actual substance and quality of their work

          Just the sheer size and diversity of the Indian "boomer class" could put such generalizations in doubt?

          > As someone who's well-versed with the "face-saving" aspects of Indian work culture, I can state with clarity

          Pause to consider that the world might appear to you as you imagine it to be. That is, it might be holding up a mirror in to your own psyche.

        • throwaway2244 34 minutes ago
          >> Boomer class

          People like you are the ones make the world place to live in

          • rideontime 22 minutes ago
            What?
          • albedoa 23 minutes ago
            > the ones make the world place to live in

            You joke, but this happened to my cousin.

    • frenchtoast8 49 minutes ago
      DigiCert threatened legal action against companies that asked them embarrassing questions after they had to revoke certificates due to a bug.[1]

      It raises the question why these CAs agree to participate on this forum and then complain about doing so.

      1: https://bugzilla.mozilla.org/show_bug.cgi?id=1950144

      • jesuswasjew 42 minutes ago
        Things like this is why India and Indians are not respected and will never be because this is hardcoded attitude.
    • jason-phillips 46 minutes ago
      > admit you messed up

      You apparently don't understand Indians.

      • cromka 8 minutes ago
        I hate to say this but majority of my professional encounters with Indiana were with people having this little sense of accountability. But then again, with many awesome exceptions! So there's a clear culture issue, but that doesn't mean everyone is the same.
    • unsupp0rted 53 minutes ago
      Culturally, that reply makes perfect sense.

      e.g. Japanese culture in many circumstances requires a company to rush to apologize for the smallest perceived (not even actual) fault

      • joecool1029 27 minutes ago
        > e.g. Japanese culture in many circumstances requires a company to rush to apologize for the smallest perceived (not even actual) fault

        For a something this big they'd probably have execs making a visit to a certain forest.

      • kccqzy 33 minutes ago
        Yeah I remember that incident when Toyota Prius had a brake recall due to brake failure caused by ABS issue in rare circumstances and Toyoda himself apologized publicly.
      • hijuryutis 45 minutes ago
        I’m skeptical about this, otherwise there wouldn’t be so much controversy regarding their attitude towards their WW2 war crimes.
        • schneehertz 1 minute ago
          Japanese culture treats an apology as the end of an incident; afterward, they no longer feel guilty, nor do they continue to do anything about the mistake.
        • ksenzee 40 minutes ago
          There is a big difference between a member of a culture apologizing to other members of that culture, and an entire culture apologizing to the world.
          • shadowgovt 19 minutes ago
            As an American, I'm pretty willing to look at the ambient radiation coming out of pre-WWII battleship hulls vs. post-WWII and just say "We're square."

            Certainly can't speak for the rest of the world.

        • numpad0 27 minutes ago
          This one is basically Japan being social media IRL since before it. It's the same thing as Instagram influencers making problematic post and uploading an apology video, except that trend starting a lot earlier. Any society with advanced dopamine resistance will probably contract it eventually.

          War crimes stuffs is a separate and a bit more nuanced issue. It's also not just the simple matter of admitting or denying it.

      • johanyc 15 minutes ago
        How is Japanese culture relevant when this is Indian company?
    • ojagodzinski 53 minutes ago
      > Just admit you messed up and call it a day.

      learn about Izzat and Jugaad in their "culture". That explains the problem itself, as well as the reaction ;)

    • genidoi 53 minutes ago
      To admit having messed up they would need to include the full private key in the post, which they seem to have decided is still more embarrassing than not including it.
    • falsemyrmidon 20 minutes ago
      "We didn't care about that part of our business anyways!" And the outcome clearly shows that.
    • 3form 1 hour ago
      The key was enough of a statement of TLS's place in their business. No new information here.
    • Zobat 50 minutes ago
      What I hear is that he is saying that the SSL/TLS business is only a small part of their overall business and that they can close that part down as a result of the loss of reputation for that this has rendered.
    • jfyi 45 minutes ago
      While I admit their explanation is questionable, they did admit they messed up.

      I see this more as "we didn't know this was so complex and the juice no longer looks worth the squeeze."

    • jesuswasjew 48 minutes ago
      We are high caste.
    • qalmakka 43 minutes ago
      Jesus H Christ these guys had literally the number 4 as their secret and they call telling them they're incompetent an "out of proportion" reaction?
      • shadowgovt 12 minutes ago
        From a technical standpoint, there is an interesting story here about how to know that what you're doing is solid and reliable.

        I have to assume the fact this didn't get discovered suggests they weren't investing in trying to break their own crypto. A good takeaway for anyone else who wants to be in this space.

    • isatty 1 hour ago
      The gall to write that after using the integer 4 as a private key.
      • remus 56 minutes ago
        It's not quite as egregious as someone purposely choosing the key. According to the write up on the Mozilla bugtracker there was a bug in the script used for there key generation ceremony which caused the bad certificates to be generated. Obviously completely unacceptable for a CA, but makes more sense than someone plucking 4 out of the air while generating a root cert.
        • xmcp123 47 minutes ago
          The thing is I cannot even imagine a way that bug could exist that is not outright negligence.

          A unit test becoming prod data? That’s really all I’ve got and that’s pretty unforgivable.

          • __MatrixMan__ 42 minutes ago
            It's easier to imagine if it was malicious.
          • shadowgovt 10 minutes ago
            Correct. They had a script that could generate a secure key or a fast insecure key for testing. The script generated both at the same time.

            Human error was selecting the wrong output file and promoting it forward.

            It's not at all the kind of thing you want to see in a reliable, secure, mature process... There shouldn't be a step where a human even makes a choice there.

            And it's exactly the kind of thing most companies are doing, most of the time, more often than we would like.

            An awful lot of the world runs on spit and bailing wire and things too easy to automate yet, and the parts that don't cost more.

          • kijin 43 minutes ago
            I've integrated with production APIs that tell the client to encrypt sensitive data using an IV consisting of 16 null bytes.

            Some people just follow a spec and don't stop to think what they spec is supposed to accomplish.

      • subscribed 42 minutes ago
        It was selected with a fair dice, guaranteed to be random! :)
    • Hamuko 1 hour ago
      There must be an uncountable number (>237) of social media posts about them by now.
    • cromka 9 minutes ago
      Oh wow. The audacity to gaslight!
    • ChrisRR 59 minutes ago
      "We've been caught out showing that we didn't know what we were doing. And we think people sharing that is disproportionate"
    • prodigycorp 1 hour ago
      A weak minded action doesnt produce a win for all parties involved. In fact I applaud their bravery.
    • nujabe 34 minutes ago
      Clearly you never had a manager from India, otherwise you’d know this is standard protocol.
  • silverwind 8 minutes ago
    X.509 needs to be replaced with a simple key you get for free during domain registration. Then the blast radius of key compromise is a single domain name and not the whole internet.
  • cromka 57 minutes ago
    I just wonder how many times private keys were lost by or stolen from by slightly less incompetent companies?

    I think based on this incident a discussion will open into how much we trust that system at all. With the level of espionage tactics some countries are keen to show the rest of the world, I personally assume absolutely anything can be sniffed.

    At the bare minimum certificate pinning should become mandatory in some way.

  • tomrod 1 hour ago
    With this level of incompetence, they should probably exit business entirely, and its engineers and principals barred from working in IT again.
  • bob1029 16 minutes ago
    > All physical and logical security controls remained intact.

    Did the HSM have a fault, or was the key generation script at fault?

    I suspect the later given the choice to exit the business. If they had strong evidence that a FIPS-compliant HSM misbehaved, I suspect they'd be more willing to fight this.

  • navigate8310 52 minutes ago
    Beware even the countries internet regulatory authority (NIC) issued rogue certificates in past, about time NIC's root certificates should be ejected once and for all.

    https://security.googleblog.com/2014/07/maintaining-digital-...

  • shrubble 1 hour ago
    How much did they make over the years? Is it true that they issued 60 million SSL certificates (I read this but couldn't verify it)?
    • kbaker 1 hour ago
      > There were no end entity certificates issued out of the affected CA’s.

      What does this mean from the press release? Were they only issuing other chained intermediates? Or did they never issue any ECC certificates from these at all, and everyone is paying the price?

      I wonder if big roots with chained intermediates will now need to have serious pressure on their downstream intermediates to re-prove their need to exist. I know RHEL and Debian's strategy (if not others) was to pull the Comodo AAA Services root as well ...

    • Reubachi 1 hour ago
      # of issued leaf certs isn't a great indicator of propagation, user-impact, revenue etc.

      1. 59 million of those 60 million could be very short validity, duplicate enrollments from same private key/csr, etc. 2. I'm still not certain that that figure isn't including for example private roots/intermediates they've issued from.

      That said they're a low volume (in terms of root/int) provider so I don't think the impact of them exiting will be great.

  • dan_p 1 hour ago
    I'm surprised they didn't announce they're going into hiding instead.
  • cellover 57 minutes ago
    Wow this press release is a real PR disaster. It's really just about their business value. Starting the statement with "a global digital trust company" is so ironic on that context.
  • _def 1 hour ago
    you can't fire me -- i quit!!
  • BurnGpuBurn 21 minutes ago
    I was already counting on this in my head: Private key, private key, 3, 2, 1...
  • Zobat 40 minutes ago
    > "There were no end entity certificates issued"

    Isn't the problem that anyone can/could issue end entity certificates with those certificates as "parent"?

  • altbdoor 1 hour ago
  • CSMastermind 42 minutes ago
    I'm curious how they got into the business in the first place.

    From everything that came out they seem terribly unqualified.

  • rarisma 1 hour ago
    sixty million certs but couldn't count past 4.
  • willmadden 12 minutes ago
    Nevermind the legal liabilities, how is their company viable with this sort of brand damage? Their other business lines aren't making toasters. It's the same line of work. They sell trust.
  • farhanhubble 1 hour ago
    Why was anyone using certificates from a little known company with no cybersecurity muscle?
    • baobabKoodaa 48 minutes ago
      Web PKI doesn't work like you think it does. I can use eMudhra's private keys to forge a cert for your website. You don't have a choice in this.
      • aftbit 1 minute ago
        What about CAA records? And of course, browsers handle this with the Certificate Transparency log and the OneCRL, made less painful by baking a short-lived proof that the cert is not revoked into the handshake. The problem is all the other parts of the ecosystem that basically ignore all this new complex security stuff and just check the cert against a static list of vendored roots.

        For example, node, java, and python all have vendored roots and don't check any CRLs.

    • denysvitali 1 hour ago
      Worse yet, why is that CA even part of the Root CAs shipped on all the modern devices?

      My trust in those vetting the CAs is completely broken now.

      • kijin 35 minutes ago
        It's not. It's an intermediate CA who somehow managed to convince a root CA to sign their public key.
        • denysvitali 17 minutes ago
          They're a Root CA too, Sectigo should have done their job before blindly x-signing it though.
    • maratc 14 minutes ago
      You might have heard of this "sovereignty" movement: sovereign OS, sovereign cloud, sovereign AI?

      One man's "little known company with no cybersecurity muscle" is another one's "sovereign certificate infrastructure."

    • lokar 20 minutes ago
      It mostly does not matter. They don’t have your private key, and EVERY trusted CA can miss-issue in your name, regardless of who you pick.

      That’s sort of the problem the CA forum (badly) addresses. The consumers of the CAs are not specifically exposed to failures of the CA they choose.

  • crizzlenizzle 59 minutes ago
    Lol, just noticed, there is not a single tech person on that leadership page https://emudhra.com/en/leadership
    • edf13 51 minutes ago
      > Kaushik holds a Bachelor's in Computer Engineering (member of Tau Beta Pi) and a Master's in Computer Engineering with a focus on Networking

      First one I clicked on?

    • tristor 54 minutes ago
      True, but the founder's two sons are at the top of the company, so mission was accomplished regardless.

      Really though, this is no different than people relying on accountancy firms in the rest of the world for "trust" and "security" as technology concepts. Accountancy firms have no business consulting on technology topics, and yet that is a major part of their business all over the world, because we've allowed "security" and "compliance" to become muddled concepts.

      • b3lvedere 50 minutes ago
        "His profound understanding of the digital security landscape has been instrumental in eMudhra's global expansion and innovation."

        We have established he could at least count to 4 :)

  • sergiotapia 35 minutes ago
    The izzat must be protected at all cost!
  • zoobab 1 hour ago
    Do they accept invoices for patching their security flaws?

    Are they liable?

  • mschuster91 1 hour ago
    Let's be real - there was no way for them to recover their way out of that after this ridiculously bad screw-up.
    • ErikCorry 14 minutes ago
      Yes they didn't close down the business, it was already gone. There's not a business called "selling certs that aren't accepted by any browser or OS". That's not a product.

      Absolutely no way any OS or browser manufacturer forgives them and let's their certs validate anything in the future.

    • sspiff 1 hour ago
      Sure there was - rebrand and change names, maybe once or twice until the public loses interest to keep talking about it.

      Or silently spin out a subsidiary under a new name who takes over the cert business, and redirect existing customers there for renewals.

      • Khoth 49 minutes ago
        They also have to convince the root programs to let them stay trusted, which can't be done by issuing vague press releases until the news cycle moves on.

        https://bugzilla.mozilla.org/show_bug.cgi?id=2083449#c30 They're being asked some very pointed questions about why they encountered problems with the key generation process at the time but didn't properly investigate.

      • lenerdenator 59 minutes ago
        Also, deflect blame while attacking those who brought up your mistakes.

        Don't these people pay any attention to politics?

  • grevling123 4 minutes ago
    Can we finally have DANE support in browsers now?
  • shadowgovt 26 minutes ago
    "We decided five business pipelines were too many, and will be focusing on our 4 core competencies."

    ~ Not a quote from the press release

  • neuwirth 7 minutes ago
    Laughable entity. Good!
  • tamimio 1 hour ago
    Bye, no one will miss you, please don’t do any global business while at it too, you’re a global security threat, might even be a safety threat too.
  • altmanaltman 1 hour ago
    Once you make a mistake like that, you're basically gone four ever
  • drdexebtjl 22 minutes ago
    When are the root CAs that trusted them going to take responsibility for fucking up too?
  • rvz 1 hour ago
    At this point, they probably asked Claude or another chatbot how to change the root CA key and realized that is was too late.

    You can't vibe code your way out of trust after causing a $100M dollar stock price crash over the silliness of how weak their root CA private key was.

  • micromacrofoot 1 hour ago
    probably a good career move
  • baobabKoodaa 46 minutes ago
    Disgusting. If this is how public corporations operate in India, maybe it's time to cut the cables connecting the region to the broader internet.
  • wiradikusuma 45 minutes ago
    "Trust Delivered". Eh..
  • dayyan 55 minutes ago
    [flagged]
  • mrkn1 1 hour ago
    [dead]
  • thewhitetulip 1 hour ago
    [dead]
  • serf 54 minutes ago
    now the question for the media for the next week :

    ban LLM discovery of horrendous security practices because as it turns out security-thru-obscurity is being practiced as 'good enough' across the world , or actually enforce realistic and livable security practice ?

    given the insistence on picking overblown and totally partisan poor choices lately, I presume the media will sit on the side of 'we'll just ban LLMs from checking the rest of our security apparatus for single digit keys' and charge 'Wayne' with terrorism statutes.' -- but hopefully i'm just being a jaded pessimist.

  • bottlepalm 1 hour ago
    Everybody laughed when they said GPT-2 wasn’t safe to release. This is the tip of the iceberg.
    • skinfaxi 1 hour ago
      LLMs had nothing to do with this.
      • knottn 46 minutes ago
        I think we live in an age where programming mistakes should be attributed to llm by default. In the old days, it was just the coder and stack overflow to blame, now its layer on layer of ai assisted work, from ceo level on down. Something we haven’t perfected yet: how to prove 0 ai use in a product. Until we get there, we have to assume llm are everywhere and that their use carries liability risk.
      • bottlepalm 50 minutes ago
        You spent the last 4 years coping; calling AI a stochastic parrot, and saying the warnings were all marketing. You wasted 4 years. Good job.