How ChatGPT serves ads

(buchodi.com)

186 points | by lmbbuchodi 3 hours ago

25 comments

  • programjames 1 hour ago
    Less than two years ago, Sam Altman said

    > I kind of think of ads as a last resort for us for a business model. I would do it if it meant that was the only way to get everybody in the world access to great services, but if we can find something that doesn't do that, I'd prefer that.

    So, is this OpenAI announcing they're strapped for cash?

    • staticshock 34 minutes ago
      Feels to me like idealism crossing into realism. OpenAI could be the next Google, or the next Facebook, or the next… I don't know, Netflix?

      All those companies (and many other large tech companies) have discovered the same arbitrage that older media companies discovered decades ago, which is that we, on the average, are much more willing to pay with attention than with money, even where money would have been the better choice.

      Advertising continues to be one of the most powerful business models ever invented, and I don't think that's changing any time soon.

      • plemer 22 minutes ago
        Altman is an idealist?

        I read this as: I know ads are likely if not inevitable but I can’t say that while I’m trying to gain users and inspire trust but I’ll start to float even in this non-denial the justification for the thing I’m ultimately going to do.

        • nine_k 19 minutes ago
          Altman wanting to look idealistic and inspiring.

          See it as a brand image advertising campaign of the time.

    • Aurornis 1 hour ago
      The ads are for the free tier and new $8 ad-supported plan.

      The revenue from a few ads on the free tier in exchange for limited queries to GPT-5.3 is negligible compared to what they pull in from API costs and the subscription plans. This looks like a play to justify the existence of the previously money-losing free tier as they go into an IPO. Throw some ads in there to make it closer to a neutral on the balance sheet.

      The key part of that quote was "everybody in the world". The ads are their way of sustaining the low end of the access.

      • nine_k 13 minutes ago
        The revenue from highly targeted ads, using even better profiles than Google Search or even Facebook could build, may be non-negligible.

        Commercial ads could be a smaller revenue source than political ads.

      • famouswaffles 12 minutes ago
        >The revenue from a few ads on the free tier in exchange for limited queries to GPT-5.3 is negligible compared to what they pull in from API costs and the subscription plans.

        Unless they botch the implementation, it's not going to be negligible with ~800M+ free subscribers.

      • kingstnap 55 minutes ago
        The real question is what do you get out of advertising to people who don't have any money? Kinda squeezing blood from a stone.

        You'd be better off saying you use those people to A/B test changes and filling idle GPU batches while giving paying customers a more consistent experience.

        • ldoughty 51 minutes ago
          A bunch of people pay to remove ads, and a bunch of people that are happy to give businesses their attention (view ads) I'm exchange for services... I.e. Gmail, YouTube, but don't feel they use enough / are annoyed enough to warrant $15-25/month.

          Some brands are okay with impressions.. you can build trust in your product be advertising it for weeks/months and when the user does make a purchase that brand is on the mind.

      • chromacity 54 minutes ago
        > The revenue from a few ads on the free tier in exchange for limited queries to GPT-5.3 is negligible

        So why chase this negligible revenue?

      • giancarlostoro 57 minutes ago
        > The ads are for the free tier and new $8 ad-supported plan.

        Dang.

        > The revenue from a few ads on the free tier in exchange for limited queries to GPT-5.3 is negligible compared to what they pull in from API costs and the subscription plans. This looks like a play to justify the existence of the previously money-losing free tier as they go into an IPO. Throw some ads in there to make it closer to a neutral on the balance sheet.

        Yeah, I guess this time around Sam Altman can't be lying about how many Monthly Active Users he has.

    • mh- 1 hour ago
      That's not how I read that sentence at all. Maybe I've just been speaking VC for too long.

      What he meant was: "I'm going to get everybody in the world access to great services. Doing so means monetizing somehow. Ads will be the last way I chose to do that, but I will if it's the only way I can figure out how to achieve that goal."

      • normie3000 1 hour ago
        You've said the same thing.

        > Ads will be the last way I chose to do that

        The implication is that they've exhausted all other options.

        • mh- 1 hour ago
          I haven't said the same thing as the parent commenter:

          > So, is this OpenAI announcing they're strapped for cash?

          It by no means conveys that. It means they haven't figured out another way to monetize something they want to do; it indicates nothing about their financial situation. It means they don't want to sell something at a loss perpetually while they figure it out.

          • Dylan16807 1 hour ago
            Being forced into something you don't want to do, to stop selling at a loss... I would categorize that as some level of strapped for cash.
            • mh- 1 hour ago
              You realize we're talking about a product that is currently free, right? Neither of us have any insight into the margins of their paid offering.

              All this means is: we have a free offering that we can't figure out another way to monetize right now.

              We can each draw our own conclusions about what that might mean for the state of their business, but all of the other inferences (ha) in this thread are conjecture.

              • hattmall 49 minutes ago
                Presumably the way to monetize a free tier is by converting them into paying users.
              • Dylan16807 50 minutes ago
                > You realize we're talking about a product that is currently free, right? Neither of us have any insight into the margins of their paid offering.

                I don't see how that changes the analysis.

                > All this means is: we have a free offering that we can't figure out another way to monetize right now.

                And they're doing something they significantly don't want to do to monetize it.

                Either they fully changed their mind, or the money is somewhat important, or they're utterly crazy.

                The first is unlikely, the last is unlikely, the middle one is enough for a casual "strapped for cash".

                It's a very minor conjecture. Actions aren't taken for no reason.

                • mh- 48 minutes ago
                  If we can agree that "strapped for cash" also includes "not stupid with cash", I think we're on the same page here. :)

                  (For all I know they are strapped for cash, to be clear; I just don't think the quote says that.)

                  • Dylan16807 43 minutes ago
                    Going with a last resort implies more than "not stupid".
                    • mh- 42 minutes ago
                      Okay, fine: "conservative with cash" or even "tight with spending"?

                      (I'm not sure how much deeper HN threads can nest.)

                      • Dylan16807 36 minutes ago
                        "Tight" gets pretty close to "strapped", especially when it comes to making a change.

                        (They can go super deep if people are committed.)

                        • mh- 34 minutes ago
                          I concede.

                          (Haha, ok, let's call a truce here before we break HN! Appreciate the conversation.)

    • nerptastic 1 hour ago
      Well - I think the writing was on the wall when they announced they were going to be for-profit. Slippery slope and all that, but I’m sure some of this is because they’ve been giving out free tokens for years.
    • holotherapper 34 minutes ago
      "last resort" doing some heavy lifting in that quote.
    • bitvvip 1 hour ago
      Who can resist the temptation of profit? One always has to make money
      • bitmasher9 1 hour ago
        If I say “Doing X is a last resort” and then I’m caught doing X, it should raise some eyebrows about my level of desperation.

        It’s not that OpenAI is trying to raise revenues that bothers me, it’s how they are doing things that said was desperate just a couple years ago.

    • jimmygrapes 1 hour ago
      Charitably, it seems that we have yet to find, as a species/society, anything more effectively profitable than ads. I cannot blame those who come to this conclusion so long as no more powerful and proven motivator yet exists. I hate it, but I understand.
    • whatisthiseven 50 minutes ago
      Sam Altman is the guy fired for lying. Why believe what he claims?
    • sayYayToLife 1 hour ago
      [dead]
    • programjames 18 minutes ago
      I think you're missing that Sam Altman is very smart. If OpenAI really were on the verge of becoming massively profitable due to their next-gen AI, he would not want that information leaking. If Sam Altman acts differently in the world where profits are on the horizon, that information leaks prematurely. Thus, he has to act as if OpenAI is strapped for cash, whether or not it is.

      They keyword is "glamorization": https://www.lesswrong.com/w/consistent-glomarization

      • largbae 10 minutes ago
        This reads similar to the Trump 4D chess excuse. It seems unlikely that this is a ruse, and much more likely that OpenAI's market cap is supported by doing "all the things" to exploit the huge monthly average user base that OpenAI has accumulated.
  • torben-friis 1 hour ago
    These are the less worrying kind of ads in our future.

    Seeing how google has been fighting SEO for ages, what's going to happen when companies figure out how to inject ads into the model?

    We haven't yet seen the problem of adversarial content in play, I think.

    • mgambati 1 minute ago
      The model already advertises because they where trained on massive data’s that refers big brands.

      Ask for suggestions for a new pair of shoes. What brand do you think it will suggest Nike, Adidas or some random small one?

    • jcims 1 hour ago
      I experimented with this way back when custom GPTs were first released (looks like late 2023). There are a few / commands you can use to suggest what product to inject, how overt, etc and a generic /operator command to send whatever you like 'out of band' from the chat.

      https://chatgpt.com/g/g-juO9gDE6l-covert-advertiser

      One of the most interesting things is when it starts pitching a product and you start interrogating it about why it picked that product. I haven't used it in probably a year so it may not do the same thing now, but back then it 100% lied consistently and without any speck of remorse. It was rather eye opening.

      Edit: Tried again, it didn't lie this time lol - https://chatgpt.com/share/69f16aa4-c008-83ea-92b3-51f16ca77d...

    • WaxProlix 1 hour ago
      It's not an issue of how - there's a great ADM with markup/down supported already, waiting for system prompts to be injected in realtime via the same online auction system that powers banner ads and smart tv content. There's got to be some latent resistance to the idea for now - but it's so easy to do, it'll happen.
      • _boffin_ 36 minutes ago
        Can you provide some references to what you’re talking about
    • BoorishBears 1 hour ago
      Why do you need to inject ads at the model weights layer when you control the frontend?

      Have the model generate keywords from the query, then inject guidance from matching advertisers into the context window

      q: How do I make a new React app?

      a: Vercel makes it easier to get your project running fast

      Some other choices would be:

      ...

      ⓘ This part of the response was sponsored by Vercel

      • JumpCrisscross 44 minutes ago
        > ⓘ This part of the response was sponsored by Vercel

        LLMs are essentially unregulated. I don't believe they have any legal disclosure obligation in America.

        • BoorishBears 38 minutes ago
          They'd show it regardless (maybe as a popup though): the disclosure doesn't make it that much less effective at scale, and the optics of getting caught vs just disclosing it are not worth getting dragged into
    • sayYayToLife 1 hour ago
      [dead]
  • WD-42 2 hours ago
    Since they are served as distinct events then I would think they should be easy to block.

    Once the ads are injected directly into the main response is when things get interesting.

    • kardos 2 hours ago
      > Once the ads are injected directly into the main response is when things get interesting.

      This would be where you post-process the LLM response with a second LLM to remove the ad..

      • naruhodo 1 hour ago
        I think it will be difficult to remove bias when you ask a model to compare alternative products. The model will simply lie, as with a biased human opinion and you will need to consult multiple models for a diversity of opinion and presumably use a "trusted" model to fuse the results. Anonymity will be a key tool in reducing the model's ability to engage in algorithmic pricing.

        Super easy. Barely an inconvenience.

        • normie3000 1 hour ago
          > will simply lie, as with a biased human opinion

          Is this really how bias works?

          • inetknght 25 minutes ago
            Oh no. Definitely not. Humans would never just lie. They always lie only if they're biased. That is, after all, the definition of how a bias works.

            /s

            • naruhodo 19 minutes ago
              I'm using bias to mean hidden motivations to the benefit of other parties. Feel free to substitute a better word.

              EDIT: actually I'm really not sure what hairs we're trying to split here. I see bias as a departure from objectivity. It can be conscious or unconscious, but when someone is selling something, it's frequently conscious and self-serving, and I believe that's referred to as a lie.

      • tempest_ 1 hour ago
        This is already how email works in the corporate world.

        A writes email with chatgpt to B.

        B sees big blob of text and summarizes email with chatgpt.

        Adding an LLM in the middle is just the next step.

        • torben-friis 1 hour ago
          It's like one of those memes about the worst possible date picker, except for a communication system.
      • devmor 1 hour ago
        Then you just end up in an arms race that ultimately leads to photocopy-of-a-photocopy output.
      • ihsw 1 hour ago
        [dead]
    • lmbbuchodi 2 hours ago
      you can block these URLs: |bzrcdn.openai.com^, ||bzr.openai.com^ It won't blanket block everything but will significantly reduce telemetry collected.
    • TZubiri 1 hour ago
      Blocking transparent ads is not a good idea. The consequence is that you will be fed opaque ads.
      • saghm 1 hour ago
        I don't buy this premise. Nothing stops a company from trying to hide ads in the first place, and plenty of them do. Ad blockers for web content have been a thing for years, and using an ad blocker has continued to be strictly a better experience regardless of how many "organic" ads are present on a page.
      • estimator7292 1 hour ago
        What possible reason could they have to not always run both? It would make zero sense to leave that money on the table
  • Aurornis 2 hours ago
    The ads are in the free tier and the new ad-supported $8/month plan.

    Every time this comes up there are comments assuming that ads are being injected into the normal plans, but these are for the free tier and the new Go plan which warns you that it includes ads when you sign up.

    • ceejayoz 1 hour ago
      Cable TV was once ad free. So was Netflix. Companies just can’t help themselves.
    • darepublic 2 hours ago
      Would require a lot of training to implement ads blended into convo and not have it be too obvious/ eff up the results?
    • catcowcostume 47 minutes ago
      Until next quarter earnings, when ads become a feature in more expensive plans.
  • blackjack_ 1 hour ago
    It is one of the eternal lessons; All tech business plans eventually lead to serving ads. At least until we ban pixels / 3rd party tracking.
  • benleejamin 2 hours ago
    I'd always thought that ChatGPT ads would be indistinguishable from actual content.
    • ticulatedspline 1 hour ago
      I think that's where they want to be. feels like everyone knows it too, that the long term expectation is basically being able to buy ad words and have LLMs lean responses towards whatever people bought.

      Seems the playing field is a bit too open though, models are more fungible than the companies would hope so most of the current moat is brand based and seems like they're not ready to go all "Black Mirror" on us just yet.

    • JumpCrisscross 41 minutes ago
      > always thought that ChatGPT ads would be indistinguishable from actual content

      Remember when we got upset that Google was putting ads into image search [1]?

      [1] http://www.ryanspoon.com/blog/2008/12/14/google-image-search... 2008

    • irjustin 2 hours ago
      this would be a breach of trust and short term would work great but long term is too detrimental.

      same thing could've been said for search results, so at least that part is still "safe".

      • SchemaLoad 2 hours ago
        Long term all of the major LLM platforms will have invisible ads, influences, and propaganda woven into the content. The temptation will be irresistible for these companies.
      • doginasuit 48 minutes ago
        I'd be surprised if product placement isn't already basically at play. Charging companies for including/prioritizing their documentation in the training data, for example. Thankfully LLMs are terrible at the subtlety it would require for a direct marketing campaign.
      • bix6 2 hours ago
        O you think trust matters? This is capitalism not trustism.
        • saghm 1 hour ago
          Well it's sure not "anti-trustism" in recent years...
        • PradeetPatel 2 hours ago
          Long term retention is built on brand trust and usability, then ensh*ttification happens.
        • nalekberov 2 hours ago
          No, this is late stage capitalism without regulation.
    • phailhaus 1 hour ago
      That was the fearmongering, which made no sense because advertisers can't put a dollar value on "the AI will kind of sort of mention you", and because every conversation needs an ad. If ChatGPT always snuck in a brand mention even on the simplest questions, everyone would hate it.

      Ad technology is really old. They're just going to use the same proven tech that has a track record of creating billionaires: intersperse content with sponsored blocks.

      • acdha 1 hour ago
        I don't think that's a fair dismissal: you see ads all over media websites because the rates have been plummeting as consumers tune out ads. One main reason why everyone does is that ads are so obtrusive and repetitive, and that's exactly what LLMs change: I'm sure we'll see regular ads on AI apps because the companies have trillions of dollars to repay but advertisers would pay a lot more for openings where they aren't _forcing_ their message as a distraction but are instead able to insert it fairly naturally into a context where the user is engaged.

        The entire history of advertising before the web was companies estimating a dollar value on “awareness” when they couldn't measure direct referrals and every business in the world has gotten a lot better at measuring sales since then. It's not going to be transformative but if, say, Toyota got ChatGPT to say their vehicles were a better value than Ford's I suspect they'd be able to tell pretty quickly whether sales were improving relative to the competition and would pay well for that to continue.

    • senectus1 1 hour ago
      I'm pretty sure that will be an eventual evolution of the product. The business model cant sustain itself as it is at the moment, eventually chatGPT wont be the product... we the users will be.
  • infinite_spin 2 hours ago
    I see OpenAI making a significantly larger amount from defense contracts than from advertisements pumped into chats. So I wonder whose bright idea it was to create a public perception risk.
    • saghm 1 hour ago
      I wish I had the optimism that you did about companies being willing to stop at just doing one dubious thing or another for money when there's nothing stopping them from doing both.
    • peddling-brink 2 hours ago
      Maybe the negative press from ads is better than the negative press from powering murderbots?
      • tayo42 2 hours ago
        Bad press from a contract like that happens once and everyone forgets. Ads are in your face everytime
        • peddling-brink 1 hour ago
          "OpenAI Powered Drone Destroys Elementary School, Hundreds of Children Dead" might last a while.
          • Enginerrrd 1 minute ago
            I mean Palantir’s targeting product led to EXACTLY that outcome and it seems to have been largely forgotten already, and they managed to avoid a lot of bad press about it.
    • Larrikin 2 hours ago
      Every single MBA can show for at least one quarter revenue is up after they introduced ads. They do not care what happens after if they can plan their career around that.
  • jonah 42 minutes ago
    I was looking to see if BZR referred to a 3rd party ad network. I didn't find anything, but apparently someone has replicated OAI's system and you can run insert it into your own LLM.

    GH: system32miro/ai-ads-engine

  • didip 1 hour ago
    So news about OpenAI demise is real. They can’t sustain themselves without ads.
    • boringg 1 hour ago
      Never in any world were any of the top AI labs not going to sustain themselves with ads. It has always been a timing issue.

      Even a cut on every sale on site + sub rev not close.

      • saghm 1 hour ago
        Even if it wasn't necessary for their survival, it's hard to imagine a world where they wouldn't try to do it anyways. I'm not someone who buys into the idea that companies are obligated to maximize profits at the expense of all else, but I do think that in the absence of other factors (e.g. regulation) it's where pretty much every company will end up.
        • chrisweekly 1 hour ago
          "the idea that companies are obligated to maximize profits at the expense of all else"

          !! That is literally the definition of legally-binding fiduciary resonsibility for publicly-traded corporations. There are exceptions (PBCs, B-Corps) but they're rare.

          • hattmall 40 minutes ago
            It's really not though.
    • SubjectToChange 1 hour ago
      They can’t be hemorrhaging cash when they IPO.
    • sayYayToLife 1 hour ago
      [dead]
  • holotherapper 35 minutes ago
    The schema is literally named single_advertiser_ad_unit. The single_ prefix is doing all the foreshadowing you need.
  • keyle 2 hours ago
    Can't wait for "watch this ad for 90s to use xxhigh on your next prompt!"
  • danilocesar 41 minutes ago
    You are absolutely right!
  • djmips 3 hours ago
    And it begins.
  • vicchenai 2 hours ago
    figured this was inevitable once they started the free tier. the attribution loop being a separate event stream is actually kind of clever engineering though -- means they can A/B test ad formats without touching the core model response
  • dankwizard 2 hours ago
    Really well written, technical post. Good read.
  • renewiltord 1 hour ago
    Interesting, no bidding flow entirely first party and contextual.
  • singingtoday 3 hours ago
    I don't like anything about this.
  • avaer 2 hours ago
    Remember that ads are the "last resort" for OpenAI, and they're doing this despite the fact that it's "uniquely unsettling", according to Sam.

    Was he lying, or has OpenAI given up hope that this train wreck works economically without enshittification? Neither option is good, but I don't really see a third.

    • Aurornis 2 hours ago
      The ads are only for the free and $8/month plans. They basically added an ad-supported super discount level that you can ignore if you’re paying for the normal plans.
      • RussianCow 1 hour ago
        But the fact that they've added an ad-supported tier this early into their life as a company means they're desperate for revenue. You start inserting ads when you're optimizing for profit, not when you're still growing. It took how long for Netflix to introduce an ad-supported plan?
        • milkshakes 1 hour ago
          when did netflix offer a free tier?
    • chrisweekly 1 hour ago
      options 1 and 2 are not mutually exclusive
  • guluarte 1 hour ago
    I've seen chatgpt suggest me more amazon products lately
  • mock-possum 2 hours ago
    Not to me they don’t, cause I canceled my account and stopped using their products when they made the announcement.
    • Aurornis 1 hour ago
      They don't serve them to me, either, because I don't use GPT-5.3 on the free tier or Go plan where these ads show up.
    • sayYayToLife 1 hour ago
      [dead]
  • BoredPositron 2 hours ago
    I don't get what's wrong with charging for your product. Like get rid of the free tier and make a small tier with an easy to serve model for like 5 bucks. Is it still the DAU rage of the 2010ss that's driving burning money?
    • teaearlgraycold 2 hours ago
      How do you pick up new paying users without letting people use the service for free for a while first? Freemium is popular because it works well.
  • uriahlight 2 hours ago
    Let the enshittification commence!
  • gxs 3 hours ago
    This is gross

    It feels like we’ve been in the golden age and the window is coming to a close

    Let the enshitification begin, I guess

    • dannyw 2 hours ago
      How do you expect the spend & COGS for free LLM inference to be funded? For users who don't want to pay, or maybe can't pay?
      • derektank 2 hours ago
        Perhaps it’s a glib and easy thing to say, but after a teaser period, I would simply not offer free LLM inference. Agreeing to serve ads just completely re-aligns your interests away from providing the best possible user experience to something else entirely.
      • infinite_spin 2 hours ago
        From things like defense/private contracts

        e.g. colleges pay for institutional subscriptions

        • 2ndorderthought 2 hours ago
          The average person doesn't benefit from defense contracts ... Like ever.
          • IX-103 1 hour ago
            The average person is slightly more female than male and has 2.1 children, but they do benefit from defense contracts since it makes up a small percentage of their salary.
    • iammrpayments 2 hours ago
      It has begun ever since they nerfed chatgpt4 before releasing 4o
    • 2ndorderthought 3 hours ago
      In the past month local models have been ramping up in major way meanwhile the namesake providers have upped prices, went offline randomly, and started doing slimier and slimier things.

      I really think the future is local compute. Or at least self hosted models.

      • SchemaLoad 2 hours ago
        The hosted ones still have the advantage of being able to search the internet for live info rather than being limited to a knowledge cut off date.
        • gbear605 2 hours ago
          I’m not sure why a model needs to be hosted in order to make network calls?
          • hansvm 2 hours ago
            Is there a library of good tools for LLMs to call? I have to imagine the bot-detection avoidance mechanisms are a major engineering effort and not likely to work out of the box with a simple harness and random local LLM.
            • ossa-ma 2 hours ago
              Even the hosted ones are blocked from searching certain sites, for example Claude is banned from searching Reddit:

              `Error: "The following domains are not accessible to our user agent: ['reddit.com']."`

            • wyre 2 hours ago
              Tavily, Exa, Firecrawl, Perplexity, and Linkup are all tools for agents to search the web.

              I’ve been building a harness the past few months and supports them all out of the box with an API key.

              • goosejuice 2 hours ago
                Kagi also has an API. People who hate ads are probably the same folk that should be paying for Kagi. That's the sane alternative world where companies respect their users.
        • chrisweekly 1 hour ago
          That's not how it works. Whether local or hosted, every modern model has a cutoff date for its training data, and can be leveraged by agents / harnesses / tools to fetch context from the internet or wherever.
        • darepublic 2 hours ago
          Local ones that support tool use can do the same
        • eightysixfour 2 hours ago
          You can do that locally too!
      • CSMastermind 2 hours ago
        What's the rough equivalent of a local model? Are we talking GPT-4?
        • 2ndorderthought 2 hours ago
          Qwen 3.6 which was released this month is a large but still smaller model. Supposedly it's at about sonnet level when configured correctly. It can be run on commodity hardware without purchasing a data center. https://www.reddit.com/r/LocalLLaMA/comments/1so1533/qwen36_...

          Then there are middle size ones which require multiple gpus which are like gpts latest flagships.

          Then there is kimi 2.6 which is a monster that is beating opus in some benchmarks. https://www.reddit.com/r/LocalLLaMA/comments/1sr8p49/kimi_k2...

          It's basically whatever you can afford. Any trash heap laptop can run code auto complete models locally no problem. The rest require some level of investment, an idle gaming pc, or a serious investment

        • Terretta 2 hours ago
          Depends on your VRAM or "unified" memory for how smart it is, and CPU/GPU for how quick it is.

          128GB of RAM? Sure, the early to mid 4s releases, except maybe 4o. And on an M5 Max, about the same speed.

          I wouldn't really bother under 64GB (meaning 32GB or less) except for entertainment value (chats, summaries, tasky read-only agent things).

        • kay_o 2 hours ago
          GLM 5.1 and DeepSeek 4 are acceptable, but the cost of hardware and energy cost that depending on your use case you may as well purchase a Tokens. They get useless and stupid rapidilty if you quant enough to run on single 16-24GB GPU style.
    • rnxrx 2 hours ago
      The arc of the technological universe is short, but it bends toward enshitification.
  • jesse_dot_id 2 hours ago
    That's cool, I'll never see them.