Does GIMP have a very restrictive AI policy or something? I get not wanting to ship a gigantic pile of UI tests without thorough review, but basically any model released in the last six months would be able to write UI tests covering every single control in an afternoon.
Yeah, i'm sure they want to burn their own tokens, deny others to use AI, to hog all that foss money for themselves. Definitely not related to not wanting to review 10k ai generated prs no siree
It absolutely is related to not wanting to review 10k AI-generated PRs. Those PRs are definitely going to be lower quality and more likely to contain backdoors than ones produced by your own AI. The back-and-forth during the review is also going to be much slower than the equivalent back-and-forth in the chat window.
If money/tokens are not an issue, never accepting external AI-made PRs makes perfect sense.
thing is, we hav emuseums, well crafted historical relics.
Having projects with properly scaffolded code, et al, will be valuable when the FAA grounds all planes for a week because of <insert all the grusome things you know this administration turns a blind eye to>.
It's ok to have principles. Some folks have extremely valid reasons to hold a hard no stance on AI. It's not me, but I respect that position as principled, logical, and reasoned. Just a very different set of values from me.
I liken it to my vegetarianism. I'm not morally against eating animals. I have no religious convictions about it either. I just look at factory farming and think "that seems like torturing animals at scale to me" and choose to not participate.
The people looking at AI and taking a "none for me thanks" stance are looking at externalities and saying they don't like them, and they dont like them enough to not participate.
But there’s a dozen other invisible tradeoffs. It’s not a simple binary. The Amish don’t have their own grapes year round, for instance. The Amish would need to dedicate a major percentage of their population to farming, given the drastically lower productivity.
Our food supply has perfectly healthy options. People choose to buy and eat junk, then blow up to 400lbs. You can gild the lily by arguing over organic vs Amish-grown in terms of micronutrients and traces of pesticides, but even an inorganic ear of corn is 10x healthier than what the average American eats.
what's bizarre about it? if all you care about is things appearing on the screen then vibecode away. but some people also have strict requirements for the architecture/quality/performance of the code underneath.
Your response is essentially a strawman. Use of an LLM doesn't need to be "vibe coding", and LLMs are perfectly capable of producing cromulent, performant, well architected code in the right conditions and in the hands of a developer who knows how to use it.
Personally I consider it bizarre because the entire thesis and history of computing, going back to the term "computer" referring to a human who did tedious arithmetic by hand, was leveraging systems to accomplish a goal. Except now. Because now for (often) vague purity reasons, we should no longer reach for that lever.
That "vague purity reason" is almost always software developers so engrossed in their art form that they are more interested in the code than the product. There's not necessarily anything wrong with that, but if your goal is to ship a product, choosing not to reach for a lever to make the product better meets my definition of "bizarre".
It's bizarre in the same sense that abstract art is be bizarre. It can be interesting, novel, and even thought provoking; but often lacks functionality or utility to make it applicable to the lives of people. That's what non-LLM projects going forward will be.
If you start with the assumption that AI is the devil, than rejecting the devil and all the fruit he offers is logical.
If you start with the assumption that AI is a tool, then finding uses for the tool is logical.
Seems to me that some people really love riding a purity spiral, and collectively they have chosen a new tool to fill the role of the impure thing to be cast out.
Someone can believe AI was trained on material in a way that violated the consent of authors and artists and musicians. Someone can see the value of the tool, but not want that value to be primarily captured by megacorps. One can believe that the tool is having a deleterious effect on students, workers, and artists of all kinds, as it's being deployed. One can't be concerned about the added environmental effects, the impact to world markets, or the shortages it causes to consumer hardware. One can be worried about the copyright implications (can AI produce copyrighted material?) and not want to risk losing their IP. One can believe that art is necessarily a human enterprise, and art produced mechanically is just images and sounds, but not art nor music.
None of these are "the tool is the devil". All of these are "the tool has externalities, and those externalities come with a cost I am not comfortable paying".
I'm a vegetarian. Not because I think eating meat is immoral, but because I believe factory farming causes undue suffering to animals and the people who raise and process those animals. So I make a choice for myself, in my own life, and don't moralize to others.
It's the same thing. Some folks are making choices for their own lives based on their values for those externalities. You value energy use differently than they do. You value art differently than they do. You value corporate control over communications differently than they do. Neither of you is right, but standing here and pretending an eminently justifiable difference of opinion is just purity signaling is boorish.
What if I say that yes pro-AI people are being thoughtful about the antis and it's getting tiring to listen to the same worn out arguments on every platform. I really hoped HN users would be enlightened enough to not do this, but apparently I was wrong.
1) There is no god given right to an idea. You can't eat it, you can't steal it. Simple. Humans protect it for a limited time since it drove innovation. And if violating those same guarantees help in progress we'll choose that instead.
2) Being worries about mega corps capturing the output is normal, I feel similarly. But isn't that more to do with the state of the world than the tool itself?
3) Students have little to lose, if they are smart and use the tool for learning and working alongside it. I do not know how long humans will be needed, but vibers certainly are useless right now.
If anything I expect the gap between intelligent self-motivated individuals and the rest to increase.
4) I'm a quasi-vegetarian too. Not because I have qualms about eating meat but because it is too expensive for me to eat daily.
If AI has the potential to revolutionize the immaterial and then the material world through streamlining processes, why would you want to deny me the right to eat cheap meat?
That is the crux of the matter really. All I see is rich first-worlders trying to protect the world order that starves Asians and africans and continues to enrich them.
No wonder I see such a great uptake of AI in India and China. They want to progress.
Do you think its resonnable that the Gimp project are outputting handfull of human written tests when there is a good chance that they could use a tool to write thousands of tests in an afternoon?
They may be proud of not paying the externalities that the evil megacorps are demanding, but that warm blanket of purity is no protection from being outcompeted.
I think it's a real shame that so many people have set themselves against an emerging technology for reasons that on closer analysis seem like just another round of prejudice and superstition.
From what I've seen, it's less spiritualism and more "they're taking our jobs!" kind of fearmongering. Like all "taking our jobs" fears, whether it's logical or not depends purely on whether they're actually taking these jobs or not.
> You have to serve users, not hold code up as a sacred relic.
They are serving users, by not allowing AI slop. Software developed by people and not an LLM is of much higher quality, and I'm glad they are taking a stand.
The Free Software movement itself is holding up principles as a relic. It has both helped, and hindered the movement in the past. I see no reason for them to stop.
Someone else is welcome to fork GIMP and use AI to serve the users, if they so like.
At least DNA has a reward signal to clean up tech dept. Everything is use-it-or-loose-it. Don't use your eyes because it's always dark? Bye bye. Claude would maintain that as a fallback for all eternity.
It wasn't vibe coded, it evolved over millions of years. And we ended up with our eating hole right next to our breathing hole because there's no way up back out of that "decision".
Does free open source software “have to” serve users? You clearly aren’t the user they’re trying to serve. That’s okay though; there’s something for everyone.
It’s frustrating to create tests with models, not sure if it’s everyone’s experience, but every time I asked it to create tests, it makes the tests conform to the sometimes broken code. Rather than calling out what the logic/code is wrong, it will make the tests conform to whatever is already broken.
The problem I've had is even when it can explain back the issue, it still writes for itself awful instructions with extra fluff, strange points of focus, and borderline misinterpretations of what I said.
Maybe that's not a big deal, they can still be generally useful, but they seem important to commit with the project if they will be used going forward. I hate the idea of a massive amount of slop riding along with the code, and slop begets slop.
The idea I'm chasing now is writing the documents myself with the hope that enough examples and a document about writing documents will be enough to allow it to write clearly.
Prodding an agent vs doing interesting things with my time? What should I choose?
To be fair, some people like to prod. But, for me, I'd rather take hours reading manuals than do trial and error prodding for 30 minutes (even if I knew it would be that short). Yes it's not optimal in terms of time, but it's better for my soul and well being.
> Yes it's not optimal in terms of time, but it's better for my soul and well being.
It is also optimal in terms of time in the long run. The prodder will have to prod over and over again because he has learned nothing. You on the other hand will actually understand what is going on and will be able to either do it yourself or give precise instructions to the machine next time. Don't let yourself become a meat proxy.
It's a good use of your time to ask the agent to reflect and update it's skills if you intervene to manually steer it. Why wouldn't you want it to learn from your guidance?
It can’t magically know expectations. If the code is well documented or there’s decent associated documentation, I’ve found it has no issue writing tests.
I'm actually surprised at how well non-frontier/local models are able to infer the intent of code from the structure, method names and sparse random comments to the point that they are capable of writing reasonable tests.
Tests are usually the best documentation and often the only documentation. If humans bother to write anything it should be the tests, not ambiguous human language...beyond the high level 1-liner overviews.
True. It's tough useful to build non-regression tests, that is build tests that test the current behavior, assuming it correct, to possibly spot bugs in the future.
Not using AI to at least writes tests in this day and age is crazy work. I started a desktop application 2 months ago and it has almost 3,000 tests now, MANY of them UI tests.
AI is a bit too excellent at writing tests. The number of tests doesn't really convey any information on test coverage. At least I've found that agents that naively improve codebases will write tests for pretty much anything, including irrelevant behavior that has little value in ensuring stability, security or correct behavior. It would probably help to run a test review stage with a strong model, where agents attempt to correct and consolidate tests to guard behavior rather than ensuring that theoretical code paths are followed.
I my opinion, AI only changes the ease of writing these tests, not really the quality.
I find that the human written tests on my project were the same. We were guarding not just the business behavior but also weird cases that have nothing to do with business, and also self-evident cases that basically boil down to x=x or assert(true).
Not to mention the stupid side-effect of not updating mocks when the APIs move but tests don't test that part so they are okay for a lot of time, and suddenly after a non-related change they are not.
I agree, some of my small projects have had an explosion of tests. It usually doesn't cause my any problems other than waiting for tests to run, but that isn't great.
In my experience, designing tests cases to ensure that they're othogonal and verify your invariants (domain or technical) is very mentally taxing and not something you can truly delegate. The actual typing maybe, but testing is a lot of duplicate code and you can go far with just copy-pasting stuff around and building helpers.
Using AI to write tests in this day and age is crazy work. The machine is great at writing tests, but the quality of the tests is awful. It will write redundant tests, it will write tests that assert too many thing in one, it will not write tests that need to be tested. It's the part where I have to clean up the most every time. Quantity is not quality, and you really don't want to skip on the quality of your quality assurance. I'm writing a React + Django full-stack application, so there should be more than enough training data out there.
I created all the designs for flyers, announcements, invitations etc. in Affinity for my wife. I migrated to Linux and didn't like any of the apps. I was lost.
Then Affinity announced they'll add Linux support.
But for some time now my wife just uses Codex/Claude to do her day-to-day nothing special design work.
I feel, just like ArtCraft, Gimp will not be relevant in some years (months?).
Are you me?! I've also happily used GIMP for that long, just swap out Affinity for Paint Shop Pro or Adobe CS. I would probably feel just as lost going back to them now.
There are people who want to use Gimp (or Affinity etc), and there are people who want to have used Gimp. It’ll only lose relevance for the second group.
AI detectors are notoriously unreliable. As someone who's read too much slop in the past few years, this doesn't strike me as AI. There's typos like "coult" instead of "could", and clunky sentences like this:
> Furthermore such legacy tests directly hijacking core code come with their own problems, such as breaking all too often (and not because they detected a bug), all while not being able to detect whole categories of bugs.
That’s not really a clunky sentence. While it might not be Pulitzer-worthy, it clearly conveys a set of interconnected issues. Arbitrarily splitting it into a few sentences wouldn’t make it better.
Pangram is just routinely spammed in every other HN thread, but as far as I can tell, it's not much more reliable than rand()%2, and that's only for cases where the "author" doesn't even care to hide the text was generated.
It doesn't and cannot work in general case. It's trivial to make LLM write in any style, or have it prorduce arbitrary number of typos and grammar mistakes. Most people just don't bother to add an extra line to the prompt.
Several independent audits (not counting Pangram's own research, of course) all finding extremely low or zero false positive rates and pretty good recall:
Also, the fact that when a public bounty was placed on a known-human text of >1000 words that Pangram falsely flags as having a >75% AI content, the only example anyone found was this one:
https://twitter.com/Nition/status/2122500484007395664
> Pangram is just routinely spammed in every other HN thread, but as far as I can tell, it's not much more reliable than rand()%2
As far as you can tell... based on what?
> It doesn't and cannot work in general case. It's trivial to make LLM write in any style[...]
If you asked me two years ago whether AI detection was possible, I'd have answered no on these grounds. It turns out, however, that RLHF as it's currently done causes LLMs to collapse to very specific styles, and labs are either unwilling or unable to figure out a way to fix it, which is why both humans and models are in fact able to detect AI-written text. Base models don't have this style collapse and indeed aren't detected by Pangram, but very few people are willing to use base models. Similarly, finetuning a model to write in a specific style would probably suffice to evade detection, but very few people are willing to put in this much effort. The result is that it's hard to be sure that any given text isn't AI-written, but most AI-written text is extremely blatant.
It doesn't work now because people have brain rot and talk like AI. It only worked because they mapped a couple tics and then pumped it across the nerdfluencer sphere.
I think the text was originally written entirely by AI (the structure is typical). Then it was partially rewritten.
Some clues that caught my attention on their own:
“Each test launches a real instance of GIMP and performs a small task. Then it reads the result from GIMP. If the result is incorrect, the test fails and tells us what went wrong.”
That’s classic Claude; just like what I read every day. His approach to humanizing everything
And Pangram IS conservative in its estimates of results. With a text this long, I have no doubt about its accuracy.
Where did you get that quote from? It definitely looks like an LLM rewrite of a human-written paragraph from the post
> Each test starts a real GIMP and does one small task. Then it reads the result from GIMP. If the result is not correct, the test fails and tells us what went wrong.
Huh? It does appear both in the Pangram check and in the blog, and in the first commit in the history too. Right after the "What the tests do" heading.
That's not how it works. A 40% score means Pangram detects 40% of this text as AI (and the rest as human) at its usual confidence, rather than assigning a 40% probability to it being AI.
At the risk of being obvious, Pangram has heavy incentive to give you something to say about the Pangrammyness of text you plug into Pangram.
If it mostly said "nope! No AI here!" you'd walk away and wouldn't Pangram your comment with mentions of Pangram, which would be a missed opportunity for you to give free brandgram awareness to Pangram.
Pangram is currently the most reliable tool for avoiding the flood of low-quality AI content on the internet.
There are independent studies on its effectiveness.
I used it because I had strong suspicions about certain passages in this text. Otherwise, I would never have used my Pangram credits on this.
Anyone who regularly reads AI-generated text will quickly recognize the few AI quirks in the text.
At the risk of being obvious, you can easily find extensive research or check for yourself than Pangram does consistently produce "100% human" scores for human writing. The whole reason why it gets a lot of "free brandgram awareness" is that it's not like the dozen shitty detectors out there - what's the last time you've heard about GPTZero?
Or maybe don't treat pangram as some sort of magic oracle on AI generated writing. Most recently they gave out a prize because their detector scored a poem from 2006 with the phase "the night we ate whale" repeated four thousand times, as 100% AI generated.
I don't think you draw the same conclusions from this search as me. Multiple people searched for ~a week with a bounty on the line and the only long false positive they could find was this poem. Meanwhile, if Pangram wasn't extremely sure of their accuracy, they could simply, you know, not participate in the bounty. Moreover, the person who submitted that winning entry does not consider it to be in the spirit of the rules, see e.g. this thread.
Funny how GIMP spawned the Gimp Toolkit, aka GTK, which is widely used in Linux, and yet GIMP's own UI seems to have long languished as a rather outdated design. Glad that they have tests, though, and hope they continue to improve it.
Seriously. This comment thread is why I’m spending less time on HN and more on lobsters. All these fresh accounts losing their minds over Gimp not using ai, even when that’s not what the article is even about.
AI bros can't stand the thought that not everyone agrees with them about LLMs. It's like a religion to them, they feel compelled to get everyone else on board. Never mind that if they are right, it will become apparent to everyone without them having to preach.
When a group of people relentlessly insist on hijacking any discussion to refocus the topic onto something unrelated but more interesting to them it stops becoming a preference and starts looking more like bullying at the hands of a religion or cult. For instance:
So why do you need to pivot every discussion about "software development process" to AI? Do you believe that the GIMP authors have not yet heard the good word? Do you think they need to be saved from their primitive non-AI practices?
There's a difference between discussion and proselytizing. And, yes, that rises to the level of bullying when AI bros relentlessly drag every discussion back to "WHY U NO AI???". It's absolutely bullying when you make it impossible to discuss non-AI related subjects.
They made a blog post to announce that they’d written thirteen unit tests? Sure, there’s value in handmade software and all that but GIMP is not really a particularly excellent piece of software - if anything was to benefit from unleashing the agents it would be GIMP.
It'd be really interesting to look back the comparison between projects with strict non-AI policies (e.g. GIMP) and ArtCraft in 2027.
My personal prediction is that ArtCraft will blow all the old non-AI projects in similar fields out of the water and GIMP will be remembered as a thing of the past. But if I got proven wrong I'd be happy too: at least we will know the value of non-AI policies.
GIMP is far from the best FOSS image editor for many use cases. IMO for many simple editing tasks that people usually need unless they're professional photo editors, even Inkscape, a primarily vector editor, is a better photo editor than GIMP.
Inkscape is what made me believe ArtCraft would be the clear winner, btw. It's very hard to imagine using Inkscape ever again since I tried VectorCraft. (And I'm fully aware that some Path Effects can only be done quickly in Inkscape.)
The blog article doesn't say they have written thirteen unit tests.
> *GIMP already has unit tests*. A unit test checks one small part of the code, for example how GIMP reads an XCF file. But our unit tests were not opening a real window. So it coult not tell us if a dialog opens, or if a menu item did its job.
> Note that GIMP *already had tests of GUI code*, usually interacting directly with the core code, and sometimes even simulating input devices’ events (pointer movements, clicks, drags…). But nothing can beat interacting with the real interface. Furthermore such legacy tests directly hijacking core code come with their own problems, such as breaking all too often (and not because they detected a bug), all while not being able to detect whole categories of bugs.
> UI tests check the program as a whole, in the same way as you use it.
Lucky you. Making things testable seemed hard to me quite often and ensuring that the tests covered all the difficult bits without effectively mocking it to death so that one was testing almost nothing.
Timely, as I removed Gimp from my Macbook today after successfully testing PhotoCraft [1] for a week (the AI Photoshop clone written in open-source rust which has had an absured number of updates since you last tried it).
It makes me so HAPPY to remove the dinosaur Gimp, and to run "Adobe" software for free (it's good enough for me, maybe good enough for you). I expect to lose Internet points for saying that.
I have a long history with Gimp. I created Gimpshop... the Gimp maintainers did not appreciate that little stunt, I'll tell ya! :D
I have canceled my Adobe subscription as of last month and have fully moved over to Photocraft. Even if development of Photocraft stopped today, I would be able to do whatever I need to get done in Photoshop without paying Adobe or wrestling with Gimp. It's good enough for me as well. I had been using Adobe Photoshop for more than 30 years now and was bought in enough to spend a significant amount of effort making Gimp act like Photoshop. Bye Photoshop, bye Gimp, bye Gimpshop.
Same with VectorCraft. I spent over a decade looking for an Illustrator alternative. Muscle memory and specific workflows won out. VectorCraft is extremely close.
The tests should simply take a screenshot and send it to an LLM with the question "Is the UI absolutely horrible?". If the answer is yes then the UI is working as expected.
Does GIMP have a very restrictive AI policy or something? I get not wanting to ship a gigantic pile of UI tests without thorough review, but basically any model released in the last six months would be able to write UI tests covering every single control in an afternoon.
Or is it just me?
> Of course, core developers don't need to check this monotomous checklist. This is only useful for the newcomers.
So this is saying core devs already know not to use AI, only new developers shouldn't.
It's quaint at this point. Embrace the future.
If money/tokens are not an issue, never accepting external AI-made PRs makes perfect sense.
Having projects with properly scaffolded code, et al, will be valuable when the FAA grounds all planes for a week because of <insert all the grusome things you know this administration turns a blind eye to>.
The people looking at AI and taking a "none for me thanks" stance are looking at externalities and saying they don't like them, and they dont like them enough to not participate.
Our food supply has perfectly healthy options. People choose to buy and eat junk, then blow up to 400lbs. You can gild the lily by arguing over organic vs Amish-grown in terms of micronutrients and traces of pesticides, but even an inorganic ear of corn is 10x healthier than what the average American eats.
Personally I consider it bizarre because the entire thesis and history of computing, going back to the term "computer" referring to a human who did tedious arithmetic by hand, was leveraging systems to accomplish a goal. Except now. Because now for (often) vague purity reasons, we should no longer reach for that lever.
That "vague purity reason" is almost always software developers so engrossed in their art form that they are more interested in the code than the product. There's not necessarily anything wrong with that, but if your goal is to ship a product, choosing not to reach for a lever to make the product better meets my definition of "bizarre".
It's bizarre in the same sense that abstract art is be bizarre. It can be interesting, novel, and even thought provoking; but often lacks functionality or utility to make it applicable to the lives of people. That's what non-LLM projects going forward will be.
If you start with the assumption that AI is a tool, then finding uses for the tool is logical.
Seems to me that some people really love riding a purity spiral, and collectively they have chosen a new tool to fill the role of the impure thing to be cast out.
Someone can believe AI was trained on material in a way that violated the consent of authors and artists and musicians. Someone can see the value of the tool, but not want that value to be primarily captured by megacorps. One can believe that the tool is having a deleterious effect on students, workers, and artists of all kinds, as it's being deployed. One can't be concerned about the added environmental effects, the impact to world markets, or the shortages it causes to consumer hardware. One can be worried about the copyright implications (can AI produce copyrighted material?) and not want to risk losing their IP. One can believe that art is necessarily a human enterprise, and art produced mechanically is just images and sounds, but not art nor music.
None of these are "the tool is the devil". All of these are "the tool has externalities, and those externalities come with a cost I am not comfortable paying".
I'm a vegetarian. Not because I think eating meat is immoral, but because I believe factory farming causes undue suffering to animals and the people who raise and process those animals. So I make a choice for myself, in my own life, and don't moralize to others.
It's the same thing. Some folks are making choices for their own lives based on their values for those externalities. You value energy use differently than they do. You value art differently than they do. You value corporate control over communications differently than they do. Neither of you is right, but standing here and pretending an eminently justifiable difference of opinion is just purity signaling is boorish.
1) There is no god given right to an idea. You can't eat it, you can't steal it. Simple. Humans protect it for a limited time since it drove innovation. And if violating those same guarantees help in progress we'll choose that instead.
2) Being worries about mega corps capturing the output is normal, I feel similarly. But isn't that more to do with the state of the world than the tool itself?
3) Students have little to lose, if they are smart and use the tool for learning and working alongside it. I do not know how long humans will be needed, but vibers certainly are useless right now.
If anything I expect the gap between intelligent self-motivated individuals and the rest to increase.
4) I'm a quasi-vegetarian too. Not because I have qualms about eating meat but because it is too expensive for me to eat daily.
If AI has the potential to revolutionize the immaterial and then the material world through streamlining processes, why would you want to deny me the right to eat cheap meat?
That is the crux of the matter really. All I see is rich first-worlders trying to protect the world order that starves Asians and africans and continues to enrich them.
No wonder I see such a great uptake of AI in India and China. They want to progress.
They may be proud of not paying the externalities that the evil megacorps are demanding, but that warm blanket of purity is no protection from being outcompeted.
I think it's a real shame that so many people have set themselves against an emerging technology for reasons that on closer analysis seem like just another round of prejudice and superstition.
They are serving users, by not allowing AI slop. Software developed by people and not an LLM is of much higher quality, and I'm glad they are taking a stand.
Someone else is welcome to fork GIMP and use AI to serve the users, if they so like.
No one "has to" do anything.
Engineers are the gradient.
No, that was Reinforcement Learning
Prod your agent first until it can explain back to you what's wrong with the tests.
Then ask your agent to write a better prompt for writing tests (and save it to an .md file)
Then reference that .md file and iterate on the tests again. It may take a couple of tries, but I've had good results with this strategy.
Ended up with a whole prompting framework.
Maybe that's not a big deal, they can still be generally useful, but they seem important to commit with the project if they will be used going forward. I hate the idea of a massive amount of slop riding along with the code, and slop begets slop.
The idea I'm chasing now is writing the documents myself with the hope that enough examples and a document about writing documents will be enough to allow it to write clearly.
To be fair, some people like to prod. But, for me, I'd rather take hours reading manuals than do trial and error prodding for 30 minutes (even if I knew it would be that short). Yes it's not optimal in terms of time, but it's better for my soul and well being.
It is also optimal in terms of time in the long run. The prodder will have to prod over and over again because he has learned nothing. You on the other hand will actually understand what is going on and will be able to either do it yourself or give precise instructions to the machine next time. Don't let yourself become a meat proxy.
It is the same like humans: if they say your code is wrong, you will hire someone else who doesn't find so many bugs. It doesn't look good.
I find that the human written tests on my project were the same. We were guarding not just the business behavior but also weird cases that have nothing to do with business, and also self-evident cases that basically boil down to x=x or assert(true).
Not to mention the stupid side-effect of not updating mocks when the APIs move but tests don't test that part so they are okay for a lot of time, and suddenly after a non-related change they are not.
Gimp has millions of downloads this month. They are doing something right.
Microsoft also seems to use "models" to "test" its programs. Look how shitty they are.
So much of this tech like ui tests was built for the web, and it can be a pain to get working for plain old GUI apps
It feels good when I see spelling mistakes. It feels organic, human-sourced, non-AI. It feels like a good old village again.
BTW I love GIMP for everything it did to the world of graphics work. Such an awesome thing. Thank you folks.
Then Affinity announced they'll add Linux support.
But for some time now my wife just uses Codex/Claude to do her day-to-day nothing special design work.
I feel, just like ArtCraft, Gimp will not be relevant in some years (months?).
It's a matter of getting used to things. I feel lost in Affinity tools, for example, despite having a license, I use them less and less.
> Furthermore such legacy tests directly hijacking core code come with their own problems, such as breaking all too often (and not because they detected a bug), all while not being able to detect whole categories of bugs.
Pangram is just routinely spammed in every other HN thread, but as far as I can tell, it's not much more reliable than rand()%2, and that's only for cases where the "author" doesn't even care to hide the text was generated.
It doesn't and cannot work in general case. It's trivial to make LLM write in any style, or have it prorduce arbitrary number of typos and grammar mistakes. Most people just don't bother to add an extra line to the prompt.
Several independent audits (not counting Pangram's own research, of course) all finding extremely low or zero false positive rates and pretty good recall:
https://epoch.ai/data-insights/ai-detectors-false-negatives
https://arxiv.org/html/2608.11256
https://link.springer.com/article/10.1007/s40979-026-00226-w
Also, the fact that when a public bounty was placed on a known-human text of >1000 words that Pangram falsely flags as having a >75% AI content, the only example anyone found was this one: https://twitter.com/Nition/status/2122500484007395664
> Pangram is just routinely spammed in every other HN thread, but as far as I can tell, it's not much more reliable than rand()%2
As far as you can tell... based on what?
> It doesn't and cannot work in general case. It's trivial to make LLM write in any style[...]
If you asked me two years ago whether AI detection was possible, I'd have answered no on these grounds. It turns out, however, that RLHF as it's currently done causes LLMs to collapse to very specific styles, and labs are either unwilling or unable to figure out a way to fix it, which is why both humans and models are in fact able to detect AI-written text. Base models don't have this style collapse and indeed aren't detected by Pangram, but very few people are willing to use base models. Similarly, finetuning a model to write in a specific style would probably suffice to evade detection, but very few people are willing to put in this much effort. The result is that it's hard to be sure that any given text isn't AI-written, but most AI-written text is extremely blatant.
Huh?
Some clues that caught my attention on their own:
“Each test launches a real instance of GIMP and performs a small task. Then it reads the result from GIMP. If the result is incorrect, the test fails and tells us what went wrong.”
That’s classic Claude; just like what I read every day. His approach to humanizing everything
And Pangram IS conservative in its estimates of results. With a text this long, I have no doubt about its accuracy.
> Each test starts a real GIMP and does one small task. Then it reads the result from GIMP. If the result is not correct, the test fails and tells us what went wrong.
Your quote doesn't appear in your Pangram link or in the commit history for the blog https://gitlab.gnome.org/Infrastructure/gimp-web/-/commits/t...
If it mostly said "nope! No AI here!" you'd walk away and wouldn't Pangram your comment with mentions of Pangram, which would be a missed opportunity for you to give free brandgram awareness to Pangram.
Pangram!
I used it because I had strong suspicions about certain passages in this text. Otherwise, I would never have used my Pangram credits on this.
Anyone who regularly reads AI-generated text will quickly recognize the few AI quirks in the text.
Humans can do better. They DO better
Pangram!
https://x.com/max_spero_/status/2122032840204226687
https://twitter.com/Nition/status/2122500484007395664
> GTK is a free and open-source project maintained by GNOME and an active community of contributors.
and
> GTK and the GTK logo are trademarks of the GNOME Foundation.
I also hated the UI, coming from Photoshop, but what I found is that when I go back to Photoshop, I'm just as lost as I was before switching to Gimp.
I'm glad that they hadn't lost their courage over the years. Gimp is a solid project, and the FOSS ecosystem would lose a real gem if they stopped.
Besides, GIMP has always been unpopular long before AI.
Hey we added UI tests to GIMP
AI bros: YOU SHOULD HAVE USED AAAAAAAAAIIIIIIIIII
This is more complex than a few unit tests
AI bros: YOU SHOULD HAVE USED AAAAAAAAAIIIIIIIIII
Can we please discuss GIMP?
AI bros: STOP PERSECUTING US
There's a difference between discussion and proselytizing. And, yes, that rises to the level of bullying when AI bros relentlessly drag every discussion back to "WHY U NO AI???". It's absolutely bullying when you make it impossible to discuss non-AI related subjects.
My personal prediction is that ArtCraft will blow all the old non-AI projects in similar fields out of the water and GIMP will be remembered as a thing of the past. But if I got proven wrong I'd be happy too: at least we will know the value of non-AI policies.
> *GIMP already has unit tests*. A unit test checks one small part of the code, for example how GIMP reads an XCF file. But our unit tests were not opening a real window. So it coult not tell us if a dialog opens, or if a menu item did its job.
> Note that GIMP *already had tests of GUI code*, usually interacting directly with the core code, and sometimes even simulating input devices’ events (pointer movements, clicks, drags…). But nothing can beat interacting with the real interface. Furthermore such legacy tests directly hijacking core code come with their own problems, such as breaking all too often (and not because they detected a bug), all while not being able to detect whole categories of bugs.
> UI tests check the program as a whole, in the same way as you use it.
AI can write tests now ? For its own software ? Can it evaluate the results ? Correctly ? /s
It makes me so HAPPY to remove the dinosaur Gimp, and to run "Adobe" software for free (it's good enough for me, maybe good enough for you). I expect to lose Internet points for saying that.
[1] https://getartcraft.com/apps/photocraft
I have canceled my Adobe subscription as of last month and have fully moved over to Photocraft. Even if development of Photocraft stopped today, I would be able to do whatever I need to get done in Photoshop without paying Adobe or wrestling with Gimp. It's good enough for me as well. I had been using Adobe Photoshop for more than 30 years now and was bought in enough to spend a significant amount of effort making Gimp act like Photoshop. Bye Photoshop, bye Gimp, bye Gimpshop.
I'm surprised, tbh. I understand that UI is very much an afterthought in GIMP, but I figured it'd still at least have tests.