Something I don’t quite know, maybe someone closer to math can answer this question
It seems we’re making tremendous progress on the back of existing abstractions and concepts with the brute force ability to generate language and verify proofs.
For example, Tao says about the Riemann proof:
> appears to use the full power of modern developments on the Langlands program and arithmetic geometry
What I wonder: how do we create new abstractions and concepts? Like whatever “Langlands program” is? That then feedback into the system, and allow for even more sophisticated mathematics.
Are we assuming AI will do this? Or does this still need to be something at least agreed-upon by a mathematics community - in the same way programmers talk about a “linked list” without having an hour long conversation to define it axiomatically? And without that social aspect, without breaking down long proofs into Lego block common abstractions, math may plateau? In part because we lose the ability to ask meaningful questions?
This has been ambiguous so far. Most people guessed "the AI can't build new theory yet, but can do insane brute-force, which turns out to be surprisingly powerful, and probably the theory building will get there eventually". I think that in the next 14 days, as this gets processed and understood, there's a good chance we finally settle this.
Compare Elliot Glazer a month-ish ago:
> I occasionally talk to experts on all the MP's. Their rough summaries on what is needed to solve them usually go:
So if we're in "not a clue" territory, maybe that's that.
I fear that it gets muddled again with e.g. the concurrent human announcement and that in retrospect RH turns out to be easier than expected, like many other problems before.
Math is hard, but how hard math is is also hard...
A lot of people have raised the possibility of math may plateau because humans no longer have the insights for new abstractions, but the truth is nobody knows.
Langlands is interesting because it is most conjectural (and not completely clear what the precise statements are -- hence "program" and not "conjecture"), but proving special cases turn out to be tremendously powerful. One special case implied Fermat's Last Theorem, for example.
Nobody knows the answer to that question, we are discovering in real-time what frontier mathematicians and frontier AI are able to do to solve previously unsolved problems.
That being said, its probably going something akin to how experimental and theoretical physics have an interplay with each other.
Can we develop more and more all encompassing abstractions (theories) that explain and verify experimental results; translates to, can we come up with more and more theorems/abstractions that explain formal proofs (and perhaps provide explanations for other known proofs)? Probably yes, and likely will also be accelerated by AI.
How this fits into the discipline of mathematics is something we are currently finding out.
Langlands program[0] was proposed by the Canadian mathematician Robert Langlands (1967, 1970) seeking to relate the structure of Galois groups in algebraic number theory to automorphic forms and, more generally...
Is anyone else struggling with feelings of both excitement and terror? I haven't felt this much personal uncertainty about my career/life since I was an L1 MLE (10 years ago).
I've been programming since I was 12 and working in the industry for 13 years, and honestly I think I'm done with it all.
I'm starting studies to be an electrician course next year. I want to work in an industry where I'm expected to do high quality work, made to last decades. I want to be as far away as possible from the slopfest.
I don’t know how you were raised but being an electrician is hard physical work. It’s very blue collar. Are you able to give up your office worker status and still feel satisfied? I wouldn’t. Being a blue collar worker changes your status in society and how people view you whether you want it to be true or not. Obviously, if there’s no other option, it makes sense and you don’t have a choice. As a software engineer, my peer groups and friends are doctors and lawyers, etc. Anecdotally it never includes anyone from the trades, including plumbers electricians roofers, and all of that. No one is consciously excluding these people. It just doesn’t seem to happen as naturally.
At a very baser level being a software engineer makes me feel like an important man in society being an electrician would not give me the same feeling. Obviously this is totally arbitrary, but I think the vast majority of software engineers think this way…
Not a software engineer or father sky, but I would take the status hit of leaving an office job in a heartbeat if something manual paid just as much and as stably (including secondary costs). I would dig holes and clean toilets.
For sure, so would I but I’m just saying it wouldn’t make me feel as satisfied with my life and it’s something to think about when this is going to apply to one of the largest well paid groups in America.
Personally, a little less excited and feeling a bit left out, a lot of the more interesting stuff is being done with massive investments I could only dream of.
9-10 years ago I was in a smaller structure and basically doing close to SOTA work in the field of NLP: contributions to `spacy`, some of the best word2vec models models for our language (french) and good english ones, at least models that crushed other word2vec models of the time on our large corporate benchmarks (both french and english), and were on par (english) and sometimes better (french) than the official benchmarks of the time. Mostly through minor model tweaks but major data sanitation and preparation work. And then custom transformer-based architecture for other NLP tasks that were also better than all off-the-shelf NLP solutions of the time. And even on my free time I could do some cool ML/NLP stuff no one else was really doing.
Now I am in a larger structure with more resources, yet I know that both in terms or resources and honestly to a degree in terms of skill I feel left out of the current NLP/AI SOTA landscape.
I have a friend who is a great expert on rule-based machine translation and natural language understanding in the classical sense (intellectually describing, in detail, how individual natural languages work and are structured), and none of her techniques have achieved state-of-the-art results for some years. The famous bitter lesson.
It sounds like you were already doing statistical NLP (the thing that has been clobbering everything rule-based in performance) but have seen that field itself start to require much greater resources than what you were working with.
mostly just depression, I feel little hope that this technology will positively impact my life, feel like my job is at risk and fear the consolidation of wealth and power at these freaks at the labs trying to build god and end the world.
It feels increasingly hard to plan for the future. There's little choice but to assume the future will be enough like the past to be predictable from my experience and knowledge, but that seems less and less likely.
For now, same old stuff. Go to work, keep up with the latest changes, get the kids to school, plan to send them to college. Hard to say if that's the right move at the moment, but what else is there?
you could make sure to buy land while you can and start your vegetable garden and produce as much food for your consumption as possible.. that's what i did, make me sleep better at night
In my opinion it shows how broken our governance / political systems are. The way you feel like this reality imposed on you really is a kind of violence in my opinion.
I basically just try over in the moment if each day and hope we have many left.
I get moments I can only describe as lucidity, or a feeling of hyper-reality. Most of the day I just go with the flow of living, but every so often it’s as if the protective mechanisms in my brain switch off, and I’m hit with a weird mix of feelings that boils down to “holy shit, this is actually happening”. I remember having similar moments as a teenager, when I’d suddenly realize, on a really visceral level, that I am in fact going to die some day, as if my brain would stop hiding the "truth" from me for a brief moment. This feels similar.
Some context for non-mathematicians (like me): the Four Color Theorem was the first major theorem to be proved with extensive computer assistance, which caused a major kerfluffle when it happened back in the 1970’s.
I understand that Tao does not want to promote a result which could turn out to be incorrect, but I simply cannot imagine posting about a Riemann Hypothesis result and not commenting about the significance.
What actually IS the significance of a proof? People on Reddit say "not much value in proof because operative assumption was it is true, so nothing changes". I know nothing about it.
I would offer an alternative that I haven't heard yet.
The standard answer was that if somebody could prove it the techniques itself would require and add new insight.
However, that does not seem to be the case for now, as its currently several GB.
Instead, what I find significant, is that a lot of people were presuming Elegant math and what we got is several GB - and it might just be that.
There is an obvious tectonic shift happening but seeing RH proven like this and perhaps _not_ be reducible to something understandable by a human would be the nail in the coffin for what I believed math and logic is, and a starting shot for something new entirely.
I'm not too plugged into the academic world - so maybe they've already understood this.
3b1b had hopes that maths in the age of AI would become about explaining and simplification. However, I now have to entertain the idea if not outright accept the reality, that the biggest questions we thought to ask have answers that simply sit outside the realm of human capability to wrap our head around.
The significance for me is we lose the presumption of elegance.
Instead our human-maths are the tip of the iceberg that just so happen to be simple enough to be human comprehensible; and a sampling error on our part to think the pattern would hold.
Yes, this is correct. Every working number theorist assumes it is true. So this validates those assumptions and many theorems whose hypothesis is "if RH then X" will now be shortened to "X is true"
Yes, but sometimes it seems like almost everything "interesting" is contingent upon RH. So this proof proving valid would be like pouring concrete where there used to be a toothpick sculpture.
To be fair, the proof of the quasi-RH was reinforcing the toothpick sculpture with some epoxy.
Maybe he understands that a proof that no one understands is not really useful, so the significance is fairly lessened until the result is boiled down and understood.
>Maybe he understands that a proof that no one understands is not really useful
Compared to the volumes of pure math proofs which are useful?
>so the significance is fairly lessened until the result is boiled down and understood
Significant enough to make a blog post about it the same day it occurs, but not significant enough to mention the significance of it within the blog post itself lol
I imagine Tao is just being careful and conservative with what he's saying it this point. His previous posts discussing AI in mathematics probably garnered way more attention (including negative attention) than he expected, so it'd be fair if he kept his perspective a bit more neutral and muted now. But it's pretty obtuse to assume that Tao doesn't consider this to be one of the most important events in his life. You don't need a PhD in mathematics to appreciate the significance of this.
It's interesting to me that the ANT GRH proof appears to have been generated directly in Lean, whereas the OAI NS proof I believe was produced in natural language then formalized into Lean.
Maybe GRH was as well, I haven't seen much about how these were put together. But, it's a curious difference in approach if not.
It’s worth noting that this is a post from Terry himself rather than him reposting something from somebody else.
I find that a lot of the times that people see the post from Terrys site they attribute the authorship to him when he does a significant amount of reposting.
It seems we’re making tremendous progress on the back of existing abstractions and concepts with the brute force ability to generate language and verify proofs.
For example, Tao says about the Riemann proof:
> appears to use the full power of modern developments on the Langlands program and arithmetic geometry
What I wonder: how do we create new abstractions and concepts? Like whatever “Langlands program” is? That then feedback into the system, and allow for even more sophisticated mathematics.
Are we assuming AI will do this? Or does this still need to be something at least agreed-upon by a mathematics community - in the same way programmers talk about a “linked list” without having an hour long conversation to define it axiomatically? And without that social aspect, without breaking down long proofs into Lego block common abstractions, math may plateau? In part because we lose the ability to ask meaningful questions?
Compare Elliot Glazer a month-ish ago:
> I occasionally talk to experts on all the MP's. Their rough summaries on what is needed to solve them usually go:
> Hodge: not a clue
> BSD: not a clue
> RH: not a clue
> P vs NP: not a clue
> Yang-Mills: "Well..."
https://news.ycombinator.com/item?id=50252673
So if we're in "not a clue" territory, maybe that's that.
I fear that it gets muddled again with e.g. the concurrent human announcement and that in retrospect RH turns out to be easier than expected, like many other problems before.
Math is hard, but how hard math is is also hard...
Langlands is interesting because it is most conjectural (and not completely clear what the precise statements are -- hence "program" and not "conjecture"), but proving special cases turn out to be tremendously powerful. One special case implied Fermat's Last Theorem, for example.
That being said, its probably going something akin to how experimental and theoretical physics have an interplay with each other.
Can we develop more and more all encompassing abstractions (theories) that explain and verify experimental results; translates to, can we come up with more and more theorems/abstractions that explain formal proofs (and perhaps provide explanations for other known proofs)? Probably yes, and likely will also be accelerated by AI.
How this fits into the discipline of mathematics is something we are currently finding out.
[0] https://en.wikipedia.org/wiki/Langlands_program
Yes.
It looks like two independent kernels accept the result, which means its likely that there are no kernel bug exploitations in the proof.
I'm starting studies to be an electrician course next year. I want to work in an industry where I'm expected to do high quality work, made to last decades. I want to be as far away as possible from the slopfest.
At a very baser level being a software engineer makes me feel like an important man in society being an electrician would not give me the same feeling. Obviously this is totally arbitrary, but I think the vast majority of software engineers think this way…
9-10 years ago I was in a smaller structure and basically doing close to SOTA work in the field of NLP: contributions to `spacy`, some of the best word2vec models models for our language (french) and good english ones, at least models that crushed other word2vec models of the time on our large corporate benchmarks (both french and english), and were on par (english) and sometimes better (french) than the official benchmarks of the time. Mostly through minor model tweaks but major data sanitation and preparation work. And then custom transformer-based architecture for other NLP tasks that were also better than all off-the-shelf NLP solutions of the time. And even on my free time I could do some cool ML/NLP stuff no one else was really doing.
Now I am in a larger structure with more resources, yet I know that both in terms or resources and honestly to a degree in terms of skill I feel left out of the current NLP/AI SOTA landscape.
It sounds like you were already doing statistical NLP (the thing that has been clobbering everything rule-based in performance) but have seen that field itself start to require much greater resources than what you were working with.
Room temperature superconductors are still a ways off imo.
For now, same old stuff. Go to work, keep up with the latest changes, get the kids to school, plan to send them to college. Hard to say if that's the right move at the moment, but what else is there?
I basically just try over in the moment if each day and hope we have many left.
It's 4CT on speed.
Is mathematics simply a list of true statements? Or is there some intrinsically human aspect?
What a time to be alive!
When all this starts to extend to the physical world
Just calm down. We can talk about it, I am willing to listen to you.
Are there any loved ones near you or someone you would consider a close friend?
Where are you located? I might be able to send help right away.
The standard answer was that if somebody could prove it the techniques itself would require and add new insight.
However, that does not seem to be the case for now, as its currently several GB.
Instead, what I find significant, is that a lot of people were presuming Elegant math and what we got is several GB - and it might just be that.
There is an obvious tectonic shift happening but seeing RH proven like this and perhaps _not_ be reducible to something understandable by a human would be the nail in the coffin for what I believed math and logic is, and a starting shot for something new entirely.
I'm not too plugged into the academic world - so maybe they've already understood this.
3b1b had hopes that maths in the age of AI would become about explaining and simplification. However, I now have to entertain the idea if not outright accept the reality, that the biggest questions we thought to ask have answers that simply sit outside the realm of human capability to wrap our head around.
The significance for me is we lose the presumption of elegance.
Instead our human-maths are the tip of the iceberg that just so happen to be simple enough to be human comprehensible; and a sampling error on our part to think the pattern would hold.
To be fair, the proof of the quasi-RH was reinforcing the toothpick sculpture with some epoxy.
The impact of the RH proof (assuming nothing torpedoes it) is any of the new machinery involved in the proof.
That said Just because something is solved doesn't mean we don't work on making the proof simplified and easier to understand.
Compared to the volumes of pure math proofs which are useful?
>so the significance is fairly lessened until the result is boiled down and understood
Significant enough to make a blog post about it the same day it occurs, but not significant enough to mention the significance of it within the blog post itself lol
I imagine Tao is just being careful and conservative with what he's saying it this point. His previous posts discussing AI in mathematics probably garnered way more attention (including negative attention) than he expected, so it'd be fair if he kept his perspective a bit more neutral and muted now. But it's pretty obtuse to assume that Tao doesn't consider this to be one of the most important events in his life. You don't need a PhD in mathematics to appreciate the significance of this.
Maybe GRH was as well, I haven't seen much about how these were put together. But, it's a curious difference in approach if not.
I find that a lot of the times that people see the post from Terrys site they attribute the authorship to him when he does a significant amount of reposting.