Stack Underflow
What an AI victory tells us about its ongoing battle with us
In 2020 I founded Artificial Frost and immediately became both the best and worst developer on the team. I would often turn to Stack Overflow (SO) when poorly written or non-existent documentation for some particular library proved impenetrable. SO was one of the most popular sites in which to ask specific technical questions about software languages, libraries or techniques.
Stack Overflow was incredibly popular. On 2 June 2021, it was sold for $1.8 billion.
As of the summer of 2025 it is effectively over.
I preferred SO over Reddit because answers tended to be more detailed, and because of this accidental 'hub answer' feature. I and many other people found Stack Overflow answers via Google, so we would tend to find more popular answer pages first, which would often have a rich discussion and back and forth about how to do some particular thing.
The original questions on these pages could be years old, but it didn't matter because Google Search kept on sending visitors to the page who would provide updated answers and comments.
These hub question pages had thousands of views and a plethora of reasonable/partial answers.
My input tended to be "end to end" answers, which I posted to these hub pages, showing how to do something (relevant to the original question) from end to end. I provided these answers to thank the SO community for the fragmentary answers that I was able to piece together into a solution to my problem.
My reputation grew at a relatively steady pace until 2025 when it very noticeably stalled.
Around this time, I finally asked my first question. I had no inherent reluctance about asking questions, it's just that every time I had gone to ask a question in the past, I had to first make sure that I had tried everything, and carefully checked my work, and most important of all in the eyes of the SO community, was not asking a question that had already been asked. The SO community is notoriously critical, so I had to take care that every detail was correct. In the process, each time I would end up answering my own question before hitting "Post".
In any event, I asked this admittedly boring question and got no answers or comments.
Ever.
As of this writing my question has 48 views. The chance that anyone is going to be directed to his question by Google Search is microscopic, especially now that Google Search is being replaced by AI answers.
I wondered if the chatbots had eaten Stack Overflow's lunch. I found the answer in this article.
I grabbed my question from SO and plopped it into Claude and ChatGPT. Perfectly reasonable answers were spit out, with sample code and explanatory text, just as in those well-crafted SO answers I used to write.
Like most developers, once I had this chatbot experience, I knew I was never going to go back to SO.
Ever.
It made sense - if you could just train a chatbot on a combination of documentation, tutorials and maybe some SO or Reddit exchanges, you would be able to generate answers that were much better written than typical documentation, but just as complete and correct.
Crucially, there's also only so much Python to learn, and furthermore, writing code is a task at which AI's shortcomings are uniquely irrelevant.
When we ask about the ability of AI to replace something human, the defeat of Stack Overflow and its human community gives us some useful information about how and why that happens.
Why the task was so AI-friendly:
Lots of Q&A format training data with voting (as with Reddit)
Technical subject matter with few disputed facts
Online documentation that has the answers providing a Wikipedia-like training task (meaning, if you just trained on the documentation, you'd have the answers)
Minimal need for opinion, point of view, personality
What shortcomings in SO made it vulnerable
Answers often fragmentary, out of date, wrong versions - you had to piece together your solution
Answers often anecdotal, not backed by the documentation
new questions had little pickup - you were less and less likely to get an answer by asking a new question
oddly insulting and/or confrontational tone of many comments
How was AI victorious
Synthesized online reference material and GitHub code
Used a neutral tone, eliminating the negative elements of SO
Provided end to end answers with multiple examples
This is an example where the absence of humanity works in its favour. AI lacks six key human traits: Backstory, Friends and Colleagues, Humility and Self-doubt, Accountability and Shame, Humour and a rooted Point of View. None of these are required or even desirable in answering technical questions about how to write code.
I was going to put a tech blog on this site, as a substitute for my posts to SO. But then I realized I would just be substituting for something that has been, not just rendered obsolete, but obliterated completely.
In the human competition with AI, we have to pick our battles.