One thing I can see that the current AI cannot replace a programmer (for the time being) is working on a complete project.
In real world, a project consists of a lot of files, modules, classes, data and logics behind.
Some resources are stored or documented on different location, servers, database, software and platforms.
Can it remembers and do thorough search?
For example, the AI provided you the code last week. Today, you ask it about the project again.
How about tomorrow you ask it again? and the day after tomorrow and so on...
Maybe you can say yes, "it thinks" but what I understand is, it will read and scan through all the files again.
A human can roughly know where the "location" (file path) or the "exact" object to find straight to the point,
provided the project is well organized in a structure which is "designed for human" to understand.
Let say it made a modification yesterday. Can you ask it to reverse what is changed?
Another scenario is a team of programmers are using AI to work on the same project.
Can it know the chronology and details who are responsible on which part?
Maybe yes with another tool to manage the audit log. But why we need it when now we don't?
Will it commented a todo and later come back to it?
Will it avoid something that a part of code which is marked dangerous not to touch or has warning code.
In a real world project, there are many parts may need improvement.
Can it provide some good ideas that cover every aspect?
I think it only can work on a specific scope.
A project is on going. Is AI part of the team?