It wasn’t just this though; the tool itself lacks the intent, context, and limitations of what we’re doing. It doesn’t have other aspects of the project, influences, references, or personal experiences in the back of its mind, because it doesn’t have a mind.

This describes the fundamental problem with AI. The chatbot will forever be like that new recruit to the team. Sure, they have the skills to make some contributions, but they lack the surrounding context to fully work autonomously. They need some guidance to get to the right path.

The difference between the chatbot and the new recruit is that the chatbot won’t remember all the guidances it got. The chatbot won’t remember all the design decisions that were made. The chatbot won’t remember that time prod went down. The chatbot will forever be like the new recruit with no experience.