

Yeah Idk. While I do in fact always have issues prompting AI… I kinda also think it has a weird form of “intelligence”. I wouldn’t say it does really well at following instructions. It tries. Certainly. But sometimes it rather does silly things. Like I recently was trying to prototype some web app. The app didn’t work. So I told it to write tests. And it wrote some stub which always passed. I had an argument with the agent how it can’t just tell me the project works now, but it always has to follow the usual agentic pattern: Plan, write code, execute the test suite, fix mistakes, repeat and only then add all files to a commit and tell me it’s done. And now we need some tests for it itself to see whether the program runs. It just wrote super convoluted tests, launching some headless browsers, didn’t ever get it right so ALL the tests kept failing. I told it to test functions and API endpoints instead (which is kind of a no brainer to do anyways). Those also kept failing. And after several hours of this nonsense it told me: TOO HARD, NEED TO FOCUS! And staged a commit which just deleted the entire test suite 😆 Hilarious. But neither what I wanted, nor what I instructed it to do…
I forgot what model that was. I was testing the Hermes Agent at that time.
I never know what amount of hand-holding is expected from me as the human operator. Models keep getting better. A year ago I had them make up convenient, yet nonexistent functions. Like mathproblem.solve() That hasn’t hapoened in a while. But I can’t be expected to instruct and teach it every tiny detail?!










Interesting. Most other people seem to use coding agents. I mean I also tried the polar opposite end of the spectrum. Copy-paste snippets into ChatGPT and back. I think that’s how a lot of people got started. But it’s tedious, still makes me let the AI do things which I later regret in the design. And I tracked my time once or twice for similar tasks. And I was slower than just typing it down myself without any AI assistance. Guess I still have to figure out what to do to get some proper use out of it.
What kind of tools do you use for your workflow? Some IDE plugin or “agent” so it has access to the entire project files, but then give it stories of a size it can tackle in one shot? Or subdivide?
I mean I also tried to subdivide tasks into chunks and hand those out. But that also has some tendency the AI doesn’t really get what it’s supposed to do because it’s missing the broader picture. That was kind of the reason for me to try agents, so it has a plan, knows what’s next in line so it doesn’t write code which doesn’t integrate (as is) into the next step to do.