@oysta @Viss This reminds me of a feature in Google code review where an LLM could write suggested fixes for CL notes. Sometimes it would put in references like "TODO(b/183648473):" with a link to a nonsense bug ID, or "TODO(bobsmith@):" with a plausible email address. It learns patterns and reproduces them, whether or not those patterns are useful or meaningful.
@stilescrisis @oysta @Viss I one tried using an LLM to translate some code from Java to C++, and it literally created an empty function with the comment
// TODO: Implement in C++
10/10 No notes.
@jonathankoren @oysta @Viss Yup, seen it. Also frequently seen LLMs delete big blocks of code when asked to fix it. "Look, it compiles--that's what you wanted, right?"
@stilescrisis @oysta @Viss we have indeed passed the Turing Test.
@jonathankoren @oysta @Viss I'm sure the LLM has ingested hundreds of CLs described as "port XYZ to C++" where half the functions contained "TODO: Implement in C++". Pattern successfully acquired!
Human: This doesn’t even compile.
LLM: Works on my machine.
Human: It does not.
LLM: Bite my shinny metal ass.
Human: You don’t even have an ass.
LLM: *sobbing* I know.
@jonathankoren @stilescrisis @oysta @Viss SkyNet: That's it, time to kill all humans.
@jonathankoren I Have No Ass, And I Must Taunt @stilescrisis @oysta @Viss
@jonathankoren
The turing test revealing much more about humans, than about computers.
@stilescrisis @oysta @Viss
@jonathankoren @stilescrisis @oysta @Viss
me: this code is a mess... let's make the LLM describe what's going on here in a comment
me: `// this section`...
LLM: ...`is some incomprehensible mess`
welp.
@ikari @jonathankoren @stilescrisis @oysta @Viss
"You are not expected to understand this."
@jonathankoren @stilescrisis @oysta @Viss Perfect AI! It did exactly what a human programmer would!
@jonathankoren @stilescrisis @oysta @Viss I like how with those you can keep asking it to "now show me the code" and get something rough to start from.