AI generated code creates a new security attack vector

Adam Crockett šŸŒ€ - Dec 31 '22 - - Dev Community

My new best friend ChatGPT has so far helped me to write a blender plug-in even when I have no python experience and I know that it works, but I canā€™t test it or understand if any of this code is secure in terms of python idiom.

So there in lies the ā€œwhyā€ we need experienced people to operate factory machines, itā€™s one thing to spew out code but you still need experience to quality control and sanity check, something AI still has to work hard on.

However hereā€™s the issue, Iā€™m happy to release my blender plugin without that experience, for all I know I have to trust this AI is not injecting malicious code unintentionally and thatā€™s interesting isnā€™t it.

There are no human errors in AI because there are no humans but it may still be possible for a bad actor to inject nasty bits of code that might not be checked to the same degreeā€¦ this code suffers from the aging product problem, I didnā€™t write it but I must trust my peers and thatā€™s the trust that could be exploited and itā€™s new and kind of scary šŸ˜¦

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .