Iām playing a CTF with my bestie, as one does, and she pointed out that challenges that use generative AI violate the cardinal rule of CTFs, which is that everything that is in there is there because someone put it there on purpose
As a longtime player and author, that is genuinely really upsetting
I'm ignorant to all the nuances but I can't shake how AI thrashes security in a bunch of ways. Hadn't considered CTF but knowing an LLM is trained means that the content and subsequent vulnerabilities could be clear, no?
It's like seeing cookie cutter sites spit out with the same holes to exploit.
No replies yet
