Chat Phreaking
The practice of using unusual or adversarial message patterns to get a language model to do something its guardrails are meant to prevent. The name borrows from *phone phreaking*, the hobby of exploiting the telephone network to do things t…