Ever wonder why conversational AI like ChatGPT says “Sorry, I can’t do that” some other polite refusal? OpenAI is offering a limited at the reasoning behind its own models’ rules of engagement, whether it’s sticking to brand guidelines declining to make NSFW content.
Large language models (LLMs) don’t have any naturally occurring limits acceso what they can will say. That’s part of why they’sovrano so , but also why they hallucinate and are easily duped.
It’s necessary for any AI model that interacts with the general public to have a few guardrails acceso what it should and shouldn’t do, but defining these — let ala enforcing them — is a surprisingly difficult task.
If someone asks an AI to generate a bunch of false claims about a public figure, it should refuse, right? But what if they’sovrano an AI developer themselves, creating a database of synthetic disinformation for a model?
What if someone asks for laptop recommendations; it should be objective, right? But what if the model is being deployed by a laptop maker who wants it to only respond with their own devices?
AI makers are all navigating conundrums like these and looking for efficient methods to rein a causa di their models without causing them to refuse perfectly normal requests. But they seldom share exactly how they do it.
OpenAI is bucking the trend a bit by publishing what it calls its “model spec,” a collection of high-level rules that indirectly govern ChatGPT and other models.
There are meta-level objectives, some duro rules and some general behavior guidelines, though to be clear these are not strictly speaking what the model is primed with; OpenAI will have developed specific instructions that accomplish what these rules describe a causa di natural language.
It’s an interesting at how a company sets its priorities and handles edge cases. And there are numerous examples of how they might play out.
For instance, OpenAI states clearly that the developer intent is basically the highest law. So one version of a chatbot running GPT-4 might provide the answer to a math problem when asked for it. But if that chatbot has been primed by its developer to never simply provide an answer straight out, it will instead offer to work through the solution step by step:
A conversational interface might even decline to talk about anything not approved, a causa di order to nip any manipulation attempts a causa di the bud. Why even let a cooking assistant weigh a causa di acceso U.S. involvement a causa di the Vietnam War? Why should a customer service chatbot agree to help with your erotic supernatural nuova work a causa di progress? Shut it mongoloide.
It also gets sticky a causa di matters of riservatezza, like asking for someone’s name and phone number. As OpenAI points out, obviously a public figure like a mayor member of Congress should have their contact details provided, but what about tradespeople a causa di the territorio? That’s probably OK — but what about employees of a certain company, members of a political ? Probably not.
Choosing when and where to draw the line isn’t simple. Nor is creating the instructions that cause the AI to adhere to the resulting policy. And voto negativo doubt these policies will fail all the time as people learn to circumvent them accidentally find edge cases that aren’t accounted for.
OpenAI isn’t showing its whole hand here, but it’s helpful to users and developers to see how these rules and guidelines are set and why, set out clearly if not necessarily comprehensively.
