Post
4,737
How much load can a language model handle?
“Summarize a Wikipedia article in at least 300 words. Use no commas. Split your answer into three titled sections.”
This is the kind of task used in IFEval, a benchmark of how well models follow multiple requirements at once.
Suppose the model breaks one requirement. Did it lose track of an instruction? Did the no-comma rule make the summary harder to write? Or was summarizing the article difficult to begin with? A program can tell us what failed, but not separate instruction load from task difficulty and interacting constraints.
There is another approach: synthetic tests where a model retrieves a key's value from a long list. Those are easier to control, but they test information retrieval rather than the execution of multiple instructions.
So how can we measure the load itself?
That's the question behind my new article on the IEC instrument. Instead of an essay, the model gets meaningless text made of random words. Instead of complex constraints, it gets simple replacement rules such as
The simplicity serves a purpose. Each rule applies to its own word, so we can add instructions without changing the operation. We can also set how many different words the text has and how often each repeats. And every application has a known correct outcome.
A single response thus produces many individually verifiable trials, not just one overall score. This lets us study how a model's behavior degrades under different kinds of load.
The article walks through the instrument, an actual prompt and GPT-4o mini response, and how to reproduce the trials. Code and data are public.
Article: https://huggingface.co/blog/kutomanovhennadii/how-to-measure-a-language-models-behavior-under-lo
Data: kutomanovhennadii/iec-gpt-4o-mini-2024-07-18
Originally written in Russian. English translation assisted by AI.
“Summarize a Wikipedia article in at least 300 words. Use no commas. Split your answer into three titled sections.”
This is the kind of task used in IFEval, a benchmark of how well models follow multiple requirements at once.
Suppose the model breaks one requirement. Did it lose track of an instruction? Did the no-comma rule make the summary harder to write? Or was summarizing the article difficult to begin with? A program can tell us what failed, but not separate instruction load from task difficulty and interacting constraints.
There is another approach: synthetic tests where a model retrieves a key's value from a long list. Those are easier to control, but they test information retrieval rather than the execution of multiple instructions.
So how can we measure the load itself?
That's the question behind my new article on the IEC instrument. Instead of an essay, the model gets meaningless text made of random words. Instead of complex constraints, it gets simple replacement rules such as
lake -> stone. Its job is to rewrite the text while applying every rule.The simplicity serves a purpose. Each rule applies to its own word, so we can add instructions without changing the operation. We can also set how many different words the text has and how often each repeats. And every application has a known correct outcome.
A single response thus produces many individually verifiable trials, not just one overall score. This lets us study how a model's behavior degrades under different kinds of load.
The article walks through the instrument, an actual prompt and GPT-4o mini response, and how to reproduce the trials. Code and data are public.
Article: https://huggingface.co/blog/kutomanovhennadii/how-to-measure-a-language-models-behavior-under-lo
Data: kutomanovhennadii/iec-gpt-4o-mini-2024-07-18
Originally written in Russian. English translation assisted by AI.
