The Ultimatum Game and The Hollywood Writer’s Strike
Every Tuesday is a Game Theory article at Mind Your Decisions.
Once during college, an annoying person asked me for game theory help. I offered to help even though it interrupted my own work. It was hard to turn down someone who lived in the same dorm.
I offered to help, but wanted something in exchange. The person was a teaching assistant for a non-credit class my friends were taking. He was essentially using his power to fulfill a personal grudge, so I asked that he be nicer to my friends and act more professionally. He was furious at my suggestion since he felt it undermined his authority.
So I said I would not help him. I reminded him that I had work to do, so if he could not compensate me for my time, I would resume my studies.
He angrily responded that he didn’t need my help after all. He actually knew how to do the problem, he indicated, but he just wanted my perspective. And, he continued, the professor was holding office hours the next day, so he would ask someone smarter.
He then walked away, sort of.
As I resumed my studies, he conspicuously sat down at a neighboring table and faked that he was doing work. Every few minutes he peeked over his book to see if I would budge.
But I didn’t.
After thirty minutes, someone who saw the whole thing came up to me and said, “Presh, I can’t believe you aren’t helping him with game theory. I mean, I know you don’t like him, but come on. He needs your help.”
To which I replied, “I am helping him. If he knew any thing about game theory, he would know that I’m not going to tutor him unless he concedes to my request.”
On hearing this, the annoying person left the room and never asked me for help again.
I guess he did not really need my help after all.
I chose my actions because I had total negotiating power—a concept from the ultimatum game.
I am the decider!
Imagine you are participating in a college experiment. The researcher hands you $10. You are instructed to propose a split of the money to another person. For instance, you might propose that you keep $7 and the other person gets $3.
If the other person accepts the division, the money is split according to the proposal. If the other person rejects the division, neither person gets anything.
How might you go about deciding a split?
The first thing you can do is diagram the game dynamics:
You are player one (black) and will offer money to player two (blue), from $0.01-$10. After hearing the offer, the second player can either accept so the split goes through, or reject and leave both parties with nothing.
The way to analyze the game is to start at the end of the diagram and think about what the second player’s strategy. This is a technique called backwards induction.
What offers will player two accept?
If he rejects an offer, then he goes home with nothing. If he cares about getting money, this would suggest that player two’s strategy is to accept any offer that player one makes. Even if the offer is for one cent, that’s better monetarily than going home with nothing.
In the land of infinite rationality, player one understands this, and takes advantage of his bargaining power. Knowing any offer will be accepted, player one will offer the smallest amount to player two—one cent—and basically take the entire pot for himself.
This solution—player one gets everything and player two gets nothing—is why the game is called the “Ultimatum game.” Player one has complete negotiating power and knows any ultimatum will be accepted.
But doesn’t player two have the power to punish?
The situation stinks for player two. It just does not seem fair that player one gets everything. I mean, player two does have the ability to punish player one by rejecting offers. Can that lessen player one’s power?
Imagine player two tries to gain power. Before the game starts, player two might try to taunt to player one, “Hey, if you offer me less than a 50-50 split, I will reject it. I don’t care if I go home with nothing; I’ll just be happy to know that I hurt you.”
In the theoretical world, player one understands this is a non-credible threat. If player one does offer a smaller amount, then player two faces a one-time decision of some money or no money. In this world, it only matters that one cent is better than nothing. There is no joy in inflicting pain on the other player. And because the game is not repeated, there is no reason player two should even care about punishing player one.
As a technical aside, each offer that player one makes actually is a “subgame” where player two has to make a decision. Since player one always offers one cent and player two always accepts, we never observe what would happen if player one offers two cents or more.
In theory, player two could do whatever he wants—he could reject those higher offers. But as argued above, the only credible thing player two would do in any subgame is to accept the offer.
So we call the equilibrium where player two accepts any offer and player one gets everything the subgame perfect equilibrium. In this game, it is the unique subgame perfect equilibrium.
But Presh, that’s simply not what happens in real life!
Yes, imagine you are playing this game with your crazy girlfriend, and she’s player two. From experience, you know that she might even reject offers where you give her less than 90% of the money.
You’d be wise to forget the subgame perfect equilibrium stuff and just make sure you keep her happy. She’s crazy after all.
Indeed, experimenters have repeatedly shown that the subgame perfect equilibrium does not happen. Here’s one example.
But I believe these experiments do not mean game theory is wrong. In fact, they illustrate why game theory is a powerful tool.
It’s all about the beliefs, man
A Nash equilibrium is based on your beliefs about other players, and how accurate those beliefs are. I gave some intuition about the Nash equilibrium in this post.
The subgame perfect equilibrium is the only Nash equilibrium where both players have infinite reasoning ability and they only care about money.
What people seem to miss is that the ultimatum game really has an infinite number of Nash equilibriums.
Let’s go back to the game with you and your crazy girlfriend. Your strategies are something like the following:
Her: “Give me at least 90%, or I reject.”
You: “I will make sure she does not reject. I surely want to leave with some money.”
If you really believe her threat, and it is accurate, the resulting division is a Nash equilibrium of the game. She is not playing rationally, but the result of you getting $1 and she getting $9 is in fact a Nash equilibrium.
Her threat to reject should be non-credible, except that she cares more about money. She cares about power, fairness, and yeah, she’s crazy.
Ironically, there is power in irrationality.
The different outcomes of the ultimatum game can illustrate how beliefs differ across societies. Americans often reject offers less than 20%. My Israeli game theory professor was proud to note that Israel is one of the few places where low offers were given and accepted.
Here’s an article with more details about the cross-cultural differences (.doc file)
But when does this game happen in real life?
The game happens all the time in homes. My brother and I would be arguing about something, like what video game to play. Eventually, my parents would tell us that we could either agree on a game or we would not get to play at all. My older and stronger brother would often speak first and pick a game that only he would like. And I was stuck with the game because it was still better than nothing.
A similar, though not exactly the same situation, happens with labor strikes. The boss offers terms to workers. If the workers accept, then both workers and the company profit. If the workers reject and go on strike, both sides get nothing and lose money while waiting.
In the current Hollywood strike, both the writers and producers are losing. The cancelled Golden Globes is estimated to be a $75-million to $100-million loss to the L.A. economy.
While the strike persists, each side will try to gather negotiating power by tricking the other side on what it truly believes. Each side will want to demonstrate to the other that it will reject solutions that are deemed unfair, even if that action appears crazy.
As analyzed on the blog of James D. Miller, the producers are showing they are committed to a prolonged strike because they have Rupert Murdoch on their side:
According to Slate.com the producers are following the hard line of Rupert Murdoch. And, as Slate.com points out, Murdoch might benefit from a strike because his main cash cow, American Idol, is unaffected by the strike, whereas American Idol’s scripted competition will be forced to show reruns if the strike continues.
Slate.com gives the following warning to producers “Does it occur to the other networks, which have no such weapon in their arsenal, that by following Murdoch’s hard line, they are enabling him to get the most out of his competitive advantage while they are left to scramble with reality shows and reruns of cable programming?”
My bet is that not only do the other networks realize this but they consider it a good thing! If the writers come to believe that Murdoch wants the strike to continue and that the other producers are going to follow Murdoch then the writers will realize that the only hope of avoiding a long strike (i.e. the car crash) is for them to give in.
In response, I think the writers are drumming up what their beliefs really are. They want us to think this is all about socialism, and that they will not stop until a just solution is met. Even if the writers are not devoted to socialism, it could help their negotiating power.
Who will win?
I can’t say, but when you see who does win, it will be clear what each side believed. And it will be clear who had more power.






14 Responses to “The Ultimatum Game and The Hollywood Writer’s Strike”
An interesting note on the writers’ strike, apparently Hollywood for the most part likes the writers’ strike. While late night shows that require constant scripting are taking a hit in ratings, for the most part networks aren’t taking a huge hit by simply playing reruns and are more than getting by.
In the meantime, they’re using this lull in development to completely redo the infrastructure of the tv business. I’m not sure what that means, but there are only a handful of people the writers’ strike is really hurting. You may want new episodes, but you’re still watching tv.
Also, there was a similar example in a previous post where it would be advantageous to both of you if you just helped that guy with game theory. If it was of no detriment to you to help him, wouldn’t helping him actually give you leverage to bargain a deal where he’s kinder to your friends? In the above example, you mention you had work and helping him would interrupt you, but say you didn’t have any work. What would be the correct course of action?
By Joon on Jan 15, 2008
@Joon: Very interesting point that networks are doing fine with reruns. Oh, how we are slaves to TV.
On the one hand, yes I could have gotten good will by helping the person. My request was somewhat unexpected, so he was taken aback. But I guess I got “caught up in the game.”
On the other hand, what I did made sure he would never ask me for help again. I call that killing two birds with one stone.
By Presh Talwalkar on Jan 15, 2008
Nice article…Bargaining and its game theory analysis has been going on for centuries. The key to bargaining or any negotiation for that matter is strength. If you cannot walk away from a deal, you are not going to win. Venture Capital comes to mind. The entrepreneur/VC game is one of that is played out over and over again. As you take more time to become cash flow positive, the entrepreneur loses out unless the entrepreneur has worked out an equitable agreement ahead of time and is true to oneself about realistic cash flow assumptions. Here is one area where being dishonest to oneself hurts a lot. As you need more capital, the VC gets more leverage to a point that you will lose all leverage and you start thinking about your next venture.
By Mahesh Vallampati on Jan 15, 2008
Mahesh brings up an interesting point, basically if you’re using irrationality to win one encounter, having a reputation as irrational can easily hurt you in the long run.
If you know your girlfriend is very set on getting at least 90%, and you know this in advance, you can immediately realize either the $10 you are given is worthless or worth just $1.
Also, as you demonstrated Presh, being irrational even just once prevents future bargaining attempts, because the person will assume they can’t bargain with you.
By RohoMech on Jan 15, 2008
@Mahesh and RohoMech: Good points. I’ll remember those the next time I to talk to a VC
By Presh Talwalkar on Jan 15, 2008
This was fascinating. I’m glad I found your site, and I look forward to reading more game theory every Tuesday.
By Monica O'Brien on Jan 23, 2008
@Monica O’Brien: Thanks for the encouragement!
By Presh Talwalkar on Jan 23, 2008
Be interested in your response to my way of playing the ultimatum game,
http://www.bizop.ca/blog2/how-would-you-play-that/is_this_a_game_of_chance.html
By michael webster on Feb 5, 2008
@Michael Webster: Nice article. I put up this comment on your site too.
I liked your solution and it had me laughing.
The only drawback is that you are technically using a strategy not included in the formal game. If you allow that, it’s not really an ultimatum game since the second player can counteroffer. And the researcher would probably throw out your result and take away the $100
But this is why the ultimatum game is somewhat of a strange game. I mean, in real life people negotiate and communicate–that’s not allowed in the winner-take all economics model.
I think the most useful part is that the outcomes of the ultimatum game do tell us about how the people went into it.
By Presh Talwalkar on Feb 6, 2008
Presh;
Thanks for the kind words. My solution as the second player was twofold: a) play sub-perfect nash, but b) play the game only if a large fee was given to me.
I think that the news article sums up part of my point: what is the point of playing the ultimatum games is not obvious from merely the description of the formal moves. This is a point which seems to elude some economists; the description of the formal rules underdescribes all the possible interactions at the table. (The philosopher Wittgenstein made a living making this obvious statement in a number of mysterious ways.)
“Rather than purely testing economic behavior, the games actually tapped into familiar cultural practices. In other words, the players tried to figure out how the game related to their real-world life, and then behaved accordingly.
“That really changed our thinking a lot about what was going on when people are in an experiment,” Dr. Camerer said. “In game theory, the bias we inherited was the mathematician’s bias, which was when you present the game, it’s like a smart kid sitting down to play Monopoly or poker. …
They read the rules, figure out what to do, they treat it as like a logic problem. But these subjects treat it as like analogical reasoning – what is this like in my life.”
I look upon game theory’s relation to strategic thinking the same way I look at probability theory’s relation to playing bridge or poker: necessary but nowhere near sufficient for good play.
On the larger question, is sub-game perfection the only rational strategy? Again, it depends on what I can focus you on to be the point of the game. I might be able to highlight the virtues of sub-game perfection -it depends on how I do it.
You are probably aware of the coopetition site:
http://mayet.som.yale.edu/coopetition/index2.html
The argue that a lot of the times you have to change the perceived rules of the game to escape a bad outcome. But sometimes what the rules are is not apparent without some help from game theory.
Be useful to match up the writer’s techniques in this strike with what Schelling described as commitment devices -no one single game theory model will likely do. Of course many of Schelling’s devices were sub game imperfect - probably explains why it took 50 years for him to get the Nobel prize.
Anyways, great site - I really liked the tree diagram, although I would have drawn player’s two actions in blue. What program did you use to generate the tree? i liked the way you showed the continuity of types of possible offers. Much better than cluttering up the extensive form with an infinite number of branches.
Will be looking forward to Tuesdays.
By michael webster on Feb 6, 2008
@michael webster: I agree that formal games are strange. It’s nice entertainment, and I myself like the math involved, but it’s dangerous when you confuse them with reality. One reason yo point out is that the rules never fully capture all the possible strategies players can use. Behavioral economists, like Camerer, are doing a lot of good by actually running experiments.
I am skeptical of sub-game perfection because it demands foresight and infinite reasoning power. And computation ability is a problem in games like chess.
I was unaware of the coopetition site. Thanks for sending me there. Lots of cool stuff, and I am adding that book to my reading list now
As you point out, game theory can help you see the rules and figure out alternate strategies to escape a bad situation. This is why I always try to change the system (if possible) before blaming people. Often, bad actions are just the result of bad design. I wrote about this in my article about free-riders answering phones in an office:
http://mindyourdecisions.com/blog/2007/10/16/game-theory-tuesdays-do-not-hate-people-change-the-game/
Schelling’s work is amazing, and I hope to highlight some topics in future articles. I find that the best part of game theory is these social problems rather than complicated business models involving sophisticated statistics. The models might not predict results (as in the ultimatum game), but they give you food for thought.
Thanks for the suggestion on the game tree coloring–I’ll make that change in future trees.
To make the tree, I used a free graphics editor (paint.net). It’s drawn free-hand so you might be able to see it’s not perfect. As for the continuous payoffs, I can’t take credit for that idea–I learned it from my first class on game theory.
Thanks for sharing your thoughts. I learned a lot and have a nice book to look forward too
By Presh Talwalkar on Feb 7, 2008
Presh;
Look forward to more discussions, but your objection to sub game perfection doesn’t make a whole lot of sense.
It is pretty hard to believe that people cannot calculate the sub game perfect nash point in the Ultimatum game -they just choose to do something different.
Who taught you game theory at Standord? Kurz?
By michael webster on Feb 7, 2008
Oopps - Stanford.
By michael webster on Feb 7, 2008