September 2000
- Avault article: The End of the Smurfs? Zak Jarvis
- End of volunteers? Peter
- End of volunteers? Greg Underwood
- End of volunteers? Peter
- Criminalize Community Volunteers? Lovecraft
- Criminalize Community Volunteers? F. Randall Farmer
- Criminalize Community Volunteers? Koster, Raph
- Criminalize Community Volunteers? John Buehler
- Criminalize Community Volunteers? Dave Rickey
- Criminalize Community Volunteers? Jeff Freeman
- Criminalize Community Volunteers? Madrona Tree
- Criminalize Community Volunteers? John Buehler
- Criminalize Community Volunteers? Madrona Tree
- Criminalize Community Volunteers? Koster, Raph
- Criminalize Community Volunteers? David Frank
- Criminalize Community Volunteers? Koster, Raph
- Criminalize Community Volunteers? Ananda Dawnsinger
- Criminalize Community Volunteers? Matthew Mihaly
- Criminalize Community Volunteers? Madrona Tree
- Criminalize Community Volunteers? Koster, Raph
- Criminalize Community Volunteers? Greg Underwood
- Criminalize Community Volunteers? Brian 'Psychochild' Green
- Criminalize Community Volunteers? Greg Underwood
- Criminalize Community Volunteers? Koster, Raph
- Criminalize Community Volunteers? Greg Underwood
- Criminalize Community Volunteers? Matthew Mihaly
- Criminalize Community Volunteers? Greg Underwood
- Criminalize Community Volunteers? Matthew Mihaly
- Criminalize Community Volunteers? Paul Schwanz - Enterprise Services
- Criminalize Community Volunteers? David H. Loeser Jr
- Criminalize Community Volunteers? Madrona Tree
- Criminalize Community Volunteers? Josh Olson
- Criminalize Community Volunteers? Jeff Freeman
- Criminalize Community Volunteers? Josh Olson
- Criminalize Community Volunteers? Jeff Freeman
- Criminalize Community Volunteers? Zak Jarvis
- Criminalize Community Volunteers? Matthew Mihaly
- Criminalize Community Volunteers? Zak Jarvis
- Criminalize Community Volunteers? Madman Across the Water
- Criminalize Community Volunteers? Dave Rickey
- Criminalize Community Volunteers? Madrona Tree
- Criminalize Community Volunteers? Josh Olson
- Criminalize Community Volunteers? Matthew Mihaly
- Criminalize Community Volunteers? Brian 'Psychochild' Green
- Criminalize Community Volunteers? Dave Rickey
- Criminalize Community Volunteers? Brian 'Psychochild' Green
- Criminalize Community Volunteers? Willowreed@aol.com
- Criminalize Community Volunteers? David H. Loeser Jr
- Criminalize Community Volunteers? Willowreed@aol.com
- Criminalize Community Volunteers? Batir
- Criminalize Community Volunteers? David H. Loeser Jr
- Criminalize Community Volunteers? Dave Rickey
- Criminalize Community Volunteers? Madrona Tree
- Criminalize Community Volunteers? Corey Crawford
- Criminalize Community Volunteers? Willowreed@aol.com
- Criminalize Community Volunteers? Willowreed@aol.com
- Criminalize Community Volunteers? Paul Schwanz - Enterprise Services
- Criminalize Community Volunteers? Koster, Raph
- Criminalize Community Volunteers? Dave Rickey
- Criminalize Community Volunteers? Erik Jarvi
- Criminalize Community Volunteers? Ananda Dawnsinger
- Criminalize Community Volunteers? Willowreed@aol.com
- Criminalize Community Volunteers? Erik Jarvi
- Criminalize Community Volunteers? Shawn L Johnston
- Criminalize Community Volunteers? Willowreed@aol.com
- Criminalize Community Volunteers? Josh Olson
- Criminalize Community Volunteers? David H. Loeser Jr
- Criminalize Community Volunteers? Willowreed@aol.com
- Criminalize Community Volunteers? Mud Imp
- Criminalize Community Volunteers? Greg Underwood
- Criminalize Community Volunteers? david.l.smith@home.com
- Criminalize Community Volunteers? Koster, Raph
- Criminalize Community Volunteers? Zak Jarvis
- Criminalize Community Volunteers? Christopher Allen
- Criminalize Community Volunteers? Mud Imp
- MUD-Dev digest, Vol 1 #216 - 11 msgs Greg Miller
- MUD-Dev digest, Vol 1 #216 - 11 msgs Jon Lambert
- graphical arrogance Matthew Mihaly
- graphical arrogance Koster, Raph
- graphical arrogance Vincent Archer
- graphical arrogance Zak Jarvis
- graphical arrogance Matthew Mihaly
- Skotos Beta Test Signup Christopher Allen
- Side note (was: Criminalize Community Volunteers?) Brian 'Psychochild' Green
- Shadowbane Matthew Mihaly
- Game Balance and Mortal Complaints SmokEater952@aol.com
- Game Balance and Mortal Complaints David Bennett
- Game Balance and Mortal Complaints Lovecraft
- Game Balance and Mortal Complaints Patrick Dughi
- Game Balance and Mortal Complaints Val Trullinger
- The Solution to Criminalizing Community Volunteers? Jon Morrow
- The Solution to Criminalizing Community Volunteers? nbossett@herbert.com
- The Solution to Criminalizing Community Volunteers? Hans-Henrik Staerfeldt
- Are eBay sales more than just a fad? Dave Rickey
- Are eBay sales more than just a fad? Koster, Raph
- Are eBay sales more than just a fad? Vincent Archer
- Are eBay sales more than just a fad? Dave Rickey
- Are eBay sales more than just a fad? Corey Crawford
- Are eBay sales more than just a fad? gmiller@classic-games.com
- Are eBay sales more than just a fad? Koster, Raph
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? Travis Casey
- Are eBay sales more than just a fad? Paul Schwanz - Enterprise Services
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? Jeff Freeman
- Are eBay sales more than just a fad? Paul Schwanz - Enterprise Services
- Are eBay sales more than just a fad? Tess Lowe
- Are eBay sales more than just a fad? Jeff Freeman
- Are eBay sales more than just a fad? Andy
- Are eBay sales more than just a fad? Timothy Dang
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? Taylor
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? Nathan Clemons
- Are eBay sales more than just a fad? Brian 'Psychochild' Green
- Are eBay sales more than just a fad? Madman Across the Water
- Are eBay sales more than just a fad? Corey Crawford
- Are eBay sales more than just a fad? Joe Andrieu
- Are eBay sales more than just a fad? Madman Across the Water
- Are eBay sales more than just a fad? Joe Andrieu
- Are eBay sales more than just a fad? Madman Across the Water
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? Madman Across the Water
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? Joe Andrieu
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? Jon Lambert
- Are eBay sales more than just a fad? Peter
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? Jon Lambert
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? Koster, Raph
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? yvesk@brutele.be
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? Dan Merillat
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? Jeff Freeman
- Are eBay sales more than just a fad? Dave Rickey
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? Jeff Freeman
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? Eli Stevens
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? Eli Stevens
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? John Buehler
- Are eBay sales more than just a fad? John Buehler
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? John Buehler
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? John Buehler
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? John Buehler
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? rayzam
- Are eBay sales more than just a fad? Matthew Mihaly
- Are eBay sales more than just a fad? Luc Van den Borre
- Are eBay sales more than just a fad? Dave Rickey
- MUD Coding Staff Structure Michael Tresca
- MUD Coding Staff Structure David Bennett
- MUD Coding Staff Structure Erik Jarvi
- MUD Coding Staff Structure Marc Bowden
- MUD Coding Staff Structure Malcolm Tester
- MUD Coding Staff Structure David Bennett
- MUD Coding Staff Structure Daniel Podlejski
- MUD Coding Staff Structure Lars Duening
- MUD Coding Staff Structure Matthew Mihaly
- MUD Coding Staff Structure Steven Kaskinen
- MUD Coding Staff Structure gmiller@classic-games.com
- MUD Coding Staff Structure Taylor
- MUD Coding Staff Structure Matthew Mihaly
- MUD Coding Staff Structure rayzam
- MUD Coding Staff Structure Matthew Mihaly
- MUD Coding Staff Structure Michael Tresca
- MUD Coding Staff Structure Dave Rickey
- MUD Coding Staff Structure Matthew Mihaly
- MUD Coding Staff Structure Vincent Archer
- MUD Coding Staff Structure Malcolm Tester
- MUD Coding Staff Structure Koster, Raph
- OT: short abscence Greg Underwood
- MUD Licensing UCMM Administration
- question Matthew Mihaly
- Nomenclature (was: MUD Coding Staff Structure) Brian 'Psychochild' Green
- Nomenclature (was: MUD Coding Staff Structure) Dave Rickey
- Nomenclature (was: MUD Coding Staff Structure) Steven Kaskinen
- Nomenclature (was: MUD Coding Staff Structure) Michael Tresca
- Conditioned reinforcers: Getting players to do things for free John Hopson
This is the next installment in my ongoing series of articles about
applying experimental psychology to game design.
Previous articles:
http://www.kanga.nu/archives/MUD-Dev-L/2000Q3/msg00364.php
http://www.kanga.nu/archives/MUD-Dev-L/2000Q3/msg00725.php
If you have any ideas for topics you'd like me to cover, drop me an email.
If you're finding these articles useful or have any questions, I'd be happy
to hear from you.
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
One of the problems with using food rewards in animal experiments is the
subjects get full. Sooner or later, the rat's eaten 900 little food
pellets and decides he's going to sleep. One solution psychologists have
uses to keep their subjects working is conditioned reinforcers, virtual
rewards that derive their value from the normal reinforcement.
The essence of this idea is that stimuli associated with reinforcers
eventually become reinforcers themselves. If you show the rat a green
light every time he gets a pellet, eventually he will work just to see the
green light. Of course, he still prefers the actual pellets, but the light
is so strongly associated with reward that it becomes rewarding in itself.
A neutral stimulus becomes linked in the mind to something of intrinsic
value, giving it a derived value.
As a solution to the psychologists' problem, conditioned reinforcers are a
godsend. When the rat meets the conditions for a reinforcer, half the time
it receives a food reinforcer and a conditioned reinforcer. The other half
the time, it only receives a conditioned reinforcer. The conditioned
reinforcers tell the animal "yes, you did the right thing" without giving
it an actual reward. If we just didn't provide anything, the subject would
not know if it had made a mistake or if there was ever another pellet
coming in the future. But the conditioned reinforcer provides
encouragement without real reward. Satiation ("being full") is a function
of real reward, so the addition of conditioned reinforcers stretches the
amount of work the subject's willing to do.
Now, you might think humans are too smart for this, but there are a
thousand examples in our daily life. Think of the person quitting
cigarettes who chews on a pen, deriving comfort from the act even in the
absence of nicotine. Or a corporation providing titles in lieu of raises.
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Conditioned reinforcers, like most of our fantasy magics, have rules that
govern their use.
**Rule #1** The conditioned reinforcer has to occur every time the real
reward occurs.
You're forging a link between a neutral thing and the reward. If the
reward occurs on its own, you've made the two things distinct items that
just happen together sometimes.
**Rule #2** The more the conditioned reinforcer occurs without the reward,
the weaker it gets.
The connection can be diluted from the other end too. Of course,
conditioned reinforcers have to happen without the reward in order to be of
any use, but the more you do it the weaker they get.
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Some examples of conditioned reinforcers in muds:
Titles: Knight, Dread lord, Supreme Ninja, it's easy to create titles that
players can earn as they advance in power. As long as gains in power also
include gains in title, titles can serve as a reward on their own.
Distinctive equipment: Because everyone starts at low levels, the low
level equipment is common. As the character advances, you can gain other
equipment. The harder the equipment is to get, the rarer it will be. As a
result, unusual equipment becomes valuable in and of itself.
Killing: If you're playing a game in which advancement occurs by killing
things, then killing things becomes a conditioned reinforcer. This may
explain why players will slaughter hundreds of weak things that they know
won't contribute to their leveling; the death of a mob has become a reward
because rewards always happen after the death of a mob.
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Conditioned reinforcers and Cheating
An interesting series of experiments has explored the connection between
conditioned reinforcers and cheating. If subjects are required to work
hard to obtain a reward, the hard work begins to serve as a conditioned
reinforcer. (This is sometimes referred to as "Learned industriousness")
This led researchers to the strange idea that subjects reinforced for a
difficult task would be _less_ likely to cheat when offered the chance than
subjects rewarded for an easy task. This was tested experimentally as
follows:
The subjects were college students. Half of them were asked to do an easy
task (adding pairs of 2 digit numbers) and half were required to do a hard
task (adding pairs of 7 digit numbers), and all of them were praised for
getting the right answers. Next, all subjects were asked to do a nearly
impossible task, solving difficult anagrams in only 5 seconds. After
being presented with a scrambled series of letters, the subjects had 5
seconds to decide what the original word was. At the end of five seconds,
the experimenter told the subject what the answer was and asked them if
they had gotten the right answer. If they said they had, the subject was
again rewarded.
Now, the ability to cheat in this second task is obvious. There's no way
for the experimenter to know if the subject had really worked out the right
answer. The subject could lie and get rewarded without fear of penalty.
The remarkable finding here was that the students who had previously been
asked to do a hard task cheated less than those who had been asked to do
the easy task.
This experimental finding has some interesting implications for mud
design. Typically, games make the first level or so easy, in order to not
to turn off players with too high a learning curve. However, this
experiment suggests that there may be a trade-off here. If you start
people out easy, you may be training them to expect easy rewards and to
feel they _deserve_ easy rewards. This could breed resentment and a strong
desire to outwit the unfair system. - Society Scaling Brad Wyble
- MUDs vs. MMUDs (was MUD Coding Staff Structure) Steven Kaskinen
- MUDs vs. MMUDs (was MUD Coding Staff Structure) Steven Kaskinen
- MUDs vs. MMUDs (was MUD Coding Staff Structure) Matthew Mihaly
- MUDs vs. MMUDs Steven Kaskinen
- MUDs vs. MMUDs Steven Kaskinen
- Mud-dev FAQ 2 Marian Griffith
- startup script for you Matthew Mihaly
- Bad Name Lists Christopher Allen
- Bad Name Lists Josh Rollyson
- Bad Name Lists William Katzell
- Bad Name Lists Michael Tresca
- Bad Name Lists Eli Stevens
- Bad Name Lists Matthew Mihaly
- Bad Name Lists Mordengaard
- Help and Reference Systems Study Jon Morrow
- Help and Reference Systems Study Peter
- Help and Reference Systems Study Colin Coghill
- FW: [uodevlist] OT - Lawsuit on Lum's Koster, Raph
- FW: [uodevlist] OT - Lawsuit on Lum's Jeff Freeman
- FW: [uodevlist] OT - Lawsuit on Lum's Dave Rickey
- FW: [uodevlist] OT - Lawsuit on Lum's Josh Olson
- FW: [uodevlist] OT - Lawsuit on Lum's Dave Rickey
- FW: [uodevlist] OT - Lawsuit on Lum's Travis Nixon
- FW: [uodevlist] OT - Lawsuit on Lum's Dave Rickey
- FW: [uodevlist] OT - Lawsuit on Lum's Jeff Freeman
- FW: [uodevlist] OT - Lawsuit on Lum's Dave Rickey
- FW: [uodevlist] OT - Lawsuit on Lum's Norman Short
- FW: [uodevlist] OT - Lawsuit on Lum's KevinL
- FW: [uodevlist] OT - Lawsuit on Lum's Norman Short
- FW: [uodevlist] OT - Lawsuit on Lum's Jeff Freeman
- FW: [uodevlist] OT - Lawsuit on Lum's Dave Rickey
- FW: [uodevlist] OT - Lawsuit on Lum's Matthew Mihaly
- FW: [uodevlist] OT - Lawsuit on Lum's Geoffrey MacDougall
- FW: [uodevlist] OT - Lawsuit on Lum's Corey Crawford
- FW: [uodevlist] OT - Lawsuit on Lum's Myschyf
- FW: [uodevlist] OT - Lawsuit on Lum's Brian 'Psychochild' Green
- FW: [uodevlist] OT - Lawsuit on Lum's Nathan F. Yospe
- Lawsuit vs. EA/Origin Brian 'Psychochild' Green
- Lawsuit vs. EA/Origin Koster, Raph
- Lawsuit vs. EA/Origin Dave Rickey
- DoS and muds Josh Rollyson
- DoS and muds Patrick Dughi
- DoS and muds Chris Jacobson
- DoS and muds Shawn L Johnston
- Interesting Page on Magic Chris Lloyd
- paying volunteers Matthew Mihaly
- paying volunteers Patrick Dughi
- paying volunteers Matthew Mihaly
- paying volunteers Nicholas Daley
- paying volunteers Chris Lloyd
- paying volunteers Matthew Mihaly
- paying volunteers Chris Lloyd
- paying volunteers Geoffrey MacDougall
- paying volunteers Jeff Freeman
- paying volunteers Sellers, Michael
- paying volunteers Daniel.Harman@barclayscapital.com
- paying volunteers the_logos@www.achaea.com
- (no subject) Ian Hess
- (no subject) Matthew Mihaly
- Chicagoland MUD-Dev Dinner Erik Jarvi
- StoryTelling Devices: "Magic Book" Eric Rhea
- StoryTelling Devices: "Magic Book" Madrona Tree
- StoryTelling Devices: "Magic Book" Nathan F. Yospe
- Portable Device Integration Eric Rhea
- Pricing structures and selling characters and items Myschyf
- Pricing structures and selling characters and items Matthew Mihaly
- Pricing structures and selling characters and items Brian 'Psychochild' Green
- Interview with Vault Koster, Raph
- [rpg-create] Combat Abstractions (fwd) J C Lawrence
- [rpg-create] Combat Abstractions (fwd) J C Lawrence
- [rpg-create] Combat Abstractions (fwd) J C Lawrence
- [rpg-create] HP triangle (fwd) J C Lawrence
- [rpg-create] HP triangle (fwd) J C Lawrence
- [rpg-create] HP triangle (fwd) J C Lawrence
- [rpg-create] HP triangle (fwd) J C Lawrence
- [rpg-create] combat thoughts (fwd) J C Lawrence
- [rpg-create] Combat System Checklist (fwd) J C Lawrence
- ADMIN: Volunteer vs paid employee thread J C Lawrence
- OT: qnx released Steve Houchard
- customer service Matthew Mihaly
- customer service Corey Crawford
- Squeezing the ink from "Magic Book" Eric Rhea
- Importance of User Documentation Jon Morrow
- Importance of User Documentation Sanvean
- Importance of User Documentation Alex
- Importance of User Documentation Dave Kennerly
- Importance of User Documentation Jon Morrow
- Importance of User Documentation Sanvean
- Importance of User Documentation Richard Tew
- Importance of User Documentation Ben
- Importance of User Documentation Sanvean
- Importance of User Documentation rayzam
- Importance of User Documentation Jon Morrow
- Fw: Importance of User Documentation Stephen Newby
- Fw: Importance of User Documentation Inq Admin
- Fw: Importance of User Documentation David Bennett
- Convincing Players to Read Documentation Jon Morrow
- Convincing Players to Read Documentation Bruce
- Convincing Players to Read Documentation Willowreed@aol.com
- Convincing Players to Read Documentation John Hopson
- Convincing Players to Read Documentation Marc Bowden
- Convincing Players to Read Documentation Richard Tew
- Convincing Players to Read Documentation Ryan P.
- Convincing Players to Read Documentation Marc Bowden
- Convincing Players to Read Documentation Richard Tew
- Convincing Players to Read Documentation Melinda Davison
- Convincing Players to Read Documentation KevinL
- Convincing Players to Read Documentation Dave Rickey
- Convincing Players to Read Documentation KevinL
- Convincing Players to Read Documentation Colin Coghill
- Convincing Players to Read Documentation Richard Tew
- Convincing Players to Read Documentation Michael Tresca