Skip to main content


Student Projects


For Further Study:


Going "Postal (2)" on the Violent Video Game Industry

Compiled by Natalie Wallace and Herve Comeau

INTRODUCTION

"Violent" video games are the latest stratum of technology to catch the watchful eye of government regulation.  The question of how far First Amendment protections extend for written materials, films, recorded music, and now video games, has created a wealth of social science-rich jurisprudence.  This year, in Schwarzenegger v. EMA, the Supreme Court will decide whether a piece of California legislation ("the Act") permissibly regulates the sale of "violent" video games to minors.  To succeed, the State will have to show that the Act withstands strict scrutiny or, alternatively, reasonably targets a new category of unprotected speech.  Throughout the case’s judicial history, both the courts and the parties focus on the availability, reliability, and applicability of social science evidence in determining the constitutionality of the Act. 

The Act:  CA. Civil §1746

Section 1746 of the Act originally considered a video game "violent" if it satisfied either prong of a two-part test.  (cite).  Due to strong judicial assertions that the second prong is unconstitutionally vague, see, e.g., 2007 WL 2261546 at 10, the State (and this article) focuses on the first prong.  Assuming that the prongs are severable, the pertinent wording becomes: "[Any] video game in which the range of options available to a player includes killing, maiming, dismembering, or sexually assaulting an image of a human being, if those acts are depicted in the game in a manner that. . . [c]omes within all of the following descriptions: [1] a reasonable person, considering the game as a whole, would find appeals to a deviant or morbid interest of minors.  (2) It is patently offensive to prevailing standards in the community as to what is suitable for minors.  (3) It causes the game, as a whole, to lack serious literary, artistic, political, or scientific value for minors."  §1746; see also 556 F.3d, 957 n. 10.

Additionally, the State has limited its legislative interest to the protection of minors from "psychological or neurological harm" from playing violent video games.  The State abandoned its previously submitted interest in reducing aggressive behavior.  Since the foci of the State’s submitted social science evidence were determined prior to this strategic legal decision, some of the studies may now be incongruous.    

The District Court grants Plaintiffs’ Motion for Summary Judgment

The District Court identifies the legal question as whether or not the Act targets non-protected speech.  2007 WL 2261546 at 4.  The persistent focus of inquiry throughout the litigation is first hinted at through the district court’s word choice: "If exposing minors to depictions of violence in video games makes them experience feelings of aggression. . . the state could have a compelling interest in restricting minors’ access to such material."  Id. at 6 (emphasis added).

Dr. Craig Anderson’s social science studies receive the majority of the opinion’s attention.  The court first introduces Dr. Anderson by reference to the criticisms it has endured in other jurisdictions.  Id. at 6 – 8, 11.  The court then generally holds the entire pool of presented evidence unsatisfactory because of its failure to differentiate between the effects on minors of different ages.  Id. at 10.  Given that eighteen-year-olds "can vote and fight in a war, a showing needs to be made that an individual nearing the age of majority needs to be shielded from uncensored speech to the same extent as an early adolescent."  Id. at 10.

Despite coming to similar legal conclusions as the other courts that reviewed this social science evidence, the court summarizes its response as less "skeptical".  Id. at 11.  Nonetheless, the Court finds the lack of studies singling out violent video games from other media, along with the absence of age-stratified data, to be decisive shortcomings in the social science evidence.  Ibid.

Appellate Court affirms District Court’s summary judgment

Early in the appellate decision, the court classifies the majority of the submitted State evidence, upon which the Legislature is presumed to have based its regulation, as social science studies, "roughly half" of which list Dr. Craig Anderson as an author.  556 F.3d, 955.  This entire body of work is later deemed insufficient by the court.  Id. at 963–965.  Generally, rather than make its own critiques of the studies, the court focuses on the shortcomings admitted by the authors themselves, such as the lack of longitudinal studies and small sample sizes.  Id.  Where the court does make an independent critique it makes a questionable inference.  The court focuses on the failure of the studies to stratify by age in order to show that violent video games harm minors more than they do adults.  Id.  However, the court is arguably misconstruing the relation of this methodological shortcoming to the related legal question, since the legislature does not need to show that minors are harmed the most in order to show a legitimate state interest in protecting minors at all. 

The 9th Circuit also focuses heavily on the lack of causality evident in the studies.  In its most exaggerated example of the importance of causality, it dismisses Dr. Jeanne Funk’s study in two brief sentences stating the study was strictly correlative.  Id., 964.  The State defends the paucity of causal evidence in the record by further analogy to sex-based obscenity law, asserting that "the Supreme Court has never required any empirical proof of harm when children are involved."  Brief for 9th Cir. at 4.  The 9th Circuit examines this argument in more detail than the district court did, but dismisses it eventually.  556 F.3d, 960–61.  While the Supreme Court’s answer to this question specifically regarding video games is still undetermined, there is an unblemished consensus across the lower courts that obscenity is, and will continue to be, limited to sexually explicit material.  See Id.

However, if this analogy to obscenity law manages to gain traction in the Supreme Court, it would open up room for serious criticisms of the 9th Circuit’s review of the social science evidence.  Because this standard is less stringent than strict scrutiny, social science evidence showing correlations, absent causality, may be sufficient to support a reasonable legislative determination.  The 9th Circuit, however, after explicitly refusing to transpose the obscenity rational basis standard, summarily disregards any social science evidence lacking conclusions of causality.  Id.  If the Supreme Court deems correlative evidence sufficient -- or, for that matter, even mildly probative -- the 9th Circuit’s cursory and dismissive treatment of the bulk of the studies would be highly susceptible to criticism.
 
Supreme Court grants certiorari and hears oral arguments

A persistent line of questioning related to The Supreme Court’s emphasis on line drawing between different types of violent media could be interpreted as a methodological query apart from any bearing on the permissible scope of legislative action.  The State’s 9th Circuit brief addresses solely its legislature’s prerogative "to deal with one medium at a time as it realizes potential harm," allowing it to regulate only video games regardless of the possible harm attendant to other forms, such as films.  However, methodologically, if the Court is meant to focus only on the permissibility of regulating violent video games, empirical studies evaluating exposure to undifferentiated media would be misleading.  The harm shown could be a result of any combination of exposure to the various media, including, hypothetically, no exposure to violent video games at all.

The Social Science Behind Violent Video Games and Aggressive behavior

Four studies have researched the correlation between video games and real world violent responses. These studies focused on children from grade four to twelve, and measured aggression aimed at teachers, classmates, and self-directed violence. ( Dominick, 1984; Fling et al., 1992; Lin & Lepper, 1987; Van Schie & Wiegman, 1997) The oldest studies, with the least graphic violent video games found a statistically positive correlation between playing video and real world aggressive behavior; the fourth, most recent study, found no correlation that differed from zero. However none of these correlational studies differentiated between games that are expressly violent, that is games that contain violent images, and games based on purely puzzle solving. So none of these early studies spoke directly to the issue at hand, but were ultimately included in the Meta analysis provided by Dr. Anderson to the court.

The experimental studies conducted prior to those conducted by Dr. Anderson are also open to obvious criticism. These experimental studies found support for the increase of violent video games on aggressive behavior. (Cooper & Mackie, 1986; Irwin & Gross, 1995; Schutte, Malouff, Post-Gorden, & Rodasta, 1988; Silvern & Williamson, 1987). These studies didn’t control for excitement, difficulty, or competitive aggression increases. And though the Anderson study also openly criticized these studies they were included in the Meta analysis. Of the studies that did control for those variables neither found an effect of violent video games on aggression. (Graybill, Strawniak, Hunter, & O'Leary, 1987; Winkel, Novak, & Hopson, 1987). These studies however measured an immediate reaction to violent video games and not the long term effect of these games.

In order to take steps to remedy the dearth in existing research Dr. Anderson conducted two studies on violent video games and aggression, one correlational, and the other experimental. Though this was a positive step, the existing research still lacks longitudinal research; though the correlational study attempted to use self-reporting via questionnaire to determine how much time particpants had previously spent playing video games.

Anderson Correlational Study:

"In Study 1, we measured both the amount of exposure to video game violence and the amount of time participants had played video games in prior time periods regardless of content. These video game measures and several individual difference measures were used as predictors of self-reported aggressive behavior and delinquency. We used a college student population, in part because they are old enough for long-term effects of playing violent video games to have had a measurable impact on real-world aggression. Study 1 also included a measure of academic achievement (grade point average [GPA]), mainly because prior longitudinal work on media violence effects on children has demonstrated a negative relation between exposure to violent media and later academic performance (e.g., Huesmann, 1986; Huesmann & Miller, 1994)."

Anderson Experimental Study:

"In Study 2 we randomly assigned participants to play either a violent or a nonviolent video game; the two games were matched (by means of pretesting) on several key dimensions. Subsequently, these participants played a competitive reaction time game in which they could punish their opponent by delivering a noxious blast of white noise. This constituted our laboratory measure of aggression. We also assessed the effects of the video games on both hostile thoughts and hostile feelings to see whether either (or both) served as mediators of the violent video game effect on aggressive behavior."
 
The correlational model was used to determine the relationship with long term violent video game expose and a multitude of variables; including aggressive behavior, academic achievement, and delinquent world view. All of these, with the exception of grades which were requested from the university registrar, were self-reported through questionnaires. A pilot study was conducted in the Anderson study that attempted to control for the differences between nonviolent and violent games given other dimensions, such as their frustration level, arousal, and overall enjoyment. Through the Pilot study two games were chosen; Wolfenstein 3d which is a first person shooting game in which the player is in a Nazi compound and can choose from a wide array of weaponry to kill Nazi’s, and Myst/Tetrix which are award winning interactive games purposefully designed to be a nonviolent gaming option. While the nonviolent options focuses on puzzle solving, Wolfenstein allows players to commit acts that induce screaming and moaning in their victims.

The subjects were made to believe that the experimenters were testing hand eye coordination and skill development. After playing the games subjects were asked to answer a questionnaire and for the experimental study, subjects were given the option of subjecting an opponent in another room to a bull horn whose volume could be controlled by the subject. The research demonstrated that in both the correlational study using self-reports of aggressive behaviors and the experimental investigation violent video game play was positively correlated to increases in aggressive behavior. The subjects in the experimental study who played violent video games demonstrated more aggressive behavior toward their opponents then did those who played nonviolent video games. And the results of the correlational study indicated that those who reported playing more violent games also self-reported more aggressive behavior in their own lives. Anderson concluded that "the convergence of findings across such disparate methods lends considerable strength to the main hypothesis that exposure to violent video games can increase aggressive behavior."(Anderson study) Because of the lack of longitudinal studies, and the excess of studies with less the credible methods Anderson conceded that these two studies only add some support to empirical and theoretical work that needs more time to develop, but that more can be said when combined with what is known about the effects of violent media. (e.g., Eron et al., 1987; Huesmann & Miller, 1994).

Conclusions:

            The Schwarzenegger litigation offers a clear example of the place social science has come to hold in certain judicial determinations.  At no point is the pertinence of social science evidence questioned.  In this scenario, where the reasonableness of legislative action is being judged as a matter of law, the validity of the underlying social science studies seems almost dispositive.


Notes and Further Reading:

The District Court summarizes the applicable strict scrutiny test as requiring that the Act "promote a compelling [state] interest," adopt the "least restrictive means. . . to further the articulated interest."  Id. at 4 (citing Sable Commc’ns of Cal., Inc. v. FCC, 492 U.S. 115, 126) (internal quotation marks omitted).






Am. Amusement Mach. Ass’n v. Kendrick, 244 F.3d 572 (7th Cir. 2001).  [Judge Posner]
Interactive Digital Software Ass’n v. St. Louis County, 329 F.3d 954 (8th Cir. 2003).
Entertainment Software Ass’n v. Blagojevich, 404 F.Supp.2d 1051 (E.D. Ill. 2005).  [Source of submitted Anderson testimony?]
2005 Cal. Legis. Serv. Ch. 638 (A.B. 1179) (West) §1.  (The California Legislature’s findings in justification of the Act.)
Aiken, L. S. & West, S. G. (1991). Multiple regression: Testing and interpreting interactions. (Newbury Park, CA: Sage) 
Anderson, C. A. (1997). Effects of violent movies and trait hostility on hostile feelings and aggressive thoughts. Aggressive Behavior, 23, 161-178. 
Anderson, C. A. & Anderson, K. B. (1996). Violent crime rate studies in philosophical context: A destructive testing approach to heat and southern culture of violence effects. Journal of Personality and Social Psychology, 70, 740-756. 
Anderson, C. A., Anderson, K. B. & Deuser, W. E. (1996). Examining an affective aggression framework: Weapon and temperature effects on aggressive thoughts, affect, and attitudes. Personality and Social Psychology Bulletin, 22, 366-376. 
Anderson, K. B., Anderson, C. A., Dill, K. E. & Deuser, W. E. (1998). The interactive relations between trait hostility, pain, and aggressive thoughts. Aggressive Behavior, 24, 161-171. 
Anderson, C. A., Benjamin, A. J. & Bartholow, B. D. (1998). Does the gun pull the trigger? Automatic priming effects of weapon pictures and weapon names. Psychological Science, 9, 308-314. 
Anderson, C. A. & Bushman, B. J. (1997). External validity of "trivial" experiments: The case of laboratory aggression. Review of General Psychology, 1, 19-41. 
Anderson, C. A., Deuser, W. E. & DeNeve, K. M. (1995). Hot temperatures, hostile affect, hostile cognition, and arousal: Tests of a general model of affective aggression. Personality and Social Psychology Bulletin, 21, 434-448. 
Anderson, C. A. & Ford, C. M. (1986). Affect of the game player: Short term effects of highly and mildly aggressive video games. Personality and Social Psychology Bulletin, 12, 390-402. 
Anderson, C. A., Lindsay, J. J. & Bushman, B. J. (1999). Research in the psychological laboratory: Truth or triviality? Current Directions in Psychological Science, 8, 3-9. 
Ballard, M. E. & Weist, J. R. (1996). Mortal Kombat: The effects of violent video game play on males' hostility and cardiovascular responding. Journal of Applied Social Psychology, 26, 717-730. 
Bandura, A. (1971). Social learning theory of aggression.(In J. G. Knutson (Ed.), Control of aggression: Implications from basic research (pp. 201-250). Chicago: Aldine-Atherton.) 
Bandura, A. (1973). Aggression: A social learning analysis. (Englewood Cliffs, NJ: Prentice-Hall) 
Bandura, A., Ross, D. & Ross, S. A. (1961). Transmission of aggression through imitation of aggressive models. Journal of Abnormal and Social Psychology, 66, 575-582. 
Bandura, A., Ross, D. & Ross, S. A. (1963). Imitation of film-mediated aggressive models. Journal of Abnormal and Social Psychology, 66, 3-11. 
Bargh, J. A. (1994). The four horsemen of automaticity: Awareness, intention, efficiency, and control in social cognition.(In R. S. Wyer, Jr. & T. K. Srull (Eds.), Handbook of social cognition: Basic processes (2nd ed., pp. 1-40). New York: Guilford Press.) 
Barton, E. J. (1981). Developing sharing: An analysis of modeling and other behavioral techniques. Behavior Modification, 5, 396-398. 
Berkowitz, L. (1984). Some effects of thoughts on anti- and prosocial influence of media events: A cognitive neoassociationist analysis. Psychological Bulletin, 95, 410-427. 
Berkowitz, L. (1990). On the formation and regulation of anger and aggression. American Psychologist, 45, 494-503. 
Berkowitz, L. (1993). Aggression: Its causes, consequences, and control. (New York: McGraw-Hill) 
Berkowitz, L. & LePage, A. (1967). Weapons as aggression-eliciting stimuli. Journal of Personality and Social Psychology, 7, 202-207. 
Bettencourt, B. A. & Miller, N. (1996). Gender differences in aggression as a function of provocation: A meta-analysis. Psychological Bulletin, 119, 422-447. 
Braun, C. & Giroux, J. (1989). Arcade video games: Proxemic, cognitive and content analyses. Journal of Leisure Research, 21, 92-105. 
Bushman, B. J. (1995). Moderating role of trait aggressiveness in the effects of violent media on aggression. Journal of Personality and Social Psychology, 69, 950-960. 
Bushman, B. J. & Anderson, C. A. (1998). Methodology in the study of aggression: Integrating experimental and nonexperimental findings.(In R. Geen & E. Donnerstein (Eds.), Human aggression: Theories, research, and implications for social policy (pp. 23-48). San Diego, CA: Academic Press.) 
Bushman, B. J., Baumeister, R. F. & Stack, A. D. (in press). Catharsis, aggression, and persuasive influence: Self-fulfilling or self-defeating prophecies? Journal of Personality and Social Psychology,
Bushman, B. J. & Wells, G. L. (in press). Trait aggressiveness and hockey penalties: Predicting hot tempers on the ice. Journal of Personality and Social Psychology,
Buss, A. H. & Durkee, A. (1957). An inventory for assessing different kinds of hostility. Journal of Consulting Psychology, 21, 343-349. 
Buss, A. H. & Perry, M. P. (1992). The aggression questionnaire. Journal of Personality and Social Psychology, 63, 452-459. 
Calvert, S. L. & Tan, S. (1994). Impact of virtual reality on young adults' physiological arousal and aggressive thoughts: Interaction versus observation. Journal of Applied Developmental Psychology, 15, 125-139. 
Caprara, G. V. (1982). A comparison of the frustration-aggression and emotional susceptibility hypothesis. Aggressive Behavior, 8, 234-236. 
Caprara, G. V., Cinanni, V., D'Imperio, G., Passerini, S., Renzi, P. & Travaglia, G. (1985). Indicators of impulsive aggression: Present status of research on irritability and emotional susceptibility scales. Personality and Individual Differences, 6, 665-674. 
Carlson, M., Marcus-Newhall, A. & Miller, N. (1989). Evidence for a general construct of aggression. Personality and Social Psychology Bulletin, 15, 377-389. 
Carlson, M., Marcus-Newhall, A. & Miller, N. (1990). Effects of situational aggressive cues: A quantitative review. Journal of Personality and Social Psychology, 58, 622-633. 
Chambers, J. H. & Ascione, F. R. (1987). The effects of prosocial and aggressive video games on children's donating and helping. Journal of Genetic Psychology, 148, 499-505. 
Cooper, J. & Mackie, D. (1986). Video games and aggression in children. Journal of Applied Social Psychology, 16, 726-744. 
Creasey, G. L. & Myers, B. J. (1986). Video games and children: Effects on leisure activities, schoolwork, and peer involvement. Merrill Palmer Quarterly, 32, 251-262. 
Crick, N. R. & Dodge, K. A. (1994). A review and reformulation of social information-processing mechanisms in children's social adjustment. Psychological Bulletin, 115, 74-101. 
Dietz, T. L. (1998). An examination of violence and gender role portrayals in video games: Implications for gender socialization and aggressive behavior. Sex Roles, 38, 425-442. 
Dill, K. E., Anderson, C. A., Anderson, K. B. & Deuser, W. E. (1997). Effects of aggressive personality on social expectations and social perceptions. Journal of Research in Personality, 31, 272-292. 
Dill, K. E. & Dill, J. C. (1998). Video game violence: A review of the empirical literature. Aggression and Violent Behavior: A Review Journal, 3, 407-428. 
Dodge, K. A. & Crick, N. R. (1990). Social information-processing bases of aggressive behavior in children. Personality and Social Psychology Bulletin, 16, 8-22. 
Dominick, J. R. (1984). Videogames, television violence, and aggression in teenagers. Journal of Communication, 34, 136-147. 
Dorr, N. & Anderson, C. A. (1995, May). Resolution of the temperature aggression debate. (Paper presented at the Annual Convention of the Midwestern Psychological Association, Chicago) 
Elliot, D. S., Huizinga, D. & Ageton, S. S. (1985). Explaining delinquency and drug use. (Beverly Hills, CA: Sage) 
Elmer-Dewitt, P. (1993, September 27). The amazing video game boom. Time, , 66-73. 
Emes, C. E. (1997). Is Mr. Pac Man eating our children? A review of the effect of video games on children. Canadian Journal of Psychiatry, 42, 409-414. 
Eron, L. D., Huesmann, L. R., Dubow, E., Romanoff, R. & Yarmel, P. (1987). Aggression and its correlates over 22 years.(In D. Crowell, I. Evans, & D. O'Donnell (Eds.), Childhood aggression and violence (pp. 249-262). New York: Plenum.) 
Fling, S., Smith, L., Rodriguez, T., Thornton, D., Atkins, E. & Nixon, K. (1992). Videogames, aggression, and self-esteem: A survey. Social Behavior and Personality, 20, 39-46. 
Geen, R. G. (1990). Human aggression. (Pacific Grove, CA: McGraw-Hill) 
Geen, R. G. & Quanty, M. B. (1977). The catharsis of aggression: An evaluation of a hypothesis.(In L. Berkowitz (Ed.), Advances in experimental social psychology (Vol. 10, pp. 1-37). New York: Academic Press.) 
Geen, R. G., Stonner, D. & Shope, G. L. (1975). The facilitation of aggression by aggression: Evidence against the catharsis hypothesis. Journal of Personality and Social Psychology, 31, 721-726. 
Gerbner, G., Gross, L., Morgan, M. & Signiorelli, N. (1980). The "mainstreaming" of America: Violence profile no. II. Journal of Communication, 30, 10-29. 
Giancola, P. R. & Chermack, S. T. (1998). Construct validity of laboratory aggression paradigms: A response to Tedeschi and Quigley (1996). Aggression and Violent Behavior, 3, 237-253. 
Graybill, D., Strawniak, M., Hunter, T. & O'Leary, M. (1987). Effects of playing versus observing violent versus nonviolent video games on children's aggression. Psychology: A Quarterly Journal of Human Behavior, 24, 1-8. 
Griffiths, M. D. & Hunt, N. (1998). Dependence on computer games by adolescents. Psychological Reports, 82, 475-480. 
Harris, M. B. & Williams, R. (1985). Video games and school performance. Education, 105, 306-309. 
Huesmann, L. R. (1986). Psychological processes promoting the relation between exposure to media violence and aggressive behavior by the viewer. Journal of Social Issues, 42, 125-139. 
Huesmann, L. R. (1994). Aggressive behavior: Current perspectives. (New York: Plenum Press) 
Huesmann, L. R. & Miller, L. S. (1994). Long-term effects of repeated exposure to media violence in childhood.(In L. R. Huesmann (Ed.), Aggressive behavior: Current perspectives (pp. 153-188). New York: Plenum Press.) 
Irwin, A. R. & Gross, A. M. (1995). Cognitive tempo, violent video games, and aggressive behavior in young boys. Journal of Family Violence, 10, 337-350. 
Kirsh, S. J. (1998). Seeing the world through Mortal Kombat-colored glasses: Violent video games and the development of a short-term hostile attribution bias. Childhood, 5, 177-184. 
Klein, M. H. (1984). The bite of Pac-Man. The Journal of Psychohistory, 11, 395-401. 
Leyens, J. P. & Picus, S. (1973). Identification with the winner of a fight and name mediation: Their differential effects upon subsequent aggressive behavior. British Journal of Social and Clinical Psychology, 12, 374-377. 
Lin, S. & Lepper, M. R. (1987). Correlates of children's usage of video games and computers. Journal of Applied Social Psychology, 17, 72-93. 
Lindsay, J. J. & Anderson, C. A. (in press). From antecedent conditions to violent actions: A general affective aggression model. Personality and Social Psychology Bulletin,
Loftus, G. A. & Loftus, E. F. (1983). Mind at play: The psychology of video games. (New York: Basic Books) 
Nelson, T. M. & Carlson, D. R. (1985). Determining factors in choice of arcade games and their consequences upon young male players. Journal of Applied Social Psychology, 15, 124-139. 
Pooley, E. (1999, May 10). Portrait of a deadly bond. Time, , 26-32. 
Schutte, N. S., Malouff, J. M., Post-Gorden, J. C. & Rodasta, A. L. (1988). Effects of playing video games on children's aggressive and other behaviors. Journal of Applied Social Psychology, 18, 454-460. 
Scott, D. (1995). The effect of video games on feelings of aggression. The Journal of Psychology, 129, 121-132. 
Silvern, S. B. & Williamson, P. A. (1987). The effects of video game play on young children's aggression, fantasy and prosocial behavior. Journal of Applied Developmental Psychology, 8, 453-462. 
Tukey, J. W. (1977). Exploratory data analysis. (Menlo Park, CA: Addison-Wesley) 
Van Schie, E. G. M. & Wiegman, O. (1997). Children and video games: Leisure activities, aggression, social integration, and school performance. Journal of Applied Social Psychology, 27, 1175-1194. 
Winkel, M., Novak, D. M. & Hopson, M. (1987). Personality factors, subject gender and the effects of aggressive video games on aggression in adolescents. Journal of Research in Personality, 21, 211-223. 
Zillmann, D. (1983). Cognition-excitation interdependencies in aggressive behavior. Aggressive Behavior, 14, 51-64.