- Subject List
- Take a Tour
- For Authors
- Subscriber Services
- Publications
- African American Studies
- African Studies
- American Literature
- Anthropology
- Architecture Planning and Preservation
- Art History
- Atlantic History
- Biblical Studies
- British and Irish Literature
- Childhood Studies
- Chinese Studies
- Cinema and Media Studies
- Communication
- Criminology
- Environmental Science
- Evolutionary Biology
- International Law
- International Relations
- Islamic Studies
- Jewish Studies
- Latin American Studies
- Latino Studies
- Linguistics
- Literary and Critical Theory
- Medieval Studies
- Military History
Political Science
- Public Health
- Renaissance and Reformation
- Social Work
- Urban Studies
- Victorian Literature
- Browse All Subjects
How to Subscribe
- Free Trials
In This Article Expand or collapse the "in this article" section Field Experiments
Introduction, data sources.
- Experimental Method and Random Assignment
- Field Experiments
- Noncompliance
- Interference
- Transfers, Subsidies, and Vouchers
- Decentralization and Governance
- Representation and Public Administration
- Discrimination
- Ethical Considerations
Related Articles Expand or collapse the "related articles" section about
About related articles close popup.
Lorem Ipsum Sit Dolor Amet
Vestibulum ante ipsum primis in faucibus orci luctus et ultrices posuere cubilia Curae; Aliquam ligula odio, euismod ut aliquam et, vestibulum nec risus. Nulla viverra, arcu et iaculis consequat, justo diam ornare tellus, semper ultrices tellus nunc eu tellus.
- Big Data in Political Science Research
- Political Geography in American Politics
Other Subject Areas
Forthcoming articles expand or collapse the "forthcoming articles" section.
- Australian Politics and Government
- Cross-National Surveys of Public Opinion
- Politics of School Reform
- Find more forthcoming articles...
- Export Citations
- Share This Facebook LinkedIn Twitter
Field Experiments by Donald P. Green , Alexander Coppock LAST REVIEWED: 26 August 2013 LAST MODIFIED: 26 August 2013 DOI: 10.1093/obo/9780199756223-0092
Field experimentation is a method of inquiry that allows social science researchers to accomplish at least two tasks that are impossible through speculation or observation alone. The first is to establish causality. Causal claims abound in the social sciences, and experiments provide a means to test them convincingly. The second task is estimating the sign and magnitude of treatment effects in real-world settings. The precision produced by experiments allows for a realistic calculation of the costs and benefits of policies and programs. This annotated bibliography aims to lay out the methodological benefits of field experimentation, as well as some important limitations and how best to deal with them. The references cited in these sections, which include noteworthy applications and technical discussions, should give the interested reader a broad introduction to field experimentation. The references also provide a snapshot of how field experimentation is used in political science and policy research.
Yale University’s Institution for Social and Policy Studies Data Archive , the Dataverse Network Project , and the Inter-University Consortium for Political and Social Research (ICPSR) provide access to publicly available datasets from randomized experiments. The Poverty Action Lab , Field Experiment Bibliography , and the Randomized Social Experiments eJournal collect published experimental results.
Greenberg, David H., and Mark D. Shroder, eds. Randomized Social Experiments eJournal .
A digest of recent published and unpublished manuscripts reporting field experimental results or methodological commentary.
Field Experiments Bibliography .
John List’s directory of field experiments, with a focus on economics.
Institution for Social and Policy Studies Data Archive . Yale University.
This archive features replication data from dozens of field experiments conducted by Yale researchers, dating back to 2000.
Inter-university Consortium for Political and Social Research (ICPSR) .
The largest social science data archive in the world contains replication data from several prominent field experiments in domains such as criminology, education, and public health.
The Dataverse Network Project .
This vast archive contains a wide array of studies, including an increasing number of field experiments.
Poverty Action Lab .
Provides extensive information on the practical issues concerning randomized evaluations.
back to top
Users without a subscription are not able to see the full content on this page. Please subscribe or login .
Oxford Bibliographies Online is available by subscription and perpetual access to institutions. For more information or to contact an Oxford Sales Representative click here .
- About Political Science »
- Meet the Editorial Board »
- Oceania, Gender, Indigenous and Ethnic Political Represent...
- Advanced Democracies, Electoral System Reform in
- Advanced Democracies, Public Opinion and Public Policy in
- Advertising and Election Campaigns in the United States
- Africa, Comparative Politics of
- Africa, Ethnic, Linguistic, Religious, and Regional Minori...
- Africa, Public Opinion in
- Africa, Women’s Political Representation in
- African Development, Politics of
- American Indian Politics
- Ancient Chinese Political Thought
- Arab Spring, The
- Arab-Israel Conflict, The
- Arendt, Hannah
- Argentine Government and Politics
- Aristotle's Political Thought
- Arms Race Modeling
- Asia, Environmental Politics in
- Asia, Water Politics in
- Asian American Mobilization and Political Identities
- Australia and New Zealand, Comparative Politics of
- Authoritarian Regimes, Lawyers in
- Authoritarianism in Russia
- Authoritarianism in the Public
- Authoritarianism in Turkey
- Bicameralism in Stable Democracies
- Biopolitics and State Regulation of Human Life
- Birthright Citizenship
- Brazilian Foreign Policy
- Brazilian Political Development
- Brexit, British Politics, and European Integration
- Business-State Relations in Europe
- Campaign Finance in the Era of Super-PACS
- Canadian Foreign Policy
- Canadian Government and Politics
- Candidate Emergence and Recruitment
- Caribbean, Elections and Democracy in the
- Celebrities in US Politics
- Channels of Electoral Representation in Advanced Industria...
- China, Political Economy of
- China's One-Child Policy
- China-Taiwan Relations
- Chinese Communist Party
- Chinese Economic Policy
- Chinese Nationalism
- Civil Society in South Asia
- Civil War in Sub-Saharan Africa
- Civil-Military Relations in Asia
- Class in American Politics
- Climate Change and Politics
- Collective Memory
- Colombian Politics and Government
- Comparative Capitalism Theory
- Comparative Industrial Relations in Europe
- Comparative Political Economy of Resource Extraction
- Comparative Politics of Angola, Mozambique, and Guinea-Bis...
- Comparative Politics of Chile and Uruguay
- Comparative Politics of Federalism
- Comparative Politics of the Middle East and North Africa
- Computational Social Science
- Congress, Defense, and Foreign Policy
- Congressional Reassertion of Authority
- Conservative Litigation Strategies and Groups in US Judici...
- Constitution, Ratification of the
- Constitutional Politics in Asia
- Constitutionalism
- Corruption in China
- Cosmopolitan Political Thought
- Crisis of European Integration in Historical Perspective, ...
- Critical Elections, Partisan Realignment, and Long-Term El...
- Critical Theory and the Frankfurt School
- Cuban Political Development
- Cycles of Protest
- Democracies, Political Clientelism in
- Democracy and Authoritarianism, Empirical Indicators of
- Democracy and Authoritarianism in Sub-Saharan Africa
- Democracy and Dictatorship in Central Asia
- Democracy and Minority Language Recognition
- Democracy in Latin America
- Democratic Citizenship
- Democratic Consolidation
- Democratic Peace Theory
- Democratic Theory
- Democratization
- Democratization in Africa
- Democratization in Central America
- Democratization in Mexico
- Democratization in the Muslim World
- Development of Survey Research
- Diasporas and Politics
- Direct Democracy in the United States
- Dual Citizenship
- East Africa, Politics of
- East and Southeast Asia, Political Party Systems in
- East and Southeast Asia, Women and Politics in
- East Asia, Civil Society and Social Movements in
- Economic Voting
- Effects of the 9/11 Terrorist Attacks on American Public O...
- Egalitarianism
- Election Forecasting
- Election Laws in Democracies
- Election Observation and the Detection of Fraud
- Electoral and Party System Development in Sub-Saharan Afri...
- Electoral Assistance
- Electoral Change in Latin America
- Electoral Institutions and Women’s Representation
- Electoral Reform and Voting in the United States
- Electoral Volatility in the New Democracies of Latin Ameri...
- Electronic Voting Systems
- Emotion and Racial Attitudes in Contemporary American Poli...
- Environmental Governance
- Environmental Politics among Advanced Industrial Democraci...
- Ethnic Diasporas and US Foreign Policy
- Ethnic Politics
- Eurasia, Comparative Politics of
- European Parliament, The
- European Social Democracy
- European Union, Politics of the
- Extension of Voting Rights to Emigrants
- Failed and Weak States in Theory and Practice
- Far-Right Parties in Europe
- Federalism in the United States
- Feminist Political Thought
- Filibuster, The
- Framing Effects in Political Communication
- Gender and Electoral Politics in the United States
- Gender and International Relations
- Gender and Political Violence
- Gender and Politics in South Asia
- Gender, Behavior, and Representation
- Gender Gap in US Public Opinion
- Gender Stereotypes in Politics
- Genetic Underpinnings of Political Attitudes and Behaviors
- German Politics and Government
- Global Inequality
- Globalization and the Welfare State
- Globalization, Health Crises, and Health Care
- Governance in Africa
- Governmental Responses to Political Corruption
- Gridlock and Divided Government in the U.S.
- Health-Care Politics in the United States
- Historiography of Twentieth-Century American Conservatism,...
- Hobbes’s Political Thought
- Hong Kong, Special Administrative Region of
- Hume’s Political Thought
- Hybrid Regimes
- Ideal Point Estimation
- Identity and Political Behavior
- Ideological Reasoning in Politics
- Illiberal Democracies and Democratic Backsliding
- Immigrant Incorporation in Canada
- Immigrant Incorporation in Western Europe
- Immigration and European Politics
- Immigration and International Relations
- Immigration Politics and Policy in the United States
- Impact of Campaign Contributions on Congressional Behavior...
- Impact of C-SPAN on US Democracy
- Implicit Attitudes in Public Opinion
- Income Dynamics and Politics in North America and Europe
- Income Inequality and Advanced Democracies
- Income Inequality in the United States, The Politics of
- Independent Voters, The Study of
- Indian Democracy
- Indigenous Politics and Representation in Latin America
- Indigenous Rights and Governance in Canada, Australia, and...
- Indonesia, Politics of
- Informal Practices of Accountability in Urban Africa
- Institutional Change in Advanced Democracies
- Institutional Factors Affecting Women’s Political Engageme...
- Intellectual Property in International Relations
- Interest Groups and Inequality in the United States
- Interest Groups in American Politics
- Interethnic Contact and Impact on Attitudes
- International Conflict Management
- International Criminal Justice
- International NGOs
- International Political Economy of Illegal Drugs
- Internet and Politics, The
- Intersectionality in Political Science
- Interstate Border Dispute Management in the Indo-Pacific
- Iran, Political Development of
- Israeli Politics
- Italian Politics and Government
- Judicial Supremacy and National Judicial Review
- Judiciaries and Politics in East Asia
- Kant's Political Thought
- Labor Migration: Dynamics and Politics
- Labor Politics in East Asia
- Land Reform in Latin America
- Latin America, Democratic Transitions in
- Latin America, Electoral Reform in
- Latin America, Environmental Policy and Politics in
- Latin America, Guerrilla Insurgencies in
- Latin America, Social Movements in
- Legal Mobilization
- LGBT Politics in the United States
- Liberal Pluralism
- Libertarianism
- Local Governments in the United States
- Machiavelli’s Political Thought
- Malaysian Politics and Government
- Marx's Political Thought
- Mass Incarceration and US Politics
- Mechanisms of Representation
- Media Effects in Politics
- Media Politics in South Asia
- Mexican Political Development
- Mexican Politics and Government
- Military Government in Latin America, 1959–1990
- Minority Governments
- Minority Political Engagement and Representation in the Un...
- Mixed-Member Electoral Systems
- Modern Dynastic Rule
- Modern Elections and Voting Behavior in Europe
- Motivated Reasoning
- Narrative Analysis
- National Interbranch Politics in the United States
- Nationalism
- NATO, Politics of
- Negative Campaigning
- Neoclassical Realism
- New Institutionalism Revisited, The
- Nigerian Politics and Government
- North America, Comparative Politics of
- Oil, Politics of
- Online Public Opinion Polling
- Organized Criminal Syndicates and Governance in Mexico and...
- Origins and Impact of Proportional Representation, The
- Outcomes of Social Movements and Protest Activities
- Partisan and Nonpartisan Theories of Organization in the U...
- Partisan Polarization in the US Congress
- Partisan Polarization in the US Electorate
- Party Networks
- Party System Institutionalization in Democracies
- Peace Operations
- Personality and Politics
- Personalization of Politics
- Philippine Politics and Government
- Plato’s Political Thought
- Policy Feedback
- Policy Responsiveness to Public Opinion
- Political Ambition
- Political Economy of Financial Regulation in Advanced Ind...
- Political Economy of India
- Political Economy of Taxation, The
- Political Humor and Its Effects
- Political Institutions and the Policymaking Process in Lat...
- Political Obligation
- Political Participation and Representation, Black
- Political Parties and Electoral Politics of Japan
- Political Roles and Activities of Former Presidents and Pr...
- Political Thought, Hegel's
- Political Thought of the American Founders, The
- Politics and Government, Australian
- Politics and Government, BeNeLux
- Politics and Policy in Contemporary Argentina
- Politics, Gender Quotas in
- Politics of Anti-Americanism
- Politics of Class Formation
- Politics of Disaster Prevention and Management
- Politics of Ethnic Identity in China
- Politics of Financial Crises
- Politics of Foreign Direct Investment in South Asia
- Politics of Higher Education in the U.S.
- Politics of Internal Conquest in the United States and Can...
- Politics of Japan
- Politics of Natural Disasters, The
- Politics of North Korea
- Politics of Science and Technology
- Politics of South Africa
- Politics of Southern Africa
- Politics of the American South
- Politics of the Philippines: From Rizal to Duterte
- Politics of the US-Mexico Border
- Populism in Latin America
- Positive and Negative Partisanship
- Postcolonial Political Theory
- Postcolonialism and International Relations
- Post-Communist Democratization
- Preferential Trade Agreements, Politics of
- Presidential Candidate Selection in Comparative Perspectiv...
- Presidential Persuasion and Public Opinion
- Presidential Primaries and Caucuses
- Private Governance
- Protest Participation
- Public Opinion in Affluent Democracies
- Public Opinion in Europe toward the European Union
- Public Opinion in New Democracies and Developing Nations
- Public Opinion on Immigration
- Public Opinion toward the Environment and Climate Change i...
- Public Presidency, US Elections, and the Permanent Campaig...
- Qualitative Methods, The Renewal of
- Race in American Political Thought
- Racial and Ethnic Descriptive Representation in the United...
- Recruitment and Selection for Elected Office
- Redistricting and Electoral Competition in American Politi...
- Referendums and Direct Democracy
- Regime Transitions and Variation in Post-Communist Europe
- Regional Integration
- Regional Integration in Latin America
- Regional Security
- Regulating Food Production
- Religion and Politics in Latin America
- Religion in American Political Thought
- Religion in Contemporary Political Thought
- Religion, Politics, and Civic Engagement in the United Sta...
- Republicanism
- Rousseau’s Political Thought
- Rule of Law
- Russia and the West
- Science and Democracy
- Science and Social Movements
- Secession and Secessionist Movements
- Semi-Presidential Systems
- Social Networks, Mass Publics, and Democratic Politics
- Social Policy and Immigrant Integration
- South Asian Political Thought
- South Korea, Politics of
- Southeast Asia, International Relations in
- Southeast Asian Politics
- Spanish Politics and Government
- Spectacle, The
- Sport and Politics
- State Building in Sub-Saharan Africa
- State Formation
- State, The Nature of the
- State-Society Relations in South Asia
- Stereotypes in Political Reasoning
- Supreme Court and Public Opinion
- Supreme Court of the United States, The
- Systemic Theories of International Politics
- Taiwan, Politics of
- Tea Party, The
- Thailand, Politics of
- The Crisis of European Integration in Historical Perspecti...
- The New Right in American Political Thought
- The Politics of Parenthood: Attitudes, Behavior, Policy, a...
- The Politics of Waste and Social Inequalities in Indian Ci...
- Third-Party Politics in the United States
- Tocqueville’s Political Thought
- Transboundary Pollution
- Transitional Justice
- Transnational Private Regulation
- Trust in Latin American Governing Institutions
- Turkey, Political Development of
- US Military Bases Abroad
- US Politics, Neoliberalism in
- US Presidency, The
- US Presidential Campaigns and Their Impact
- Venezuela, The Path Toward Authoritarianism in
- Voter Support for Women Candidates
- Voter Turnout
- Voter Turnout Field Experiments
- Voting Technology and Election Administration in the Unite...
- War, Factors Influencing Popular Support for
- Welfare State Development
- Welfare State Development in Latin America
- Welfare State Development in Western Europe
- West Africa, Politics of
- White Identity Politics
- Women and Conflict Studies
- Women’s Inclusion in Executive Cabinets
- Women’s Legal and Constitutional Rights
- Women’s Political Activism and Civic Engagement in Latin A...
- Women’s Representation in Governmental Office in Latin Ame...
- Women’s Representation in the Middle East and North Africa
- Workers’ Politics in China
- Youth and Generational Differences in US Politics
- Privacy Policy
- Cookie Policy
- Legal Notice
- Accessibility
Powered by:
- [66.249.64.20|195.158.225.244]
- 195.158.225.244
- Search Menu
- Sign in through your institution
- Browse content in Arts and Humanities
- Browse content in Archaeology
- Anglo-Saxon and Medieval Archaeology
- Archaeological Methodology and Techniques
- Archaeology by Region
- Archaeology of Religion
- Archaeology of Trade and Exchange
- Biblical Archaeology
- Contemporary and Public Archaeology
- Environmental Archaeology
- Historical Archaeology
- History and Theory of Archaeology
- Industrial Archaeology
- Landscape Archaeology
- Mortuary Archaeology
- Prehistoric Archaeology
- Underwater Archaeology
- Urban Archaeology
- Zooarchaeology
- Browse content in Architecture
- Architectural Structure and Design
- History of Architecture
- Residential and Domestic Buildings
- Theory of Architecture
- Browse content in Art
- Art Subjects and Themes
- History of Art
- Industrial and Commercial Art
- Theory of Art
- Biographical Studies
- Byzantine Studies
- Browse content in Classical Studies
- Classical History
- Classical Philosophy
- Classical Mythology
- Classical Numismatics
- Classical Literature
- Classical Reception
- Classical Art and Architecture
- Classical Oratory and Rhetoric
- Greek and Roman Epigraphy
- Greek and Roman Law
- Greek and Roman Archaeology
- Greek and Roman Papyrology
- Late Antiquity
- Religion in the Ancient World
- Social History
- Digital Humanities
- Browse content in History
- Colonialism and Imperialism
- Diplomatic History
- Environmental History
- Genealogy, Heraldry, Names, and Honours
- Genocide and Ethnic Cleansing
- Historical Geography
- History by Period
- History of Agriculture
- History of Education
- History of Emotions
- History of Gender and Sexuality
- Industrial History
- Intellectual History
- International History
- Labour History
- Legal and Constitutional History
- Local and Family History
- Maritime History
- Military History
- National Liberation and Post-Colonialism
- Oral History
- Political History
- Public History
- Regional and National History
- Revolutions and Rebellions
- Slavery and Abolition of Slavery
- Social and Cultural History
- Theory, Methods, and Historiography
- Urban History
- World History
- Browse content in Language Teaching and Learning
- Language Learning (Specific Skills)
- Language Teaching Theory and Methods
- Browse content in Linguistics
- Applied Linguistics
- Cognitive Linguistics
- Computational Linguistics
- Forensic Linguistics
- Grammar, Syntax and Morphology
- Historical and Diachronic Linguistics
- History of English
- Language Acquisition
- Language Variation
- Language Families
- Language Evolution
- Language Reference
- Lexicography
- Linguistic Theories
- Linguistic Typology
- Linguistic Anthropology
- Phonetics and Phonology
- Psycholinguistics
- Sociolinguistics
- Translation and Interpretation
- Writing Systems
- Browse content in Literature
- Bibliography
- Children's Literature Studies
- Literary Studies (Asian)
- Literary Studies (European)
- Literary Studies (Eco-criticism)
- Literary Studies (Modernism)
- Literary Studies (Romanticism)
- Literary Studies (American)
- Literary Studies - World
- Literary Studies (1500 to 1800)
- Literary Studies (19th Century)
- Literary Studies (20th Century onwards)
- Literary Studies (African American Literature)
- Literary Studies (British and Irish)
- Literary Studies (Early and Medieval)
- Literary Studies (Fiction, Novelists, and Prose Writers)
- Literary Studies (Gender Studies)
- Literary Studies (Graphic Novels)
- Literary Studies (History of the Book)
- Literary Studies (Plays and Playwrights)
- Literary Studies (Poetry and Poets)
- Literary Studies (Postcolonial Literature)
- Literary Studies (Queer Studies)
- Literary Studies (Science Fiction)
- Literary Studies (Travel Literature)
- Literary Studies (War Literature)
- Literary Studies (Women's Writing)
- Literary Theory and Cultural Studies
- Mythology and Folklore
- Shakespeare Studies and Criticism
- Browse content in Media Studies
- Browse content in Music
- Applied Music
- Dance and Music
- Ethics in Music
- Ethnomusicology
- Gender and Sexuality in Music
- Medicine and Music
- Music Cultures
- Music and Religion
- Music and Culture
- Music and Media
- Music Education and Pedagogy
- Music Theory and Analysis
- Musical Scores, Lyrics, and Libretti
- Musical Structures, Styles, and Techniques
- Musicology and Music History
- Performance Practice and Studies
- Race and Ethnicity in Music
- Sound Studies
- Browse content in Performing Arts
- Browse content in Philosophy
- Aesthetics and Philosophy of Art
- Epistemology
- Feminist Philosophy
- History of Western Philosophy
- Meta-Philosophy
- Metaphysics
- Moral Philosophy
- Non-Western Philosophy
- Philosophy of Science
- Philosophy of Action
- Philosophy of Law
- Philosophy of Religion
- Philosophy of Language
- Philosophy of Mind
- Philosophy of Perception
- Philosophy of Mathematics and Logic
- Practical Ethics
- Social and Political Philosophy
- Browse content in Religion
- Biblical Studies
- Christianity
- East Asian Religions
- History of Religion
- Judaism and Jewish Studies
- Qumran Studies
- Religion and Gender
- Religion and Education
- Religion and Health
- Religion and Politics
- Religion and Science
- Religion and Law
- Religion and Art, Literature, and Music
- Religious Studies
- Browse content in Society and Culture
- Cookery, Food, and Drink
- Cultural Studies
- Customs and Traditions
- Ethical Issues and Debates
- Hobbies, Games, Arts and Crafts
- Lifestyle, Home, and Garden
- Natural world, Country Life, and Pets
- Popular Beliefs and Controversial Knowledge
- Sports and Outdoor Recreation
- Technology and Society
- Travel and Holiday
- Visual Culture
- Browse content in Law
- Arbitration
- Browse content in Company and Commercial Law
- Commercial Law
- Company Law
- Browse content in Comparative Law
- Systems of Law
- Competition Law
- Browse content in Constitutional and Administrative Law
- Government Powers
- Judicial Review
- Local Government Law
- Military and Defence Law
- Parliamentary and Legislative Practice
- Construction Law
- Contract Law
- Browse content in Criminal Law
- Criminal Procedure
- Criminal Evidence Law
- Sentencing and Punishment
- Employment and Labour Law
- Environment and Energy Law
- Browse content in Financial Law
- Banking Law
- Insolvency Law
- History of Law
- Human Rights and Immigration
- Intellectual Property Law
- Browse content in International Law
- Private International Law and Conflict of Laws
- Public International Law
- IT and Communications Law
- Jurisprudence and Philosophy of Law
- Law and Politics
- Law and Society
- Browse content in Legal System and Practice
- Courts and Procedure
- Legal Skills and Practice
- Legal System - Costs and Funding
- Primary Sources of Law
- Regulation of Legal Profession
- Medical and Healthcare Law
- Browse content in Policing
- Criminal Investigation and Detection
- Police and Security Services
- Police Procedure and Law
- Police Regional Planning
- Browse content in Property Law
- Personal Property Law
- Restitution
- Study and Revision
- Terrorism and National Security Law
- Browse content in Trusts Law
- Wills and Probate or Succession
- Browse content in Medicine and Health
- Browse content in Allied Health Professions
- Arts Therapies
- Clinical Science
- Dietetics and Nutrition
- Occupational Therapy
- Operating Department Practice
- Physiotherapy
- Radiography
- Speech and Language Therapy
- Browse content in Anaesthetics
- General Anaesthesia
- Browse content in Clinical Medicine
- Acute Medicine
- Cardiovascular Medicine
- Clinical Genetics
- Clinical Pharmacology and Therapeutics
- Dermatology
- Endocrinology and Diabetes
- Gastroenterology
- Genito-urinary Medicine
- Geriatric Medicine
- Infectious Diseases
- Medical Oncology
- Medical Toxicology
- Pain Medicine
- Palliative Medicine
- Rehabilitation Medicine
- Respiratory Medicine and Pulmonology
- Rheumatology
- Sleep Medicine
- Sports and Exercise Medicine
- Clinical Neuroscience
- Community Medical Services
- Critical Care
- Emergency Medicine
- Forensic Medicine
- Haematology
- History of Medicine
- Browse content in Medical Dentistry
- Oral and Maxillofacial Surgery
- Paediatric Dentistry
- Restorative Dentistry and Orthodontics
- Surgical Dentistry
- Medical Ethics
- Browse content in Medical Skills
- Clinical Skills
- Communication Skills
- Nursing Skills
- Surgical Skills
- Medical Statistics and Methodology
- Browse content in Neurology
- Clinical Neurophysiology
- Neuropathology
- Nursing Studies
- Browse content in Obstetrics and Gynaecology
- Gynaecology
- Occupational Medicine
- Ophthalmology
- Otolaryngology (ENT)
- Browse content in Paediatrics
- Neonatology
- Browse content in Pathology
- Chemical Pathology
- Clinical Cytogenetics and Molecular Genetics
- Histopathology
- Medical Microbiology and Virology
- Patient Education and Information
- Browse content in Pharmacology
- Psychopharmacology
- Browse content in Popular Health
- Caring for Others
- Complementary and Alternative Medicine
- Self-help and Personal Development
- Browse content in Preclinical Medicine
- Cell Biology
- Molecular Biology and Genetics
- Reproduction, Growth and Development
- Primary Care
- Professional Development in Medicine
- Browse content in Psychiatry
- Addiction Medicine
- Child and Adolescent Psychiatry
- Forensic Psychiatry
- Learning Disabilities
- Old Age Psychiatry
- Psychotherapy
- Browse content in Public Health and Epidemiology
- Epidemiology
- Public Health
- Browse content in Radiology
- Clinical Radiology
- Interventional Radiology
- Nuclear Medicine
- Radiation Oncology
- Reproductive Medicine
- Browse content in Surgery
- Cardiothoracic Surgery
- Gastro-intestinal and Colorectal Surgery
- General Surgery
- Neurosurgery
- Paediatric Surgery
- Peri-operative Care
- Plastic and Reconstructive Surgery
- Surgical Oncology
- Transplant Surgery
- Trauma and Orthopaedic Surgery
- Vascular Surgery
- Browse content in Science and Mathematics
- Browse content in Biological Sciences
- Aquatic Biology
- Biochemistry
- Bioinformatics and Computational Biology
- Developmental Biology
- Ecology and Conservation
- Evolutionary Biology
- Genetics and Genomics
- Microbiology
- Molecular and Cell Biology
- Natural History
- Plant Sciences and Forestry
- Research Methods in Life Sciences
- Structural Biology
- Systems Biology
- Zoology and Animal Sciences
- Browse content in Chemistry
- Analytical Chemistry
- Computational Chemistry
- Crystallography
- Environmental Chemistry
- Industrial Chemistry
- Inorganic Chemistry
- Materials Chemistry
- Medicinal Chemistry
- Mineralogy and Gems
- Organic Chemistry
- Physical Chemistry
- Polymer Chemistry
- Study and Communication Skills in Chemistry
- Theoretical Chemistry
- Browse content in Computer Science
- Artificial Intelligence
- Computer Architecture and Logic Design
- Game Studies
- Human-Computer Interaction
- Mathematical Theory of Computation
- Programming Languages
- Software Engineering
- Systems Analysis and Design
- Virtual Reality
- Browse content in Computing
- Business Applications
- Computer Security
- Computer Games
- Computer Networking and Communications
- Digital Lifestyle
- Graphical and Digital Media Applications
- Operating Systems
- Browse content in Earth Sciences and Geography
- Atmospheric Sciences
- Environmental Geography
- Geology and the Lithosphere
- Maps and Map-making
- Meteorology and Climatology
- Oceanography and Hydrology
- Palaeontology
- Physical Geography and Topography
- Regional Geography
- Soil Science
- Urban Geography
- Browse content in Engineering and Technology
- Agriculture and Farming
- Biological Engineering
- Civil Engineering, Surveying, and Building
- Electronics and Communications Engineering
- Energy Technology
- Engineering (General)
- Environmental Science, Engineering, and Technology
- History of Engineering and Technology
- Mechanical Engineering and Materials
- Technology of Industrial Chemistry
- Transport Technology and Trades
- Browse content in Environmental Science
- Applied Ecology (Environmental Science)
- Conservation of the Environment (Environmental Science)
- Environmental Sustainability
- Environmentalist Thought and Ideology (Environmental Science)
- Management of Land and Natural Resources (Environmental Science)
- Natural Disasters (Environmental Science)
- Nuclear Issues (Environmental Science)
- Pollution and Threats to the Environment (Environmental Science)
- Social Impact of Environmental Issues (Environmental Science)
- History of Science and Technology
- Browse content in Materials Science
- Ceramics and Glasses
- Composite Materials
- Metals, Alloying, and Corrosion
- Nanotechnology
- Browse content in Mathematics
- Applied Mathematics
- Biomathematics and Statistics
- History of Mathematics
- Mathematical Education
- Mathematical Finance
- Mathematical Analysis
- Numerical and Computational Mathematics
- Probability and Statistics
- Pure Mathematics
- Browse content in Neuroscience
- Cognition and Behavioural Neuroscience
- Development of the Nervous System
- Disorders of the Nervous System
- History of Neuroscience
- Invertebrate Neurobiology
- Molecular and Cellular Systems
- Neuroendocrinology and Autonomic Nervous System
- Neuroscientific Techniques
- Sensory and Motor Systems
- Browse content in Physics
- Astronomy and Astrophysics
- Atomic, Molecular, and Optical Physics
- Biological and Medical Physics
- Classical Mechanics
- Computational Physics
- Condensed Matter Physics
- Electromagnetism, Optics, and Acoustics
- History of Physics
- Mathematical and Statistical Physics
- Measurement Science
- Nuclear Physics
- Particles and Fields
- Plasma Physics
- Quantum Physics
- Relativity and Gravitation
- Semiconductor and Mesoscopic Physics
- Browse content in Psychology
- Affective Sciences
- Clinical Psychology
- Cognitive Neuroscience
- Cognitive Psychology
- Criminal and Forensic Psychology
- Developmental Psychology
- Educational Psychology
- Evolutionary Psychology
- Health Psychology
- History and Systems in Psychology
- Music Psychology
- Neuropsychology
- Organizational Psychology
- Psychological Assessment and Testing
- Psychology of Human-Technology Interaction
- Psychology Professional Development and Training
- Research Methods in Psychology
- Social Psychology
- Browse content in Social Sciences
- Browse content in Anthropology
- Anthropology of Religion
- Human Evolution
- Medical Anthropology
- Physical Anthropology
- Regional Anthropology
- Social and Cultural Anthropology
- Theory and Practice of Anthropology
- Browse content in Business and Management
- Business Strategy
- Business History
- Business Ethics
- Business and Government
- Business and Technology
- Business and the Environment
- Comparative Management
- Corporate Governance
- Corporate Social Responsibility
- Entrepreneurship
- Health Management
- Human Resource Management
- Industrial and Employment Relations
- Industry Studies
- Information and Communication Technologies
- International Business
- Knowledge Management
- Management and Management Techniques
- Operations Management
- Organizational Theory and Behaviour
- Pensions and Pension Management
- Public and Nonprofit Management
- Social Issues in Business and Management
- Strategic Management
- Supply Chain Management
- Browse content in Criminology and Criminal Justice
- Criminal Justice
- Criminology
- Forms of Crime
- International and Comparative Criminology
- Youth Violence and Juvenile Justice
- Development Studies
- Browse content in Economics
- Agricultural, Environmental, and Natural Resource Economics
- Asian Economics
- Behavioural Finance
- Behavioural Economics and Neuroeconomics
- Econometrics and Mathematical Economics
- Economic Systems
- Economic Methodology
- Economic History
- Economic Development and Growth
- Financial Markets
- Financial Institutions and Services
- General Economics and Teaching
- Health, Education, and Welfare
- History of Economic Thought
- International Economics
- Labour and Demographic Economics
- Law and Economics
- Macroeconomics and Monetary Economics
- Microeconomics
- Public Economics
- Urban, Rural, and Regional Economics
- Welfare Economics
- Browse content in Education
- Adult Education and Continuous Learning
- Care and Counselling of Students
- Early Childhood and Elementary Education
- Educational Equipment and Technology
- Educational Research Methodology
- Educational Strategies and Policy
- Higher and Further Education
- Organization and Management of Education
- Philosophy and Theory of Education
- Schools Studies
- Secondary Education
- Teaching of a Specific Subject
- Teaching of Specific Groups and Special Educational Needs
- Teaching Skills and Techniques
- Browse content in Environment
- Applied Ecology (Social Science)
- Climate Change
- Conservation of the Environment (Social Science)
- Environmentalist Thought and Ideology (Social Science)
- Management of Land and Natural Resources (Social Science)
- Natural Disasters (Environment)
- Pollution and Threats to the Environment (Social Science)
- Social Impact of Environmental Issues (Social Science)
- Sustainability
- Browse content in Human Geography
- Cultural Geography
- Economic Geography
- Political Geography
- Browse content in Interdisciplinary Studies
- Communication Studies
- Museums, Libraries, and Information Sciences
- Browse content in Politics
- African Politics
- Asian Politics
- Chinese Politics
- Comparative Politics
- Conflict Politics
- Elections and Electoral Studies
- Environmental Politics
- Ethnic Politics
- European Union
- Foreign Policy
- Gender and Politics
- Human Rights and Politics
- Indian Politics
- International Relations
- International Organization (Politics)
- International Political Economy
- Irish Politics
- Latin American Politics
- Middle Eastern Politics
- Political Methodology
- Political Communication
- Political Philosophy
- Political Sociology
- Political Theory
- Political Behaviour
- Political Economy
- Political Institutions
- Politics and Law
- Politics and Religion
- Politics of Development
- Public Administration
- Public Policy
- Qualitative Political Methodology
- Quantitative Political Methodology
- Regional Political Studies
- Russian Politics
- Security Studies
- State and Local Government
- UK Politics
- US Politics
- Browse content in Regional and Area Studies
- African Studies
- Asian Studies
- East Asian Studies
- Japanese Studies
- Latin American Studies
- Middle Eastern Studies
- Native American Studies
- Scottish Studies
- Browse content in Research and Information
- Research Methods
- Browse content in Social Work
- Addictions and Substance Misuse
- Adoption and Fostering
- Care of the Elderly
- Child and Adolescent Social Work
- Couple and Family Social Work
- Direct Practice and Clinical Social Work
- Emergency Services
- Human Behaviour and the Social Environment
- International and Global Issues in Social Work
- Mental and Behavioural Health
- Social Justice and Human Rights
- Social Policy and Advocacy
- Social Work and Crime and Justice
- Social Work Macro Practice
- Social Work Practice Settings
- Social Work Research and Evidence-based Practice
- Welfare and Benefit Systems
- Browse content in Sociology
- Childhood Studies
- Community Development
- Comparative and Historical Sociology
- Disability Studies
- Economic Sociology
- Gender and Sexuality
- Gerontology and Ageing
- Health, Illness, and Medicine
- Marriage and the Family
- Migration Studies
- Occupations, Professions, and Work
- Organizations
- Population and Demography
- Race and Ethnicity
- Social Theory
- Social Movements and Social Change
- Social Research and Statistics
- Social Stratification, Inequality, and Mobility
- Sociology of Religion
- Sociology of Education
- Sport and Leisure
- Urban and Rural Studies
- Browse content in Warfare and Defence
- Defence Strategy, Planning, and Research
- Land Forces and Warfare
- Military Administration
- Military Life and Institutions
- Naval Forces and Warfare
- Other Warfare and Defence Issues
- Peace Studies and Conflict Resolution
- Weapons and Equipment
- < Previous chapter
- Next chapter >
5 Field Experiments and the Study of Political Behavior
Tiffany C. Davenport is a doctoral student in Political Science at Yale University.
Yale University
Donald P. Green (Ph.D., University of California at Berkeley) is Professor of Political Science at Columbia University. The author of four books and more than one hundred essays, Green's research interests span a wide array of topics: voting behavior, partisanship, campaign finance, hate crime, and research methods. Much of his current work uses field experimentation to study the ways in which political campaigns mobilize and persuade voters, but he has also conducted experimental research on the effects of the mass media, civic education classes, and criminal sentencing. With Alan Gerber, he recently co-authored a textbook on this research method titled Field Experiments: Design, Analysis, and Interpretation (W.W. Norton, 2012).
- Published: 02 May 2010
- Cite Icon Cite
- Permissions Icon Permissions
This article presents an overview of field experiments and their contribution to the study of political behavior. First, it briefly outlines the history of field experimentation in political science and neighboring disciplines. It then summarizes a series of important and interrelated research literatures, exploring the influences of political campaigns, political communication, and political socialization. The review shows that the advent of field experimentation represents a significant departure from what had been a field dominated by survey and lab research. Furthermore, the ways in which field experimental studies shaped the research in political behavior are addressed. Field experimental studies have brought a new level of precision to the study of campaign communication. The principal argument for observational research is that it enables scholars to study a broad class of causal questions, not just those that are amenable to experimental manipulation.
Experiments are studies in which the units of observation—people, locations, organizations—are randomly assigned to different interventions. The purpose of an experiment is to isolate the causal influence of these interventions. In political science, the term “field experiment” refers to experiments that take place in real‐world settings. Field experimentation attempts to approximate the conditions under which a causal process occurs, the aim being to enhance the external validity, or applicability, of experimental findings. Four criteria are often used to assess the degree to which field experiments approximate real‐world conditions: whether the stimulus used in the study resembles the stimuli of interest in the political world, whether the participants resemble the actors who ordinarily encounter these stimuli, whether the context within which subjects receive the stimulus resembles the political context of interest, and whether the outcome measures resemble the actual political outcomes of theoretical or practical interest.
Political science field experiments take many forms. For example, Miller and Krosnick ( 2004 ) collaborated with an interest group in order to test the effectiveness of alternative fundraising appeals. The treatments were fundraising letters; the experiment was unobtrusive in the sense that recipients of the fundraising appeals were unaware that an experiment was being conducted; and the outcomes were financial donations. Similarly, Bergan ( 2009 ) teamed up with a grassroots lobbying organization in order to test whether constituents' email to state representatives influences roll call voting. The lobbying organization allowed Bergan to extract a random control group from its list of targeted legislators; otherwise, its lobbying campaign was conducted in the usual way, and outcomes were assessed based on the legislators' floor votes.
Not all field experiments are as realistic and unobtrusive as these examples. Sometimes the interventions that are deployed in the field are designed by researchers rather than by practitioners. For example, Gosnell ( 1927 ) and Eldersveld ( 1956 ) fashioned their own get‐out‐the‐vote campaigns in order to test whether they would cause registered voters to cast ballots. Sometimes treatments are administered and outcomes are measured in a way that notifies participants that they are being studied, as in Paluck's (2009) experimental investigation of radio's effects on inter‐group attitudes in Rwanda. Her study enlisted groups of Rwandan villagers to listen to recordings of radio programs on a monthly basis for a period of one year.
The distinction between field experiments and other types of experiments hinges on the causal question that the researcher has in mind. To the researcher who seeks to understand how college students behave when presented with dilemmas involving the distribution of small sums of money, laboratory experiments in which undergraduates vie for monetary payoffs may be regarded as field experiments. On the other hand, if one seeks to understand how members of the general public respond to political communication, the external validity of lab studies involving undergraduates has been questioned (Sears 1986 ), and similar objections have been levied against the artificial ways in which outcomes are often measured in the lab (Aronson, Wilson, and Brewer 1998 ). These kinds of external validity concerns may one day subside if research demonstrates that lab studies involving undergraduates consistently produce results that are corroborated by experimental studies outside the lab; for now, the degree of correspondence remains an open question.
The same may be said of survey experiments. By varying question wording and order, survey experiments may provide important insights into the factors that shape survey response, and they may also shed light on decisions that closely resemble survey responses, such as voting in elections (Glaser 2006 ) and approval of presidential performance in the wake of a foreign policy confrontation (Tomz 2007 ). Whether survey experiments provide externally valid insights about the effects of exposure to media messages or other campaign influences, however, remains unclear. What constitutes a field experiment therefore depends on how “the field” is defined. Early agricultural experiments were called field experiments because they were literally conducted in fields. But if the question were how to maximize agricultural productivity of greenhouses, the appropriate field experiment might be conducted indoors.
Studies classified as “natural experiments” or “quasi‐experiments” are related to field experiments in that they enable researchers to gauge the causal influence of real‐world interventions. Although usage varies, the term “natural experiment” typically denotes randomized experiments where the treatments are assigned by government agencies or non‐academic entities. For example, the Vietnam Draft Lottery (Angrist 1990 ), the random assignment of defendants to judges (Green and Winik 2010 ; Waldfogel 1994 ), the random audit of local municipalities (Ferraz and Finan 2008 ), the assignment of students to schools by means of school choice lotteries (Hastings et al. 2007 ), and state‐run Powerball lotteries (Doherty, Gerber, and Green 2006 ) are a few examples where randomization procedures were employed by non‐researchers, setting the stage for an experimental analysis.
Related are “quasi‐experiments” (Cook and Campbell 1979 ) in which near‐random processes cause places, groups, or individuals to receive different treatments. Scholars have used seemingly arbitrary breaks in jurisdiction (Huber and Gordon 2004 ), geography (Huber and Arceneaux 2007 ; Krasno and Green 2008 ), representation rules (Pettersson‐Lidbom 2004 ), and election thresholds (Lee 2007 ) to identify a wide array of different parameters. Huber and Arceneaux ( 2007 ), for example, use the arbitrary shapes of television markets and the incidental exposure of voters in non‐battleground states to presidential advertisements in order to test whether these ads shape voters' preferences. Pettersson‐Lidbom ( 2004 ) tests whether the number of municipal representatives affects the amount of government spending by seizing on the fact that certain Scandinavian countries require the number of local representatives to change with population size according to a rigid schedule. By looking at towns on either side of these population thresholds, Pettersson‐Lidbom is able to test whether budgets shift as otherwise similar towns experience a shift in representation. Because quasi‐experiments do not involve random assignment, the causal inferences they support are subject to greater uncertainty (Gerber et al. 2009). Nevertheless, we review field, natural, and quasi‐experiments together because they all reflect a style of analysis that places emphasis on generating secure causal inferences through carefully constructed comparisons of groups receiving different treatments.
This chapter provides an overview of field experiments and their contribution to the study of political behavior. We begin by briefly summarizing the history of field experimentation in political science and neighboring disciplines. We then review a series of important and interrelated research literatures examining the effects of political campaigns, political communication, and political socialization. Our review suggests that the advent of field experimentation represents a significant departure from what had been a field dominated by survey and lab research. The net effect of this development has been to focus new attention on causal inference and to challenge key claims that had heretofore rested on observational or laboratory data.
History and Revival of Field Experimentation
The history of field experimentation may be traced to early attempts to conduct controlled interventions in the context of political campaigns. An early example of such work was Harold Gosnell's ( 1927 ) study of voter registration and turnout in Chicago prior to the 1924 and 1925 elections. Gosnell divided neighborhoods into blocks, assigning certain blocks to the treatment condition of his experiment, which consisted of a letter urging adults to register to vote. Tabulating the registration and voting rates in his treatment and control group, Gosnell found his intervention produced a small increase in voting in 1924 but a large increase in voting in the mayoral election of 1925. In 1935 George Hartmann conducted a controlled experiment in which he distributed 10,000 leaflets bearing either “rational” or “emotional” appeals for the Socialist party. Examining ballot returns, Hartmann ( 1936 –37) found Socialist voting to be somewhat more common in wards that received emotional leaflets.
These early studies might be characterized as controlled field experiments, as distinct from randomized field experiments. Although Gosnell and Hartmann determined which blocks or wards were to receive their solicitations, they did not assign observations to treatment and control conditions on a random basis. As the statistical insights of Fisher ( 1935 ) took root in social science, experimentation became synonymous with randomized experimentation. For example, Hovland, Lumsdaine, and Sheffield ( 1949 ), working in the Experimental Section of the Research Division of the War Department during the Second World War, conducted a series of randomized experiments examining the effectiveness of various training films designed to indoctrinate Army personnel. Eldersveld's ( 1956 ) classic study of voter mobilization in the Ann Arbor elections of 1953 and 1954 built randomization into the basic design of the Gosnell study. Assigning voters to receive phone calls, mail, or personal contact prior to election day, Eldersveld examined the marginal effects of different types of appeals, both separately and in combination with one another.
Although Eldersveld's research was admired, the research methodology that it introduced did not catch on in political science. New developments in data analysis, sampling theory, and computing seemed to make non‐experimental research more promising and experimentation less necessary. Surveys offered an inexpensive means by which to gather information from nationally representative samples; they could inquire whether the respondent had been contacted by parties or campaigns; indeed, they could examine the psychological mechanisms that might explain why canvassing leads to higher rates of political participation. Moreover, survey data could be mined again and again by researchers interested in an array of different questions, not just the causal question that animated a particular experiment. Surveys seemed not only superior as instruments of measurement and description, but also as vehicles for causal analysis.
Overshadowed by survey‐based investigations, field experimentation had trouble taking root as a method for studying mass political behavior. The Handbook of Political Science devoted a chapter to “Experimentation and Simulation” (Brody and Brownstein 1975 ). Although the authors praised field experiments, they could point to few examples. In Donald Kinder and Thomas Palfrey's edited volume Experimental Foundations of Political Science ( 1993 ), only one of the twenty research essays may be considered a field experiment, Cover and Brumberg ( 1982 ). No field experiments were published in leading political science journals during the 1990s.
The turning point in field experimentation may be traced to economics, which saw during the 1980s and 1990s increasing debate about the accuracy of inferences derived from observational research. In a memorable essay, Lalonde ( 1986 ) argued that regression models—even technically sophisticated ones—may fail to extract accurate parameter estimates from survey data. LaLonde's demonstration involved comparing survey results to estimates generated by randomized field experiments. The exercise provided an unusually clear demonstration of the biases of non‐experimental methods. Especially disconcerting was the fact that observational estimates remained inaccurate even when state‐of‐the‐art statistical methods, such as propensity score matching or Heckman selection models, were used to correct for threats of bias (Glazerman, Levy, and Myers 2003 ). In short, despite the growing sophistication of statistical techniques, they remain unable to reliably address the threat of bias, and they remain unable to properly quantify the uncertainty of the estimates they generate.
Growing skepticism about the accuracy of conclusions rooted in observational research helped pave the way for a series of ambitious randomized experiments in a variety of social science disciplines. Criminologists launched a series of remarkable studies to assess the deterrent effects of arresting perpetrators of domestic violence (Sherman and Berk 1984 ) or police raids of drug distribution centers (Sherman and Rogan 1995 ). Sociologists and economists collaborated to study the effects of randomly moving residents of economically depressed housing projects to nearby neighborhoods with lower poverty and crime rates (Kling, Liebman, and Katz 2007 ). Economists working in developing countries introduced field experimentation on a grand scale to study the effectiveness of anti‐poverty measures ranging from public health interventions to schooling to loans (Banerjee and Duflo 2006 ; Kremer 2003 ). The net effect was a rapidly expanding network of scholars working in different substantive areas but using similar methodological tools.
Amid these intellectual currents, field experimentation resurfaced in political science. Gerber and Green ( 2000 ) conducted a randomized experiment in New Haven, Connecticut in 1998, testing the extent to which door‐to‐door canvassing, calls from a commercial phone bank, and direct mail increased voter turnout. The study was in many ways reminiscent of earlier work by Eldersveld ( 1956 ) but differed in two important respects. First, the scale of the Gerber and Green ( 2000 ) study was approximately one hundred times larger than Eldersveld's. The number of observations in the New Haven study for the first time enabled researchers to gauge reliably the relative effectiveness and cost‐efficiency of different get‐out‐the‐vote tactics. Second, Gerber and Green took advantage of statistical advances that had occurred in the decades since the publication of Eldersveld's path‐breaking study. Their statistical analysis addressed the problems that arise in field experiments where some of those who are assigned to receive phone calls or visits turn out to be unreachable. Whereas Eldersveld and other scholars classified the unreachable subjects together with the control group, Gerber and Green preserved the original randomly assigned categories and showed how they could be used to estimate properly the effects of the phone calls and visits. This study sparked interest in field experimentation, and during the next decade dozens of articles employing field experimentation appeared in political science journals and edited volumes. The next section considers the ways in which field experimental studies shaped the research in political behavior.
The Effects of Political Campaigns and Political Communication
Before the recent advent of field experimentation, the literature on campaign effects consisted of three main lines of research. The first relied on surveys conducted over the course of a political campaign or series of political campaigns. Many of the most influential studies of public opinion and voting behavior draw on surveys that measured respondents' choices and the kinds of environmental influences that may have shaped them. For example, Rosenstone and Hansen ( 1993 ) used a series of American National Election Studies to demonstrate that voter mobilization efforts conducted by political parties and campaigns increase voter turnout. Regression analysis indicated that, controlling for other factors that may influence turnout, those who report having been called or visited by campaign workers are more likely to report having voted. The problem with this type of analysis is that it is prone to bias. Campaigns do not target voters at random. Rather, they tend to target frequent voters. Thus, even if campaign contact had no causal effect on turnout, a regression analysis might indicate that those who were contacted by campaigns tend to vote at higher rates. The threat of bias is compounded by survey error. Survey respondents are notoriously inaccurate in their reports of campaign exposure, and there appears to be a tendency for self‐reported voters to exaggerate the amount of campaign contact to which they are exposed. Similar problems afflict efforts to estimate the persuasive effects of campaign messages or communication within one's social network.
The second line of research on campaigns grew out of the work of Jacobson ( 1978 ), who pioneered the study of campaign spending and its effects on congressional election outcomes. In contrast to the survey‐based studies mentioned above, Jacobson's approach involved assembling a database in which each House or Senate election comprised an observation. The independent variables of central interest in his analysis were expenditures by challengers and incumbents; by estimating the translation of money into votes, Jacobson's analysis addressed policy debates about campaign finance reform while at the same time speaking to the broader social science question of how voters form preferences about candidates. This line of research, however, became deadlocked over the question of whether reliable inferences could be drawn. Green and Krasno ( 1988 ), Levitt ( 1994 ), and Erikson and Palfrey ( 1998 ) each advanced critiques suggesting that regression analysis could be biased if the amount that candidates spend is a marker for unobserved factors that affect election outcomes. Incumbents, for example, may raise and spend more money when faced with a talented and well‐connected challenger. If incumbents in general spend more when unmeasured factors make them more vulnerable, the analyst might underestimate the causal influence of incumbent spending on the incumbent's vote share. Each of the aforementioned authors advances a different statistical approach for grappling with this issue, but each model imposes its own set of assumptions. This literature came to a standstill when it became clear that different assumptions generated contradictory results: some authors found challenger spending to be influential; some found challenger and incumbent spending to be influential; and some found neither to be influential.
The third line of research uses laboratory experiments to assess the influence of campaign communications. Laboratory settings permit the researcher to randomly assign different kinds of campaign stimuli. Because randomly assigned campaign exposure is statistically independent of factors that might affect vote choice or behavior, laboratory experiments overcome one of the key impediments preventing survey researchers from drawing sound inferences about the causal influence of commercials and other forms of communication. Laboratory studies such as Ansolabehere and Iyengar ( 1995 ), Brader ( 2006 ), Iyengar, Peters, and Kinder ( 1982 ), Mendelberg ( 1997 ), and Mutz ( 1998 ) are outstanding examples of research that demonstrated the causal influence that televised news and commercials could have on public opinion and voting behavior. The limitations of lab research have to do with the extent to which results from the lab can be generalized to real world settings. Often, the subjects in laboratory experiments are drawn from the ranks of undergraduate classrooms; subjects are presented with the experimental communication in an unusual context (often a simulated living room on a college campus); and outcomes measures are survey responses gathered shortly after the stimulus is presented to the subject. These concerns raise the question of what laboratory results suggest about the effectiveness of an actual advertising campaign, in which the general population may be exposed to ads days before an election takes place.
Field experimental studies have brought a new level of precision to the study of campaign communication. In contrast to survey research, which typically categorizes campaign activity in very broad terms (“Did anyone from one of the political parties call you up or come around and talk to you about the campaign?”), experimental control enables the research to know what the communication was, who delivered it, and when. More importantly, the campaign intervention is randomly assigned and therefore unrelated to attributes that might predict the receiver's political attitudes and behavior. Although this virtue is also applicable to lab work, most field experiments have the advantage of measuring outcomes in an unobtrusive fashion so that participants remain unaware of the connection between the intervention and the outcome. When surveys are used to assess the effectiveness of campaigns, they are conducted so that neither the treatment nor control group is aware of the connection between the survey and the experimental intervention.
Interpersonal influence is another topic of broad concern to students of political behavior that has in recent years seen renewed use of experimental methods. Building on the earlier socialization studies of Jennings and Niemi ( 1974 , 1981 ), Huckfeldt and Sprague ( 1987 , 1995 ) pioneered the survey‐based investigation of how friends and family members influence each other's political views. Their methodological approach was to survey respondents and people with whom these respondents discussed politics, a methodology that rapidly spread to other studies of interpersonal influence (Mutz 1998 ). Huckfeldt and Sprague found that the correlation between discussion‐mates' political views persisted even after controlling for their background characteristics. These authors inferred that discussion itself caused the transmission of political views. However, the discussions themselves were neither observed nor randomly manipulated. Field experimental studies that have taken the Huckfeldt and Sprague findings as their point of departure have sought to test whether the correlation observed in these surveys reflects the causal influence of interpersonal communication per se , as opposed to unmeasured similarities between discussion‐mates.
What has been learned through field experimental investigation? Let us preface the answer by defining what we mean by learning. We take a Bayesian perspective and envision a learning process by which prior beliefs about causal parameters are updated in the wake of new findings in order to form posterior beliefs (see Gerber, Green, and Kaplan 2004 ). These beliefs may be described as distributions, so that at any point in time a researcher's beliefs may be characterized in terms of their location and dispersion. The mean of this distribution indicates what the researcher takes to be the expected value of the causal parameter; the wider the dispersion of these beliefs, the greater the researcher's uncertainty about the causal parameter. From this vantage point, learning is a matter of reducing uncertainty. Even if the mean of the prior and posterior distribution remains unchanged in the wake of new data, the narrowing of the distribution indicates that learning has occurred. Thus, we must be careful not to disparage experimental results as merely “telling us what we already know” if they substantially reduce our uncertainty.
Collective Action
With that in mind, the field experimental literature has shed light on four important propositions about the effects of campaigns on voting behavior and candidate choice. The first concerns collective action. The basic theoretical insight from formal analysis of collective action problems is this: pursuit of a collective goal will falter in situations where individuals can enjoy a collective outcome without incurring the private costs of bringing it about. In the context of an election, for example, a voter may strongly prefer to see a Republican presidential candidate elected; however, the chances of influencing the outcome are infinitesimal, and the success of the GOP candidate can be enjoyed regardless of whether the voter cast a ballot. Thus, the voter abstains rather than expend time and effort to cast a ballot. Unless people find voting intrinsically rewarding, only a small portion of the electorate casts ballots or, for that matter, engages in any kind of collective political action (Olson 1965 ).
From this theoretical vantage point, voter mobilization campaigns are predicted to influence voter turnout when they change the benefit–cost ratio. Merely imploring strangers to vote should have little effect on whether they cast ballots. And yet it does. Door‐to‐door canvassing has a powerful effect on voter turnout (Gerber and Green 2000 ; Green, Gerber, and Nickerson 2003 ; Michelson 2005 ). One interpretation is that mobilization by canvassers imparts information to voters about when and where to cast ballots. But contrary to this hypothesis, reminders to vote by professional phone banks on average have little effect on turnout (Gerber and Green 2005 ; Green and Gerber 2008 ; McNulty 2005 ; but see Nickerson 2007 ). The overall pattern of results is inconsistent with the standard logic of collective action insofar as turnout is stimulated by factors having nothing to do with the direct personal costs and benefits of casting a ballot.
Source Credibility and Persuasion
The persuasive influence of credible sources is a second major proposition that field experiments address. The extensive laboratory and survey literature on persuasion has long suggested that people readily take cues from trusted individuals and groups (Lupia 2000 ; Petty and Wegener 1998 ), particularly in the context of low‐salience elections in which information about the candidates is scarce. This proposition has recently been tested in various field contexts using campaign messages from party leaders and issue‐advocacy groups. The results suggest that such communications have a surprisingly limited role in shaping vote choice (Arceneaux and Kolodny 2009 ). Perhaps the most striking result comes from a field experiment in which the popular Republican governor of a solidly Republican state recorded phone messages directed at Republican voters targeted by the campaign as the governor's likely supporters. The messages endorsed a sitting Supreme Court justice who had been appointed by the governor, urging Republicans to vote for him in the upcoming GOP primary on the basis of his record as a “true conservative.” The experimental results, however, suggested that these messages had minimal effects on both vote choice and voter turnout (Gerber et al. 2007a ). Field experimental results, in other words, seem to underscore the difficulty of changing voters' minds through direct appeals, whereas studies conducted in laboratory settings and eliciting immediate survey responses from participants tend to find much stronger interactions between messages and credibility (Iyengar and Valentino 2000 ; Yoon, Pinkleton, and Ko 2005 ). The more muted effects observed in field experiments are consistent with the observation that aggregate public opinion seldom shows marked and enduring shifts in the wake of persuasive communications (Gaines, Kuklinski, and Quirk 2007 ).
The Effects of Campaign Spending on Election Outcomes
The first article to draw the link between field experimentation and the literature on campaign finance was Gerber ( 2004 ), which attempted to gauge the cost‐per‐vote from experiments and compare it to the cost‐per‐vote implied by previous observational studies. Gerber's own experiments looked at the cost‐effectiveness of partisan direct mail in congressional, state legislative, and mayoral contests, using voter turnout records to assess mobilization effects and post‐election surveys to measure persuasive effects on vote choice. Although these studies were limited to direct mail, they were conducted with both Democratic and Republican candidates and both incumbents and challengers. These studies suggest that campaign spending is much more effective for challengers than incumbents, consistent with the original claims of Jacobson ( 1978 ).
Why do challengers enjoy greater marginal returns from their campaign spending? One long‐standing hypothesis (Mann and Wolfinger 1980 ) is that challengers suffer from low name recognition, and voters are reluctant to vote for candidates whose names they cannot recognize. Through campaign expenditures, challengers can make rapid gains in name recognition, but incumbents cannot. The name‐recognition hypothesis has a number of testable implications, one being that publicizing the names of both incumbents and challengers in low‐salience elections has the net effect of benefiting challengers. Panagopoulos and Green ( 2008 ) tested this proposition using a series of radio advertisements. In randomly selected cities and towns where mayoral contests were being conducted in 2005 and 2006, Panagopoulos and Green placed radio advertisements that encouraged voter participation in the upcoming elections and mentioned the names of the leading candidates (without endorsing any of them). In both years, they found that towns in which these ads aired gave higher vote percentages to mayoral challengers. Like the Gerber ( 2004 ) findings, the Panagopoulos and Green ( 2008 ) results merit further experimentation, for it would be interesting to know how much of the effectiveness of campaign communication on behalf of challengers is due to augmented name recognition and how much is due to other factors, such as communicating the challenger's qualifications, policy stances, or endorsements. Nevertheless, field experiments can be credited with breathing new life into important research literatures.
Interpersonal Influence
The experimental study of interpersonal influence dates back to the 1950s, when Katz ( 1957 ) studied the diffusion of rumors. In recent years, research has used three experimental paradigms. The first was pioneered by Sacerdote ( 2001 ), who studied the effects of randomly assigned college roommates on grades and other academic outcomes. This line of research was extended to the effects of randomly assigned racial contact or racial priming cues on racial policy attitudes (Newswanger 1996 ; Valentino, Traugott, and Hutchings 2002 ; Van Laar et al. 2005 ). Nickerson ( 2004 ) extended this analysis still further, looking at the transmission of political attitudes among randomly‐assigned roommates and suitemates. Nickerson's findings challenge both the conclusions and methodology of the Huckfeldt and Sprague studies. The roommate study finds little or no transmission of political orientations or policy opinions, except for those topics that are especially salient to undergraduates, such as legalization of marijuana or the statutory drinking age. Nickerson also shows that the statistical analysis used by Huckfeldt and Sprague, when applied to the experimental roommate data, severely exaggerates the interpersonal transmission of attitudes.
A second line of interpersonal influence research was also pioneered by Nickerson, this time in the context of voter mobilization. Nickerson ( 2008 ), in what probably ranks as the most elegant experimental design used to date, studied the effects of a canvassing campaign in which canvassers alternated between a get‐out‐the‐vote script and a please‐recycle script. In both cases, canvassers targeted two‐voter households and communicated their script to the first person who came to the door. In keeping with prior turnout experiments, Nickerson finds that the get‐out‐the‐vote script raised turnout substantially (those who came to the door and were treated with the voter mobilization script were approximately 9 percentage‐points more likely to vote than those who came to the door and were encouraged to recycle). More importantly, Nickerson finds that the untreated voter in the households who were assigned to the voter mobilization script were substantially more likely to vote than their counterparts in the households assigned to the recycle condition. This result implies that those who heard the get‐out‐the‐vote appeal somehow transmitted its influence to their housemate.
A third approach to the study of social influence is to communicate varying messages, each representing somewhat different social psychological forces. One such study is Gerber, Green, and Larimer's ( 2008 ) study of the role of social pressure on voting. Gerber et al. test the hypothesis that the likelihood of voting increases when people are reminded of the norm of voting and convinced that others are monitoring whether they comply with this norm. Their experiment consists of five randomly assigned groups, a control group comprising 100,000 households and four treatment groups of 20,000 households apiece, each of which received one mailing. The first treatment group received mail encouraging them to vote on the grounds that voting is a civic duty. The next treatment group was encouraged to vote using a similar appeal but was further informed that researchers were monitoring whether they voted for academic purposes. This treatment was designed to measure the Hawthorne effect of openly studying a person's turnout. More social pressure was exerted in the third treatment group, which encouraged recipients to do their civic duty and vote but also presented household members with official records of whether they had voted in two prior elections. The treatment exerting maximal social pressure presented not only the household's official voting records but also the voting records of several neighbors. In the last two conditions, recipients were told that they would receive a follow‐up mailing indicating whether they (and their neighbors) voted. The results show a steady and dramatic increase in the effectiveness of each treatment as social pressure increases. The maximal social pressure condition raised turnout from 29.7 percent in the control group to 37.8 percent in the treatment group, an effect that rivals the effect of contact with a door‐to‐door canvasser. The finding that a single mailing can have explosive effects suggests the importance of surveillance to the enforcement of norms. The implication is that social pressure to conform to norms is one of the factors sustaining collective action.
Prospects and Limitations of Field Experimental Research
The recent turn toward experiments and quasi‐experiments reflects a growing sense among students of political behavior that the field had begun to reach the limits of what could be learned from observational research. Although observational studies supplied crucial descriptive information about the contours of public opinion, rates of political participation, subgroup differences, and changes over time, they meet with increasing skepticism from a social science community that has grown wary of inferences premised on untestable assumptions.
This pessimistic assessment of observational research methods has met resistance from those who believe that sophisticated statistical methods can resuscitate observational research. In recent years, scholars in economics (Dehejia and Wahba 1999 ) and political science (Imai 2005 ) have contended that methods such as propensity score matching enable observational researchers to closely approximate experimental results, thus sidestepping the practical and ethical challenges of experimentation. This argument set in motion a surge of observational research employing matching on topics such as the effects of deliberation on opinion change (Barabas 2004 ). However, the claim that matching provides reliable estimates of causal effects has drawn criticism outside of political science (Glazerman, Levy, and Myers 2003 ) and, increasingly, within it (Gerber and Green 2005 ). For example, Arceneaux, Gerber, and Green ( 2006 ) demonstrate that matching grossly misestimates the mobilizing effects of non‐partisan phone calls on voter turnout. Their field experiment involving over one million registered voters showed these calls to have negligible effects on voter turnout; reanalyzing the same data using matching suggested that the calls profoundly increased turnout.
This finding and others like it do not demonstrate that all matching exercises are doomed to fail, but they do call attention to a fundamental problem that besets all observational studies, even those that rely on sophisticated statistical techniques: it is extremely difficult to assess ex ante the adequacy of an observational study's key assumptions. A researcher can argue forcefully that a statistical technique eliminates bias only to find one's conclusions upended by an experiment. As Gerber, Green, and Kaplan ( 2004 ) demonstrate, it is the threat of bias that fundamentally alters the statistical precision of an observational study. The nominal standard errors that are reported by statistical software packages ignore altogether this source of uncertainty. Indeed, even if the sample sizes of an observational study were infinite, the uncertainty associated with its conclusions would not be reduced to zero because there remains uncertainty about whether unmeasured differences between those who received different treatments invalidate the conclusions. In sum, the advantages of experiments are not easily approximated via observational research and statistical technique.
The principal argument for observational research is that it enables scholars to study a broad class of causal questions, not just those that are amenable to experimental manipulation. The question is how to balance the magnitude of the research question against the difficulty of extracting reliable answers. One approach is to look for quasi‐experiments that speak more convincingly to broad‐ranging questions than a conventional observational study. Gentzkow's ( 2006 ) study of television's consequences for electoral participation is an outstanding example of this style of research. Taking advantage of the stop‐and‐start way in which broadcast licenses were granted over time, Gentzkow shows that as broadcast television entered different geographic areas, it caused a decline in radio and newspaper consumption, which in turn produced a decline in voter turnout that was especially pronounced in off‐year elections. Another approach is to conduct more ambitious field experiments. The scale and scope of field experimentation continues to grow. Until recently, it would have been unthinkable to experimentally manipulate a set of competing parties' campaign appeals (Wantchekon 2003 ) or millions of dollars in television ads aired on behalf of an incumbent governor (Gerber et al. 2007b ) or a nationwide campaign to hold legislators accountable to their constituents (Humphreys and Weinstein 2007 ).
One way to make field experiments more ambitious is to sharpen their theoretical focus. For example, research in social psychology has long argued that people conform to the views and behaviors of others, an argument of special relevance given recent interest in deliberative democracy (Fishkin 1997 ). The pressures of conformity could induce members of a minority to succumb to opinions expressed by a majority, regardless of the merit of those opinions (Mendelberg 2002 ). By randomly assigning individuals to discussion groups, Farrar et al. ( 2009 ) tested whether people assigned to more conservative or liberal discussion groups emerged with more conservative or liberal views and found that they did not. Findings such as these serve two functions. They speak to long‐standing propositions about political behavior in the context of small groups and present a challenge to laboratory experiments on conformity that have tended to rely on undergraduate subjects and have largely focused on non‐political decisions. A wide array of core propositions from social and cognitive psychology awaits experimental testing in political settings.
Another unexplored opportunity for field experimental research is the interaction between political elites and the mass public. Consider, for example, the domain of constituency service, which is said to bolster the incumbent's “personal vote” (Cain, Ferejohn, and Fiorina 1987 ). Apart from one relatively small field experiment looking at the effectiveness of franked mail (Cover and Brumberg 1982 ), scholars have not seized on opportunities to evaluate the impact of various facets of interaction between elected officials and their constituents. The number and timing of trips to the home district, actions on behalf of constituents who raise questions or request assistance, and initiatives designed to raise the visibility of a political issue all represent experimentally manipulable interventions that speak to the general question of whether constituents notice and reward legislative effort. Conversely, from the standpoint of the constituent one could evaluate the relationship between the attributes of those who request assistance or information from government officials and the nature of their response. Just as experiments are used to gauge discrimination by employers against those with putatively African American names (Bertrand and Mullainathan 2004 ), they could be used to assess whether constituents with different ethnic, age, class, gender, or partisan attributes receive different treatment.
The history of science suggests that significant advances often occur in the wake of new measurement technologies, such as the telescope or microscope. The experimental method represents this type of generative technology in the social sciences. Druckman et al. ( 2006 ) document the steep rise in experimental methods since the 1970s and the recent advent of field experimentation, noting the important substantive contributions that have been made during a relatively short period of time. But the benefits of the experimental method extend well beyond the specific research conducted to date. Experimental design forces researchers to state their hypotheses with greater clarity and often allows them to analyze the results more simply and transparently. Experimental procedures enable all researchers, not just those with a flair for statistical analysis, to draw unbiased inferences from data. And experiments conducted in the field draw the social scientist into the world of practitioners, where questions of cause and effect are of both immediate and scientific significance. Just as the challenges of civil engineering informed physics, the rigorous study of political interventions informs political science by providing a reliable empirical foundation from which theoretical propositions can be derived.
Angrist, J. D. 1990 . Lifetime Earnings and the Vietnam Era Draft Lottery: Evidence from Social Security Administrative Records. The American Economic Review , 80/3: 313–36.
Google Scholar
Ansolabehere, S. and Iyengar, S. 1995 . Going Negative: How Attack Ads Shrink and Polarize the Electorate . New York: Free Press.
Google Preview
Arceneaux, K. , Gerber, A. S. , and Green, D. P. 2006 . Comparing Experimental and Matching Methods using a Large‐Scale Voter Mobilization Experiment. Political Analysis , 14: 1–36.
—— and Kolodny, R. 2009. Educating the Least Informed: Group Endorsements in a Grassroots Campaign. American Journal of Political Science , 54/3.
Aronson, E. , Wilson, T. D. , and Brewer, M. B. 1998 . Experimentation in Social Psychology. In The Handbook of Social Psychology , ed. D. T. Gilbert , S. T. Fiske , and G. Lindzey. Boston: McGraw‐Hill.
Banerjee, A. and Duf Flo, E. 2006 . Addressing Absence. Journal of Economic Perspectives , 20/1: 117–32. 10.1257/089533006776526139
Barabas, J. 2004 . How Deliberation Affects Policy Opinions. American Political Science Review , 98/4: 687–701.
Bergan, D. 2007 . Does Grassroots Lobbying Work?: A Field Experiment Measuring the Effects of an e‐Mail Lobbying Campaign on Legislative Behavior. American Politics Research , 37/2: 327–52.
Bertrand, M. and Mullainathan, S. 2004 . Are Emily and Greg More Employable than Lakisha and Jamal? A Field Experiment on Labor Market Discrimination. The American Economic Review , 94/4: 991–1013. 10.1257/0002828042002561
Brader, T. 2006 . Campaigning for Hearts and Minds: How Emotional Appeals in Political Ads Work . Chicago: University of Chicago Press.
Brody, R. and Brownstein, C. 1975 . Experimentation and Simulation. In Handbook of Political Science , volume 7, ed. F. Greenstein and N. Polsby. Reading, Mass.: Addison‐Wesley.
Cain, B. , Ferejohn, J. , and Fiorina, M. 1987 . The Personal Vote: Constituency Service and Electoral Independence . Cambridge, Mass.: Harvard University Press.
Cook, T. D. and Campbell, D. T. 1979 . Quasi‐Experimentation: Design and Analysis Issues for Field Settings . Boston: Houghton‐Mifflin.
Cover, A. D. and Brumberg, B. S. 1982 . Baby Books and Ballots: The Impact of Congressional Mail on Constituent Opinion. American Political Science Review , 76: 347–59. 10.2307/1961114
Dehejia, R. and Wahba, S. 1999 . Causal Effects in Nonexperimental Studies: Reevaluating the Evaluation of Training Programs. Journal of the American Statistical Association , 94: 1053–62. 10.2307/2669919
Doherty, D. J. , Gerber, A. S. , and Green, D. P. 2006 . Personal Income and Attitudes toward Redistribution: A Study of Lottery Winners. Political Psychology , 27/3: 441–58. 10.1111/j.1467-9221.2006.00509.x
Druckman, J. N. , Green, D. P. , Kuklinski, J. H. , and Lupia, A. 2006 . The Growth and Development of Experimental Research in Political Science. American Political Science Review , 100: 627–35. 10.1017/S0003055406062514
Eldersveld, S. J. 1956 . Experimental Propaganda Techniques and Voting Behavior. American Political Science Review , 50: 154–65. 10.2307/1951603
Erikson, R. S. and Palfrey, T. R. 1998 . Campaign Spending and Incumbency: An Alternative Simultaneous Equations Approach. The Journal of Politics 60/2: 355–73. 10.2307/2647913
Farrar, C. , Green, D. P. , Green, J. E. , Nickerson, D. , and Shewfelt, S. 2009. Does Discussion Group Composition Affect Policy Preferences? Results from Three Randomized Experiments. Political Psychology , 30/4: 615–47.
Ferraz, C. and Finan, F. 2008 . Exposing Corrupt Politicians: The Effect of Brazil's Publicly Released Audits on Electoral Outcomes. Quarterly Journal of Economics , 123/2: 703–45. 10.1162/qjec.2008.123.2.703
Fisher, R. 1935 . Design of Experiments . New York: Hafner Publishing.
Fishkin, J. S. 1997 . The Voice of the People . New Haven, Conn.: Yale University Press.
Gaines, B. J. , Kuklinski, J. H. , and Quirk, P. J. 2007 . The Logic of the Survey Experiment Reexamined. Political Analysis , 15: 1–20. 10.1093/pan/mpl008
Gentzkow, M. 2006 . Television and Voter Turnout. The Quarterly Journal of Economics , 121/3: 931–72. 10.1162/qjec.121.3.931
Gerber, A. S. 2004 . Does Campaign Spending Work? Field Experiments Provide Evidence and Suggest New Theory. American Behavioral Scientist , 47/5: 541–74. 10.1177/0002764203260415
—— and Green, D. P. 2000 . The Effects of Canvassing, Direct Mail, and Telephone Contact on Voter Turnout: A Field Experiment. American Political Science Review , 94: 653–63. 10.2307/2585837
—— —— 2005 . Do Phone Calls Increase Turnout? An Update. The Annals of the American Academy of Political and Social Science , 601: 142–54. 10.1177/0002716205278445
—— —— and Kaplan, E. H. 2004 . The Illusion of Learning from Observational Research. In Problems and Methods in the Study of Politics , ed. I. Shapiro , R. Smith , and T. Massoud. New York: Cambridge University Press.
—— —— and Larimer, C. W. 2008 . Social Pressure and Voter Turnout: Evidence from a Large‐Scale Field Experiment. American Political Science Review , 102/1: 33–48.
—— Gimpel, J. G. , Green, D. P. , and Shaw, D. R. 2007 a. Do Robotic Calls from Credible Sources Influence Voter Turnout or Vote Choice? Evidence from a Randomized Field Experiment. Unpublished manuscript, Institution for Social and Policy Studies, Yale University.
—— —— —— —— 2007b. The Influence of Television and Radio Advertising on Candidate Evaluations: Results from a Large Scale Randomized Experiment. Presented at the Annual Meeting of the Midwest Political Science Association, Chicago, Ill.
Glaser, J. M. 2006 . Public Support for Political Compromise on a Volatile Racial Issue: Insight from the Survey Experiment. Political Psychology , 27/3: 423–39. 10.1111/j.1467-9221.2006.00508.x
Glazerman, S. , Levy, D. M. , and Myers, D. 2003 . Nonexperimental Versus Experimental Estimates of Earnings Impacts. The Annals of the American Academy of Political and Social Science , 589/1: 63–93. 10.1177/0002716203254879
Gosnell, H. F. 1927 . Getting‐out‐the‐vote: An Experiment in the Stimulation of Voting . Chicago: University of Chicago Press.
Green, D. P. and Gerber, A. S. 2008 . Get Out The Vote: How to Increase Voter Turnout , 2nd edn. Washington, D.C.: Brookings Institution Press.
—— and Krasno, J. S. 1988 . Salvation for the Spendthrift Incumbent: Reestimating the Effects of Campaign Spending in House Elections. American Journal of Political Science , 32: 884–907. 10.2307/2111193
—— and Leong, Y. Y., Kern, H. L., Gerber, A. S., and Larimer, C. W. 2009. Testing the Accuracy of Regression Discontinuity Analysis Using Experimental Benchmarks. Political Analysis , 17.
—— and Nickerson, D. W. 2003 . Getting Out the Vote in Local Elections: Results from Six Door‐to‐Door Canvassing Experiments. Journal of Politics , 65/4: 1083–96.
—— and Winik, D. 2010. Using Random Judge Assignments to Estimate the Effects of Incarceration and Probation on Recidivism among Drug Offenders. Criminology , 48.
Hartmann, G. W. 1936 –1937. Field Experiment on the Comparative Effectiveness of “Emotional” and “Rational” Political Leaflets in Determining Election Results. Journal of Abnormal Psychology , 31: 99–114. 10.1037/h0056079
Hastings, J. S. , Kane, T. J. , Staiger, D. O. , and Weinstein, J. M. 2007 . The Effect of Randomized School Admissions on Voter Participation. Journal of Public Economics , 91/5–6: 915–37. 10.1016/j.jpubeco.2006.11.007
Hovland, C. I. , Lumsdaine, A. A. , and Sheffield, F. D. 1949 . Experiments on Mass Communication . Princeton, N.J.: Princeton University Press.
Huber, G. A. and Arceneaux, K. 2007 . Identifying the Persuasive Effects of Presidential Advertising. American Journal of Political Science , 4: 957–77. 10.1111/j.1540-5907.2007.00291.x
—— and Gordon, S. C. 2004 . Accountability and Coercion: Is Justice Blind When It Runs for Office? The American Journal of Political Science , 48: 247–63.
Huckfeldt, R. and Sprague, J. 1987 . Networks in Context: The Social Flow of Political Information. The American Political Science Review , 81/4: 1197–216. 10.2307/1962585
—— —— 1995 . Citizens, Politics, and Social Communication: Information and Influence in an Election Campaign . New York: Cambridge University Press.
Humphreys, M. and Weinstein, J. M. 2007. Policing Politicians: Citizen Empowerment and Political Accountability in Africa. Presented at the annual meeting of the American Political Science Association, Chicago, Ill.
Imai, K. 2005 . Do Get‐Out‐the‐Vote Calls Reduce Turnout? The Importance of Statistical Methods for Field Experiments. American Political Science Review , 99/2: 283–300.
Iyengar, S. , Peters, M. D. , and Kinder, D. R. 1982 . Experimental Demonstrations of the “Not‐So‐Minimal” Consequences of Television News Programs. The American Political Science Review , 76/4: 848–58. 10.2307/1962976
—— and Valentino, N. A. 2000 . Who Says What? Source Credibility as a Mediator of Campaign Advertising. In Elements of Reason: Cognition, Choice, and the Bounds of Rationality , ed. A. Lupia , M. D. McCubbins , and S. L. Popkin. Cambridge: Cambridge University Press.
Jacobson, G. C. 1978 . The Effects of Campaign Spending in Congressional Elections. The American Political Science Review , 72/2: 469–91. 10.2307/1954105
Jennings, M. K. and Niemi, R. G. 1974 . The Political Character of Adolescence: The Influence of Families and Schools . Princeton, N.J.: Princeton University Press.
—— —— 1981 . Generations and Politics: A Panel Study of Young Adults and Their Parents . Princeton, N.J.: Princeton University Press.
Katz, E. 1957 . The Two‐Step Flow of Communication: An Up‐To‐Date Report on an Hypothesis. The Public Opinion Quarterly , 21/1: 61–78. 10.1086/266687
Kinder, D. R. and Palfrey, T. R. 1993 . Experimental Foundations of Political Science . Ann Arbor: University of Michigan Press.
Kling, J. R. , Liebman, J. B. , and Katz, L. F. 2007 . Experimental Analysis of Neighborhood Effects. Econometrica , 75/1: 83–119. 10.1111/j.1468-0262.2007.00733.x
Krasno, J. S. and D. P. Green. 2008 . Do Televised Presidential Ads Increase Voter Turnout? Evidence from a Natural Experiment. Journal of Politics , 70/1: 245–61.
Kremer, M. 2003 . The Contribution of Recent Innovations in Data Collection to Development Economics, Randomized Evaluations of Educational Programs in Developing Countries: Some Lessons. The American Economic Review , 93/2: 102–6.
La Londe, R. J. 1986 . Evaluating the Econometric Evaluations of Training Programs with Experimental Data. American Economic Review , 76: 604–20.
Lee, D. S. 2007 . Randomized Experiments from Non‐Random Selection in U.S. House Elections. Journal of Econometrics , 142: 675–97. 10.1016/j.jeconom.2007.05.004
Levitt, S. D. 1994 . Using Repeat Challengers to Estimate the Effect of Campaign Spending on Election Outcomes in the U.S. House. The Journal of Political Economy , 102/4: 777–98. 10.1086/261954
Lupia, A. 2000 . Who Can Persuade Whom?: Implications from the Nexus of Psychology and Rational Choice Theory. In Political Psychology , ed. J. H. Kuklinski. New York: Cambridge University Press.
Mann, T. and Wolf inger, R. 1980 . Candidates and Parties in Congressional Elections. American Political Science Review , 74: 617–32. 10.2307/1958145
McNulty, J. E. 2005 . Phone‐Based GOTV—What's on the Line? Field Experiments with Varied Partisan Components, 2002–2003. In “ The Science of Voter Mobilization, ” special ed. D. P. Green and A. S. Gerber , The Annals of the American Academy of Political and Social Science , 601: 41–65.
Mendelberg, T. 1997 . Executing Hortons: Racial Crime in the 1988 Presidential Campaign. The Public Opinion Quarterly , 61/1: 134–57. 10.1086/297790
—— 2002 . The Deliberative Citizen: Theory and Evidence. Political Decision Making, Deliberation, and Participation , 6: 151–93.
Michelson, M. R. 2005 . Meeting the Challenge of Latino Voter Mobilization. In “ The Science of Voter Mobilization. ” special ed. D. P. Green and A. S. Gerber , The Annals of the American Academy of Political and Social Science 601: 85–101.
Miller, J. M. and Krosnick, J. A. 2004 . Threat as a Motivator of Political Activism: A Field Experiment. Political Psychology , 25/4: 507–23. 10.1111/j.1467-9221.2004.00384.x
Mutz, D. C. 1998 . Impersonal Influence: How Perceptions of Mass Collectives Affect Political Attitudes . New York: Cambridge University Press.
Newswanger, J. F. 1996 . The Relationship between White Racial Identity Attitudes and the Experience of Having a Black College Roommate. Journal of College Student Development , 37/5: 536–42.
Nickerson, D. W. 2004 . Measuring Interpersonal Influence . Ph.D. dissertation, Department of Political Science, Yale University.
—— 2007 . Quality is Job One: Professional and Volunteer Voter Mobilization Calls. American Journal of Political Science , 51/2: 269–82. 10.1111/j.1540-5907.2007.00250.x
—— 2008 . Is Voting Contagious? Evidence from Two Field Experiments. American Political Science Review , 102/1: 49–57.
Olson, M. 1965 . The Logic of Collective Action: Public Goods and the Theory of Groups . Cambridge, Mass.: Harvard University Press.
Paluck, E. L. 2009. Reducing Intergroup Prejudice and Conflict Using the Media: A Field Experiment in Rwanda. Journal of Personality and Social Psychology , 96: 574–87.
Panagopoulos, C. and Green, D. P. 2008 . Field Experiments Testing the Impact of Radio Advertisements on Electoral Competition. American Journal of Political Science , 52/1: 156–68. 10.1111/j.1540-5907.2007.00305.x
Pettersson ‐ Lidbom, P. 2004 . Does the Size of the Legislature Affect the Size of Government? Evidence from Two Natural Experiments. Unpublished manuscript, Department of Economics, Stockholm University.
Petty, R. E. and Wegener, D. T. 1998 . Attitude Change: Multiple Roles for Persuasion Variables. In Handbook of Social Psychology , 4th edn., volume 2, ed. D. T. Gilbert , S. T. Fiske , and G. Lindzey. New York: McGraw‐Hill.
Rosenstone, S. J. and Hansen, J. M. 1993 . Mobilization, Participation, and Democracy in America . New York: MacMillan Press.
Sacerdote, B. 2001 . Peer Effects with Random Assignment: Results for Dartmouth Roommates. Quarterly Journal of Economics , 116/2: 681–704. 10.1162/00335530151144131
Sears, D. O. 1986 . College Sophomores in the Laboratory: Influences of a Narrow Database on Social‐Psychology View of Human Nature. Journal of Personality and Social Psychology , 51/3: 515–30. 10.1037/0022-3514.51.3.515
Sherman, L. W. and Berk, R. A. 1984 . The Specific Deterrent Effects of Arrest for Domestic Assault. American Sociological Review , 49: 261–72. 10.2307/2095575
—— and Rogan, D. P. 1995 . Deterrent Effects of Police Raids on Crack Houses: A Randomized, Controlled Experiment. Justice Quarterly , 12/4: 755–81. 10.1080/07418829500096281
Tomz, M. 2007 . Domestic Audience Costs in International Relations: An Experimental Approach. International Organization , 61: 821–40.
Valentino, N. A. , Traugott, M. W. , and Hutchings, V. L. 2002 . Group Cues and Ideological Constraint: A Replication of Political Advertising Effects Studies in the Lab and in the Field. Political Communication , 19: 29–48. 10.1080/105846002317246470
Van Laar, C. , Levin, S. , Sinclair, S. , and Sidanius, J. 2005 . The Effect of University Roommate Contact on Ethnic Attitudes and Behavior. Journal of Experimental Social Psychology , 41/4: 329–45. 10.1016/j.jesp.2004.08.002
Waldfogel, J. 1994 . Does Conviction Have a Persistent Effect on Income and Employment? International Review of Law and Economics , 14: 103–19. 10.1016/0144-8188(94)90039-6
Wantchekon, L. 2003 . Clientelism and Voting Behavior. Evidence from a Field Experiment in Benin. World Politics , 55/3: 399–422. 10.1353/wp.2003.0018
Yoon, K. , Pinkleton, B. , and Ko, W. 2005 . Effects of Negative Political Advertising on Voting Intention: An Exploration of the Roles of Involvement and Source Credibility in the Development of Voter Cynicism. Journal of Marketing Communications , 11/2: 95–112. 10.1080/1352726042000315423
- About Oxford Academic
- Publish journals with us
- University press partners
- What we publish
- New features
- Open access
- Institutional account management
- Rights and permissions
- Get help with access
- Accessibility
- Advertising
- Media enquiries
- Oxford University Press
- Oxford Languages
- University of Oxford
Oxford University Press is a department of the University of Oxford. It furthers the University's objective of excellence in research, scholarship, and education by publishing worldwide
- Copyright © 2024 Oxford University Press
- Cookie settings
- Cookie policy
- Privacy policy
- Legal notice
This Feature Is Available To Subscribers Only
Sign In or Create an Account
This PDF is available to Subscribers Only
For full access to this pdf, sign in to an existing account, or purchase an annual subscription.
IMAGES
VIDEO
COMMENTS
Aug 26, 2013 · This archive features replication data from dozens of field experiments conducted by Yale researchers, dating back to 2000. Inter-university Consortium for Political and Social Research (ICPSR) . The largest social science data archive in the world contains replication data from several prominent field experiments in domains such as criminology ...
PART II THE DEVELOPMENT OF EXPERIMENTS IN POLITICAL SCIENCE; 6 Laboratory Experiments in Political Science; 7 Experiments and Game Theory's Value to Political Science; 8 The Logic and Design of the Survey Experiment; 9 Field Experiments in Political Science; PART III DECISION MAKING; PART IV VOTE CHOICE, CANDIDATE EVALUATIONS, AND TURNOUT; PART ...
in developing countries.2 In this chapter we primarily consider experiments related to those political institutions that determine the extent to which citizens can control their leaders and the political process.3 We focus on eld experiments as an increasingly popular research approach that has exciting potential yet notable limitations.
1Department of Political Science, Columbia University, New York, New York 10027; email: [email protected] 2Department of Political Science, Stanford University, Stanford, California 94305; email: [email protected] Annu. Rev. Polit. Sci. 2009.12:367–78 The Annual Review of Political Science is online at polisci.annualreviews.org This ...
7 Experiments and Game Theory’s Value to Political Science 89 John H. Aldrich and Arthur Lupia 8 The Logic and Design of the Survey Experiment: An Autobiography of a Methodological Innovation 102 Paul M. Sniderman 9 Field Experiments in Political Science 115 Alan S. Gerber PART III: DECISION MAKING 10 Attitude Change Experiments in Political ...
First, it briefly outlines the history of field experimentation in political science and neighboring disciplines. It then summarizes a series of important and interrelated research literatures, exploring the influences of political campaigns, political communication, and political socialization.
science. RCT researchers do not come to sweeping conclusions about the potential impact of a program based on any single experiment. Instead, each experiment is like a dot on a pointillist painting: on its own it does not mean much, but the accu-mulation of experimental results eventually paints a picture that helps make sense
Not a single field experiment was published in any political science journal in the decade pre-ceding 1998, when field experimentation began to make a comeback. The first voting experiments, examining the impact of mail, telephoning, and canvassing on turnout, had been conducted but not yet published (Gerber and Green 2000). The next wave of ...
Dec 23, 2019 · Field experiments are now common in the political science literature. Many of these experiments are randomized controlled trials or program evaluations, in which researchers randomize interventions by governments or aid organizations to determine the effects of these policies on desired outcomes.
Jan 6, 2017 · Field experiments -- randomized controlled trials -- have become ever more popular in political science, as well as in other disciplines, such as economics, social policy and development.