李晓倩

• 1:华中科技大学公共管理学院

摘要(Abstract)：

近年来公共管理的实验研究迅速崛起,但同时不少学者对于实验方法在公共管理研究领域的应用仍然存在质疑。本文针对实验方法的外部效度困境以及有关实验方法优劣势的认知偏差和误区进行了系统分析。这些分析表明,外部效度对实验研究而言是一个需要回答的问题而非一个标准;实验研究的非现实性有其存在的合理性,而其推广性则主要体现在理论的推广而非研究发现的推广上;对于外部效度的质疑主要针对个别类型的实验方法,不同类型的实验方法有其各自的优劣势;人们对于实验方法优劣势的模糊认知主要来自不同程度的知识盲点和角度差异。

关键词(KeyWords)： 实验方法;外部效度;现实性;推广性;实验类型

Abstract:

Keywords:

基金项目(Foundation): 国家自然科学基金面上项目“动态交互式政策实验方法对改进公共政策制定效果的实证研究”(项目批准号:71573153);; 教育部人文社会科学青年基金项目“基于社会影响力债券的我国政府购买社会服务创新机制研究:以政府购买预防型服务为例”(项目批准号:18YJC630078);; 北京市自然科学基金青年项目“社会影响力债券对于改善北京市购买预防性社会服务的研究:基于动态式模型分析-实验方法”(项目批准号:9184025)资助

作者(Author): 李晓倩

参考文献(References)：

• 耿曙,余莎,孔晏.2016.实验方法在公共政策研究中的应用---以纳税遵从为例[J].公共政策与评论,5(3):45-52.Geng S,Yu S,Kong Y.2016.Studying public policy with experimental methods-Lessons from a tax compliance experiment[J].Public Administration And Policy Review,5(3):45-52.(in Chinese)
• 景怀斌.2015.专栏导语:强化公共管理实验研究的几个问题[J].公共行政评论,8(3):120-125.Jing H B.2015.Editor's notes:Several issues to experimental methods in public administraiton research[J].Journal of Public Administration,8(3):120-125.(in Chinese)
• 李文钊.2018.面向中国的公共管理学:缘起、路径与展望[J].探索,(6):37-49.Li W Z.2018.Chinese public management:Reason,path and prospect[J].Probe,(6):37-49.
• 李晓倩,吕孝礼,徐浩,等.2017.国外公共管理实验研究的进展与启示[J].公共管理评论,(2):16-34.Li X Q,LüX L,Xu H,et al.2017.A systematic review of foreign experimental studies in public administration[J].China Public Administration Review,(2):16-34.(in Chinese)
• 李晓倩.2018.行为公共管理学实验:基于SSCI期刊(1978-2016)相关文献的分析[J].公共行政评论,11(1):37-61.Li X Q.2018.Experimental research in behavioral public administration:An analysis of related literature based on SSCI-indexed journals(1978-2016)[J].Journal of Public Administration,11(1):37-61.(in Chinese)
• 陆方文.2017.随机实地实验:方法、趋势和展望[J].经济评论,(4):149-160.Lu F W.2017.Randomized field experiment:Method,trend and prospect[J].Economic Review,(4):149-160.(in Chinese)
• 马亮.2015.公共管理实验研究何以可能:一项方法学回顾[J].甘肃行政学院学报,(4):13-23.Ma L.2015.How to use experimental methods in public administration research:Amethodological review[J].Journal of Gansu Administration Institute,(4):13-23.(in Chinese)
• 王思琦.2018.公共管理与政策研究中的实地实验:因果推断与影响评估的视角[J].公共行政评论,11(1):87-107.Wang S Q.2018.Field experiments in research of public administration and public policy:Causal inference and impact evaluation[J].Journal of Public Administration,11(1):87-107.(in Chinese)
• 余莎,游宇.2017.不操纵无因果:实验政治学几个核心的方法论问题[J].甘肃行政学院学报,(2):53-66.Yu S,You Y.2017.No causation without manipulation:The fundamental methodological questions in experimental political science[J].Journal of Gansu Administration Institute,(2):53-66.(in Chinese)
• 岳经纶,张虎平.2019.实验方法在公共管理研究中的应用:基于PAR和JPART两种期刊(2010-2017)的文献分析[J].中国公共政策评论,15(2):39-59.Ngok K,Zhang H P.2019.Application of experimental methods in public management research:Literature analysis from 2010 to 2017 in PAR and JPART[J].Chinese Public Policy Review,15(2):39-59.(in Chinese)
• 张书维,李纾.2018.行为公共管理学探新:内容、方法与趋势[J].公共行政评论,11(1):7-36.Zhang S W,Li S.2018.Exploring behavioral public administration:Content,method and trend[J].Journal of Public Administration,11(1):7-36.(in Chinese)
• 张书维,许志国.2018.行为公共管理学视角下政府决策的互动机制---基于环境型项目的分析[J].中国行政管理,(12):59-65.Zhang S W,Xu Z G.2018.Interaction mechanism of public decision-making from the behavioral public administration perspective-An analysis based on environmental projects[J].Chinese Public Administration,(12):59-65.(in Chinese)
• 张书维,梁歆佚,岳经纶.2019.行为社会政策:“助推”公共福利的实践与探索[J].心理科学进展,27(3):429-438.Zhang S W,Liang X Y,Yue J L.2019.Behavioral social policy:Nudge in the practice and exploration of public welfare[J].Advances in Psychological Science,27(3):429-438.(in Chinese)
• Aguinis H,Bradley K J.2014.Best practice recommendations for designing and implementing experimental vignette methodology studies[J].Organizational Research Methods,17(4):351-371.
• Alm J,Bloomquist K M,Mc Kee M.2015.On the external validity of laboratory tax compliance experiments[J].Economic Inquiry,53(2):1170-1186.
• Al-Ubaydli O,List J A.2015.Do natural field experiments afford researchers more or less control than laboratory experiments?[J].American Economic Review,105(5):462-466.
• Baker M.2016.Is there a reproducibility crisis?[J].Nature,533:452-454.
• Berkowitz L,Donnerstein E.1982.External validity is more than skin deep:Some answers to criticisms of laboratory experiments[J].American Psychologist,37(7):245-257.
• Bertrand M,Mullainathan S.2004.Are emily and greg more employable than lakisha and jamal?A field experiment on labor market discrimination[J].American Economic Review,94(4):991-1013.
• Camerer C.[2019-10-06].The promise and success of lab-field generalizability in experimental economics:A critical reply to levitt and list[EB/OL].(2011-11-30).https://ssrn.com/abstract=1977749.
• Campbell D T,Stanley J C.1966.Experimental and quasi-experimental designs for research[M].Chicago,IL:Rand Mc Nally.
• Carlsmith J M,Ellsworth P C,Aronson E.1976.Methods of research in social psychology[M].Reading,Mass:Addison-Wesley.
• Chen J D,Pan J,Xu Y Q.2016.Sources of authoritarian responsiveness:A field experiment in China[J].American Journal of Political Science,60(2):383-400.
• Collaboration O S.2015.Estimating the reproducibility of psychological science[J].Science,349(6251):aac4716.
• Dipboye R L,Flanagan M F.1979.Research settings in industrial and organizational psychology:Are findings in the field more generalizable than in the laboratory?[J].American Psychologist,34(2):141-150.
• Druckman J N,Kam C D.2011.Students as experimental participants:A defense of the“Narrow Data Base”[M]//Druckman J N,Green D P,Kuklinski J H,et al.Cambridge Handbook of Experimental Political Science.New York:Cambridge University Press.
• Duflo E,Glennerster R,Kremer M.2007.Using randomization in development economics research:A toolkit[J].Handbook of Development Economics,(4):3895-3962.
• Dyer D,Kagel J H,Levin D.1989.A comparison of naive and experienced bidders in common value offer auctions:A laboratory analysis[J].The Economic Journal,99(394):108-115.
• Eriksson S,Rooth D O.2014.Do employers use unemployment as a sorting criterion when hiring?Evidence from a field experiment[J].American Economic Review,104(3):1014-1039.
• Falk A,Heckman J J.2009.Lab experiments are a major source of knowledge in the social sciences[J].Science,326(5952):535-538.
• Grimmelikhuijsen S,Jilke S,Olsen A L,et al.2017.Behavioral public administration:Combining insights from public administration and psychology[J].Public Administration Review,77(1):45-56.
• Harrison G W,List J A.2004.Field experiments[J].Journal of Economic Literature,42(4):1009-1055.
• James O,Jilke S,Van Ryzin G G.2017.Experiments in public management research:Challenges and contributions[M].Cambridge:Cambridge University Press.
• Kam C D,Wilking J R,Zechmeister E J.2007.Beyond the“Narrow Data Base”:Another convenience sample for experimental research[J].Political Behavior,29(4):415-440.
• Kim S H,Kim S.2016.Social desirability bias in measuring public service motivation[J].International Public Management Journal,19(3):293-319.
• Kruglanski A W.1975.The human subject in the psychology experiment:Fact and artifact[J].Advances in Experimental Social Psychology,(8):101-147.
• Levitt S D,List J A.2007a.What do laboratory experiments measuring social preferences reveal about the real world?[J].Journal of Economic Perspectives,21(2):153-174.
• Levitt S D,List J A.2007b.Viewpoint:On the generalizability of lab behaviour to the field[J].Canadian Journal of Economics,40(2):347-370.
• Levitt S D,List J A.2009.Field experiments in economics:The past,the present,and the future[J].European Economic Review,53(1):1-18.
• Margetts H Z.2011.Experiments for public management research[J].Public Management Review,13(2):189-208.
• Mc Dermott R.2002.Experimental methods in political science[J].Annual Review of Political Science,(5):31-61.
• Mook D G.1983.In defense of external invalidity[J].American Psychologist,38(4):379-387.
• Morton R B,Williams K C.2010.Experimental political science and the study of causality:From nature to the lab[M].Cambridge:Cambridge University Press.
• Plott C R.1982.Industrial organization theory and experimental economics[J].Journal of Economic Literature,20(4):1485-1527.
• Plott C R.1986.Laboratory experiments in economics:The implications of posted-price institutions[J].Science,232(4751):732-738.
• Plott C R.1987.Dimensions of parallelism:Some policy applications of experimental methods[M]//Roth A E.Laboratory experimentation in economics:Six points of view.New York:Cambridge University Press,193-229.
• Sears D O.1986.College sophomores in the laboratory:Influences of a narrow data base on social psychology's view of human nature[J].Journal of Personality and Social Psychology,51(3):515-530.
• Shaughnessy J J,Zechmeister E B,Zechmeister J S.2003.Research methods in psychology[M].Boston:Mc Graw-Hill.
• Shogren J F,Fox J A,Hayes D J,et al.1999.Observed choices for food safety in retail,survey,and auction markets[J].American Journal of Agricultural Economics,81(5):1192-1199.
• Tsang E W K,Kwan K M.1999.Replication and theory development in organizational science:A critical realist perspective[J].Academy of Management Review,24(4):759-780.
• Voorberg W,Jilke S,Tummers L,et al.2018.Financial rewards do not stimulate coproduction:Evidence from two experiments[J].Public Administration Review,78(6):864-873.
• Walker R M,James O,Brewer G A.2017.Replication,experiments and knowledge in public management research[J].Public Management Review,19(9):1221-1234.
• Webster M,Sell J.2007.Laboratory experiments in the social sciences[M].Amsterdam:Elsevier.
• Yong E.2012.Replication studies:Bad copy[J].Nature,485(7398):298-300.
• (1)该书的内容最早出现在Handbook of Research on Teaching(1963)一书的“Experimental and quasiexperimental designs for research on teaching”一章中。
• (1)可复制性是指一项实验研究的发现能否在其他研究中重复发现,推广性是指一项研究的发现能否应用到更广的群体和情境中,二者存在一定的差异。