I am a Research Psychologist in the IntelliMedia Group within the Department of Computer Science at North Carolina State University. I have a Ph.D. in Human Factors Psychology from Old Dominion University. My research uses principles theories and methods of applied psychology (human factors, industrial/organizational, experimental, psychometrics) to design and evaluate the impact of next generation learning technologies on learning and performance. I am particularly interested in adaptive training techniques, performance assessment and measurement, user modeling, and human-automation interaction.

Prior to joining the IntelliMedia Group in 2017, I served as a research psychologist for the U.S. Army Research Institute for the Behavioral and Social Sciences (ARI) where I conducted research on emerging training technologies, including intelligent tutoring systems and game-based learning environments, to support Soldier training. More recently, I served as a research psychologist at RTI International where I led a multiyear effort to validate cognitive and noncognitive predictors of job performance for the Transportation Security Administration.

I have published my research in several peer-reviewed journals, including Military Psychology, Cognitive Technology, and Ergonomics. I have also coauthored several book chapters on design applications for intelligent tutoring systems and next generation learning technologies. I currently serves as an associate editor for Military Psychology and have received recognition for my research from the Human Factors and Ergonomics Society and the National Training and Simulation Association.

I’m a Virginia native and have a bachelor’s degree in Industrial/Organizational Psychology with a minor in Education from Christopher Newport University. In graduate school, I worked with Dr. James Bliss studying human trust in automation. We also examined the affordances of using game-based technologies to facilitate distributed training for dismounted infantry tasks. My interest in adaptive training and intelligent tutoring systems was cultivated during my time at ARI during which I worked on several research projects that aimed to increase training effectiveness and efficiency by providing personalized instruction.

Education
Ph.D., Human Factors Psychology (2009)
Old Dominion University, Norfolk, VA

M.S., Experimental Psychology (2006)
Old Dominion University, Norfolk, VA

B.A., Psychology with Honors (2003)
Christopher Newport University, Newport News, VA

Honors
Best Paper Award, Education Subcommittee – I/ITSEC, 2019

Best Paper Award, Education Subcommittee – I/ITSEC, 2013

Best Paper Award (Honorable Mention) – HFES Cognitive Engineering and Decision Making Technical Group, 2009

Best Paper Award – HFES Perception and Performance Technical Group, 2007

Department Scholar Award for Industrial/Organizational Psychology, Christopher Newport University, 2003

Alpha Chi National College Honor Society, 2003

Book Chapters
Katz, I. R., LaMar, M. M., Spain, R. D., Zapata-Rivera, J. D., Baird, J., & Greiff, S. (2017). Validity Issues and Concerns for Technology Based Performance Assessments. In Design Recommendations for Intelligent Tutoring Systems: Volume 5 – Assessment Methods, Sottilare, R., Graesser, A., Hu, X., and Goodwin, G.. (Eds.), pp. 209-224, U.S. Army Research Laboratory, Orlando, Florida, 2017.

Spain, R. D., Hedge, J. W., & Ladd, K. M. (2015). An examination of visual search success for transportation security officers and behavior detection officers. In D. D. Schmorrow, C. M. Fidopiastis, (Eds.), Foundations of Augmented Cognition. (pp. 817–824). Lecture Notes in Artificial Intelligence. Cham, Switzerland: Springer International.

Wisher, R. A., Brusso, R. C., Curnow, C. K., Hatfield, J., Paddock, A., & Spain, R. D. (2015). Formulating best practices and guidelines for emerging e-Learning technologies. In. B. H. Khan & M. Ally (Eds.), International handbook of e-learning volume 1: Theoretical perspectives and research. (pp. 127–137). New York, NY: Routledge. doi: 10.4324/9781315760933.ch8.

Goldberg, B. & Spain, R. D. (2014). Creating the intelligent novice: Supporting self-regulated learning and metacognition in educational technology. In R. Sottilare, A. Graesser, X. Hu, & B. Goldberg (Eds.), Design recommendations for intelligent tutoring systems, volume 2: Instructional management (pp. 109–134). Orlando, FL: U.S. Army Research Laboratory.

Durlach, P. J., & Spain, R. D. (2012). Framework for instructional technology. In V. G. Duffy (Ed.), Advances in Applied Human Modeling and Simulation (pg. 222-231). Boca Raton, FL: CRC Press, Taylor and Francis Group.

Journal Articles
Spain, R. D., Priest, H. A., & Murphy, J. S. (2012). Current trends in adaptive training with military applications: An introduction to supplemental issue on adaptive training. Military Psychology, 24, 87-95. (Served as guest editor for supplemental issue.) doi:http://dx.doi.org/10.1080/08995605.2012

Bliss, J. P., Spain, R. D., Bustamante, E. A., & Fallon, C. K. (2011). Temporal persistence of alarm reaction intentions. Cognitive Technology.

Spain, R. D., & Bliss, J. P. (2008). The effects of sonification pulse rate and reliability on operator workload and trust during a simulated patient-monitoring task. Ergonomics, 51, 1320-1337.

Conference Papers
Spain, R.D., Hedge, J. W., Blanchard, J. K. (2017). Examining predictors of visual search success in Transportation Security Officers and Behavior Detection Officers. In Proceedings of the 61st annual meeting of the Human Factors and Ergonomics Society (pp.). Austin, TX: Sage Publication.

Spain, R. D., Mulvaney, R. H., Cummings, P., Barnieu, J., Hyland, J., Lodato, M. A., & Zoellick C. (2013). Enhancing soldier-centered learning with emerging technologies and integrated assessments. Proceedings of the Interservice/Industry Training, Simulation and Education Conference (I/ITSEC) (pp. 1423–1434). Orlando, FL: National Training and Simulation Association. (Best Paper – Education Subcommittee)

Menaker, E. S., & Spain, R. D. (2013). Mobile learning anytime, anywhere: But why and how? Proceedings of the Interservice/Industry Training, Simulation and Education Conference (I/ITSEC) (pp. 1497–1508). Orlando, FL: National Training and Simulation Association.

Spain, R. D. (2010). A game-based training application to support the development of commanders’ skills in counterinsurgency operations. In Proceedings of the 54th annual meeting of the Human Factors and Ergonomics Society (pp. 2274-2278). San Francisco, CA: Sage Publication. doi: 10.1177/154193121005402712.

Spain, R. D., & Bliss, J. P. (2009). The effects of automation expertise and system confidence on trust behaviors. In Proceedings of the 53rd annual meeting of the Human Factors and Ergonomics Society (pp. 344-348). San Antonio, TX: Sage Publication. doi: 10.1177/154193120905300438. (Best Paper – Honorable Mention, CEDM Technical Group)

Spain, R. D., & Madhavan, P. (2009). The role of automation etiquette and pedigree in automation trust and dependence. In Proceedings of the 53rd annual meeting of the Human Factors and Ergonomics Society (pp. 339-343). San Antonio, TX: Sage Publication. doi: 10.1177/154193120905300437

Spain, R. D., Bustamante, E. A., & Bliss, J. P. (2008). Towards an empirically developed scale for system trust: Take two. In Proceedings of the 52nd annual meeting of the Human Factors and Ergonomics Society (pp. 1335-1339). New York: Sage Publication. doi: 10.1177/154193120805201907.

Spain, R. D., Bliss, J. P., & Newlin, E. T. (2008). A multilevel analysis of operator trust in sonification systems. Poster presented at the 23rd annual conference of the Society for Industrial and Organizational Psychology, San Francisco, CA.

Bustamante, E. A., & Spain, R. D. (2008). Measurement invariance of the NASA-TLX. In Proceedings of the 52nd annual meeting of the Human Factors and Ergonomics Society (pp. 1522-1526). New York: Sage Publication.

Hansberger, J. T., Schreiber, C., & Spain, R. D. (2008). Analysis of C2 distributed cognition. Paper presented at the 13th International Command and Control Research and Technology Symposium, Bellevue, WA.

Spain, R. D., Bliss, J. P., & Newlin, E. T. (2007). The effect of sonification pulse rate on perceived urgency and response behaviors. In the Proceedings: 51st annual meeting of the Human Factors and Ergonomics Society, pp. 116-120. Baltimore, MD. Sage Publication. (Best Paper Winner – PPTG)

Bliss, J. P., & Spain, R. D. (2007). Sonification and reliability – implications for signal design. In Proceedings of the 13th International Conference on Auditory Display (Montreal, Canada). pp. 154-159.

Symposium and Workshop Papers
Spain, R. D., & Madhavan, P. (2009). Automation etiquette: Shaping users’ perceived reliability of automation. Paper presented at the 82nd annual meeting of the Virginia Social Science Association, Petersburg, VA.

Bustamante, E. A., Spain, R. D., & Bliss, J. P. (2007). A multilevel analysis of pilots’ situation awareness during weather threats as a function of distance, workload, and rank. Poster presented at the 22nd annual conference of the Society for Industrial and Organizational Psychology, New York, NY.

Bustamante, E. A., Spain, R. D., Newlin, E. T., & Bliss, J. P. (2007). Superiority of the a-b signal detection theory model over the classical signal detection theory model. Poster presented at the American Psychological Association Divisions 19 & 21 midyear symposium, Fairfax, VA.

Bustamante, E. A., Bailey, N. R., Spain, R. D., Fallon, C. K., Newlin, E. T., & Bliss, J. P. (2006). An examination of the psychometric properties of the NASA TLX. Poster presented at the American Psychological Association Divisions 19 & 21 midyear symposium, Fairfax, VA.

Spain, R. D., Gaskins, R. C., Boone, C. M. (2006). Using the Ravens Progressive Matrix as an indicator of knowledge building requirements. Poster presented at the 15th annual conference on Behavior Representation in Modeling and Simulation, Baltimore, MD.

Gaskins, R. C., Spain, R. D., Boone, C. M., Bryan, D. (2006). PMFserv psychological and software engineering analysis. Poster presented at the 15th annual conference on Behavior Representation in Modeling and Simulation, Baltimore, MD, May 16-17.

Gaskins, R. C., Cuper, T. T., Hansberger, J. T., Spain, R. D., Harris, K. K., & Ishom, W. (2006). Serious gaming for understanding the influence of advance organizers on adaptive strategies to support effects based approach to operations. Poster presented at the 15th annual conference on Behavior Representation in Modeling and Simulation Annual Conference, Baltimore, MD.

Spain, R. D., Bliss, J. P. (2005). Alarm mistrust: The effect of attention and workload on alarm confidence ratings. Paper presented at the annual meeting of the Virginia Psychological Association, Williamsburg, VA.