CURRICULUM VITAE, 1.1.2023

Roman Bednarik, PhD.
School of Computing, University of Eastern Finland, P.O. Box 111, FIN-80101, Finland
roman.bednarik@uef.fi http://cs.uef.fi/~rbednari
https://orcid.org/0000-0003-1726-3520
Education, Academic titles and degrees
2012: Docent (dosentti), April 2012, Interactive technologies, University of Eastern Finland. 2003 - 2007: Doctor of Philosophy, December 19th, 2007. Department of Computer Science and Statistics, University of Joensuu, Finland. Title of the thesis: Methods to analyze visual attention strategies: Applications in the studies of programming. Supervisor: prof. Markku Tukiainen.  
2006: Licentiate of Philosophy, May 2006, Dept. of Computer Science, University of Joensuu, Finland. Title of the thesis: Towards an Eye-tracking Methodology for Studies of Programming
2002: Master of Science in Computer Science, Dept. of Computer Science, University of Joensuu, Finland
Current position
2023 - : professor, University of Eastern Finland
Previous professional appointments
2019 - 2022: associate professor, University of Eastern Finland
2012 - 12/2018: senior researcher, University of Eastern Finland
2018/07-08: University of Alberta, CAN, visiting professor
2014/07 - 2014/09: Seikei University, Japan, visiting researcher
2010 - 2013: University of Eastern Finland, post-doctoral fellow
2013/05 - 2013/06: Simon Fraser University, CAN, visiting researcher, School of Computing Science
2011/01 - 2011/09: University of Pittsburgh, USA, visiting scholar, School of Information Sciences
2007/09 - 2009: University of Joensuu, assistant professor (yliassistentti). Responsibilities: research, teaching, international master's programmes coordination (IMPIT, CBU, CIMET)
2006: Kabarak University, Kenya, visiting lecturer (HCI, usability), 1.5 months
2005: University of Pittsburgh, USA, visiting researcher, School of Information Sciences
2005/07 - 2007/08: University of Joensuu, Finland, ESCE graduate school researcher
2002 - 2005/06: University of Joensuu, Finland, researcher
Major research funding and academic leadership
Horizon Europe, HORIZON-MSCA-2021-DN-01, 572.976€, total funding €2.605.759, "Eyes4ICU", 2022
Joensuu University Foundation, 15.000e, 2020
Academy of Finland, grant #334658, 382.440e, "Next generation sensory monitoring for improving microsurgical skills and performance", 2020
Centre for Economic Development, Transport and the Environment,"Experts in Medical Computing", 1.063.950e, consortium leader, 2019
Emil Aaltonen Foundation, 210.000e, "Microsurgical skills measurement methods, detection, and support using sensory information", 2018
University of Eastern Finland, Proof-of-Concept funding, 20.000e, "Augmented reality systems in surgical training" 2018
Nokia Foundation, 10.000e, Visiting Professor Award, 2017
University of Eastern Finland, 9.000e, preparatory grant, 2016
Academy of Finland, grant #305199, 232.583e, "Future Interactive Surgical Systems", 2016-2018, consortium leader, total funding 503.000e
Academy of Finland, grant #297964, 19.000e, "Improving programming education through understanding of reading strategies from large datasets", 2016-2017
Finnish Funding Agency for Innovation, TEKES, 241.500e, "G4M", 2015-2016
University of Eastern Finland, preparatory grant, 9.000e, 2015
Joensuu University Foundation, support funding, 1200e, 2014, 1500e, 2013
Academy of Finland, grant #278809, 9.600e, "Conversational Involvement and Gaze", 2014.
University of Eastern Finland, seed funding, 12.000e, proposal preparatory project, 2012
Academy of Finland, grant #137773, 304.100e, "Expertise and Engagement in Collaborative Tasks: Modeling and Support using Eye-Movement Tracking", 2011-2013. 21% acceptance.
Academy of Finland, grant #135590, 34.000e, "Eye-tracking to Study, Model, and Support Expertise and Engagement in Collaboration", 2010-2011.

Supervised academic works and post-docs: 4 complete and 5+ PhD theses in progress, 20+ MSc theses
Ahreum Lee, Human Factors in Surgical ORs, post-doc UEF, 2020-2022
Mastaneh Torkamani Azar, Multimodal surgical stress monitoring, post-doc UEF, 2020-2022
Feng Feng, Surgical sensorimotor perception, post-doc UEF, 2020-2021
Piotr Bartczak, Spectral imaging in microsurgery, post-doc at UEF & KUH, 2017-2018
Shahram Eivazi, Eye Gaze Patterns in Micro-neurosurgery: PhD thesis 2016. Now post-doc at Tubingen, Germany.
Paul Orlov: Extrafoveal vision during source code comprehension : a gaze-contingent tool, a latency evaluation method, and experiments, PhD thesis 2016. Post-doc at ICL.
Ana Gebejes: Spectral video and eye-tracking, PhD thesis 2017, (with Markku Hauta-Kasari)
Juha Lang: Eye-tracking in reading television subtitles, PhD thesis (with Jukka Makisalo).
Hana Vrzakova: Computational approaches for eye-tracking data analysis, PhD thesis (2019). Post-doc at University of Colorado Boulder, USA, Head of Research KUH
Hoorieh Afkari: Interactive technologies for microneurosurgery OR, PhD thesis (2018). Now post-doc at LIST, Luxembourg.
Jani Koskinen: Multimodal detection of surgical expertise, PhD thesis
Sanna Hannonen: Brain-eye connection: Eye-based Diagnostic Methods, DMs thesis co-supervisor
Sami Andberg: Gaze based biomerkers for neurodegenerative diseases, PhD thesis
Teaching experience

Eye tracking, lecturer, 2013, 2015, 2018,2020, 2021 UEF, Finland
Usability Engineering, lecturer, 2018, UEF, User-Centered Design, lecturer, 2017, 2019, UEF, Tietoverkot tietojenkasittelijoille/Computer networks for computer scientists, lecturer, 2016, UEF
Participatory and User-Centered Design, lecturer, Eritrean Institute of Technology, ict4eedu.org project, 2015,
Eye tracking and data analysis, lecturer (2011), NordForsk Research Training Course on Feedback, Communicative Gesturing and Gazing, University of Helsinki, Finland
Human Factors in System Design, lecturer (2011), University of Pittsburgh, USA

University of Joensuu, Finland: Requirements Engineering, lecturer (2009), User-Centered Design, lecturer (2009, 2020), Usability Engineering, lecturer (2006, 2008). 2002-2005 - teaching assistant in courses:
Design and Analysis of Algorithms, Mental and Other Representations, Artificial Intelligence, Object-oriented programming with Java, Theoretical foundations of computer science, Programming languages
Human-Computer Interaction, lecturer, 2006, Kabarak University, Kenya

Awards, honours, patents
- Bednarik et al.: Method and apparatus for gaze detection, patent application number 20175960 , 2018
- Doctoral Dissertation Graduation Award, University of Joensuu, 2008.
- Best paper honorable mention ACM ETRA 2012 - Bednarik et al.: What you want to do next: A novel approach for intent prediction in gaze-based interaction.
- Ebco Eppich Fellowship, Simon Frazer University, Canada (March-April 2013).
- Best of CHI honorable mention (top 5%), ACM CHI, 2014, Jiang, X., Atkins, M. S., Tien, G., Bednarik, R., and Zheng, B.: Pupil Responses during Discrete Goal-directed Movements
- Premier Award for Excellence in Engineering Education, finalist candidate, 2007, with N. Myller, A. Moreno

Smaller grants and awards (sum ~ 70 000 e):
- FinCEAL travel grant, 900e, 2015, East Finland Graduate School in Computer Science and Engineering - position 07/2005 - 12/2007, Faculty of Science, University of Joensuu, post-graduate scholarship, 2003, 2004, Emil Aaltosen Säätiö, scholarship, 2005, PROLEARN Travel Grant, 2005, TES - Tekniikan edistämissäätiö, scholarship, 2006, PPIG, travel grant, 2006
Professional Duties and Activities
Docent (Adjunct professor): University of Eastern Finland, 2012 -

PhD thesis reviewer/opponent: 5+, 2008-2019
MSc. thesis reviewer (~15 MSc theses, 2006 - 2020)
Keynotes, invited talks
Eye-tracking in studies of psychology of programming, Keynote at Tobii eye-tracking seminar Finland, Hanken Swedish School of Economics, Helsinki. (June, 2006)
Eye tracking in surgical operating rooms and spectral imaging, Invited talk at International Symposium on Multimodal Medical Engineering, Chiba, Japan, 2017
Predicting user states from gaze and other multimodal data, Keynote at 3rd International Workshop on Eye Tracking for Spatial Research, Zurich, 2018.
Eye Tracking in Microscope Applications, invited talk at International Workshop on Optics, Biology, and Related Technologies 2022

Reviewer, PC member, editor for: UMUAI, ACM TOCHI, ACM SIGCHI, Behavior Research Methods, BSC HCI, IJHCS, Eye Tracking Research & Applications, Pervasive Eye Tracking and Mobile Eye-Based Interaction, PPIG, Interacting with Computers, NordiCHI, Science of Computer Programming, Universal Access in the Information Society, PETMEI, Interaction Studies, ECEM (2011,2013), MMSym 2013, JEMR, Transactions on Education.
JEMR Special issue on PETMEI, 2014 (issue co-editor)
PPIG - procs. editor (2007, 2008). PPIG newsletter editor (2010)
Season of Usability 2008, 2009 - usability mentor.

Grant/position reviewer:
Internal Grant Agency, The University of Economics, Prague, 2010, 2011, Croatian Science Foundation, 2012, National Research Foundation, peer rating review, South Africa, 2015
Conference organizer: PPIG 2007 (co-organizer), Computer Science Days of Finnish Computer Science Society 2010 (organizer), DUET 2011 at ECSCW (co-organizer), DUET 2012 at ACM CSCW (co-organizer), GazeIn'13, GazeIn'14 at ACM ICMI (co-chair), 3rd International Workshop on Pervasive Eye Tracking and Mobile Eye-based Interaction (PETMEI 2013, co-chair), ACM ETRA'14 (poster chair), ACM ETRA 2016 - program chair, ACM ETRA 2018 - program chair.
Current research activities and impact
Human Behavioral and Physiological Data analysis
Eye-Movement Tracking Applications and Methodology, Data Intensive Eye-tracking Analysis
Medical Computing and Applications
Design and Evaluation of Educational Environments, Program Comprehension and Visualization, Computer Science Education
140 publications, h-index = 28, 2856 citations
Professional Interests, positions of trust
Co-founder of SeeTrue Technologies OY - customized eye-tracking, seetruetechnologies.com
Co-founder of United Users Ltd. unitedusers.fi
International Development - board member in i4DPeople OY
The Finnish Society for Computer Science - board member 2010, 2011, 2012
PROLEARN Associate member
North-Carelian Africa society RY: founding member, board member -2009.
 
 
Publications of Roman Bednarik

    Journals and Book Chapters

  1. Lee, A., Torkamani-Azar, M., Zheng, B., & Bednarik, R. (2023). Unpacking the Broad Landscape of Intraoperative Stressors for Clinical Personnel: A Mixed-Methods Systematic Review. Journal of Multidisciplinary Healthcare, 1953-1977.

  2. Afkari, H., & Bednarik, R. (2023). Seize the moment: the role of scrub nurses’ proactivity in microsurgical operating-room collaborations. Behaviour & Information Technology, 42(10), 1640-1657.

  3. Puustinen, S., Vrzáková, H., Hyttinen, J., Rauramaa, T., Fält, P., Hauta-Kasari, M., ... & Elomaa, A. P. (2023). Hyperspectral Imaging in Brain Tumor Surgery—Evidence of Machine Learning-Based Performance. World Neurosurgery.

  4. Koskinen, J., He, W., Elomaa, A. P., Kaipainen, A., Hussein, A., Zheng, B., ... & Bednarik, R. (2023). Utilizing Grasp Monitoring to Predict Microsurgical Expertise. Journal of Surgical Research, 282, 101-108.

  5. Torkamani-Azar, M., Lee, A., & Bednarik, R. Methods and Measures for Mental Stress Assessment in Surgery: A Systematic Review of 20 Years of Literature. IEEE journal of biomedical and health informatics.

  6. Hannonen, S, Andberg, S., et al. (2022). Shortening of Saccades as a Possible Easy-to-Use Biomarker to Detect Risk of Alzheimer´s Disease To appear in Journal of Alzheimer’s Disease, 2022.

  7. Tyni, J., Turunen, A., Kahila, J., Bednarik, R., & Tedre, M. (2022). Reward Types in Popular Recreational and Educational Mobile Games. IEEE Access, 11, 1166-1174.

  8. Tyni, J., Tarkiainen, A., López-Pernas, S., Saqr, M., Kahila, J., Bednarik, R., & Tedre, M. (2022). Games and Rewards: A Scientometric Study of Rewards in Educational and Serious Games. IEEE Access, 10, 31578-31585

  9. Koskinen, J., Torkamani-Azar, M., Hussein, A., Huotarinen, A. and Bednarik, R., 2022. Automated tool detection with deep learning for monitoring kinematics and eye-hand coordination in microsurgery. Computers in Biology and Medicine 141, 105121.

  10. Tolvanen, O., Elomaa, A.-P. A.-P., Itkonen, M., Vrzakova, H., Bednarik, R., and Huotarinen, A., 2022. Eye-tracking indivators of workload in surgery—A systematic review. Journal of Investigative Surgery. 1-10.

  11. Koskinen, J., Huotarinen, A., Elomaa, A.P., Zheng, B. and Bednarik, R., 2021. Movement-level process modeling of microsurgical bimanual and unimanual tasks. International Journal of Computer Assisted Radiology and Surgery, 1-10.

  12. Chainey, J., Zheng, B., Kim, M., Elomaa, A., Bednarik, R. and O’Kelly, C., 2021. C. 6 Action-Related Fixation in Microsuturing, a New Gaze Behavior Metric to Differentiate the Level of Expertise. Canadian Journal of Neurological Sciences 48 (s3), S19-S19.

  13. Chainey, J., Elomaa, A.P., O’Kelly, C.J., Kim, M.J., Bednarik, R. and Zheng, B., 2021. Eye-Hand Coordination of Neurosurgeons: Evidence of Action-Related Fixation in Microsuturing. World Neurosurgery 155, e196-e202

  14. Ogawa-Ochiai, K., Kiyokawa, T., Kiyomitsu, K., Bednarik, R., Mitani, Y. and Tsumura, N., 2021. Comparison of noncontact camera-based methods for measuring pulse-rate of awake infants. Artificial Life and Robotics, 1-8.

  15. Zheng, B., Jiang, X., Bednarik, R. and Atkins, M.S., 2021. Action-related eye measures to assess surgical expertise. BJS Open 5 (5), zrab068.

  16. Chitalkina, N., Puurtinen, M., Gruber, H. and Bednarik, R., 2021. Handling of incongruences in music notation during singing or playing. International Journal of Music Education 39 (1), 18-38

  17. Koskinen, J., Bednarik, R., Vrzakova, H. and Elomaa, A.P., 2020. Combined Gaze Metrics as Stress-Sensitive Indicators of Microsurgical Proficiency. Surgical Innovation 27 (6), 614-622.

  18. Bednarik, R., Busjahn, T., Gibaldi, A., Ahadi, A., Bielikova, M., Crosby, M., Essig, K., Fagerholm, F., Jbara, A., Lister, R. and Orlov, P., 2020. EMIP: The eye movements in programming dataset. Science of Computer Programming, 198, p.102520

  19. Sharafi, Z., Sharif, B., Guéhéneuc, Y.G., Begel, A., Bednarik, R. and Crosby, M., 2020. A practical guide on conducting eye tracking studies in software engineering. Empirical Software Engineering 25 (5), 3128-3174.

  20. Puustinen, S., Alaoui, S., Bartczak, P., Bednarik, R., Koivisto, T., Dietz, A., von Und Zu Fraunberg, M., Iso-Mustajärvi, M. and Elomaa, A.P., 2020. Spectrally Tunable Neural Network-Assisted Segmentation of Microneurosurgical Anatomy. Frontiers in Neuroscience 14, 640.

  21. Vrzakova, H., Begel, A., Mehtätalo, L., & Bednarik, R. (2020). Affect recognition in code review: An in-situ biometric study of reviewer’s affect. Journal of Systems and Software, 159,

  22. Gil De Gómez Pérez, D., Bednarik, R.: POnline: An Online Pupil Annotation Tool Employing Crowd-sourcing and Engagement Mechanisms. Human Computation 6:1:176-191, 2019.

  23. Eivazi, S., Hafez, A., Fuhl, W., Afkari, H., Kasneci, E., Lehecka, M., Bednarik, R.: Optimal eye movement strategies: a comparison of neurosurgeons gaze patterns when using a surgical microscope. Acta Neurochirurgica, 2017.

  24. Orlov, P., Bednarik, R.: The role of extrafoveal vision in source code comprehension Perception 46(5), 2017.

  25. Afkari, H., Bednarik, R., Makela, S., Eivazi, S.: Mechanisms for Maintaining Situation Awareness in Micro-Neurosurgical Operating Room. International Journal of Human-Computer Studies, 2016. http://dx.doi.org/10.1016/j.ijhcs.2016.05.004

  26. Kajan, R., Herout, A., Bednarik, R., Povolny, F.: PeepList: Adapting Ex-Post Interaction with Pervasive Display Content Using Eye Tracking. Pervasive and Mobile Computing, 2016. http://dx.doi.org/10.1016/j.pmcj.2015.12.004

  27. Eivazi, S., Bednarik, R., Leinonen, V., von und Fraunberg, M., Jaaskelainen, J. E.: Embedding an Eye Tracker into a Surgical Microscope: Requirements, Design, and Implementation. IEEE Sensors, 2015. http://dx.doi.org/10.1109/JSEN.2015.2501237

  28. Orlov, P., Bednarik, R.: ScreenMasker: An open-source gaze-contingent screen masking environment. Behaviour Research Methods 48(3), 2016.

  29. Eivazi, S., Afkari, H., Bednarik, R., Leinonen, V., Tukiainen, M., Jaaskelainen, J.: Analysis of disruptive events and precarious situations caused by interaction with neurosurgical microscope. Acta Neurochirurgica 157(7), pp- 1147-1154, 2015. http://dx.doi.org/10.1007/s00701-015-2433-5

  30. Jiang, X., Zheng, B., Bednarik, R., Atkins, M.S.: Pupil responses to continuous aiming movements. International Journal of Human-Computer Studies 83, pp 1-11, 2015. http://dx.doi.org/10.1016/j.ijhcs.2015.05.006

  31. Bednarik, R., Krohns, J.: User-centered design practice and adoption in smaller ICT companies in Eastern Finland: An Interview Study. International Journal of Business Information Systems, 18(3), pp. 285- 298, 2015.

  32. Bednarik, R., Eivazi, S., Vrzakova, H.: A computational approach for prediction of problem-solving behavior using Support Vector Machines and eye-tracking data. In Eye Gaze in Intelligent User Interfaces - Gaze-based Analyses, Models, and Applications, Springer, pp. 111-134, 2013. ISBN 978-1-4471-4783-1. http://dx.doi.org/ 10.1007/978-1-4471-4784-8_7

  33. Bednarik, R., Gowases, T., Tukiainen, M.: Gaze-augmented interaction improves problem-solving: new evidence from verbal protocols. Behaviour & Information Technology 32 (8), 2013. http://dx.doi.org/10.1080/0144929X.2012.659216

  34. Bednarik, R.: Expertise-dependent Visual Attention Strategies Develop Over Time During Debugging with Multiple Code Representations. International Journal of Human - Computer Studies 70 (2012), pp. 143-155. http://dx.doi.org/10.1016/j.ijhcs.2011.09.003

  35. Ben-Ari, M., Bednarik, R., Ben-Bassat Levy, R., Ebel, G., Moreno, A., Myller, N., Sutinen, E.: A decade of research and development on program animation: The Jeliot experience. Journal of Visual Languages and Computing, 22, pp 375 - 384, 2011. doi:10.1016/j.jvlc.2 011.04.004

  36. Bednarik, R., Gowases, T., Tukiainen, M.: Gaze interaction enhances problem solving: Effects of dwell-time based, gaze-augmented, and mouse interaction on problem-solving strategies and user experience. Journal of Eye Movement Research, 3(1)3, 1-10, 2009. Available online: http://www.jemr.org/online/3/1/3

  37. Myller, N., Bednarik, R., Ben-Ari, M., Sutinen, E.: Extending the Engagement Taxonomy: Software Visualization and Collaborative Learning. ACM Transactions on Computing Education, 9(1), article 7, 2009.

  38. Randolph, J. J., & Bednarik, R.: Publication bias in the computer science education literature. Journal of Universal Computer Science, 14(4), 2008, pp. 575-589.

  39. Randolph, J. J., Rogers, P. C., Kakkonen, T., Myller, N., & Bednarik, R.: Emerging technologies for educational evaluation. In M. Ortiz & C. Rubio (Eds.) Educational Evaluation: 21st Century Issues and Challenges. Hauppauge, NY: Nova, 2009, pp. 417-442.

  40. Randolph, J.J., Julnes, G., Bednarik, R., & Sutinen, E.: A comparison of the methodological quality of articles in computer science education journals and conference proceedings. Computer Science Education, 17(4), 2007, pp. 263-274.

  41. Bednarik, R., Randolph, J.: Studying Cognitive Processes in Computer Program Comprehension. In Hammoud, R. I. (Ed): Passive Eye Monitoring: Algorithms, Applications and Experiments, Springer, ISBN 9783540754114, pp. 373-386, 2008.

  42. Bednarik, R., Moreno, A., Myller, N.: Program Visualization for Programming Education - Case of Jeliot 3. ACM NZ Bulletin, 2(2), ISSN 1176-9998, 2006. Avalailable online from http://is-alt.massey.ac.nz/acmnz/bulletin/vol2/issue2/

  43. Bednarik, R., Moreno, A., Myller, N.: Various Utilizations of an Open-Source Program Visualization Tool, Jeliot 3. Informatics in Education 5(2), 2006, pp. 195-206.

  44. Bednarik, R., Tukiainen, M.: Validating the Restricted Focus Viewer: A Study Using Eye-Movement Tracking. Behavior Research Methods, 39(2), 2007, pp. 274-282. Available online: http://brm.psychonomic-journals.org/content/39/2/274.full.pdf

  45. Bednarik, R., Myller, N., Sutinen, E., Tukiainen, M.: Analyzing Individual Differences in Program Comprehension. Technology, Instruction, Cognition and Learning (TICL), 3 (3-4), special issue on modeling and simulation, 2006, pp. 205-232.

    Books and Edited Proceedings

  46. Tamm, S., Bednarik, R., Busjahn, T., Schulte, C., Vrzakova, H., Budde, L. (Eds.): Eye Movements in Programming: Spring Academy 2017. Freie Universität Berlin, Department of Mathematics and Computer Science, Berlin, Germany, Technical Report TR-B-17-02, 2017. PDF

  47. Bednarik, R.; Busjahn, T.; Schulte, C.; Tamm, S. (Eds.): Eye Movements in Programming: Models to Data. University of Eastern Finland, Joensuu, Finland: Reports and Studies in Forestry and Natural Sciences, no 23, 2016. (ISBN: 978-952-61-2040-9)

  48. Busjahn, T., Schulte, C., Tamm, S., Bednarik, R.: Eye Movements in Programming Education II: Analyzing the Novice’s Gaze. Freie Universität Berlin, TR-B-15-01, 2015. PDF

  49. Huang, H.-H., Bednarik, R., Jokinen, K., Nakano, Y.: Gaze-in 2014: the 7th Workshop on Eye Gaze in Intelligent Human Machine Interaction. In Proceedings of the 16th International Conference on Multimodal Interaction (ICMI '14). ACM, New York, NY, USA, 527-528.

  50. Bednarik, R., Busjahn, T., Schulte, C.: Eye Movements in Programming Education: Analyzing the Expert's Gaze. Publications of the University of Eastern Finland. Reports and Studies in Forestry and Natural Sciences, no 18, ISBN: 978-952-61-1539-9. PDF

  51. Bednarik, R., Huang, H.-H., Nakano, Y., Jokinen, K.: GazeIn'13 -The 6th Workshop on Eye Gaze in Intelligent Human Machine Interaction. http://dx.doi.org/10.1145/2522848.2535892, 2013, ACM.

  52. Bednarik, R.: Computer Science Days 2010, the proceedings of the conference Tietojenkasittelytieteen paivat 2010, in Publications of the University of Eastern Finland. Reports and Studies in Forestry and Natural Sciences, vol 2, 2010. ISBN 978-952-61-0130-9.

  53. Buckley, J., Rooksby, J., Bednarik, R.: Proceedings of the 20th Annual Workshop of the Psychology of Programming Interest Group (PPIG08). Lancaster, UK, 2008. Lancaster University, ISBN 978-1-86220-215-3.

  54. Sajaniemi, J., Tukiainen, M., Bednarik, R., Nevalainen, S.: Proceedings of the 19th Annual Workshop of the Psychology of Programming Interest Group (PPIG07). Joensuu, Finland, July, 2007. International Proceedings Series 7, University of Joensuu, Department of Computer Science and Statistics.

    International Conferences with Referee Procedure

  55. Moustafa, R. S., Karhu, H., Andberg, S., & Bednarik, R. (2023, May). Seeing Through Their Eyes-A Customizable Gaze-Contingent Simulation of Impaired Vision and Other Eye Conditions Using VR/XR Technology. In Proceedings of the 2023 Symposium on Eye Tracking Research and Applications (pp. 1-2).

  56. Bednarik, R., Blandford, A., Feng, F., Huotarinen, A., Iso-Mustajärvi, M., Lee, A., ... & Zheng, B. (2022, April). Integration of Human Factors in Surgery: Interdisciplinary Collaboration in Design, Development, and Evaluation of Surgical Technologies. In CHI Conference on Human Factors in Computing Systems Extended Abstracts (pp. 1-7)

  57. Lee, A. and Bednarik, R., 2021. 3D Exoscopes in Microsurgery: How 3D Exoscopes Reconfigure the Workflow of Assistant Surgeons and Nurses in the Operating Room. Companion Publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing, 112-116.

  58. Bednarik, R., Vrzakova, H., Elomaa, A.P. and Skön, J.P., 2020. Experts in Medical Computing: Designing a continuous education program with clinical relevance and industrial applicability. 2020 IEEE Frontiers in Education Conference (FIE), 1-5.

  59. Koskinen, J. and Bednarik, R., 2020. Gaze-grabber distance in expert and novice forest machine operators: the effects of automatic boom control. ACM Symposium on Eye Tracking Research and Applications, 1-7.

  60. Chitalkina, N., Bednarik, R., Puurtinen, M. and Gruber, H., 2020. When you ignore what you see: How to study proof-readers’ error in pseudocode reading. ACM Symposium on Eye Tracking Research and Applications, 1-5.

  61. Chitalkina, N., Bednarik, R., Puurtinen, M. and Gruber, G., 2019. Prediction as a prerequisite of skilled reading: The cases of source-code and music notation. Proceedings of the 19th Koli Calling International Conference on Computing Education Research.

  62. Kiyokawa, T; Kiyomitsu, K; Bednarik, R; Ogawa-Ochi, K; Tsumura, N. : Comparison of non-contact camera based methods to measure the pulse rate for awake infants. 26th Color and Imaging Conference: Color Science and Engineering Systems, Technologies, and Applications, CIC 2018. https://doi.org/10.2352/ISSN.2169-2629.2018.26.157

  63. Bednarik, R., Budde, L., Heinemann, B., Schulte, C., Vrzakova, H.: Eye-movement Modeling Examples in Source Code Comprehension: A Classroom Study. To appear in Koli Calling, 2018. ACM.

  64. Bednarik, R., Koskinen, J., Vrzakova, H., Bartczak, P., Elomaa, A-P.: Blink-based estimation of suturing task workload and expertise in microsurgery. 2018 IEEE 31st International Symposium on Computer-Based Medical Systems, pp. 233-238. https://doi.org/10.1109/CBMS.2018.00048 PDF

  65. Bartczak, P., Iso-Mustajärvi, M., Vrzakova, H., Bednarik, R., Fraunberg, M., Elomaa, A-P.: Portable System for On-site Spectral Imaging: Pre-Clinical Development and Early Evaluation 2018 IEEE 31st International Symposium on Computer-Based Medical Systems. PDF

  66. Bartczak, P., Vrzakova, H., Bednarik, R., Iso-Mustajärvi, M., ..., Elomaa, A-P.: Spectral Video in Image-guided Microsurgical Applications: Integrating Imaging Technology into the Clinical Environment and Ergonomic Considerations. 2018 IEEE 31st International Symposium on Computer-Based Medical Systems. PDF

  67. Leppänen, T., Vrzakova, H., Bednarik, R., Kanervisto, A., Elomaa, A-P., et al.: Augmenting Microsurgical Training: Microsurgical Instrument Detection using Convolutional Neural Networks. 2018 IEEE 31st International Symposium on Computer-Based Medical Systems, pp. 211-216. https://doi.org/10.1109/CBMS.2018.00044 PDF

  68. Bednarik, R., Bartczak, P., Vrzakova, H., Elomaa, A-P., Koskinen, J., et al.: Pupil size as an indicator to visual-motor workload and expertise in microsurgical training tasks. In Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications (p. 60). ACM.

  69. Gil de Gómez Pérez, D., Suokas, M., Bednarik, R.: Crowdsourcing pupil annotation datasets: boundary vs. center, what performs better? In Proceedings of the 7th Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction (p. 3). ACM

  70. Afkari, H., Gil de Gómez, D., Bednarik, R.: Command Selection in Gaze-based See-through Virtual Image-Guided Environments Proceedings of the 9th Augmented Human International Conference, 2018. https://doi.org/10.1145/3174910.3174940

  71. Gil de Gómez, D., Bednarik, R.: CrowdPupil: A crowdsourced, pupil-center annotated image dataset In Proceedings of Cogain 2017

  72. Orlov, P., Bednarik, R., Orlova, L.: Programmers' experiences with working in the restricted-view mode as indications of parafoveal processing differences In Proceedings of PPIG 2016.

  73. Zheng, B., Jiang, X., Bednarik, R., Atkins, M. S.: Gaze Characteristics of Video Watching in a Surgical Setting IEEE 2nd Workshop on Eye Tracking and Visualization, pp- 11-15, 2016. https://doi.org/10.1109/ETVIS.2016.7851158

  74. Quang, D. N., Vrzakova, H., Bednarik, R.: WTP: Web-Tracking Plugin for Real-time Automatic AOI Annotations In Proceedings of PETMEI 2016.

  75. Gebejes, A., Fält, P., Bednarik, R., Hauta-Kasari, M.: SPEED: Spectral Eye Video Database In Proceedings of UbiComp '16 Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct, pp. 1666-1675. https://doi.org/10.1145/2968219.2968335

  76. Vrzakova, H., Bednarik, R., Nakano, Y., Nihei, F.: Speakers' head and gaze dynamics weakly correlate in group conversation Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications, pp. 77-84, ACM, 2016. http://dx.doi.org/10.1145/2857491.2857522

  77. Vrzakova, H., Bednarik, R.: Quiet Eye Affects Action Detection from Gaze more than Context Length In 2015 User Modelling, Adaptation and Personalization, pp. 277-288. PDF http://dx.doi.org/10.1007/978-3-319-20267-9_23

  78. Busjahn, T., Bednarik, R., Begel, A., Crosby, M., Peterson J., Schulte, C., Sharif, B., Tamm, S.: Eye Movements in Code Reading: Relaxing the Linear Order 23rd IEEE International Conference on Program Comprehension., 2015. PDF

  79. Vrzakova, H., Bednarik, R., Nihei, F., Nakano, Y.: Influential statements and gaze for persuasion modeling In the 8th Nordic Conference on Human-Computer Interaction, 2014., pp. 915-918, PDF http://dx.doi.org/10.1145/2639189.2670192

  80. Afkari, H., Eivazi, S., Bednarik, R., Makela, S.: The Potentials for Hands-free Interaction in Micro-neurosurgery In the 8th Nordic Conference on Human-Computer Interaction, 2014, pp. 401-410, http://dx.doi.org/10.1145/2639189.2639213 PDF

  81. Orlov, P., Bednarik, R.: Low-cost Latency Measurement System for Eye-mouse Software In the 8th Nordic Conference on Human-Computer Interaction, 2014, pp. 1085-1088, http://doi.acm.org/10.1145/2639189.2670282

  82. Busjahn, T., Schulte, C., Sharif, B., Simon, Begel, A., et al.: Eye tracking in computing education. In Proceedings of the tenth annual conference on International computing education research (ICER '14). ACM, pp. 3-10. http://doi.acm.org/10.1145/2632320.2632344

  83. Malmi, L., Sheard, J., Simon, Bednarik, R., et al.: Theoretical Underpinnings of Computing Education Research ? What is the Evidence? Accepted to ACM ICER 2014.

  84. Jiang, X., Atkins, M. S., Tien, G., Bednarik, R., and Zheng, B.: Pupil Responses during Discrete Goal-directed Movements. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems (CHI '14). ACM, New York, NY, USA, 2075-2084. http://dx.doi.org/10.1145/2556288.2557086. Best of CHI honorable mention.

  85. Jiang X., Atkins, M. S., Tien, G, Zheng, B., Bednarik, R.: Pupil dilations during target-pointing respect Fitt's Law. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '14). ACM, New York, NY, USA, 175-182. http://doi.acm.org/10.1145/2578153.2578178

  86. Dao, C., Bednarik, R., Vrzakova, H.: Heatmap Rendering from Large-scale Distributed Datasets using Cloud Computing. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '14). ACM, New York, NY, USA, 215-218. http://doi.acm.org/10.1145/2578153.2578187

  87. Tien, J., Atkins, M. S., Jiang, X., Zheng, B., Bednarik, R.: Verbal gaze instruction matches visual gaze guidance in laparoscopic skills training. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '14). ACM, New York, NY, USA, 331-334. http://doi.acm.org/10.1145/2578153.2578217

  88. Busjahn, T., Bednarik, R., Schulte, C.: What influences dwell time during source code reading? Analysis of element type and frequency as factors In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '14). ACM, New York, NY, USA, 335-338. http://doi.acm.org/10.1145/2578153.2578211

  89. Bednarik, R., Kauppinen, M.: Unravelling the Interaction Strategies and Gaze in Collaborative Learning with Online Video Lectures. In proceedings of GazeIn'13 -The 6th Workshop on Eye Gaze in Intelligent Human Machine Interaction, http://dx.doi.org/10.1145/2535948.2535959, ACM, 20013.

  90. Vrzakova, H., Bednarik, R.: EyeCloud: Cloud Computing for Pervasive Eye-Tracking In the proceedings of PETMEI 2013, 3rd International Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction, 2013. PDF

  91. Vrzakova, H., Bednarik, R.: That's not Norma(n/l)! A Detailed Analysis of Midas Touch in Gaze-based Problem-solving To appear in the proceedings of ACM CHI'13, 2013. PDF

  92. Mäkelä, S., Bednarik, R., Tukiainen, M.: Evaluating User Experience of Autistic Children through Video Observation. To appear in the proceedings of ACM CHI'13, 2013.

  93. Erkut, C., Bednarik, R., M‰kel‰, S., Kleimola, J.: Apps for Me, Too: Gaze and Natural Interaction Applications for Varying Cognitive Strengths on a Multi-touch Table Network To appear in the proceedings of the Gaze Interaction in the Post-WIMP World Workshop, CHI'13, 2013.

  94. Vrzakova, H., Bednarik, R.: Fast and Comprehensive Extension to Intention Prediction from Gaze In the proceedings of IUI2013 Second Workshop on Interacting with Smart Objects, 2013. PDF.

  95. Bednarik, R., Orlov, P.: Investigating the role of programmers' peripheral vision: a gaze-contingent tool and an experiment proposal. In the proceedings of Psychology of Programming Interest Group PPIG 2012. PDF.

  96. Wang, P., Bednarik, R., Moreno, A.: During automatic program animation, explanations after animations have greater impact than before animations. In Proceedings of the 12th Koli Calling International Conference on Computing Education Research, pp. 100-109, 2012 http://dx.doi.org/10.11 45/2401796.2401808

  97. Bednarik, R., Herout, A.: What Students Want: A Study on the Role of Supervisor of Final Works in Computing Education . In Proceedings of the 12th Koli Calling International Conference on Computing Education Research, pp. 118-125, 2012 http://dx.doi.org/10.11 45/2401796.2401811

  98. Bednarik, R., Eivazi, S., Hradis, M.: Gaze and Conversational Engagement in Multiparty Video Conversation: An annotation scheme and classification Gaze-In '12 Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction, Article 10, 2012. http://dx.doi.org/10.1145/2401836.2401846

  99. Vrzakova, H., Bednarik, R.: Hard lessons learned: Mobile eye-tracking in cockpits Gaze-In '12 Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction, Article 7, 2012. http://dx.doi.org/10.1145/2401836.2401843

  100. Bednarik, R., Shipilov, A.: Usability of gaze-transfer in collaborative programming: How and when could it work, and some implications for research agenda. In proceedings of DUET 2012, Dual Eye-Tracking in CSCW. PDF

  101. Bednarik, R., Vrzakova, H., Hradis, M.: What you want to do next: A novel approach for intent prediction in gaze-based interaction. In proceedings of ETRA'12, pp. 83-90. http://dx.doi.org/10.11 45/2168556.2168569 Best paper honorable mention.

  102. Hradis, M., Eivazi, S., Bednarik, R.: Voice activity detection in video mediated communication from gaze. In proceedings of ETRA'12, pp. 329-332. http://dx.doi.org/10.11 45/2168556.2168628

  103. Eivazi, S., Bednarik, R., Tukiainen, M., von und zu Fraunberg, M., Leinonen, V., J‰‰skel‰inen J.: Gaze Behaviour of Expert and Novice Microneurosurgeons Differs During Observations of Tumor Removal Recordings. In proceedings of 2012 ACM ETRA'12, pp. 377-380. http://dx.doi.org/10.11 45/2168556.2168641

  104. Bednarik, R., Shipilov, A.: Gaze Cursor During Distant Collaborative Programming: A Preliminary Analysis. In the proceedings of DUET 2011: Dual Eye Tracking in CSCW, 2011. ECSCW 2011. PDF

  105. Gowases, T., Bednarik, R., Tukiainen, M.: Text highlighting improves user experience for reading with magnified displays. In the proceedings of Extended Abstracts of ACM CHI, pp. 1891-1896, 2011. http://dx.doi.org/10.1145/1979742.1979917

  106. Bednarik, R., Shipilov, A., Pietinen, S.: Bidirectional Gaze in Remote Computer Mediated Collaboration: Setup and Initial Results from Pair-Programming In the proceedings of the Computer Supported Cooperative Work, CSCW, ACM, pp. 597-600, 2011. http://dx.doi.org/10.1145/1958824.1958923

  107. Eivazi, S., Bednarik, R.: Predicting Problem-Solving Behavior and Performance Levels from Visual Attention Data In the proceedings of 2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction at IUI 2011, pp 9-16, 2011. PDF

  108. Eivazi, S., Bednarik, R.: Inferring Problem Solving Strategies Using Eye-Tracking: System Description and Evaluation. Proceedings of the 10th Koli Calling International Conference on Computing Education Research. Koli Calling'10, New York, NY, USA, ACM, 2010, pp. 55-61, http://dx.doi.org/10.1145/1930464.1930472

  109. Malmi, L., Sheard, J., Simon, Bednarik, R., Helminen, J., Korhonen, A., Myller, N., Sorva, J., Taherkhani, A.: Characterizing research in computing education: a preliminary analysis of the literature. In the proceedings of ACM ICER 2010, pp. 3-12. http://doi.acm.org/10.1145/1839594.1839597

  110. Pietinen, S., Bednarik, R. and Tukiainen, M.: Eye-tracking in Collaborative settings: Setup and Descriptive analysis. The 5th Scandinavian Workshop on Applied Eye-Tracking, SWAET 2010, Lund University, May 5-7 2010, p. 38.

  111. Pietinen, S., Bednarik, R., Tukiainen, M.: Shared Visual Attention in Collaborative Programming: A Descriptive Analysis. ACM/IEEE 32nd International Conference on Software Engineering, ICSE 2010, Cooperative and Human Aspects of Software Engineering, CHASE 2010, Workshop at the ICSE 2010, May 2nd 2010, Cape Town, South Africa.

  112. Kinnunen, T., Sedlak, F., Bednarik, R.: Towards Task-Independent Person Authentication Using Eye Movement Signals. In the Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, ETRA'10, ACM, pp. 187-190.

  113. Pietinen, S., Bednarik, R., Tukiainen, M.: An Exploration of Shared Visual Attention in Collaborative Programming. In Proceedings of the 21th Annual Workshop of the Psychology of Programming Interest Group (PPIG'09), Limerick, Ireland, pp. 134-135. Available online: http://www.ppig.org/papers/21st-pietinen.pdf

  114. Duveskog, M., Bednarik, R., Sutinen, R., Kemppainen, K.: Designing a Story-Based Platform for HIV/AIDS Counseling with Tanzanian Children. In Proceedings of the 8th ACM International Conference on Interaction Design and Children, pp. 27-35, 2009.

  115. Gowases, T., Bednarik, R., Tukiainen, M.: Gaze vs. Mouse in Games: The Effects on User Experience. In Proceedings of The 16th International Conference on Computers in Education, ICCE 2008, pp. 773 - 777.

  116. Nuutinen, J., Bednarik, R., Sutinen, E.: A Layered Approach to the Development Process of Social Mindtools. In Proceedings of ED-Media 2008, pp. 2109-2118.

  117. Bednarik, R., Tukiainen, M.: Temporal Eye-Tracking Data: Evolution of Debugging Strategies with Multiple Representations. In Proceedings of the 2008 Symposium on Eye Tracking Research & Applications (Savannah, Georgia, March 26 - 28, 2008). ETRA '08. ACM, New York, NY, pp. 99-102.

  118. Pietinen, S., Bednarik, R., Glotova, T., Tenhunen, V., Tukiainen M.: A Method to Study Visual Attention Aspects of Collaboration: Eye-Tracking Pair Programmers Simultaneously. In Proceedings of the 2008 Symposium on Eye Tracking Research & Applications (Savannah, Georgia, March 26 - 28, 2008). ETRA '08. ACM, New York, NY, pp. 39-42.

  119. Moreno, A., Sutinen, E., Bednarik, R. and Myller, N. (2007): Conflictive animations as engaging learning tools. In Proc. Seventh Baltic Sea Conference on Computing Education Research (Koli Calling 2007), Koli National Park, Finland. CRPIT, 88. Lister, R. and Simon, Eds., ACS. pp. 203-206.

  120. Bednarik, R., Tukiainen, M.: Analysing and Interpreting Quantitative Eye-Tracking Data in Studies of Programming: Phases of Debugging with Multiple Representations. In Proceedings of the 19th Annual Workshop of the Psychology of Programming Interest Group (PPIG'07), Joensuu, Finland, July 2-6, 2007, pp. 158-172.

  121. Myller, N., Bednarik, R., Moreno, A.: Integrating Dynamic Program Visualization into BlueJ: the Jeliot 3 extension. In proceedings of IEEE ICALT 2007, IEEE Computer Society, 2007, pp. 505-506.

  122. Moreno, A., Bednarik, R., Yudelson, M.: How to Adapt the Visualization of Programs? UM'2007 workshop 2, 11th International Conference on User Modeling: Personalisation in e-learning environments at individual and group level, PING'07. Corfu, Greece, June 25-29, 2007, pp. 65-70.

  123. Bednarik, R., Kamppuri, M., Tedre, M., Vesisenaho, M.: Alternative to Technology-Driven Development: An Approach Based on Authentic Needs. Presented at the Workshop on User Centred Design and International Development to be held on 28th April 2007, CHI2007.

  124. Kamppuri, M., Bednarik, R., Tukiainen, M.: The Expanding Focus of Design: Case Culture. In proceedings of NordiCHI 2006, The Fourth Nordic Conference on Human-Computer Interaction. Oslo, Norway, 2006, ACM Press, pp. 405-408.

  125. Bednarik, R., Myller, N., Sutinen, E., Tukiainen, M.: Program Visualisation: Comparing Eye-tracking Patterns with Comprehension Summaries and Performance. In proceedings of the 18th Annual Workshop of the Psychology of Programming Interest Group (PPIG'06), Brighton, UK, September 7-8, 2006, pp. 68-82.

  126. Myller, N., Bednarik, R.: Methodologies for Studies of Program Visualization. In proceedings of Methods, Materials and Tools for Programming Education (MMT2006), Tampere, Finland, May 4-5, 2006, pp. 37-42.

  127. Bednarik, R., Tukiainen, M.: An Eye-tracking Methodology for Characterizing Program Comprehension. In Proceedings the 2006 Symposium on Eye Tracking Research and Applications, ETRA 2006, March 27-29, San Diego, CA, USA, ACM Press, pp. 125 - 132.

  128. Randolph, J. J., Bednarik, R. and Myller, N.: A Methodological Review of the Articles Published in the Proceedings of Koli Calling 2001-2004. In Proceedings of Koli Calling 2005: 5th Annual Finnish / Baltic Sea Conference on Computer Science Education. November 17 - November 20, 2005, pp. 103-109.

  129. Moreno, A., Myller, N. and Bednarik, R.: Jeliot 3, an Extensible Tool for Program Visualization. In Proceedings of Koli Calling 2005: 5th Annual Finnish / Baltic Sea Conference on Computer Science Education. November 17 - November 20, 2005, pp. 183-184.

  130. Bednarik, R., Joy, M., Moreno, A., Myller, N., Sun, S., Sutinen, E.: Multi-Agent Educational System for Program Visualization. In proceedings of the International Conference on Intelligent Agents, Web Technology and Internet Commerce (IAWTIC'2005), 28 - 30 November 2005, Vienna, Austria, IEEE Computer Society, pp. 283 - 288.

  131. Bednarik, R., Myller, N., Sutinen, E., Tukiainen, M.: Applying Eye-Movement Tracking to Program Visualization. In proceedings of 2005 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC'05), Dallas, Texas, USA, September 21-24, 2005, IEEE Computer Society, pp. 302-304.

  132. Bednarik, R.: Potentials of Eye-Movement Tracking in Adaptive Systems. In the Proceedings of the Fourth Workshop on the Evaluation of Adaptive Systems, held in conjunction with the 10th International Conference on User Modeling (UM'05), Edinburgh, UK, July 24th to 30th, 2005, pp. 1-8.

  133. Bednarik, R., Myller, N., Sutinen, E., Tukiainen, M.: Effects of Experience on Gaze Behaviour during Program Animation. In proceedings of the 17th Annual Psychology of Programming Interest Group Workshop (PPIG'05), Brighton, UK, June 28 - July 1, 2005, pp. 49-61.

  134. Randolph, J. J., Bednarik, R., Silander, P., Gonzalez, J., Myller, N., and Sutinen, E.: A Critical Analysis of the Research Methodologies Reported in the Full Papers of the Proceedings of ICALT 2004. In proceedings of the 5th IEEE International Conference on Advanced Learning Technologies (ICALT 2005), Kaohsiung, Taiwan, July 5-8, 2005, IEEE Computer Society, pp. 10-14.

  135. Bednarik, R., Moreno, A., Myller, N., Sutinen, E.: Smart Program Visualization Technologies: Planning a Next Step. In proceedings of the 5th IEEE International Conference on Advanced Learning Technologies (ICALT 2005), Kaohsiung, Taiwan, July 5-8, 2005, IEEE Computer Society, pp. 717-721.

  136. Bednarik, R., Kinnunen, T., Mihaila, A., Fr‰nti, P.: Eye-Movements as a Biometric. In Proceedings of the 14th Scandinavian Conference on Image Analysis, SCIA 2005, Joensuu, Finland, June 19-22, 2005. Lecture Notes in Computer Science, Vol. 3540, Springer, 2005, pp. 780-789.

  137. Bednarik, R., Tukiainen, M.: Effects of Display Blurring on the Behavior of Novices and Experts during Program Debugging. In CHI '05 extended abstracts on Human factors in computing systems, CHI 2005, Portland, Oregon, USA, April 2-7, 2005, ACM Press, pp. 1204-1207.

  138. Bednarik, R., Tukiainen, M.: Visual Attention Tracking During Program Debugging. In Proceedings of NordiCHI 2004, The Third Nordic Conference on Human-Computer Interaction, October 23-27, 2004, Tampere, Finland, ACM Press, pp. 331-334.

  139. Bednarik, R. & Tukiainen, M.: Visual Attention and Representation Switching in Java Program Debugging: A Study Using Eye Movement Tracking. In Proceedings of 16th Annual Psychology of Programming Interest Group Workshop (PPIG'04), Institute of Technology Carlow, Ireland, April 5-7, 2004, pp. 159-169.

  140. Bednarik, R., Fr‰nti, P.: Survival of Students with Different Learning Preferences. The 4th Annual Finnish / Baltic Sea Conference on Computer Science Education, Koli, Finland, October 1-3, 2004, pp. 121-125.

  141. Bednarik, R., Gerdt, P., Miraftabi, R., Tukiainen, M.: Development of the TUP Model - Evaluating Educational Software. In Proceedings of the 4th IEEE International Conference on Advanced Learning Technologies (ICALT 2004), Joensuu, Finland, August 30 - September 1, 2004, IEEE Computer Society, pp. 699-701.

  142. Bednarik, R.: Problem-Based Learning in Teaching Theoretical Computer Science. In Proceedings of the International Conference on Engineering Education and Research Conference iCEER 2004, Olomouc, Czech Republic, June 27-30, 2004, pp. 801-807, CD-ROM.

    National Conferences with Referee Procedure

  143. Bednarik, R., Marjomaa E., La Russa, G.: Logical Variability in Tutors and Evaluators. In Proceedings of the ITK'04 Workshop on Educational Technology Research, April 20-22, H‰meenlinna, Finland, 2005. pp. 48-49.

    Tutorials and Technical Reports, Other Publications

  144. Tsukuda, M., Bednarik, R., Hauta-Kasari, M., Nakauchi, S.: Static cues for mirror-glass discrimination explored by gaze distribution. In European Conference on Visual Perception, ECVP 2016.

  145. Bednarik, R., Kinnunnen, T., Eivazi, S., Sedlak, F., & Vrzakova, H.: Beyond AOIs: Classification and prediction methods in gaze data analysis in biometrics, problem solving, and interaction.. ECEM 2011.

  146. Kamppuri, M., Bednarik, R. and Juntunen, A.: Haasteena k‰ytett‰vyys: Kotihoitoa tukevat et‰palvelut-hankkeen k‰ytett‰vyystutkimus. [in Finnish, Usability as a challenge. Usability study of eHealth Services Supporting Home Care - project]. Kajaani University of Applied Sciences reports B, Raportteja ja selvityksi‰ 11, 2008, ss. 39, ISBN 978-952-9853-6, ISSN 1458-915X.

  147. Bednarik, R., Jansen, A.: Eye-tracking and its applications in studies of programming. In Proceedings of the 19th Annual Workshop of the Psychology of Programming Interest Group (PPIG'07), Joensuu, Finland, July 2-6, 2007, pp. 255.

    Monographs

  148. Bednarik, R.: Methods to analyze visual attention strategies: Applications in the studies of programming. PhD thesis, Department of Computer Science and Statistics, University of Joensuu, 2007. Available for download from: ftp://cs.joensuu.fi/pub/Dissertations/bednarik.pdf

  149. Bednarik, R.: Towards an Eye-tracking Methodology for Studies of Programming. PhLic thesis, Department of Computer Science, University of Joensuu, 2006.