CURRICULUM VITAE, 1.6.2017

Roman Bednarik, PhD.
School of Computing, University of Eastern Finland, P.O. Box 111, FIN-80101, Finland
roman.bednarik@uef.fi http://cs.uef.fi/~rbednari
Education, Academic titles and degrees

2012: Docent (dosentti), April 2012, Interactive technologies, University of Eastern Finland.

2003 - 2007: Doctor of Philosophy, December 19th, 2007. Department of Computer Science and Statistics, University of Joensuu, Finland. Title of the thesis: Methods to analyze visual attention strategies: Applications in the studies of programming. Supervisor: prof. Markku Tukiainen.  

2006: Licentiate of Philosophy, May 2006, Dept. of Computer Science, University of Joensuu, Finland. Title of the thesis: Towards an Eye-tracking Methodology for Studies of Programming

2001 - 2002: Master of Science in Computer Science, December 2002. Dept. of Computer Science, University of Joensuu, Finland: IMPIT programme

 
Current position
2012 - 2017: senior researcher, University of Eastern Finland
 
Previous professional appointments
2014/07 - 2014/09: Seikei University, Japanvisiting researcher
2010 - 2013: University of Eastern Finlandpost-doctoral fellow
2013/05 - 2013/06:Simon Fraser University, Canadavisiting researcher, School of Computing Science
2011/01 - 2011/09:University of Pittsburgh, USAvisiting scholar, School of Information Sciences
2007/09 - 2009: University of Joensuuassistant professor (yliassistentti). Responsibilities: research, teaching, international master's programmes coordination (IMPIT, CBU, CIMET)
2006: Kabarak University, Kenyavisiting lecturer (HCI, usability), 1.5 months
2005:University of Pittsburgh, USAvisiting researcher at prof. Peter Brusilovsky's laboratory, School of Information Sciences
2005/07 - 2007/08:University of Joensuu, FinlandESCE graduate school researcher
2002 - 2005/06:University of Joensuu, Finlandresearcher
 
Major research funding and academic leadership
University of Eastern Finland, 9.000e, ERC preparatory grant, 2016
Academy of Finland, grant #305199, 232.583e, "Future Interactive Surgical Systems", 2016-2018, consortium leader, total funding 503.000e
Academy of Finland, grant #297964, 19.000e, "Improving programming education through understanding of reading strategies from large datasets", 2016-2017
Finnish Funding Agency for Innovation, TEKES, 241.500e, "G4M", 2015-2016
University of Eastern Finland, preparatory grant, 9.000e, 2015
Joensuu University Foundation, support funding, 1200e, 2014
Academy of Finland, grant #278809, 9.600e, "Conversational Involvement and Gaze", 2014.
Joensuu University Foundation, support funding, 1500e, 2013
University of Eastern Finland, seed funding, 12.000e, ERC proposal preparatory project, 2012
Academy of Finland, grant #137773, 304.100e, "Expertise and Engagement in Collaborative Tasks: Modeling and Support using Eye-Movement Tracking", 2011-2013. 21% acceptance.
Academy of Finland, grant #135590, 34.000e, "Eye-tracking to Study, Model, and Support Expertise and Engagement in Collaboration", 2010-2011.

Supervised academic works: 3 complete and 4 PhD theses in progress, 20+ MSc theses
Shahram Eivazi, Eye Gaze Patterns in Micro-neurosurgery: PhD thesis 2016 (with Markku Tukiainen). Now post-doc at TŸbingen, Germany.
Paul Orlov: Extrafoveal vision during source code comprehension : a gaze-contingent tool, a latency evaluation method, and experiments, PhD thesis 2016. Now post-doc at ICL.
Ana Gebejes: Spectral video and eye-tracking, PhD thesis 2017, (with Markku Hauta-Kasari)
Juha Lang: Eye-tracking in reading television subtitles, PhD thesis (with Jukka Makisalo).
Tersia // Gowases: Gaze-based interaction in problem-solving, PhD thesis
Hana Vrzakova: Computational approaches for eye-tracking data analysis, PhD thesis (with Markku Tukiainen)
Hoorieh Afkari: Interactive technologies for microneurosurgery OR, PhD thesis.
David Gil de G—mez: Interactive training systems for surgical eye-hand coordination, PhD thesis
Teaching experience

User-Centered Design, lecturer, 2017, UEF
Tietoverkot tietojenkasittelijoille/Computer networks for computer scientists, lecturer, 2016, UEF
Participatory and User-Centered Design, lecturer, Eritrean Institute of Technology, ict4eedu.org project, 2015,
Eye tracking, lecturer, 2013, 2015, UEF, Finland
Eye tracking and data analysis, lecturer (2011), NordForsk Research Training Course on Feedback, Communicative Gesturing and Gazing, University of Helsinki, Finland
Human Factors in System Design, lecturer (2011), University of Pittsburgh, USA

University of Joensuu, Finland: Requirements Engineering, lecturer (2009), User-Centered Design, lecturer (2009), Usability Engineering, lecturer (2006, 2008). 2002-2005 - teaching assistant in courses:
Design and Analysis of Algorithms, Mental and Other Representations, Artificial Intelligence, Object-oriented programming with Java, Theoretical foundations of computer science, Programming languages
Human-Computer Interaction, lecturer, 2006, Kabarak University, Kenya

Awards and honours
- Doctoral Dissertation Graduation Award, University of Joensuu, 2008.
- Best paper honorable mention ACM ETRA 2012 - Bednarik et al.: What you want to do next: A novel approach for intent prediction in gaze-based interaction.
- Ebco Eppich Fellowship, Simon Frazer University, Canada (March-April 2013).
- Best of CHI honorable mention (top 5%), ACM CHI, 2014, Jiang, X., Atkins, M. S., Tien, G., Bednarik, R., and Zheng, B.: Pupil Responses during Discrete Goal-directed Movements
- Premier Award for Excellence in Engineering Education, finalist candidate, 2007, with N. Myller, A. Moreno

Smaller grants and awards (sum ~ 70 000 e):
- FinCEAL travel grant, 900e, 2015
- East Finland Graduate School in Computer Science and Engineering - position 07/2005 - 12/2007
- Faculty of Science, University of Joensuu, post-graduate scholarship, 2003, 2004
- Emil Aaltosen Säätiö, scholarship, 2005
- PROLEARN Travel Grant, 2005
- TES - Tekniikan edistämissäätiö, scholarship, 2006
- PPIG, travel grant, 2006
Professional Duties and Activities
Docent (Adjunct professor): University of Eastern Finland, 2012 -

PhD thesis reviewer:
Ing. Tomas Kincl: Website user satisfaction: asymmetric effect of perceived website quality. 2008 (+ opponent).
Selina Sharmin: Eye Movements in Reading of Dynamic On-screen Text in Various Presentation Formats and Contexts. 2015.
Juan Pedro Lopez Velasco: Psychovisual model for improving video quality assessment metrics, 2015 (+opponent).
MSc. thesis reviewer (~15 MSc theses, 2006 - 2015)

Keynote: "Eye-tracking in studies of psychology of programming", Tobii eye-tracking seminar Finland, Hanken Swedish School of Economics, Helsinki. (June, 2006)
Reviewer, PC member, editor for: UMUAI, ACM TOCHI, ACM SIGCHI, Behavior Research Methods, BSC HCI, IJHCS, Eye Tracking Research & Applications, Pervasive Eye Tracking and Mobile Eye-Based Interaction, PPIG, Interacting with Computers, NordiCHI, Science of Computer Programming, Universal Access in the Information Society, PETMEI, Interaction Studies, ECEM (2011,2013), MMSym 2013, JEMR, Transactions on Education.
JEMR Special issue on PETMEI, 2014 (issue co-editor)
PPIG - procs. editor (2007, 2008). PPIG newsletter editor (2010)
Season of Usability 2008, 2009 - usability mentor.

Grant/position reviewer:
Internal Grant Agency, The University of Economics, Prague, 2010, 2011, Croatian Science Foundation, 2012, National Research Foundation, peer rating review, South Africa, 2015
Conference organizer: PPIG 2007 (co-organizer), Computer Science Days of Finnish Computer Science Society 2010 (organizer), DUET 2011 at ECSCW (co-organizer), DUET 2012 at ACM CSCW (co-organizer), GazeIn'13, GazeIn'14 at ACM ICMI (co-chair), 3rd International Workshop on Pervasive Eye Tracking and Mobile Eye-based Interaction (PETMEI 2013, co-chair), ACM ETRA'14 (poster chair), ACM ETRA 2016 - program chair, ACM ETRA 2018 - program chair.
Current research activities and impact
Human Behavioral and Physiological Data analysis
Eye-Movement Tracking Applications and Methodology, Data Intensive Eye-tracking Analysis
Gaze in Medical Applications
Design and Evaluation of Educational Environments, Program Visualization, Computer Science Education
111 publications, h-index = 20, 1330 citations
Professional Interests, positions of trust
Co-founder of United Users Ltd. unitedusers.fi
International Development - board member in i4DPeople OY
The Finnish Society for Computer Science - board member 2010, 2011, 2012
PROLEARN Associate member
North-Carelian Africa society RY: founding member, board member -2009.
 
 
Publications of Roman Bednarik

    Journals and Book Chapters

  1. Eivazi, S., Hafez, A., Fuhl, W., Afkari, H., Kasneci, E., Lehecka, M., Bednarik, R.: Optimal eye movement strategies: a comparison of neurosurgeons gaze patterns when using a surgical microscope. Acta Neurochirurgica, 2017.

  2. Orlov, P., Bednarik, R.: The role of extrafoveal vision in source code comprehension Perception 46(5), 2017.

  3. Afkari, H., Bednarik, R., Makela, S., Eivazi, S.: Mechanisms for Maintaining Situation Awareness in Micro-Neurosurgical Operating Room. International Journal of Human-Computer Studies, 2016. http://dx.doi.org/10.1016/j.ijhcs.2016.05.004

  4. Kajan, R., Herout, A., Bednarik, R., Povolny, F.: PeepList: Adapting Ex-Post Interaction with Pervasive Display Content Using Eye Tracking. Pervasive and Mobile Computing, 2016. http://dx.doi.org/10.1016/j.pmcj.2015.12.004

  5. Eivazi, S., Bednarik, R., Leinonen, V., von und Fraunberg, M., Jaaskelainen, J. E.: Embedding an Eye Tracker into a Surgical Microscope: Requirements, Design, and Implementation. IEEE Sensors, 2015. http://dx.doi.org/10.1109/JSEN.2015.2501237

  6. Orlov, P., Bednarik, R.: ScreenMasker: An open-source gaze-contingent screen masking environment. Behaviour Research Methods 48(3), 2016.

  7. Eivazi, S., Afkari, H., Bednarik, R., Leinonen, V., Tukiainen, M., Jaaskelainen, J.: Analysis of disruptive events and precarious situations caused by interaction with neurosurgical microscope. Acta Neurochirurgica 157(7), pp- 1147-1154, 2015. http://dx.doi.org/10.1007/s00701-015-2433-5

  8. Jiang, X., Zheng, B., Bednarik, R., Atkins, M.S.: Pupil responses to continuous aiming movements. International Journal of Human-Computer Studies 83, pp 1-11, 2015. http://dx.doi.org/10.1016/j.ijhcs.2015.05.006

  9. Bednarik, R., Krohns, J.: User-centered design practice and adoption in smaller ICT companies in Eastern Finland: An Interview Study. International Journal of Business Information Systems, 18(3), pp. 285- 298, 2015.

  10. Bednarik, R., Eivazi, S., Vrzakova, H.: A computational approach for prediction of problem-solving behavior using Support Vector Machines and eye-tracking data. In Eye Gaze in Intelligent User Interfaces - Gaze-based Analyses, Models, and Applications, Springer, pp. 111-134, 2013. ISBN 978-1-4471-4783-1. http://dx.doi.org/ 10.1007/978-1-4471-4784-8_7

  11. Bednarik, R., Gowases, T., Tukiainen, M.: Gaze-augmented interaction improves problem-solving: new evidence from verbal protocols. Behaviour & Information Technology 32 (8), 2013. http://dx.doi.org/10.1080/0144929X.2012.659216

  12. Bednarik, R.: Expertise-dependent Visual Attention Strategies Develop Over Time During Debugging with Multiple Code Representations. International Journal of Human - Computer Studies 70 (2012), pp. 143-155. http://dx.doi.org/10.1016/j.ijhcs.2011.09.003

  13. Ben-Ari, M., Bednarik, R., Ben-Bassat Levy, R., Ebel, G., Moreno, A., Myller, N., Sutinen, E.: A decade of research and development on program animation: The Jeliot experience. Journal of Visual Languages and Computing, 22, pp 375 - 384, 2011. doi:10.1016/j.jvlc.2 011.04.004

  14. Bednarik, R., Gowases, T., Tukiainen, M.: Gaze interaction enhances problem solving: Effects of dwell-time based, gaze-augmented, and mouse interaction on problem-solving strategies and user experience. Journal of Eye Movement Research, 3(1)3, 1-10, 2009. Available online: http://www.jemr.org/online/3/1/3

  15. Myller, N., Bednarik, R., Ben-Ari, M., Sutinen, E.: Extending the Engagement Taxonomy: Software Visualization and Collaborative Learning. ACM Transactions on Computing Education, 9(1), article 7, 2009.

  16. Randolph, J. J., & Bednarik, R.: Publication bias in the computer science education literature. Journal of Universal Computer Science, 14(4), 2008, pp. 575-589.

  17. Randolph, J. J., Rogers, P. C., Kakkonen, T., Myller, N., & Bednarik, R.: Emerging technologies for educational evaluation. In M. Ortiz & C. Rubio (Eds.) Educational Evaluation: 21st Century Issues and Challenges. Hauppauge, NY: Nova, 2009, pp. 417-442.

  18. Randolph, J.J., Julnes, G., Bednarik, R., & Sutinen, E.: A comparison of the methodological quality of articles in computer science education journals and conference proceedings. Computer Science Education, 17(4), 2007, pp. 263-274.

  19. Bednarik, R., Randolph, J.: Studying Cognitive Processes in Computer Program Comprehension. In Hammoud, R. I. (Ed): Passive Eye Monitoring: Algorithms, Applications and Experiments, Springer, ISBN 9783540754114, pp. 373-386, 2008.

  20. Bednarik, R., Moreno, A., Myller, N.: Program Visualization for Programming Education - Case of Jeliot 3. ACM NZ Bulletin, 2(2), ISSN 1176-9998, 2006. Avalailable online from http://is-alt.massey.ac.nz/acmnz/bulletin/vol2/issue2/

  21. Bednarik, R., Moreno, A., Myller, N.: Various Utilizations of an Open-Source Program Visualization Tool, Jeliot 3. Informatics in Education 5(2), 2006, pp. 195-206.

  22. Bednarik, R., Tukiainen, M.: Validating the Restricted Focus Viewer: A Study Using Eye-Movement Tracking. Behavior Research Methods, 39(2), 2007, pp. 274-282. Available online: http://brm.psychonomic-journals.org/content/39/2/274.full.pdf

  23. Bednarik, R., Myller, N., Sutinen, E., Tukiainen, M.: Analyzing Individual Differences in Program Comprehension. Technology, Instruction, Cognition and Learning (TICL), 3 (3-4), special issue on modeling and simulation, 2006, pp. 205-232.

    Books and Edited Proceedings

  24. Tamm, S., Bednarik, R., Busjahn, T., Schulte, C., Vrzakova, H., Budde, L. (Eds.): Eye Movements in Programming: Spring Academy 2017. Freie Universität Berlin, Department of Mathematics and Computer Science, Berlin, Germany, Technical Report TR-B-17-02, 2017. PDF

  25. Bednarik, R.; Busjahn, T.; Schulte, C.; Tamm, S. (Eds.): Eye Movements in Programming: Models to Data. University of Eastern Finland, Joensuu, Finland: Reports and Studies in Forestry and Natural Sciences, no 23, 2016. (ISBN: 978-952-61-2040-9)

  26. Busjahn, T., Schulte, C., Tamm, S., Bednarik, R.: Eye Movements in Programming Education II: Analyzing the Novice’s Gaze. Freie Universität Berlin, TR-B-15-01, 2015. PDF

  27. Huang, H.-H., Bednarik, R., Jokinen, K., Nakano, Y.: Gaze-in 2014: the 7th Workshop on Eye Gaze in Intelligent Human Machine Interaction. In Proceedings of the 16th International Conference on Multimodal Interaction (ICMI '14). ACM, New York, NY, USA, 527-528.

  28. Bednarik, R., Busjahn, T., Schulte, C.: Eye Movements in Programming Education: Analyzing the Expert's Gaze. Publications of the University of Eastern Finland. Reports and Studies in Forestry and Natural Sciences, no 18, ISBN: 978-952-61-1539-9. PDF

  29. Bednarik, R., Huang, H.-H., Nakano, Y., Jokinen, K.: GazeIn'13 -The 6th Workshop on Eye Gaze in Intelligent Human Machine Interaction. http://dx.doi.org/10.1145/2522848.2535892, 2013, ACM.

  30. Bednarik, R.: Computer Science Days 2010, the proceedings of the conference Tietojenkasittelytieteen paivat 2010, in Publications of the University of Eastern Finland. Reports and Studies in Forestry and Natural Sciences, vol 2, 2010. ISBN 978-952-61-0130-9.

  31. Buckley, J., Rooksby, J., Bednarik, R.: Proceedings of the 20th Annual Workshop of the Psychology of Programming Interest Group (PPIG08). Lancaster, UK, 2008. Lancaster University, ISBN 978-1-86220-215-3.

  32. Sajaniemi, J., Tukiainen, M., Bednarik, R., Nevalainen, S.: Proceedings of the 19th Annual Workshop of the Psychology of Programming Interest Group (PPIG07). Joensuu, Finland, July, 2007. International Proceedings Series 7, University of Joensuu, Department of Computer Science and Statistics.

    International Conferences with Referee Procedure

  33. Gil de Gómez, D., Bednarik, R.: CrowdPupil: A crowdsourced, pupil-center annotated image dataset In Proceedings of Cogain 2017

  34. Orlov, P., Bednarik, R., Orlova, L.: Programmers' experiences with working in the restricted-view mode as indications of parafoveal processing differences In Proceedings of PPIG 2016.

  35. Zheng, B., Jiang, X., Bednarik, R., Atkins, M. S.: Gaze Characteristics of Video Watching in a Surgical Setting IEEE 2nd Workshop on Eye Tracking and Visualization, pp- 11-15, 2016. https://doi.org/10.1109/ETVIS.2016.7851158

  36. Quang, D. N., Vrzakova, H., Bednarik, R.: WTP: Web-Tracking Plugin for Real-time Automatic AOI Annotations In Proceedings of PETMEI 2016.

  37. Gebejes, A., Fält, P., Bednarik, R., Hauta-Kasari, M.: SPEED: Spectral Eye Video Database In Proceedings of UbiComp '16 Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct, pp. 1666-1675. https://doi.org/10.1145/2968219.2968335

  38. Vrzakova, H., Bednarik, R., Nakano, Y., Nihei, F.: Speakers' head and gaze dynamics weakly correlate in group conversation Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications, pp. 77-84, ACM, 2016. http://dx.doi.org/10.1145/2857491.2857522

  39. Vrzakova, H., Bednarik, R.: Quiet Eye Affects Action Detection from Gaze more than Context Length In 2015 User Modelling, Adaptation and Personalization, pp. 277-288. PDF http://dx.doi.org/10.1007/978-3-319-20267-9_23

  40. Busjahn, T., Bednarik, R., Begel, A., Crosby, M., Peterson J., Schulte, C., Sharif, B., Tamm, S.: Eye Movements in Code Reading: Relaxing the Linear Order To appear in 23rd IEEE International Conference on Program Comprehension., 2015. PDF

  41. Vrzakova, H., Bednarik, R., Nihei, F., Nakano, Y.: Influential statements and gaze for persuasion modeling In the 8th Nordic Conference on Human-Computer Interaction, 2014., pp. 915-918, PDF http://dx.doi.org/10.1145/2639189.2670192

  42. Afkari, H., Eivazi, S., Bednarik, R., Makela, S.: The Potentials for Hands-free Interaction in Micro-neurosurgery In the 8th Nordic Conference on Human-Computer Interaction, 2014, pp. 401-410, http://dx.doi.org/10.1145/2639189.2639213 PDF

  43. Orlov, P., Bednarik, R.: Low-cost Latency Measurement System for Eye-mouse Software In the 8th Nordic Conference on Human-Computer Interaction, 2014, pp. 1085-1088, http://doi.acm.org/10.1145/2639189.2670282

  44. Busjahn, T., Schulte, C., Sharif, B., Simon, Begel, A., et al.: Eye tracking in computing education. In Proceedings of the tenth annual conference on International computing education research (ICER '14). ACM, pp. 3-10. http://doi.acm.org/10.1145/2632320.2632344

  45. Malmi, L., Sheard, J., Simon, Bednarik, R., et al.: Theoretical Underpinnings of Computing Education Research ? What is the Evidence? Accepted to ACM ICER 2014.

  46. Jiang, X., Atkins, M. S., Tien, G., Bednarik, R., and Zheng, B.: Pupil Responses during Discrete Goal-directed Movements. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems (CHI '14). ACM, New York, NY, USA, 2075-2084. http://dx.doi.org/10.1145/2556288.2557086. Best of CHI honorable mention.

  47. Jiang X., Atkins, M. S., Tien, G, Zheng, B., Bednarik, R.: Pupil dilations during target-pointing respect Fitt's Law. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '14). ACM, New York, NY, USA, 175-182. http://doi.acm.org/10.1145/2578153.2578178

  48. Dao, C., Bednarik, R., Vrzakova, H.: Heatmap Rendering from Large-scale Distributed Datasets using Cloud Computing. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '14). ACM, New York, NY, USA, 215-218. http://doi.acm.org/10.1145/2578153.2578187

  49. Tien, J., Atkins, M. S., Jiang, X., Zheng, B., Bednarik, R.: Verbal gaze instruction matches visual gaze guidance in laparoscopic skills training. In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '14). ACM, New York, NY, USA, 331-334. http://doi.acm.org/10.1145/2578153.2578217

  50. Busjahn, T., Bednarik, R., Schulte, C.: What influences dwell time during source code reading? Analysis of element type and frequency as factors In Proceedings of the Symposium on Eye Tracking Research and Applications (ETRA '14). ACM, New York, NY, USA, 335-338. http://doi.acm.org/10.1145/2578153.2578211

  51. Bednarik, R., Kauppinen, M.: Unravelling the Interaction Strategies and Gaze in Collaborative Learning with Online Video Lectures. In proceedings of GazeIn'13 -The 6th Workshop on Eye Gaze in Intelligent Human Machine Interaction, http://dx.doi.org/10.1145/2535948.2535959, ACM, 20013.

  52. Vrzakova, H., Bednarik, R.: EyeCloud: Cloud Computing for Pervasive Eye-Tracking In the proceedings of PETMEI 2013, 3rd International Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction, 2013. PDF

  53. Vrzakova, H., Bednarik, R.: That's not Norma(n/l)! A Detailed Analysis of Midas Touch in Gaze-based Problem-solving To appear in the proceedings of ACM CHI'13, 2013. PDF

  54. Mäkelä, S., Bednarik, R., Tukiainen, M.: Evaluating User Experience of Autistic Children through Video Observation. To appear in the proceedings of ACM CHI'13, 2013.

  55. Erkut, C., Bednarik, R., M‰kel‰, S., Kleimola, J.: Apps for Me, Too: Gaze and Natural Interaction Applications for Varying Cognitive Strengths on a Multi-touch Table Network To appear in the proceedings of the Gaze Interaction in the Post-WIMP World Workshop, CHI'13, 2013.

  56. Vrzakova, H., Bednarik, R.: Fast and Comprehensive Extension to Intention Prediction from Gaze In the proceedings of UI2013 Second Workshop on Interacting with Smart Objects, 2013. PDF.

  57. Bednarik, R., Orlov, P.: Investigating the role of programmers' peripheral vision: a gaze-contingent tool and an experiment proposal. In the proceedings of Psychology of Programming Interest Group PPIG 2012. PDF.

  58. Wang, P., Bednarik, R., Moreno, A.: During automatic program animation, explanations after animations have greater impact than before animations. In Proceedings of the 12th Koli Calling International Conference on Computing Education Research, pp. 100-109, 2012 http://dx.doi.org/10.11 45/2401796.2401808

  59. Bednarik, R., Herout, A.: What Students Want: A Study on the Role of Supervisor of Final Works in Computing Education . In Proceedings of the 12th Koli Calling International Conference on Computing Education Research, pp. 118-125, 2012 http://dx.doi.org/10.11 45/2401796.2401811

  60. Bednarik, R., Eivazi, S., Hradis, M.: Gaze and Conversational Engagement in Multiparty Video Conversation: An annotation scheme and classification Gaze-In '12 Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction, Article 10, 2012. http://dx.doi.org/10.1145/2401836.2401846

  61. Vrzakova, H., Bednarik, R.: Hard lessons learned: Mobile eye-tracking in cockpits Gaze-In '12 Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction, Article 7, 2012. http://dx.doi.org/10.1145/2401836.2401843

  62. Bednarik, R., Shipilov, A.: Usability of gaze-transfer in collaborative programming: How and when could it work, and some implications for research agenda. In proceedings of DUET 2012, Dual Eye-Tracking in CSCW. PDF

  63. Bednarik, R., Vrzakova, H., Hradis, M.: What you want to do next: A novel approach for intent prediction in gaze-based interaction. In proceedings of ETRA'12, pp. 83-90. http://dx.doi.org/10.11 45/2168556.2168569 Best paper honorable mention.

  64. Hradis, M., Eivazi, S., Bednarik, R.: Voice activity detection in video mediated communication from gaze. In proceedings of ETRA'12, pp. 329-332. http://dx.doi.org/10.11 45/2168556.2168628

  65. Eivazi, S., Bednarik, R., Tukiainen, M., von und zu Fraunberg, M., Leinonen, V., J‰‰skel‰inen J.: Gaze Behaviour of Expert and Novice Microneurosurgeons Differs During Observations of Tumor Removal Recordings. In proceedings of 2012 ACM ETRA'12, pp. 377-380. http://dx.doi.org/10.11 45/2168556.2168641

  66. Bednarik, R., Shipilov, A.: Gaze Cursor During Distant Collaborative Programming: A Preliminary Analysis. In the proceedings of DUET 2011: Dual Eye Tracking in CSCW, 2011. ECSCW 2011. PDF

  67. Gowases, T., Bednarik, R., Tukiainen, M.: Text highlighting improves user experience for reading with magnified displays. In the proceedings of Extended Abstracts of ACM CHI, pp. 1891-1896, 2011. http://dx.doi.org/10.1145/1979742.1979917

  68. Bednarik, R., Shipilov, A., Pietinen, S.: Bidirectional Gaze in Remote Computer Mediated Collaboration: Setup and Initial Results from Pair-Programming In the proceedings of the Computer Supported Cooperative Work, CSCW, ACM, pp. 597-600, 2011. http://dx.doi.org/10.1145/1958824.1958923

  69. Eivazi, S., Bednarik, R.: Predicting Problem-Solving Behavior and Performance Levels from Visual Attention Data In the proceedings of 2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction at IUI 2011, pp 9-16, 2011. PDF

  70. Eivazi, S., Bednarik, R.: Inferring Problem Solving Strategies Using Eye-Tracking: System Description and Evaluation. Proceedings of the 10th Koli Calling International Conference on Computing Education Research. Koli Calling'10, New York, NY, USA, ACM, 2010, pp. 55-61, http://dx.doi.org/10.1145/1930464.1930472

  71. Malmi, L., Sheard, J., Simon, Bednarik, R., Helminen, J., Korhonen, A., Myller, N., Sorva, J., Taherkhani, A.: Characterizing research in computing education: a preliminary analysis of the literature. In the proceedings of ACM ICER 2010, pp. 3-12. http://doi.acm.org/10.1145/1839594.1839597

  72. Pietinen, S., Bednarik, R. and Tukiainen, M.: Eye-tracking in Collaborative settings: Setup and Descriptive analysis. The 5th Scandinavian Workshop on Applied Eye-Tracking, SWAET 2010, Lund University, May 5-7 2010, p. 38.

  73. Pietinen, S., Bednarik, R., Tukiainen, M.: Shared Visual Attention in Collaborative Programming: A Descriptive Analysis. ACM/IEEE 32nd International Conference on Software Engineering, ICSE 2010, Cooperative and Human Aspects of Software Engineering, CHASE 2010, Workshop at the ICSE 2010, May 2nd 2010, Cape Town, South Africa.

  74. Kinnunen, T., Sedlak, F., Bednarik, R.: Towards Task-Independent Person Authentication Using Eye Movement Signals. In the Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, ETRA'10, ACM, pp. 187-190.

  75. Pietinen, S., Bednarik, R., Tukiainen, M.: An Exploration of Shared Visual Attention in Collaborative Programming. In Proceedings of the 21th Annual Workshop of the Psychology of Programming Interest Group (PPIG'09), Limerick, Ireland, pp. 134-135. Available online: http://www.ppig.org/papers/21st-pietinen.pdf

  76. Duveskog, M., Bednarik, R., Sutinen, R., Kemppainen, K.: Designing a Story-Based Platform for HIV/AIDS Counseling with Tanzanian Children. In Proceedings of the 8th ACM International Conference on Interaction Design and Children, pp. 27-35, 2009.

  77. Gowases, T., Bednarik, R., Tukiainen, M.: Gaze vs. Mouse in Games: The Effects on User Experience. In Proceedings of The 16th International Conference on Computers in Education, ICCE 2008, pp. 773 - 777.

  78. Nuutinen, J., Bednarik, R., Sutinen, E.: A Layered Approach to the Development Process of Social Mindtools. In Proceedings of ED-Media 2008, pp. 2109-2118.

  79. Bednarik, R., Tukiainen, M.: Temporal Eye-Tracking Data: Evolution of Debugging Strategies with Multiple Representations. In Proceedings of the 2008 Symposium on Eye Tracking Research & Applications (Savannah, Georgia, March 26 - 28, 2008). ETRA '08. ACM, New York, NY, pp. 99-102.

  80. Pietinen, S., Bednarik, R., Glotova, T., Tenhunen, V., Tukiainen M.: A Method to Study Visual Attention Aspects of Collaboration: Eye-Tracking Pair Programmers Simultaneously. In Proceedings of the 2008 Symposium on Eye Tracking Research & Applications (Savannah, Georgia, March 26 - 28, 2008). ETRA '08. ACM, New York, NY, pp. 39-42.

  81. Moreno, A., Sutinen, E., Bednarik, R. and Myller, N. (2007): Conflictive animations as engaging learning tools. In Proc. Seventh Baltic Sea Conference on Computing Education Research (Koli Calling 2007), Koli National Park, Finland. CRPIT, 88. Lister, R. and Simon, Eds., ACS. pp. 203-206.

  82. Bednarik, R., Tukiainen, M.: Analysing and Interpreting Quantitative Eye-Tracking Data in Studies of Programming: Phases of Debugging with Multiple Representations. In Proceedings of the 19th Annual Workshop of the Psychology of Programming Interest Group (PPIG'07), Joensuu, Finland, July 2-6, 2007, pp. 158-172.

  83. Myller, N., Bednarik, R., Moreno, A.: Integrating Dynamic Program Visualization into BlueJ: the Jeliot 3 extension. In proceedings of IEEE ICALT 2007, IEEE Computer Society, 2007, pp. 505-506.

  84. Moreno, A., Bednarik, R., Yudelson, M.: How to Adapt the Visualization of Programs? UM'2007 workshop 2, 11th International Conference on User Modeling: Personalisation in e-learning environments at individual and group level, PING'07. Corfu, Greece, June 25-29, 2007, pp. 65-70.

  85. Bednarik, R., Kamppuri, M., Tedre, M., Vesisenaho, M.: Alternative to Technology-Driven Development: An Approach Based on Authentic Needs. Presented at the Workshop on User Centred Design and International Development to be held on 28th April 2007, CHI2007.

  86. Kamppuri, M., Bednarik, R., Tukiainen, M.: The Expanding Focus of Design: Case Culture. In proceedings of NordiCHI 2006, The Fourth Nordic Conference on Human-Computer Interaction. Oslo, Norway, 2006, ACM Press, pp. 405-408.

  87. Bednarik, R., Myller, N., Sutinen, E., Tukiainen, M.: Program Visualisation: Comparing Eye-tracking Patterns with Comprehension Summaries and Performance. In proceedings of the 18th Annual Workshop of the Psychology of Programming Interest Group (PPIG'06), Brighton, UK, September 7-8, 2006, pp. 68-82.

  88. Myller, N., Bednarik, R.: Methodologies for Studies of Program Visualization. In proceedings of Methods, Materials and Tools for Programming Education (MMT2006), Tampere, Finland, May 4-5, 2006, pp. 37-42.

  89. Bednarik, R., Tukiainen, M.: An Eye-tracking Methodology for Characterizing Program Comprehension. In Proceedings the 2006 Symposium on Eye Tracking Research and Applications, ETRA 2006, March 27-29, San Diego, CA, USA, ACM Press, pp. 125 - 132.

  90. Randolph, J. J., Bednarik, R. and Myller, N.: A Methodological Review of the Articles Published in the Proceedings of Koli Calling 2001-2004. In Proceedings of Koli Calling 2005: 5th Annual Finnish / Baltic Sea Conference on Computer Science Education. November 17 - November 20, 2005, pp. 103-109.

  91. Moreno, A., Myller, N. and Bednarik, R.: Jeliot 3, an Extensible Tool for Program Visualization. In Proceedings of Koli Calling 2005: 5th Annual Finnish / Baltic Sea Conference on Computer Science Education. November 17 - November 20, 2005, pp. 183-184.

  92. Bednarik, R., Joy, M., Moreno, A., Myller, N., Sun, S., Sutinen, E.: Multi-Agent Educational System for Program Visualization. In proceedings of the International Conference on Intelligent Agents, Web Technology and Internet Commerce (IAWTIC'2005), 28 - 30 November 2005, Vienna, Austria, IEEE Computer Society, pp. 283 - 288.

  93. Bednarik, R., Myller, N., Sutinen, E., Tukiainen, M.: Applying Eye-Movement Tracking to Program Visualization. In proceedings of 2005 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC'05), Dallas, Texas, USA, September 21-24, 2005, IEEE Computer Society, pp. 302-304.

  94. Bednarik, R.: Potentials of Eye-Movement Tracking in Adaptive Systems. In the Proceedings of the Fourth Workshop on the Evaluation of Adaptive Systems, held in conjunction with the 10th International Conference on User Modeling (UM'05), Edinburgh, UK, July 24th to 30th, 2005, pp. 1-8.

  95. Bednarik, R., Myller, N., Sutinen, E., Tukiainen, M.: Effects of Experience on Gaze Behaviour during Program Animation. In proceedings of the 17th Annual Psychology of Programming Interest Group Workshop (PPIG'05), Brighton, UK, June 28 - July 1, 2005, pp. 49-61.

  96. Randolph, J. J., Bednarik, R., Silander, P., Gonzalez, J., Myller, N., and Sutinen, E.: A Critical Analysis of the Research Methodologies Reported in the Full Papers of the Proceedings of ICALT 2004. In proceedings of the 5th IEEE International Conference on Advanced Learning Technologies (ICALT 2005), Kaohsiung, Taiwan, July 5-8, 2005, IEEE Computer Society, pp. 10-14.

  97. Bednarik, R., Moreno, A., Myller, N., Sutinen, E.: Smart Program Visualization Technologies: Planning a Next Step. In proceedings of the 5th IEEE International Conference on Advanced Learning Technologies (ICALT 2005), Kaohsiung, Taiwan, July 5-8, 2005, IEEE Computer Society, pp. 717-721.

  98. Bednarik, R., Kinnunen, T., Mihaila, A., Fr‰nti, P.: Eye-Movements as a Biometric. In Proceedings of the 14th Scandinavian Conference on Image Analysis, SCIA 2005, Joensuu, Finland, June 19-22, 2005. Lecture Notes in Computer Science, Vol. 3540, Springer, 2005, pp. 780-789.

  99. Bednarik, R., Tukiainen, M.: Effects of Display Blurring on the Behavior of Novices and Experts during Program Debugging. In CHI '05 extended abstracts on Human factors in computing systems, CHI 2005, Portland, Oregon, USA, April 2-7, 2005, ACM Press, pp. 1204-1207.

  100. Bednarik, R., Tukiainen, M.: Visual Attention Tracking During Program Debugging. In Proceedings of NordiCHI 2004, The Third Nordic Conference on Human-Computer Interaction, October 23-27, 2004, Tampere, Finland, ACM Press, pp. 331-334.

  101. Bednarik, R. & Tukiainen, M.: Visual Attention and Representation Switching in Java Program Debugging: A Study Using Eye Movement Tracking. In Proceedings of 16th Annual Psychology of Programming Interest Group Workshop (PPIG'04), Institute of Technology Carlow, Ireland, April 5-7, 2004, pp. 159-169.

  102. Bednarik, R., Fr‰nti, P.: Survival of Students with Different Learning Preferences. The 4th Annual Finnish / Baltic Sea Conference on Computer Science Education, Koli, Finland, October 1-3, 2004, pp. 121-125.

  103. Bednarik, R., Gerdt, P., Miraftabi, R., Tukiainen, M.: Development of the TUP Model - Evaluating Educational Software. In Proceedings of the 4th IEEE International Conference on Advanced Learning Technologies (ICALT 2004), Joensuu, Finland, August 30 - September 1, 2004, IEEE Computer Society, pp. 699-701.

  104. Bednarik, R.: Problem-Based Learning in Teaching Theoretical Computer Science. In Proceedings of the International Conference on Engineering Education and Research Conference iCEER 2004, Olomouc, Czech Republic, June 27-30, 2004, pp. 801-807, CD-ROM.

    National Conferences with Referee Procedure

  105. Bednarik, R., Marjomaa E., La Russa, G.: Logical Variability in Tutors and Evaluators. In Proceedings of the ITK'04 Workshop on Educational Technology Research, April 20-22, H‰meenlinna, Finland, 2005. pp. 48-49.

    Tutorials and Technical Reports, Other Publications

  106. Tsukuda, M., Bednarik, R., Hauta-Kasari, M., Nakauchi, S.: Static cues for mirror-glass discrimination explored by gaze distribution. In European Conference on Visual Perception, ECVP 2016.

  107. Bednarik, R., Kinnunnen, T., Eivazi, S., Sedlak, F., & Vrzakova, H.: Beyond AOIs: Classification and prediction methods in gaze data analysis in biometrics, problem solving, and interaction.. ECEM 2011.

  108. Kamppuri, M., Bednarik, R. and Juntunen, A.: Haasteena k‰ytett‰vyys: Kotihoitoa tukevat et‰palvelut-hankkeen k‰ytett‰vyystutkimus. [in Finnish, Usability as a challenge. Usability study of eHealth Services Supporting Home Care - project]. Kajaani University of Applied Sciences reports B, Raportteja ja selvityksi‰ 11, 2008, ss. 39, ISBN 978-952-9853-6, ISSN 1458-915X.

  109. Bednarik, R., Jansen, A.: Eye-tracking and its applications in studies of programming. In Proceedings of the 19th Annual Workshop of the Psychology of Programming Interest Group (PPIG'07), Joensuu, Finland, July 2-6, 2007, pp. 255.

    Monographs

  110. Bednarik, R.: Methods to analyze visual attention strategies: Applications in the studies of programming. PhD thesis, Department of Computer Science and Statistics, University of Joensuu, 2007. Available for download from: ftp://cs.joensuu.fi/pub/Dissertations/bednarik.pdf

  111. Bednarik, R.: Towards an Eye-tracking Methodology for Studies of Programming. PhLic thesis, Department of Computer Science, University of Joensuu, 2006.