close
Skip to main content
Springer Nature Link
Log in

Individualized Learning Patterns Require Individualized Conversations – Data-Driven Insights from the Field on How Chatbots Instruct Students in Solving Exercises

  • Conference paper
  • First Online:
Save conference paper
View saved research
Chatbot Research and Design (CONVERSATIONS 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 13171))

Included in the following conference series:

  • 3218 Accesses

  • 8 Citations

Abstract

Chatbots can foster the learning success of students in educational settings. This has been shown in prior research studies, e.g., using laboratory studies in online learning settings. Actual evaluations of using educational chatbots in the field are nevertheless rarely reported. Thus, insights into the students’ interactions with chatbots in long-term field settings are missing. In this research study, we aim at gaining insights into the students’ interactions with an educational chatbot in a programming course. To this aim, we follow an explorative data-driven discourse analysis approach and show how students interacted with the chatbot during a field study lasting several months. We ground our analysis on a dataset from 54 students interacting with a chatbot while working on programming exercise tasks. We reveal how students interact with the chatbot and identify different types of usage patterns. The results imply that adaptive learning paths are one of the most important aspects of educational chatbot design for dealing with heterogeneous usage patterns.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+
from $39.99 /Month
  • Starting from 10 chapters or articles per month
  • Access and download chapters and articles from more than 300k books and 2,500 journals
  • Cancel anytime
View plans

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 54.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 69.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Free shipping worldwide - view details

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Explore related subjects

Discover the latest articles, books and news in related subjects, suggested using machine learning.

References

  1. Winkler, R., Hobert, S., Salovaara, A., Söllner, M., Leimeister, J.M.: Sara, the Lecturer: improving learning in online education with a scaffolding-based conversational agent. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. CHI 2020, pp. 1–14. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3313831.3376781

  2. Maedche, A., et al.: AI-based digital assistants. Bus. Inf. Syst. Eng. 61(4), 535–544 (2019). https://doi.org/10.1007/s12599-019-00600-8

    Article  Google Scholar 

  3. Wollny, S., Schneider, J., Di Mitri, D., Weidlich, J., Rittberger, M., Drachsler, H.: Are we there yet? - A systematic literature review on chatbots in education. Front. Artif. Intell. 4 (2021). https://doi.org/10.3389/frai.2021.654924

  4. Hobert, S.: How are you, chatbot? Evaluating chatbots in educational settings – results of a literature review. In: Pinkwart, N., Konert, J. (eds.) DELFI 2019, pp. 259–270. Gesellschaft für Informatik e.V, Bonn (2019). https://doi.org/10.18420/delfi2019_289

  5. Følstad, A., et al.: Future directions for chatbot research: an interdisciplinary research agenda. Computing 103(12), 2915–2942 (2021). https://doi.org/10.1007/s00607-021-01016-7

    Article  Google Scholar 

  6. Hobert, S.: Say hello to ‘coding tutor’! Design and evaluation of a chatbot-based learning system supporting students to learn to program. In: ICIS 2019 Proceedings, pp. 1–17 (2019)

    Google Scholar 

  7. Hobert, S., Meyer von Wolff, R.: Say hello to your new automated tutor – a structured literature review on pedagogical conversational agents. In: Proceedings of the 14th International Conference on Wirtschaftsinformatik, pp. 301–314. Siegen (2019)

    Google Scholar 

  8. Tegos, S., Demetriadis, S., Karakostas, A.: MentorChat: introducing a configurable conversational agent as a tool for adaptive online collaboration support. In: 2011 15th Panhellenic Conference on Informatics, pp. 13–17. IEEE (2011). https://doi.org/10.1109/PCI.2011.24

  9. Graesser, A.C., Cai, Z., Morgan, B., Wang, L.: Assessment with computer agents that engage in conversational dialogues and trialogues with learners. Comput. Hum. Behav. 76, 607–616 (2017). https://doi.org/10.1016/j.chb.2017.03.041

    Article  Google Scholar 

  10. Catania, F., Spitale, M., Cosentino, G., Garzotto, F.: Conversational agents to promote children’s verbal communication skills. In: Følstad, A., et al. (eds.) CONVERSATIONS 2020. LNCS, vol. 12604, pp. 158–172. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-68288-0_11

    Chapter  Google Scholar 

  11. Wambsganss, T., Soellner, M., Leimeister, J.M.: Design and evaluation of an adaptive dialog-based tutoring system for argumentation skills. In: ICIS 2020 Proceedings, Paper 2 (2020)

    Google Scholar 

  12. Brandtzaeg, P.B., Følstad, A.: Chatbots: changing user needs and motivations. Interactions 25, 38–43 (2018). https://doi.org/10.1145/3236669

  13. Følstad, A., Brandtzaeg, P.B.: Users’ experiences with chatbots: findings from a questionnaire study. Qual. User Exp. 5(1), 1–14 (2020). https://doi.org/10.1007/s41233-020-00033-2

    Article  Google Scholar 

  14. Weizenbaum, J.: ELIZA - a computer program for the study of natural language communication between man and machine. Commun. ACM 9, 36–45 (1966). https://doi.org/10.1145/365153.365168

    Article  Google Scholar 

  15. Diederich, S., Brendel, A.B., Kolbe, L.M.: Designing anthropomorphic enterprise conversational agents. Bus. Inf. Syst. Eng. 62(3), 193–209 (2020). https://doi.org/10.1007/s12599-020-00639-y

    Article  Google Scholar 

  16. Winkler, R., Söllner, M.: Unleashing the potential of chatbots in education: a state-of-the-art analysis. In: Academy of Management Annual Meeting (AOM). Chicago (2018)

    Google Scholar 

  17. Ruan, S., et al.: QuizBot: a dialogue-based adaptive learning system for factual knowledge. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–13. ACM, New York (2019). https://doi.org/10.1145/3290605.3300587

  18. Meyer von Wolff, R., Hobert, S., Masuch, K., Schumann, M.: Chatbots at digital workplaces - a grounded-theory approach for surveying application areas and objectives. Pac. Asia J. Assoc. Inf. Syst. 12, 64–102 (2020). https://doi.org/10.17705/1pais.12203

  19. Kim, M.C., Hannafin, M.J.: Scaffolding problem solving in technology-enhanced learning environments (TELEs): bridging research and theory with practice. Comput. Educ. 56, 403–417 (2011). https://doi.org/10.1016/j.compedu.2010.08.024

    Article  Google Scholar 

  20. van de Pol, J., Volman, M., Beishuizen, J.: Scaffolding in teacher-student interaction: a decade of research. Educ. Psychol. Rev. 22, 271–296 (2010). https://doi.org/10.1007/s10648-010-9127-6

    Article  Google Scholar 

  21. Chi, M.T.H., Wylie, R.: The ICAP framework: linking cognitive engagement to active learning outcomes. Educ. Psychol. 49, 219–243 (2014). https://doi.org/10.1080/00461520.2014.965823

    Article  Google Scholar 

  22. Hobert, S., Berens, F.: Small talk conversations and the long-term use of chatbots in educational settings – experiences from a field study. In: Følstad, A., et al. (eds.) CONVERSATIONS 2019. LNCS, vol. 11970, pp. 260–272. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-39540-7_18

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Goettingen, Goettingen, Germany

    Sebastian Hobert

  2. Campus Institute Data Science, Goettingen, Germany

    Sebastian Hobert

Authors
  1. Sebastian Hobert
    View author publications

    Search author on:PubMed Google Scholar

Corresponding author

Correspondence to Sebastian Hobert.

Editor information

Editors and Affiliations

  1. SINTEF, Oslo, Norway

    Asbjørn Følstad

  2. VU Amsterdam, Amsterdam, The Netherlands

    Theo Araujo

  3. CERTH-ITI, Thessaloniki, Greece

    Symeon Papadopoulos

  4. Durham University, Durham, UK

    Effie L.-C. Law

  5. University of Edinburgh, Edinburgh, UK

    Ewa Luger

  6. Center for Artificial Intelligence Research, University of Agder, Kristiansand, Norway

    Morten Goodwin

  7. University of Oslo, Oslo, Norway

    Petter Bae Brandtzaeg

Rights and permissions

Reprints and permissions

Copyright information

© 2022 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Hobert, S. (2022). Individualized Learning Patterns Require Individualized Conversations – Data-Driven Insights from the Field on How Chatbots Instruct Students in Solving Exercises. In: Følstad, A., et al. Chatbot Research and Design. CONVERSATIONS 2021. Lecture Notes in Computer Science(), vol 13171. Springer, Cham. https://doi.org/10.1007/978-3-030-94890-0_4

Download citation

Keywords

Publish with us

Policies and ethics