Skip to main content
Springer Nature Link
Log in

Effects of an AI-Guided Musical Blocks System on Children's Learning Engagement and Emotions

  • Conference paper
  • First Online:
Learning and Collaboration Technologies (HCII 2025)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 15806))

Included in the following conference series:

  • 227 Accesses

Abstract

This study presents the development of an innovative music learning system that integrates artificial intelligence-based image recognition technology, employing interactive musical storybooks and intelligent musical blocks as core pedagogical tools to establish a novel digital learning paradigm for musical literacy. Using a quasi-experimental design, 27 participants aged 7–12 years were randomly assigned to experimental and control groups. The system integrates Robflow’s image recognition technology with the YOLOv11 deep learning model, achieving 99.5% mean precision in musical note recognition tasks. Analysis using the Achievement Emotions Questionnaire (AEQ) revealed that the experimental group exhibited significantly higher positive emotions (enjoyment, hope, and pride) while demonstrating notable reductions in negative emotions (boredom, shame, and hopelessness). From a human-computer interaction perspective, the system employs CNC precision machining and epoxy resin filling techniques to develop transparent musical blocks that blend aesthetics with functionality. The research validates the feasibility and effectiveness of AI-assisted music education in fostering musical literacy, providing new directions for future digital interactive learning development.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
€34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (Germany)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 69.54
Price includes VAT (Germany)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 87.73
Price includes VAT (Germany)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

') var buybox = document.querySelector("[data-id=id_"+ timestamp +"]").parentNode var buyingOptions = buybox.querySelectorAll(".buying-option") ;[].slice.call(buyingOptions).forEach(initCollapsibles) var buyboxMaxSingleColumnWidth = 480 function initCollapsibles(subscription, index) { var toggle = subscription.querySelector(".buying-option-price") subscription.classList.remove("expanded") var form = subscription.querySelector(".buying-option-form") var priceInfo = subscription.querySelector(".price-info") var buyingOption = toggle.parentElement if (toggle && form && priceInfo) { toggle.setAttribute("role", "button") toggle.setAttribute("tabindex", "0") toggle.addEventListener("click", function (event) { var expandedBuyingOptions = buybox.querySelectorAll(".buying-option.expanded") var buyboxWidth = buybox.offsetWidth ;[].slice.call(expandedBuyingOptions).forEach(function(option) { if (buyboxWidth buyboxMaxSingleColumnWidth) { toggle.click() } else { if (index === 0) { toggle.click() } else { toggle.setAttribute("aria-expanded", "false") form.hidden = "hidden" priceInfo.hidden = "hidden" } } }) } initialStateOpen() if (window.buyboxInitialised) return window.buyboxInitialised = true initKeyControls() })()

Institutional subscriptions

Similar content being viewed by others

References

  1. Akçayır, M., Dündar, H., Akçayır, G.: What makes you a digital native? is it enough to be born after 1980? Comput. Hum. Behav. 60, 435–440 (2016)

    Article  Google Scholar 

  2. Vodanovich, S., Sundaram, D., Myers, M.: Research commentary digital natives and ubiquitous information systems. Inf. Syst. Res. 21, 711–723 (2010)

    Article  Google Scholar 

  3. Prensky, M.H.: Sapiens digital: from digital immigrants and digital natives to digital wisdom. Innovate: J. online Edu. 5(3) (2009)

    Google Scholar 

  4. Li, H.: Piano education of children using musical instrument recognition and deep learning technologies under the educational psychology. Front. Psychol. 12 (2021)

    Google Scholar 

  5. McPherson, G.E.: Giftedness and talent in music. J. Aesthetic Educ. 31(4), 65–77 (1997)

    Article  Google Scholar 

  6. He, Y.: Practical teaching of college music courses based on vocal rhythmic pedagogy. Appl. Math. Nonlinear Sci. 9 (2024)

    Google Scholar 

  7. Woody, R.H.: Musicians’ use of harmonic cognitive strategies when playing by ear. Psychol. Music 48(5), 674–692 (2020)

    Article  Google Scholar 

  8. Yafie, E., et al.: Supporting cognitive development through multimedia learning and scientific approach: an experimental study in preschool. Univ. J. Educ. Res. 8(11), 113–123 (2020)

    Google Scholar 

  9. Paule-Ruiz, M., et al.: Music learning in preschool with mobile devices. Behav. Inf. Technol. 36(1), 95–111 (2017)

    Google Scholar 

  10. Dotsenko, S., Zhang, Y.: Multimedia technologies in music education of preschool children. New Collegium (2023)

    Google Scholar 

  11. Turyamureeba, S.: Integrating music education into the curriculum for cognitive development. J. Res. Educ. 4, 50–54 (2024)

    Google Scholar 

  12. Shore, R.A.: Music and cognitive development: from notes to neural networks. NHSA DIALOG 13(1), 53–65 (2010)

    Article  Google Scholar 

  13. Liu, J.: An automatic classification method for multiple music genres by integrating emotions and intelligent algorithms. Appl. Artif. Intell. 37(1), 2211458 (2023)

    Article  Google Scholar 

  14. Shi, S.: Research on the innovation path of music education in higher vocational colleges and universities in the context of the new era. Appl. Math. Nonlinear Sci. 9 (2024)

    Google Scholar 

  15. Zhang, N.: Informatization integration strategy of modern vocal music teaching and traditional music culture in colleges and universities in the era of artificial intelligence. Appl. Math. Nonlinear Sci. 9 (2023)

    Google Scholar 

  16. LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436–444 (2015)

    Article  Google Scholar 

  17. O′Shea, K.: An introduction to convolutional neural networks. arXiv preprint arXiv:1511.08458 (2015)

  18. Li, Z., et al.: A survey of convolutional neural networks: analysis, applications, and prospects. IEEE Trans. Neural Netw. Learn. Syst. 33(12), 6999–7019 (2021)

    Article  MathSciNet  Google Scholar 

  19. Baldovino, R.G., et al.: A visual aid system using image processing and deep learning with audio haptic feedback for the blind and visually-impaired. Procedia Comput. Sci. 246, 2974–2983 (2024)

    Article  Google Scholar 

  20. Halder, S., et al.: AI-based seagrass morphology measurement. J. Environ. Manage. 369, 122246 (2024)

    Article  Google Scholar 

  21. Kumar, M., et al.: YOLOv5x-based brain tumor detection for healthcare applications. Procedia Comput. Sci. 233, 950–959 (2024)

    Article  Google Scholar 

  22. Soni, V., et al.: Introducing AOD 4: a dataset for air borne object detection. Data Brief 56, 110801 (2024)

    Article  Google Scholar 

  23. Agarwal, V., Bansal, G.: Automatic number plate detection and recognition using YOLO world. Comput. Electr. Eng. 120, 109646 (2024)

    Article  Google Scholar 

  24. Amin, A.L., Chimba, D., Hasan, K.: Integrating AI and edge computing for advanced safety at railroad grade crossings. J. Rail Transport Planning Manag. 33, 100501 (2025)

    Article  Google Scholar 

  25. Du, J.: Understanding of object detection based on CNN family and YOLO. In: Journal of Physics: Conference Series. IOP Publishing (2018)

    Google Scholar 

  26. Bahhar, C., et al.: Wildfire and smoke detection using staged YOLO model and ensemble CNN. Electronics (2023)

    Google Scholar 

  27. El-Bana, S., Al-Kabbany, A., Sharkas, M.: A multi-task pipeline with specialized streams for classification and segmentation of infection manifestations in COVID-19 scans. PeerJ Comput. Sci. 6, e303 (2020)

    Article  Google Scholar 

  28. Li, M., et al.: Agricultural greenhouses detection in high-resolution satellite images based on convolutional neural networks: comparison of faster R-CNN, YOLO v3 and SSD. Sensors 20 (2020)

    Google Scholar 

  29. Liu, Y., et al.: Attention to task-aligned object detection for end–edge–cloud video surveillance. IEEE Internet Things J. 11, 13781–13792 (2024)

    Article  Google Scholar 

  30. Liao, J., Hansen, P., Chai, C.: A framework of artificial intelligence augmented design support. Hum. Comput. Interact. 35(5–6), 511–544 (2020)

    Article  Google Scholar 

  31. Shanshan, S., Sen, G.: Empowering learners with AI-generated content for programming learning and computational thinking: the lens of extended effective use theory. J. Comput. Assist. Learn. 40(4), 1941–1958 (2024)

    Article  Google Scholar 

  32. Li, J., et al.: What does artificial intelligence generated content bring to teaching and learning? a literature review on AIGC in education. In: 2024 International Symposium on Educational Technology. IEEE (2024)

    Google Scholar 

  33. Choi, A.E., et al.: SKIMusic: a mobile sheet music player. in DLSU research congress (2017)

    Google Scholar 

  34. Koong Lin, H.C., et al.: Application of WSQ (watch-summary-question) flipped teaching in affective conversational robots: impacts on learning emotion, self-directed learning, and learning effectiveness of senior high school students. Int. J. Hum. Comput. Interact. 1–18 (2024)

    Google Scholar 

  35. Plass, J.L., Homer, B.D., Kinzer, C.K.: Foundations of game-based learning. Educ. Psychol. 50(4), 258–283 (2015)

    Article  Google Scholar 

  36. Wu, T.T., et al.: Leveraging computer vision for adaptive learning in STEM education: Effect of engagement and self-efficacy. Int. J. Educ. Technol. High. Educ. 20(1), 53 (2023)

    Article  Google Scholar 

Download references

Acknowledgments

This research work was funded by the National Science and Technology Council, Taiwan, under the Undergraduate Student Research Program, with grant number NSTC 113–2813-C-218–003-H.

Author information

Authors and Affiliations

  1. Department of Information and Learning Technology, National University of Tainan, No. 33, Sec. 2, Shulin St., West Central District, Tainan, Taiwan R.O.C.

    Chia-Hui Feng & Hao-Chiang Koong Lin

  2. Department of Creative Product Design, Southern Taiwan University of Science and Technology, No. 1, Nan-Tai St., Yongkang District, Tainan, Taiwan R.O.C.

    Chia-Hui Feng, Chu-Yu Christine Cheng & Yu-Xin Zhou

  3. Hillsborough High-School, 466 Raider Blvd, Hillsborough, NJ, 08844, USA

    Jing-Lin Huang

Authors
  1. Chia-Hui Feng
    View author publications

    Search author on:PubMed Google Scholar

  2. Hao-Chiang Koong Lin
    View author publications

    Search author on:PubMed Google Scholar

  3. Chu-Yu Christine Cheng
    View author publications

    Search author on:PubMed Google Scholar

  4. Jing-Lin Huang
    View author publications

    Search author on:PubMed Google Scholar

  5. Yu-Xin Zhou
    View author publications

    Search author on:PubMed Google Scholar

Corresponding author

Correspondence to Chia-Hui Feng .

Editor information

Editors and Affiliations

  1. Boston College, Chestnut Hill, MA, USA

    Brian K. Smith

  2. The Pennsylvania State University, University Park, PA, USA

    Marcela Borge

Rights and permissions

Reprints and permissions

Copyright information

© 2025 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Feng, CH., Lin, HC.K., Cheng, CY.C., Huang, JL., Zhou, YX. (2025). Effects of an AI-Guided Musical Blocks System on Children's Learning Engagement and Emotions. In: Smith, B.K., Borge, M. (eds) Learning and Collaboration Technologies. HCII 2025. Lecture Notes in Computer Science, vol 15806. Springer, Cham. https://doi.org/10.1007/978-3-031-93564-0_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-93564-0_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-93563-3

  • Online ISBN: 978-3-031-93564-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics