Worked Examples to Facilitate the Development of Prompt Engineering Skills
A. Tolzin, N. Knoth, and A. Janson. Thirty-Second European Conference on Information Systems (ECIS 2024), Paphos, Cyprus, (2024)
Abstract
This paper explores the evolving field of prompt engineering in Artificial Intelligence (AI), with a focus on Large Language Models (LLMs). As LLMs exhibit remarkable potential in various educational domains, their effective use requires adept prompt engineering skills. We introduce a skill-based approach to prompt engineering and explicitly investigate the impact of using worked examples to facilitate prompt engineering skills among students interacting with LLMs. We propose hypotheses linking prompt engineering, worked examples, and perceived anthropomorphism to the quality of LLM output. Our initial findings support the critical relationship between proficient prompt engineering and the resulting output quality of LLMs. Subsequent phases will further explore the role of worked examples in prompt engineering, aiming to provide practical recommendations for educational improvement and industry application. Additionally, this research aims to shed light on the responsible utilization of LLMs in education and contribute insights to educational practice, research, and organizational development.
%0 Conference Paper
%1 ls_leimeister
%A Tolzin, Antonia
%A Knoth, Nils
%A Janson, Andreas
%B Thirty-Second European Conference on Information Systems (ECIS 2024)
%C Paphos, Cyprus
%D 2024
%K itegpub pub_aja pub_ato u3bpub
%T Worked Examples to Facilitate the Development of Prompt Engineering Skills
%U http://pubs.wi-kassel.de/wp-content/uploads/2024/06/JML_967.pdf
%X This paper explores the evolving field of prompt engineering in Artificial Intelligence (AI), with a focus on Large Language Models (LLMs). As LLMs exhibit remarkable potential in various educational domains, their effective use requires adept prompt engineering skills. We introduce a skill-based approach to prompt engineering and explicitly investigate the impact of using worked examples to facilitate prompt engineering skills among students interacting with LLMs. We propose hypotheses linking prompt engineering, worked examples, and perceived anthropomorphism to the quality of LLM output. Our initial findings support the critical relationship between proficient prompt engineering and the resulting output quality of LLMs. Subsequent phases will further explore the role of worked examples in prompt engineering, aiming to provide practical recommendations for educational improvement and industry application. Additionally, this research aims to shed light on the responsible utilization of LLMs in education and contribute insights to educational practice, research, and organizational development.
@inproceedings{ls_leimeister,
abstract = {This paper explores the evolving field of prompt engineering in Artificial Intelligence (AI), with a focus on Large Language Models (LLMs). As LLMs exhibit remarkable potential in various educational domains, their effective use requires adept prompt engineering skills. We introduce a skill-based approach to prompt engineering and explicitly investigate the impact of using worked examples to facilitate prompt engineering skills among students interacting with LLMs. We propose hypotheses linking prompt engineering, worked examples, and perceived anthropomorphism to the quality of LLM output. Our initial findings support the critical relationship between proficient prompt engineering and the resulting output quality of LLMs. Subsequent phases will further explore the role of worked examples in prompt engineering, aiming to provide practical recommendations for educational improvement and industry application. Additionally, this research aims to shed light on the responsible utilization of LLMs in education and contribute insights to educational practice, research, and organizational development.},
added-at = {2024-04-24T12:05:48.000+0200},
address = {Paphos, Cyprus},
author = {Tolzin, Antonia and Knoth, Nils and Janson, Andreas},
biburl = {https://www.bibsonomy.org/bibtex/2769c076c6dcc7a917507ae79855bc104/ls_leimeister},
booktitle = {Thirty-Second European Conference on Information Systems (ECIS 2024)},
eventtitle = {Thirty-Second European Conference on Information Systems (ECIS 2024)},
interhash = {78d83bb1159b09b89ccc5aa94d70c2fb},
intrahash = {769c076c6dcc7a917507ae79855bc104},
keywords = {itegpub pub_aja pub_ato u3bpub},
timestamp = {2024-06-03T12:28:05.000+0200},
title = {Worked Examples to Facilitate the Development of Prompt Engineering Skills},
url = {http://pubs.wi-kassel.de/wp-content/uploads/2024/06/JML_967.pdf},
venue = {Paphos, Cyprus},
year = 2024
}