The Art of AI Prompting: Technical, Reasonable, and Test Development Considerations

So, you have a generative AI tool, now what? With the rise of generative AI technology being built directly into item banks, it's now possible to create exam content that is customized to the unique needs and preferences of each individual assessment program. Prompting correctly with generative AI is important because it enables users to create content that is relevant and appropriate for use.

This session will review generative AI in full practicality to the assessment community reviewing what generative AI is, how to framework prompting, and test development considerations.

We will start the session with a crash course on generative AI to provide a foundational understanding. Learn what AI is, the open questions of how it is built (black box), and the technological considerations to make when interacting with it, like how the AI algorithms can identify patterns and predict what type of content will resonate. We will review prompting framework to use with generative AI that are designed to receive the best response. Lastly, from a test development perspective, we will review considerations that should be made for item workshops, setting guidelines, and ethical considerations.