Blessing or Curse? The impact of AI on certification, assessment and localization.

ChatGPT has captured the imagination of the world, including the credentialing industry. Many of us have already started to experiment with how we can leverage large language models (LLMs) like this to drive efficiencies in our design, development, delivery, etc. processes, but are we doing it with the care and diligence that we should be? Have we jumped in without gaging the depth of the pool? In this session, we’ll explore some of the benefits, challenges, and implications of leveraging AI models in ways intended to drive improvements and efficiencies in our processes, including:
- Implications for using AI for item and content creation,
- Advantages and disadvantages of using LLMs to create original content,
- Bias in AI in terms of DE&I,
- Role of human intervention
- Fair use issues of content use in LLMs,
- Quality of the AI output and the amount of checking needed in other languages,
- Limitation of AI abilities in languages other than English / Spanish (where there is a lot of content for training available),
- Necessity for fact-checkers and content validators, including cultural implications, and
- Source text optimization and need for disambiguation.
We will address some important questions that programs need to consider as they adopt AI solutions, such as:
- What does it mean if the models were trained on data before a particular date?
- How much can you trust it?
- Does the use of AI to generate content fundamentally change the value proposition for your program?
- Who owns the IP if you leverage LLMs as a starting point for content generation?
- What is the candidate perception of AI generated assessment content?