Skip to Main Content

Generative AI & Research

Select: Assess a Tool in Relation to Your Information Need

McGill University librarians Sandy Hervieux and Amanda Wheatley developed the ROBOT test in 2020 as a way of evaluating generative AI tools. As new tools are developed and existing tools evolve, it's more important than ever to make sure you're choosing the right tool for your needs. Ask yourself the following questions:

Reliability: Where does the content in the tool come from? How reliable is that content?

Objective: What is the tool's stated purpose? What is it meant to help you accomplish?

Bias: What types of bias might be present in the information the tool provides? Are there ethical issues associated with this technology? Does the tool acknowledge bias and/or ethical issues?

Owner: Who developed this technology? Who owns it? Who has access to it? Does everyone have equal access? What happens to information you enter into the tool?

Type: How does it work? Is it a large language model or another type of technology? 

 

Hervieux, S. & Wheatley, A. (2020). The ROBOT test [Evaluation tool]. The LibrAIry. https://thelibrairy.wordpress.com/2020/03/11/the-robot-test