Lucidea logo - click here for homepage

3 Major Drawbacks of Using GenAI for Research

Lauren Hays

Lauren Hays

October 29, 2024

As I mentioned in my last post, there are many generative artificial intelligence (GenAI) tools that researchers and special librarians can use to conduct literature searching.

These tools can be beneficial for individuals new to a field and helpful when users want to visualize published research in new ways. However, there are also several drawbacks to consider before signing off on GenAI as a reliable research assistant.

Researchers must take responsibility for understanding how GenAI works and closely review literature search results before relying on them. Let’s take a look at three major drawbacks for researchers and special librarians to consider when leveraging or recommending GenAI platforms.

GenAI Drawback #1: The Black Box Problem

One issue with research identified by GenAI tools is our lack of understanding of how the literature is selected. Just like with other GenAI outputs, the process of how GenAI selects literature is invisible. This is often referred to as the black box problem because we can’t “see” what’s going on behind the scenes; we only see the output delivered to us by the AI tools.

If the process for identifying literature is hidden from users, certain voices may be amplified over others without a clear understanding of why the GenAI tool is selecting certain literature. Additionally, the same literature may be referenced repeatedly instead of new content being highlighted. Asking GenAI to tell you the seminal works in a field would logically lead to many of the same sources being selected—but it may not highlight new research that could become seminal literature in the future.

GenAI Research Drawback #2: Sloppy Summaries

Another concern with using GenAI tools to conduct research is that the tools will often summarize content. Individuals may be tempted to accept the summaries without verifying their accuracy, but AI-generated summaries are not the same as abstracts written by the authors. The AI summaries may be outright false or use language that is not precise, creating a different impression of the article than would be understood by someone who read the full piece.

GenAI Drawback #3: The Relevance Spectrum

Further, GenAI tools may identify literature as relevant to a topic even though it is not actually well-aligned. Researchers will need to review AI-identified literature thoroughly to ensure its applicability to the research topic. In some cases, the identified literature may be tangentially related or discuss the research topic generally, but not specifically state what is understood by the researcher.

The Researcher’s Responsibility

While GenAI has many valuable uses, researchers should always be careful and diligently review any literature they locate with the help of AI. They should read the entire article—not just the abstract—and make sure they understand the authors’ argument. However, GenAI introduces new ways of locating resources that make it easier to skip labor-intensive close reading, potentially encouraging researchers to develop literature reviews without the same level of understanding they would have previously gained.

Therefore, as you are working with library users and other stakeholders in your job, I encourage you to be clear about how GenAI can be beneficial—and surface the issues it creates. Teaching users how GenAI works (i.e. large language models, predictive text) can help make these issues more understandable. When individuals better understand how GenAI works, they are more likely to be able to respond with appropriate actions and appropriate ways of thinking (i.e., critical thinking) about GenAI-created outputs.

Lauren Hays

Lauren Hays

Dr. Lauren Hays is an Assistant Professor of Instructional Technology at the University of Central Missouri and a frequent presenter and interviewer on topics related to libraries and librarianship. Please read Lauren’s other posts relevant to special librarians. Learn about Lucidea’s powerful integrated library systems, SydneyDigital and GeniePlus, used daily by innovative special librarians in libraries of all types, sizes, and budgets.

**Disclaimer: Any in-line promotional text does not imply Lucidea product endorsement by the author of this post.

Similar Posts

Leave a Comment

Comments are reviewed and must adhere to our comments policy.

0 Comments

Submit a Comment

Your email address will not be published. Required fields are marked *

Pin It on Pinterest

Share This