Evaluating AI Analysis of Large Sets of Consumer-Related Communications

During a state law enforcement case, NERA evaluated the use of LLM and other AI tools in characterizing whether large sets of sales calls were deceptive. As a key part of this analysis, we examined procedures for proper documentation of inputs and appropriate external validation of the accuracy and consistency of LLM outputs with respect to the concepts of interest.