Journal of Data and Information Quality

Journal: Journal of Data and Information Quality

Association for Computing Machinery

1936-1955
1936-1963

Publications 1 - 2 of 2

Augmenting data quality through high-precision gender categorization
Müller, Daniel; Jain, Pratiksha; Te, Yieh-Funk (2019)
Journal of Data and Information Quality
The Choice of Textual Knowledge Base in Automated Claim Checking
Stammbach, Dominik; Zhang, Boya; Ash, Elliott (2023)
Journal of Data and Information Quality
Automated claim checking is the task of determining the veracity of a claim given evidence retrieved from a textual knowledge base of trustworthy facts. While previous work has taken the knowledge base as given and optimized the claim-checking pipeline, we take the opposite approach - taking the pipeline as given, we explore the choice of the knowledge base. Our first insight is that a claim-checking pipeline can be transferred to a new domain of claims with access to a knowledge base from the new domain. Second, we do not find a "universally best"knowledge base - higher domain overlap of a task dataset and a knowledge base tends to produce better label accuracy. Third, combining multiple knowledge bases does not tend to improve performance beyond using the closest-domain knowledge base. Finally, we show that the claim-checking pipeline's confidence score for selecting evidence can be used to assess whether a knowledge base will perform well for a new set of claims, even in the absence of ground-truth labels.

Publications 1 - 2 of 2