One-shot relation retrieval in news archives: adapting N-way K-shot relation classification for efficient knowledge extraction - Institut de Recherche en Informatique et Systèmes Aléatoires - Composante INSA Rennes
Communication Dans Un Congrès Année : 2024

One-shot relation retrieval in news archives: adapting N-way K-shot relation classification for efficient knowledge extraction

Résumé

One-shot relation retrieval is the knowledge extraction task that consists in searching in a textual dataset for all occurrences of a relation of interest, named the source relation, characterized by a single example--a relation being a link between a pair of entities in an utterance. Performing this task on large datasets requires an intelligent system to automate the process, for instance when exploring news archives for press review or business intelligence. We propose a framework that leverages the representation learning capabilities of N-way K-shot models for few-shot relation classification and extends these models to enable one-shot retrieval with a rejection class. At evaluation time, one-shot relation retrieval is performed in a N-way K-shot setting where 1 of the N ways (or relations) is the source relation and the N-1 others are distractors, i.e., relations modeling a rejection class. We benchmark this framework and investigate the influence of the number and the choice of distractors on the standard TACREV and FewRel datasets. Experimental results demonstrate the effectiveness of our approach to address this highly challenging task, however with high variability primarily induced by the type of the source relation. Experiments also highlight a sound strategy for the choice of distractors-a large number of distractors at an intermediate distance from the embedding of the source relation in the latent space learned by the model-, which provides a competing trade-off between recall and precision. This strategy is globally optimal but can however be surpassed on certain source relations by others, depending on the characteristics of the source relation, paving the way for future work. We finally show the substantial benefit of two-shot retrieval over one-shot retrieval, which sheds light on the design of actual intelligent applications leveraging one-or few-shot relation retrieval.
Fichier principal
Vignette du fichier
k24-138.pdf (592.79 Ko) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte
licence

Dates et versions

hal-04708239 , version 1 (24-09-2024)

Licence

Identifiants

  • HAL Id : hal-04708239 , version 1

Citer

Hugo Thomas, Guillaume Gravier, Pascale Sébillot. One-shot relation retrieval in news archives: adapting N-way K-shot relation classification for efficient knowledge extraction. 28th International Conference on Knowledge-Based and Intelligent Information & Engineering Systems (KES), Sep 2024, Seville, Spain. ⟨hal-04708239⟩
0 Consultations
0 Téléchargements

Partager

More