Building Brownian Bridges to Learn Dynamic Author Representations from Texts - Université Lumière Lyon 2 Accéder directement au contenu
Communication Dans Un Congrès Année : 2024

Building Brownian Bridges to Learn Dynamic Author Representations from Texts

Résumé

Authors writing habits fluctuate throughout their lives. This evolution may stem from engaging in new topics, new genres or by the variation of their writing style. However, most representation models aiming at building meaningful authors embedding focus on static repre- sentations. They skip the precious time information useful to build more powerful and versatile representations. Only a limited number of meth- ods learn dynamic representations, each dedicated to a time bin. Here we propose a new representation learning model called BARL (Brown- ian Bridges for Author Representation Learning). BARL uses Brownian Bridges, a Gaussian process, to embed authors as continuous trajectories through time. Leveraging the Variational Information Bottleneck (VIB) framework, it integrates a pre-trained temporal text encoder to encode authors and documents into the same space, learning a distinct dynamic for each author along with a customized variance. We evaluate BARL on several tasks: authorship attribution, document dating and author classification on two datasets from the literature. BARL outperforms baselines and existing dynamic author embedding models while learning a continuous temporal representation space.
Fichier principal
Vignette du fichier
IDA2024_final.pdf (583.75 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence
Copyright (Tous droits réservés)

Dates et versions

hal-04649762 , version 1 (16-07-2024)

Licence

Copyright (Tous droits réservés)

Identifiants

  • HAL Id : hal-04649762 , version 1

Citer

Enzo Terreau, Julien Velcin. Building Brownian Bridges to Learn Dynamic Author Representations from Texts. Symposium on Intelligent Data Analysis (IDA), Apr 2024, Stockholm, Sweden. ⟨hal-04649762⟩
0 Consultations
0 Téléchargements

Partager

Gmail Mastodon Facebook X LinkedIn More