no code implementations • 31 May 2024 • Fernando Moreno-Pino, Álvaro Arroyo, Harrison Waldon, Xiaowen Dong, Álvaro Cartea
To address this challenge, we introduce the Rough Transformer, a variation of the Transformer model that operates on continuous-time representations of input sequences and incurs significantly lower computational costs.
no code implementations • 15 Mar 2024 • Fernando Moreno-Pino, Álvaro Arroyo, Harrison Waldon, Xiaowen Dong, Álvaro Cartea
To mitigate this, we introduce the Rough Transformer, a variation of the Transformer model which operates on continuous-time representations of input sequences and incurs significantly reduced computational costs, critical for addressing long-range dependencies common in medical contexts.
no code implementations • 21 Mar 2023 • Haitz Sáez de Ocáriz Borde, Álvaro Arroyo, Ingmar Posner
Graph Neural Networks leverage the connectivity structure of graphs as an inductive bias.