no code implementations • 7 May 2024 • Hassan Shakil, Atqiya Munawara Mahi, Phuoc Nguyen, Zeydy Ortiz, Mamoun T. Mardini
This research examines the effectiveness of OpenAI's GPT models as independent evaluators of text summaries generated by six transformer-based models from Hugging Face: DistilBART, BERT, ProphetNet, T5, BART, and PEGASUS.
no code implementations • 7 May 2024 • Hassan Shakil, Zeydy Ortiz, Grant C. Forbes
In this research, we uses the DistilBERT model to generate extractive summary and the T5 model to generate abstractive summaries.
no code implementations • 16 Oct 2023 • Grant C. Forbes, Parth Katlana, Zeydy Ortiz
Due to this need, a wide array of metrics estimating consistency with the text being summarized have been proposed.