 |
 |
 |
 |
 |
|
 |
 |
 |
 |
Task 13b: Biomedical Semantic QA
| PHASE A | |||||
| BATCH 1 | BATCH 2 | BATCH 3 | BATCH 4 | ||
| DOCUMENTS | 1st | Insilicom | Insilicom | Insilicom | Insilicom |
| (SELECION STRATEGY: MAP) | 2nd | UA | UA | Fudan | UA |
| SNIPPETS | 1st | Insilicom | Insilicom | Insilicom | Insilicom |
| (SELECION STRATEGY: F-measure) | 2nd | Fudan | Fudan | NCU-IISR | NCU-IISR |
| PHASE A+ | ||||||
| BATCH 1 | BATCH 2 | BATCH 3 | BATCH 4 | |||
| EXACT | 1st | UR | UR | MI / NCU-IISR | Fudan | |
| (SELECTION STRATEGY: AVG RANKING IN THREE TYPES: Y/N-ACC, FACT-MRR, LIST MEAN F-MEASURE) | 2nd | NSUT | Fudan | - | UR | |
| IDEAL | 1st | NSUT | UA | UA | UR | |
| (SELECTION STRATEGY: MEAN MANUAL SCORE) | 2nd | UA | NCU-IISR | UR | MI | |
| PHASE B | ||||||
| BATCH 1 | BATCH 2 | BATCH 3 | BATCH 4 | |||
| EXACT | 1st | DMIS | DMIS | Evidence Prime | DMIS | |
| (SELECTION STRATEGY: AVG RANKING IN THREE TYPES: Y/N-ACC, FACT-MRR, LIST MEAN F-MEASURE) | 2nd | Fudan | Evidence Prime | DMIS | Fudan | |
| IDEAL | 1st | UR | HCMC | NCU-IISR | UR | |
| (SELECTION STRATEGY: MEAN MANUAL SCORE) | 2nd | Evidence Prime | UR | UA | NCU-IISR | |
Teams (Task 13b):
-
Insilicom LLC team: Jinfeng Zhang, Yuan Zhang. Han Yue, Eric Zhou, Alex Hu, Xueshen Li, Jianan Wang, Xin Sui, Sylvia Torres, Ming-Chin Wu, Thuy Tran, Kaixian Yu, and Jun Zhou
(Insilicom LLC, US) -
UR team: Samy Ateia and Udo Kruschwitz
(UR: University of Regensburg, Germany) -
UA team: Richard A. A. Jonker, Tiago Almeida, João Almeida, and Sérgio Matos
(UA: University of Aveiro, Portugal) -
Fudan team: Huiyin Yan, Yuyi Zhang, Mincong Zhao, Jiale Ding, and Shanfeng Zhu
(Fudan-Atypon: Fudan University, China) - NCU-IISR team: Chih Bing-Chen, Jen-Chieh Han, Hsi-Chuan Hung, and Richard Tzong-Han Tsai
- (NCU-IISR: National Central University, Taiwan)
-
DMIS team: Hajung Kim, Hoonick Lee, Yewon Cho, Jungwoo Park, Jueon Park, Soyon Park, Yan Ting Chok, Seungheun Baek, Donghyeon Lee, and Jaewoo Kang
(DMIS: Korea University, S. Korea) -
NSUT team: Poojan Vachharajani
(NSUT: Netaji Subhas University of Technology, India ) -
MI team: Nhung Nguyen, Dmytro Lituiev, Aditya Kashyap, Kevin Kuhl, Zhimin Liu, Garrett Jenkinson, Christopher Corrado, Nicolas Baro, and Timothy Schultz
(MI: Johnson & Johnson Innovative Medicine, UK ) -
Evidence Prime team: Damian Stachura, Joanna Konieczna, and Artur Nowak
(Evidence Prime, Poland) -
HCMC team: Hoang Quan Tran and Xuan Van Tran
(HCMC: University of Science, Vietnam )
Results at:
http://participants-area.bioasq.org/results/13b/phaseA/ http://participants-area.bioasq.org/results/13b/phaseAplus/ http://participants-area.bioasq.org/results/13b/phaseB/
Task Synergy 13: Biomedical Semantic QA for Developing Topics
| Round 1 | Round 2 | Round 3 | Round 4 | ||
| DOCUMENTS | 1st | Fudan | Fudan | Fudan | Fudan |
| (SELECION STRATEGY: MAP) | 2nd | BSRC | UJA | SBU | KOREATECH |
| SNIPPETS | 1st | Fudan | SBU | SBU | UJA |
| (SELECION STRATEGY: F-measure) | 2nd | BSRC | Fudan | Fudan | SBU |
| EXACT | 1st | Fudan | Fudan | Fudan | BSRC / Fudan / UJA |
| (SELECTION STRATEGY: AVG RANKING IN THREE TYPES: Y/N-ACC, FACT-MRR, LIST MEAN F-MEASURE) | 2nd | SBU | BSRC | BSRC | - |
| IDEAL | 1st | Fudan | BSRC | Fudan | Fudan |
| (SELECTION STRATEGY: MEAN MANUAL SCORE) | 2nd | SBU | Fudan | BSRC | UJA |
Teams (Task Synergy 13):
-
Fudan team: Huiyin Yan, and Shanfeng Zhu
(Fudan-Atypon: Fudan University, China) -
SBU team: Tanoy Debnath
(SBU : Stony Brook University, USA) -
BSRC team: Dimitra Panou, Alexandros C. Dimopoulos, Manolis Koubarakis and Martin Reczko
(BSRC: Biomedical Sciences Research Center “Alexander Fleming”, Greece ) -
UJA team: Sara Dueñas-Romero, L. Alfonso Ureña-López, and Eugenio Martínez-Cámara
(UJA: University of Jaén, Spain) -
KOREATECH team: Suyeon Cho, SangHun Im, and KyeongWoo Cho
(KOREATECH: Korea University of Technology and Education, S. Korea)
Task MultiClinSum: Multilingual Clinical Summarization
The teams that topped the competition were:
| MultiClinSum-en | ||
| First place | Second place | |
| Micro F-Measure | seemdog | MaLei |
| MultiClinSum-es | ||
| First place | Second place | |
| Micro F-Measure | Grazhdanski | NSUT |
| MultiClinSum-fr | ||
| First place | Second place | |
| Micro F-Measure | NSUT | BU |
| MultiClinSum-pt | ||
| First place | Second place | |
| Micro F-Measure | NSUT | ETS-PUCPR |
Teams (Task MultiClinSum):
-
NSUT team: Poojan Vachharajani
(NSUT: Netaji Subhas University of Technology, India ) -
seemdog team: Jean Seo
(seemdog: AITRICS, S. Korea) -
Grazhdanski team: Georgi Grazhdanski
(Georgi Grazhdanski, Bulgaria) -
MaLei team: Libo Ren, Yee Man Ng, and Lifeng Han
(MaLei: University of Manchester, UK; Leiden University, Netherlands) -
BU team: Nicolay Rusnachenko, Xiaoxiao Liu, Jian Chang, and Jian Jun Zhang
(BU: Bournemouth University, UK) -
ETS-PUCPR team: Elisa Terumi Rubel Schneider, Fernando Henrique Schneider, Emerson Cabrera Paraiso, Alceu Souza Britto Jr and Rafael Menelau Oliveira Cruz
(ETS-PUCPR: École de Technologie Supérieure, Canada; Pontifícia Universidade Católica do Paraná, Brazil)
Task BioNNE-L: Nested Entity Linking in Russian and English
The teams that topped the competition were:
| Bilingual NEL | ||
| First place | Second place | |
| F-Measure | Fudan | BlancaPlanca |
| English NEL | ||
| First place | Second place | |
| F-Measure | VerbaNex AI lab | Fudan |
| Russian NEL | ||
| First place | Second place | |
| F-Measure | BlancaPlanca | Fudan |
Teams (Task BioNNE):
-
Fudan team: Yuxuan Liu and Shanfeng Zhu
(Fudan-Atypon: Fudan University, China) -
BlancaPlanca: Albina Burlova
(National Research University Higher School of Economics, Russia) -
VerbaNex AI lab team: Daniel Peña Gnecco, Jairo Serrano, Edwin Puertas and Juan Carlos Martinez-Santos
(VerbaNex AI lab: Universidad Tecnológica de Bolívar, Colombia)
Task ElCardioCC: Clinical Coding in Cardiology
The teams that topped the competition were:
| NER | ||
| First place | Second place | |
| F-Measure | Fudan | Enigma |
| EL | ||
| First place | Second place | |
| F-Measure | Fudan | Enigma |
| MLC-X | ||
| First place | Second place | |
| F-Measure | Fudan | bhuang |
Teams (Task ElCardioCC):
-
Fudan team: Yuxuan Liu and Shanfeng Zhu
(Fudan-Atypon: Fudan University, China) -
Enigma team: Boris Velichkov, Aleksis Datseris, Sylvia Vassileva and Svetla Boytcheva
(Enigma: Graphwise, Bulgaria; Sofia University, Bulgaria) -
bhuang: Bor-Woei Huang
(University of Padua, Italy)
Task GutBrainIE: Gut-Brain Interplay Information Extraction
The teams that topped the competition were:
| NER | ||
| First place | Second place | |
| F-Measure | GutUZH | Gut-Insticts |
| Binary Tag-Based RE | ||
| First place | Second place | |
| F-Measure | Gut-Insticts | ONTUG (collaboration of teams ToGS and Graphwise-1) |
| Ternary Tag-Based RE | ||
| First place | Second place | |
| F-Measure | Gut-Insticts | Fudan |
| Ternary Mention-Based RE | ||
| First place | Second place | |
| F-Measure | Gut-Insticts | Fudan |
Teams (Task GutBrainIE):
-
Gut-Insticts team: Lasse Ryge Andersen, Mikkel Hagerup Dolmer, Marius Ihlen Gardshodn, Juan Manuel Rodriguez, and Daniele Dell’Aglio
(Gut-Insticts: Aalborg University, Denmark) -
GutUZH team: Jinyi Han and Yeyang Liu
(GutUZH: University of Zurich, Switzerland) -
ToGS team: Benedikt Kantz, Stefan Lengauer, Peter Waldert and Tobias Schreck
(ToGS: Graz University of Technology, Austria) -
Graphwise-1 team: Aleksis Datseris, Mario Kuzmanov, Ivelina Nikolova-Koleva, Dimitar Taskov, and Svetla Boytcheva
(Graphwise-1: Graphwise, Bulgaria) -
ataupd2425-pam team: Lorenzo Pamio and Giorgio Maria Di Nunzio
(University of Padua, Italy)
