 |
 |
 |
 |
 |
 |
Task 12b: Biomedical Semantic QA
| PHASE A | |||||
| BATCH 1 | BATCH 2 | BATCH 3 | BATCH 4 | ||
| DOCUMENTS | 1st | Fudan-Atypon | Fudan-Atypon | Fudan-Atypon | UA |
| (SELECION STRATEGY: MAP) | 2nd | UA | UA | UA | Fudan-Atypon |
| SNIPPETS | 1st | Fudan-Atypon | Fudan-Atypon | MiBi | BSRC |
| (SELECION STRATEGY: F-measure) | 2nd | UR | MiBi | Fudan-Atypon | Fudan-Atypon |
| PHASE A+ | ||||||
| BATCH 1 | BATCH 2 | BATCH 3 | BATCH 4 | |||
| EXACT | 1st | UR | Fudan-Atypon | Fudan-Atypon | Fudan-Atypon | |
| (SELECTION STRATEGY: AVG RANKING IN THREE TYPES: Y/N-ACC, FACT-MRR, LIST MEAN F-MEASURE) | 2nd | Fudan-Atypon | UR | MiBi | UR | |
| IDEAL | 1st | Fudan-Atypon | Fudan-Atypon | Fudan-Atypon | Fudan-Atypon | |
| (SELECTION STRATEGY: MEAN MANUAL SCORE) | 2nd | MiBi | MiBi | UR | UA | |
| PHASE B | ||||||
| BATCH 1 | BATCH 2 | BATCH 3 | BATCH 4 | |||
| EXACT | 1st | Fudan-Atypon | UR | MiBi | UR | |
| (SELECTION STRATEGY: AVG RANKING IN THREE TYPES: Y/N-ACC, FACT-MRR, LIST MEAN F-MEASURE) | 2nd | UR | Fudan-Atypon | Fudan-Atypon | NCU-IISR | |
| IDEAL | 1st | NCU-IISR | NCU-IISR | NCU-IISR | UR | |
| (SELECTION STRATEGY: MEAN MANUAL SCORE) | 2nd | UR | UR | MiBi | NCU-IISR | |
Teams (Task 12b):
-
Fudan-Atypon team: Huiyin Yan, Jiale Ding, Yuyi Zhang, Mincong Zhao，Hong Zhou and Shanfeng Zhu
(Fudan-Atypon: Fudan University, China; Atypon, US) -
UR team: Samy Ateia and Udo Kruschwitz
(UR: University of Regensburg, Germany) -
MiBi team: Jan Heinrich Merker, Alexander Bondarenko, Matthias Hagen and Adrian Viehweger
(MiBi: Friedrich-Schiller-Universität Jena & Leipzig University, Germany) -
NCU-IISR team: Bing-Chen Chih, Jen-Chieh Han and Richard Tzong-Han Tsai
(NCU-IISR: National Central University, Taiwan) -
UA team: Tiago Almeida, Richard Jonker, João Reis, João Almeida and Sérgio Matos
(UA: University of Aveiro, Portugal) -
BSRC team: Dimitra Panou, Alexandros Dimopoulos and Martin Reczko
(BSRC: Biomedical Sciences Research Center “Alexander Fleming”, Greece )
Results at:
http://participants-area.bioasq.org/results/12b/phaseA/ http://participants-area.bioasq.org/results/12b/phaseAplus/ http://participants-area.bioasq.org/results/12b/phaseB/
Task Synergy 12: Biomedical Semantic QA for Developing Topics
| Round 1 | Round 2 | Round 3 | Round 4 | ||
| DOCUMENTS | 1st | Fudan-Atypon | Fudan-Atypon | Fudan-Atypon | Fudan-Atypon |
| (SELECION STRATEGY: MAP) | 2nd | BSRC | - | UR | UR |
| SNIPPETS | 1st | Fudan-Atypon | Fudan-Atypon | Fudan-Atypon | Fudan-Atypon |
| (SELECION STRATEGY: F-measure) | 2nd | - | - | UR | UR |
| EXACT | 1st | Fudan-Atypon / BSRC | Fudan-Atypon | Fudan-Atypon | UR |
| (SELECTION STRATEGY: AVG RANKING IN THREE TYPES: Y/N-ACC, FACT-MRR, LIST MEAN F-MEASURE) | 2nd | - | BSRC | UR | Fudan-Atypon |
| IDEAL | 1st | Fudan-Atypon | Fudan-Atypon | Fudan-Atypon | UR |
| (SELECTION STRATEGY: MEAN MANUAL SCORE) | 2nd | - | BSRC | UR | Fudan-Atypon |
Teams (Task Synergy 12):
-
Fudan-Atypon team: Huiyin Yan, Jiale Ding, Yuyi Zhang, Mincong Zhao，Hong Zhou and Shanfeng Zhu
(Fudan-Atypon: Fudan University, China; Atypon, US) -
UR team: Samy Ateia and Udo Kruschwitz
(UR: University of Regensburg, Germany) -
BSRC team: Dimitra Panou, Alexandros Dimopoulos and Martin Reczko
(BSRC: Biomedical Sciences Research Center “Alexander Fleming”, Greece )
Task MultiCardioNER: Multilingual Semantic Annotation in Cardiology
The teams that topped the competition were:
| Track 1-CardioDis | ||
| First place | Second place | |
| Micro F-Measure | BIT-UA | Enigma |
| Track 2 Spanish: MultiDrug-ES | ||
| First place | Second place | |
| Micro F-Measure | ICUE | Enigma |
| Track 2 English: MultiDrug-EN | ||
| First place | Second place | |
| Micro F-Measure | Enigma | ICUE |
| Track 2 Italian: MultiDrug-IT | ||
| First place | Second place | |
| Micro F-Measure | Enigma | Siemens |
Teams (Task MultiCardioNER):
-
BIT.UA team: Richard Jonker, Tiago Almeida and Sérgio Matos
(BIT.UA: University of Aveiro, Portugal) -
Enigma team: Anna Aksenova, Aleksis Datseris, Sylvia Vassileva and Svetla Boytcheva
(Enigma: Ontotext & Sofia University St. Kliment Ohridski, Bulgaria) -
ICUE team: Chaeeun Lee, T. Ian Simpson, Joram M. Posma and Antoine D. Lain
(ICUE: University of Edinburgh & Imperial College London, UK) -
Siemens team: Manuela Daniela Danu, George Marica, Constantin Suciu, Lucian Mihai Itu and Oladimeji Farri
(Siemens: Advanta Siemens SRL Brasov & Transilvania University of Brasov, Romania; Siemens Healthineers, US)
Task BioNNE: Nested Named Entiry Recognition in Russian and English
The teams that topped the competition were:
| Bilingual NNER | ||
| First place | Second place | |
| F-Measure | fulstock | hasin.rehana |
| English NNER | ||
| First place | Second place | |
| F-Measure | fulstock | hasin.rehana |
| Russian NNER | ||
| First place | Second place | |
| F-Measure | fulstock | hasin.rehana |
Teams (Task BioNNE):
-
fulstock: Igor Rozhkov
(Lomonosov Moscow State University, Russia) -
hasin.rehana team: Hasin Rehana, Benu Bansal, Nur Bengisu Çam, Jie Zheng, Yongqun He, Arzucan Özgür and Junguk Hur
(University of North Dakota, US; Bogazici University, Turkey; University of Michigan, US)
