Eleventh Challenge Winners










Task 11b: Biomedical Semantic QA

PHASE A
    BATCH 1 BATCH 2 BATCH 3 BATCH 4
DOCUMENTS 1st Fudan-Atypon Fudan-Atypon Fudan-Atypon Fudan-Atypon
(SELECION STRATEGY: MAP) 2nd UA UA UA UA
SNIPPETS 1st Fudan-Atypon Fudan-Atypon Fudan-Atypon Fudan-Atypon
(SELECION STRATEGY: F-measure) 2nd UNAL UNAL UNAL UNAL

PHASE B
    BATCH 1 BATCH 2 BATCH 3 BATCH 4
EXACT 1st UR NCU / UR Fudan-Atypon KU
(SELECTION STRATEGY: AVG RANKING IN THREE TYPES: Y/N-ACC, FACT-MRR, LIST MEAN F-MEASURE) 2nd KU - KU UR
IDEAL 1st NCU NCU NCU NCU
(SELECTION STRATEGY: MEAN MANUAL SCORE) 2nd MQU Fudan-Atypon MQU MQU

 
Teams (Task 11b):
  • Fudan-Atypon team: Li Liu, Huiyin Yan, Hong Zhou, and Shanfeng Zhu
    (Fudan-Atypon: Fudan University, China)
  • NCU team: Chun-Yu Hsueh, Yu Zhang, Yu-Wei Lu, Jen-Chieh Han, Wilailack Meesawad, and Richard Tzong-Han Tsai
    (NCU: National Central University, Taiwan)
  • UNAL team: Andrés Rosso-Mateus, Manuel Montes-Y-Gómez, León Andrés Munoz Serna, and Fabio Gonzalez
    (UNAL: Nacional University of Colombia, Colombia)
  • UR team: Samy Ateia and Udo Kruschwitz
    (UR: University of Regensburg, Germany)
  • KU team: Hyunjae Kim, Hyeon Hwang, Chaeeun Lee, Minju Seo, Wonjin Yoon, and Jaewoo Kang
    (KU: Korea University, South Korea)
  • UA team: Tiago Almeida, Richard A. A. Jonker, Roshan Poudel, Jorge M. Silva and Sérgio Matos
    (UA: University of Aveiro, Portugal)
  • MQU team: Diego Molla
    (MQU: Macquarie University, Australia)

 

Task Synergy 11: Biomedical Semantic QA for Developing Topics

    Round 1 Round 2 Round 3 Round 4
DOCUMENTS 1st Fudan-Atypon Fudan-Atypon Fudan-Atypon Fudan-Atypon
(SELECION STRATEGY: MAP) 2nd UCSD UCSD UCSD UCSD
SNIPPETS 1st Fudan-Atypon Fudan-Atypon Fudan-Atypon Fudan-Atypon
(SELECION STRATEGY: F-measure) 2nd UCSD UCSD UCSD UCSD
EXACT 1st - Fudan-Atypon Fudan-Atypon Fudan-Atypon
(SELECTION STRATEGY: AVG RANKING IN THREE TYPES: Y/N-ACC, FACT-MRR, LIST MEAN F-MEASURE) 2nd - BSRC UCSD BSRC
IDEAL 1st - Fudan-Atypon Fudan-Atypon Fudan-Atypon
(SELECTION STRATEGY: MEAN MANUAL SCORE) 2nd - UCSD UCSD UCSD

 
Teams (Task Synergy 11):
  • Fudan-Atypon team: Li Liu, Huiyin Yan, Hong Zhou, and Shanfeng Zhu
    (Fudan-Atypon: Fudan University, China)
  • UCSD team: Ibrahim Burak Ozyurt
    (UCSD: University of California San Diego, USA)
  • BSRC team: Dimitra Panou and Martin Reczko
    (BSRC: Biomedical Sciences Research Center “Alexander Fleming”, Greece )

 

Task MedProcNER: Medical Procedure Named Entity Recognition

The teams that topped the competition were:
 
MedProcNER-Recognition
  First place Second place
Micro F-Measure UA Vicomtech
MedProcNER-Normalization
  First place Second place
Micro F-Measure Vicomtech SU
MedProcNER-Indexing
  First place Second place
Micro F-Measure Vicomtech KFU

 

Teams (Task MedProcNER):
  • Vicomtech team: Elena Zotova, Aitor García-Pablos, Montse Cuadros, and German Rigau
    (Vicomtech: Vicomtech, Spain)
  • UA team: Tiago Almeida, Richard A. A. Jonker, Roshan Poudel, Jorge M. Silva and Sérgio Matos
    (UA: University of Aveiro, Portugal)
  • SU team: Sylvia Vassileva, Georgi Grazhdanski, Svetla Boytcheva, and Ivan Koychev
    (SU: Sofia University "St. Kliment Ohridski", Bulgaria)
  • KFU team: Zulfat Miftahutdinov
    (KFU: Kazan Federal University, Russia)