Tenth Challenge Winners






Task 10a: Large-scale online biomedical semantic indexing

The teams that topped the competition for each batch were:
 
Batch 1
  First place Second place
Flat / Hierarchical Measures Fudan-Atypon NLM

Batch 2
  First place Second place
Flat / Hierarchical Measures Fudan-Atypon NLM

Batch 3
  First place Second place
Flat / Hierarchical Measures Fudan-Atypon NLM

 

Teams (Task 10a):
  • Fudan-Atypon team: Tianyang Huang, Ronghui You, Yuxuan Liu, Hong Zhou, and Shanfeng Zhu
    (Fudan-Atypon: Fudan University, China)
  • NLM team: Alastair Rae, James Mork, and Dina Demner-Fushman
    (NLM: The National Library of Medicine, USA)

 

Results at: 

http://participants-area.bioasq.org/results/10a/

Task 10b: Biomedical Semantic QA


PHASE A
    BATCH 1 BATCH 2 BATCH 3 BATCH 4 BATCH 5 BATCH 6*
DOCUMENTS 1st Fudan-Atypon Fudan-Atypon Fudan-Atypon Fudan-Atypon Fudan-Atypon Google
(SELECION STRATEGY: MAP) 2nd Google Google Google Google UA Fudan-Atypon
SNIPPETS 1st Fudan-Atypon Fudan-Atypon Fudan-Atypon Fudan-Atypon Fudan-Atypon Fudan-Atypon
(SELECION STRATEGY: F-measure) 2nd UCSD UCSD UCSD UCSD UCSD UCSD

PHASE B
    BATCH 1 BATCH 2 BATCH 3 BATCH 4 BATCH 5 BATCH 6*
EXACT 1st UD UD UD Fudan-Atypon Fudan-Atypon Fudan-Atypon
(SELECTION STRATEGY: AVG RANKING IN THREE TYPES: Y/N-ACC, FACT-MRR, LIST MEAN F-MEASURE) 2nd Fudan-Atypon Fudan-Atypon KU UD NCU KU
IDEAL 1st UCSD NCU UCSD NCU NCU UCSD
(SELECTION STRATEGY: MEAN MANUAL SCORE) 2nd USP UCSD NCU UCSD UCSD NCU

 
Teams (Task 10b):
  • Fudan-Atypon team Li Huang, Zhanzhan Zhu，Li Liu, Hong Zhou, and Shanfeng Zhu
    (Fudan-Atypon: Fudan University, China)
  • UCSD team: Ibrahim Burak Ozyurt
    (UCSD: University of California San Diego, USA)
  • NCU team: Hao-Hsuan Ting, Yu Zhang, Jen-Chieh Han, and Richard Tzong-Han Tsai
    (NCU: National Central University, Taiwan)
  • UD team Sultan Alrowili and K.Vijay Shanker
    (UD: University of Delaware, USA)
  • Google team: Jing Lu, Ji Ma, and Keith Hall
    (Google: Google, USA)
  • UA team: Tiago Almeida, André Pinho, Rodrigo Pereira, and Sérgio Matos
    (UA: University of Aveiro, Portugal)
  • KU team: Gangwoo Kim, Hajung Kim, Seongyun Lee, and Jaewoo Kang
    (KU: Korea University, South Korea)
  • USP team: Tiago Lubiana
    (USP: University of sao Paulo, Brazil)

 

* BATCH 6 (collaborative): This year, an additional sixth batch was provided, with questions developed by new biomedical experts following a collaborative schema with the supprot of the BioASQ team of experienced biomedical experts. 

Task DisTEMIST: Disease Text Mining Shared Task

The teams that topped the competition were:
 
DisTEMIST-Entities
  First place Second place
Micro F-Measure PICUS HPI-DHC
DisTEMIST-Linking
  First place Second place
Micro F-Measure HPI-DHC Better/NSE

 

Teams (Task DisTEMIST):
  • HPI-DHC team: Florian Borchert and Matthieu-P. Schapranow
    (HPI-DHC: University of Potsdam, Germany)
  • PICUS team: Vincenzo Moscato, Marco Postiglione and Giancarlo Sperlì
    (PICUS: PICUSlab, Italy)
  • Better/NSE team: Matic Bernik, Robert Tovornik, Borut Fabjan and Luis Marco-Ruiz
    (Better/NSE: Better Innovations Lab & Norwegian Centre for E-health Research, Slovenia & Norway)

 

Results at: 

http://participants-area.bioasq.org/results/DisTEMIST/

Task Synergy 10: Biomedical Semantic QA for COVID-19

    Round 1 Round 2 Round 3 Round 4
DOCUMENTS 1st Fudan-Atypon Fudan-Atypon UCSD UCSD
(SELECION STRATEGY: MAP) 2nd UCSD UCSD Fudan-Atypon Fudan-Atypon
SNIPPETS 1st Fudan-Atypon Fudan-Atypon UCSD UCSD
(SELECION STRATEGY: F-measure) 2nd UCSD UCSD Fudan-Atypon Fudan-Atypon
EXACT 1st Fudan-Atypon UCSD Fudan-Atypon Fudan-Atypon
(SELECTION STRATEGY: AVG RANKING IN THREE TYPES: Y/N-ACC, FACT-MRR, LIST MEAN F-MEASURE) 2nd UCSD Fudan-Atypon UCSD UCSD
IDEAL 1st Fudan-Atypon Fudan-Atypon Fudan-Atypon UCSD
(SELECTION STRATEGY: MEAN MANUAL SCORE) 2nd UCSD MQU MQU MQU

 
Teams (Task Synergy 10):
  • Fudan-Atypon team Zhanzhan Zhu，Li Huang, Li Liu, Hong Zhou, and Shanfeng Zhu
    (Fudan-Atypon: Fudan University, China)
  • UCSD team: Ibrahim Burak Ozyurt
    (UCSD: University of California San Diego, USA)
  • MQU team: Diego Molla
    (MQU: Macquarie University, Australia )