SciTail

The SciTail dataset is the first entailment dataset derived from an end task (science question answering) with independently authored sentences. To create this dataset, a multiple-choice question and the correct ansmore

Public Submissions Getting Started About

Download

Rank	Submission	Created	Accuracy

1	DeBERTa Microsoft Dynamics 365 AI	10/26/2020	0.9770
2	CA-MTL Elhattami, Pilault and Pal	09/27/2020	0.9675
2	ALUM Xiaodong Liu	03/19/2020	0.9675
4	ALICE Lis Kanashiro Pereira, Xiaodo…	05/15/2020	0.9624
5	KD-MT-DNN Microsoft D365 AI & MSR AI	05/19/2019	0.9610
6	CMTL Amine Elhattami, Jonathan Pil…	09/23/2020	0.9595
7	MT-DNN(BigBird) Microsoft D365 AI & MSR AI	01/29/2019	0.9407
8	BigBird Microsoft Dynamics 365 AI Res…	11/29/2018	0.9384
9	Finetuned Transformer LM OpenAI	06/12/2018	0.8830
10	HBMP University of Helsinki	08/28/2018	0.8600
11	BiLSTM Max-Out Allen Institute for Artificia…	09/09/2018	0.8540
12	ConSeqNet IBM Research AI	09/27/2018	0.8520
13	MIMN Beijing Language and Culture …	08/15/2018	0.8400
14	CAFE Nanyang Technological Univers…	09/11/2018	0.8330
15	DeIsTe University of Pennsylvania & …	04/25/2018	0.8210
16	HCRN Nanyang Technological Univers…	07/14/2018	0.8000
17	AdvEntuRe Carnegie Mellon University & …	07/16/2018	0.7900
18	DGEM Allen Institute for Artificia…	02/03/2018	0.7730
19	Decomposable Attention Google	02/03/2018	0.7230
20	NGram baseline Allen Institute for Artificia…	02/03/2018	0.7060
20	600D ESIM University of Science and Tec…	02/03/2018	0.7060
22	Hypothesis-Only Johns Hopkins University & BI…	05/14/2018	0.6660
23	Majority Class	02/03/2018	0.6030

Leaderboards

SciTail

Accuracy Over Time