To submit your scores to the leaderboard or engage with the benchmark, please reach out to us at yhzhu99@gmail.com .
We'll promptly review your solutions and update the leaderboard accordingly.
We'll promptly review your solutions and update the leaderboard accordingly.
Model | AUPRC | AUROC | ACC | ES | MAE | MSE | OSMAE | Dataset | Task |
---|
AdaCare | 0.9786389887 | 0.9852562965 | 0.9319758593000002 | 0.7839320879999999 | tjh | outcome | |||
Agent | 0.9721968413000001 | 0.9799944759000001 | 0.925965482 | 0.8580217808 | tjh | outcome | |||
GRASP | 0.9604075729999998 | 0.9730290831000001 | 0.9106189788 | 0.816264462 | tjh | outcome | |||
GRU | 0.9632854342 | 0.9758728086999999 | 0.9161114095 | 0.7833154328 | tjh | outcome | |||
LSTM | 0.9482497512 | 0.9708195149000002 | 0.9256067455 | 0.8479544673999999 | tjh | outcome | |||
MLP | 0.9377832413 | 0.9595300734000001 | 0.9015199959 | 0.7287316240999999 | tjh | outcome | |||
RETAIN | 0.9648850143000001 | 0.9784066616999999 | 0.9353710175 | 0.8258505476 | tjh | outcome | |||
RNN | 0.9602822065000002 | 0.9740915059999999 | 0.908731669 | 0.7832609898999999 | tjh | outcome | |||
StageNet | 0.9571052372000001 | 0.972702694 | 0.910291803 | 0.7744344511000001 | tjh | outcome | |||
TCN | 0.9312690197 | 0.9639046668999999 | 0.9074758471000001 | 0.7466459729 | tjh | outcome | |||
Transformer | 0.9346502961 | 0.9686100483999999 | 0.9052904246000001 | 0.7921391591 | tjh | outcome | |||
AdaCare | 4.553408265 | 39.668838500999996 | tjh | los | |||||
Agent | 4.6568430661999995 | 41.70815334500001 | tjh | los | |||||
GRASP | 4.5522058248 | 40.570186424 | tjh | los | |||||
GRU | 4.32538445 | 35.097379302 | tjh | los | |||||
LSTM | 4.4878946783 | 37.378696442 | tjh | los | |||||
MLP | 5.0768351555999995 | 47.209260559 | tjh | los | |||||
RETAIN | 4.6443580628 | 41.222969055 | tjh | los | |||||
RNN | 4.5665243625 | 39.821641922 | tjh | los | |||||
StageNet | 4.5978057385 | 41.698987198000005 | tjh | los | |||||
TCN | 4.693488049400001 | 43.291580201 | tjh | los | |||||
Transformer | 5.036200141899999 | 43.877203179000006 | tjh | los | |||||
AdaCare | 0.9655035614999999 | 0.977929628 | 0.9155474007000001 | 0.758612427 | 4.4083698986 | 38.855409432 | 5.240753746099999 | tjh | multitask |
Agent | 0.9709890366 | 0.9793400643 | 0.9285401940999998 | 0.8573731227 | 4.4072120667 | 37.546808052 | 4.747069358799999 | tjh | multitask |
GRASP | 0.9617054223 | 0.9743631480999999 | 0.9078495263 | 0.7695617535 | 4.4422149659 | 37.78565635699999 | 5.308313727300001 | tjh | multitask |
GRU | 0.9674443662 | 0.9780099450999999 | 0.9159662127999999 | 0.7925675718 | 4.799152565 | 41.783566093000005 | 5.3775866509000005 | tjh | multitask |
LSTM | 0.9510754108 | 0.9685466883999998 | 0.9099886833999999 | 0.7832984921 | 4.4626619815 | 39.243073083 | 5.5337913514 | tjh | multitask |
MLP | 0.9240647018999999 | 0.9422995449000002 | 0.8709912359999998 | 0.7223399509 | 4.899227667 | 44.352591135000004 | 7.263900565999999 | tjh | multitask |
RETAIN | 0.9647607862 | 0.9737671732 | 0.9253906607000001 | 0.8049663378 | 4.6208897115 | 40.055053329 | 5.0313022613 | tjh | multitask |
RNN | 0.9674973307999999 | 0.9760080815000001 | 0.9140720248 | 0.7945278973 | 4.684901523599999 | 40.211732293 | 5.4647907973 | tjh | multitask |
StageNet | 0.9679147838999999 | 0.9784632564999999 | 0.8640158833999999 | 0.5058085371000001 | 4.4931185723 | 39.545071410000006 | 7.101962375699999 | tjh | multitask |
TCN | 0.9529108821 | 0.9718586565 | 0.9142587065000001 | 0.7765361679 | 4.7862374306 | 41.561799622 | 5.5204885481999995 | tjh | multitask |
Transformer | 0.9194976867 | 0.9587057769999999 | 0.8853287696999999 | 0.7219284844 | 5.060578680000001 | 46.023742102 | 6.6146848202 | tjh | multitask |
AdaCare | 0.5532047898 | 0.8658639073 | 0.8980615137999999 | 0.1745786948 | cdsl | outcome | |||
Agent | 0.5417162537 | 0.867636776 | 0.8981210053000002 | 0.1753478376 | cdsl | outcome | |||
GRASP | 0.5394920707 | 0.8444214881000001 | 0.8980764747000001 | 0.1526838135 | cdsl | outcome | |||
GRU | 0.5678366663 | 0.8792954624 | 0.8988534211999998 | 0.21661850759999995 | cdsl | outcome | |||
LSTM | 0.5552720872 | 0.8701652289 | 0.9008397878000001 | 0.1962632144 | cdsl | outcome | |||
MLP | 0.4859671712 | 0.8414625942999999 | 0.8940420030999998 | -0.007611293899999999 | cdsl | outcome | |||
RETAIN | 0.5453552634000001 | 0.8501514136999999 | 0.9008494854 | 0.0731798751 | cdsl | outcome | |||
RNN | 0.5756921053000001 | 0.878111577 | 0.9010356427000001 | 0.19662550399999998 | cdsl | outcome | |||
StageNet | 0.5657411368 | 0.8708547294000001 | 0.8990036428 | 0.2393194093 | cdsl | outcome | |||
TCN | 0.5709281206999999 | 0.8740062356000001 | 0.9001217246 | 0.1347817701 | cdsl | outcome | |||
Transformer | 0.3833585649 | 0.8132175387 | 0.8716204464999999 | -0.039611490900000004 | cdsl | outcome | |||
AdaCare | 3.7950925589 | 29.065027999999995 | cdsl | los | |||||
Agent | 3.8012159824 | 29.644560813 | cdsl | los | |||||
GRASP | 3.8397060869999997 | 29.952086068000007 | cdsl | los | |||||
GRU | 3.7502251625 | 28.898976518000005 | cdsl | los | |||||
LSTM | 3.8128245353 | 29.285501862 | cdsl | los | |||||
MLP | 4.047199082499999 | 32.078908921 | cdsl | los | |||||
RETAIN | 3.8316593409 | 30.556966018000004 | cdsl | los | |||||
RNN | 3.8958309889 | 30.664709854 | cdsl | los | |||||
StageNet | 3.7221213103000004 | 28.814656449 | cdsl | los | |||||
TCN | 3.7453344344999997 | 29.482636831999997 | cdsl | los | |||||
Transformer | 3.9753091096999995 | 32.351934813 | cdsl | los | |||||
AdaCare | 0.5506200315 | 0.8660150647 | 0.8988276661000001 | 0.005457610899999999 | 3.8119909526 | 32.05291443 | 4.4345427211 | cdsl | multitask |
Agent | 0.5546144337000001 | 0.8760000766999999 | 0.8972189128 | 0.173480153 | 3.8229723690999995 | 29.448865891000004 | 4.4925170008999995 | cdsl | multitask |
GRASP | 0.5055707843 | 0.8272299708 | 0.8988066436000001 | 0.0875702776 | 3.8934049607 | 30.013298987000002 | 4.4861089531 | cdsl | multitask |
GRU | 0.5455978363 | 0.8703870892000001 | 0.8966007293 | 0.1837967486 | 3.9808692932 | 32.140679739 | 4.5484021736999996 | cdsl | multitask |
LSTM | 0.5473756490999999 | 0.8581020532 | 0.9003432511 | 0.1428560904 | 3.8456590653 | 30.127433206 | 4.3998187202 | cdsl | multitask |
MLP | 0.4840334505 | 0.8409308671 | 0.8930129408999999 | 0.004592363399999999 | 4.0789613722 | 31.544749261000003 | 4.8562093914 | cdsl | multitask |
RETAIN | 0.5524443954 | 0.8618606924 | 0.9002398672 | 0.10051379630000001 | 3.8365308523 | 29.920767211999998 | 4.4100517771 | cdsl | multitask |
RNN | 0.5477275697999999 | 0.8712944149 | 0.8997802614999999 | 0.11559448129999998 | 3.8747841595 | 29.52487774 | 4.434345123200001 | cdsl | multitask |
StageNet | 0.5630470812 | 0.8692472576 | 0.9016616880999999 | 0.18653400950000004 | 3.7789074899999995 | 29.933821297999998 | 4.280600766000001 | cdsl | multitask |
TCN | 0.593805626 | 0.8835858404 | 0.9059001564999999 | 0.1493754415 | 3.7952782393 | 29.452152062 | 4.215153516499999 | cdsl | multitask |
Transformer | 0.34852706499999997 | 0.8102628170000001 | 0.8774398269000001 | -0.24000728409999997 | 4.0034072876 | 32.022444535999995 | 5.128226753600001 | cdsl | multitask |
RNN-ta | 0.9596829534 | 0.9738167522 | 0.9117385149 | 0.7978816605000001 | tjh | outcome | |||
GRU-ta | 0.9649964809 | 0.9769934952 | 0.9235021232999999 | 0.8092577645000001 | tjh | outcome | |||
TCN-ta | 0.9330506562 | 0.9673985421 | 0.9119762003000002 | 0.7646819417999999 | tjh | outcome | |||
StageNet-ta | 0.9578785777000001 | 0.9732458768999999 | 0.9151506900999999 | 0.7887656689 | tjh | outcome | |||
RNN-ta | 0.5821096956 | 0.8801120341 | 0.9024570942000001 | 0.201494078 | cdsl | outcome | |||
GRU-ta | 0.5775350959000001 | 0.8798203110999999 | 0.9014825165 | 0.23539762250000001 | cdsl | outcome | |||
TCN-ta | 0.5771059662 | 0.8758854032999999 | 0.9005005417999999 | 0.21594856410000002 | cdsl | outcome | |||
StageNet-ta | 0.5819321035 | 0.8817536950999999 | 0.902946949 | 0.245451841 | cdsl | outcome | |||
RETAIN-ta | 0.9599486349999999 | 0.9781719744999998 | 0.9333798826 | 0.8284665882999999 | tjh | outcome | |||
RETAIN-ta | 0.5429916231999999 | 0.8542809666 | 0.9011915566 | 0.0900160811 | cdsl | outcome | |||
Agent-ta | 0.9715768636 | 0.9799952806000001 | 0.9263169349 | 0.8601225106999999 | tjh | outcome | |||
Agent-ta | 0.5305916845 | 0.8706408381000001 | 0.8960195780000001 | 0.1934600334 | cdsl | outcome | |||
AdaCare-ta | 0.9810777723000002 | 0.9864030719000001 | 0.9450821578999999 | 0.8451141060999999 | tjh | outcome | |||
AdaCare-ta | 0.5561999498999999 | 0.8699503244000001 | 0.8976028321999999 | 0.2008885068 | cdsl | outcome | |||
MLP-ta | 0.9320582032000001 | 0.9564748943 | 0.9014810265000002 | 0.7394078828999999 | tjh | outcome | |||
MLP-ta | 0.4866653233 | 0.8423970044000001 | 0.8938630581 | 0.005521264200000001 | cdsl | outcome | |||
Transformer-ta | 0.9386060237 | 0.9701086283 | 0.9115795016 | 0.8072601256999998 | tjh | outcome | |||
Transformer-ta | 0.40183152260000005 | 0.8236221254 | 0.8710098028 | -0.0077689182 | cdsl | outcome | |||
LSTM-ta | 0.9540229499999999 | 0.9709605814000002 | 0.9257753849 | 0.8377709624999999 | tjh | outcome | |||
LSTM-ta | 0.5688821195000001 | 0.8775795460000001 | 0.9001522959000001 | 0.20924837309999997 | cdsl | outcome | |||
GRASP-ta | 0.9615641236 | 0.9739803254 | 0.9175275505 | 0.8281687476 | tjh | outcome | |||
GRASP-ta | 0.5349556714 | 0.8491031884 | 0.8979778050999998 | 0.1560754578 | cdsl | outcome | |||
MCGRU-ta | 0.5867553472 | 0.8796226322999999 | 0.9025227486999998 | 0.20896978170000002 | cdsl | outcome | |||
MCGRU-ta | 0.9704268755 | 0.9794375299 | 0.9260942341000001 | 0.8231037149 | tjh | outcome | |||
MCGRU | 0.9700568557 | 0.9789270698999999 | 0.9224362076 | 0.8096521510000001 | tjh | outcome | |||
MCGRU | 0.5858788221 | 0.8775994954999999 | 0.9034934639 | 0.1758382993 | cdsl | outcome | |||
MCGRU | 4.6938171149 | 40.263544656 | tjh | los | |||||
MCGRU | 3.8079104186 | 30.161354064 | cdsl | los | |||||
MCGRU | 0.9684126018000001 | 0.9782458841999999 | 0.9234324634 | 0.8073998693 | 4.6676920177 | 40.417599679 | 5.273617124500001 | tjh | multitask |
MCGRU | 0.5824461431000001 | 0.8796639145 | 0.9009697497 | 0.1799959026 | 3.8481662510999994 | 29.154552651 | 4.4600234147 | cdsl | multitask |
RF | 0.9555743814 | 0.9657701968 | 0.9025015414 | 0.7263389908000001 | 4.8271178722000005 | 40.944742584 | 6.1447158038 | tjh | twostage |
DT | 0.8048079788000001 | 0.8740912795 | 0.870567423 | 0.6785627756 | 5.072771072299999 | 50.164400482 | 7.0187152889 | tjh | twostage |
GBDT | 0.9512656865999999 | 0.9641164362 | 0.9047833442 | 0.7644876342000001 | 4.788533592399999 | 42.026769067 | 5.915560693900001 | tjh | twostage |
XGBoost | 0.9570254922 | 0.9684201657999999 | 0.9091698646000002 | 0.7640542913000001 | 4.7752770901 | 41.762908554 | 5.766438055 | tjh | twostage |
CatBoost | 0.9599039913 | 0.9713894782999999 | 0.9110587537000001 | 0.7490686317 | 4.7128426551 | 39.715387154 | 5.700566032199999 | tjh | twostage |
MLP | 0.9377832413 | 0.9595300615000001 | 0.9015199959 | 0.7287316240999999 | 5.076835298699999 | 47.209260367 | 6.342037916300001 | tjh | twostage |
GRU | 0.9632854342 | 0.9758728086999999 | 0.9161114095 | 0.7833154328 | 4.3253844977 | 35.097379492 | 5.1630623579999995 | tjh | twostage |
RNN | 0.9602822065000002 | 0.9740915059999999 | 0.908731669 | 0.7832609898999999 | 4.5665244578 | 39.82164211199999 | 5.543430137700001 | tjh | twostage |
LSTM | 0.9482497512 | 0.9708195149000002 | 0.9256067455 | 0.8479544673999999 | 4.4878946305 | 37.378697014000004 | 4.884629535699999 | tjh | twostage |
TCN | 0.9312426685 | 0.9638918639 | 0.9074758471000001 | 0.7466459729 | 4.6935214998 | 43.292757607 | 5.768236923300001 | tjh | twostage |
Transformer | 0.9346502961 | 0.9686100483999999 | 0.9052904246000001 | 0.7921391591 | 5.036199999100001 | 43.877201461999995 | 5.9647363663 | tjh | twostage |
AdaCare | 0.9785897611 | 0.9852206946 | 0.9319758593000002 | 0.7839320879999999 | 4.553396654099999 | 39.669198608 | 5.0809082984 | tjh | twostage |
Agent | 0.9730553865000001 | 0.9805219232000001 | 0.9283065497999999 | 0.8592743929 | 4.606300521 | 40.846111105 | 4.9269716024 | tjh | twostage |
GRASP | 0.9598561883000001 | 0.9726926745 | 0.9100899755 | 0.8078160966000001 | 4.569875526399999 | 40.65379600600001 | 5.5129616022 | tjh | twostage |
RETAIN | 0.9648850143000001 | 0.9784066616999999 | 0.9353710175 | 0.8258505476 | 4.6443578720000005 | 41.222969816 | 4.7736297845 | tjh | twostage |
StageNet | 0.9571052372000001 | 0.972702694 | 0.910291803 | 0.7744344511000001 | 4.5978072644 | 41.69894905100001 | 5.5923059225 | tjh | twostage |
MCGRU | 0.9700568557 | 0.9789270698999999 | 0.9224362076 | 0.8096521510000001 | 4.6938171149 | 40.263544656 | 5.2899138927 | tjh | twostage |
RF | 0.4948263287 | 0.8434864104 | 0.8925584256000001 | -0.10543790009999998 | 4.0457752944 | 31.297169302999997 | 4.8989038661 | cdsl | twostage |
DT | 0.3826520741 | 0.7966862797 | 0.8880331217 | -0.082256734 | 4.1124117136 | 32.228445054000005 | 4.9938524070999994 | cdsl | twostage |
GBDT | 0.5032403768 | 0.8514598012000001 | 0.8931539893 | 0.0225089812 | 4.0130859373 | 30.743353842999994 | 4.819166975 | cdsl | twostage |
XGBoost | 0.4969544678 | 0.8458968162 | 0.8939622283 | -0.031212604100000003 | 4.024023365900001 | 31.098378562 | 4.8102089371 | cdsl | twostage |
CatBoost | 0.508629349 | 0.8508757293 | 0.8952650368 | -0.0394133158 | 4.0082854033999995 | 30.616400526999996 | 4.7910359535 | cdsl | twostage |
MLP | 0.48596697749999995 | 0.8414624869 | 0.8940420030999998 | -0.007611293899999999 | 4.047199082499999 | 32.078908919999996 | 4.799329118799999 | cdsl | twostage |
GRU | 0.5678381054 | 0.8792964338000001 | 0.8988534211999998 | 0.21661850759999995 | 3.7502244473 | 28.898952484999995 | 4.3442715849999995 | cdsl | twostage |
RNN | 0.5756888091000001 | 0.8781121492 | 0.9010595681 | 0.1968774308 | 3.8958442925999996 | 30.664727594000006 | 4.3685072425 | cdsl | twostage |
LSTM | 0.5552726179 | 0.8701654732999999 | 0.9008397878000001 | 0.1962632144 | 3.8128327847000003 | 29.285522462 | 4.336702299200001 | cdsl | twostage |
TCN | 0.5709285318999999 | 0.8740065814000001 | 0.9001298010000001 | 0.1347905959 | 3.7453385591 | 29.482575034 | 4.3125137475 | cdsl | twostage |
Transformer | 0.3833560436 | 0.8132175208000001 | 0.8716204464999999 | -0.039611490900000004 | 3.9753091812 | 32.351934051 | 5.1929822000999994 | cdsl | twostage |
AdaCare | 0.5532097131 | 0.865864247 | 0.8980536401 | 0.17449138299999997 | 3.7950990678000003 | 29.065064240000005 | 4.4165063754 | cdsl | twostage |
Agent | 0.5324166833 | 0.864805305 | 0.8965636550999999 | 0.1798250955 | 3.7981463910000004 | 29.700071143000002 | 4.4560058891 | cdsl | twostage |
GRASP | 0.5396965385 | 0.844401002 | 0.8981881083000001 | 0.15395607900000002 | 3.8398999930000004 | 29.946670150999996 | 4.425222047 | cdsl | twostage |
RETAIN | 0.5453545181999999 | 0.8501503885 | 0.9008575558999998 | 0.0732681335 | 3.831662058799999 | 30.557006837 | 4.4092356721999995 | cdsl | twostage |
StageNet | 0.5657408862000001 | 0.8708548127999999 | 0.8990036428 | 0.2393194093 | 3.7221209288 | 28.814667511 | 4.3303187352000005 | cdsl | twostage |
MCGRU | 0.5858788221 | 0.8775994954999999 | 0.9034934639 | 0.1758382993 | 3.8079104186 | 30.161354064 | 4.294457975499999 | cdsl | twostage |
CatBoost | 0.9599039913 | 0.9713894782999999 | 0.9110587537000001 | 0.7490686317 | tjh | outcome | |||
DT | 0.8048079788000001 | 0.8740912795 | 0.870567423 | 0.6785627756 | tjh | outcome | |||
GBDT | 0.9512656865999999 | 0.9641164362 | 0.9047833442 | 0.7644876342000001 | tjh | outcome | |||
RF | 0.9555743814 | 0.9657701968 | 0.9025015414 | 0.7263389908000001 | tjh | outcome | |||
XGBoost | 0.9570254922 | 0.9684201657999999 | 0.9091698646000002 | 0.7640542913000001 | tjh | outcome | |||
CatBoost | 4.7128426551 | 39.715387154 | tjh | los | |||||
DT | 5.072771072299999 | 50.164400482 | tjh | los | |||||
GBDT | 4.788533592399999 | 42.026769067 | tjh | los | |||||
RF | 4.8271178722000005 | 40.944742584 | tjh | los | |||||
XGBoost | 4.7752770901 | 41.762908554 | tjh | los | |||||
CatBoost | 0.508629349 | 0.8508757293 | 0.8952650368 | -0.0394133158 | cdsl | outcome | |||
DT | 0.3826520741 | 0.7966862797 | 0.8880331217 | -0.082256734 | cdsl | outcome | |||
GBDT | 0.5032403768 | 0.8514598012000001 | 0.8931539893 | 0.0225089812 | cdsl | outcome | |||
RF | 0.4948263287 | 0.8434864104 | 0.8925584256000001 | -0.10543790009999998 | cdsl | outcome | |||
XGBoost | 0.4969544678 | 0.8458968162 | 0.8939622283 | -0.031212604100000003 | cdsl | outcome | |||
CatBoost | 4.0082854033999995 | 30.616400526999996 | cdsl | los | |||||
DT | 4.1124117136 | 32.228445054000005 | cdsl | los | |||||
GBDT | 4.0130859373 | 30.743353842999994 | cdsl | los | |||||
RF | 4.0457752944 | 31.297169302999997 | cdsl | los | |||||
XGBoost | 4.024023365900001 | 31.098378562 | cdsl | los |