Home - Secondary structure Comparative modelling Contacts Threading - search - FTP - Mirrors - Bottom
EVA summary for category sec (Pairwise)
DISCLAIMER Any final ranking list
will be frustrated in the sense that method i assessed to be better than
method j in the direct pairwise comparison may be positioned
worse than method j in the final ranking because of the impact
of the pairwise comparisons with other methods, based on different sets of
common models.
- table entries are mean differences between servers
- [...] contain sample size
- green color indicates the difference between two servers is not significant
- pink color indicates the difference between two servers is significant
- significance level is 0.95 of Student t-distribution
- '?' => < 2 common predictions
Analysis of Q3 score for Secondary Structure Prediction:
Ranking of the methods:
1. Porter
2. PSIpred
3. SAM-T99sec
4. PROFsec
5. SSpro4
6. SABLE2
7. SABLE
8. APSSP2
9. SCRATCH (SSpro3)
10. PHDpsi
11. Prospect
12. yaspin
13. PROF_king
t-Student statistical analysis of the comparisons:
| Porter | PSIpred | SAM-T99sec | PROFsec | SSpro4 | SABLE2 | SABLE | APSSP2 | SCRATCH (SSpro3) | PHDpsi | Prospect | yaspin | PROF_king |
1. Porter | | 1.37 ± 6.57 [ 72] | 2.71 ± 6.95 [ 44] | 1.79 ± 7.06 [ 69] | 2.95 ± 6.36 [ 70] | 2.78 ± 7.26 [ 59] | 3.44 ± 7.29 [ 70] | 0.37 ± 6.86 [ 10] | 3.72 ± 6.56 [ 69] | 3.82 ± 9.16 [ 70] | ? | 4.29 ± 10.84 [ 71] | 8.17 ± 9.74 [ 70] | 2. PSIpred | -1.37 ± 6.57 [ 72] | | -0.00 ± 8.93 [ 190] | 1.03 ± 9.32 [ 215] | 0.96 ± 6.84 [ 141] | 1.41 ± 6.67 [ 160] | 1.96 ± 6.93 [ 214] | 2.40 ± 7.85 [ 108] | 2.08 ± 8.11 [ 193] | 2.75 ± 10.33 [ 214] | 5.09 ± 15.02 [ 89] | 5.24 ± 14.60 [ 154] | 5.73 ± 11.27 [ 219] | 3. SAM-T99sec | -2.71 ± 6.95 [ 44] | 0.00 ± 8.93 [ 190] | | 0.85 ± 9.37 [ 196] | 0.17 ± 6.02 [ 112] | 0.79 ± 8.08 [ 137] | 1.44 ± 7.88 [ 195] | 2.45 ± 10.21 [ 115] | 1.39 ± 7.30 [ 178] | 2.77 ± 9.98 [ 194] | 6.30 ± 11.52 [ 93] | 4.87 ± 14.18 [ 124] | 5.91 ± 10.85 [ 194] | 4. PROFsec | -1.79 ± 7.06 [ 69] | -1.03 ± 9.32 [ 215] | -0.85 ± 9.37 [ 196] | | 0.20 ± 7.61 [ 136] | 0.63 ± 8.87 [ 155] | 0.48 ± 8.47 [ 221] | 1.19 ± 11.31 [ 118] | 0.96 ± 9.52 [ 198] | 1.69 ± 7.85 [ 227] | 4.57 ± 13.98 [ 90] | 3.87 ± 13.06 [ 149] | 4.55 ± 10.51 [ 221] | 5. SSpro4 | -2.95 ± 6.36 [ 70] | -0.96 ± 6.84 [ 141] | -0.17 ± 6.02 [ 112] | -0.20 ± 7.61 [ 136] | | 0.35 ± 6.38 [ 126] | 1.21 ± 6.41 [ 141] | 1.01 ± 7.25 [ 52] | 1.47 ± 4.51 [ 140] | 1.68 ± 7.76 [ 135] | 3.45 ± 8.42 [ 38] | 2.61 ± 10.45 [ 122] | 4.94 ± 8.88 [ 140] | 6. SABLE2 | -2.78 ± 7.26 [ 59] | -1.41 ± 6.67 [ 160] | -0.79 ± 8.08 [ 137] | -0.63 ± 8.87 [ 155] | -0.35 ± 6.38 [ 126] | | 0.75 ± 4.88 [ 159] | 1.39 ± 8.36 [ 65] | 1.12 ± 8.01 [ 137] | 1.18 ± 10.03 [ 156] | 5.82 ± 14.48 [ 53] | 3.58 ± 14.41 [ 130] | 4.57 ± 11.43 [ 155] | 7. SABLE | -3.44 ± 7.29 [ 70] | -1.96 ± 6.93 [ 214] | -1.44 ± 7.88 [ 195] | -0.48 ± 8.47 [ 221] | -1.21 ± 6.41 [ 141] | -0.75 ± 4.88 [ 159] | | 0.01 ± 8.36 [ 113] | -0.14 ± 7.76 [ 197] | 1.24 ± 9.49 [ 218] | 3.55 ± 11.85 [ 89] | 2.64 ± 12.79 [ 154] | 4.36 ± 10.33 [ 219] | 8. APSSP2 | -0.37 ± 6.86 [ 10] | -2.40 ± 7.85 [ 108] | -2.45 ± 10.21 [ 115] | -1.19 ± 11.31 [ 118] | -1.01 ± 7.25 [ 52] | -1.39 ± 8.36 [ 65] | -0.01 ± 8.36 [ 113] | | -0.68 ± 8.30 [ 109] | 1.01 ± 11.46 [ 116] | 4.32 ± 14.50 [ 73] | 5.72 ± 15.56 [ 72] | 3.24 ± 10.43 [ 113] | 9. SCRATCH (SSpro3) | -3.72 ± 6.56 [ 69] | -2.08 ± 8.11 [ 193] | -1.39 ± 7.30 [ 178] | -0.96 ± 9.52 [ 198] | -1.47 ± 4.51 [ 140] | -1.12 ± 8.01 [ 137] | 0.14 ± 7.76 [ 197] | 0.68 ± 8.30 [ 109] | | 0.99 ± 9.97 [ 198] | 4.41 ± 13.08 [ 83] | 3.23 ± 14.18 [ 139] | 4.05 ± 9.99 [ 196] | 10. PHDpsi | -3.82 ± 9.16 [ 70] | -2.75 ± 10.33 [ 214] | -2.77 ± 9.98 [ 194] | -1.69 ± 7.85 [ 227] | -1.68 ± 7.76 [ 135] | -1.18 ± 10.03 [ 156] | -1.24 ± 9.49 [ 218] | -1.01 ± 11.46 [ 116] | -0.99 ± 9.97 [ 198] | | 2.52 ± 13.37 [ 89] | 1.75 ± 12.59 [ 148] | 2.86 ± 11.11 [ 218] | 11. Prospect | ? | -5.09 ± 15.02 [ 89] | -6.30 ± 11.52 [ 93] | -4.57 ± 13.98 [ 90] | -3.45 ± 8.42 [ 38] | -5.82 ± 14.48 [ 53] | -3.55 ± 11.85 [ 89] | -4.32 ± 14.50 [ 73] | -4.41 ± 13.08 [ 83] | -2.52 ± 13.37 [ 89] | | 1.60 ± 17.24 [ 47] | 0.32 ± 12.70 [ 90] | 12. yaspin | -4.29 ± 10.84 [ 71] | -5.24 ± 14.60 [ 154] | -4.87 ± 14.18 [ 124] | -3.87 ± 13.06 [ 149] | -2.61 ± 10.45 [ 122] | -3.58 ± 14.41 [ 130] | -2.64 ± 12.79 [ 154] | -5.72 ± 15.56 [ 72] | -3.23 ± 14.18 [ 139] | -1.75 ± 12.59 [ 148] | -1.60 ± 17.24 [ 47] | | 1.09 ± 13.59 [ 153] | 13. PROF_king | -8.17 ± 9.74 [ 70] | -5.73 ± 11.27 [ 219] | -5.91 ± 10.85 [ 194] | -4.55 ± 10.51 [ 221] | -4.94 ± 8.88 [ 140] | -4.57 ± 11.43 [ 155] | -4.36 ± 10.33 [ 219] | -3.24 ± 10.43 [ 113] | -4.05 ± 9.99 [ 196] | -2.86 ± 11.11 [ 218] | -0.32 ± 12.70 [ 90] | -1.09 ± 13.59 [ 153] | |
Analysis of sov score for Secondary Structure Prediction:
Ranking of the methods:
1. PSIpred
2. Porter
3. SAM-T99sec
4. PROFsec
5. SABLE
6. APSSP2
7. SABLE2
8. yaspin
9. SSpro4
10. SCRATCH (SSpro3)
11. PHDpsi
12. Prospect
13. PROF_king
t-Student statistical analysis of the comparisons:
| PSIpred | Porter | SAM-T99sec | PROFsec | SABLE | APSSP2 | SABLE2 | yaspin | SSpro4 | SCRATCH (SSpro3) | PHDpsi | Prospect | PROF_king |
1. PSIpred | | -1.67 ± 11.10 [ 72] | 0.58 ± 14.50 [ 190] | 0.49 ± 13.83 [ 215] | 1.56 ± 11.90 [ 214] | 3.05 ± 13.08 [ 108] | 3.27 ± 13.41 [ 160] | 3.88 ± 16.54 [ 154] | 4.07 ± 12.23 [ 141] | 4.34 ± 13.81 [ 193] | 4.45 ± 15.98 [ 214] | 6.01 ± 21.34 [ 89] | 8.14 ± 16.61 [ 219] | 2. Porter | 1.67 ± 11.10 [ 72] | | 2.30 ± 12.89 [ 44] | 2.13 ± 14.62 [ 69] | 3.21 ± 11.74 [ 70] | -1.56 ± 8.25 [ 10] | 4.23 ± 15.70 [ 59] | 2.64 ± 12.09 [ 71] | 5.73 ± 12.40 [ 70] | 5.97 ± 12.54 [ 69] | 5.63 ± 15.26 [ 70] | ? | 11.47 ± 16.93 [ 70] | 3. SAM-T99sec | -0.58 ± 14.50 [ 190] | -2.30 ± 12.89 [ 44] | | 0.10 ± 15.21 [ 196] | 0.54 ± 12.37 [ 195] | 2.10 ± 15.65 [ 115] | 1.64 ± 14.31 [ 137] | 3.05 ± 16.78 [ 124] | 3.02 ± 12.42 [ 112] | 3.15 ± 13.30 [ 178] | 4.09 ± 14.69 [ 194] | 6.37 ± 18.58 [ 93] | 8.28 ± 17.76 [ 194] | 4. PROFsec | -0.49 ± 13.83 [ 215] | -2.13 ± 14.62 [ 69] | -0.10 ± 15.21 [ 196] | | -0.06 ± 12.98 [ 221] | 2.26 ± 15.49 [ 118] | 2.45 ± 14.61 [ 155] | 2.57 ± 15.68 [ 149] | 2.98 ± 12.85 [ 136] | 3.04 ± 14.38 [ 198] | 3.43 ± 13.12 [ 227] | 6.15 ± 20.23 [ 90] | 7.53 ± 16.57 [ 221] | 5. SABLE | -1.56 ± 11.90 [ 214] | -3.21 ± 11.74 [ 70] | -0.54 ± 12.37 [ 195] | 0.06 ± 12.98 [ 221] | | 0.89 ± 13.10 [ 113] | 1.14 ± 9.50 [ 159] | 1.52 ± 14.77 [ 154] | 1.59 ± 10.69 [ 141] | 2.52 ± 11.20 [ 197] | 3.76 ± 14.35 [ 218] | 6.17 ± 17.71 [ 89] | 7.55 ± 15.43 [ 219] | 6. APSSP2 | -3.05 ± 13.08 [ 108] | 1.56 ± 8.25 [ 10] | -2.10 ± 15.65 [ 115] | -2.26 ± 15.49 [ 118] | -0.89 ± 13.10 [ 113] | | 0.35 ± 15.43 [ 65] | 3.96 ± 19.38 [ 72] | 0.36 ± 12.62 [ 52] | 1.30 ± 11.77 [ 109] | 2.29 ± 18.02 [ 116] | 5.93 ± 20.85 [ 73] | 4.89 ± 15.80 [ 113] | 7. SABLE2 | -3.27 ± 13.41 [ 160] | -4.23 ± 15.70 [ 59] | -1.64 ± 14.31 [ 137] | -2.45 ± 14.61 [ 155] | -1.14 ± 9.50 [ 159] | -0.35 ± 15.43 [ 65] | | 0.10 ± 18.53 [ 130] | 1.05 ± 12.13 [ 126] | 2.04 ± 13.69 [ 137] | 1.65 ± 15.03 [ 156] | 5.82 ± 20.35 [ 53] | 6.10 ± 17.61 [ 155] | 8. yaspin | -3.88 ± 16.54 [ 154] | -2.64 ± 12.09 [ 71] | -3.05 ± 16.78 [ 124] | -2.57 ± 15.68 [ 149] | -1.52 ± 14.77 [ 154] | -3.96 ± 19.38 [ 72] | -0.10 ± 18.53 [ 130] | | 1.70 ± 12.24 [ 122] | 0.24 ± 16.51 [ 139] | 2.04 ± 14.94 [ 148] | -0.42 ± 20.71 [ 47] | 5.47 ± 19.03 [ 153] | 9. SSpro4 | -4.07 ± 12.23 [ 141] | -5.73 ± 12.40 [ 70] | -3.02 ± 12.42 [ 112] | -2.98 ± 12.85 [ 136] | -1.59 ± 10.69 [ 141] | -0.36 ± 12.62 [ 52] | -1.05 ± 12.13 [ 126] | -1.70 ± 12.24 [ 122] | | 1.10 ± 9.74 [ 140] | 0.67 ± 13.22 [ 135] | 0.11 ± 13.50 [ 38] | 5.40 ± 14.75 [ 140] | 10. SCRATCH (SSpro3) | -4.34 ± 13.81 [ 193] | -5.97 ± 12.54 [ 69] | -3.15 ± 13.30 [ 178] | -3.04 ± 14.38 [ 198] | -2.52 ± 11.20 [ 197] | -1.30 ± 11.77 [ 109] | -2.04 ± 13.69 [ 137] | -0.24 ± 16.51 [ 139] | -1.10 ± 9.74 [ 140] | | 0.60 ± 14.91 [ 198] | 3.51 ± 18.68 [ 83] | 4.32 ± 15.00 [ 196] | 11. PHDpsi | -4.45 ± 15.98 [ 214] | -5.63 ± 15.26 [ 70] | -4.09 ± 14.69 [ 194] | -3.43 ± 13.12 [ 227] | -3.76 ± 14.35 [ 218] | -2.29 ± 18.02 [ 116] | -1.65 ± 15.03 [ 156] | -2.04 ± 14.94 [ 148] | -0.67 ± 13.22 [ 135] | -0.60 ± 14.91 [ 198] | | 1.67 ± 18.81 [ 89] | 4.02 ± 16.78 [ 218] | 12. Prospect | -6.01 ± 21.34 [ 89] | ? | -6.37 ± 18.58 [ 93] | -6.15 ± 20.23 [ 90] | -6.17 ± 17.71 [ 89] | -5.93 ± 20.85 [ 73] | -5.82 ± 20.35 [ 53] | 0.42 ± 20.71 [ 47] | -0.11 ± 13.50 [ 38] | -3.51 ± 18.68 [ 83] | -1.67 ± 18.81 [ 89] | | 2.10 ± 17.89 [ 90] | 13. PROF_king | -8.14 ± 16.61 [ 219] | -11.47 ± 16.93 [ 70] | -8.28 ± 17.76 [ 194] | -7.53 ± 16.57 [ 221] | -7.55 ± 15.43 [ 219] | -4.89 ± 15.80 [ 113] | -6.10 ± 17.61 [ 155] | -5.47 ± 19.03 [ 153] | -5.40 ± 14.75 [ 140] | -4.32 ± 15.00 [ 196] | -4.02 ± 16.78 [ 218] | -2.10 ± 17.89 [ 90] | |
Home - Secondary structure Comparative modelling Contacts Threading - search - FTP - Mirrors - Top