
Bayesian Multinomial Logistic Regression - Training 	Ver. 2.02
Command line:  ../BMRtrain Compass.300+.training.bmr Compass.model
Log Level: 0
PriorType: normal diagonal	Var= auto-select
HyperParameter: Norm-based default
Cosine normalization: No
Model - link function: Logistic 	Optimizer: ZO
Standardize: No
Convergence threshold: 0.001	Iterations limit: 10000
Data file for Training: Compass.300+.training.bmr
Write Model file: Compass.model
Cases in training data: 45
Features in training data: 40
Classes in training data: 9
Design: 41 variables
Total parameters: 369	 Of them fixed: 0
Average square norm (no const term) 314.384 Hyperparameter 0.00318083
Starting PolyZO model, - Time 00 0 1 0 157.192
1 0 1 0 157.192
2 0 1 0 157.192
3 0 1 0 157.192
4 0 1 0 157.192
5 0 1 0 157.192
6 0 1 0 157.192
7 0 1 0 157.192
8 0 1 0 157.192
0 1 1 0 157.192
1 1 1 0 157.192
2 1 1 0 157.192
3 1 1 0 157.192
4 1 1 0 157.192
5 1 1 0 157.192
6 1 1 0 157.192
7 1 1 0 157.192
8 1 1 0 157.192
0 2 1 0 157.192
1 2 1 0 157.192
2 2 1 0 157.192
3 2 1 0 157.192
4 2 1 0 157.192
5 2 1 0 157.192
6 2 1 0 157.192
7 2 1 0 157.192
8 2 1 0 157.192
0 3 1 0 157.192
1 3 1 0 157.192
2 3 1 0 157.192
3 3 1 0 157.192
4 3 1 0 157.192
5 3 1 0 157.192
6 3 1 0 157.192
7 3 1 0 157.192
8 3 1 0 157.192
0 4 1 0 157.192
1 4 1 0 157.192
2 4 1 0 157.192
3 4 1 0 157.192
4 4 1 0 157.192
5 4 1 0 157.192
6 4 1 0 157.192
7 4 1 0 157.192
8 4 1 0 157.192
0 5 1 0 157.192
1 5 1 0 157.192
2 5 1 0 157.192
3 5 1 0 157.192
4 5 1 0 157.192
5 5 1 0 157.192
6 5 1 0 157.192
7 5 1 0 157.192
8 5 1 0 157.192
0 6 1 0 157.192
1 6 1 0 157.192
2 6 1 0 157.192
3 6 1 0 157.192
4 6 1 0 157.192
5 6 1 0 157.192
6 6 1 0 157.192
7 6 1 0 157.192
8 6 1 0 157.192
0 7 1 0 157.192
1 7 1 0 157.192
2 7 1 0 157.192
3 7 1 0 157.192
4 7 1 0 157.192
5 7 1 0 157.192
6 7 1 0 157.192
7 7 1 0 157.192
8 7 1 0 157.192
0 8 1 0 157.192
1 8 1 0 157.192
2 8 1 0 157.192
3 8 1 0 157.192
4 8 1 0 157.192
5 8 1 0 157.192
6 8 1 0 157.192
7 8 1 0 157.192
8 8 1 0 157.192
0 9 1 0 157.192
1 9 1 0 157.192
2 9 1 0 157.192
3 9 1 0 157.192
4 9 1 0 157.192
5 9 1 0 157.192
6 9 1 0 157.192
7 9 1 0 157.192
8 9 1 0 157.192
0 10 1 0 157.192
1 10 1 0 157.192
2 10 1 0 157.192
3 10 1 0 157.192
4 10 1 0 157.192
5 10 1 0 157.192
6 10 1 0 157.192
7 10 1 0 157.192
8 10 1 0 157.192
0 11 1 0 157.192
1 11 1 0 157.192
2 11 1 0 157.192
3 11 1 0 157.192
4 11 1 0 157.192
5 11 1 0 157.192
6 11 1 0 157.192
7 11 1 0 157.192
8 11 1 0 157.192
0 12 1 0 157.192
1 12 1 0 157.192
2 12 1 0 157.192
3 12 1 0 157.192
4 12 1 0 157.192
5 12 1 0 157.192
6 12 1 0 157.192
7 12 1 0 157.192
8 12 1 0 157.192
0 13 1 0 157.192
1 13 1 0 157.192
2 13 1 0 157.192
3 13 1 0 157.192
4 13 1 0 157.192
5 13 1 0 157.192
6 13 1 0 157.192
7 13 1 0 157.192
8 13 1 0 157.192
0 14 1 0 157.192
1 14 1 0 157.192
2 14 1 0 157.192
3 14 1 0 157.192
4 14 1 0 157.192
5 14 1 0 157.192
6 14 1 0 157.192
7 14 1 0 157.192
8 14 1 0 157.192
0 15 1 0 157.192
1 15 1 0 157.192
2 15 1 0 157.192
3 15 1 0 157.192
4 15 1 0 157.192
5 15 1 0 157.192
6 15 1 0 157.192
7 15 1 0 157.192
8 15 1 0 157.192
0 16 1 0 157.192
1 16 1 0 157.192
2 16 1 0 157.192
3 16 1 0 157.192
4 16 1 0 157.192
5 16 1 0 157.192
6 16 1 0 157.192
7 16 1 0 157.192
8 16 1 0 157.192
0 17 1 0 157.192
1 17 1 0 157.192
2 17 1 0 157.192
3 17 1 0 157.192
4 17 1 0 157.192
5 17 1 0 157.192
6 17 1 0 157.192
7 17 1 0 157.192
8 17 1 0 157.192
0 18 1 0 157.192
1 18 1 0 157.192
2 18 1 0 157.192
3 18 1 0 157.192
4 18 1 0 157.192
5 18 1 0 157.192
6 18 1 0 157.192
7 18 1 0 157.192
8 18 1 0 157.192
0 19 1 0 157.192
1 19 1 0 157.192
2 19 1 0 157.192
3 19 1 0 157.192
4 19 1 0 157.192
5 19 1 0 157.192
6 19 1 0 157.192
7 19 1 0 157.192
8 19 1 0 157.192
0 20 1 0 157.192
1 20 1 0 157.192
2 20 1 0 157.192
3 20 1 0 157.192
4 20 1 0 157.192
5 20 1 0 157.192
6 20 1 0 157.192
7 20 1 0 157.192
8 20 1 0 157.192
0 21 1 0 157.192
1 21 1 0 157.192
2 21 1 0 157.192
3 21 1 0 157.192
4 21 1 0 157.192
5 21 1 0 157.192
6 21 1 0 157.192
7 21 1 0 157.192
8 21 1 0 157.192
0 22 1 0 157.192
1 22 1 0 157.192
2 22 1 0 157.192
3 22 1 0 157.192
4 22 1 0 157.192
5 22 1 0 157.192
6 22 1 0 157.192
7 22 1 0 157.192
8 22 1 0 157.192
0 23 1 0 157.192
1 23 1 0 157.192
2 23 1 0 157.192
3 23 1 0 157.192
4 23 1 0 157.192
5 23 1 0 157.192
6 23 1 0 157.192
7 23 1 0 157.192
8 23 1 0 157.192
0 24 1 0 157.192
1 24 1 0 157.192
2 24 1 0 157.192
3 24 1 0 157.192
4 24 1 0 157.192
5 24 1 0 157.192
6 24 1 0 157.192
7 24 1 0 157.192
8 24 1 0 157.192
0 25 1 0 157.192
1 25 1 0 157.192
2 25 1 0 157.192
3 25 1 0 157.192
4 25 1 0 157.192
5 25 1 0 157.192
6 25 1 0 157.192
7 25 1 0 157.192
8 25 1 0 157.192
0 26 1 0 157.192
1 26 1 0 157.192
2 26 1 0 157.192
3 26 1 0 157.192
4 26 1 0 157.192
5 26 1 0 157.192
6 26 1 0 157.192
7 26 1 0 157.192
8 26 1 0 157.192
0 27 1 0 157.192
1 27 1 0 157.192
2 27 1 0 157.192
3 27 1 0 157.192
4 27 1 0 157.192
5 27 1 0 157.192
6 27 1 0 157.192
7 27 1 0 157.192
8 27 1 0 157.192
0 28 1 0 157.192
1 28 1 0 157.192
2 28 1 0 157.192
3 28 1 0 157.192
4 28 1 0 157.192
5 28 1 0 157.192
6 28 1 0 157.192
7 28 1 0 157.192
8 28 1 0 157.192
0 29 1 0 157.192
1 29 1 0 157.192
2 29 1 0 157.192
3 29 1 0 157.192
4 29 1 0 157.192
5 29 1 0 157.192
6 29 1 0 157.192
7 29 1 0 157.192
8 29 1 0 157.192
0 30 1 0 157.192
1 30 1 0 157.192
2 30 1 0 157.192
3 30 1 0 157.192
4 30 1 0 157.192
5 30 1 0 157.192
6 30 1 0 157.192
7 30 1 0 157.192
8 30 1 0 157.192
0 31 1 0 157.192
1 31 1 0 157.192
2 31 1 0 157.192
3 31 1 0 157.192
4 31 1 0 157.192
5 31 1 0 157.192
6 31 1 0 157.192
7 31 1 0 157.192
8 31 1 0 157.192
0 32 1 0 157.192
1 32 1 0 157.192
2 32 1 0 157.192
3 32 1 0 157.192
4 32 1 0 157.192
5 32 1 0 157.192
6 32 1 0 157.192
7 32 1 0 157.192
8 32 1 0 157.192
0 33 1 0 157.192
1 33 1 0 157.192
2 33 1 0 157.192
3 33 1 0 157.192
4 33 1 0 157.192
5 33 1 0 157.192
6 33 1 0 157.192
7 33 1 0 157.192
8 33 1 0 157.192
0 34 1 0 157.192
1 34 1 0 157.192
2 34 1 0 157.192
3 34 1 0 157.192
4 34 1 0 157.192
5 34 1 0 157.192
6 34 1 0 157.192
7 34 1 0 157.192
8 34 1 0 157.192
0 35 1 0 157.192
1 35 1 0 157.192
2 35 1 0 157.192
3 35 1 0 157.192
4 35 1 0 157.192
5 35 1 0 157.192
6 35 1 0 157.192
7 35 1 0 157.192
8 35 1 0 157.192
0 36 1 0 157.192
1 36 1 0 157.192
2 36 1 0 157.192
3 36 1 0 157.192
4 36 1 0 157.192
5 36 1 0 157.192
6 36 1 0 157.192
7 36 1 0 157.192
8 36 1 0 157.192
0 37 1 0 157.192
1 37 1 0 157.192
2 37 1 0 157.192
3 37 1 0 157.192
4 37 1 0 157.192
5 37 1 0 157.192
6 37 1 0 157.192
7 37 1 0 157.192
8 37 1 0 157.192
0 38 1 0 157.192
1 38 1 0 157.192
2 38 1 0 157.192
3 38 1 0 157.192
4 38 1 0 157.192
5 38 1 0 157.192
6 38 1 0 157.192
7 38 1 0 157.192
8 38 1 0 157.192
0 39 1 0 157.192
1 39 1 0 157.192
2 39 1 0 157.192
3 39 1 0 157.192
4 39 1 0 157.192
5 39 1 0 157.192
6 39 1 0 157.192
7 39 1 0 157.192
8 39 1 0 157.192
0 40 1 0 157.192
1 40 1 0 157.192
2 40 1 0 157.192
3 40 1 0 157.192
4 40 1 0 157.192
5 40 1 0 157.192
6 40 1 0 157.192
7 40 1 0 157.192
8 40 1 0 157.192

Built ZO model 101 iterations, Time 2
Total steps 37269, skipped 0, slept 0
Beta components dropped finally: 0 Left: 369

---Resubstitution results---
Confusion Table:
Training set loglikelihood -40.967144134 Average -0.910380980755
Log prior (penalty) 705.652 Log posterior 664.685

One-vs-All view: Class 0
Confusion matrix:   Relevant	Not Relevant
	Retrieved    	5	1
	Not Retrieved	1	38
Precision = 83.3333
Recall  = 83.3333
F1 = 83.3333
ROC area under curve 99.5726

One-vs-All view: Class 1
Confusion matrix:   Relevant	Not Relevant
	Retrieved    	6	2
	Not Retrieved	0	37
Precision = 75
Recall  = 100
F1 = 85.7143
ROC area under curve 96.6216

One-vs-All view: Class 2
Confusion matrix:   Relevant	Not Relevant
	Retrieved    	2	0
	Not Retrieved	0	43
Precision = 100
Recall  = 100
F1 = 100
ROC area under curve 97.6744

One-vs-All view: Class 3
Confusion matrix:   Relevant	Not Relevant
	Retrieved    	5	0
	Not Retrieved	0	40
Precision = 100
Recall  = 100
F1 = 100
ROC area under curve 100

One-vs-All view: Class 4
Confusion matrix:   Relevant	Not Relevant
	Retrieved    	6	2
	Not Retrieved	0	37
Precision = 75
Recall  = 100
F1 = 85.7143
ROC area under curve 97.973

One-vs-All view: Class 5
Confusion matrix:   Relevant	Not Relevant
	Retrieved    	3	0
	Not Retrieved	1	41
Precision = 100
Recall  = 75
F1 = 85.7143
ROC area under curve 100

One-vs-All view: Class 6
Confusion matrix:   Relevant	Not Relevant
	Retrieved    	3	0
	Not Retrieved	2	40
Precision = 100
Recall  = 60
F1 = 75
ROC area under curve 95.2381

One-vs-All view: Class 7
Confusion matrix:   Relevant	Not Relevant
	Retrieved    	5	0
	Not Retrieved	0	40
Precision = 100
Recall  = 100
F1 = 100
ROC area under curve 99.5

One-vs-All view: Class 8
Confusion matrix:   Relevant	Not Relevant
	Retrieved    	5	0
	Not Retrieved	1	39
Precision = 100
Recall  = 83.3333
F1 = 90.9091
ROC area under curve 97
Time 2
