Arch: bert-base-uncased_pt
Bs trn: 16
Bs val: 16
Hidden dim: 256
Dataset: civilcomments
Resample class: 
Slice with: rep
Rep cluster method: gmm
Num anchor: 32
Num positive: 32
Num negative: 32
Num negative easy: 0
Weight anc by loss: False
Weight pos by loss: False
Weight neg by loss: False
Anc loss temp: 0.5
Pos loss temp: 0.5
Neg loss temp: 0.5
Data wide pos: False
Target sample ratio: 1
Balance targets: False
Additional negatives: False
Hard negative factor: 0
Full contrastive: False
Train encoder: False
No projection head: False
Projection dim: 128
Batch factor: None
Temperature: 0.05
Single pos: False
Supervised linear scale up: False
Supervised update delay: 0
Contrastive weight: 0.5
Classifier update interval: 8
Optim: AdamW
Max epoch: 5
Lr: 1e-05
Momentum: 0.9
Weight decay: 0.01
Weight decay c: 0.01
Stopping window: 30
Load encoder: 
Freeze encoder: False
Finetune epochs: 0
Clip grad norm: True
Lr scheduler classifier: 
Lr scheduler: 
Grad clip grad norm: False
Erm: False
Erm only: False
Pretrained spurious path: ./model/civilcomments/config/no_gce/JTT_sgd_no_gce_model_b_epoch0_seed42.pt
Max epoch s: 1
Bs trn s: 32
Lr s: 0.001
Momentum s: 0.9
Weight decay s: 0.0005
Slice temp: 10
Log loss interval: 10
Checkpoint interval: 50
Grad checkpoint interval: 50
Log visual interval: 100
Log grad visual interval: 50
Verbose: True
Seed: 42
Replicate: 0
No cuda: False
Resume: False
New slice: False
Num workers: 12
Evaluate: False
Data cmap: hsv
Test cmap: 
P correlation: 0.9
P corr by class: None
Train classes: ['non_toxic', 'toxic']
Train class ratios: None
Test shift: random
Flipped: False
Q: 0.7
Pretrained bmodel: True
Cosine: False
Exp: JTT_sgd_no_gce_JTT_adamW
Supervised contrast: True
Prioritize spurious pos: False
Contrastive type: cnc
Compute auroc: False
Model type: bert-base-uncased_pt_cnc
Criterion: cross_entropy
Pretrained: False
Max grad norm: 1.0
Adam epsilon: 1e-08
Warmup steps: 0
Max grad norm s: 1.0
Adam epsilon s: 1e-08
Warmup steps s: 0
Grad max grad norm: 1.0
Grad adam epsilon: 1e-08
Grad warmup steps: 0
Device: cuda
Img file type: .png
Display image: False
Image path: ./images/civilcomments/civilcomments/config/contrastive_umaps
Log interval: 1
Log path: ./logs/civilcomments/config
Results path: ./results/civilcomments/config
Model path: ./model/civilcomments/config
Loss factor: 1
Supersample labels: False
Subsample labels: False
Weigh slice samples by loss: True
Val split: 0.1
Spurious train split: 0.2
Subsample groups: False
Train method: sc
Max robust acc: -1
Max robust epoch: -1
Max robust group acc: (None, None)
Root dir: ./datasets/data/CivilComments/
Target name: toxic
Confounder names: ['identities']
Image mean: 0
Image std: 0
Augment data: False
Max token length: 300
Task: civilcomments
Num classes: 2
Experiment configs: config
Experiment name: cnc-civilcomments-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=5-bst=16-o=AdamW-lr=1e-05-mo=0.9-wd=0.01-wdc=0.01-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=42-r=0
Mi resampled: None

------------------------
> Loading spurious model
------------------------
Pretrained model loaded from ./model/civilcomments/config/no_gce/JTT_sgd_no_gce_model_b_epoch0_seed42.pt
======
# Calculate probability ...
======
======
# Load biased model ...
======

t_total is 10


t_total is 1413721125

male 0
[213150  25373  26078   4437]
1 1 25373
3 3 4437
female 1
[207241  31282  25553   4962]
1 1 31282
3 3 4962
LGBTQ 2
[232368   6155  28250   2265]
1 1 6155
3 3 2265
christian 3
[214231  24292  28069   2446]
1 1 24292
3 3 2446
muslim 4
[227694  10829  27390   3125]
1 1 10829
3 3 3125
other_religions 5
[232982   5541  29512   1003]
1 1 5541
3 3 1003
black 6
[231738   6785  27404   3111]
1 1 6785
3 3 3111
white 7
[226507  12016  25833   4682]
1 1 12016
3 3 4682
[213150  25373  26078   4437]
[207241  31282  25553   4962]
[232368   6155  28250   2265]
[214231  24292  28069   2446]
[227694  10829  27390   3125]
[232982   5541  29512   1003]
[231738   6785  27404   3111]
[226507  12016  25833   4682]
Epoch:   1 | Train Loss: 0.022 | Train Acc: 84.757 | Val Loss: 0.000 | Val Acc: 90.354
Training:
Accuracies by groups:
0, 0  acc: 57760 / 65506 =  88.175
0, 1  acc:  6108 /  7017 =  87.046
0, 2  acc:  9086 / 10882 =  83.496
0, 3  acc:  4536 /  5432 =  83.505
0, 4  acc:  1215 /  2161 =  56.224
0, 5  acc:   157 /   293 =  53.584
0, 6  acc:   204 /   317 =  64.353
0, 7  acc:   179 /   296 =  60.473
0, 8  acc:  5365 /  6272 =  85.539
0, 9  acc:   377 /   457 =  82.495
0, 10  acc:   384 /   475 =  80.842
0, 11  acc:   254 /   321 =  79.128
0, 12  acc:   237 /   418 =  56.699
0, 13  acc:    20 /    51 =  39.216
0, 14  acc:    33 /    53 =  62.264
0, 15  acc:    10 /    32 =  31.250
0, 16  acc:  3414 /  4983 =  68.513
0, 17  acc:   139 /   190 =  73.158
0, 18  acc:   342 /   475 =  72.000
0, 19  acc:   110 /   162 =  67.901
0, 20  acc:    61 /   140 =  43.571
0, 21  acc:    10 /    17 =  58.824
0, 22  acc:    37 /    56 =  66.071
0, 23  acc:     3 /    11 =  27.273
0, 24  acc:   416 /   623 =  66.774
0, 25  acc:    34 /    41 =  82.927
0, 26  acc:    48 /    61 =  78.689
0, 27  acc:    17 /    24 =  70.833
0, 28  acc:    21 /    35 =  60.000
0, 29  acc:     1 /     5 =  20.000
0, 30  acc:     3 /    12 =  25.000
0, 31  acc:     7 /     9 =  77.778
0, 32  acc:  1369 /  1650 =  82.970
0, 33  acc:    61 /    75 =  81.333
0, 34  acc:    52 /    63 =  82.540
0, 35  acc:    12 /    16 =  75.000
0, 36  acc:    27 /    38 =  71.053
0, 37  acc:     1 /     6 =  16.667
0, 38  acc:     7 /    11 =  63.636
0, 39  acc:     1 /     1 = 100.000
0, 40  acc:   341 /   409 =  83.374
0, 41  acc:    14 /    17 =  82.353
0, 42  acc:    10 /    11 =  90.909
0, 43  acc:     8 /     9 =  88.889
0, 44  acc:    10 /    19 =  52.632
0, 45  acc:     0 /     0 =     nan
0, 46  acc:     5 /     5 = 100.000
0, 47  acc:     3 /     5 =  60.000
0, 48  acc:   199 /   325 =  61.231
0, 49  acc:     4 /     4 = 100.000
0, 50  acc:    13 /    18 =  72.222
0, 51  acc:    14 /    14 = 100.000
0, 52  acc:     3 /     7 =  42.857
0, 53  acc:     0 /     0 =     nan
0, 54  acc:     1 /     2 =  50.000
0, 55  acc:     1 /     1 = 100.000
0, 56  acc:   205 /   301 =  68.106
0, 57  acc:     7 /     8 =  87.500
0, 58  acc:     6 /    11 =  54.545
0, 59  acc:    11 /    13 =  84.615
0, 60  acc:     7 /    18 =  38.889
0, 61  acc:     0 /     3 =   0.000
0, 62  acc:     9 /    15 =  60.000
0, 63  acc:     0 /     0 =     nan
0, 64  acc:  1505 /  2419 =  62.216
0, 65  acc:   198 /   353 =  56.091
0, 66  acc:   148 /   242 =  61.157
0, 67  acc:    65 /    89 =  73.034
0, 68  acc:    33 /    53 =  62.264
0, 69  acc:     3 /     4 =  75.000
0, 70  acc:     7 /    20 =  35.000
0, 71  acc:     5 /     7 =  71.429
0, 72  acc:    51 /    65 =  78.462
0, 73  acc:     3 /     6 =  50.000
0, 74  acc:     3 /     4 =  75.000
0, 75  acc:     9 /    13 =  69.231
0, 76  acc:     2 /     7 =  28.571
0, 77  acc:     0 /     0 =     nan
0, 78  acc:     0 /     0 =     nan
0, 79  acc:     0 /     0 =     nan
0, 80  acc:    67 /   109 =  61.468
0, 81  acc:     5 /    12 =  41.667
0, 82  acc:     6 /    11 =  54.545
0, 83  acc:     4 /     7 =  57.143
0, 84  acc:     3 /     4 =  75.000
0, 85  acc:     0 /     1 =   0.000
0, 86  acc:     7 /    14 =  50.000
0, 87  acc:     1 /     3 =  33.333
0, 88  acc:     8 /    11 =  72.727
0, 89  acc:     0 /     2 =   0.000
0, 90  acc:     0 /     0 =     nan
0, 91  acc:     0 /     0 =     nan
0, 92  acc:     0 /     0 =     nan
0, 93  acc:     0 /     1 =   0.000
0, 94  acc:    42 /    70 =  60.000
0, 95  acc:     3 /     3 = 100.000
0, 96  acc:     1 /     4 =  25.000
0, 97  acc:     2 /     2 = 100.000
0, 98  acc:     7 /    15 =  46.667
0, 99  acc:     2 /     2 = 100.000
0, 100  acc:     0 /     2 =   0.000
0, 101  acc:     4 /     5 =  80.000
0, 102  acc:     0 /     0 =     nan
0, 103  acc:     1 /     1 = 100.000
0, 104  acc:     0 /     0 =     nan
0, 105  acc:     1 /     1 = 100.000
0, 106  acc:     9 /    17 =  52.941
0, 107  acc:     0 /     0 =     nan
0, 108  acc:     0 /     0 =     nan
0, 109  acc:     1 /     1 = 100.000
0, 110  acc:     0 /     5 =   0.000
0, 111  acc:     0 /     1 =   0.000
0, 112  acc:     4 /     9 =  44.444
0, 113  acc:     0 /     0 =     nan
0, 114  acc:     0 /     0 =     nan
0, 115  acc:     0 /     0 =     nan
0, 116  acc:     1 /     1 = 100.000
0, 117  acc:  5421 /  7025 =  77.167
0, 118  acc:  1284 /  1710 =  75.088
0, 119  acc:   259 /   364 =  71.154
0, 120  acc:   294 /   373 =  78.820
0, 121  acc:    48 /    84 =  57.143
0, 122  acc:    19 /    37 =  51.351
0, 123  acc:     8 /     8 = 100.000
0, 124  acc:    18 /    24 =  75.000
0, 125  acc:   271 /   368 =  73.641
0, 126  acc:    88 /   120 =  73.333
0, 127  acc:     7 /    12 =  58.333
0, 128  acc:    38 /    48 =  79.167
0, 129  acc:     4 /     5 =  80.000
0, 130  acc:     4 /     6 =  66.667
0, 131  acc:     1 /     1 = 100.000
0, 132  acc:     0 /     0 =     nan
0, 133  acc:   156 /   260 =  60.000
0, 134  acc:    41 /    79 =  51.899
0, 135  acc:    20 /    26 =  76.923
0, 136  acc:    31 /    39 =  79.487
0, 137  acc:     8 /    11 =  72.727
0, 138  acc:     6 /     6 = 100.000
0, 139  acc:     0 /     0 =     nan
0, 140  acc:     0 /     0 =     nan
0, 141  acc:    38 /    68 =  55.882
0, 142  acc:     8 /    13 =  61.538
0, 143  acc:     3 /    10 =  30.000
0, 144  acc:     9 /    11 =  81.818
0, 145  acc:     0 /     0 =     nan
0, 146  acc:     0 /     1 =   0.000
0, 147  acc:     0 /     0 =     nan
0, 148  acc:    82 /   116 =  70.690
0, 149  acc:     8 /    13 =  61.538
0, 150  acc:     4 /     5 =  80.000
0, 151  acc:    14 /    22 =  63.636
0, 152  acc:     4 /     6 =  66.667
0, 153  acc:     2 /     3 =  66.667
0, 154  acc:    43 /    49 =  87.755
0, 155  acc:     3 /     6 =  50.000
0, 156  acc:     1 /     1 = 100.000
0, 157  acc:     0 /     0 =     nan
0, 158  acc:     3 /     3 = 100.000
0, 159  acc:     6 /    18 =  33.333
0, 160  acc:     0 /     1 =   0.000
0, 161  acc:     1 /     1 = 100.000
0, 162  acc:     1 /     2 =  50.000
0, 163  acc:     0 /     0 =     nan
0, 164  acc:    15 /    16 =  93.750
0, 165  acc:     1 /     1 = 100.000
0, 166  acc:     3 /     6 =  50.000
0, 167  acc:     1 /     2 =  50.000
0, 168  acc:     0 /     0 =     nan
0, 169  acc:  1050 /  1781 =  58.956
0, 170  acc:   229 /   425 =  53.882
0, 171  acc:    58 /   110 =  52.727
0, 172  acc:   100 /   159 =  62.893
0, 173  acc:     8 /    24 =  33.333
0, 174  acc:     3 /     5 =  60.000
0, 175  acc:     4 /     5 =  80.000
0, 176  acc:     1 /    15 =   6.667
0, 177  acc:    47 /    68 =  69.118
0, 178  acc:     6 /     9 =  66.667
0, 179  acc:    10 /    11 =  90.909
0, 180  acc:     2 /     3 =  66.667
0, 181  acc:     0 /     0 =     nan
0, 182  acc:     0 /     0 =     nan
0, 183  acc:     3 /     4 =  75.000
0, 184  acc:    44 /    68 =  64.706
0, 185  acc:     4 /     4 = 100.000
0, 186  acc:     3 /     5 =  60.000
0, 187  acc:     2 /     4 =  50.000
0, 188  acc:     0 /     0 =     nan
0, 189  acc:     8 /     8 = 100.000
0, 190  acc:     0 /     0 =     nan
0, 191  acc:    16 /    37 =  43.243
0, 192  acc:     0 /     2 =   0.000
0, 193  acc:     0 /     0 =     nan
0, 194  acc:     0 /     2 =   0.000
0, 195  acc:     0 /     4 =   0.000
0, 196  acc:    40 /    61 =  65.574
0, 197  acc:    21 /    25 =  84.000
0, 198  acc:     0 /     4 =   0.000
0, 199  acc:     5 /     8 =  62.500
0, 200  acc:     7 /     9 =  77.778
0, 201  acc:     0 /     0 =     nan
0, 202  acc:     0 /     0 =     nan
0, 203  acc:     1 /     3 =  33.333
0, 204  acc:    12 /    17 =  70.588
0, 205  acc:     6 /     6 = 100.000
0, 206  acc:     0 /     0 =     nan
0, 207  acc:     2 /     2 = 100.000
0, 208  acc:     3 /     6 =  50.000
0, 209  acc:     6 /     8 =  75.000
0, 210  acc:     3 /     6 =  50.000
0, 211  acc:     1 /     1 = 100.000
0, 212  acc:     0 /     0 =     nan
0, 213  acc:     0 /     0 =     nan
0, 214  acc:     0 /     1 =   0.000
0, 215  acc:     0 /     0 =     nan
0, 216  acc:     3 /     8 =  37.500
0, 217  acc:     0 /     0 =     nan
0, 218  acc:     0 /     0 =     nan
0, 219  acc:     0 /     0 =     nan
0, 220  acc:     0 /     1 =   0.000
0, 221  acc:     0 /     0 =     nan
1, 0  acc: 54426 / 61468 =  88.544
1, 1  acc:  5382 /  6283 =  85.660
1, 2  acc:  9390 / 11037 =  85.077
1, 3  acc:  3902 /  4712 =  82.810
1, 4  acc:  4967 /  5391 =  92.135
1, 5  acc:   814 /   891 =  91.358
1, 6  acc:   447 /   504 =  88.690
1, 7  acc:   594 /   662 =  89.728
1, 8  acc:  4630 /  5585 =  82.901
1, 9  acc:   318 /   378 =  84.127
1, 10  acc:   417 /   501 =  83.234
1, 11  acc:   183 /   229 =  79.913
1, 12  acc:   789 /   853 =  92.497
1, 13  acc:   119 /   131 =  90.840
1, 14  acc:   111 /   140 =  79.286
1, 15  acc:   117 /   132 =  88.636
1, 16  acc:  7167 /  8342 =  85.915
1, 17  acc:   241 /   292 =  82.534
1, 18  acc:   524 /   624 =  83.974
1, 19  acc:   156 /   208 =  75.000
1, 20  acc:   268 /   295 =  90.847
1, 21  acc:    41 /    43 =  95.349
1, 22  acc:   117 /   139 =  84.173
1, 23  acc:    37 /    42 =  88.095
1, 24  acc:   939 /  1136 =  82.658
1, 25  acc:    27 /    31 =  87.097
1, 26  acc:    96 /   108 =  88.889
1, 27  acc:    11 /    12 =  91.667
1, 28  acc:   129 /   136 =  94.853
1, 29  acc:     8 /     9 =  88.889
1, 30  acc:    25 /    27 =  92.593
1, 31  acc:    10 /    11 =  90.909
1, 32  acc:  1450 /  1734 =  83.622
1, 33  acc:    77 /    95 =  81.053
1, 34  acc:    58 /    72 =  80.556
1, 35  acc:    20 /    23 =  86.957
1, 36  acc:    45 /    47 =  95.745
1, 37  acc:     4 /     5 =  80.000
1, 38  acc:    29 /    33 =  87.879
1, 39  acc:     5 /     5 = 100.000
1, 40  acc:   374 /   441 =  84.807
1, 41  acc:    23 /    25 =  92.000
1, 42  acc:     8 /    15 =  53.333
1, 43  acc:    18 /    25 =  72.000
1, 44  acc:    30 /    32 =  93.750
1, 45  acc:     4 /     5 =  80.000
1, 46  acc:     7 /     9 =  77.778
1, 47  acc:     0 /     0 =     nan
1, 48  acc:   485 /   564 =  85.993
1, 49  acc:    12 /    13 =  92.308
1, 50  acc:    41 /    47 =  87.234
1, 51  acc:    25 /    26 =  96.154
1, 52  acc:    12 /    14 =  85.714
1, 53  acc:     0 /     0 =     nan
1, 54  acc:    21 /    28 =  75.000
1, 55  acc:     0 /     0 =     nan
1, 56  acc:   358 /   428 =  83.645
1, 57  acc:    20 /    21 =  95.238
1, 58  acc:    23 /    24 =  95.833
1, 59  acc:    14 /    18 =  77.778
1, 60  acc:    21 /    29 =  72.414
1, 61  acc:     0 /     0 =     nan
1, 62  acc:    13 /    13 = 100.000
1, 63  acc:     0 /     0 =     nan
1, 64  acc:  5097 /  5628 =  90.565
1, 65  acc:   674 /   778 =  86.632
1, 66  acc:   411 /   484 =  84.917
1, 67  acc:   158 /   203 =  77.833
1, 68  acc:   235 /   251 =  93.625
1, 69  acc:    38 /    38 = 100.000
1, 70  acc:    86 /    93 =  92.473
1, 71  acc:    18 /    19 =  94.737
1, 72  acc:   114 /   125 =  91.200
1, 73  acc:     3 /     4 =  75.000
1, 74  acc:     0 /     3 =   0.000
1, 75  acc:     5 /     5 = 100.000
1, 76  acc:    25 /    27 =  92.593
1, 77  acc:     2 /     4 =  50.000
1, 78  acc:     0 /     0 =     nan
1, 79  acc:     4 /     4 = 100.000
1, 80  acc:   169 /   200 =  84.500
1, 81  acc:    22 /    24 =  91.667
1, 82  acc:    49 /    51 =  96.078
1, 83  acc:     4 /     4 = 100.000
1, 84  acc:    13 /    13 = 100.000
1, 85  acc:     0 /     0 =     nan
1, 86  acc:    28 /    29 =  96.552
1, 87  acc:     0 /     0 =     nan
1, 88  acc:    17 /    21 =  80.952
1, 89  acc:     0 /     0 =     nan
1, 90  acc:     0 /     0 =     nan
1, 91  acc:     0 /     0 =     nan
1, 92  acc:     1 /     3 =  33.333
1, 93  acc:     5 /     5 = 100.000
1, 94  acc:   133 /   157 =  84.713
1, 95  acc:    14 /    19 =  73.684
1, 96  acc:    20 /    20 = 100.000
1, 97  acc:     0 /     0 =     nan
1, 98  acc:    21 /    22 =  95.455
1, 99  acc:     0 /     0 =     nan
1, 100  acc:    27 /    30 =  90.000
1, 101  acc:     4 /     4 = 100.000
1, 102  acc:     0 /     0 =     nan
1, 103  acc:     0 /     0 =     nan
1, 104  acc:     4 /     4 = 100.000
1, 105  acc:     0 /     0 =     nan
1, 106  acc:    22 /    26 =  84.615
1, 107  acc:     0 /     0 =     nan
1, 108  acc:    10 /    13 =  76.923
1, 109  acc:     0 /     0 =     nan
1, 110  acc:    13 /    13 = 100.000
1, 111  acc:     1 /     4 =  25.000
1, 112  acc:    16 /    17 =  94.118
1, 113  acc:     0 /     0 =     nan
1, 114  acc:     0 /     0 =     nan
1, 115  acc:     0 /     0 =     nan
1, 116  acc:     0 /     0 =     nan
1, 117  acc:  6579 /  8279 =  79.466
1, 118  acc:  1705 /  2040 =  83.578
1, 119  acc:   413 /   495 =  83.434
1, 120  acc:   462 /   563 =  82.060
1, 121  acc:   148 /   163 =  90.798
1, 122  acc:    73 /    89 =  82.022
1, 123  acc:    23 /    35 =  65.714
1, 124  acc:    47 /    49 =  95.918
1, 125  acc:   450 /   555 =  81.081
1, 126  acc:   115 /   135 =  85.185
1, 127  acc:    16 /    26 =  61.538
1, 128  acc:    28 /    40 =  70.000
1, 129  acc:    19 /    20 =  95.000
1, 130  acc:     9 /    11 =  81.818
1, 131  acc:     0 /     0 =     nan
1, 132  acc:     9 /    12 =  75.000
1, 133  acc:   380 /   465 =  81.720
1, 134  acc:    72 /    90 =  80.000
1, 135  acc:    37 /    40 =  92.500
1, 136  acc:    13 /    25 =  52.000
1, 137  acc:     4 /     4 = 100.000
1, 138  acc:     3 /     4 =  75.000
1, 139  acc:     5 /     5 = 100.000
1, 140  acc:     2 /     2 = 100.000
1, 141  acc:    90 /   129 =  69.767
1, 142  acc:    25 /    27 =  92.593
1, 143  acc:     3 /     3 = 100.000
1, 144  acc:     4 /     6 =  66.667
1, 145  acc:     1 /     2 =  50.000
1, 146  acc:     0 /     0 =     nan
1, 147  acc:     0 /     4 =   0.000
1, 148  acc:   159 /   218 =  72.936
1, 149  acc:    17 /    22 =  77.273
1, 150  acc:    11 /    11 = 100.000
1, 151  acc:     5 /    14 =  35.714
1, 152  acc:     3 /     3 = 100.000
1, 153  acc:     0 /     2 =   0.000
1, 154  acc:    35 /    43 =  81.395
1, 155  acc:     0 /     0 =     nan
1, 156  acc:     0 /     0 =     nan
1, 157  acc:    11 /    13 =  84.615
1, 158  acc:     0 /     0 =     nan
1, 159  acc:    34 /    36 =  94.444
1, 160  acc:     1 /     3 =  33.333
1, 161  acc:     0 /     0 =     nan
1, 162  acc:     0 /     0 =     nan
1, 163  acc:     0 /     0 =     nan
1, 164  acc:    24 /    32 =  75.000
1, 165  acc:     9 /    10 =  90.000
1, 166  acc:     0 /     0 =     nan
1, 167  acc:     0 /     0 =     nan
1, 168  acc:     0 /     0 =     nan
1, 169  acc:  3030 /  3486 =  86.919
1, 170  acc:   635 /   705 =  90.071
1, 171  acc:   213 /   253 =  84.190
1, 172  acc:   193 /   223 =  86.547
1, 173  acc:    42 /    50 =  84.000
1, 174  acc:     7 /    12 =  58.333
1, 175  acc:     5 /     5 = 100.000
1, 176  acc:    48 /    58 =  82.759
1, 177  acc:    94 /    98 =  95.918
1, 178  acc:    11 /    19 =  57.895
1, 179  acc:     4 /     8 =  50.000
1, 180  acc:     5 /     9 =  55.556
1, 181  acc:     9 /     9 = 100.000
1, 182  acc:     3 /     3 = 100.000
1, 183  acc:    17 /    19 =  89.474
1, 184  acc:   100 /   115 =  86.957
1, 185  acc:    47 /    48 =  97.917
1, 186  acc:    20 /    22 =  90.909
1, 187  acc:    11 /    11 = 100.000
1, 188  acc:     2 /     2 = 100.000
1, 189  acc:     4 /     6 =  66.667
1, 190  acc:    14 /    17 =  82.353
1, 191  acc:     7 /     8 =  87.500
1, 192  acc:     9 /     9 = 100.000
1, 193  acc:     8 /     8 = 100.000
1, 194  acc:     2 /     3 =  66.667
1, 195  acc:     4 /     4 = 100.000
1, 196  acc:   100 /   118 =  84.746
1, 197  acc:    11 /    12 =  91.667
1, 198  acc:     0 /     0 =     nan
1, 199  acc:     0 /     0 =     nan
1, 200  acc:     0 /     0 =     nan
1, 201  acc:     0 /     0 =     nan
1, 202  acc:     1 /     1 = 100.000
1, 203  acc:     0 /     0 =     nan
1, 204  acc:    16 /    19 =  84.211
1, 205  acc:     8 /     8 = 100.000
1, 206  acc:     0 /     0 =     nan
1, 207  acc:     0 /     0 =     nan
1, 208  acc:     0 /     0 =     nan
1, 209  acc:    19 /    20 =  95.000
1, 210  acc:     0 /     0 =     nan
1, 211  acc:     2 /     2 = 100.000
1, 212  acc:     0 /     0 =     nan
1, 213  acc:    12 /    13 =  92.308
1, 214  acc:     0 /     0 =     nan
1, 215  acc:     4 /     4 = 100.000
1, 216  acc:     0 /     0 =     nan
1, 217  acc:     3 /     3 = 100.000
1, 218  acc:    12 /    12 = 100.000
1, 219  acc:     6 /     6 = 100.000
1, 220  acc:     0 /     0 =     nan
1, 221  acc:     0 /     0 =     nan
--------------------------------------
Average acc: 228028 / 269038 =  84.757
Robust  acc:     0 /     3 =   0.000
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc: 22950 / 25373 =  90.450
0, 1  acc: 28257 / 31282 =  90.330
0, 2  acc:  5563 /  6155 =  90.382
0, 3  acc: 21895 / 24292 =  90.133
0, 4  acc:  9785 / 10829 =  90.359
0, 5  acc:  4999 /  5541 =  90.218
0, 6  acc:  6132 /  6785 =  90.376
0, 7  acc: 10837 / 12016 =  90.188
1, 0  acc:  3999 /  4437 =  90.128
1, 1  acc:  4500 /  4962 =  90.689
1, 2  acc:  2045 /  2265 =  90.287
1, 3  acc:  2212 /  2446 =  90.433
1, 4  acc:  2834 /  3125 =  90.688
1, 5  acc:   895 /  1003 =  89.232
1, 6  acc:  2801 /  3111 =  90.035
1, 7  acc:  4239 /  4682 =  90.538
--------------------------------------
Average acc: 133943 / 148304 =  90.317
Robust  acc:   895 /  1003 =  89.232
--------------------------------------
New max robust acc: 89.23230309072781
debias model - Saving best checkpoint at epoch 0
replace: True
Checkpoint saved at ./model/civilcomments/config/debias-wga-best_seed42.pt
male 0
[106466  12092  13021   2203]
1 1 12092
3 3 2203
female 1
[104379  14179  12954   2270]
1 1 14179
3 3 2270
LGBTQ 2
[115348   3210  14008   1216]
1 1 3210
3 3 1216
christian 3
[106457  12101  13964   1260]
1 1 12101
3 3 1260
muslim 4
[113203   5355  13597   1627]
1 1 5355
3 3 1627
other_religions 5
[115578   2980  14704    520]
1 1 2980
3 3 520
black 6
[115223   3335  13687   1537]
1 1 3335
3 3 1537
white 7
[112835   5723  12978   2246]
1 1 5723
3 3 2246
[106466  12092  13021   2203]
[104379  14179  12954   2270]
[115348   3210  14008   1216]
[106457  12101  13964   1260]
[113203   5355  13597   1627]
[115578   2980  14704    520]
[115223   3335  13687   1537]
[112835   5723  12978   2246]
Robust Acc: 47.676 | Best Acc: 88.744
-------------------------------------
Training, Epoch 0:
Accuracies by groups:
0, 0  acc:  9313 / 12092 =  77.018
0, 1  acc: 11331 / 14179 =  79.914
0, 2  acc:  1580 /  3210 =  49.221
0, 3  acc:  9812 / 12101 =  81.084
0, 4  acc:  2973 /  5355 =  55.518
0, 5  acc:  2109 /  2980 =  70.772
0, 6  acc:  1590 /  3335 =  47.676
0, 7  acc:  3153 /  5723 =  55.093
1, 0  acc:  1870 /  2203 =  84.884
1, 1  acc:  1849 /  2270 =  81.454
1, 2  acc:  1046 /  1216 =  86.020
1, 3  acc:  1048 /  1260 =  83.175
1, 4  acc:  1403 /  1627 =  86.232
1, 5  acc:   432 /   520 =  83.077
1, 6  acc:  1364 /  1537 =  88.744
1, 7  acc:  1886 /  2246 =  83.972
------------------------------------
Average acc: 52759 / 71854 =  73.425
Robust  acc:  1590 /  3335 =  47.676
------------------------------------
Accuracies by groups:
0, 0  acc:  9313 / 12092 =  77.018
0, 1  acc: 11331 / 14179 =  79.914
0, 2  acc:  1580 /  3210 =  49.221
0, 3  acc:  9812 / 12101 =  81.084
0, 4  acc:  2973 /  5355 =  55.518
0, 5  acc:  2109 /  2980 =  70.772
0, 6  acc:  1590 /  3335 =  47.676
0, 7  acc:  3153 /  5723 =  55.093
1, 0  acc:  1870 /  2203 =  84.884
1, 1  acc:  1849 /  2270 =  81.454
1, 2  acc:  1046 /  1216 =  86.020
1, 3  acc:  1048 /  1260 =  83.175
1, 4  acc:  1403 /  1627 =  86.232
1, 5  acc:   432 /   520 =  83.077
1, 6  acc:  1364 /  1537 =  88.744
1, 7  acc:  1886 /  2246 =  83.972
------------------------------------
Average acc: 52759 / 71854 =  73.425
Robust  acc:  1590 /  3335 =  47.676
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9313 / 12092 =  77.018
0, 1  acc: 11331 / 14179 =  79.914
0, 2  acc:  1580 /  3210 =  49.221
0, 3  acc:  9812 / 12101 =  81.084
0, 4  acc:  2973 /  5355 =  55.518
0, 5  acc:  2109 /  2980 =  70.772
0, 6  acc:  1590 /  3335 =  47.676
0, 7  acc:  3153 /  5723 =  55.093
1, 0  acc:  1870 /  2203 =  84.884
1, 1  acc:  1849 /  2270 =  81.454
1, 2  acc:  1046 /  1216 =  86.020
1, 3  acc:  1048 /  1260 =  83.175
1, 4  acc:  1403 /  1627 =  86.232
1, 5  acc:   432 /   520 =  83.077
1, 6  acc:  1364 /  1537 =  88.744
1, 7  acc:  1886 /  2246 =  83.972
------------------------------------
Average acc: 52759 / 71854 =  73.425
Robust  acc:  1590 /  3335 =  47.676
------------------------------------

t_total is 1413721125

male 0
[213150  25373  26078   4437]
1 1 25373
3 3 4437
female 1
[207241  31282  25553   4962]
1 1 31282
3 3 4962
LGBTQ 2
[232368   6155  28250   2265]
1 1 6155
3 3 2265
christian 3
[214231  24292  28069   2446]
1 1 24292
3 3 2446
muslim 4
[227694  10829  27390   3125]
1 1 10829
3 3 3125
other_religions 5
[232982   5541  29512   1003]
1 1 5541
3 3 1003
black 6
[231738   6785  27404   3111]
1 1 6785
3 3 3111
white 7
[226507  12016  25833   4682]
1 1 12016
3 3 4682
[213150  25373  26078   4437]
[207241  31282  25553   4962]
[232368   6155  28250   2265]
[214231  24292  28069   2446]
[227694  10829  27390   3125]
[232982   5541  29512   1003]
[231738   6785  27404   3111]
[226507  12016  25833   4682]
Epoch:   2 | Train Loss: 0.012 | Train Acc: 93.819 | Val Loss: 0.000 | Val Acc: 94.306
Training:
Accuracies by groups:
0, 0  acc: 61914 / 65491 =  94.538
0, 1  acc:  6601 /  7010 =  94.165
0, 2  acc: 10091 / 10894 =  92.629
0, 3  acc:  5111 /  5529 =  92.440
0, 4  acc:  1693 /  2126 =  79.633
0, 5  acc:   200 /   284 =  70.423
0, 6  acc:   262 /   313 =  83.706
0, 7  acc:   219 /   271 =  80.812
0, 8  acc:  5779 /  6248 =  92.494
0, 9  acc:   434 /   484 =  89.669
0, 10  acc:   391 /   422 =  92.654
0, 11  acc:   267 /   305 =  87.541
0, 12  acc:   302 /   403 =  74.938
0, 13  acc:    23 /    30 =  76.667
0, 14  acc:    34 /    43 =  79.070
0, 15  acc:    20 /    30 =  66.667
0, 16  acc:  4279 /  4968 =  86.131
0, 17  acc:   166 /   197 =  84.264
0, 18  acc:   450 /   522 =  86.207
0, 19  acc:   146 /   163 =  89.571
0, 20  acc:    98 /   125 =  78.400
0, 21  acc:    12 /    17 =  70.588
0, 22  acc:    54 /    64 =  84.375
0, 23  acc:    10 /    15 =  66.667
0, 24  acc:   538 /   651 =  82.642
0, 25  acc:    37 /    41 =  90.244
0, 26  acc:    68 /    75 =  90.667
0, 27  acc:    27 /    28 =  96.429
0, 28  acc:    37 /    44 =  84.091
0, 29  acc:     1 /     2 =  50.000
0, 30  acc:     5 /     8 =  62.500
0, 31  acc:     8 /     9 =  88.889
0, 32  acc:  1536 /  1661 =  92.474
0, 33  acc:    75 /    79 =  94.937
0, 34  acc:    71 /    75 =  94.667
0, 35  acc:    19 /    23 =  82.609
0, 36  acc:    34 /    40 =  85.000
0, 37  acc:    11 /    12 =  91.667
0, 38  acc:    14 /    17 =  82.353
0, 39  acc:     2 /     2 = 100.000
0, 40  acc:   382 /   408 =  93.627
0, 41  acc:    13 /    13 = 100.000
0, 42  acc:     9 /    11 =  81.818
0, 43  acc:    10 /    10 = 100.000
0, 44  acc:    16 /    21 =  76.190
0, 45  acc:     1 /     1 = 100.000
0, 46  acc:     7 /     7 = 100.000
0, 47  acc:     5 /     5 = 100.000
0, 48  acc:   289 /   334 =  86.527
0, 49  acc:     1 /     1 = 100.000
0, 50  acc:    11 /    11 = 100.000
0, 51  acc:    15 /    16 =  93.750
0, 52  acc:     4 /     4 = 100.000
0, 53  acc:     1 /     1 = 100.000
0, 54  acc:     6 /     7 =  85.714
0, 55  acc:     2 /     2 = 100.000
0, 56  acc:   242 /   280 =  86.429
0, 57  acc:     6 /     6 = 100.000
0, 58  acc:     8 /    13 =  61.538
0, 59  acc:    10 /    10 = 100.000
0, 60  acc:    11 /    17 =  64.706
0, 61  acc:     1 /     1 = 100.000
0, 62  acc:     8 /     8 = 100.000
0, 63  acc:     0 /     0 =     nan
0, 64  acc:  2051 /  2469 =  83.070
0, 65  acc:   288 /   351 =  82.051
0, 66  acc:   209 /   249 =  83.936
0, 67  acc:    89 /    97 =  91.753
0, 68  acc:    28 /    41 =  68.293
0, 69  acc:     4 /     4 = 100.000
0, 70  acc:     8 /    13 =  61.538
0, 71  acc:     9 /     9 = 100.000
0, 72  acc:    65 /    73 =  89.041
0, 73  acc:     9 /     9 = 100.000
0, 74  acc:     8 /     9 =  88.889
0, 75  acc:     2 /     2 = 100.000
0, 76  acc:     2 /     4 =  50.000
0, 77  acc:     0 /     0 =     nan
0, 78  acc:     1 /     1 = 100.000
0, 79  acc:     0 /     0 =     nan
0, 80  acc:    78 /   100 =  78.000
0, 81  acc:    10 /    14 =  71.429
0, 82  acc:     5 /     6 =  83.333
0, 83  acc:     2 /     6 =  33.333
0, 84  acc:     2 /     3 =  66.667
0, 85  acc:     0 /     0 =     nan
0, 86  acc:     3 /     6 =  50.000
0, 87  acc:     0 /     0 =     nan
0, 88  acc:    10 /    11 =  90.909
0, 89  acc:     3 /     3 = 100.000
0, 90  acc:     0 /     0 =     nan
0, 91  acc:     2 /     2 = 100.000
0, 92  acc:     0 /     0 =     nan
0, 93  acc:     2 /     2 = 100.000
0, 94  acc:    55 /    67 =  82.090
0, 95  acc:     1 /     2 =  50.000
0, 96  acc:     5 /     6 =  83.333
0, 97  acc:     1 /     1 = 100.000
0, 98  acc:     8 /    10 =  80.000
0, 99  acc:     2 /     2 = 100.000
0, 100  acc:     0 /     2 =   0.000
0, 101  acc:     8 /     8 = 100.000
0, 102  acc:     1 /     1 = 100.000
0, 103  acc:     1 /     1 = 100.000
0, 104  acc:     0 /     0 =     nan
0, 105  acc:     0 /     0 =     nan
0, 106  acc:    13 /    18 =  72.222
0, 107  acc:     0 /     0 =     nan
0, 108  acc:     0 /     0 =     nan
0, 109  acc:     0 /     0 =     nan
0, 110  acc:     1 /     7 =  14.286
0, 111  acc:     0 /     0 =     nan
0, 112  acc:     8 /    10 =  80.000
0, 113  acc:     0 /     0 =     nan
0, 114  acc:     0 /     0 =     nan
0, 115  acc:     0 /     0 =     nan
0, 116  acc:     0 /     0 =     nan
0, 117  acc:  6146 /  6855 =  89.657
0, 118  acc:  1498 /  1670 =  89.701
0, 119  acc:   353 /   391 =  90.281
0, 120  acc:   310 /   360 =  86.111
0, 121  acc:    54 /    71 =  76.056
0, 122  acc:    35 /    39 =  89.744
0, 123  acc:     7 /     8 =  87.500
0, 124  acc:    23 /    29 =  79.310
0, 125  acc:   353 /   394 =  89.594
0, 126  acc:   109 /   124 =  87.903
0, 127  acc:     9 /    12 =  75.000
0, 128  acc:    47 /    52 =  90.385
0, 129  acc:     2 /     3 =  66.667
0, 130  acc:     5 /     5 = 100.000
0, 131  acc:     4 /     4 = 100.000
0, 132  acc:     0 /     0 =     nan
0, 133  acc:   218 /   262 =  83.206
0, 134  acc:    70 /    84 =  83.333
0, 135  acc:    30 /    31 =  96.774
0, 136  acc:    35 /    42 =  83.333
0, 137  acc:    12 /    15 =  80.000
0, 138  acc:     0 /     0 =     nan
0, 139  acc:     0 /     0 =     nan
0, 140  acc:     0 /     0 =     nan
0, 141  acc:    48 /    64 =  75.000
0, 142  acc:    16 /    17 =  94.118
0, 143  acc:     6 /     7 =  85.714
0, 144  acc:    21 /    23 =  91.304
0, 145  acc:     0 /     1 =   0.000
0, 146  acc:     0 /     1 =   0.000
0, 147  acc:     0 /     0 =     nan
0, 148  acc:    98 /   108 =  90.741
0, 149  acc:    11 /    13 =  84.615
0, 150  acc:     0 /     0 =     nan
0, 151  acc:    20 /    29 =  68.966
0, 152  acc:     0 /     1 =   0.000
0, 153  acc:     4 /     4 = 100.000
0, 154  acc:    45 /    46 =  97.826
0, 155  acc:     6 /     6 = 100.000
0, 156  acc:     1 /     1 = 100.000
0, 157  acc:     0 /     0 =     nan
0, 158  acc:     5 /     5 = 100.000
0, 159  acc:    17 /    18 =  94.444
0, 160  acc:     0 /     0 =     nan
0, 161  acc:     2 /     2 = 100.000
0, 162  acc:     4 /     4 = 100.000
0, 163  acc:     0 /     0 =     nan
0, 164  acc:    16 /    17 =  94.118
0, 165  acc:     4 /     4 = 100.000
0, 166  acc:    10 /    11 =  90.909
0, 167  acc:     1 /     1 = 100.000
0, 168  acc:     1 /     1 = 100.000
0, 169  acc:  1494 /  1834 =  81.461
0, 170  acc:   320 /   404 =  79.208
0, 171  acc:    78 /    98 =  79.592
0, 172  acc:   161 /   177 =  90.960
0, 173  acc:    11 /    19 =  57.895
0, 174  acc:     6 /     8 =  75.000
0, 175  acc:    12 /    12 = 100.000
0, 176  acc:     5 /    10 =  50.000
0, 177  acc:    52 /    64 =  81.250
0, 178  acc:    13 /    15 =  86.667
0, 179  acc:    11 /    12 =  91.667
0, 180  acc:     6 /     7 =  85.714
0, 181  acc:     3 /     5 =  60.000
0, 182  acc:     0 /     0 =     nan
0, 183  acc:     7 /     7 = 100.000
0, 184  acc:    41 /    53 =  77.358
0, 185  acc:     6 /     6 = 100.000
0, 186  acc:     7 /     9 =  77.778
0, 187  acc:     4 /     7 =  57.143
0, 188  acc:     0 /     3 =   0.000
0, 189  acc:     5 /     5 = 100.000
0, 190  acc:     0 /     0 =     nan
0, 191  acc:    29 /    31 =  93.548
0, 192  acc:     0 /     1 =   0.000
0, 193  acc:     0 /     1 =   0.000
0, 194  acc:     1 /     1 = 100.000
0, 195  acc:     0 /     1 =   0.000
0, 196  acc:    56 /    65 =  86.154
0, 197  acc:    21 /    21 = 100.000
0, 198  acc:     0 /     4 =   0.000
0, 199  acc:     7 /     8 =  87.500
0, 200  acc:     3 /     3 = 100.000
0, 201  acc:     1 /     1 = 100.000
0, 202  acc:     0 /     0 =     nan
0, 203  acc:     1 /     1 = 100.000
0, 204  acc:    18 /    22 =  81.818
0, 205  acc:     5 /     5 = 100.000
0, 206  acc:     1 /     1 = 100.000
0, 207  acc:     7 /     7 = 100.000
0, 208  acc:     1 /     2 =  50.000
0, 209  acc:     4 /     6 =  66.667
0, 210  acc:     1 /     1 = 100.000
0, 211  acc:     0 /     1 =   0.000
0, 212  acc:     1 /     2 =  50.000
0, 213  acc:     0 /     1 =   0.000
0, 214  acc:     3 /     4 =  75.000
0, 215  acc:     0 /     0 =     nan
0, 216  acc:     7 /     8 =  87.500
0, 217  acc:     0 /     0 =     nan
0, 218  acc:     0 /     1 =   0.000
0, 219  acc:     0 /     0 =     nan
0, 220  acc:     1 /     1 = 100.000
0, 221  acc:     4 /     4 = 100.000
1, 0  acc: 59353 / 61545 =  96.438
1, 1  acc:  6077 /  6343 =  95.806
1, 2  acc: 10386 / 10928 =  95.040
1, 3  acc:  4426 /  4671 =  94.755
1, 4  acc:  5205 /  5414 =  96.140
1, 5  acc:   923 /   962 =  95.946
1, 6  acc:   530 /   557 =  95.153
1, 7  acc:   652 /   684 =  95.322
1, 8  acc:  5254 /  5533 =  94.958
1, 9  acc:   393 /   423 =  92.908
1, 10  acc:   448 /   479 =  93.528
1, 11  acc:   234 /   249 =  93.976
1, 12  acc:   800 /   832 =  96.154
1, 13  acc:    99 /   105 =  94.286
1, 14  acc:   137 /   147 =  93.197
1, 15  acc:   126 /   139 =  90.647
1, 16  acc:  7973 /  8421 =  94.680
1, 17  acc:   258 /   273 =  94.505
1, 18  acc:   602 /   651 =  92.473
1, 19  acc:   215 /   230 =  93.478
1, 20  acc:   276 /   292 =  94.521
1, 21  acc:    47 /    47 = 100.000
1, 22  acc:   128 /   134 =  95.522
1, 23  acc:    33 /    36 =  91.667
1, 24  acc:  1000 /  1076 =  92.937
1, 25  acc:    22 /    23 =  95.652
1, 26  acc:    95 /    97 =  97.938
1, 27  acc:    10 /    11 =  90.909
1, 28  acc:   160 /   165 =  96.970
1, 29  acc:     7 /     7 = 100.000
1, 30  acc:    28 /    28 = 100.000
1, 31  acc:     4 /     4 = 100.000
1, 32  acc:  1688 /  1777 =  94.992
1, 33  acc:    78 /    81 =  96.296
1, 34  acc:    72 /    79 =  91.139
1, 35  acc:    21 /    23 =  91.304
1, 36  acc:    51 /    53 =  96.226
1, 37  acc:     5 /     5 = 100.000
1, 38  acc:    40 /    40 = 100.000
1, 39  acc:     7 /     8 =  87.500
1, 40  acc:   411 /   428 =  96.028
1, 41  acc:    19 /    19 = 100.000
1, 42  acc:     5 /     8 =  62.500
1, 43  acc:    20 /    20 = 100.000
1, 44  acc:    15 /    16 =  93.750
1, 45  acc:     4 /     5 =  80.000
1, 46  acc:     9 /     9 = 100.000
1, 47  acc:     0 /     0 =     nan
1, 48  acc:   512 /   536 =  95.522
1, 49  acc:    12 /    12 = 100.000
1, 50  acc:    57 /    60 =  95.000
1, 51  acc:    18 /    18 = 100.000
1, 52  acc:    12 /    14 =  85.714
1, 53  acc:     0 /     0 =     nan
1, 54  acc:    31 /    31 = 100.000
1, 55  acc:     0 /     0 =     nan
1, 56  acc:   436 /   458 =  95.197
1, 57  acc:    17 /    18 =  94.444
1, 58  acc:    19 /    19 = 100.000
1, 59  acc:    12 /    13 =  92.308
1, 60  acc:    34 /    37 =  91.892
1, 61  acc:     0 /     0 =     nan
1, 62  acc:    28 /    29 =  96.552
1, 63  acc:     0 /     0 =     nan
1, 64  acc:  5414 /  5647 =  95.874
1, 65  acc:   691 /   733 =  94.270
1, 66  acc:   469 /   490 =  95.714
1, 67  acc:   219 /   233 =  93.991
1, 68  acc:   225 /   232 =  96.983
1, 69  acc:    42 /    42 = 100.000
1, 70  acc:    94 /    96 =  97.917
1, 71  acc:    22 /    25 =  88.000
1, 72  acc:   114 /   118 =  96.610
1, 73  acc:     3 /     3 = 100.000
1, 74  acc:     0 /     1 =   0.000
1, 75  acc:     0 /     0 =     nan
1, 76  acc:    22 /    24 =  91.667
1, 77  acc:     4 /     4 = 100.000
1, 78  acc:     0 /     0 =     nan
1, 79  acc:     7 /     7 = 100.000
1, 80  acc:   164 /   173 =  94.798
1, 81  acc:    12 /    16 =  75.000
1, 82  acc:    43 /    51 =  84.314
1, 83  acc:     3 /     4 =  75.000
1, 84  acc:    17 /    17 = 100.000
1, 85  acc:     0 /     0 =     nan
1, 86  acc:    25 /    25 = 100.000
1, 87  acc:     0 /     0 =     nan
1, 88  acc:    26 /    27 =  96.296
1, 89  acc:     0 /     0 =     nan
1, 90  acc:     0 /     0 =     nan
1, 91  acc:     0 /     0 =     nan
1, 92  acc:     3 /     4 =  75.000
1, 93  acc:     5 /     5 = 100.000
1, 94  acc:   144 /   152 =  94.737
1, 95  acc:    10 /    12 =  83.333
1, 96  acc:    14 /    14 = 100.000
1, 97  acc:     0 /     0 =     nan
1, 98  acc:    15 /    15 = 100.000
1, 99  acc:     0 /     0 =     nan
1, 100  acc:    22 /    23 =  95.652
1, 101  acc:     8 /     8 = 100.000
1, 102  acc:     0 /     0 =     nan
1, 103  acc:     0 /     0 =     nan
1, 104  acc:     1 /     1 = 100.000
1, 105  acc:     0 /     0 =     nan
1, 106  acc:    50 /    50 = 100.000
1, 107  acc:     0 /     0 =     nan
1, 108  acc:    11 /    12 =  91.667
1, 109  acc:     0 /     0 =     nan
1, 110  acc:     6 /     6 = 100.000
1, 111  acc:     4 /     5 =  80.000
1, 112  acc:    14 /    14 = 100.000
1, 113  acc:     0 /     0 =     nan
1, 114  acc:     0 /     0 =     nan
1, 115  acc:     0 /     0 =     nan
1, 116  acc:     0 /     0 =     nan
1, 117  acc:  7873 /  8470 =  92.952
1, 118  acc:  1871 /  2011 =  93.038
1, 119  acc:   424 /   454 =  93.392
1, 120  acc:   537 /   582 =  92.268
1, 121  acc:   131 /   136 =  96.324
1, 122  acc:    96 /    99 =  96.970
1, 123  acc:    14 /    16 =  87.500
1, 124  acc:    48 /    52 =  92.308
1, 125  acc:   486 /   517 =  94.004
1, 126  acc:   114 /   123 =  92.683
1, 127  acc:    13 /    17 =  76.471
1, 128  acc:    31 /    33 =  93.939
1, 129  acc:    20 /    21 =  95.238
1, 130  acc:     8 /     8 = 100.000
1, 131  acc:     0 /     0 =     nan
1, 132  acc:     9 /    11 =  81.818
1, 133  acc:   399 /   430 =  92.791
1, 134  acc:    84 /    89 =  94.382
1, 135  acc:    29 /    30 =  96.667
1, 136  acc:    32 /    36 =  88.889
1, 137  acc:     5 /     6 =  83.333
1, 138  acc:     5 /     6 =  83.333
1, 139  acc:     8 /     8 = 100.000
1, 140  acc:     6 /     6 = 100.000
1, 141  acc:    90 /    97 =  92.784
1, 142  acc:    11 /    15 =  73.333
1, 143  acc:     5 /     5 = 100.000
1, 144  acc:     2 /     2 = 100.000
1, 145  acc:     2 /     2 = 100.000
1, 146  acc:     0 /     0 =     nan
1, 147  acc:     6 /     6 = 100.000
1, 148  acc:   167 /   184 =  90.761
1, 149  acc:    23 /    24 =  95.833
1, 150  acc:    12 /    12 = 100.000
1, 151  acc:     7 /    14 =  50.000
1, 152  acc:     9 /     9 = 100.000
1, 153  acc:     2 /     4 =  50.000
1, 154  acc:    42 /    45 =  93.333
1, 155  acc:     0 /     0 =     nan
1, 156  acc:     0 /     0 =     nan
1, 157  acc:     8 /     8 = 100.000
1, 158  acc:     0 /     0 =     nan
1, 159  acc:    30 /    31 =  96.774
1, 160  acc:     1 /     4 =  25.000
1, 161  acc:     0 /     0 =     nan
1, 162  acc:     0 /     0 =     nan
1, 163  acc:     4 /     5 =  80.000
1, 164  acc:    21 /    22 =  95.455
1, 165  acc:     5 /     5 = 100.000
1, 166  acc:     0 /     0 =     nan
1, 167  acc:     0 /     0 =     nan
1, 168  acc:     0 /     0 =     nan
1, 169  acc:  3339 /  3564 =  93.687
1, 170  acc:   645 /   687 =  93.886
1, 171  acc:   257 /   271 =  94.834
1, 172  acc:   213 /   224 =  95.089
1, 173  acc:    57 /    63 =  90.476
1, 174  acc:    10 /    12 =  83.333
1, 175  acc:     4 /     5 =  80.000
1, 176  acc:    37 /    42 =  88.095
1, 177  acc:    87 /    91 =  95.604
1, 178  acc:    12 /    12 = 100.000
1, 179  acc:     5 /     5 = 100.000
1, 180  acc:     3 /     5 =  60.000
1, 181  acc:     3 /     3 = 100.000
1, 182  acc:     3 /     3 = 100.000
1, 183  acc:    15 /    16 =  93.750
1, 184  acc:   100 /   110 =  90.909
1, 185  acc:    51 /    52 =  98.077
1, 186  acc:    15 /    17 =  88.235
1, 187  acc:    12 /    12 = 100.000
1, 188  acc:     2 /     2 = 100.000
1, 189  acc:     3 /     4 =  75.000
1, 190  acc:    13 /    15 =  86.667
1, 191  acc:     6 /     7 =  85.714
1, 192  acc:     4 /     4 = 100.000
1, 193  acc:     5 /     5 = 100.000
1, 194  acc:     1 /     2 =  50.000
1, 195  acc:     5 /     5 = 100.000
1, 196  acc:   110 /   120 =  91.667
1, 197  acc:     8 /    11 =  72.727
1, 198  acc:     0 /     0 =     nan
1, 199  acc:     0 /     0 =     nan
1, 200  acc:     0 /     0 =     nan
1, 201  acc:     0 /     0 =     nan
1, 202  acc:     0 /     0 =     nan
1, 203  acc:     0 /     0 =     nan
1, 204  acc:    12 /    14 =  85.714
1, 205  acc:     4 /     4 = 100.000
1, 206  acc:     0 /     0 =     nan
1, 207  acc:     0 /     0 =     nan
1, 208  acc:     0 /     0 =     nan
1, 209  acc:    15 /    16 =  93.750
1, 210  acc:     0 /     0 =     nan
1, 211  acc:     2 /     2 = 100.000
1, 212  acc:     1 /     1 = 100.000
1, 213  acc:    14 /    17 =  82.353
1, 214  acc:     0 /     0 =     nan
1, 215  acc:     3 /     3 = 100.000
1, 216  acc:     0 /     0 =     nan
1, 217  acc:    11 /    11 = 100.000
1, 218  acc:    10 /    10 = 100.000
1, 219  acc:     3 /     4 =  75.000
1, 220  acc:     0 /     0 =     nan
1, 221  acc:     0 /     0 =     nan
--------------------------------------
Average acc: 252408 / 269038 =  93.819
Robust  acc:     0 /     2 =   0.000
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc: 23891 / 25373 =  94.159
0, 1  acc: 29573 / 31282 =  94.537
0, 2  acc:  5823 /  6155 =  94.606
0, 3  acc: 22867 / 24292 =  94.134
0, 4  acc: 10203 / 10829 =  94.219
0, 5  acc:  5238 /  5541 =  94.532
0, 6  acc:  6378 /  6785 =  94.001
0, 7  acc: 11339 / 12016 =  94.366
1, 0  acc:  4171 /  4437 =  94.005
1, 1  acc:  4679 /  4962 =  94.297
1, 2  acc:  2151 /  2265 =  94.967
1, 3  acc:  2298 /  2446 =  93.949
1, 4  acc:  2956 /  3125 =  94.592
1, 5  acc:   947 /  1003 =  94.417
1, 6  acc:  2922 /  3111 =  93.925
1, 7  acc:  4418 /  4682 =  94.361
--------------------------------------
Average acc: 139854 / 148304 =  94.302
Robust  acc:  2922 /  3111 =  93.925
--------------------------------------
New max robust acc: 93.92478302796529
debias model - Saving best checkpoint at epoch 1
replace: True
-> Updating checkpoint debias-wga-best_seed42.pt...
Checkpoint saved at ./model/civilcomments/config/debias-wga-best_seed42.pt
male 0
[106466  12092  13021   2203]
1 1 12092
3 3 2203
female 1
[104379  14179  12954   2270]
1 1 14179
3 3 2270
LGBTQ 2
[115348   3210  14008   1216]
1 1 3210
3 3 1216
christian 3
[106457  12101  13964   1260]
1 1 12101
3 3 1260
muslim 4
[113203   5355  13597   1627]
1 1 5355
3 3 1627
other_religions 5
[115578   2980  14704    520]
1 1 2980
3 3 520
black 6
[115223   3335  13687   1537]
1 1 3335
3 3 1537
white 7
[112835   5723  12978   2246]
1 1 5723
3 3 2246
[106466  12092  13021   2203]
[104379  14179  12954   2270]
[115348   3210  14008   1216]
[106457  12101  13964   1260]
[113203   5355  13597   1627]
[115578   2980  14704    520]
[115223   3335  13687   1537]
[112835   5723  12978   2246]
Robust Acc: 46.357 | Best Acc: 89.005
-------------------------------------
Training, Epoch 1:
Accuracies by groups:
0, 0  acc:  9679 / 12092 =  80.045
0, 1  acc: 11670 / 14179 =  82.305
0, 2  acc:  1585 /  3210 =  49.377
0, 3  acc: 10223 / 12101 =  84.481
0, 4  acc:  3259 /  5355 =  60.859
0, 5  acc:  2165 /  2980 =  72.651
0, 6  acc:  1546 /  3335 =  46.357
0, 7  acc:  3223 /  5723 =  56.317
1, 0  acc:  1796 /  2203 =  81.525
1, 1  acc:  1800 /  2270 =  79.295
1, 2  acc:  1043 /  1216 =  85.773
1, 3  acc:  1005 /  1260 =  79.762
1, 4  acc:  1352 /  1627 =  83.098
1, 5  acc:   431 /   520 =  82.885
1, 6  acc:  1368 /  1537 =  89.005
1, 7  acc:  1864 /  2246 =  82.992
------------------------------------
Average acc: 54009 / 71854 =  75.165
Robust  acc:  1546 /  3335 =  46.357
------------------------------------
Accuracies by groups:
0, 0  acc:  9679 / 12092 =  80.045
0, 1  acc: 11670 / 14179 =  82.305
0, 2  acc:  1585 /  3210 =  49.377
0, 3  acc: 10223 / 12101 =  84.481
0, 4  acc:  3259 /  5355 =  60.859
0, 5  acc:  2165 /  2980 =  72.651
0, 6  acc:  1546 /  3335 =  46.357
0, 7  acc:  3223 /  5723 =  56.317
1, 0  acc:  1796 /  2203 =  81.525
1, 1  acc:  1800 /  2270 =  79.295
1, 2  acc:  1043 /  1216 =  85.773
1, 3  acc:  1005 /  1260 =  79.762
1, 4  acc:  1352 /  1627 =  83.098
1, 5  acc:   431 /   520 =  82.885
1, 6  acc:  1368 /  1537 =  89.005
1, 7  acc:  1864 /  2246 =  82.992
------------------------------------
Average acc: 54009 / 71854 =  75.165
Robust  acc:  1546 /  3335 =  46.357
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9679 / 12092 =  80.045
0, 1  acc: 11670 / 14179 =  82.305
0, 2  acc:  1585 /  3210 =  49.377
0, 3  acc: 10223 / 12101 =  84.481
0, 4  acc:  3259 /  5355 =  60.859
0, 5  acc:  2165 /  2980 =  72.651
0, 6  acc:  1546 /  3335 =  46.357
0, 7  acc:  3223 /  5723 =  56.317
1, 0  acc:  1796 /  2203 =  81.525
1, 1  acc:  1800 /  2270 =  79.295
1, 2  acc:  1043 /  1216 =  85.773
1, 3  acc:  1005 /  1260 =  79.762
1, 4  acc:  1352 /  1627 =  83.098
1, 5  acc:   431 /   520 =  82.885
1, 6  acc:  1368 /  1537 =  89.005
1, 7  acc:  1864 /  2246 =  82.992
------------------------------------
Average acc: 54009 / 71854 =  75.165
Robust  acc:  1546 /  3335 =  46.357
------------------------------------

t_total is 1413721125

male 0
[213150  25373  26078   4437]
1 1 25373
3 3 4437
female 1
[207241  31282  25553   4962]
1 1 31282
3 3 4962
LGBTQ 2
[232368   6155  28250   2265]
1 1 6155
3 3 2265
christian 3
[214231  24292  28069   2446]
1 1 24292
3 3 2446
muslim 4
[227694  10829  27390   3125]
1 1 10829
3 3 3125
other_religions 5
[232982   5541  29512   1003]
1 1 5541
3 3 1003
black 6
[231738   6785  27404   3111]
1 1 6785
3 3 3111
white 7
[226507  12016  25833   4682]
1 1 12016
3 3 4682
[213150  25373  26078   4437]
[207241  31282  25553   4962]
[232368   6155  28250   2265]
[214231  24292  28069   2446]
[227694  10829  27390   3125]
[232982   5541  29512   1003]
[231738   6785  27404   3111]
[226507  12016  25833   4682]
Epoch:   3 | Train Loss: 0.008 | Train Acc: 96.742 | Val Loss: 0.000 | Val Acc: 97.184
Training:
Accuracies by groups:
0, 0  acc: 63275 / 65363 =  96.806
0, 1  acc:  6693 /  6886 =  97.197
0, 2  acc: 10614 / 11046 =  96.089
0, 3  acc:  5155 /  5365 =  96.086
0, 4  acc:  2022 /  2257 =  89.588
0, 5  acc:   243 /   296 =  82.095
0, 6  acc:   275 /   294 =  93.537
0, 7  acc:   255 /   284 =  89.789
0, 8  acc:  5889 /  6154 =  95.694
0, 9  acc:   422 /   451 =  93.570
0, 10  acc:   500 /   523 =  95.602
0, 11  acc:   330 /   338 =  97.633
0, 12  acc:   382 /   426 =  89.671
0, 13  acc:    40 /    48 =  83.333
0, 14  acc:    43 /    43 = 100.000
0, 15  acc:    24 /    29 =  82.759
0, 16  acc:  4723 /  5129 =  92.084
0, 17  acc:   187 /   205 =  91.220
0, 18  acc:   472 /   514 =  91.829
0, 19  acc:   153 /   161 =  95.031
0, 20  acc:   109 /   124 =  87.903
0, 21  acc:    19 /    20 =  95.000
0, 22  acc:    69 /    72 =  95.833
0, 23  acc:    17 /    21 =  80.952
0, 24  acc:   625 /   689 =  90.711
0, 25  acc:    39 /    40 =  97.500
0, 26  acc:    65 /    69 =  94.203
0, 27  acc:    21 /    21 = 100.000
0, 28  acc:    38 /    42 =  90.476
0, 29  acc:     2 /     3 =  66.667
0, 30  acc:    16 /    17 =  94.118
0, 31  acc:     7 /     8 =  87.500
0, 32  acc:  1576 /  1649 =  95.573
0, 33  acc:    68 /    72 =  94.444
0, 34  acc:    64 /    68 =  94.118
0, 35  acc:    19 /    20 =  95.000
0, 36  acc:    28 /    32 =  87.500
0, 37  acc:     4 /     4 = 100.000
0, 38  acc:    21 /    23 =  91.304
0, 39  acc:     1 /     1 = 100.000
0, 40  acc:   402 /   421 =  95.487
0, 41  acc:    19 /    19 = 100.000
0, 42  acc:    11 /    14 =  78.571
0, 43  acc:    15 /    16 =  93.750
0, 44  acc:    14 /    15 =  93.333
0, 45  acc:     0 /     0 =     nan
0, 46  acc:     4 /     4 = 100.000
0, 47  acc:     6 /     6 = 100.000
0, 48  acc:   317 /   344 =  92.151
0, 49  acc:     5 /     6 =  83.333
0, 50  acc:    23 /    23 = 100.000
0, 51  acc:    15 /    17 =  88.235
0, 52  acc:     6 /     9 =  66.667
0, 53  acc:     1 /     1 = 100.000
0, 54  acc:     4 /     5 =  80.000
0, 55  acc:     1 /     1 = 100.000
0, 56  acc:   262 /   282 =  92.908
0, 57  acc:    15 /    15 = 100.000
0, 58  acc:    12 /    15 =  80.000
0, 59  acc:     7 /     7 = 100.000
0, 60  acc:    17 /    19 =  89.474
0, 61  acc:     3 /     3 = 100.000
0, 62  acc:    10 /    11 =  90.909
0, 63  acc:     1 /     2 =  50.000
0, 64  acc:  2227 /  2470 =  90.162
0, 65  acc:   338 /   372 =  90.860
0, 66  acc:   223 /   254 =  87.795
0, 67  acc:    77 /    86 =  89.535
0, 68  acc:    51 /    62 =  82.258
0, 69  acc:     1 /     1 = 100.000
0, 70  acc:    10 /    11 =  90.909
0, 71  acc:    10 /    10 = 100.000
0, 72  acc:    58 /    61 =  95.082
0, 73  acc:     4 /     4 = 100.000
0, 74  acc:     8 /     8 = 100.000
0, 75  acc:     9 /    11 =  81.818
0, 76  acc:     3 /     3 = 100.000
0, 77  acc:     0 /     0 =     nan
0, 78  acc:     0 /     0 =     nan
0, 79  acc:     0 /     0 =     nan
0, 80  acc:    96 /   108 =  88.889
0, 81  acc:     9 /    12 =  75.000
0, 82  acc:    11 /    12 =  91.667
0, 83  acc:     9 /    10 =  90.000
0, 84  acc:     2 /     4 =  50.000
0, 85  acc:     0 /     1 =   0.000
0, 86  acc:    13 /    13 = 100.000
0, 87  acc:     1 /     2 =  50.000
0, 88  acc:     9 /    10 =  90.000
0, 89  acc:     4 /     4 = 100.000
0, 90  acc:     0 /     0 =     nan
0, 91  acc:     4 /     4 = 100.000
0, 92  acc:     0 /     0 =     nan
0, 93  acc:     0 /     0 =     nan
0, 94  acc:    71 /    75 =  94.667
0, 95  acc:     4 /     4 = 100.000
0, 96  acc:     4 /     4 = 100.000
0, 97  acc:     0 /     0 =     nan
0, 98  acc:    16 /    16 = 100.000
0, 99  acc:     0 /     0 =     nan
0, 100  acc:     0 /     1 =   0.000
0, 101  acc:    11 /    13 =  84.615
0, 102  acc:     2 /     2 = 100.000
0, 103  acc:     2 /     2 = 100.000
0, 104  acc:     0 /     0 =     nan
0, 105  acc:     0 /     0 =     nan
0, 106  acc:    17 /    20 =  85.000
0, 107  acc:     0 /     0 =     nan
0, 108  acc:     0 /     0 =     nan
0, 109  acc:     0 /     0 =     nan
0, 110  acc:     1 /     1 = 100.000
0, 111  acc:     0 /     1 =   0.000
0, 112  acc:    14 /    14 = 100.000
0, 113  acc:     1 /     1 = 100.000
0, 114  acc:     0 /     0 =     nan
0, 115  acc:     0 /     0 =     nan
0, 116  acc:     0 /     1 =   0.000
0, 117  acc:  6473 /  6877 =  94.125
0, 118  acc:  1594 /  1684 =  94.656
0, 119  acc:   386 /   408 =  94.608
0, 120  acc:   345 /   368 =  93.750
0, 121  acc:    63 /    75 =  84.000
0, 122  acc:    36 /    37 =  97.297
0, 123  acc:     6 /     6 = 100.000
0, 124  acc:    27 /    29 =  93.103
0, 125  acc:   334 /   353 =  94.618
0, 126  acc:   146 /   155 =  94.194
0, 127  acc:    26 /    30 =  86.667
0, 128  acc:    42 /    44 =  95.455
0, 129  acc:     9 /     9 = 100.000
0, 130  acc:     7 /     7 = 100.000
0, 131  acc:     0 /     0 =     nan
0, 132  acc:     0 /     0 =     nan
0, 133  acc:   222 /   237 =  93.671
0, 134  acc:    64 /    68 =  94.118
0, 135  acc:    22 /    25 =  88.000
0, 136  acc:    21 /    21 = 100.000
0, 137  acc:    10 /    12 =  83.333
0, 138  acc:     5 /     5 = 100.000
0, 139  acc:     0 /     0 =     nan
0, 140  acc:     0 /     0 =     nan
0, 141  acc:    74 /    81 =  91.358
0, 142  acc:     9 /    10 =  90.000
0, 143  acc:     8 /     9 =  88.889
0, 144  acc:    16 /    16 = 100.000
0, 145  acc:     0 /     0 =     nan
0, 146  acc:     0 /     0 =     nan
0, 147  acc:     0 /     0 =     nan
0, 148  acc:   133 /   137 =  97.080
0, 149  acc:    13 /    14 =  92.857
0, 150  acc:     2 /     3 =  66.667
0, 151  acc:    14 /    21 =  66.667
0, 152  acc:     0 /     0 =     nan
0, 153  acc:     0 /     0 =     nan
0, 154  acc:    40 /    42 =  95.238
0, 155  acc:     4 /     6 =  66.667
0, 156  acc:     4 /     4 = 100.000
0, 157  acc:     1 /     1 = 100.000
0, 158  acc:     3 /     3 = 100.000
0, 159  acc:    26 /    26 = 100.000
0, 160  acc:     3 /     3 = 100.000
0, 161  acc:     3 /     3 = 100.000
0, 162  acc:     4 /     4 = 100.000
0, 163  acc:     0 /     0 =     nan
0, 164  acc:    13 /    17 =  76.471
0, 165  acc:     3 /     3 = 100.000
0, 166  acc:     8 /     8 = 100.000
0, 167  acc:     0 /     0 =     nan
0, 168  acc:     2 /     2 = 100.000
0, 169  acc:  1601 /  1753 =  91.329
0, 170  acc:   374 /   403 =  92.804
0, 171  acc:   106 /   116 =  91.379
0, 172  acc:   165 /   179 =  92.179
0, 173  acc:    16 /    17 =  94.118
0, 174  acc:     6 /     6 = 100.000
0, 175  acc:     9 /     9 = 100.000
0, 176  acc:    12 /    15 =  80.000
0, 177  acc:    85 /    86 =  98.837
0, 178  acc:    13 /    14 =  92.857
0, 179  acc:     8 /     9 =  88.889
0, 180  acc:     5 /     5 = 100.000
0, 181  acc:     6 /     7 =  85.714
0, 182  acc:     0 /     1 =   0.000
0, 183  acc:     4 /     4 = 100.000
0, 184  acc:    56 /    58 =  96.552
0, 185  acc:    17 /    18 =  94.444
0, 186  acc:     6 /     6 = 100.000
0, 187  acc:     4 /     5 =  80.000
0, 188  acc:     1 /     1 = 100.000
0, 189  acc:     7 /     7 = 100.000
0, 190  acc:     0 /     0 =     nan
0, 191  acc:    33 /    36 =  91.667
0, 192  acc:     2 /     2 = 100.000
0, 193  acc:     0 /     1 =   0.000
0, 194  acc:     2 /     2 = 100.000
0, 195  acc:     0 /     1 =   0.000
0, 196  acc:    48 /    53 =  90.566
0, 197  acc:    15 /    15 = 100.000
0, 198  acc:     3 /     4 =  75.000
0, 199  acc:    11 /    11 = 100.000
0, 200  acc:     5 /     5 = 100.000
0, 201  acc:     0 /     0 =     nan
0, 202  acc:     0 /     0 =     nan
0, 203  acc:     5 /     5 = 100.000
0, 204  acc:    26 /    28 =  92.857
0, 205  acc:     5 /     5 = 100.000
0, 206  acc:     1 /     1 = 100.000
0, 207  acc:     2 /     2 = 100.000
0, 208  acc:     6 /     6 = 100.000
0, 209  acc:     5 /     8 =  62.500
0, 210  acc:     5 /     5 = 100.000
0, 211  acc:     1 /     1 = 100.000
0, 212  acc:     1 /     1 = 100.000
0, 213  acc:     0 /     0 =     nan
0, 214  acc:     1 /     1 = 100.000
0, 215  acc:     0 /     0 =     nan
0, 216  acc:    12 /    12 = 100.000
0, 217  acc:     0 /     0 =     nan
0, 218  acc:     0 /     1 =   0.000
0, 219  acc:     0 /     0 =     nan
0, 220  acc:     0 /     0 =     nan
0, 221  acc:     1 /     2 =  50.000
1, 0  acc: 60192 / 61261 =  98.255
1, 1  acc:  6122 /  6246 =  98.015
1, 2  acc: 10700 / 10977 =  97.477
1, 3  acc:  4531 /  4647 =  97.504
1, 4  acc:  5261 /  5368 =  98.007
1, 5  acc:   905 /   928 =  97.522
1, 6  acc:   526 /   537 =  97.952
1, 7  acc:   650 /   664 =  97.892
1, 8  acc:  5481 /  5627 =  97.405
1, 9  acc:   384 /   397 =  96.725
1, 10  acc:   490 /   501 =  97.804
1, 11  acc:   278 /   282 =  98.582
1, 12  acc:   788 /   812 =  97.044
1, 13  acc:   132 /   137 =  96.350
1, 14  acc:   142 /   144 =  98.611
1, 15  acc:   140 /   144 =  97.222
1, 16  acc:  8256 /  8476 =  97.404
1, 17  acc:   300 /   304 =  98.684
1, 18  acc:   585 /   601 =  97.338
1, 19  acc:   241 /   248 =  97.177
1, 20  acc:   310 /   313 =  99.042
1, 21  acc:    52 /    52 = 100.000
1, 22  acc:   133 /   135 =  98.519
1, 23  acc:    26 /    26 = 100.000
1, 24  acc:  1031 /  1070 =  96.355
1, 25  acc:    19 /    19 = 100.000
1, 26  acc:    93 /    96 =  96.875
1, 27  acc:    19 /    19 = 100.000
1, 28  acc:   140 /   146 =  95.890
1, 29  acc:    11 /    11 = 100.000
1, 30  acc:    30 /    31 =  96.774
1, 31  acc:     7 /     9 =  77.778
1, 32  acc:  1675 /  1717 =  97.554
1, 33  acc:    76 /    77 =  98.701
1, 34  acc:    59 /    60 =  98.333
1, 35  acc:    18 /    19 =  94.737
1, 36  acc:    51 /    51 = 100.000
1, 37  acc:     4 /     4 = 100.000
1, 38  acc:    40 /    40 = 100.000
1, 39  acc:     8 /     8 = 100.000
1, 40  acc:   425 /   434 =  97.926
1, 41  acc:    17 /    18 =  94.444
1, 42  acc:    17 /    18 =  94.444
1, 43  acc:    23 /    23 = 100.000
1, 44  acc:    35 /    36 =  97.222
1, 45  acc:     4 /     4 = 100.000
1, 46  acc:    13 /    13 = 100.000
1, 47  acc:     0 /     0 =     nan
1, 48  acc:   513 /   535 =  95.888
1, 49  acc:    14 /    14 = 100.000
1, 50  acc:    45 /    45 = 100.000
1, 51  acc:    36 /    38 =  94.737
1, 52  acc:     6 /     6 = 100.000
1, 53  acc:     0 /     0 =     nan
1, 54  acc:    37 /    37 = 100.000
1, 55  acc:     0 /     0 =     nan
1, 56  acc:   451 /   467 =  96.574
1, 57  acc:    17 /    17 = 100.000
1, 58  acc:    25 /    25 = 100.000
1, 59  acc:    16 /    16 = 100.000
1, 60  acc:    32 /    32 = 100.000
1, 61  acc:     0 /     0 =     nan
1, 62  acc:    16 /    16 = 100.000
1, 63  acc:     0 /     0 =     nan
1, 64  acc:  5466 /  5587 =  97.834
1, 65  acc:   711 /   738 =  96.341
1, 66  acc:   497 /   507 =  98.028
1, 67  acc:   189 /   194 =  97.423
1, 68  acc:   233 /   245 =  95.102
1, 69  acc:    36 /    36 = 100.000
1, 70  acc:    75 /    75 = 100.000
1, 71  acc:    28 /    28 = 100.000
1, 72  acc:   119 /   120 =  99.167
1, 73  acc:     5 /     5 = 100.000
1, 74  acc:     3 /     6 =  50.000
1, 75  acc:     4 /     4 = 100.000
1, 76  acc:    22 /    24 =  91.667
1, 77  acc:     2 /     3 =  66.667
1, 78  acc:     0 /     0 =     nan
1, 79  acc:     4 /     4 = 100.000
1, 80  acc:   204 /   212 =  96.226
1, 81  acc:    27 /    29 =  93.103
1, 82  acc:    45 /    46 =  97.826
1, 83  acc:     3 /     4 =  75.000
1, 84  acc:    13 /    13 = 100.000
1, 85  acc:     0 /     0 =     nan
1, 86  acc:    28 /    28 = 100.000
1, 87  acc:     0 /     0 =     nan
1, 88  acc:    23 /    23 = 100.000
1, 89  acc:     0 /     0 =     nan
1, 90  acc:     0 /     0 =     nan
1, 91  acc:     0 /     0 =     nan
1, 92  acc:     2 /     2 = 100.000
1, 93  acc:     5 /     5 = 100.000
1, 94  acc:   145 /   149 =  97.315
1, 95  acc:    13 /    13 = 100.000
1, 96  acc:    17 /    18 =  94.444
1, 97  acc:     0 /     0 =     nan
1, 98  acc:    18 /    19 =  94.737
1, 99  acc:     0 /     0 =     nan
1, 100  acc:    15 /    15 = 100.000
1, 101  acc:     2 /     2 = 100.000
1, 102  acc:     0 /     0 =     nan
1, 103  acc:     0 /     0 =     nan
1, 104  acc:     2 /     2 = 100.000
1, 105  acc:     0 /     0 =     nan
1, 106  acc:    43 /    44 =  97.727
1, 107  acc:     0 /     0 =     nan
1, 108  acc:    13 /    13 = 100.000
1, 109  acc:     0 /     0 =     nan
1, 110  acc:     4 /     4 = 100.000
1, 111  acc:     3 /     3 = 100.000
1, 112  acc:    17 /    19 =  89.474
1, 113  acc:     0 /     0 =     nan
1, 114  acc:     0 /     0 =     nan
1, 115  acc:     0 /     0 =     nan
1, 116  acc:     0 /     0 =     nan
1, 117  acc:  8170 /  8425 =  96.973
1, 118  acc:  1983 /  2047 =  96.873
1, 119  acc:   482 /   494 =  97.571
1, 120  acc:   539 /   549 =  98.179
1, 121  acc:   148 /   152 =  97.368
1, 122  acc:    77 /    80 =  96.250
1, 123  acc:    26 /    27 =  96.296
1, 124  acc:    42 /    42 = 100.000
1, 125  acc:   506 /   522 =  96.935
1, 126  acc:   126 /   129 =  97.674
1, 127  acc:    23 /    24 =  95.833
1, 128  acc:    32 /    37 =  86.486
1, 129  acc:    18 /    18 = 100.000
1, 130  acc:     8 /     8 = 100.000
1, 131  acc:     0 /     0 =     nan
1, 132  acc:    12 /    12 = 100.000
1, 133  acc:   446 /   456 =  97.807
1, 134  acc:    84 /    85 =  98.824
1, 135  acc:    33 /    34 =  97.059
1, 136  acc:    33 /    36 =  91.667
1, 137  acc:     7 /     7 = 100.000
1, 138  acc:     4 /     4 = 100.000
1, 139  acc:     5 /     5 = 100.000
1, 140  acc:     1 /     1 = 100.000
1, 141  acc:   104 /   110 =  94.545
1, 142  acc:    20 /    21 =  95.238
1, 143  acc:     3 /     3 = 100.000
1, 144  acc:     5 /     5 = 100.000
1, 145  acc:     0 /     0 =     nan
1, 146  acc:     0 /     0 =     nan
1, 147  acc:     5 /     5 = 100.000
1, 148  acc:   216 /   225 =  96.000
1, 149  acc:    18 /    19 =  94.737
1, 150  acc:    14 /    14 = 100.000
1, 151  acc:    20 /    29 =  68.966
1, 152  acc:     1 /     2 =  50.000
1, 153  acc:     5 /     5 = 100.000
1, 154  acc:    57 /    58 =  98.276
1, 155  acc:     0 /     0 =     nan
1, 156  acc:     0 /     0 =     nan
1, 157  acc:     1 /     2 =  50.000
1, 158  acc:     0 /     0 =     nan
1, 159  acc:    24 /    26 =  92.308
1, 160  acc:     2 /     2 = 100.000
1, 161  acc:     0 /     0 =     nan
1, 162  acc:     0 /     0 =     nan
1, 163  acc:     1 /     1 = 100.000
1, 164  acc:    36 /    36 = 100.000
1, 165  acc:     3 /     4 =  75.000
1, 166  acc:     0 /     0 =     nan
1, 167  acc:     0 /     0 =     nan
1, 168  acc:     0 /     0 =     nan
1, 169  acc:  3452 /  3551 =  97.212
1, 170  acc:   693 /   712 =  97.331
1, 171  acc:   276 /   280 =  98.571
1, 172  acc:   216 /   221 =  97.738
1, 173  acc:    58 /    60 =  96.667
1, 174  acc:    18 /    19 =  94.737
1, 175  acc:     8 /     8 = 100.000
1, 176  acc:    42 /    48 =  87.500
1, 177  acc:    93 /    95 =  97.895
1, 178  acc:    10 /    10 = 100.000
1, 179  acc:     3 /     3 = 100.000
1, 180  acc:     5 /     6 =  83.333
1, 181  acc:     9 /     9 = 100.000
1, 182  acc:     3 /     4 =  75.000
1, 183  acc:    20 /    21 =  95.238
1, 184  acc:   119 /   123 =  96.748
1, 185  acc:    32 /    33 =  96.970
1, 186  acc:    18 /    19 =  94.737
1, 187  acc:    11 /    11 = 100.000
1, 188  acc:     5 /     6 =  83.333
1, 189  acc:     3 /     4 =  75.000
1, 190  acc:     8 /     8 = 100.000
1, 191  acc:     5 /     6 =  83.333
1, 192  acc:    12 /    12 = 100.000
1, 193  acc:     7 /     7 = 100.000
1, 194  acc:     1 /     1 = 100.000
1, 195  acc:     4 /     4 = 100.000
1, 196  acc:   118 /   124 =  95.161
1, 197  acc:    14 /    14 = 100.000
1, 198  acc:     0 /     0 =     nan
1, 199  acc:     0 /     0 =     nan
1, 200  acc:     0 /     0 =     nan
1, 201  acc:     0 /     0 =     nan
1, 202  acc:     1 /     1 = 100.000
1, 203  acc:     0 /     0 =     nan
1, 204  acc:    15 /    15 = 100.000
1, 205  acc:     6 /     6 = 100.000
1, 206  acc:     0 /     0 =     nan
1, 207  acc:     0 /     0 =     nan
1, 208  acc:     0 /     0 =     nan
1, 209  acc:    21 /    23 =  91.304
1, 210  acc:     0 /     0 =     nan
1, 211  acc:     1 /     1 = 100.000
1, 212  acc:     1 /     1 = 100.000
1, 213  acc:     8 /     8 = 100.000
1, 214  acc:     0 /     0 =     nan
1, 215  acc:     4 /     4 = 100.000
1, 216  acc:     0 /     0 =     nan
1, 217  acc:    11 /    11 = 100.000
1, 218  acc:     6 /     6 = 100.000
1, 219  acc:     5 /     5 = 100.000
1, 220  acc:     0 /     0 =     nan
1, 221  acc:     0 /     0 =     nan
--------------------------------------
Average acc: 260273 / 269038 =  96.742
Robust  acc:     0 /     1 =   0.000
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc: 24651 / 25373 =  97.154
0, 1  acc: 30427 / 31282 =  97.267
0, 2  acc:  5988 /  6155 =  97.287
0, 3  acc: 23608 / 24292 =  97.184
0, 4  acc: 10536 / 10829 =  97.294
0, 5  acc:  5379 /  5541 =  97.076
0, 6  acc:  6592 /  6785 =  97.155
0, 7  acc: 11655 / 12016 =  96.996
1, 0  acc:  4318 /  4437 =  97.318
1, 1  acc:  4827 /  4962 =  97.279
1, 2  acc:  2202 /  2265 =  97.219
1, 3  acc:  2378 /  2446 =  97.220
1, 4  acc:  3048 /  3125 =  97.536
1, 5  acc:   971 /  1003 =  96.810
1, 6  acc:  3017 /  3111 =  96.978
1, 7  acc:  4545 /  4682 =  97.074
--------------------------------------
Average acc: 144142 / 148304 =  97.194
Robust  acc:   971 /  1003 =  96.810
--------------------------------------
New max robust acc: 96.80957128614158
debias model - Saving best checkpoint at epoch 2
replace: True
-> Updating checkpoint debias-wga-best_seed42.pt...
Checkpoint saved at ./model/civilcomments/config/debias-wga-best_seed42.pt
male 0
[106466  12092  13021   2203]
1 1 12092
3 3 2203
female 1
[104379  14179  12954   2270]
1 1 14179
3 3 2270
LGBTQ 2
[115348   3210  14008   1216]
1 1 3210
3 3 1216
christian 3
[106457  12101  13964   1260]
1 1 12101
3 3 1260
muslim 4
[113203   5355  13597   1627]
1 1 5355
3 3 1627
other_religions 5
[115578   2980  14704    520]
1 1 2980
3 3 520
black 6
[115223   3335  13687   1537]
1 1 3335
3 3 1537
white 7
[112835   5723  12978   2246]
1 1 5723
3 3 2246
[106466  12092  13021   2203]
[104379  14179  12954   2270]
[115348   3210  14008   1216]
[106457  12101  13964   1260]
[113203   5355  13597   1627]
[115578   2980  14704    520]
[115223   3335  13687   1537]
[112835   5723  12978   2246]
Robust Acc: 63.718 | Best Acc: 89.538
-------------------------------------
Training, Epoch 2:
Accuracies by groups:
0, 0  acc: 10291 / 12092 =  85.106
0, 1  acc: 12255 / 14179 =  86.431
0, 2  acc:  2157 /  3210 =  67.196
0, 3  acc: 10835 / 12101 =  89.538
0, 4  acc:  4042 /  5355 =  75.481
0, 5  acc:  2461 /  2980 =  82.584
0, 6  acc:  2125 /  3335 =  63.718
0, 7  acc:  3844 /  5723 =  67.168
1, 0  acc:  1675 /  2203 =  76.033
1, 1  acc:  1701 /  2270 =  74.934
1, 2  acc:   918 /  1216 =  75.493
1, 3  acc:   900 /  1260 =  71.429
1, 4  acc:  1222 /  1627 =  75.108
1, 5  acc:   382 /   520 =  73.462
1, 6  acc:  1237 /  1537 =  80.481
1, 7  acc:  1747 /  2246 =  77.783
------------------------------------
Average acc: 57792 / 71854 =  80.430
Robust  acc:  2125 /  3335 =  63.718
------------------------------------
Accuracies by groups:
0, 0  acc: 10291 / 12092 =  85.106
0, 1  acc: 12255 / 14179 =  86.431
0, 2  acc:  2157 /  3210 =  67.196
0, 3  acc: 10835 / 12101 =  89.538
0, 4  acc:  4042 /  5355 =  75.481
0, 5  acc:  2461 /  2980 =  82.584
0, 6  acc:  2125 /  3335 =  63.718
0, 7  acc:  3844 /  5723 =  67.168
1, 0  acc:  1675 /  2203 =  76.033
1, 1  acc:  1701 /  2270 =  74.934
1, 2  acc:   918 /  1216 =  75.493
1, 3  acc:   900 /  1260 =  71.429
1, 4  acc:  1222 /  1627 =  75.108
1, 5  acc:   382 /   520 =  73.462
1, 6  acc:  1237 /  1537 =  80.481
1, 7  acc:  1747 /  2246 =  77.783
------------------------------------
Average acc: 57792 / 71854 =  80.430
Robust  acc:  2125 /  3335 =  63.718
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc: 10291 / 12092 =  85.106
0, 1  acc: 12255 / 14179 =  86.431
0, 2  acc:  2157 /  3210 =  67.196
0, 3  acc: 10835 / 12101 =  89.538
0, 4  acc:  4042 /  5355 =  75.481
0, 5  acc:  2461 /  2980 =  82.584
0, 6  acc:  2125 /  3335 =  63.718
0, 7  acc:  3844 /  5723 =  67.168
1, 0  acc:  1675 /  2203 =  76.033
1, 1  acc:  1701 /  2270 =  74.934
1, 2  acc:   918 /  1216 =  75.493
1, 3  acc:   900 /  1260 =  71.429
1, 4  acc:  1222 /  1627 =  75.108
1, 5  acc:   382 /   520 =  73.462
1, 6  acc:  1237 /  1537 =  80.481
1, 7  acc:  1747 /  2246 =  77.783
------------------------------------
Average acc: 57792 / 71854 =  80.430
Robust  acc:  2125 /  3335 =  63.718
------------------------------------

t_total is 1413721125

male 0
[213150  25373  26078   4437]
1 1 25373
3 3 4437
female 1
[207241  31282  25553   4962]
1 1 31282
3 3 4962
LGBTQ 2
[232368   6155  28250   2265]
1 1 6155
3 3 2265
christian 3
[214231  24292  28069   2446]
1 1 24292
3 3 2446
muslim 4
[227694  10829  27390   3125]
1 1 10829
3 3 3125
other_religions 5
[232982   5541  29512   1003]
1 1 5541
3 3 1003
black 6
[231738   6785  27404   3111]
1 1 6785
3 3 3111
white 7
[226507  12016  25833   4682]
1 1 12016
3 3 4682
[213150  25373  26078   4437]
[207241  31282  25553   4962]
[232368   6155  28250   2265]
[214231  24292  28069   2446]
[227694  10829  27390   3125]
[232982   5541  29512   1003]
[231738   6785  27404   3111]
[226507  12016  25833   4682]
Epoch:   4 | Train Loss: 0.005 | Train Acc: 98.033 | Val Loss: 0.000 | Val Acc: 98.966
Training:
Accuracies by groups:
0, 0  acc: 64573 / 65863 =  98.041
0, 1  acc:  6828 /  6986 =  97.738
0, 2  acc: 10534 / 10794 =  97.591
0, 3  acc:  5329 /  5466 =  97.494
0, 4  acc:  2000 /  2159 =  92.635
0, 5  acc:   278 /   308 =  90.260
0, 6  acc:   296 /   309 =  95.793
0, 7  acc:   277 /   297 =  93.266
0, 8  acc:  6124 /  6286 =  97.423
0, 9  acc:   466 /   484 =  96.281
0, 10  acc:   455 /   463 =  98.272
0, 11  acc:   309 /   320 =  96.562
0, 12  acc:   418 /   444 =  94.144
0, 13  acc:    30 /    33 =  90.909
0, 14  acc:    42 /    46 =  91.304
0, 15  acc:    25 /    27 =  92.593
0, 16  acc:  4724 /  4960 =  95.242
0, 17  acc:   183 /   190 =  96.316
0, 18  acc:   497 /   524 =  94.847
0, 19  acc:   149 /   162 =  91.975
0, 20  acc:   115 /   126 =  91.270
0, 21  acc:    18 /    20 =  90.000
0, 22  acc:    50 /    54 =  92.593
0, 23  acc:    11 /    16 =  68.750
0, 24  acc:   603 /   635 =  94.961
0, 25  acc:    25 /    25 = 100.000
0, 26  acc:    36 /    38 =  94.737
0, 27  acc:    28 /    28 = 100.000
0, 28  acc:    42 /    47 =  89.362
0, 29  acc:     1 /     1 = 100.000
0, 30  acc:     9 /    10 =  90.000
0, 31  acc:    12 /    12 = 100.000
0, 32  acc:  1557 /  1597 =  97.495
0, 33  acc:    69 /    73 =  94.521
0, 34  acc:    64 /    66 =  96.970
0, 35  acc:    21 /    21 = 100.000
0, 36  acc:    49 /    50 =  98.000
0, 37  acc:    11 /    11 = 100.000
0, 38  acc:    24 /    27 =  88.889
0, 39  acc:     2 /     2 = 100.000
0, 40  acc:   383 /   395 =  96.962
0, 41  acc:    19 /    19 = 100.000
0, 42  acc:    17 /    17 = 100.000
0, 43  acc:    16 /    16 = 100.000
0, 44  acc:    17 /    19 =  89.474
0, 45  acc:     2 /     3 =  66.667
0, 46  acc:     3 /     3 = 100.000
0, 47  acc:     1 /     1 = 100.000
0, 48  acc:   286 /   293 =  97.611
0, 49  acc:     5 /     5 = 100.000
0, 50  acc:    14 /    15 =  93.333
0, 51  acc:    10 /    11 =  90.909
0, 52  acc:    10 /    10 = 100.000
0, 53  acc:     2 /     2 = 100.000
0, 54  acc:     0 /     1 =   0.000
0, 55  acc:     0 /     0 =     nan
0, 56  acc:   253 /   266 =  95.113
0, 57  acc:     9 /     9 = 100.000
0, 58  acc:    17 /    19 =  89.474
0, 59  acc:    11 /    11 = 100.000
0, 60  acc:    14 /    17 =  82.353
0, 61  acc:     2 /     2 = 100.000
0, 62  acc:     9 /     9 = 100.000
0, 63  acc:     0 /     0 =     nan
0, 64  acc:  2340 /  2481 =  94.317
0, 65  acc:   365 /   379 =  96.306
0, 66  acc:   268 /   281 =  95.374
0, 67  acc:    97 /   103 =  94.175
0, 68  acc:    44 /    48 =  91.667
0, 69  acc:     1 /     1 = 100.000
0, 70  acc:    19 /    23 =  82.609
0, 71  acc:     9 /     9 = 100.000
0, 72  acc:    51 /    53 =  96.226
0, 73  acc:     9 /     9 = 100.000
0, 74  acc:     5 /     6 =  83.333
0, 75  acc:    10 /    10 = 100.000
0, 76  acc:     4 /     4 = 100.000
0, 77  acc:     0 /     0 =     nan
0, 78  acc:     2 /     2 = 100.000
0, 79  acc:     0 /     0 =     nan
0, 80  acc:    85 /    91 =  93.407
0, 81  acc:     4 /     8 =  50.000
0, 82  acc:     8 /     8 = 100.000
0, 83  acc:    10 /    10 = 100.000
0, 84  acc:     4 /     7 =  57.143
0, 85  acc:     0 /     0 =     nan
0, 86  acc:    12 /    12 = 100.000
0, 87  acc:     2 /     3 =  66.667
0, 88  acc:     4 /     4 = 100.000
0, 89  acc:     0 /     0 =     nan
0, 90  acc:     0 /     0 =     nan
0, 91  acc:     1 /     1 = 100.000
0, 92  acc:     0 /     0 =     nan
0, 93  acc:     2 /     2 = 100.000
0, 94  acc:    62 /    65 =  95.385
0, 95  acc:     4 /     4 = 100.000
0, 96  acc:    10 /    10 = 100.000
0, 97  acc:     1 /     1 = 100.000
0, 98  acc:    16 /    17 =  94.118
0, 99  acc:     3 /     3 = 100.000
0, 100  acc:     0 /     1 =   0.000
0, 101  acc:     6 /     7 =  85.714
0, 102  acc:     2 /     2 = 100.000
0, 103  acc:     2 /     2 = 100.000
0, 104  acc:     0 /     0 =     nan
0, 105  acc:     0 /     0 =     nan
0, 106  acc:    22 /    23 =  95.652
0, 107  acc:     0 /     0 =     nan
0, 108  acc:     0 /     0 =     nan
0, 109  acc:     0 /     0 =     nan
0, 110  acc:     1 /     2 =  50.000
0, 111  acc:     1 /     1 = 100.000
0, 112  acc:     8 /     8 = 100.000
0, 113  acc:     0 /     0 =     nan
0, 114  acc:     0 /     0 =     nan
0, 115  acc:     0 /     0 =     nan
0, 116  acc:     0 /     0 =     nan
0, 117  acc:  6881 /  7134 =  96.454
0, 118  acc:  1534 /  1587 =  96.660
0, 119  acc:   399 /   416 =  95.913
0, 120  acc:   340 /   350 =  97.143
0, 121  acc:    58 /    64 =  90.625
0, 122  acc:    46 /    47 =  97.872
0, 123  acc:    15 /    15 = 100.000
0, 124  acc:    18 /    19 =  94.737
0, 125  acc:   402 /   409 =  98.289
0, 126  acc:   115 /   118 =  97.458
0, 127  acc:    19 /    20 =  95.000
0, 128  acc:    44 /    46 =  95.652
0, 129  acc:     5 /     5 = 100.000
0, 130  acc:    10 /    10 = 100.000
0, 131  acc:     1 /     1 = 100.000
0, 132  acc:     0 /     0 =     nan
0, 133  acc:   226 /   234 =  96.581
0, 134  acc:    71 /    77 =  92.208
0, 135  acc:    24 /    24 = 100.000
0, 136  acc:    36 /    36 = 100.000
0, 137  acc:    15 /    15 = 100.000
0, 138  acc:     4 /     4 = 100.000
0, 139  acc:     0 /     0 =     nan
0, 140  acc:     0 /     0 =     nan
0, 141  acc:    57 /    60 =  95.000
0, 142  acc:    17 /    17 = 100.000
0, 143  acc:     6 /     6 = 100.000
0, 144  acc:    18 /    18 = 100.000
0, 145  acc:     0 /     0 =     nan
0, 146  acc:     1 /     1 = 100.000
0, 147  acc:     0 /     0 =     nan
0, 148  acc:   132 /   137 =  96.350
0, 149  acc:    15 /    15 = 100.000
0, 150  acc:     2 /     2 = 100.000
0, 151  acc:    19 /    25 =  76.000
0, 152  acc:     6 /     6 = 100.000
0, 153  acc:     3 /     3 = 100.000
0, 154  acc:    53 /    56 =  94.643
0, 155  acc:     3 /     4 =  75.000
0, 156  acc:     1 /     1 = 100.000
0, 157  acc:     1 /     1 = 100.000
0, 158  acc:     4 /     4 = 100.000
0, 159  acc:    26 /    27 =  96.296
0, 160  acc:     2 /     2 = 100.000
0, 161  acc:     2 /     2 = 100.000
0, 162  acc:     3 /     3 = 100.000
0, 163  acc:     0 /     0 =     nan
0, 164  acc:    18 /    18 = 100.000
0, 165  acc:     1 /     1 = 100.000
0, 166  acc:    11 /    11 = 100.000
0, 167  acc:     1 /     1 = 100.000
0, 168  acc:     2 /     2 = 100.000
0, 169  acc:  1655 /  1743 =  94.951
0, 170  acc:   397 /   416 =  95.433
0, 171  acc:   105 /   107 =  98.131
0, 172  acc:   192 /   200 =  96.000
0, 173  acc:    18 /    21 =  85.714
0, 174  acc:     9 /     9 = 100.000
0, 175  acc:    10 /    11 =  90.909
0, 176  acc:    23 /    32 =  71.875
0, 177  acc:    66 /    68 =  97.059
0, 178  acc:    19 /    21 =  90.476
0, 179  acc:     6 /     6 = 100.000
0, 180  acc:     5 /     5 = 100.000
0, 181  acc:     2 /     2 = 100.000
0, 182  acc:     0 /     0 =     nan
0, 183  acc:     5 /     6 =  83.333
0, 184  acc:    60 /    61 =  98.361
0, 185  acc:     8 /     8 = 100.000
0, 186  acc:    12 /    13 =  92.308
0, 187  acc:     4 /     4 = 100.000
0, 188  acc:     0 /     0 =     nan
0, 189  acc:     6 /     6 = 100.000
0, 190  acc:     0 /     0 =     nan
0, 191  acc:    37 /    37 = 100.000
0, 192  acc:     2 /     2 = 100.000
0, 193  acc:     1 /     1 = 100.000
0, 194  acc:     1 /     1 = 100.000
0, 195  acc:     2 /     2 = 100.000
0, 196  acc:    51 /    53 =  96.226
0, 197  acc:    21 /    21 = 100.000
0, 198  acc:     4 /     4 = 100.000
0, 199  acc:     9 /     9 = 100.000
0, 200  acc:     3 /     3 = 100.000
0, 201  acc:     3 /     3 = 100.000
0, 202  acc:     0 /     0 =     nan
0, 203  acc:     6 /     6 = 100.000
0, 204  acc:    34 /    36 =  94.444
0, 205  acc:     4 /     4 = 100.000
0, 206  acc:     1 /     1 = 100.000
0, 207  acc:     6 /     6 = 100.000
0, 208  acc:     7 /     7 = 100.000
0, 209  acc:     7 /     9 =  77.778
0, 210  acc:     0 /     0 =     nan
0, 211  acc:     2 /     2 = 100.000
0, 212  acc:     2 /     2 = 100.000
0, 213  acc:     0 /     1 =   0.000
0, 214  acc:     3 /     3 = 100.000
0, 215  acc:     0 /     0 =     nan
0, 216  acc:     9 /     9 = 100.000
0, 217  acc:     0 /     0 =     nan
0, 218  acc:     0 /     1 =   0.000
0, 219  acc:     0 /     0 =     nan
0, 220  acc:     2 /     2 = 100.000
0, 221  acc:     3 /     3 = 100.000
1, 0  acc: 60503 / 61127 =  98.979
1, 1  acc:  6308 /  6385 =  98.794
1, 2  acc: 10795 / 10939 =  98.684
1, 3  acc:  4510 /  4572 =  98.644
1, 4  acc:  5334 /  5414 =  98.522
1, 5  acc:   944 /   962 =  98.129
1, 6  acc:   536 /   547 =  97.989
1, 7  acc:   661 /   673 =  98.217
1, 8  acc:  5600 /  5694 =  98.349
1, 9  acc:   386 /   389 =  99.229
1, 10  acc:   464 /   471 =  98.514
1, 11  acc:   264 /   266 =  99.248
1, 12  acc:   844 /   852 =  99.061
1, 13  acc:   103 /   107 =  96.262
1, 14  acc:   127 /   131 =  96.947
1, 15  acc:   141 /   144 =  97.917
1, 16  acc:  8317 /  8452 =  98.403
1, 17  acc:   263 /   267 =  98.502
1, 18  acc:   639 /   643 =  99.378
1, 19  acc:   207 /   214 =  96.729
1, 20  acc:   308 /   311 =  99.035
1, 21  acc:    37 /    38 =  97.368
1, 22  acc:   129 /   130 =  99.231
1, 23  acc:    49 /    53 =  92.453
1, 24  acc:  1091 /  1111 =  98.200
1, 25  acc:    24 /    24 = 100.000
1, 26  acc:   101 /   102 =  99.020
1, 27  acc:    11 /    11 = 100.000
1, 28  acc:   164 /   167 =  98.204
1, 29  acc:    12 /    12 = 100.000
1, 30  acc:    26 /    26 = 100.000
1, 31  acc:    12 /    12 = 100.000
1, 32  acc:  1693 /  1723 =  98.259
1, 33  acc:    84 /    84 = 100.000
1, 34  acc:    77 /    78 =  98.718
1, 35  acc:    19 /    19 = 100.000
1, 36  acc:    43 /    44 =  97.727
1, 37  acc:     5 /     5 = 100.000
1, 38  acc:    38 /    38 = 100.000
1, 39  acc:    10 /    10 = 100.000
1, 40  acc:   447 /   451 =  99.113
1, 41  acc:    22 /    22 = 100.000
1, 42  acc:    16 /    16 = 100.000
1, 43  acc:    32 /    32 = 100.000
1, 44  acc:    26 /    26 = 100.000
1, 45  acc:     4 /     4 = 100.000
1, 46  acc:    13 /    13 = 100.000
1, 47  acc:     0 /     0 =     nan
1, 48  acc:   539 /   545 =  98.899
1, 49  acc:    14 /    14 = 100.000
1, 50  acc:    42 /    43 =  97.674
1, 51  acc:    21 /    21 = 100.000
1, 52  acc:     9 /     9 = 100.000
1, 53  acc:     0 /     0 =     nan
1, 54  acc:    33 /    33 = 100.000
1, 55  acc:     0 /     0 =     nan
1, 56  acc:   439 /   450 =  97.556
1, 57  acc:    21 /    21 = 100.000
1, 58  acc:    20 /    20 = 100.000
1, 59  acc:    11 /    12 =  91.667
1, 60  acc:    26 /    26 = 100.000
1, 61  acc:     0 /     0 =     nan
1, 62  acc:    24 /    24 = 100.000
1, 63  acc:     0 /     0 =     nan
1, 64  acc:  5515 /  5575 =  98.924
1, 65  acc:   744 /   757 =  98.283
1, 66  acc:   511 /   521 =  98.081
1, 67  acc:   207 /   209 =  99.043
1, 68  acc:   222 /   223 =  99.552
1, 69  acc:    48 /    48 = 100.000
1, 70  acc:    93 /    93 = 100.000
1, 71  acc:    22 /    22 = 100.000
1, 72  acc:   107 /   108 =  99.074
1, 73  acc:     5 /     5 = 100.000
1, 74  acc:     1 /     1 = 100.000
1, 75  acc:     3 /     3 = 100.000
1, 76  acc:    26 /    26 = 100.000
1, 77  acc:     3 /     3 = 100.000
1, 78  acc:     0 /     0 =     nan
1, 79  acc:     3 /     3 = 100.000
1, 80  acc:   178 /   180 =  98.889
1, 81  acc:    26 /    28 =  92.857
1, 82  acc:    39 /    39 = 100.000
1, 83  acc:     2 /     2 = 100.000
1, 84  acc:    13 /    13 = 100.000
1, 85  acc:     0 /     0 =     nan
1, 86  acc:    25 /    25 = 100.000
1, 87  acc:     0 /     0 =     nan
1, 88  acc:    20 /    20 = 100.000
1, 89  acc:     0 /     0 =     nan
1, 90  acc:     0 /     0 =     nan
1, 91  acc:     0 /     0 =     nan
1, 92  acc:     5 /     5 = 100.000
1, 93  acc:     6 /     6 = 100.000
1, 94  acc:   150 /   152 =  98.684
1, 95  acc:    20 /    20 = 100.000
1, 96  acc:    16 /    16 = 100.000
1, 97  acc:     0 /     0 =     nan
1, 98  acc:    21 /    21 = 100.000
1, 99  acc:     0 /     0 =     nan
1, 100  acc:    15 /    15 = 100.000
1, 101  acc:     3 /     3 = 100.000
1, 102  acc:     0 /     0 =     nan
1, 103  acc:     0 /     0 =     nan
1, 104  acc:     8 /     8 = 100.000
1, 105  acc:     0 /     0 =     nan
1, 106  acc:    28 /    28 = 100.000
1, 107  acc:     0 /     0 =     nan
1, 108  acc:    13 /    13 = 100.000
1, 109  acc:     0 /     0 =     nan
1, 110  acc:     8 /     8 = 100.000
1, 111  acc:     2 /     2 = 100.000
1, 112  acc:    17 /    17 = 100.000
1, 113  acc:     0 /     0 =     nan
1, 114  acc:     0 /     0 =     nan
1, 115  acc:     0 /     0 =     nan
1, 116  acc:     0 /     0 =     nan
1, 117  acc:  8110 /  8272 =  98.042
1, 118  acc:  2009 /  2036 =  98.674
1, 119  acc:   512 /   520 =  98.462
1, 120  acc:   561 /   569 =  98.594
1, 121  acc:   149 /   150 =  99.333
1, 122  acc:    98 /    98 = 100.000
1, 123  acc:    14 /    15 =  93.333
1, 124  acc:    43 /    45 =  95.556
1, 125  acc:   534 /   538 =  99.257
1, 126  acc:   113 /   114 =  99.123
1, 127  acc:    30 /    31 =  96.774
1, 128  acc:    43 /    44 =  97.727
1, 129  acc:    13 /    14 =  92.857
1, 130  acc:     4 /     5 =  80.000
1, 131  acc:     0 /     0 =     nan
1, 132  acc:    11 /    11 = 100.000
1, 133  acc:   415 /   419 =  99.045
1, 134  acc:    79 /    80 =  98.750
1, 135  acc:    33 /    33 = 100.000
1, 136  acc:    19 /    21 =  90.476
1, 137  acc:     3 /     3 = 100.000
1, 138  acc:     3 /     4 =  75.000
1, 139  acc:     6 /     6 = 100.000
1, 140  acc:     4 /     4 = 100.000
1, 141  acc:    91 /    94 =  96.809
1, 142  acc:    18 /    19 =  94.737
1, 143  acc:     2 /     3 =  66.667
1, 144  acc:     8 /     8 = 100.000
1, 145  acc:     4 /     4 = 100.000
1, 146  acc:     0 /     0 =     nan
1, 147  acc:     6 /     6 = 100.000
1, 148  acc:   195 /   196 =  99.490
1, 149  acc:    22 /    22 = 100.000
1, 150  acc:    13 /    13 = 100.000
1, 151  acc:     8 /    13 =  61.538
1, 152  acc:     5 /     5 = 100.000
1, 153  acc:     3 /     3 = 100.000
1, 154  acc:    36 /    36 = 100.000
1, 155  acc:     0 /     0 =     nan
1, 156  acc:     0 /     0 =     nan
1, 157  acc:    14 /    14 = 100.000
1, 158  acc:     0 /     0 =     nan
1, 159  acc:    27 /    27 = 100.000
1, 160  acc:     5 /     5 = 100.000
1, 161  acc:     0 /     0 =     nan
1, 162  acc:     0 /     0 =     nan
1, 163  acc:     2 /     2 = 100.000
1, 164  acc:    29 /    29 = 100.000
1, 165  acc:     4 /     4 = 100.000
1, 166  acc:     0 /     0 =     nan
1, 167  acc:     0 /     0 =     nan
1, 168  acc:     0 /     0 =     nan
1, 169  acc:  3481 /  3540 =  98.333
1, 170  acc:   625 /   636 =  98.270
1, 171  acc:   286 /   287 =  99.652
1, 172  acc:   215 /   218 =  98.624
1, 173  acc:    55 /    56 =  98.214
1, 174  acc:    11 /    11 = 100.000
1, 175  acc:     7 /     7 = 100.000
1, 176  acc:    41 /    45 =  91.111
1, 177  acc:    74 /    76 =  97.368
1, 178  acc:    12 /    12 = 100.000
1, 179  acc:     3 /     3 = 100.000
1, 180  acc:     9 /     9 = 100.000
1, 181  acc:    13 /    13 = 100.000
1, 182  acc:     2 /     2 = 100.000
1, 183  acc:    14 /    14 = 100.000
1, 184  acc:   131 /   133 =  98.496
1, 185  acc:    40 /    40 = 100.000
1, 186  acc:    26 /    27 =  96.296
1, 187  acc:    14 /    14 = 100.000
1, 188  acc:     2 /     2 = 100.000
1, 189  acc:     2 /     2 = 100.000
1, 190  acc:    12 /    12 = 100.000
1, 191  acc:     8 /     8 = 100.000
1, 192  acc:    14 /    14 = 100.000
1, 193  acc:     7 /     7 = 100.000
1, 194  acc:     2 /     2 = 100.000
1, 195  acc:     3 /     3 = 100.000
1, 196  acc:   115 /   120 =  95.833
1, 197  acc:     7 /     8 =  87.500
1, 198  acc:     0 /     0 =     nan
1, 199  acc:     0 /     0 =     nan
1, 200  acc:     0 /     0 =     nan
1, 201  acc:     0 /     0 =     nan
1, 202  acc:     3 /     3 = 100.000
1, 203  acc:     0 /     0 =     nan
1, 204  acc:    19 /    20 =  95.000
1, 205  acc:     5 /     5 = 100.000
1, 206  acc:     0 /     0 =     nan
1, 207  acc:     0 /     0 =     nan
1, 208  acc:     0 /     0 =     nan
1, 209  acc:    12 /    14 =  85.714
1, 210  acc:     0 /     0 =     nan
1, 211  acc:     1 /     1 = 100.000
1, 212  acc:     5 /     5 = 100.000
1, 213  acc:     3 /     4 =  75.000
1, 214  acc:     0 /     0 =     nan
1, 215  acc:     7 /     7 = 100.000
1, 216  acc:     0 /     0 =     nan
1, 217  acc:     7 /     7 = 100.000
1, 218  acc:     9 /     9 = 100.000
1, 219  acc:    15 /    15 = 100.000
1, 220  acc:     0 /     0 =     nan
1, 221  acc:     0 /     0 =     nan
--------------------------------------
Average acc: 263745 / 269038 =  98.033
Robust  acc:     0 /     1 =   0.000
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc: 25086 / 25373 =  98.869
0, 1  acc: 30972 / 31282 =  99.009
0, 2  acc:  6096 /  6155 =  99.041
0, 3  acc: 24030 / 24292 =  98.921
0, 4  acc: 10707 / 10829 =  98.873
0, 5  acc:  5492 /  5541 =  99.116
0, 6  acc:  6696 /  6785 =  98.688
0, 7  acc: 11873 / 12016 =  98.810
1, 0  acc:  4398 /  4437 =  99.121
1, 1  acc:  4915 /  4962 =  99.053
1, 2  acc:  2250 /  2265 =  99.338
1, 3  acc:  2429 /  2446 =  99.305
1, 4  acc:  3100 /  3125 =  99.200
1, 5  acc:   994 /  1003 =  99.103
1, 6  acc:  3080 /  3111 =  99.004
1, 7  acc:  4640 /  4682 =  99.103
--------------------------------------
Average acc: 146758 / 148304 =  98.958
Robust  acc:  6696 /  6785 =  98.688
--------------------------------------
New max robust acc: 98.6882829771555
debias model - Saving best checkpoint at epoch 3
replace: True
-> Updating checkpoint debias-wga-best_seed42.pt...
Checkpoint saved at ./model/civilcomments/config/debias-wga-best_seed42.pt
male 0
[106466  12092  13021   2203]
1 1 12092
3 3 2203
female 1
[104379  14179  12954   2270]
1 1 14179
3 3 2270
LGBTQ 2
[115348   3210  14008   1216]
1 1 3210
3 3 1216
christian 3
[106457  12101  13964   1260]
1 1 12101
3 3 1260
muslim 4
[113203   5355  13597   1627]
1 1 5355
3 3 1627
other_religions 5
[115578   2980  14704    520]
1 1 2980
3 3 520
black 6
[115223   3335  13687   1537]
1 1 3335
3 3 1537
white 7
[112835   5723  12978   2246]
1 1 5723
3 3 2246
[106466  12092  13021   2203]
[104379  14179  12954   2270]
[115348   3210  14008   1216]
[106457  12101  13964   1260]
[113203   5355  13597   1627]
[115578   2980  14704    520]
[115223   3335  13687   1537]
[112835   5723  12978   2246]
Robust Acc: 60.873 | Best Acc: 93.819
-------------------------------------
Training, Epoch 3:
Accuracies by groups:
0, 0  acc: 11031 / 12092 =  91.226
0, 1  acc: 13013 / 14179 =  91.777
0, 2  acc:  2535 /  3210 =  78.972
0, 3  acc: 11353 / 12101 =  93.819
0, 4  acc:  4573 /  5355 =  85.397
0, 5  acc:  2680 /  2980 =  89.933
0, 6  acc:  2590 /  3335 =  77.661
0, 7  acc:  4693 /  5723 =  82.002
1, 0  acc:  1440 /  2203 =  65.365
1, 1  acc:  1478 /  2270 =  65.110
1, 2  acc:   777 /  1216 =  63.898
1, 3  acc:   767 /  1260 =  60.873
1, 4  acc:  1017 /  1627 =  62.508
1, 5  acc:   322 /   520 =  61.923
1, 6  acc:  1063 /  1537 =  69.161
1, 7  acc:  1456 /  2246 =  64.826
------------------------------------
Average acc: 60788 / 71854 =  84.599
Robust  acc:   767 /  1260 =  60.873
------------------------------------
Accuracies by groups:
0, 0  acc: 11031 / 12092 =  91.226
0, 1  acc: 13013 / 14179 =  91.777
0, 2  acc:  2535 /  3210 =  78.972
0, 3  acc: 11353 / 12101 =  93.819
0, 4  acc:  4573 /  5355 =  85.397
0, 5  acc:  2680 /  2980 =  89.933
0, 6  acc:  2590 /  3335 =  77.661
0, 7  acc:  4693 /  5723 =  82.002
1, 0  acc:  1440 /  2203 =  65.365
1, 1  acc:  1478 /  2270 =  65.110
1, 2  acc:   777 /  1216 =  63.898
1, 3  acc:   767 /  1260 =  60.873
1, 4  acc:  1017 /  1627 =  62.508
1, 5  acc:   322 /   520 =  61.923
1, 6  acc:  1063 /  1537 =  69.161
1, 7  acc:  1456 /  2246 =  64.826
------------------------------------
Average acc: 60788 / 71854 =  84.599
Robust  acc:   767 /  1260 =  60.873
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc: 11031 / 12092 =  91.226
0, 1  acc: 13013 / 14179 =  91.777
0, 2  acc:  2535 /  3210 =  78.972
0, 3  acc: 11353 / 12101 =  93.819
0, 4  acc:  4573 /  5355 =  85.397
0, 5  acc:  2680 /  2980 =  89.933
0, 6  acc:  2590 /  3335 =  77.661
0, 7  acc:  4693 /  5723 =  82.002
1, 0  acc:  1440 /  2203 =  65.365
1, 1  acc:  1478 /  2270 =  65.110
1, 2  acc:   777 /  1216 =  63.898
1, 3  acc:   767 /  1260 =  60.873
1, 4  acc:  1017 /  1627 =  62.508
1, 5  acc:   322 /   520 =  61.923
1, 6  acc:  1063 /  1537 =  69.161
1, 7  acc:  1456 /  2246 =  64.826
------------------------------------
Average acc: 60788 / 71854 =  84.599
Robust  acc:   767 /  1260 =  60.873
------------------------------------

t_total is 1413721125

male 0
[213150  25373  26078   4437]
1 1 25373
3 3 4437
female 1
[207241  31282  25553   4962]
1 1 31282
3 3 4962
LGBTQ 2
[232368   6155  28250   2265]
1 1 6155
3 3 2265
christian 3
[214231  24292  28069   2446]
1 1 24292
3 3 2446
muslim 4
[227694  10829  27390   3125]
1 1 10829
3 3 3125
other_religions 5
[232982   5541  29512   1003]
1 1 5541
3 3 1003
black 6
[231738   6785  27404   3111]
1 1 6785
3 3 3111
white 7
[226507  12016  25833   4682]
1 1 12016
3 3 4682
[213150  25373  26078   4437]
[207241  31282  25553   4962]
[232368   6155  28250   2265]
[214231  24292  28069   2446]
[227694  10829  27390   3125]
[232982   5541  29512   1003]
[231738   6785  27404   3111]
[226507  12016  25833   4682]
Epoch:   5 | Train Loss: 0.004 | Train Acc: 98.568 | Val Loss: 0.000 | Val Acc: 98.919
Training:
Accuracies by groups:
0, 0  acc: 65137 / 66079 =  98.574
0, 1  acc:  6803 /  6894 =  98.680
0, 2  acc: 10899 / 11076 =  98.402
0, 3  acc:  5252 /  5361 =  97.967
0, 4  acc:  2108 /  2208 =  95.471
0, 5  acc:   266 /   276 =  96.377
0, 6  acc:   321 /   336 =  95.536
0, 7  acc:   300 /   310 =  96.774
0, 8  acc:  6074 /  6202 =  97.936
0, 9  acc:   463 /   471 =  98.301
0, 10  acc:   460 /   468 =  98.291
0, 11  acc:   303 /   308 =  98.377
0, 12  acc:   439 /   457 =  96.061
0, 13  acc:    32 /    35 =  91.429
0, 14  acc:    50 /    56 =  89.286
0, 15  acc:    26 /    29 =  89.655
0, 16  acc:  4780 /  4930 =  96.957
0, 17  acc:   194 /   198 =  97.980
0, 18  acc:   515 /   530 =  97.170
0, 19  acc:   171 /   174 =  98.276
0, 20  acc:   115 /   127 =  90.551
0, 21  acc:    19 /    19 = 100.000
0, 22  acc:    47 /    52 =  90.385
0, 23  acc:    12 /    14 =  85.714
0, 24  acc:   632 /   664 =  95.181
0, 25  acc:    40 /    41 =  97.561
0, 26  acc:    70 /    71 =  98.592
0, 27  acc:    28 /    28 = 100.000
0, 28  acc:    29 /    30 =  96.667
0, 29  acc:     1 /     1 = 100.000
0, 30  acc:     8 /     8 = 100.000
0, 31  acc:    12 /    12 = 100.000
0, 32  acc:  1586 /  1619 =  97.962
0, 33  acc:    82 /    87 =  94.253
0, 34  acc:    81 /    82 =  98.780
0, 35  acc:    12 /    13 =  92.308
0, 36  acc:    46 /    46 = 100.000
0, 37  acc:     4 /     4 = 100.000
0, 38  acc:    21 /    22 =  95.455
0, 39  acc:     0 /     0 =     nan
0, 40  acc:   383 /   393 =  97.455
0, 41  acc:    21 /    23 =  91.304
0, 42  acc:    11 /    12 =  91.667
0, 43  acc:    12 /    12 = 100.000
0, 44  acc:    19 /    19 = 100.000
0, 45  acc:     1 /     1 = 100.000
0, 46  acc:    19 /    19 = 100.000
0, 47  acc:     5 /     5 = 100.000
0, 48  acc:   298 /   307 =  97.068
0, 49  acc:     1 /     1 = 100.000
0, 50  acc:    20 /    21 =  95.238
0, 51  acc:    11 /    11 = 100.000
0, 52  acc:     6 /     6 = 100.000
0, 53  acc:     0 /     0 =     nan
0, 54  acc:     2 /     2 = 100.000
0, 55  acc:     0 /     0 =     nan
0, 56  acc:   255 /   262 =  97.328
0, 57  acc:     2 /     2 = 100.000
0, 58  acc:    15 /    15 = 100.000
0, 59  acc:    14 /    14 = 100.000
0, 60  acc:    11 /    14 =  78.571
0, 61  acc:     0 /     0 =     nan
0, 62  acc:    10 /    10 = 100.000
0, 63  acc:     0 /     1 =   0.000
0, 64  acc:  2313 /  2391 =  96.738
0, 65  acc:   359 /   372 =  96.505
0, 66  acc:   234 /   243 =  96.296
0, 67  acc:   100 /   105 =  95.238
0, 68  acc:    43 /    48 =  89.583
0, 69  acc:     4 /     4 = 100.000
0, 70  acc:    21 /    21 = 100.000
0, 71  acc:     9 /     9 = 100.000
0, 72  acc:    65 /    68 =  95.588
0, 73  acc:     9 /     9 = 100.000
0, 74  acc:     7 /     7 = 100.000
0, 75  acc:     7 /     7 = 100.000
0, 76  acc:     7 /     9 =  77.778
0, 77  acc:     0 /     0 =     nan
0, 78  acc:     1 /     1 = 100.000
0, 79  acc:     0 /     0 =     nan
0, 80  acc:    82 /    84 =  97.619
0, 81  acc:    10 /    14 =  71.429
0, 82  acc:     6 /     6 = 100.000
0, 83  acc:     7 /     7 = 100.000
0, 84  acc:     4 /     5 =  80.000
0, 85  acc:     1 /     1 = 100.000
0, 86  acc:     9 /     9 = 100.000
0, 87  acc:     0 /     0 =     nan
0, 88  acc:    11 /    11 = 100.000
0, 89  acc:     1 /     1 = 100.000
0, 90  acc:     1 /     1 = 100.000
0, 91  acc:     2 /     2 = 100.000
0, 92  acc:     0 /     0 =     nan
0, 93  acc:     3 /     3 = 100.000
0, 94  acc:    68 /    69 =  98.551
0, 95  acc:    10 /    10 = 100.000
0, 96  acc:     7 /     7 = 100.000
0, 97  acc:     1 /     1 = 100.000
0, 98  acc:     8 /     9 =  88.889
0, 99  acc:     0 /     0 =     nan
0, 100  acc:     5 /     5 = 100.000
0, 101  acc:     6 /     6 = 100.000
0, 102  acc:     0 /     0 =     nan
0, 103  acc:     3 /     3 = 100.000
0, 104  acc:     0 /     0 =     nan
0, 105  acc:     0 /     0 =     nan
0, 106  acc:    16 /    17 =  94.118
0, 107  acc:     2 /     2 = 100.000
0, 108  acc:     0 /     0 =     nan
0, 109  acc:     1 /     1 = 100.000
0, 110  acc:     2 /     3 =  66.667
0, 111  acc:     0 /     0 =     nan
0, 112  acc:    13 /    13 = 100.000
0, 113  acc:     0 /     0 =     nan
0, 114  acc:     0 /     0 =     nan
0, 115  acc:     0 /     0 =     nan
0, 116  acc:     0 /     0 =     nan
0, 117  acc:  6754 /  6927 =  97.503
0, 118  acc:  1623 /  1654 =  98.126
0, 119  acc:   418 /   431 =  96.984
0, 120  acc:   356 /   363 =  98.072
0, 121  acc:    71 /    79 =  89.873
0, 122  acc:    29 /    29 = 100.000
0, 123  acc:     9 /     9 = 100.000
0, 124  acc:    29 /    30 =  96.667
0, 125  acc:   395 /   401 =  98.504
0, 126  acc:   131 /   132 =  99.242
0, 127  acc:    24 /    25 =  96.000
0, 128  acc:    50 /    50 = 100.000
0, 129  acc:     2 /     2 = 100.000
0, 130  acc:     7 /     7 = 100.000
0, 131  acc:     5 /     5 = 100.000
0, 132  acc:     0 /     0 =     nan
0, 133  acc:   222 /   228 =  97.368
0, 134  acc:    69 /    72 =  95.833
0, 135  acc:    25 /    25 = 100.000
0, 136  acc:    28 /    30 =  93.333
0, 137  acc:     8 /     8 = 100.000
0, 138  acc:     3 /     3 = 100.000
0, 139  acc:     0 /     0 =     nan
0, 140  acc:     0 /     0 =     nan
0, 141  acc:    61 /    61 = 100.000
0, 142  acc:    12 /    13 =  92.308
0, 143  acc:    10 /    10 = 100.000
0, 144  acc:     5 /     6 =  83.333
0, 145  acc:     0 /     0 =     nan
0, 146  acc:     1 /     1 = 100.000
0, 147  acc:     0 /     0 =     nan
0, 148  acc:   122 /   124 =  98.387
0, 149  acc:    14 /    15 =  93.333
0, 150  acc:     2 /     3 =  66.667
0, 151  acc:    20 /    26 =  76.923
0, 152  acc:     3 /     3 = 100.000
0, 153  acc:     2 /     2 = 100.000
0, 154  acc:    53 /    54 =  98.148
0, 155  acc:     7 /     8 =  87.500
0, 156  acc:     1 /     1 = 100.000
0, 157  acc:     1 /     1 = 100.000
0, 158  acc:     1 /     1 = 100.000
0, 159  acc:    19 /    20 =  95.000
0, 160  acc:     2 /     2 = 100.000
0, 161  acc:     2 /     2 = 100.000
0, 162  acc:     4 /     4 = 100.000
0, 163  acc:     0 /     0 =     nan
0, 164  acc:    17 /    17 = 100.000
0, 165  acc:     1 /     1 = 100.000
0, 166  acc:     5 /     5 = 100.000
0, 167  acc:     1 /     1 = 100.000
0, 168  acc:     0 /     0 =     nan
0, 169  acc:  1713 /  1792 =  95.592
0, 170  acc:   397 /   407 =  97.543
0, 171  acc:   121 /   127 =  95.276
0, 172  acc:   176 /   181 =  97.238
0, 173  acc:    19 /    20 =  95.000
0, 174  acc:     6 /     7 =  85.714
0, 175  acc:     5 /     5 = 100.000
0, 176  acc:    13 /    14 =  92.857
0, 177  acc:    65 /    67 =  97.015
0, 178  acc:    13 /    13 = 100.000
0, 179  acc:    12 /    13 =  92.308
0, 180  acc:     6 /     6 = 100.000
0, 181  acc:     1 /     1 = 100.000
0, 182  acc:     1 /     1 = 100.000
0, 183  acc:     5 /     5 = 100.000
0, 184  acc:    56 /    56 = 100.000
0, 185  acc:     5 /     5 = 100.000
0, 186  acc:     4 /     4 = 100.000
0, 187  acc:     6 /     8 =  75.000
0, 188  acc:     1 /     2 =  50.000
0, 189  acc:     9 /     9 = 100.000
0, 190  acc:     0 /     0 =     nan
0, 191  acc:    32 /    33 =  96.970
0, 192  acc:     0 /     0 =     nan
0, 193  acc:     1 /     1 = 100.000
0, 194  acc:     1 /     1 = 100.000
0, 195  acc:     2 /     3 =  66.667
0, 196  acc:    50 /    51 =  98.039
0, 197  acc:    25 /    25 = 100.000
0, 198  acc:     2 /     2 = 100.000
0, 199  acc:    13 /    14 =  92.857
0, 200  acc:     5 /     5 = 100.000
0, 201  acc:     0 /     0 =     nan
0, 202  acc:     0 /     0 =     nan
0, 203  acc:     5 /     5 = 100.000
0, 204  acc:    23 /    27 =  85.185
0, 205  acc:     4 /     4 = 100.000
0, 206  acc:     0 /     0 =     nan
0, 207  acc:     5 /     5 = 100.000
0, 208  acc:     2 /     2 = 100.000
0, 209  acc:     3 /     5 =  60.000
0, 210  acc:     1 /     1 = 100.000
0, 211  acc:     0 /     0 =     nan
0, 212  acc:     1 /     1 = 100.000
0, 213  acc:     4 /     4 = 100.000
0, 214  acc:     1 /     1 = 100.000
0, 215  acc:     0 /     0 =     nan
0, 216  acc:    13 /    13 = 100.000
0, 217  acc:     0 /     0 =     nan
0, 218  acc:     2 /     2 = 100.000
0, 219  acc:     0 /     0 =     nan
0, 220  acc:     0 /     0 =     nan
0, 221  acc:     3 /     3 = 100.000
1, 0  acc: 60767 / 61273 =  99.174
1, 1  acc:  6387 /  6434 =  99.270
1, 2  acc: 10797 / 10900 =  99.055
1, 3  acc:  4470 /  4518 =  98.938
1, 4  acc:  5242 /  5302 =  98.868
1, 5  acc:   906 /   912 =  99.342
1, 6  acc:   560 /   563 =  99.467
1, 7  acc:   659 /   668 =  98.653
1, 8  acc:  5418 /  5487 =  98.742
1, 9  acc:   417 /   420 =  99.286
1, 10  acc:   453 /   461 =  98.265
1, 11  acc:   279 /   283 =  98.587
1, 12  acc:   893 /   897 =  99.554
1, 13  acc:   105 /   105 = 100.000
1, 14  acc:   124 /   127 =  97.638
1, 15  acc:   139 /   141 =  98.582
1, 16  acc:  8364 /  8435 =  99.158
1, 17  acc:   304 /   306 =  99.346
1, 18  acc:   670 /   677 =  98.966
1, 19  acc:   226 /   227 =  99.559
1, 20  acc:   310 /   314 =  98.726
1, 21  acc:    26 /    26 = 100.000
1, 22  acc:   152 /   153 =  99.346
1, 23  acc:    35 /    37 =  94.595
1, 24  acc:  1130 /  1145 =  98.690
1, 25  acc:    15 /    15 = 100.000
1, 26  acc:   102 /   102 = 100.000
1, 27  acc:    11 /    11 = 100.000
1, 28  acc:   165 /   165 = 100.000
1, 29  acc:    11 /    11 = 100.000
1, 30  acc:    31 /    31 = 100.000
1, 31  acc:     7 /     7 = 100.000
1, 32  acc:  1748 /  1767 =  98.925
1, 33  acc:    97 /    97 = 100.000
1, 34  acc:    77 /    79 =  97.468
1, 35  acc:    23 /    24 =  95.833
1, 36  acc:    61 /    62 =  98.387
1, 37  acc:     3 /     3 = 100.000
1, 38  acc:    32 /    32 = 100.000
1, 39  acc:     3 /     3 = 100.000
1, 40  acc:   436 /   440 =  99.091
1, 41  acc:    20 /    20 = 100.000
1, 42  acc:    14 /    15 =  93.333
1, 43  acc:    21 /    21 = 100.000
1, 44  acc:    17 /    17 = 100.000
1, 45  acc:     6 /     6 = 100.000
1, 46  acc:     8 /     8 = 100.000
1, 47  acc:     0 /     0 =     nan
1, 48  acc:   556 /   562 =  98.932
1, 49  acc:    11 /    11 = 100.000
1, 50  acc:    33 /    34 =  97.059
1, 51  acc:    19 /    20 =  95.000
1, 52  acc:    22 /    22 = 100.000
1, 53  acc:     0 /     0 =     nan
1, 54  acc:    25 /    25 = 100.000
1, 55  acc:     0 /     0 =     nan
1, 56  acc:   448 /   460 =  97.391
1, 57  acc:    16 /    16 = 100.000
1, 58  acc:    14 /    14 = 100.000
1, 59  acc:    14 /    14 = 100.000
1, 60  acc:    24 /    25 =  96.000
1, 61  acc:     0 /     0 =     nan
1, 62  acc:    27 /    27 = 100.000
1, 63  acc:     0 /     0 =     nan
1, 64  acc:  5414 /  5474 =  98.904
1, 65  acc:   733 /   740 =  99.054
1, 66  acc:   476 /   484 =  98.347
1, 67  acc:   188 /   189 =  99.471
1, 68  acc:   244 /   247 =  98.785
1, 69  acc:    42 /    42 = 100.000
1, 70  acc:    76 /    77 =  98.701
1, 71  acc:    24 /    24 = 100.000
1, 72  acc:    87 /    88 =  98.864
1, 73  acc:     6 /     6 = 100.000
1, 74  acc:     0 /     0 =     nan
1, 75  acc:     1 /     1 = 100.000
1, 76  acc:    22 /    22 = 100.000
1, 77  acc:     7 /     7 = 100.000
1, 78  acc:     0 /     0 =     nan
1, 79  acc:     9 /     9 = 100.000
1, 80  acc:   204 /   208 =  98.077
1, 81  acc:    22 /    27 =  81.481
1, 82  acc:    46 /    47 =  97.872
1, 83  acc:     3 /     4 =  75.000
1, 84  acc:    14 /    14 = 100.000
1, 85  acc:     0 /     0 =     nan
1, 86  acc:    24 /    25 =  96.000
1, 87  acc:     0 /     0 =     nan
1, 88  acc:    26 /    26 = 100.000
1, 89  acc:     0 /     0 =     nan
1, 90  acc:     0 /     0 =     nan
1, 91  acc:     0 /     0 =     nan
1, 92  acc:     4 /     4 = 100.000
1, 93  acc:     5 /     5 = 100.000
1, 94  acc:   156 /   157 =  99.363
1, 95  acc:    19 /    19 = 100.000
1, 96  acc:     9 /     9 = 100.000
1, 97  acc:     0 /     0 =     nan
1, 98  acc:    14 /    14 = 100.000
1, 99  acc:     0 /     0 =     nan
1, 100  acc:    20 /    20 = 100.000
1, 101  acc:     5 /     5 = 100.000
1, 102  acc:     0 /     0 =     nan
1, 103  acc:     0 /     0 =     nan
1, 104  acc:     2 /     2 = 100.000
1, 105  acc:     0 /     0 =     nan
1, 106  acc:    34 /    34 = 100.000
1, 107  acc:     0 /     0 =     nan
1, 108  acc:    11 /    12 =  91.667
1, 109  acc:     0 /     0 =     nan
1, 110  acc:     8 /     8 = 100.000
1, 111  acc:     2 /     2 = 100.000
1, 112  acc:    20 /    21 =  95.238
1, 113  acc:     0 /     0 =     nan
1, 114  acc:     0 /     0 =     nan
1, 115  acc:     0 /     0 =     nan
1, 116  acc:     0 /     0 =     nan
1, 117  acc:  8209 /  8336 =  98.476
1, 118  acc:  2055 /  2089 =  98.372
1, 119  acc:   502 /   512 =  98.047
1, 120  acc:   537 /   544 =  98.713
1, 121  acc:   131 /   134 =  97.761
1, 122  acc:    66 /    66 = 100.000
1, 123  acc:    26 /    26 = 100.000
1, 124  acc:    39 /    39 = 100.000
1, 125  acc:   551 /   560 =  98.393
1, 126  acc:   107 /   109 =  98.165
1, 127  acc:    21 /    23 =  91.304
1, 128  acc:    29 /    29 = 100.000
1, 129  acc:    23 /    23 = 100.000
1, 130  acc:     4 /     5 =  80.000
1, 131  acc:     0 /     0 =     nan
1, 132  acc:    10 /    10 = 100.000
1, 133  acc:   414 /   422 =  98.104
1, 134  acc:    78 /    79 =  98.734
1, 135  acc:    30 /    30 = 100.000
1, 136  acc:    28 /    30 =  93.333
1, 137  acc:     4 /     4 = 100.000
1, 138  acc:     3 /     3 = 100.000
1, 139  acc:     3 /     3 = 100.000
1, 140  acc:     1 /     1 = 100.000
1, 141  acc:    99 /   101 =  98.020
1, 142  acc:    20 /    20 = 100.000
1, 143  acc:     9 /     9 = 100.000
1, 144  acc:     4 /     4 = 100.000
1, 145  acc:     1 /     1 = 100.000
1, 146  acc:     0 /     0 =     nan
1, 147  acc:     3 /     3 = 100.000
1, 148  acc:   195 /   197 =  98.985
1, 149  acc:    19 /    19 = 100.000
1, 150  acc:    11 /    11 = 100.000
1, 151  acc:     7 /    13 =  53.846
1, 152  acc:     3 /     3 = 100.000
1, 153  acc:     6 /     6 = 100.000
1, 154  acc:    42 /    44 =  95.455
1, 155  acc:     0 /     0 =     nan
1, 156  acc:     0 /     0 =     nan
1, 157  acc:     6 /     6 = 100.000
1, 158  acc:     0 /     0 =     nan
1, 159  acc:    27 /    27 = 100.000
1, 160  acc:     4 /     4 = 100.000
1, 161  acc:     0 /     0 =     nan
1, 162  acc:     0 /     0 =     nan
1, 163  acc:     4 /     4 = 100.000
1, 164  acc:    32 /    32 = 100.000
1, 165  acc:     5 /     5 = 100.000
1, 166  acc:     0 /     0 =     nan
1, 167  acc:     0 /     0 =     nan
1, 168  acc:     0 /     0 =     nan
1, 169  acc:  3567 /  3605 =  98.946
1, 170  acc:   674 /   683 =  98.682
1, 171  acc:   271 /   275 =  98.545
1, 172  acc:   187 /   192 =  97.396
1, 173  acc:    61 /    61 = 100.000
1, 174  acc:    11 /    12 =  91.667
1, 175  acc:     6 /     6 = 100.000
1, 176  acc:    48 /    51 =  94.118
1, 177  acc:    73 /    73 = 100.000
1, 178  acc:     9 /     9 = 100.000
1, 179  acc:     6 /     6 = 100.000
1, 180  acc:     8 /     8 = 100.000
1, 181  acc:     8 /     8 = 100.000
1, 182  acc:     3 /     3 = 100.000
1, 183  acc:    20 /    20 = 100.000
1, 184  acc:   117 /   120 =  97.500
1, 185  acc:    50 /    50 = 100.000
1, 186  acc:    18 /    18 = 100.000
1, 187  acc:    14 /    14 = 100.000
1, 188  acc:     4 /     4 = 100.000
1, 189  acc:     3 /     3 = 100.000
1, 190  acc:    20 /    20 = 100.000
1, 191  acc:    11 /    11 = 100.000
1, 192  acc:     7 /     7 = 100.000
1, 193  acc:     4 /     4 = 100.000
1, 194  acc:     0 /     0 =     nan
1, 195  acc:     2 /     2 = 100.000
1, 196  acc:   109 /   110 =  99.091
1, 197  acc:    19 /    19 = 100.000
1, 198  acc:     0 /     0 =     nan
1, 199  acc:     0 /     0 =     nan
1, 200  acc:     0 /     0 =     nan
1, 201  acc:     0 /     0 =     nan
1, 202  acc:     7 /     7 = 100.000
1, 203  acc:     0 /     0 =     nan
1, 204  acc:    17 /    17 = 100.000
1, 205  acc:     6 /     6 = 100.000
1, 206  acc:     0 /     0 =     nan
1, 207  acc:     0 /     0 =     nan
1, 208  acc:     0 /     0 =     nan
1, 209  acc:    17 /    19 =  89.474
1, 210  acc:     0 /     0 =     nan
1, 211  acc:     0 /     0 =     nan
1, 212  acc:     0 /     0 =     nan
1, 213  acc:    11 /    11 = 100.000
1, 214  acc:     0 /     0 =     nan
1, 215  acc:     2 /     2 = 100.000
1, 216  acc:     0 /     0 =     nan
1, 217  acc:     6 /     6 = 100.000
1, 218  acc:    21 /    21 = 100.000
1, 219  acc:     5 /     5 = 100.000
1, 220  acc:     0 /     0 =     nan
1, 221  acc:     0 /     0 =     nan
--------------------------------------
Average acc: 265185 / 269038 =  98.568
Robust  acc:     0 /     1 =   0.000
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc: 25100 / 25373 =  98.924
0, 1  acc: 30933 / 31282 =  98.884
0, 2  acc:  6087 /  6155 =  98.895
0, 3  acc: 23997 / 24292 =  98.786
0, 4  acc: 10715 / 10829 =  98.947
0, 5  acc:  5465 /  5541 =  98.628
0, 6  acc:  6709 /  6785 =  98.880
0, 7  acc: 11881 / 12016 =  98.876
1, 0  acc:  4397 /  4437 =  99.098
1, 1  acc:  4917 /  4962 =  99.093
1, 2  acc:  2243 /  2265 =  99.029
1, 3  acc:  2424 /  2446 =  99.101
1, 4  acc:  3097 /  3125 =  99.104
1, 5  acc:   990 /  1003 =  98.704
1, 6  acc:  3074 /  3111 =  98.811
1, 7  acc:  4635 /  4682 =  98.996
--------------------------------------
Average acc: 146664 / 148304 =  98.894
Robust  acc:  5465 /  5541 =  98.628
--------------------------------------
male 0
[106466  12092  13021   2203]
1 1 12092
3 3 2203
female 1
[104379  14179  12954   2270]
1 1 14179
3 3 2270
LGBTQ 2
[115348   3210  14008   1216]
1 1 3210
3 3 1216
christian 3
[106457  12101  13964   1260]
1 1 12101
3 3 1260
muslim 4
[113203   5355  13597   1627]
1 1 5355
3 3 1627
other_religions 5
[115578   2980  14704    520]
1 1 2980
3 3 520
black 6
[115223   3335  13687   1537]
1 1 3335
3 3 1537
white 7
[112835   5723  12978   2246]
1 1 5723
3 3 2246
[106466  12092  13021   2203]
[104379  14179  12954   2270]
[115348   3210  14008   1216]
[106457  12101  13964   1260]
[113203   5355  13597   1627]
[115578   2980  14704    520]
[115223   3335  13687   1537]
[112835   5723  12978   2246]
Robust Acc: 65.952 | Best Acc: 91.910
-------------------------------------
Training, Epoch 4:
Accuracies by groups:
0, 0  acc: 10699 / 12092 =  88.480
0, 1  acc: 12771 / 14179 =  90.070
0, 2  acc:  2438 /  3210 =  75.950
0, 3  acc: 11122 / 12101 =  91.910
0, 4  acc:  4445 /  5355 =  83.007
0, 5  acc:  2616 /  2980 =  87.785
0, 6  acc:  2493 /  3335 =  74.753
0, 7  acc:  4436 /  5723 =  77.512
1, 0  acc:  1554 /  2203 =  70.540
1, 1  acc:  1575 /  2270 =  69.383
1, 2  acc:   824 /  1216 =  67.763
1, 3  acc:   831 /  1260 =  65.952
1, 4  acc:  1087 /  1627 =  66.810
1, 5  acc:   352 /   520 =  67.692
1, 6  acc:  1119 /  1537 =  72.804
1, 7  acc:  1562 /  2246 =  69.546
------------------------------------
Average acc: 59924 / 71854 =  83.397
Robust  acc:   831 /  1260 =  65.952
------------------------------------
Accuracies by groups:
0, 0  acc: 10699 / 12092 =  88.480
0, 1  acc: 12771 / 14179 =  90.070
0, 2  acc:  2438 /  3210 =  75.950
0, 3  acc: 11122 / 12101 =  91.910
0, 4  acc:  4445 /  5355 =  83.007
0, 5  acc:  2616 /  2980 =  87.785
0, 6  acc:  2493 /  3335 =  74.753
0, 7  acc:  4436 /  5723 =  77.512
1, 0  acc:  1554 /  2203 =  70.540
1, 1  acc:  1575 /  2270 =  69.383
1, 2  acc:   824 /  1216 =  67.763
1, 3  acc:   831 /  1260 =  65.952
1, 4  acc:  1087 /  1627 =  66.810
1, 5  acc:   352 /   520 =  67.692
1, 6  acc:  1119 /  1537 =  72.804
1, 7  acc:  1562 /  2246 =  69.546
------------------------------------
Average acc: 59924 / 71854 =  83.397
Robust  acc:   831 /  1260 =  65.952
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc: 10699 / 12092 =  88.480
0, 1  acc: 12771 / 14179 =  90.070
0, 2  acc:  2438 /  3210 =  75.950
0, 3  acc: 11122 / 12101 =  91.910
0, 4  acc:  4445 /  5355 =  83.007
0, 5  acc:  2616 /  2980 =  87.785
0, 6  acc:  2493 /  3335 =  74.753
0, 7  acc:  4436 /  5723 =  77.512
1, 0  acc:  1554 /  2203 =  70.540
1, 1  acc:  1575 /  2270 =  69.383
1, 2  acc:   824 /  1216 =  67.763
1, 3  acc:   831 /  1260 =  65.952
1, 4  acc:  1087 /  1627 =  66.810
1, 5  acc:   352 /   520 =  67.692
1, 6  acc:  1119 /  1537 =  72.804
1, 7  acc:  1562 /  2246 =  69.546
------------------------------------
Average acc: 59924 / 71854 =  83.397
Robust  acc:   831 /  1260 =  65.952
------------------------------------
replace: True
Checkpoint saved at ./model/civilcomments/config/debias-end_seed42.pt
