Arch: resnet50_pt
Bs trn: 256
Bs val: 256
Hidden dim: 256
Dataset: celebA
Resample class: 
Slice with: rep
Rep cluster method: gmm
Num anchor: 32
Num positive: 32
Num negative: 32
Num negative easy: 0
Weight anc by loss: False
Weight pos by loss: False
Weight neg by loss: False
Anc loss temp: 0.5
Pos loss temp: 0.5
Neg loss temp: 0.5
Data wide pos: False
Target sample ratio: 1
Balance targets: False
Additional negatives: False
Hard negative factor: 0
Full contrastive: False
Train encoder: False
No projection head: False
Projection dim: 128
Batch factor: None
Temperature: 0.05
Single pos: False
Supervised linear scale up: False
Supervised update delay: 0
Contrastive weight: 0.5
Classifier update interval: 8
Optim: sgd
Max epoch: 100
Lr: 1e-05
Momentum: 0.9
Weight decay: 0.1
Weight decay c: 0.1
Stopping window: 30
Load encoder: 
Freeze encoder: False
Finetune epochs: 0
Clip grad norm: False
Lr scheduler classifier: 
Lr scheduler: 
Grad clip grad norm: False
Erm: False
Erm only: False
Pretrained spurious path: ./model/celebA/stage_one_erm_model_b_end_seed0.pt
Max epoch s: 1
Bs trn s: 32
Lr s: 0.001
Momentum s: 0.9
Weight decay s: 0.0005
Slice temp: 10
Log loss interval: 10
Checkpoint interval: 50
Grad checkpoint interval: 50
Log visual interval: 100
Log grad visual interval: 50
Verbose: True
Seed: 0
Replicate: 0
No cuda: False
Resume: False
New slice: False
Num workers: 32
Evaluate: False
Data cmap: hsv
Test cmap: 
P correlation: 0.9
P corr by class: None
Train classes: ['blond', 'nonblond']
Train class ratios: None
Test shift: random
Flipped: False
Q: 0.7
Pretrained bmodel: True
Cosine: False
Exp: None
Supervised contrast: True
Prioritize spurious pos: False
Contrastive type: cnc
Compute auroc: False
Model type: resnet50_pt_cnc
Criterion: cross_entropy
Pretrained: False
Max grad norm: 1.0
Adam epsilon: 1e-08
Warmup steps: 0
Max grad norm s: 1.0
Adam epsilon s: 1e-08
Warmup steps s: 0
Grad max grad norm: 1.0
Grad adam epsilon: 1e-08
Grad warmup steps: 0
Device: cuda
Img file type: .png
Display image: False
Image path: ./images/celebA/celebA/config/contrastive_umaps
Log interval: 1
Log path: ./logs/celebA/config
Results path: ./results/celebA/config
Model path: ./model/celebA/config
Loss factor: 1
Supersample labels: False
Subsample labels: False
Weigh slice samples by loss: True
Val split: 0.2
Spurious train split: 0.2
Subsample groups: False
Train method: sc
Max robust acc: -1
Max robust epoch: -1
Max robust group acc: (None, None)
Root dir: ./datasets/data/CelebA/
Target name: Blond_Hair
Confounder names: ['Male']
Image mean: 0.449
Image std: 0.226
Augment data: False
Task: celebA
Num classes: 2
Experiment configs: config
Experiment name: cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0
Mi resampled: None

Loading checkpoints for train split:
[-1 -1 -1 ... -1 -1 -1]
<class 'numpy.ndarray'>
[0 1 2 3] [71629 66874 22880  1387]
Loading checkpoints for val split:
[-1 -1 -1 ... -1  1 -1]
<class 'numpy.ndarray'>
[0 1 2 3] [8535 8276 2874  182]
Loading checkpoints for test split:
[-1 -1 -1 ... -1 -1  1]
<class 'numpy.ndarray'>
[0 1 2 3] [9767 7535 2480  180]
Train dataset:
    Blond_Hair = 0, Male = 0 : n = 71629
    Blond_Hair = 0, Male = 1 : n = 66874
    Blond_Hair = 1, Male = 0 : n = 22880
    Blond_Hair = 1, Male = 1 : n = 1387
Val dataset:
    Blond_Hair = 0, Male = 0 : n = 8535
    Blond_Hair = 0, Male = 1 : n = 8276
    Blond_Hair = 1, Male = 0 : n = 2874
    Blond_Hair = 1, Male = 1 : n = 182
Test dataset:
    Blond_Hair = 0, Male = 0 : n = 9767
    Blond_Hair = 0, Male = 1 : n = 7535
    Blond_Hair = 1, Male = 0 : n = 2480
    Blond_Hair = 1, Male = 1 : n = 180
------------------------
> Loading spurious model
------------------------
Pretrained model loaded from ./model/celebA/stage_one_erm_model_b_end_seed0.pt
======
# Calculate probability ...
======
======
# Load biased model ...
======
Epoch:   1 | Train Loss: 0.003 | Train Acc: 60.525 | Val Loss: 0.001 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 51247 / 51247 = 100.000
0, 1  acc: 47269 / 47269 = 100.000
1, 0  acc:     0 / 58212 =   0.000
1, 1  acc:     0 /  6042 =   0.000
-------------------------------------
Average acc: 98516 / 162770 =  60.525
Robust  acc:     0 / 58212 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 0:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:   2 | Train Loss: 0.003 | Train Acc: 60.504 | Val Loss: 0.001 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 50999 / 50999 = 100.000
0, 1  acc: 47484 / 47484 = 100.000
1, 0  acc:     0 / 58229 =   0.000
1, 1  acc:     0 /  6058 =   0.000
-------------------------------------
Average acc: 98483 / 162770 =  60.504
Robust  acc:     0 / 58229 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 1:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:   3 | Train Loss: 0.003 | Train Acc: 60.581 | Val Loss: 0.001 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 50981 / 50981 = 100.000
0, 1  acc: 47626 / 47626 = 100.000
1, 0  acc:     0 / 58178 =   0.000
1, 1  acc:     0 /  5985 =   0.000
-------------------------------------
Average acc: 98607 / 162770 =  60.581
Robust  acc:     0 / 58178 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 2:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:   4 | Train Loss: 0.003 | Train Acc: 60.369 | Val Loss: 0.001 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 51198 / 51198 = 100.000
0, 1  acc: 47065 / 47065 = 100.000
1, 0  acc:     0 / 58527 =   0.000
1, 1  acc:     0 /  5980 =   0.000
-------------------------------------
Average acc: 98263 / 162770 =  60.369
Robust  acc:     0 / 58527 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 3:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:   5 | Train Loss: 0.002 | Train Acc: 60.275 | Val Loss: 0.001 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 50673 / 50673 = 100.000
0, 1  acc: 47437 / 47437 = 100.000
1, 0  acc:     0 / 58607 =   0.000
1, 1  acc:     0 /  6053 =   0.000
-------------------------------------
Average acc: 98110 / 162770 =  60.275
Robust  acc:     0 / 58607 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 4:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:   6 | Train Loss: 0.002 | Train Acc: 60.320 | Val Loss: 0.001 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 51073 / 51073 = 100.000
0, 1  acc: 47110 / 47110 = 100.000
1, 0  acc:     0 / 58585 =   0.000
1, 1  acc:     0 /  6002 =   0.000
-------------------------------------
Average acc: 98183 / 162770 =  60.320
Robust  acc:     0 / 58585 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 5:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:   7 | Train Loss: 0.002 | Train Acc: 60.667 | Val Loss: 0.001 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 51207 / 51207 = 100.000
0, 1  acc: 47540 / 47540 = 100.000
1, 0  acc:     0 / 58149 =   0.000
1, 1  acc:     0 /  5874 =   0.000
-------------------------------------
Average acc: 98747 / 162770 =  60.667
Robust  acc:     0 / 58149 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 6:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:   8 | Train Loss: 0.002 | Train Acc: 60.365 | Val Loss: 0.001 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 51154 / 51154 = 100.000
0, 1  acc: 47102 / 47102 = 100.000
1, 0  acc:     0 / 58610 =   0.000
1, 1  acc:     0 /  5904 =   0.000
-------------------------------------
Average acc: 98256 / 162770 =  60.365
Robust  acc:     0 / 58610 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 7:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:   9 | Train Loss: 0.002 | Train Acc: 60.784 | Val Loss: 0.001 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 51403 / 51403 = 100.000
0, 1  acc: 47535 / 47535 = 100.000
1, 0  acc:     0 / 57961 =   0.000
1, 1  acc:     0 /  5871 =   0.000
-------------------------------------
Average acc: 98938 / 162770 =  60.784
Robust  acc:     0 / 57961 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 8:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:  10 | Train Loss: 0.002 | Train Acc: 60.547 | Val Loss: 0.001 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 51230 / 51230 = 100.000
0, 1  acc: 47322 / 47322 = 100.000
1, 0  acc:     0 / 58184 =   0.000
1, 1  acc:     0 /  6034 =   0.000
-------------------------------------
Average acc: 98552 / 162770 =  60.547
Robust  acc:     0 / 58184 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 9:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:  11 | Train Loss: 0.002 | Train Acc: 60.663 | Val Loss: 0.001 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 51216 / 51216 = 100.000
0, 1  acc: 47525 / 47525 = 100.000
1, 0  acc:     0 / 58003 =   0.000
1, 1  acc:     0 /  6026 =   0.000
-------------------------------------
Average acc: 98741 / 162770 =  60.663
Robust  acc:     0 / 58003 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 10:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:  12 | Train Loss: 0.002 | Train Acc: 60.509 | Val Loss: 0.001 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 51469 / 51469 = 100.000
0, 1  acc: 47021 / 47021 = 100.000
1, 0  acc:     0 / 58259 =   0.000
1, 1  acc:     0 /  6021 =   0.000
-------------------------------------
Average acc: 98490 / 162770 =  60.509
Robust  acc:     0 / 58259 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 11:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:  13 | Train Loss: 0.002 | Train Acc: 60.412 | Val Loss: 0.001 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 51216 / 51216 = 100.000
0, 1  acc: 47117 / 47117 = 100.000
1, 0  acc:     0 / 58384 =   0.000
1, 1  acc:     0 /  6053 =   0.000
-------------------------------------
Average acc: 98333 / 162770 =  60.412
Robust  acc:     0 / 58384 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 12:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:  14 | Train Loss: 0.002 | Train Acc: 60.383 | Val Loss: 0.001 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 50855 / 50855 = 100.000
0, 1  acc: 47431 / 47431 = 100.000
1, 0  acc:     0 / 58418 =   0.000
1, 1  acc:     0 /  6066 =   0.000
-------------------------------------
Average acc: 98286 / 162770 =  60.383
Robust  acc:     0 / 58418 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 13:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:  15 | Train Loss: 0.002 | Train Acc: 60.454 | Val Loss: 0.001 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 51097 / 51097 = 100.000
0, 1  acc: 47304 / 47304 = 100.000
1, 0  acc:     0 / 58235 =   0.000
1, 1  acc:     0 /  6134 =   0.000
-------------------------------------
Average acc: 98401 / 162770 =  60.454
Robust  acc:     0 / 58235 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 14:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:  16 | Train Loss: 0.002 | Train Acc: 60.488 | Val Loss: 0.002 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 50832 / 50832 = 100.000
0, 1  acc: 47624 / 47624 = 100.000
1, 0  acc:     0 / 58234 =   0.000
1, 1  acc:     0 /  6080 =   0.000
-------------------------------------
Average acc: 98456 / 162770 =  60.488
Robust  acc:     0 / 58234 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 15:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:  17 | Train Loss: 0.002 | Train Acc: 60.554 | Val Loss: 0.001 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 51027 / 51027 = 100.000
0, 1  acc: 47536 / 47536 = 100.000
1, 0  acc:     0 / 58220 =   0.000
1, 1  acc:     0 /  5987 =   0.000
-------------------------------------
Average acc: 98563 / 162770 =  60.554
Robust  acc:     0 / 58220 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 16:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:  18 | Train Loss: 0.002 | Train Acc: 60.474 | Val Loss: 0.002 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 51015 / 51015 = 100.000
0, 1  acc: 47419 / 47419 = 100.000
1, 0  acc:     0 / 58364 =   0.000
1, 1  acc:     0 /  5972 =   0.000
-------------------------------------
Average acc: 98434 / 162770 =  60.474
Robust  acc:     0 / 58364 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 17:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:  19 | Train Loss: 0.002 | Train Acc: 60.429 | Val Loss: 0.001 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 51104 / 51104 = 100.000
0, 1  acc: 47257 / 47257 = 100.000
1, 0  acc:     0 / 58495 =   0.000
1, 1  acc:     0 /  5914 =   0.000
-------------------------------------
Average acc: 98361 / 162770 =  60.429
Robust  acc:     0 / 58495 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 18:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:  20 | Train Loss: 0.002 | Train Acc: 60.785 | Val Loss: 0.002 | Val Acc: 84.653
Training:
Accuracies by groups:
0, 0  acc: 51403 / 51404 =  99.998
0, 1  acc: 47443 / 47443 = 100.000
1, 0  acc:    93 / 57959 =   0.160
1, 1  acc:     0 /  5964 =   0.000
-------------------------------------
Average acc: 98939 / 162770 =  60.785
Robust  acc:     0 /  5964 =   0.000
-------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8533 /  8535 =  99.977
0, 1  acc:  8275 /  8276 =  99.988
1, 0  acc:     9 /  2874 =   0.313
1, 1  acc:     1 /   182 =   0.549
------------------------------------
Average acc: 16818 / 19867 =  84.653
Robust  acc:     9 /  2874 =   0.313
------------------------------------
New max robust acc: 0.31315240083507306
- Saving best checkpoint at epoch 19
replace: True
Checkpoint saved at ./model/celebA/config/cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=19-cpre=-1-cpb=-1.pt
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 86.700
Robust Acc: 0.242 | Best Acc: 100.000
-------------------------------------
Training, Epoch 19:
Accuracies by groups:
0, 0  acc:  9764 /  9767 =  99.969
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     6 /  2480 =   0.242
1, 1  acc:     2 /   180 =   1.111
------------------------------------
Average acc: 17307 / 19962 =  86.700
Robust  acc:     6 /  2480 =   0.242
------------------------------------
Accuracies by groups:
0, 0  acc:  9764 /  9767 =  99.969
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     6 /  2480 =   0.242
1, 1  acc:     2 /   180 =   1.111
------------------------------------
Average acc: 17307 / 19962 =  86.700
Robust  acc:     6 /  2480 =   0.242
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9764 /  9767 =  99.969
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     6 /  2480 =   0.242
1, 1  acc:     2 /   180 =   1.111
------------------------------------
Average acc: 17307 / 19962 =  86.700
Robust  acc:     6 /  2480 =   0.242
------------------------------------
Epoch:  21 | Train Loss: 0.002 | Train Acc: 64.025 | Val Loss: 0.002 | Val Acc: 89.722
Training:
Accuracies by groups:
0, 0  acc: 50925 / 51101 =  99.656
0, 1  acc: 47385 / 47405 =  99.958
1, 0  acc:  5832 / 58099 =  10.038
1, 1  acc:    71 /  6165 =   1.152
--------------------------------------
Average acc: 104213 / 162770 =  64.025
Robust  acc:    71 /  6165 =   1.152
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8307 /  8535 =  97.329
0, 1  acc:  8246 /  8276 =  99.638
1, 0  acc:  1243 /  2874 =  43.250
1, 1  acc:    29 /   182 =  15.934
------------------------------------
Average acc: 17825 / 19867 =  89.722
Robust  acc:    29 /   182 =  15.934
------------------------------------
New max robust acc: 15.934065934065933
- Saving best checkpoint at epoch 20
replace: True
-> Updating checkpoint cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=19-cpre=-1-cpb=-1.pt...
Checkpoint saved at ./model/celebA/config/cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=20-cpre=-1-cpb=-1.pt
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 90.772
Robust Acc: 7.222 | Best Acc: 99.589
------------------------------------
Training, Epoch 20:
Accuracies by groups:
0, 0  acc:  9569 /  9767 =  97.973
0, 1  acc:  7504 /  7535 =  99.589
1, 0  acc:  1034 /  2480 =  41.694
1, 1  acc:    13 /   180 =   7.222
------------------------------------
Average acc: 18120 / 19962 =  90.772
Robust  acc:    13 /   180 =   7.222
------------------------------------
Accuracies by groups:
0, 0  acc:  9569 /  9767 =  97.973
0, 1  acc:  7504 /  7535 =  99.589
1, 0  acc:  1034 /  2480 =  41.694
1, 1  acc:    13 /   180 =   7.222
------------------------------------
Average acc: 18120 / 19962 =  90.772
Robust  acc:    13 /   180 =   7.222
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9569 /  9767 =  97.973
0, 1  acc:  7504 /  7535 =  99.589
1, 0  acc:  1034 /  2480 =  41.694
1, 1  acc:    13 /   180 =   7.222
------------------------------------
Average acc: 18120 / 19962 =  90.772
Robust  acc:    13 /   180 =   7.222
------------------------------------
Epoch:  22 | Train Loss: 0.002 | Train Acc: 69.985 | Val Loss: 0.001 | Val Acc: 88.252
Training:
Accuracies by groups:
0, 0  acc: 50210 / 50822 =  98.796
0, 1  acc: 47642 / 47749 =  99.776
1, 0  acc: 15796 / 58080 =  27.197
1, 1  acc:   266 /  6119 =   4.347
--------------------------------------
Average acc: 113914 / 162770 =  69.985
Robust  acc:   266 /  6119 =   4.347
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8512 /  8535 =  99.731
0, 1  acc:  8274 /  8276 =  99.976
1, 0  acc:   742 /  2874 =  25.818
1, 1  acc:     5 /   182 =   2.747
------------------------------------
Average acc: 17533 / 19867 =  88.252
Robust  acc:     5 /   182 =   2.747
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 89.605
Robust Acc: 1.111 | Best Acc: 100.000
-------------------------------------
Training, Epoch 21:
Accuracies by groups:
0, 0  acc:  9748 /  9767 =  99.805
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:   602 /  2480 =  24.274
1, 1  acc:     2 /   180 =   1.111
------------------------------------
Average acc: 17887 / 19962 =  89.605
Robust  acc:     2 /   180 =   1.111
------------------------------------
Accuracies by groups:
0, 0  acc:  9748 /  9767 =  99.805
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:   602 /  2480 =  24.274
1, 1  acc:     2 /   180 =   1.111
------------------------------------
Average acc: 17887 / 19962 =  89.605
Robust  acc:     2 /   180 =   1.111
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9748 /  9767 =  99.805
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:   602 /  2480 =  24.274
1, 1  acc:     2 /   180 =   1.111
------------------------------------
Average acc: 17887 / 19962 =  89.605
Robust  acc:     2 /   180 =   1.111
------------------------------------
Epoch:  23 | Train Loss: 0.002 | Train Acc: 73.539 | Val Loss: 0.001 | Val Acc: 92.269
Training:
Accuracies by groups:
0, 0  acc: 49978 / 51019 =  97.960
0, 1  acc: 47504 / 47663 =  99.666
1, 0  acc: 21812 / 58233 =  37.456
1, 1  acc:   405 /  5855 =   6.917
--------------------------------------
Average acc: 119699 / 162770 =  73.539
Robust  acc:   405 /  5855 =   6.917
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8373 /  8535 =  98.102
0, 1  acc:  8256 /  8276 =  99.758
1, 0  acc:  1673 /  2874 =  58.212
1, 1  acc:    29 /   182 =  15.934
------------------------------------
Average acc: 18331 / 19867 =  92.269
Robust  acc:    29 /   182 =  15.934
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.636
Robust Acc: 9.444 | Best Acc: 99.562
------------------------------------
Training, Epoch 22:
Accuracies by groups:
0, 0  acc:  9637 /  9767 =  98.669
0, 1  acc:  7502 /  7535 =  99.562
1, 0  acc:  1336 /  2480 =  53.871
1, 1  acc:    17 /   180 =   9.444
------------------------------------
Average acc: 18492 / 19962 =  92.636
Robust  acc:    17 /   180 =   9.444
------------------------------------
Accuracies by groups:
0, 0  acc:  9637 /  9767 =  98.669
0, 1  acc:  7502 /  7535 =  99.562
1, 0  acc:  1336 /  2480 =  53.871
1, 1  acc:    17 /   180 =   9.444
------------------------------------
Average acc: 18492 / 19962 =  92.636
Robust  acc:    17 /   180 =   9.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9637 /  9767 =  98.669
0, 1  acc:  7502 /  7535 =  99.562
1, 0  acc:  1336 /  2480 =  53.871
1, 1  acc:    17 /   180 =   9.444
------------------------------------
Average acc: 18492 / 19962 =  92.636
Robust  acc:    17 /   180 =   9.444
------------------------------------
Epoch:  24 | Train Loss: 0.002 | Train Acc: 75.559 | Val Loss: 0.001 | Val Acc: 91.866
Training:
Accuracies by groups:
0, 0  acc: 50193 / 51517 =  97.430
0, 1  acc: 46905 / 47151 =  99.478
1, 0  acc: 25299 / 58226 =  43.450
1, 1  acc:   591 /  5876 =  10.058
--------------------------------------
Average acc: 122988 / 162770 =  75.559
Robust  acc:   591 /  5876 =  10.058
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8049 /  8535 =  94.306
0, 1  acc:  8176 /  8276 =  98.792
1, 0  acc:  1968 /  2874 =  68.476
1, 1  acc:    58 /   182 =  31.868
------------------------------------
Average acc: 18251 / 19867 =  91.866
Robust  acc:    58 /   182 =  31.868
------------------------------------
New max robust acc: 31.868131868131865
- Saving best checkpoint at epoch 23
replace: True
-> Updating checkpoint cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=20-cpre=-1-cpb=-1.pt...
Checkpoint saved at ./model/celebA/config/cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=23-cpre=-1-cpb=-1.pt
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.967
Robust Acc: 22.778 | Best Acc: 99.151
-------------------------------------
Training, Epoch 23:
Accuracies by groups:
0, 0  acc:  9335 /  9767 =  95.577
0, 1  acc:  7471 /  7535 =  99.151
1, 0  acc:  1711 /  2480 =  68.992
1, 1  acc:    41 /   180 =  22.778
------------------------------------
Average acc: 18558 / 19962 =  92.967
Robust  acc:    41 /   180 =  22.778
------------------------------------
Accuracies by groups:
0, 0  acc:  9335 /  9767 =  95.577
0, 1  acc:  7471 /  7535 =  99.151
1, 0  acc:  1711 /  2480 =  68.992
1, 1  acc:    41 /   180 =  22.778
------------------------------------
Average acc: 18558 / 19962 =  92.967
Robust  acc:    41 /   180 =  22.778
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9335 /  9767 =  95.577
0, 1  acc:  7471 /  7535 =  99.151
1, 0  acc:  1711 /  2480 =  68.992
1, 1  acc:    41 /   180 =  22.778
------------------------------------
Average acc: 18558 / 19962 =  92.967
Robust  acc:    41 /   180 =  22.778
------------------------------------
Epoch:  25 | Train Loss: 0.002 | Train Acc: 77.221 | Val Loss: 0.002 | Val Acc: 92.510
Training:
Accuracies by groups:
0, 0  acc: 49779 / 51454 =  96.745
0, 1  acc: 46889 / 47187 =  99.368
1, 0  acc: 28291 / 58377 =  48.463
1, 1  acc:   734 /  5752 =  12.761
--------------------------------------
Average acc: 125693 / 162770 =  77.221
Robust  acc:   734 /  5752 =  12.761
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7919 /  8535 =  92.783
0, 1  acc:  8032 /  8276 =  97.052
1, 0  acc:  2343 /  2874 =  81.524
1, 1  acc:    85 /   182 =  46.703
------------------------------------
Average acc: 18379 / 19867 =  92.510
Robust  acc:    85 /   182 =  46.703
------------------------------------
New max robust acc: 46.7032967032967
- Saving best checkpoint at epoch 24
replace: True
-> Updating checkpoint cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=23-cpre=-1-cpb=-1.pt...
Checkpoint saved at ./model/celebA/config/cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=24-cpre=-1-cpb=-1.pt
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.337
Robust Acc: 41.667 | Best Acc: 97.399
-------------------------------------
Training, Epoch 24:
Accuracies by groups:
0, 0  acc:  9223 /  9767 =  94.430
0, 1  acc:  7339 /  7535 =  97.399
1, 0  acc:  1995 /  2480 =  80.444
1, 1  acc:    75 /   180 =  41.667
------------------------------------
Average acc: 18632 / 19962 =  93.337
Robust  acc:    75 /   180 =  41.667
------------------------------------
Accuracies by groups:
0, 0  acc:  9223 /  9767 =  94.430
0, 1  acc:  7339 /  7535 =  97.399
1, 0  acc:  1995 /  2480 =  80.444
1, 1  acc:    75 /   180 =  41.667
------------------------------------
Average acc: 18632 / 19962 =  93.337
Robust  acc:    75 /   180 =  41.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9223 /  9767 =  94.430
0, 1  acc:  7339 /  7535 =  97.399
1, 0  acc:  1995 /  2480 =  80.444
1, 1  acc:    75 /   180 =  41.667
------------------------------------
Average acc: 18632 / 19962 =  93.337
Robust  acc:    75 /   180 =  41.667
------------------------------------
Epoch:  26 | Train Loss: 0.002 | Train Acc: 78.450 | Val Loss: 0.001 | Val Acc: 93.003
Training:
Accuracies by groups:
0, 0  acc: 49213 / 51218 =  96.085
0, 1  acc: 47148 / 47475 =  99.311
1, 0  acc: 30440 / 58191 =  52.310
1, 1  acc:   892 /  5886 =  15.155
--------------------------------------
Average acc: 127693 / 162770 =  78.450
Robust  acc:   892 /  5886 =  15.155
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8306 /  8535 =  97.317
0, 1  acc:  8247 /  8276 =  99.650
1, 0  acc:  1892 /  2874 =  65.832
1, 1  acc:    32 /   182 =  17.582
------------------------------------
Average acc: 18477 / 19867 =  93.003
Robust  acc:    32 /   182 =  17.582
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.503
Robust Acc: 12.222 | Best Acc: 99.748
-------------------------------------
Training, Epoch 25:
Accuracies by groups:
0, 0  acc:  9598 /  9767 =  98.270
0, 1  acc:  7516 /  7535 =  99.748
1, 0  acc:  1529 /  2480 =  61.653
1, 1  acc:    22 /   180 =  12.222
------------------------------------
Average acc: 18665 / 19962 =  93.503
Robust  acc:    22 /   180 =  12.222
------------------------------------
Accuracies by groups:
0, 0  acc:  9598 /  9767 =  98.270
0, 1  acc:  7516 /  7535 =  99.748
1, 0  acc:  1529 /  2480 =  61.653
1, 1  acc:    22 /   180 =  12.222
------------------------------------
Average acc: 18665 / 19962 =  93.503
Robust  acc:    22 /   180 =  12.222
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9598 /  9767 =  98.270
0, 1  acc:  7516 /  7535 =  99.748
1, 0  acc:  1529 /  2480 =  61.653
1, 1  acc:    22 /   180 =  12.222
------------------------------------
Average acc: 18665 / 19962 =  93.503
Robust  acc:    22 /   180 =  12.222
------------------------------------
Epoch:  27 | Train Loss: 0.002 | Train Acc: 79.305 | Val Loss: 0.001 | Val Acc: 92.998
Training:
Accuracies by groups:
0, 0  acc: 48638 / 50796 =  95.752
0, 1  acc: 47046 / 47512 =  99.019
1, 0  acc: 32373 / 58629 =  55.217
1, 1  acc:  1028 /  5833 =  17.624
--------------------------------------
Average acc: 129085 / 162770 =  79.305
Robust  acc:  1028 /  5833 =  17.624
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8004 /  8535 =  93.779
0, 1  acc:  8183 /  8276 =  98.876
1, 0  acc:  2223 /  2874 =  77.349
1, 1  acc:    66 /   182 =  36.264
------------------------------------
Average acc: 18476 / 19867 =  92.998
Robust  acc:    66 /   182 =  36.264
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.588
Robust Acc: 30.556 | Best Acc: 98.938
-------------------------------------
Training, Epoch 26:
Accuracies by groups:
0, 0  acc:  9293 /  9767 =  95.147
0, 1  acc:  7455 /  7535 =  98.938
1, 0  acc:  1879 /  2480 =  75.766
1, 1  acc:    55 /   180 =  30.556
------------------------------------
Average acc: 18682 / 19962 =  93.588
Robust  acc:    55 /   180 =  30.556
------------------------------------
Accuracies by groups:
0, 0  acc:  9293 /  9767 =  95.147
0, 1  acc:  7455 /  7535 =  98.938
1, 0  acc:  1879 /  2480 =  75.766
1, 1  acc:    55 /   180 =  30.556
------------------------------------
Average acc: 18682 / 19962 =  93.588
Robust  acc:    55 /   180 =  30.556
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9293 /  9767 =  95.147
0, 1  acc:  7455 /  7535 =  98.938
1, 0  acc:  1879 /  2480 =  75.766
1, 1  acc:    55 /   180 =  30.556
------------------------------------
Average acc: 18682 / 19962 =  93.588
Robust  acc:    55 /   180 =  30.556
------------------------------------
Epoch:  28 | Train Loss: 0.002 | Train Acc: 80.284 | Val Loss: 0.001 | Val Acc: 85.921
Training:
Accuracies by groups:
0, 0  acc: 48846 / 51282 =  95.250
0, 1  acc: 46684 / 47160 =  98.991
1, 0  acc: 33872 / 58275 =  58.124
1, 1  acc:  1277 /  6053 =  21.097
--------------------------------------
Average acc: 130679 / 162770 =  80.284
Robust  acc:  1277 /  6053 =  21.097
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8528 /  8535 =  99.918
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:   265 /  2874 =   9.221
1, 1  acc:     1 /   182 =   0.549
------------------------------------
Average acc: 17070 / 19867 =  85.921
Robust  acc:     1 /   182 =   0.549
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 87.772
Robust Acc: 0.556 | Best Acc: 100.000
-------------------------------------
Training, Epoch 27:
Accuracies by groups:
0, 0  acc:  9763 /  9767 =  99.959
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:   222 /  2480 =   8.952
1, 1  acc:     1 /   180 =   0.556
------------------------------------
Average acc: 17521 / 19962 =  87.772
Robust  acc:     1 /   180 =   0.556
------------------------------------
Accuracies by groups:
0, 0  acc:  9763 /  9767 =  99.959
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:   222 /  2480 =   8.952
1, 1  acc:     1 /   180 =   0.556
------------------------------------
Average acc: 17521 / 19962 =  87.772
Robust  acc:     1 /   180 =   0.556
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9763 /  9767 =  99.959
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:   222 /  2480 =   8.952
1, 1  acc:     1 /   180 =   0.556
------------------------------------
Average acc: 17521 / 19962 =  87.772
Robust  acc:     1 /   180 =   0.556
------------------------------------
Epoch:  29 | Train Loss: 0.002 | Train Acc: 81.078 | Val Loss: 0.001 | Val Acc: 93.361
Training:
Accuracies by groups:
0, 0  acc: 48324 / 51040 =  94.679
0, 1  acc: 47046 / 47591 =  98.855
1, 0  acc: 35166 / 58163 =  60.461
1, 1  acc:  1435 /  5976 =  24.013
--------------------------------------
Average acc: 131971 / 162770 =  81.078
Robust  acc:  1435 /  5976 =  24.013
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8087 /  8535 =  94.751
0, 1  acc:  8200 /  8276 =  99.082
1, 0  acc:  2206 /  2874 =  76.757
1, 1  acc:    55 /   182 =  30.220
------------------------------------
Average acc: 18548 / 19867 =  93.361
Robust  acc:    55 /   182 =  30.220
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.089
Robust Acc: 28.333 | Best Acc: 99.297
-------------------------------------
Training, Epoch 28:
Accuracies by groups:
0, 0  acc:  9383 /  9767 =  96.068
0, 1  acc:  7482 /  7535 =  99.297
1, 0  acc:  1866 /  2480 =  75.242
1, 1  acc:    51 /   180 =  28.333
------------------------------------
Average acc: 18782 / 19962 =  94.089
Robust  acc:    51 /   180 =  28.333
------------------------------------
Accuracies by groups:
0, 0  acc:  9383 /  9767 =  96.068
0, 1  acc:  7482 /  7535 =  99.297
1, 0  acc:  1866 /  2480 =  75.242
1, 1  acc:    51 /   180 =  28.333
------------------------------------
Average acc: 18782 / 19962 =  94.089
Robust  acc:    51 /   180 =  28.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9383 /  9767 =  96.068
0, 1  acc:  7482 /  7535 =  99.297
1, 0  acc:  1866 /  2480 =  75.242
1, 1  acc:    51 /   180 =  28.333
------------------------------------
Average acc: 18782 / 19962 =  94.089
Robust  acc:    51 /   180 =  28.333
------------------------------------
Epoch:  30 | Train Loss: 0.002 | Train Acc: 81.714 | Val Loss: 0.001 | Val Acc: 88.524
Training:
Accuracies by groups:
0, 0  acc: 48112 / 50910 =  94.504
0, 1  acc: 46711 / 47372 =  98.605
1, 0  acc: 36577 / 58552 =  62.469
1, 1  acc:  1606 /  5936 =  27.055
--------------------------------------
Average acc: 133006 / 162770 =  81.714
Robust  acc:  1606 /  5936 =  27.055
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8504 /  8535 =  99.637
0, 1  acc:  8272 /  8276 =  99.952
1, 0  acc:   808 /  2874 =  28.114
1, 1  acc:     3 /   182 =   1.648
------------------------------------
Average acc: 17587 / 19867 =  88.524
Robust  acc:     3 /   182 =   1.648
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 89.826
Robust Acc: 2.222 | Best Acc: 100.000
-------------------------------------
Training, Epoch 29:
Accuracies by groups:
0, 0  acc:  9733 /  9767 =  99.652
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:   659 /  2480 =  26.573
1, 1  acc:     4 /   180 =   2.222
------------------------------------
Average acc: 17931 / 19962 =  89.826
Robust  acc:     4 /   180 =   2.222
------------------------------------
Accuracies by groups:
0, 0  acc:  9733 /  9767 =  99.652
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:   659 /  2480 =  26.573
1, 1  acc:     4 /   180 =   2.222
------------------------------------
Average acc: 17931 / 19962 =  89.826
Robust  acc:     4 /   180 =   2.222
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9733 /  9767 =  99.652
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:   659 /  2480 =  26.573
1, 1  acc:     4 /   180 =   2.222
------------------------------------
Average acc: 17931 / 19962 =  89.826
Robust  acc:     4 /   180 =   2.222
------------------------------------
Epoch:  31 | Train Loss: 0.002 | Train Acc: 82.284 | Val Loss: 0.001 | Val Acc: 93.215
Training:
Accuracies by groups:
0, 0  acc: 48253 / 51373 =  93.927
0, 1  acc: 46505 / 47223 =  98.480
1, 0  acc: 37478 / 58216 =  64.377
1, 1  acc:  1697 /  5958 =  28.483
--------------------------------------
Average acc: 133933 / 162770 =  82.284
Robust  acc:  1697 /  5958 =  28.483
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8316 /  8535 =  97.434
0, 1  acc:  8244 /  8276 =  99.613
1, 0  acc:  1929 /  2874 =  67.119
1, 1  acc:    30 /   182 =  16.484
------------------------------------
Average acc: 18519 / 19867 =  93.215
Robust  acc:    30 /   182 =  16.484
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.708
Robust Acc: 13.333 | Best Acc: 99.788
-------------------------------------
Training, Epoch 30:
Accuracies by groups:
0, 0  acc:  9564 /  9767 =  97.922
0, 1  acc:  7519 /  7535 =  99.788
1, 0  acc:  1599 /  2480 =  64.476
1, 1  acc:    24 /   180 =  13.333
------------------------------------
Average acc: 18706 / 19962 =  93.708
Robust  acc:    24 /   180 =  13.333
------------------------------------
Accuracies by groups:
0, 0  acc:  9564 /  9767 =  97.922
0, 1  acc:  7519 /  7535 =  99.788
1, 0  acc:  1599 /  2480 =  64.476
1, 1  acc:    24 /   180 =  13.333
------------------------------------
Average acc: 18706 / 19962 =  93.708
Robust  acc:    24 /   180 =  13.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9564 /  9767 =  97.922
0, 1  acc:  7519 /  7535 =  99.788
1, 0  acc:  1599 /  2480 =  64.476
1, 1  acc:    24 /   180 =  13.333
------------------------------------
Average acc: 18706 / 19962 =  93.708
Robust  acc:    24 /   180 =  13.333
------------------------------------
Epoch:  32 | Train Loss: 0.002 | Train Acc: 82.872 | Val Loss: 0.001 | Val Acc: 93.089
Training:
Accuracies by groups:
0, 0  acc: 47489 / 50660 =  93.741
0, 1  acc: 46741 / 47497 =  98.408
1, 0  acc: 38790 / 58529 =  66.275
1, 1  acc:  1871 /  6084 =  30.753
--------------------------------------
Average acc: 134891 / 162770 =  82.872
Robust  acc:  1871 /  6084 =  30.753
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7848 /  8535 =  91.951
0, 1  acc:  8118 /  8276 =  98.091
1, 0  acc:  2440 /  2874 =  84.899
1, 1  acc:    88 /   182 =  48.352
------------------------------------
Average acc: 18494 / 19867 =  93.089
Robust  acc:    88 /   182 =  48.352
------------------------------------
New max robust acc: 48.35164835164835
- Saving best checkpoint at epoch 31
replace: True
-> Updating checkpoint cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=24-cpre=-1-cpb=-1.pt...
Checkpoint saved at ./model/celebA/config/cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=31-cpre=-1-cpb=-1.pt
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.918
Robust Acc: 40.556 | Best Acc: 98.447
-------------------------------------
Training, Epoch 31:
Accuracies by groups:
0, 0  acc:  9187 /  9767 =  94.062
0, 1  acc:  7418 /  7535 =  98.447
1, 0  acc:  2070 /  2480 =  83.468
1, 1  acc:    73 /   180 =  40.556
------------------------------------
Average acc: 18748 / 19962 =  93.918
Robust  acc:    73 /   180 =  40.556
------------------------------------
Accuracies by groups:
0, 0  acc:  9187 /  9767 =  94.062
0, 1  acc:  7418 /  7535 =  98.447
1, 0  acc:  2070 /  2480 =  83.468
1, 1  acc:    73 /   180 =  40.556
------------------------------------
Average acc: 18748 / 19962 =  93.918
Robust  acc:    73 /   180 =  40.556
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9187 /  9767 =  94.062
0, 1  acc:  7418 /  7535 =  98.447
1, 0  acc:  2070 /  2480 =  83.468
1, 1  acc:    73 /   180 =  40.556
------------------------------------
Average acc: 18748 / 19962 =  93.918
Robust  acc:    73 /   180 =  40.556
------------------------------------
Epoch:  33 | Train Loss: 0.002 | Train Acc: 83.222 | Val Loss: 0.001 | Val Acc: 91.106
Training:
Accuracies by groups:
0, 0  acc: 47765 / 51226 =  93.244
0, 1  acc: 46471 / 47327 =  98.191
1, 0  acc: 39288 / 58215 =  67.488
1, 1  acc:  1937 /  6002 =  32.273
--------------------------------------
Average acc: 135461 / 162770 =  83.222
Robust  acc:  1937 /  6002 =  32.273
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7506 /  8535 =  87.944
0, 1  acc:  7877 /  8276 =  95.179
1, 0  acc:  2596 /  2874 =  90.327
1, 1  acc:   121 /   182 =  66.484
------------------------------------
Average acc: 18100 / 19867 =  91.106
Robust  acc:   121 /   182 =  66.484
------------------------------------
New max robust acc: 66.48351648351648
- Saving best checkpoint at epoch 32
replace: True
-> Updating checkpoint cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=31-cpre=-1-cpb=-1.pt...
Checkpoint saved at ./model/celebA/config/cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=32-cpre=-1-cpb=-1.pt
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.065
Robust Acc: 61.667 | Best Acc: 95.209
-------------------------------------
Training, Epoch 32:
Accuracies by groups:
0, 0  acc:  8885 /  9767 =  90.970
0, 1  acc:  7174 /  7535 =  95.209
1, 0  acc:  2208 /  2480 =  89.032
1, 1  acc:   111 /   180 =  61.667
------------------------------------
Average acc: 18378 / 19962 =  92.065
Robust  acc:   111 /   180 =  61.667
------------------------------------
Accuracies by groups:
0, 0  acc:  8885 /  9767 =  90.970
0, 1  acc:  7174 /  7535 =  95.209
1, 0  acc:  2208 /  2480 =  89.032
1, 1  acc:   111 /   180 =  61.667
------------------------------------
Average acc: 18378 / 19962 =  92.065
Robust  acc:   111 /   180 =  61.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8885 /  9767 =  90.970
0, 1  acc:  7174 /  7535 =  95.209
1, 0  acc:  2208 /  2480 =  89.032
1, 1  acc:   111 /   180 =  61.667
------------------------------------
Average acc: 18378 / 19962 =  92.065
Robust  acc:   111 /   180 =  61.667
------------------------------------
Epoch:  34 | Train Loss: 0.002 | Train Acc: 83.588 | Val Loss: 0.001 | Val Acc: 90.497
Training:
Accuracies by groups:
0, 0  acc: 47449 / 51131 =  92.799
0, 1  acc: 46378 / 47216 =  98.225
1, 0  acc: 40222 / 58435 =  68.832
1, 1  acc:  2008 /  5988 =  33.534
--------------------------------------
Average acc: 136057 / 162770 =  83.588
Robust  acc:  2008 /  5988 =  33.534
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8461 /  8535 =  99.133
0, 1  acc:  8270 /  8276 =  99.928
1, 0  acc:  1235 /  2874 =  42.971
1, 1  acc:    13 /   182 =   7.143
------------------------------------
Average acc: 17979 / 19867 =  90.497
Robust  acc:    13 /   182 =   7.143
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.313
Robust Acc: 5.556 | Best Acc: 99.947
------------------------------------
Training, Epoch 33:
Accuracies by groups:
0, 0  acc:  9695 /  9767 =  99.263
0, 1  acc:  7531 /  7535 =  99.947
1, 0  acc:   992 /  2480 =  40.000
1, 1  acc:    10 /   180 =   5.556
------------------------------------
Average acc: 18228 / 19962 =  91.313
Robust  acc:    10 /   180 =   5.556
------------------------------------
Accuracies by groups:
0, 0  acc:  9695 /  9767 =  99.263
0, 1  acc:  7531 /  7535 =  99.947
1, 0  acc:   992 /  2480 =  40.000
1, 1  acc:    10 /   180 =   5.556
------------------------------------
Average acc: 18228 / 19962 =  91.313
Robust  acc:    10 /   180 =   5.556
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9695 /  9767 =  99.263
0, 1  acc:  7531 /  7535 =  99.947
1, 0  acc:   992 /  2480 =  40.000
1, 1  acc:    10 /   180 =   5.556
------------------------------------
Average acc: 18228 / 19962 =  91.313
Robust  acc:    10 /   180 =   5.556
------------------------------------
Epoch:  35 | Train Loss: 0.002 | Train Acc: 84.129 | Val Loss: 0.001 | Val Acc: 90.084
Training:
Accuracies by groups:
0, 0  acc: 47398 / 51298 =  92.397
0, 1  acc: 46219 / 47141 =  98.044
1, 0  acc: 41190 / 58445 =  70.477
1, 1  acc:  2130 /  5886 =  36.188
--------------------------------------
Average acc: 136937 / 162770 =  84.129
Robust  acc:  2130 /  5886 =  36.188
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7275 /  8535 =  85.237
0, 1  acc:  7878 /  8276 =  95.191
1, 0  acc:  2636 /  2874 =  91.719
1, 1  acc:   108 /   182 =  59.341
------------------------------------
Average acc: 17897 / 19867 =  90.084
Robust  acc:   108 /   182 =  59.341
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.278
Robust Acc: 65.000 | Best Acc: 95.169
-------------------------------------
Training, Epoch 34:
Accuracies by groups:
0, 0  acc:  8672 /  9767 =  88.789
0, 1  acc:  7171 /  7535 =  95.169
1, 0  acc:  2261 /  2480 =  91.169
1, 1  acc:   117 /   180 =  65.000
------------------------------------
Average acc: 18221 / 19962 =  91.278
Robust  acc:   117 /   180 =  65.000
------------------------------------
Accuracies by groups:
0, 0  acc:  8672 /  9767 =  88.789
0, 1  acc:  7171 /  7535 =  95.169
1, 0  acc:  2261 /  2480 =  91.169
1, 1  acc:   117 /   180 =  65.000
------------------------------------
Average acc: 18221 / 19962 =  91.278
Robust  acc:   117 /   180 =  65.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8672 /  9767 =  88.789
0, 1  acc:  7171 /  7535 =  95.169
1, 0  acc:  2261 /  2480 =  91.169
1, 1  acc:   117 /   180 =  65.000
------------------------------------
Average acc: 18221 / 19962 =  91.278
Robust  acc:   117 /   180 =  65.000
------------------------------------
Epoch:  36 | Train Loss: 0.002 | Train Acc: 84.429 | Val Loss: 0.001 | Val Acc: 92.762
Training:
Accuracies by groups:
0, 0  acc: 47316 / 51288 =  92.255
0, 1  acc: 46015 / 47029 =  97.844
1, 0  acc: 41796 / 58479 =  71.472
1, 1  acc:  2298 /  5974 =  38.467
--------------------------------------
Average acc: 137425 / 162770 =  84.429
Robust  acc:  2298 /  5974 =  38.467
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8357 /  8535 =  97.914
0, 1  acc:  8255 /  8276 =  99.746
1, 0  acc:  1797 /  2874 =  62.526
1, 1  acc:    20 /   182 =  10.989
------------------------------------
Average acc: 18429 / 19867 =  92.762
Robust  acc:    20 /   182 =  10.989
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.322
Robust Acc: 12.222 | Best Acc: 99.801
-------------------------------------
Training, Epoch 35:
Accuracies by groups:
0, 0  acc:  9607 /  9767 =  98.362
0, 1  acc:  7520 /  7535 =  99.801
1, 0  acc:  1480 /  2480 =  59.677
1, 1  acc:    22 /   180 =  12.222
------------------------------------
Average acc: 18629 / 19962 =  93.322
Robust  acc:    22 /   180 =  12.222
------------------------------------
Accuracies by groups:
0, 0  acc:  9607 /  9767 =  98.362
0, 1  acc:  7520 /  7535 =  99.801
1, 0  acc:  1480 /  2480 =  59.677
1, 1  acc:    22 /   180 =  12.222
------------------------------------
Average acc: 18629 / 19962 =  93.322
Robust  acc:    22 /   180 =  12.222
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9607 /  9767 =  98.362
0, 1  acc:  7520 /  7535 =  99.801
1, 0  acc:  1480 /  2480 =  59.677
1, 1  acc:    22 /   180 =  12.222
------------------------------------
Average acc: 18629 / 19962 =  93.322
Robust  acc:    22 /   180 =  12.222
------------------------------------
Epoch:  37 | Train Loss: 0.002 | Train Acc: 84.830 | Val Loss: 0.002 | Val Acc: 87.336
Training:
Accuracies by groups:
0, 0  acc: 46957 / 51111 =  91.873
0, 1  acc: 46273 / 47379 =  97.666
1, 0  acc: 42487 / 58375 =  72.783
1, 1  acc:  2360 /  5905 =  39.966
--------------------------------------
Average acc: 138077 / 162770 =  84.830
Robust  acc:  2360 /  5905 =  39.966
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6847 /  8535 =  80.223
0, 1  acc:  7661 /  8276 =  92.569
1, 0  acc:  2707 /  2874 =  94.189
1, 1  acc:   136 /   182 =  74.725
------------------------------------
Average acc: 17351 / 19867 =  87.336
Robust  acc:   136 /   182 =  74.725
------------------------------------
New max robust acc: 74.72527472527473
- Saving best checkpoint at epoch 36
replace: True
-> Updating checkpoint cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=32-cpre=-1-cpb=-1.pt...
Checkpoint saved at ./model/celebA/config/cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=36-cpre=-1-cpb=-1.pt
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 88.924
Robust Acc: 73.889 | Best Acc: 93.952
-------------------------------------
Training, Epoch 36:
Accuracies by groups:
0, 0  acc:  8277 /  9767 =  84.745
0, 1  acc:  7011 /  7535 =  93.046
1, 0  acc:  2330 /  2480 =  93.952
1, 1  acc:   133 /   180 =  73.889
------------------------------------
Average acc: 17751 / 19962 =  88.924
Robust  acc:   133 /   180 =  73.889
------------------------------------
Accuracies by groups:
0, 0  acc:  8277 /  9767 =  84.745
0, 1  acc:  7011 /  7535 =  93.046
1, 0  acc:  2330 /  2480 =  93.952
1, 1  acc:   133 /   180 =  73.889
------------------------------------
Average acc: 17751 / 19962 =  88.924
Robust  acc:   133 /   180 =  73.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8277 /  9767 =  84.745
0, 1  acc:  7011 /  7535 =  93.046
1, 0  acc:  2330 /  2480 =  93.952
1, 1  acc:   133 /   180 =  73.889
------------------------------------
Average acc: 17751 / 19962 =  88.924
Robust  acc:   133 /   180 =  73.889
------------------------------------
Epoch:  38 | Train Loss: 0.002 | Train Acc: 85.049 | Val Loss: 0.001 | Val Acc: 91.564
Training:
Accuracies by groups:
0, 0  acc: 46860 / 51127 =  91.654
0, 1  acc: 46218 / 47374 =  97.560
1, 0  acc: 42897 / 58222 =  73.678
1, 1  acc:  2459 /  6047 =  40.665
--------------------------------------
Average acc: 138434 / 162770 =  85.049
Robust  acc:  2459 /  6047 =  40.665
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7471 /  8535 =  87.534
0, 1  acc:  7987 /  8276 =  96.508
1, 0  acc:  2622 /  2874 =  91.232
1, 1  acc:   111 /   182 =  60.989
------------------------------------
Average acc: 18191 / 19867 =  91.564
Robust  acc:   111 /   182 =  60.989
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.736
Robust Acc: 54.444 | Best Acc: 96.894
-------------------------------------
Training, Epoch 37:
Accuracies by groups:
0, 0  acc:  8868 /  9767 =  90.796
0, 1  acc:  7301 /  7535 =  96.894
1, 0  acc:  2245 /  2480 =  90.524
1, 1  acc:    98 /   180 =  54.444
------------------------------------
Average acc: 18512 / 19962 =  92.736
Robust  acc:    98 /   180 =  54.444
------------------------------------
Accuracies by groups:
0, 0  acc:  8868 /  9767 =  90.796
0, 1  acc:  7301 /  7535 =  96.894
1, 0  acc:  2245 /  2480 =  90.524
1, 1  acc:    98 /   180 =  54.444
------------------------------------
Average acc: 18512 / 19962 =  92.736
Robust  acc:    98 /   180 =  54.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8868 /  9767 =  90.796
0, 1  acc:  7301 /  7535 =  96.894
1, 0  acc:  2245 /  2480 =  90.524
1, 1  acc:    98 /   180 =  54.444
------------------------------------
Average acc: 18512 / 19962 =  92.736
Robust  acc:    98 /   180 =  54.444
------------------------------------
Epoch:  39 | Train Loss: 0.002 | Train Acc: 85.266 | Val Loss: 0.002 | Val Acc: 80.651
Training:
Accuracies by groups:
0, 0  acc: 47018 / 51494 =  91.308
0, 1  acc: 46136 / 47345 =  97.446
1, 0  acc: 43162 / 58024 =  74.386
1, 1  acc:  2471 /  5907 =  41.832
--------------------------------------
Average acc: 138787 / 162770 =  85.266
Robust  acc:  2471 /  5907 =  41.832
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6032 /  8535 =  70.674
0, 1  acc:  7005 /  8276 =  84.642
1, 0  acc:  2821 /  2874 =  98.156
1, 1  acc:   165 /   182 =  90.659
------------------------------------
Average acc: 16023 / 19867 =  80.651
Robust  acc:  6032 /  8535 =  70.674
------------------------------------
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 82.392
Robust Acc: 76.359 | Best Acc: 97.540
-------------------------------------
Training, Epoch 38:
Accuracies by groups:
0, 0  acc:  7458 /  9767 =  76.359
0, 1  acc:  6413 /  7535 =  85.109
1, 0  acc:  2419 /  2480 =  97.540
1, 1  acc:   157 /   180 =  87.222
------------------------------------
Average acc: 16447 / 19962 =  82.392
Robust  acc:  7458 /  9767 =  76.359
------------------------------------
Accuracies by groups:
0, 0  acc:  7458 /  9767 =  76.359
0, 1  acc:  6413 /  7535 =  85.109
1, 0  acc:  2419 /  2480 =  97.540
1, 1  acc:   157 /   180 =  87.222
------------------------------------
Average acc: 16447 / 19962 =  82.392
Robust  acc:  7458 /  9767 =  76.359
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  7458 /  9767 =  76.359
0, 1  acc:  6413 /  7535 =  85.109
1, 0  acc:  2419 /  2480 =  97.540
1, 1  acc:   157 /   180 =  87.222
------------------------------------
Average acc: 16447 / 19962 =  82.392
Robust  acc:  7458 /  9767 =  76.359
------------------------------------
Epoch:  40 | Train Loss: 0.002 | Train Acc: 85.690 | Val Loss: 0.001 | Val Acc: 91.473
Training:
Accuracies by groups:
0, 0  acc: 46629 / 51151 =  91.160
0, 1  acc: 46175 / 47353 =  97.512
1, 0  acc: 44141 / 58390 =  75.597
1, 1  acc:  2533 /  5876 =  43.108
--------------------------------------
Average acc: 139478 / 162770 =  85.690
Robust  acc:  2533 /  5876 =  43.108
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7463 /  8535 =  87.440
0, 1  acc:  8059 /  8276 =  97.378
1, 0  acc:  2546 /  2874 =  88.587
1, 1  acc:   105 /   182 =  57.692
------------------------------------
Average acc: 18173 / 19867 =  91.473
Robust  acc:   105 /   182 =  57.692
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.526
Robust Acc: 49.444 | Best Acc: 97.452
-------------------------------------
Training, Epoch 39:
Accuracies by groups:
0, 0  acc:  8836 /  9767 =  90.468
0, 1  acc:  7343 /  7535 =  97.452
1, 0  acc:  2202 /  2480 =  88.790
1, 1  acc:    89 /   180 =  49.444
------------------------------------
Average acc: 18470 / 19962 =  92.526
Robust  acc:    89 /   180 =  49.444
------------------------------------
Accuracies by groups:
0, 0  acc:  8836 /  9767 =  90.468
0, 1  acc:  7343 /  7535 =  97.452
1, 0  acc:  2202 /  2480 =  88.790
1, 1  acc:    89 /   180 =  49.444
------------------------------------
Average acc: 18470 / 19962 =  92.526
Robust  acc:    89 /   180 =  49.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8836 /  9767 =  90.468
0, 1  acc:  7343 /  7535 =  97.452
1, 0  acc:  2202 /  2480 =  88.790
1, 1  acc:    89 /   180 =  49.444
------------------------------------
Average acc: 18470 / 19962 =  92.526
Robust  acc:    89 /   180 =  49.444
------------------------------------
Epoch:  41 | Train Loss: 0.002 | Train Acc: 85.787 | Val Loss: 0.001 | Val Acc: 93.557
Training:
Accuracies by groups:
0, 0  acc: 46202 / 50860 =  90.842
0, 1  acc: 46287 / 47597 =  97.248
1, 0  acc: 44429 / 58255 =  76.266
1, 1  acc:  2718 /  6058 =  44.866
--------------------------------------
Average acc: 139636 / 162770 =  85.787
Robust  acc:  2718 /  6058 =  44.866
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8116 /  8535 =  95.091
0, 1  acc:  8213 /  8276 =  99.239
1, 0  acc:  2209 /  2874 =  76.862
1, 1  acc:    49 /   182 =  26.923
------------------------------------
Average acc: 18587 / 19867 =  93.557
Robust  acc:    49 /   182 =  26.923
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.209
Robust Acc: 25.000 | Best Acc: 99.469
-------------------------------------
Training, Epoch 40:
Accuracies by groups:
0, 0  acc:  9408 /  9767 =  96.324
0, 1  acc:  7495 /  7535 =  99.469
1, 0  acc:  1858 /  2480 =  74.919
1, 1  acc:    45 /   180 =  25.000
------------------------------------
Average acc: 18806 / 19962 =  94.209
Robust  acc:    45 /   180 =  25.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9408 /  9767 =  96.324
0, 1  acc:  7495 /  7535 =  99.469
1, 0  acc:  1858 /  2480 =  74.919
1, 1  acc:    45 /   180 =  25.000
------------------------------------
Average acc: 18806 / 19962 =  94.209
Robust  acc:    45 /   180 =  25.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9408 /  9767 =  96.324
0, 1  acc:  7495 /  7535 =  99.469
1, 0  acc:  1858 /  2480 =  74.919
1, 1  acc:    45 /   180 =  25.000
------------------------------------
Average acc: 18806 / 19962 =  94.209
Robust  acc:    45 /   180 =  25.000
------------------------------------
Epoch:  42 | Train Loss: 0.002 | Train Acc: 86.295 | Val Loss: 0.001 | Val Acc: 92.676
Training:
Accuracies by groups:
0, 0  acc: 46426 / 51185 =  90.702
0, 1  acc: 46223 / 47493 =  97.326
1, 0  acc: 44980 / 58069 =  77.460
1, 1  acc:  2833 /  6023 =  47.036
--------------------------------------
Average acc: 140462 / 162770 =  86.295
Robust  acc:  2833 /  6023 =  47.036
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7689 /  8535 =  90.088
0, 1  acc:  8115 /  8276 =  98.055
1, 0  acc:  2518 /  2874 =  87.613
1, 1  acc:    90 /   182 =  49.451
------------------------------------
Average acc: 18412 / 19867 =  92.676
Robust  acc:    90 /   182 =  49.451
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.553
Robust Acc: 45.000 | Best Acc: 98.341
-------------------------------------
Training, Epoch 41:
Accuracies by groups:
0, 0  acc:  9011 /  9767 =  92.260
0, 1  acc:  7410 /  7535 =  98.341
1, 0  acc:  2173 /  2480 =  87.621
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18675 / 19962 =  93.553
Robust  acc:    81 /   180 =  45.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9011 /  9767 =  92.260
0, 1  acc:  7410 /  7535 =  98.341
1, 0  acc:  2173 /  2480 =  87.621
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18675 / 19962 =  93.553
Robust  acc:    81 /   180 =  45.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9011 /  9767 =  92.260
0, 1  acc:  7410 /  7535 =  98.341
1, 0  acc:  2173 /  2480 =  87.621
1, 1  acc:    81 /   180 =  45.000
------------------------------------
Average acc: 18675 / 19962 =  93.553
Robust  acc:    81 /   180 =  45.000
------------------------------------
Epoch:  43 | Train Loss: 0.002 | Train Acc: 86.424 | Val Loss: 0.001 | Val Acc: 93.779
Training:
Accuracies by groups:
0, 0  acc: 46481 / 51279 =  90.643
0, 1  acc: 46078 / 47488 =  97.031
1, 0  acc: 45343 / 58017 =  78.155
1, 1  acc:  2770 /  5986 =  46.275
--------------------------------------
Average acc: 140672 / 162770 =  86.424
Robust  acc:  2770 /  5986 =  46.275
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8165 /  8535 =  95.665
0, 1  acc:  8219 /  8276 =  99.311
1, 0  acc:  2193 /  2874 =  76.305
1, 1  acc:    54 /   182 =  29.670
------------------------------------
Average acc: 18631 / 19867 =  93.779
Robust  acc:    54 /   182 =  29.670
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.334
Robust Acc: 27.778 | Best Acc: 99.443
-------------------------------------
Training, Epoch 42:
Accuracies by groups:
0, 0  acc:  9434 /  9767 =  96.591
0, 1  acc:  7493 /  7535 =  99.443
1, 0  acc:  1854 /  2480 =  74.758
1, 1  acc:    50 /   180 =  27.778
------------------------------------
Average acc: 18831 / 19962 =  94.334
Robust  acc:    50 /   180 =  27.778
------------------------------------
Accuracies by groups:
0, 0  acc:  9434 /  9767 =  96.591
0, 1  acc:  7493 /  7535 =  99.443
1, 0  acc:  1854 /  2480 =  74.758
1, 1  acc:    50 /   180 =  27.778
------------------------------------
Average acc: 18831 / 19962 =  94.334
Robust  acc:    50 /   180 =  27.778
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9434 /  9767 =  96.591
0, 1  acc:  7493 /  7535 =  99.443
1, 0  acc:  1854 /  2480 =  74.758
1, 1  acc:    50 /   180 =  27.778
------------------------------------
Average acc: 18831 / 19962 =  94.334
Robust  acc:    50 /   180 =  27.778
------------------------------------
Epoch:  44 | Train Loss: 0.002 | Train Acc: 86.450 | Val Loss: 0.001 | Val Acc: 93.743
Training:
Accuracies by groups:
0, 0  acc: 46425 / 51458 =  90.219
0, 1  acc: 45976 / 47392 =  97.012
1, 0  acc: 45349 / 57910 =  78.309
1, 1  acc:  2965 /  6010 =  49.334
--------------------------------------
Average acc: 140715 / 162770 =  86.450
Robust  acc:  2965 /  6010 =  49.334
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8061 /  8535 =  94.446
0, 1  acc:  8176 /  8276 =  98.792
1, 0  acc:  2321 /  2874 =  80.759
1, 1  acc:    66 /   182 =  36.264
------------------------------------
Average acc: 18624 / 19867 =  93.743
Robust  acc:    66 /   182 =  36.264
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.334
Robust Acc: 33.333 | Best Acc: 99.164
-------------------------------------
Training, Epoch 43:
Accuracies by groups:
0, 0  acc:  9330 /  9767 =  95.526
0, 1  acc:  7472 /  7535 =  99.164
1, 0  acc:  1969 /  2480 =  79.395
1, 1  acc:    60 /   180 =  33.333
------------------------------------
Average acc: 18831 / 19962 =  94.334
Robust  acc:    60 /   180 =  33.333
------------------------------------
Accuracies by groups:
0, 0  acc:  9330 /  9767 =  95.526
0, 1  acc:  7472 /  7535 =  99.164
1, 0  acc:  1969 /  2480 =  79.395
1, 1  acc:    60 /   180 =  33.333
------------------------------------
Average acc: 18831 / 19962 =  94.334
Robust  acc:    60 /   180 =  33.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9330 /  9767 =  95.526
0, 1  acc:  7472 /  7535 =  99.164
1, 0  acc:  1969 /  2480 =  79.395
1, 1  acc:    60 /   180 =  33.333
------------------------------------
Average acc: 18831 / 19962 =  94.334
Robust  acc:    60 /   180 =  33.333
------------------------------------
Epoch:  45 | Train Loss: 0.002 | Train Acc: 86.717 | Val Loss: 0.002 | Val Acc: 88.287
Training:
Accuracies by groups:
0, 0  acc: 46253 / 51242 =  90.264
0, 1  acc: 45739 / 47153 =  97.001
1, 0  acc: 46251 / 58426 =  79.162
1, 1  acc:  2907 /  5949 =  48.865
--------------------------------------
Average acc: 141150 / 162770 =  86.717
Robust  acc:  2907 /  5949 =  48.865
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7149 /  8535 =  83.761
0, 1  acc:  7551 /  8276 =  91.240
1, 0  acc:  2703 /  2874 =  94.050
1, 1  acc:   137 /   182 =  75.275
------------------------------------
Average acc: 17540 / 19867 =  88.287
Robust  acc:   137 /   182 =  75.275
------------------------------------
New max robust acc: 75.27472527472527
- Saving best checkpoint at epoch 44
replace: True
-> Updating checkpoint cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=36-cpre=-1-cpb=-1.pt...
Checkpoint saved at ./model/celebA/config/cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=44-cpre=-1-cpb=-1.pt
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 89.420
Robust Acc: 76.667 | Best Acc: 93.065
-------------------------------------
Training, Epoch 44:
Accuracies by groups:
0, 0  acc:  8534 /  9767 =  87.376
0, 1  acc:  6870 /  7535 =  91.175
1, 0  acc:  2308 /  2480 =  93.065
1, 1  acc:   138 /   180 =  76.667
------------------------------------
Average acc: 17850 / 19962 =  89.420
Robust  acc:   138 /   180 =  76.667
------------------------------------
Accuracies by groups:
0, 0  acc:  8534 /  9767 =  87.376
0, 1  acc:  6870 /  7535 =  91.175
1, 0  acc:  2308 /  2480 =  93.065
1, 1  acc:   138 /   180 =  76.667
------------------------------------
Average acc: 17850 / 19962 =  89.420
Robust  acc:   138 /   180 =  76.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8534 /  9767 =  87.376
0, 1  acc:  6870 /  7535 =  91.175
1, 0  acc:  2308 /  2480 =  93.065
1, 1  acc:   138 /   180 =  76.667
------------------------------------
Average acc: 17850 / 19962 =  89.420
Robust  acc:   138 /   180 =  76.667
------------------------------------
Epoch:  46 | Train Loss: 0.002 | Train Acc: 86.800 | Val Loss: 0.001 | Val Acc: 93.743
Training:
Accuracies by groups:
0, 0  acc: 45796 / 51015 =  89.770
0, 1  acc: 46110 / 47631 =  96.807
1, 0  acc: 46367 / 58192 =  79.679
1, 1  acc:  3012 /  5932 =  50.775
--------------------------------------
Average acc: 141285 / 162770 =  86.800
Robust  acc:  3012 /  5932 =  50.775
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8196 /  8535 =  96.028
0, 1  acc:  8227 /  8276 =  99.408
1, 0  acc:  2159 /  2874 =  75.122
1, 1  acc:    42 /   182 =  23.077
------------------------------------
Average acc: 18624 / 19867 =  93.743
Robust  acc:    42 /   182 =  23.077
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.439
Robust Acc: 23.889 | Best Acc: 99.655
-------------------------------------
Training, Epoch 45:
Accuracies by groups:
0, 0  acc:  9487 /  9767 =  97.133
0, 1  acc:  7509 /  7535 =  99.655
1, 0  acc:  1813 /  2480 =  73.105
1, 1  acc:    43 /   180 =  23.889
------------------------------------
Average acc: 18852 / 19962 =  94.439
Robust  acc:    43 /   180 =  23.889
------------------------------------
Accuracies by groups:
0, 0  acc:  9487 /  9767 =  97.133
0, 1  acc:  7509 /  7535 =  99.655
1, 0  acc:  1813 /  2480 =  73.105
1, 1  acc:    43 /   180 =  23.889
------------------------------------
Average acc: 18852 / 19962 =  94.439
Robust  acc:    43 /   180 =  23.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9487 /  9767 =  97.133
0, 1  acc:  7509 /  7535 =  99.655
1, 0  acc:  1813 /  2480 =  73.105
1, 1  acc:    43 /   180 =  23.889
------------------------------------
Average acc: 18852 / 19962 =  94.439
Robust  acc:    43 /   180 =  23.889
------------------------------------
Epoch:  47 | Train Loss: 0.002 | Train Acc: 86.956 | Val Loss: 0.001 | Val Acc: 93.356
Training:
Accuracies by groups:
0, 0  acc: 46134 / 51251 =  90.016
0, 1  acc: 45766 / 47313 =  96.730
1, 0  acc: 46634 / 58260 =  80.045
1, 1  acc:  3005 /  5946 =  50.538
--------------------------------------
Average acc: 141539 / 162770 =  86.956
Robust  acc:  3005 /  5946 =  50.538
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8279 /  8535 =  97.001
0, 1  acc:  8246 /  8276 =  99.638
1, 0  acc:  1985 /  2874 =  69.068
1, 1  acc:    37 /   182 =  20.330
------------------------------------
Average acc: 18547 / 19867 =  93.356
Robust  acc:    37 /   182 =  20.330
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.989
Robust Acc: 18.333 | Best Acc: 99.774
-------------------------------------
Training, Epoch 46:
Accuracies by groups:
0, 0  acc:  9551 /  9767 =  97.788
0, 1  acc:  7518 /  7535 =  99.774
1, 0  acc:  1660 /  2480 =  66.935
1, 1  acc:    33 /   180 =  18.333
------------------------------------
Average acc: 18762 / 19962 =  93.989
Robust  acc:    33 /   180 =  18.333
------------------------------------
Accuracies by groups:
0, 0  acc:  9551 /  9767 =  97.788
0, 1  acc:  7518 /  7535 =  99.774
1, 0  acc:  1660 /  2480 =  66.935
1, 1  acc:    33 /   180 =  18.333
------------------------------------
Average acc: 18762 / 19962 =  93.989
Robust  acc:    33 /   180 =  18.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9551 /  9767 =  97.788
0, 1  acc:  7518 /  7535 =  99.774
1, 0  acc:  1660 /  2480 =  66.935
1, 1  acc:    33 /   180 =  18.333
------------------------------------
Average acc: 18762 / 19962 =  93.989
Robust  acc:    33 /   180 =  18.333
------------------------------------
Epoch:  48 | Train Loss: 0.002 | Train Acc: 87.227 | Val Loss: 0.001 | Val Acc: 93.401
Training:
Accuracies by groups:
0, 0  acc: 45982 / 51238 =  89.742
0, 1  acc: 45957 / 47520 =  96.711
1, 0  acc: 46994 / 58162 =  80.798
1, 1  acc:  3047 /  5850 =  52.085
--------------------------------------
Average acc: 141980 / 162770 =  87.227
Robust  acc:  3047 /  5850 =  52.085
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8152 /  8535 =  95.513
0, 1  acc:  8229 /  8276 =  99.432
1, 0  acc:  2138 /  2874 =  74.391
1, 1  acc:    37 /   182 =  20.330
------------------------------------
Average acc: 18556 / 19867 =  93.401
Robust  acc:    37 /   182 =  20.330
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.234
Robust Acc: 24.444 | Best Acc: 99.536
-------------------------------------
Training, Epoch 47:
Accuracies by groups:
0, 0  acc:  9432 /  9767 =  96.570
0, 1  acc:  7500 /  7535 =  99.536
1, 0  acc:  1835 /  2480 =  73.992
1, 1  acc:    44 /   180 =  24.444
------------------------------------
Average acc: 18811 / 19962 =  94.234
Robust  acc:    44 /   180 =  24.444
------------------------------------
Accuracies by groups:
0, 0  acc:  9432 /  9767 =  96.570
0, 1  acc:  7500 /  7535 =  99.536
1, 0  acc:  1835 /  2480 =  73.992
1, 1  acc:    44 /   180 =  24.444
------------------------------------
Average acc: 18811 / 19962 =  94.234
Robust  acc:    44 /   180 =  24.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9432 /  9767 =  96.570
0, 1  acc:  7500 /  7535 =  99.536
1, 0  acc:  1835 /  2480 =  73.992
1, 1  acc:    44 /   180 =  24.444
------------------------------------
Average acc: 18811 / 19962 =  94.234
Robust  acc:    44 /   180 =  24.444
------------------------------------
Epoch:  49 | Train Loss: 0.002 | Train Acc: 87.224 | Val Loss: 0.001 | Val Acc: 93.467
Training:
Accuracies by groups:
0, 0  acc: 45718 / 51006 =  89.633
0, 1  acc: 45817 / 47444 =  96.571
1, 0  acc: 47228 / 58268 =  81.053
1, 1  acc:  3212 /  6052 =  53.073
--------------------------------------
Average acc: 141975 / 162770 =  87.224
Robust  acc:  3212 /  6052 =  53.073
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8254 /  8535 =  96.708
0, 1  acc:  8236 /  8276 =  99.517
1, 0  acc:  2033 /  2874 =  70.738
1, 1  acc:    46 /   182 =  25.275
------------------------------------
Average acc: 18569 / 19867 =  93.467
Robust  acc:    46 /   182 =  25.275
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.994
Robust Acc: 27.222 | Best Acc: 99.655
-------------------------------------
Training, Epoch 48:
Accuracies by groups:
0, 0  acc:  9546 /  9767 =  97.737
0, 1  acc:  7509 /  7535 =  99.655
1, 0  acc:  1659 /  2480 =  66.895
1, 1  acc:    49 /   180 =  27.222
------------------------------------
Average acc: 18763 / 19962 =  93.994
Robust  acc:    49 /   180 =  27.222
------------------------------------
Accuracies by groups:
0, 0  acc:  9546 /  9767 =  97.737
0, 1  acc:  7509 /  7535 =  99.655
1, 0  acc:  1659 /  2480 =  66.895
1, 1  acc:    49 /   180 =  27.222
------------------------------------
Average acc: 18763 / 19962 =  93.994
Robust  acc:    49 /   180 =  27.222
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9546 /  9767 =  97.737
0, 1  acc:  7509 /  7535 =  99.655
1, 0  acc:  1659 /  2480 =  66.895
1, 1  acc:    49 /   180 =  27.222
------------------------------------
Average acc: 18763 / 19962 =  93.994
Robust  acc:    49 /   180 =  27.222
------------------------------------
Epoch:  50 | Train Loss: 0.002 | Train Acc: 87.437 | Val Loss: 0.001 | Val Acc: 87.155
Training:
Accuracies by groups:
0, 0  acc: 45729 / 51146 =  89.409
0, 1  acc: 45773 / 47416 =  96.535
1, 0  acc: 47586 / 58255 =  81.686
1, 1  acc:  3233 /  5953 =  54.309
--------------------------------------
Average acc: 142321 / 162770 =  87.437
Robust  acc:  3233 /  5953 =  54.309
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6821 /  8535 =  79.918
0, 1  acc:  7569 /  8276 =  91.457
1, 0  acc:  2773 /  2874 =  96.486
1, 1  acc:   152 /   182 =  83.516
------------------------------------
Average acc: 17315 / 19867 =  87.155
Robust  acc:  6821 /  8535 =  79.918
------------------------------------
New max robust acc: 79.91798476859988
- Saving best checkpoint at epoch 49
replace: True
-> Updating checkpoint cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=44-cpre=-1-cpb=-1.pt...
Checkpoint saved at ./model/celebA/config/cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=49-cpre=-1-cpb=-1.pt
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 88.879
Robust Acc: 81.667 | Best Acc: 96.129
-------------------------------------
Training, Epoch 49:
Accuracies by groups:
0, 0  acc:  8260 /  9767 =  84.570
0, 1  acc:  6951 /  7535 =  92.250
1, 0  acc:  2384 /  2480 =  96.129
1, 1  acc:   147 /   180 =  81.667
------------------------------------
Average acc: 17742 / 19962 =  88.879
Robust  acc:   147 /   180 =  81.667
------------------------------------
Accuracies by groups:
0, 0  acc:  8260 /  9767 =  84.570
0, 1  acc:  6951 /  7535 =  92.250
1, 0  acc:  2384 /  2480 =  96.129
1, 1  acc:   147 /   180 =  81.667
------------------------------------
Average acc: 17742 / 19962 =  88.879
Robust  acc:   147 /   180 =  81.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8260 /  9767 =  84.570
0, 1  acc:  6951 /  7535 =  92.250
1, 0  acc:  2384 /  2480 =  96.129
1, 1  acc:   147 /   180 =  81.667
------------------------------------
Average acc: 17742 / 19962 =  88.879
Robust  acc:   147 /   180 =  81.667
------------------------------------
Epoch:  51 | Train Loss: 0.002 | Train Acc: 87.525 | Val Loss: 0.001 | Val Acc: 93.774
Training:
Accuracies by groups:
0, 0  acc: 45878 / 51353 =  89.339
0, 1  acc: 45527 / 47191 =  96.474
1, 0  acc: 47806 / 58258 =  82.059
1, 1  acc:  3254 /  5968 =  54.524
--------------------------------------
Average acc: 142465 / 162770 =  87.525
Robust  acc:  3254 /  5968 =  54.524
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8062 /  8535 =  94.458
0, 1  acc:  8175 /  8276 =  98.780
1, 0  acc:  2321 /  2874 =  80.759
1, 1  acc:    72 /   182 =  39.560
------------------------------------
Average acc: 18630 / 19867 =  93.774
Robust  acc:    72 /   182 =  39.560
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.364
Robust Acc: 38.889 | Best Acc: 99.190
-------------------------------------
Training, Epoch 50:
Accuracies by groups:
0, 0  acc:  9371 /  9767 =  95.946
0, 1  acc:  7474 /  7535 =  99.190
1, 0  acc:  1922 /  2480 =  77.500
1, 1  acc:    70 /   180 =  38.889
------------------------------------
Average acc: 18837 / 19962 =  94.364
Robust  acc:    70 /   180 =  38.889
------------------------------------
Accuracies by groups:
0, 0  acc:  9371 /  9767 =  95.946
0, 1  acc:  7474 /  7535 =  99.190
1, 0  acc:  1922 /  2480 =  77.500
1, 1  acc:    70 /   180 =  38.889
------------------------------------
Average acc: 18837 / 19962 =  94.364
Robust  acc:    70 /   180 =  38.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9371 /  9767 =  95.946
0, 1  acc:  7474 /  7535 =  99.190
1, 0  acc:  1922 /  2480 =  77.500
1, 1  acc:    70 /   180 =  38.889
------------------------------------
Average acc: 18837 / 19962 =  94.364
Robust  acc:    70 /   180 =  38.889
------------------------------------
Epoch:  52 | Train Loss: 0.002 | Train Acc: 87.688 | Val Loss: 0.002 | Val Acc: 82.997
Training:
Accuracies by groups:
0, 0  acc: 45329 / 50918 =  89.024
0, 1  acc: 45791 / 47511 =  96.380
1, 0  acc: 48292 / 58374 =  82.729
1, 1  acc:  3317 /  5967 =  55.589
--------------------------------------
Average acc: 142729 / 162770 =  87.688
Robust  acc:  3317 /  5967 =  55.589
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6184 /  8535 =  72.455
0, 1  acc:  7336 /  8276 =  88.642
1, 0  acc:  2809 /  2874 =  97.738
1, 1  acc:   160 /   182 =  87.912
------------------------------------
Average acc: 16489 / 19867 =  82.997
Robust  acc:  6184 /  8535 =  72.455
------------------------------------
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 84.746
Robust Acc: 77.659 | Best Acc: 96.976
-------------------------------------
Training, Epoch 51:
Accuracies by groups:
0, 0  acc:  7585 /  9767 =  77.659
0, 1  acc:  6778 /  7535 =  89.954
1, 0  acc:  2405 /  2480 =  96.976
1, 1  acc:   149 /   180 =  82.778
------------------------------------
Average acc: 16917 / 19962 =  84.746
Robust  acc:  7585 /  9767 =  77.659
------------------------------------
Accuracies by groups:
0, 0  acc:  7585 /  9767 =  77.659
0, 1  acc:  6778 /  7535 =  89.954
1, 0  acc:  2405 /  2480 =  96.976
1, 1  acc:   149 /   180 =  82.778
------------------------------------
Average acc: 16917 / 19962 =  84.746
Robust  acc:  7585 /  9767 =  77.659
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  7585 /  9767 =  77.659
0, 1  acc:  6778 /  7535 =  89.954
1, 0  acc:  2405 /  2480 =  96.976
1, 1  acc:   149 /   180 =  82.778
------------------------------------
Average acc: 16917 / 19962 =  84.746
Robust  acc:  7585 /  9767 =  77.659
------------------------------------
Epoch:  53 | Train Loss: 0.002 | Train Acc: 87.602 | Val Loss: 0.001 | Val Acc: 93.019
Training:
Accuracies by groups:
0, 0  acc: 45530 / 51260 =  88.822
0, 1  acc: 45591 / 47349 =  96.287
1, 0  acc: 48067 / 58150 =  82.660
1, 1  acc:  3401 /  6011 =  56.580
--------------------------------------
Average acc: 142589 / 162770 =  87.602
Robust  acc:  3401 /  6011 =  56.580
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7728 /  8535 =  90.545
0, 1  acc:  8092 /  8276 =  97.777
1, 0  acc:  2558 /  2874 =  89.005
1, 1  acc:   102 /   182 =  56.044
------------------------------------
Average acc: 18480 / 19867 =  93.019
Robust  acc:   102 /   182 =  56.044
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.608
Robust Acc: 48.333 | Best Acc: 97.983
-------------------------------------
Training, Epoch 52:
Accuracies by groups:
0, 0  acc:  9029 /  9767 =  92.444
0, 1  acc:  7383 /  7535 =  97.983
1, 0  acc:  2187 /  2480 =  88.185
1, 1  acc:    87 /   180 =  48.333
------------------------------------
Average acc: 18686 / 19962 =  93.608
Robust  acc:    87 /   180 =  48.333
------------------------------------
Accuracies by groups:
0, 0  acc:  9029 /  9767 =  92.444
0, 1  acc:  7383 /  7535 =  97.983
1, 0  acc:  2187 /  2480 =  88.185
1, 1  acc:    87 /   180 =  48.333
------------------------------------
Average acc: 18686 / 19962 =  93.608
Robust  acc:    87 /   180 =  48.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9029 /  9767 =  92.444
0, 1  acc:  7383 /  7535 =  97.983
1, 0  acc:  2187 /  2480 =  88.185
1, 1  acc:    87 /   180 =  48.333
------------------------------------
Average acc: 18686 / 19962 =  93.608
Robust  acc:    87 /   180 =  48.333
------------------------------------
Epoch:  54 | Train Loss: 0.002 | Train Acc: 87.777 | Val Loss: 0.002 | Val Acc: 82.307
Training:
Accuracies by groups:
0, 0  acc: 45279 / 51040 =  88.713
0, 1  acc: 45704 / 47376 =  96.471
1, 0  acc: 48585 / 58404 =  83.188
1, 1  acc:  3306 /  5950 =  55.563
--------------------------------------
Average acc: 142874 / 162770 =  87.777
Robust  acc:  3306 /  5950 =  55.563
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6280 /  8535 =  73.579
0, 1  acc:  7077 /  8276 =  85.512
1, 0  acc:  2830 /  2874 =  98.469
1, 1  acc:   165 /   182 =  90.659
------------------------------------
Average acc: 16352 / 19867 =  82.307
Robust  acc:  6280 /  8535 =  73.579
------------------------------------
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 84.255
Robust Acc: 79.072 | Best Acc: 98.065
-------------------------------------
Training, Epoch 53:
Accuracies by groups:
0, 0  acc:  7723 /  9767 =  79.072
0, 1  acc:  6504 /  7535 =  86.317
1, 0  acc:  2432 /  2480 =  98.065
1, 1  acc:   160 /   180 =  88.889
------------------------------------
Average acc: 16819 / 19962 =  84.255
Robust  acc:  7723 /  9767 =  79.072
------------------------------------
Accuracies by groups:
0, 0  acc:  7723 /  9767 =  79.072
0, 1  acc:  6504 /  7535 =  86.317
1, 0  acc:  2432 /  2480 =  98.065
1, 1  acc:   160 /   180 =  88.889
------------------------------------
Average acc: 16819 / 19962 =  84.255
Robust  acc:  7723 /  9767 =  79.072
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  7723 /  9767 =  79.072
0, 1  acc:  6504 /  7535 =  86.317
1, 0  acc:  2432 /  2480 =  98.065
1, 1  acc:   160 /   180 =  88.889
------------------------------------
Average acc: 16819 / 19962 =  84.255
Robust  acc:  7723 /  9767 =  79.072
------------------------------------
Epoch:  55 | Train Loss: 0.002 | Train Acc: 87.730 | Val Loss: 0.001 | Val Acc: 93.884
Training:
Accuracies by groups:
0, 0  acc: 45162 / 51051 =  88.464
0, 1  acc: 45495 / 47259 =  96.267
1, 0  acc: 48804 / 58528 =  83.386
1, 1  acc:  3337 /  5932 =  56.254
--------------------------------------
Average acc: 142798 / 162770 =  87.730
Robust  acc:  3337 /  5932 =  56.254
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8021 /  8535 =  93.978
0, 1  acc:  8174 /  8276 =  98.768
1, 0  acc:  2385 /  2874 =  82.985
1, 1  acc:    72 /   182 =  39.560
------------------------------------
Average acc: 18652 / 19867 =  93.884
Robust  acc:    72 /   182 =  39.560
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.565
Robust Acc: 38.333 | Best Acc: 98.912
-------------------------------------
Training, Epoch 54:
Accuracies by groups:
0, 0  acc:  9353 /  9767 =  95.761
0, 1  acc:  7453 /  7535 =  98.912
1, 0  acc:  2002 /  2480 =  80.726
1, 1  acc:    69 /   180 =  38.333
------------------------------------
Average acc: 18877 / 19962 =  94.565
Robust  acc:    69 /   180 =  38.333
------------------------------------
Accuracies by groups:
0, 0  acc:  9353 /  9767 =  95.761
0, 1  acc:  7453 /  7535 =  98.912
1, 0  acc:  2002 /  2480 =  80.726
1, 1  acc:    69 /   180 =  38.333
------------------------------------
Average acc: 18877 / 19962 =  94.565
Robust  acc:    69 /   180 =  38.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9353 /  9767 =  95.761
0, 1  acc:  7453 /  7535 =  98.912
1, 0  acc:  2002 /  2480 =  80.726
1, 1  acc:    69 /   180 =  38.333
------------------------------------
Average acc: 18877 / 19962 =  94.565
Robust  acc:    69 /   180 =  38.333
------------------------------------
Epoch:  56 | Train Loss: 0.002 | Train Acc: 88.048 | Val Loss: 0.001 | Val Acc: 91.559
Training:
Accuracies by groups:
0, 0  acc: 45286 / 51195 =  88.458
0, 1  acc: 45985 / 47829 =  96.145
1, 0  acc: 48588 / 57808 =  84.051
1, 1  acc:  3456 /  5938 =  58.201
--------------------------------------
Average acc: 143315 / 162770 =  88.048
Robust  acc:  3456 /  5938 =  58.201
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7472 /  8535 =  87.545
0, 1  acc:  7910 /  8276 =  95.578
1, 0  acc:  2676 /  2874 =  93.111
1, 1  acc:   132 /   182 =  72.527
------------------------------------
Average acc: 18190 / 19867 =  91.559
Robust  acc:   132 /   182 =  72.527
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.516
Robust Acc: 63.889 | Best Acc: 95.886
-------------------------------------
Training, Epoch 55:
Accuracies by groups:
0, 0  acc:  8844 /  9767 =  90.550
0, 1  acc:  7225 /  7535 =  95.886
1, 0  acc:  2284 /  2480 =  92.097
1, 1  acc:   115 /   180 =  63.889
------------------------------------
Average acc: 18468 / 19962 =  92.516
Robust  acc:   115 /   180 =  63.889
------------------------------------
Accuracies by groups:
0, 0  acc:  8844 /  9767 =  90.550
0, 1  acc:  7225 /  7535 =  95.886
1, 0  acc:  2284 /  2480 =  92.097
1, 1  acc:   115 /   180 =  63.889
------------------------------------
Average acc: 18468 / 19962 =  92.516
Robust  acc:   115 /   180 =  63.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8844 /  9767 =  90.550
0, 1  acc:  7225 /  7535 =  95.886
1, 0  acc:  2284 /  2480 =  92.097
1, 1  acc:   115 /   180 =  63.889
------------------------------------
Average acc: 18468 / 19962 =  92.516
Robust  acc:   115 /   180 =  63.889
------------------------------------
Epoch:  57 | Train Loss: 0.002 | Train Acc: 88.027 | Val Loss: 0.001 | Val Acc: 93.446
Training:
Accuracies by groups:
0, 0  acc: 45135 / 51023 =  88.460
0, 1  acc: 45657 / 47512 =  96.096
1, 0  acc: 49111 / 58308 =  84.227
1, 1  acc:  3378 /  5927 =  56.993
--------------------------------------
Average acc: 143281 / 162770 =  88.027
Robust  acc:  3378 /  5927 =  56.993
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7799 /  8535 =  91.377
0, 1  acc:  8127 /  8276 =  98.200
1, 0  acc:  2545 /  2874 =  88.553
1, 1  acc:    94 /   182 =  51.648
------------------------------------
Average acc: 18565 / 19867 =  93.446
Robust  acc:    94 /   182 =  51.648
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.154
Robust Acc: 49.444 | Best Acc: 98.474
-------------------------------------
Training, Epoch 56:
Accuracies by groups:
0, 0  acc:  9124 /  9767 =  93.417
0, 1  acc:  7420 /  7535 =  98.474
1, 0  acc:  2162 /  2480 =  87.177
1, 1  acc:    89 /   180 =  49.444
------------------------------------
Average acc: 18795 / 19962 =  94.154
Robust  acc:    89 /   180 =  49.444
------------------------------------
Accuracies by groups:
0, 0  acc:  9124 /  9767 =  93.417
0, 1  acc:  7420 /  7535 =  98.474
1, 0  acc:  2162 /  2480 =  87.177
1, 1  acc:    89 /   180 =  49.444
------------------------------------
Average acc: 18795 / 19962 =  94.154
Robust  acc:    89 /   180 =  49.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9124 /  9767 =  93.417
0, 1  acc:  7420 /  7535 =  98.474
1, 0  acc:  2162 /  2480 =  87.177
1, 1  acc:    89 /   180 =  49.444
------------------------------------
Average acc: 18795 / 19962 =  94.154
Robust  acc:    89 /   180 =  49.444
------------------------------------
Epoch:  58 | Train Loss: 0.002 | Train Acc: 88.136 | Val Loss: 0.001 | Val Acc: 91.906
Training:
Accuracies by groups:
0, 0  acc: 45429 / 51299 =  88.557
0, 1  acc: 45352 / 47209 =  96.066
1, 0  acc: 49143 / 58253 =  84.361
1, 1  acc:  3535 /  6009 =  58.828
--------------------------------------
Average acc: 143459 / 162770 =  88.136
Robust  acc:  3535 /  6009 =  58.828
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7480 /  8535 =  87.639
0, 1  acc:  7999 /  8276 =  96.653
1, 0  acc:  2658 /  2874 =  92.484
1, 1  acc:   122 /   182 =  67.033
------------------------------------
Average acc: 18259 / 19867 =  91.906
Robust  acc:   122 /   182 =  67.033
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.766
Robust Acc: 58.889 | Best Acc: 96.762
-------------------------------------
Training, Epoch 57:
Accuracies by groups:
0, 0  acc:  8849 /  9767 =  90.601
0, 1  acc:  7291 /  7535 =  96.762
1, 0  acc:  2272 /  2480 =  91.613
1, 1  acc:   106 /   180 =  58.889
------------------------------------
Average acc: 18518 / 19962 =  92.766
Robust  acc:   106 /   180 =  58.889
------------------------------------
Accuracies by groups:
0, 0  acc:  8849 /  9767 =  90.601
0, 1  acc:  7291 /  7535 =  96.762
1, 0  acc:  2272 /  2480 =  91.613
1, 1  acc:   106 /   180 =  58.889
------------------------------------
Average acc: 18518 / 19962 =  92.766
Robust  acc:   106 /   180 =  58.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8849 /  9767 =  90.601
0, 1  acc:  7291 /  7535 =  96.762
1, 0  acc:  2272 /  2480 =  91.613
1, 1  acc:   106 /   180 =  58.889
------------------------------------
Average acc: 18518 / 19962 =  92.766
Robust  acc:   106 /   180 =  58.889
------------------------------------
Epoch:  59 | Train Loss: 0.002 | Train Acc: 88.366 | Val Loss: 0.001 | Val Acc: 92.822
Training:
Accuracies by groups:
0, 0  acc: 45207 / 51004 =  88.634
0, 1  acc: 45404 / 47242 =  96.109
1, 0  acc: 49763 / 58629 =  84.878
1, 1  acc:  3460 /  5895 =  58.694
--------------------------------------
Average acc: 143834 / 162770 =  88.366
Robust  acc:  3460 /  5895 =  58.694
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7656 /  8535 =  89.701
0, 1  acc:  8044 /  8276 =  97.197
1, 0  acc:  2625 /  2874 =  91.336
1, 1  acc:   116 /   182 =  63.736
------------------------------------
Average acc: 18441 / 19867 =  92.822
Robust  acc:   116 /   182 =  63.736
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.438
Robust Acc: 56.667 | Best Acc: 97.186
-------------------------------------
Training, Epoch 58:
Accuracies by groups:
0, 0  acc:  9003 /  9767 =  92.178
0, 1  acc:  7323 /  7535 =  97.186
1, 0  acc:  2224 /  2480 =  89.677
1, 1  acc:   102 /   180 =  56.667
------------------------------------
Average acc: 18652 / 19962 =  93.438
Robust  acc:   102 /   180 =  56.667
------------------------------------
Accuracies by groups:
0, 0  acc:  9003 /  9767 =  92.178
0, 1  acc:  7323 /  7535 =  97.186
1, 0  acc:  2224 /  2480 =  89.677
1, 1  acc:   102 /   180 =  56.667
------------------------------------
Average acc: 18652 / 19962 =  93.438
Robust  acc:   102 /   180 =  56.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9003 /  9767 =  92.178
0, 1  acc:  7323 /  7535 =  97.186
1, 0  acc:  2224 /  2480 =  89.677
1, 1  acc:   102 /   180 =  56.667
------------------------------------
Average acc: 18652 / 19962 =  93.438
Robust  acc:   102 /   180 =  56.667
------------------------------------
Epoch:  60 | Train Loss: 0.002 | Train Acc: 88.162 | Val Loss: 0.001 | Val Acc: 93.009
Training:
Accuracies by groups:
0, 0  acc: 45592 / 51691 =  88.201
0, 1  acc: 45287 / 47340 =  95.663
1, 0  acc: 49013 / 57744 =  84.880
1, 1  acc:  3609 /  5995 =  60.200
--------------------------------------
Average acc: 143501 / 162770 =  88.162
Robust  acc:  3609 /  5995 =  60.200
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7700 /  8535 =  90.217
0, 1  acc:  8086 /  8276 =  97.704
1, 0  acc:  2587 /  2874 =  90.014
1, 1  acc:   105 /   182 =  57.692
------------------------------------
Average acc: 18478 / 19867 =  93.009
Robust  acc:   105 /   182 =  57.692
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.803
Robust Acc: 55.556 | Best Acc: 97.850
-------------------------------------
Training, Epoch 59:
Accuracies by groups:
0, 0  acc:  9036 /  9767 =  92.516
0, 1  acc:  7373 /  7535 =  97.850
1, 0  acc:  2216 /  2480 =  89.355
1, 1  acc:   100 /   180 =  55.556
------------------------------------
Average acc: 18725 / 19962 =  93.803
Robust  acc:   100 /   180 =  55.556
------------------------------------
Accuracies by groups:
0, 0  acc:  9036 /  9767 =  92.516
0, 1  acc:  7373 /  7535 =  97.850
1, 0  acc:  2216 /  2480 =  89.355
1, 1  acc:   100 /   180 =  55.556
------------------------------------
Average acc: 18725 / 19962 =  93.803
Robust  acc:   100 /   180 =  55.556
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9036 /  9767 =  92.516
0, 1  acc:  7373 /  7535 =  97.850
1, 0  acc:  2216 /  2480 =  89.355
1, 1  acc:   100 /   180 =  55.556
------------------------------------
Average acc: 18725 / 19962 =  93.803
Robust  acc:   100 /   180 =  55.556
------------------------------------
Epoch:  61 | Train Loss: 0.002 | Train Acc: 88.279 | Val Loss: 0.001 | Val Acc: 89.621
Training:
Accuracies by groups:
0, 0  acc: 44776 / 50805 =  88.133
0, 1  acc: 45741 / 47654 =  95.986
1, 0  acc: 49614 / 58354 =  85.022
1, 1  acc:  3561 /  5957 =  59.778
--------------------------------------
Average acc: 143692 / 162770 =  88.279
Robust  acc:  3561 /  5957 =  59.778
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7134 /  8535 =  83.585
0, 1  acc:  7777 /  8276 =  93.971
1, 0  acc:  2749 /  2874 =  95.651
1, 1  acc:   145 /   182 =  79.670
------------------------------------
Average acc: 17805 / 19867 =  89.621
Robust  acc:   145 /   182 =  79.670
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 90.702
Robust Acc: 68.333 | Best Acc: 94.919
-------------------------------------
Training, Epoch 60:
Accuracies by groups:
0, 0  acc:  8484 /  9767 =  86.864
0, 1  acc:  7145 /  7535 =  94.824
1, 0  acc:  2354 /  2480 =  94.919
1, 1  acc:   123 /   180 =  68.333
------------------------------------
Average acc: 18106 / 19962 =  90.702
Robust  acc:   123 /   180 =  68.333
------------------------------------
Accuracies by groups:
0, 0  acc:  8484 /  9767 =  86.864
0, 1  acc:  7145 /  7535 =  94.824
1, 0  acc:  2354 /  2480 =  94.919
1, 1  acc:   123 /   180 =  68.333
------------------------------------
Average acc: 18106 / 19962 =  90.702
Robust  acc:   123 /   180 =  68.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8484 /  9767 =  86.864
0, 1  acc:  7145 /  7535 =  94.824
1, 0  acc:  2354 /  2480 =  94.919
1, 1  acc:   123 /   180 =  68.333
------------------------------------
Average acc: 18106 / 19962 =  90.702
Robust  acc:   123 /   180 =  68.333
------------------------------------
Epoch:  62 | Train Loss: 0.001 | Train Acc: 88.374 | Val Loss: 0.001 | Val Acc: 93.789
Training:
Accuracies by groups:
0, 0  acc: 44770 / 50863 =  88.021
0, 1  acc: 45594 / 47510 =  95.967
1, 0  acc: 49836 / 58306 =  85.473
1, 1  acc:  3646 /  6091 =  59.859
--------------------------------------
Average acc: 143846 / 162770 =  88.374
Robust  acc:  3646 /  6091 =  59.859
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8244 /  8535 =  96.591
0, 1  acc:  8232 /  8276 =  99.468
1, 0  acc:  2108 /  2874 =  73.347
1, 1  acc:    49 /   182 =  26.923
------------------------------------
Average acc: 18633 / 19867 =  93.789
Robust  acc:    49 /   182 =  26.923
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.329
Robust Acc: 25.556 | Best Acc: 99.602
-------------------------------------
Training, Epoch 61:
Accuracies by groups:
0, 0  acc:  9532 /  9767 =  97.594
0, 1  acc:  7505 /  7535 =  99.602
1, 0  acc:  1747 /  2480 =  70.444
1, 1  acc:    46 /   180 =  25.556
------------------------------------
Average acc: 18830 / 19962 =  94.329
Robust  acc:    46 /   180 =  25.556
------------------------------------
Accuracies by groups:
0, 0  acc:  9532 /  9767 =  97.594
0, 1  acc:  7505 /  7535 =  99.602
1, 0  acc:  1747 /  2480 =  70.444
1, 1  acc:    46 /   180 =  25.556
------------------------------------
Average acc: 18830 / 19962 =  94.329
Robust  acc:    46 /   180 =  25.556
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9532 /  9767 =  97.594
0, 1  acc:  7505 /  7535 =  99.602
1, 0  acc:  1747 /  2480 =  70.444
1, 1  acc:    46 /   180 =  25.556
------------------------------------
Average acc: 18830 / 19962 =  94.329
Robust  acc:    46 /   180 =  25.556
------------------------------------
Epoch:  63 | Train Loss: 0.001 | Train Acc: 88.345 | Val Loss: 0.001 | Val Acc: 85.715
Training:
Accuracies by groups:
0, 0  acc: 45011 / 51059 =  88.155
0, 1  acc: 45355 / 47444 =  95.597
1, 0  acc: 49802 / 58246 =  85.503
1, 1  acc:  3631 /  6021 =  60.306
--------------------------------------
Average acc: 143799 / 162770 =  88.345
Robust  acc:  3631 /  6021 =  60.306
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6625 /  8535 =  77.622
0, 1  acc:  7443 /  8276 =  89.935
1, 0  acc:  2803 /  2874 =  97.530
1, 1  acc:   158 /   182 =  86.813
------------------------------------
Average acc: 17029 / 19867 =  85.715
Robust  acc:  6625 /  8535 =  77.622
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 87.060
Robust Acc: 82.277 | Best Acc: 97.339
-------------------------------------
Training, Epoch 62:
Accuracies by groups:
0, 0  acc:  8036 /  9767 =  82.277
0, 1  acc:  6777 /  7535 =  89.940
1, 0  acc:  2414 /  2480 =  97.339
1, 1  acc:   152 /   180 =  84.444
------------------------------------
Average acc: 17379 / 19962 =  87.060
Robust  acc:  8036 /  9767 =  82.277
------------------------------------
Accuracies by groups:
0, 0  acc:  8036 /  9767 =  82.277
0, 1  acc:  6777 /  7535 =  89.940
1, 0  acc:  2414 /  2480 =  97.339
1, 1  acc:   152 /   180 =  84.444
------------------------------------
Average acc: 17379 / 19962 =  87.060
Robust  acc:  8036 /  9767 =  82.277
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8036 /  9767 =  82.277
0, 1  acc:  6777 /  7535 =  89.940
1, 0  acc:  2414 /  2480 =  97.339
1, 1  acc:   152 /   180 =  84.444
------------------------------------
Average acc: 17379 / 19962 =  87.060
Robust  acc:  8036 /  9767 =  82.277
------------------------------------
Epoch:  64 | Train Loss: 0.001 | Train Acc: 88.315 | Val Loss: 0.002 | Val Acc: 83.334
Training:
Accuracies by groups:
0, 0  acc: 44965 / 51253 =  87.731
0, 1  acc: 45272 / 47256 =  95.802
1, 0  acc: 49788 / 58144 =  85.629
1, 1  acc:  3725 /  6117 =  60.896
--------------------------------------
Average acc: 143750 / 162770 =  88.315
Robust  acc:  3725 /  6117 =  60.896
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6300 /  8535 =  73.814
0, 1  acc:  7270 /  8276 =  87.844
1, 0  acc:  2822 /  2874 =  98.191
1, 1  acc:   164 /   182 =  90.110
------------------------------------
Average acc: 16556 / 19867 =  83.334
Robust  acc:  6300 /  8535 =  73.814
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 84.816
Robust Acc: 78.499 | Best Acc: 98.105
-------------------------------------
Training, Epoch 63:
Accuracies by groups:
0, 0  acc:  7667 /  9767 =  78.499
0, 1  acc:  6671 /  7535 =  88.534
1, 0  acc:  2433 /  2480 =  98.105
1, 1  acc:   160 /   180 =  88.889
------------------------------------
Average acc: 16931 / 19962 =  84.816
Robust  acc:  7667 /  9767 =  78.499
------------------------------------
Accuracies by groups:
0, 0  acc:  7667 /  9767 =  78.499
0, 1  acc:  6671 /  7535 =  88.534
1, 0  acc:  2433 /  2480 =  98.105
1, 1  acc:   160 /   180 =  88.889
------------------------------------
Average acc: 16931 / 19962 =  84.816
Robust  acc:  7667 /  9767 =  78.499
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  7667 /  9767 =  78.499
0, 1  acc:  6671 /  7535 =  88.534
1, 0  acc:  2433 /  2480 =  98.105
1, 1  acc:   160 /   180 =  88.889
------------------------------------
Average acc: 16931 / 19962 =  84.816
Robust  acc:  7667 /  9767 =  78.499
------------------------------------
Epoch:  65 | Train Loss: 0.001 | Train Acc: 88.586 | Val Loss: 0.001 | Val Acc: 93.869
Training:
Accuracies by groups:
0, 0  acc: 45067 / 51181 =  88.054
0, 1  acc: 45220 / 47294 =  95.615
1, 0  acc: 50158 / 58305 =  86.027
1, 1  acc:  3746 /  5990 =  62.538
--------------------------------------
Average acc: 144191 / 162770 =  88.586
Robust  acc:  3746 /  5990 =  62.538
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8110 /  8535 =  95.021
0, 1  acc:  8193 /  8276 =  98.997
1, 0  acc:  2282 /  2874 =  79.402
1, 1  acc:    64 /   182 =  35.165
------------------------------------
Average acc: 18649 / 19867 =  93.869
Robust  acc:    64 /   182 =  35.165
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.560
Robust Acc: 31.111 | Best Acc: 99.363
-------------------------------------
Training, Epoch 64:
Accuracies by groups:
0, 0  acc:  9412 /  9767 =  96.365
0, 1  acc:  7487 /  7535 =  99.363
1, 0  acc:  1921 /  2480 =  77.460
1, 1  acc:    56 /   180 =  31.111
------------------------------------
Average acc: 18876 / 19962 =  94.560
Robust  acc:    56 /   180 =  31.111
------------------------------------
Accuracies by groups:
0, 0  acc:  9412 /  9767 =  96.365
0, 1  acc:  7487 /  7535 =  99.363
1, 0  acc:  1921 /  2480 =  77.460
1, 1  acc:    56 /   180 =  31.111
------------------------------------
Average acc: 18876 / 19962 =  94.560
Robust  acc:    56 /   180 =  31.111
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9412 /  9767 =  96.365
0, 1  acc:  7487 /  7535 =  99.363
1, 0  acc:  1921 /  2480 =  77.460
1, 1  acc:    56 /   180 =  31.111
------------------------------------
Average acc: 18876 / 19962 =  94.560
Robust  acc:    56 /   180 =  31.111
------------------------------------
Epoch:  66 | Train Loss: 0.001 | Train Acc: 88.409 | Val Loss: 0.001 | Val Acc: 91.131
Training:
Accuracies by groups:
0, 0  acc: 44847 / 51179 =  87.628
0, 1  acc: 45074 / 47120 =  95.658
1, 0  acc: 50254 / 58483 =  85.929
1, 1  acc:  3729 /  5988 =  62.275
--------------------------------------
Average acc: 143904 / 162770 =  88.409
Robust  acc:  3729 /  5988 =  62.275
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7408 /  8535 =  86.796
0, 1  acc:  7892 /  8276 =  95.360
1, 0  acc:  2679 /  2874 =  93.215
1, 1  acc:   126 /   182 =  69.231
------------------------------------
Average acc: 18105 / 19867 =  91.131
Robust  acc:   126 /   182 =  69.231
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.205
Robust Acc: 67.222 | Best Acc: 95.474
-------------------------------------
Training, Epoch 65:
Accuracies by groups:
0, 0  acc:  8810 /  9767 =  90.202
0, 1  acc:  7194 /  7535 =  95.474
1, 0  acc:  2281 /  2480 =  91.976
1, 1  acc:   121 /   180 =  67.222
------------------------------------
Average acc: 18406 / 19962 =  92.205
Robust  acc:   121 /   180 =  67.222
------------------------------------
Accuracies by groups:
0, 0  acc:  8810 /  9767 =  90.202
0, 1  acc:  7194 /  7535 =  95.474
1, 0  acc:  2281 /  2480 =  91.976
1, 1  acc:   121 /   180 =  67.222
------------------------------------
Average acc: 18406 / 19962 =  92.205
Robust  acc:   121 /   180 =  67.222
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8810 /  9767 =  90.202
0, 1  acc:  7194 /  7535 =  95.474
1, 0  acc:  2281 /  2480 =  91.976
1, 1  acc:   121 /   180 =  67.222
------------------------------------
Average acc: 18406 / 19962 =  92.205
Robust  acc:   121 /   180 =  67.222
------------------------------------
Epoch:  67 | Train Loss: 0.001 | Train Acc: 88.516 | Val Loss: 0.001 | Val Acc: 91.609
Training:
Accuracies by groups:
0, 0  acc: 45159 / 51420 =  87.824
0, 1  acc: 44899 / 46973 =  95.585
1, 0  acc: 50273 / 58369 =  86.130
1, 1  acc:  3746 /  6008 =  62.350
--------------------------------------
Average acc: 144077 / 162770 =  88.516
Robust  acc:  3746 /  6008 =  62.350
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7437 /  8535 =  87.135
0, 1  acc:  7979 /  8276 =  96.411
1, 0  acc:  2664 /  2874 =  92.693
1, 1  acc:   120 /   182 =  65.934
------------------------------------
Average acc: 18200 / 19867 =  91.609
Robust  acc:   120 /   182 =  65.934
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.581
Robust Acc: 61.667 | Best Acc: 96.815
-------------------------------------
Training, Epoch 66:
Accuracies by groups:
0, 0  acc:  8807 /  9767 =  90.171
0, 1  acc:  7295 /  7535 =  96.815
1, 0  acc:  2268 /  2480 =  91.452
1, 1  acc:   111 /   180 =  61.667
------------------------------------
Average acc: 18481 / 19962 =  92.581
Robust  acc:   111 /   180 =  61.667
------------------------------------
Accuracies by groups:
0, 0  acc:  8807 /  9767 =  90.171
0, 1  acc:  7295 /  7535 =  96.815
1, 0  acc:  2268 /  2480 =  91.452
1, 1  acc:   111 /   180 =  61.667
------------------------------------
Average acc: 18481 / 19962 =  92.581
Robust  acc:   111 /   180 =  61.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8807 /  9767 =  90.171
0, 1  acc:  7295 /  7535 =  96.815
1, 0  acc:  2268 /  2480 =  91.452
1, 1  acc:   111 /   180 =  61.667
------------------------------------
Average acc: 18481 / 19962 =  92.581
Robust  acc:   111 /   180 =  61.667
------------------------------------
Epoch:  68 | Train Loss: 0.001 | Train Acc: 88.657 | Val Loss: 0.001 | Val Acc: 85.700
Training:
Accuracies by groups:
0, 0  acc: 44979 / 51385 =  87.533
0, 1  acc: 45213 / 47223 =  95.744
1, 0  acc: 50378 / 58173 =  86.600
1, 1  acc:  3737 /  5989 =  62.398
--------------------------------------
Average acc: 144307 / 162770 =  88.657
Robust  acc:  3737 /  5989 =  62.398
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6539 /  8535 =  76.614
0, 1  acc:  7525 /  8276 =  90.926
1, 0  acc:  2806 /  2874 =  97.634
1, 1  acc:   156 /   182 =  85.714
------------------------------------
Average acc: 17026 / 19867 =  85.700
Robust  acc:  6539 /  8535 =  76.614
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 87.146
Robust Acc: 81.315 | Best Acc: 97.581
-------------------------------------
Training, Epoch 67:
Accuracies by groups:
0, 0  acc:  7942 /  9767 =  81.315
0, 1  acc:  6880 /  7535 =  91.307
1, 0  acc:  2420 /  2480 =  97.581
1, 1  acc:   154 /   180 =  85.556
------------------------------------
Average acc: 17396 / 19962 =  87.146
Robust  acc:  7942 /  9767 =  81.315
------------------------------------
Accuracies by groups:
0, 0  acc:  7942 /  9767 =  81.315
0, 1  acc:  6880 /  7535 =  91.307
1, 0  acc:  2420 /  2480 =  97.581
1, 1  acc:   154 /   180 =  85.556
------------------------------------
Average acc: 17396 / 19962 =  87.146
Robust  acc:  7942 /  9767 =  81.315
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  7942 /  9767 =  81.315
0, 1  acc:  6880 /  7535 =  91.307
1, 0  acc:  2420 /  2480 =  97.581
1, 1  acc:   154 /   180 =  85.556
------------------------------------
Average acc: 17396 / 19962 =  87.146
Robust  acc:  7942 /  9767 =  81.315
------------------------------------
Epoch:  69 | Train Loss: 0.001 | Train Acc: 88.735 | Val Loss: 0.002 | Val Acc: 75.215
Training:
Accuracies by groups:
0, 0  acc: 44864 / 51163 =  87.688
0, 1  acc: 45355 / 47399 =  95.688
1, 0  acc: 50554 / 58312 =  86.696
1, 1  acc:  3661 /  5896 =  62.093
--------------------------------------
Average acc: 144434 / 162770 =  88.735
Robust  acc:  3661 /  5896 =  62.093
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  5501 /  8535 =  64.452
0, 1  acc:  6411 /  8276 =  77.465
1, 0  acc:  2855 /  2874 =  99.339
1, 1  acc:   176 /   182 =  96.703
------------------------------------
Average acc: 14943 / 19867 =  75.215
Robust  acc:  5501 /  8535 =  64.452
------------------------------------
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 76.641
Robust Acc: 69.489 | Best Acc: 99.194
-------------------------------------
Training, Epoch 68:
Accuracies by groups:
0, 0  acc:  6787 /  9767 =  69.489
0, 1  acc:  5881 /  7535 =  78.049
1, 0  acc:  2460 /  2480 =  99.194
1, 1  acc:   171 /   180 =  95.000
------------------------------------
Average acc: 15299 / 19962 =  76.641
Robust  acc:  6787 /  9767 =  69.489
------------------------------------
Accuracies by groups:
0, 0  acc:  6787 /  9767 =  69.489
0, 1  acc:  5881 /  7535 =  78.049
1, 0  acc:  2460 /  2480 =  99.194
1, 1  acc:   171 /   180 =  95.000
------------------------------------
Average acc: 15299 / 19962 =  76.641
Robust  acc:  6787 /  9767 =  69.489
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  6787 /  9767 =  69.489
0, 1  acc:  5881 /  7535 =  78.049
1, 0  acc:  2460 /  2480 =  99.194
1, 1  acc:   171 /   180 =  95.000
------------------------------------
Average acc: 15299 / 19962 =  76.641
Robust  acc:  6787 /  9767 =  69.489
------------------------------------
Epoch:  70 | Train Loss: 0.001 | Train Acc: 88.758 | Val Loss: 0.001 | Val Acc: 93.638
Training:
Accuracies by groups:
0, 0  acc: 44933 / 51311 =  87.570
0, 1  acc: 45432 / 47540 =  95.566
1, 0  acc: 50420 / 58066 =  86.832
1, 1  acc:  3686 /  5853 =  62.976
--------------------------------------
Average acc: 144471 / 162770 =  88.758
Robust  acc:  3686 /  5853 =  62.976
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7949 /  8535 =  93.134
0, 1  acc:  8148 /  8276 =  98.453
1, 0  acc:  2428 /  2874 =  84.482
1, 1  acc:    78 /   182 =  42.857
------------------------------------
Average acc: 18603 / 19867 =  93.638
Robust  acc:    78 /   182 =  42.857
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.359
Robust Acc: 41.111 | Best Acc: 98.859
-------------------------------------
Training, Epoch 69:
Accuracies by groups:
0, 0  acc:  9256 /  9767 =  94.768
0, 1  acc:  7449 /  7535 =  98.859
1, 0  acc:  2057 /  2480 =  82.944
1, 1  acc:    74 /   180 =  41.111
------------------------------------
Average acc: 18836 / 19962 =  94.359
Robust  acc:    74 /   180 =  41.111
------------------------------------
Accuracies by groups:
0, 0  acc:  9256 /  9767 =  94.768
0, 1  acc:  7449 /  7535 =  98.859
1, 0  acc:  2057 /  2480 =  82.944
1, 1  acc:    74 /   180 =  41.111
------------------------------------
Average acc: 18836 / 19962 =  94.359
Robust  acc:    74 /   180 =  41.111
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9256 /  9767 =  94.768
0, 1  acc:  7449 /  7535 =  98.859
1, 0  acc:  2057 /  2480 =  82.944
1, 1  acc:    74 /   180 =  41.111
------------------------------------
Average acc: 18836 / 19962 =  94.359
Robust  acc:    74 /   180 =  41.111
------------------------------------
Epoch:  71 | Train Loss: 0.001 | Train Acc: 88.737 | Val Loss: 0.001 | Val Acc: 90.874
Training:
Accuracies by groups:
0, 0  acc: 44802 / 51184 =  87.531
0, 1  acc: 45201 / 47334 =  95.494
1, 0  acc: 50732 / 58346 =  86.950
1, 1  acc:  3703 /  5906 =  62.699
--------------------------------------
Average acc: 144438 / 162770 =  88.737
Robust  acc:  3703 /  5906 =  62.699
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7348 /  8535 =  86.093
0, 1  acc:  7844 /  8276 =  94.780
1, 0  acc:  2726 /  2874 =  94.850
1, 1  acc:   136 /   182 =  74.725
------------------------------------
Average acc: 18054 / 19867 =  90.874
Robust  acc:   136 /   182 =  74.725
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.005
Robust Acc: 69.444 | Best Acc: 95.435
-------------------------------------
Training, Epoch 70:
Accuracies by groups:
0, 0  acc:  8720 /  9767 =  89.280
0, 1  acc:  7191 /  7535 =  95.435
1, 0  acc:  2330 /  2480 =  93.952
1, 1  acc:   125 /   180 =  69.444
------------------------------------
Average acc: 18366 / 19962 =  92.005
Robust  acc:   125 /   180 =  69.444
------------------------------------
Accuracies by groups:
0, 0  acc:  8720 /  9767 =  89.280
0, 1  acc:  7191 /  7535 =  95.435
1, 0  acc:  2330 /  2480 =  93.952
1, 1  acc:   125 /   180 =  69.444
------------------------------------
Average acc: 18366 / 19962 =  92.005
Robust  acc:   125 /   180 =  69.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8720 /  9767 =  89.280
0, 1  acc:  7191 /  7535 =  95.435
1, 0  acc:  2330 /  2480 =  93.952
1, 1  acc:   125 /   180 =  69.444
------------------------------------
Average acc: 18366 / 19962 =  92.005
Robust  acc:   125 /   180 =  69.444
------------------------------------
Epoch:  72 | Train Loss: 0.001 | Train Acc: 88.777 | Val Loss: 0.001 | Val Acc: 90.361
Training:
Accuracies by groups:
0, 0  acc: 44758 / 51199 =  87.420
0, 1  acc: 45252 / 47398 =  95.472
1, 0  acc: 50759 / 58309 =  87.052
1, 1  acc:  3733 /  5864 =  63.660
--------------------------------------
Average acc: 144502 / 162770 =  88.777
Robust  acc:  3733 /  5864 =  63.660
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7210 /  8535 =  84.476
0, 1  acc:  7875 /  8276 =  95.155
1, 0  acc:  2742 /  2874 =  95.407
1, 1  acc:   125 /   182 =  68.681
------------------------------------
Average acc: 17952 / 19867 =  90.361
Robust  acc:   125 /   182 =  68.681
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.494
Robust Acc: 68.889 | Best Acc: 95.820
-------------------------------------
Training, Epoch 71:
Accuracies by groups:
0, 0  acc:  8575 /  9767 =  87.796
0, 1  acc:  7220 /  7535 =  95.820
1, 0  acc:  2345 /  2480 =  94.556
1, 1  acc:   124 /   180 =  68.889
------------------------------------
Average acc: 18264 / 19962 =  91.494
Robust  acc:   124 /   180 =  68.889
------------------------------------
Accuracies by groups:
0, 0  acc:  8575 /  9767 =  87.796
0, 1  acc:  7220 /  7535 =  95.820
1, 0  acc:  2345 /  2480 =  94.556
1, 1  acc:   124 /   180 =  68.889
------------------------------------
Average acc: 18264 / 19962 =  91.494
Robust  acc:   124 /   180 =  68.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8575 /  9767 =  87.796
0, 1  acc:  7220 /  7535 =  95.820
1, 0  acc:  2345 /  2480 =  94.556
1, 1  acc:   124 /   180 =  68.889
------------------------------------
Average acc: 18264 / 19962 =  91.494
Robust  acc:   124 /   180 =  68.889
------------------------------------
Epoch:  73 | Train Loss: 0.001 | Train Acc: 88.808 | Val Loss: 0.001 | Val Acc: 83.244
Training:
Accuracies by groups:
0, 0  acc: 44792 / 51360 =  87.212
0, 1  acc: 45273 / 47413 =  95.486
1, 0  acc: 50657 / 58048 =  87.267
1, 1  acc:  3830 /  5949 =  64.381
--------------------------------------
Average acc: 144552 / 162770 =  88.808
Robust  acc:  3830 /  5949 =  64.381
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6334 /  8535 =  74.212
0, 1  acc:  7230 /  8276 =  87.361
1, 0  acc:  2815 /  2874 =  97.947
1, 1  acc:   159 /   182 =  87.363
------------------------------------
Average acc: 16538 / 19867 =  83.244
Robust  acc:  6334 /  8535 =  74.212
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 84.761
Robust Acc: 79.083 | Best Acc: 97.823
-------------------------------------
Training, Epoch 72:
Accuracies by groups:
0, 0  acc:  7724 /  9767 =  79.083
0, 1  acc:  6609 /  7535 =  87.711
1, 0  acc:  2426 /  2480 =  97.823
1, 1  acc:   161 /   180 =  89.444
------------------------------------
Average acc: 16920 / 19962 =  84.761
Robust  acc:  7724 /  9767 =  79.083
------------------------------------
Accuracies by groups:
0, 0  acc:  7724 /  9767 =  79.083
0, 1  acc:  6609 /  7535 =  87.711
1, 0  acc:  2426 /  2480 =  97.823
1, 1  acc:   161 /   180 =  89.444
------------------------------------
Average acc: 16920 / 19962 =  84.761
Robust  acc:  7724 /  9767 =  79.083
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  7724 /  9767 =  79.083
0, 1  acc:  6609 /  7535 =  87.711
1, 0  acc:  2426 /  2480 =  97.823
1, 1  acc:   161 /   180 =  89.444
------------------------------------
Average acc: 16920 / 19962 =  84.761
Robust  acc:  7724 /  9767 =  79.083
------------------------------------
Epoch:  74 | Train Loss: 0.001 | Train Acc: 88.908 | Val Loss: 0.001 | Val Acc: 91.483
Training:
Accuracies by groups:
0, 0  acc: 44730 / 51254 =  87.271
0, 1  acc: 45234 / 47290 =  95.652
1, 0  acc: 50868 / 58205 =  87.395
1, 1  acc:  3883 /  6021 =  64.491
--------------------------------------
Average acc: 144715 / 162770 =  88.908
Robust  acc:  3883 /  6021 =  64.491
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7424 /  8535 =  86.983
0, 1  acc:  7982 /  8276 =  96.448
1, 0  acc:  2655 /  2874 =  92.380
1, 1  acc:   114 /   182 =  62.637
------------------------------------
Average acc: 18175 / 19867 =  91.483
Robust  acc:   114 /   182 =  62.637
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.776
Robust Acc: 64.444 | Best Acc: 96.921
-------------------------------------
Training, Epoch 73:
Accuracies by groups:
0, 0  acc:  8812 /  9767 =  90.222
0, 1  acc:  7303 /  7535 =  96.921
1, 0  acc:  2289 /  2480 =  92.298
1, 1  acc:   116 /   180 =  64.444
------------------------------------
Average acc: 18520 / 19962 =  92.776
Robust  acc:   116 /   180 =  64.444
------------------------------------
Accuracies by groups:
0, 0  acc:  8812 /  9767 =  90.222
0, 1  acc:  7303 /  7535 =  96.921
1, 0  acc:  2289 /  2480 =  92.298
1, 1  acc:   116 /   180 =  64.444
------------------------------------
Average acc: 18520 / 19962 =  92.776
Robust  acc:   116 /   180 =  64.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8812 /  9767 =  90.222
0, 1  acc:  7303 /  7535 =  96.921
1, 0  acc:  2289 /  2480 =  92.298
1, 1  acc:   116 /   180 =  64.444
------------------------------------
Average acc: 18520 / 19962 =  92.776
Robust  acc:   116 /   180 =  64.444
------------------------------------
Epoch:  75 | Train Loss: 0.001 | Train Acc: 88.863 | Val Loss: 0.001 | Val Acc: 88.106
Training:
Accuracies by groups:
0, 0  acc: 44709 / 51214 =  87.298
0, 1  acc: 45065 / 47246 =  95.384
1, 0  acc: 50913 / 58189 =  87.496
1, 1  acc:  3956 /  6121 =  64.630
--------------------------------------
Average acc: 144643 / 162770 =  88.863
Robust  acc:  3956 /  6121 =  64.630
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6902 /  8535 =  80.867
0, 1  acc:  7674 /  8276 =  92.726
1, 0  acc:  2782 /  2874 =  96.799
1, 1  acc:   146 /   182 =  80.220
------------------------------------
Average acc: 17504 / 19867 =  88.106
Robust  acc:   146 /   182 =  80.220
------------------------------------
New max robust acc: 80.21978021978022
- Saving best checkpoint at epoch 74
replace: True
-> Updating checkpoint cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=49-cpre=-1-cpb=-1.pt...
Checkpoint saved at ./model/celebA/config/cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=74-cpre=-1-cpb=-1.pt
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 89.545
Robust Acc: 76.667 | Best Acc: 96.089
-------------------------------------
Training, Epoch 74:
Accuracies by groups:
0, 0  acc:  8299 /  9767 =  84.970
0, 1  acc:  7055 /  7535 =  93.630
1, 0  acc:  2383 /  2480 =  96.089
1, 1  acc:   138 /   180 =  76.667
------------------------------------
Average acc: 17875 / 19962 =  89.545
Robust  acc:   138 /   180 =  76.667
------------------------------------
Accuracies by groups:
0, 0  acc:  8299 /  9767 =  84.970
0, 1  acc:  7055 /  7535 =  93.630
1, 0  acc:  2383 /  2480 =  96.089
1, 1  acc:   138 /   180 =  76.667
------------------------------------
Average acc: 17875 / 19962 =  89.545
Robust  acc:   138 /   180 =  76.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8299 /  9767 =  84.970
0, 1  acc:  7055 /  7535 =  93.630
1, 0  acc:  2383 /  2480 =  96.089
1, 1  acc:   138 /   180 =  76.667
------------------------------------
Average acc: 17875 / 19962 =  89.545
Robust  acc:   138 /   180 =  76.667
------------------------------------
Epoch:  76 | Train Loss: 0.001 | Train Acc: 88.793 | Val Loss: 0.001 | Val Acc: 92.928
Training:
Accuracies by groups:
0, 0  acc: 44679 / 51188 =  87.284
0, 1  acc: 44744 / 46936 =  95.330
1, 0  acc: 51248 / 58636 =  87.400
1, 1  acc:  3857 /  6010 =  64.176
--------------------------------------
Average acc: 144528 / 162770 =  88.793
Robust  acc:  3857 /  6010 =  64.176
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7707 /  8535 =  90.299
0, 1  acc:  8054 /  8276 =  97.318
1, 0  acc:  2592 /  2874 =  90.188
1, 1  acc:   109 /   182 =  59.890
------------------------------------
Average acc: 18462 / 19867 =  92.928
Robust  acc:   109 /   182 =  59.890
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.613
Robust Acc: 60.000 | Best Acc: 97.372
-------------------------------------
Training, Epoch 75:
Accuracies by groups:
0, 0  acc:  9029 /  9767 =  92.444
0, 1  acc:  7337 /  7535 =  97.372
1, 0  acc:  2213 /  2480 =  89.234
1, 1  acc:   108 /   180 =  60.000
------------------------------------
Average acc: 18687 / 19962 =  93.613
Robust  acc:   108 /   180 =  60.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9029 /  9767 =  92.444
0, 1  acc:  7337 /  7535 =  97.372
1, 0  acc:  2213 /  2480 =  89.234
1, 1  acc:   108 /   180 =  60.000
------------------------------------
Average acc: 18687 / 19962 =  93.613
Robust  acc:   108 /   180 =  60.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9029 /  9767 =  92.444
0, 1  acc:  7337 /  7535 =  97.372
1, 0  acc:  2213 /  2480 =  89.234
1, 1  acc:   108 /   180 =  60.000
------------------------------------
Average acc: 18687 / 19962 =  93.613
Robust  acc:   108 /   180 =  60.000
------------------------------------
Epoch:  77 | Train Loss: 0.001 | Train Acc: 89.026 | Val Loss: 0.001 | Val Acc: 92.918
Training:
Accuracies by groups:
0, 0  acc: 44658 / 51083 =  87.422
0, 1  acc: 45353 / 47593 =  95.293
1, 0  acc: 50917 / 58033 =  87.738
1, 1  acc:  3980 /  6061 =  65.666
--------------------------------------
Average acc: 144908 / 162770 =  89.026
Robust  acc:  3980 /  6061 =  65.666
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7705 /  8535 =  90.275
0, 1  acc:  8065 /  8276 =  97.450
1, 0  acc:  2589 /  2874 =  90.084
1, 1  acc:   101 /   182 =  55.495
------------------------------------
Average acc: 18460 / 19867 =  92.918
Robust  acc:   101 /   182 =  55.495
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.518
Robust Acc: 51.111 | Best Acc: 97.717
-------------------------------------
Training, Epoch 76:
Accuracies by groups:
0, 0  acc:  9022 /  9767 =  92.372
0, 1  acc:  7363 /  7535 =  97.717
1, 0  acc:  2191 /  2480 =  88.347
1, 1  acc:    92 /   180 =  51.111
------------------------------------
Average acc: 18668 / 19962 =  93.518
Robust  acc:    92 /   180 =  51.111
------------------------------------
Accuracies by groups:
0, 0  acc:  9022 /  9767 =  92.372
0, 1  acc:  7363 /  7535 =  97.717
1, 0  acc:  2191 /  2480 =  88.347
1, 1  acc:    92 /   180 =  51.111
------------------------------------
Average acc: 18668 / 19962 =  93.518
Robust  acc:    92 /   180 =  51.111
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9022 /  9767 =  92.372
0, 1  acc:  7363 /  7535 =  97.717
1, 0  acc:  2191 /  2480 =  88.347
1, 1  acc:    92 /   180 =  51.111
------------------------------------
Average acc: 18668 / 19962 =  93.518
Robust  acc:    92 /   180 =  51.111
------------------------------------
Epoch:  78 | Train Loss: 0.001 | Train Acc: 89.118 | Val Loss: 0.001 | Val Acc: 90.633
Training:
Accuracies by groups:
0, 0  acc: 44615 / 51014 =  87.456
0, 1  acc: 45124 / 47288 =  95.424
1, 0  acc: 51453 / 58489 =  87.970
1, 1  acc:  3865 /  5979 =  64.643
--------------------------------------
Average acc: 145057 / 162770 =  89.118
Robust  acc:  3865 /  5979 =  64.643
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7313 /  8535 =  85.682
0, 1  acc:  7879 /  8276 =  95.203
1, 0  acc:  2692 /  2874 =  93.667
1, 1  acc:   122 /   182 =  67.033
------------------------------------
Average acc: 18006 / 19867 =  90.633
Robust  acc:   122 /   182 =  67.033
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.804
Robust Acc: 63.333 | Best Acc: 95.952
-------------------------------------
Training, Epoch 77:
Accuracies by groups:
0, 0  acc:  8683 /  9767 =  88.901
0, 1  acc:  7230 /  7535 =  95.952
1, 0  acc:  2299 /  2480 =  92.702
1, 1  acc:   114 /   180 =  63.333
------------------------------------
Average acc: 18326 / 19962 =  91.804
Robust  acc:   114 /   180 =  63.333
------------------------------------
Accuracies by groups:
0, 0  acc:  8683 /  9767 =  88.901
0, 1  acc:  7230 /  7535 =  95.952
1, 0  acc:  2299 /  2480 =  92.702
1, 1  acc:   114 /   180 =  63.333
------------------------------------
Average acc: 18326 / 19962 =  91.804
Robust  acc:   114 /   180 =  63.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8683 /  9767 =  88.901
0, 1  acc:  7230 /  7535 =  95.952
1, 0  acc:  2299 /  2480 =  92.702
1, 1  acc:   114 /   180 =  63.333
------------------------------------
Average acc: 18326 / 19962 =  91.804
Robust  acc:   114 /   180 =  63.333
------------------------------------
Epoch:  79 | Train Loss: 0.001 | Train Acc: 89.191 | Val Loss: 0.002 | Val Acc: 72.401
Training:
Accuracies by groups:
0, 0  acc: 44541 / 51108 =  87.151
0, 1  acc: 45283 / 47404 =  95.526
1, 0  acc: 51435 / 58296 =  88.231
1, 1  acc:  3918 /  5962 =  65.716
--------------------------------------
Average acc: 145177 / 162770 =  89.191
Robust  acc:  3918 /  5962 =  65.716
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  5171 /  8535 =  60.586
0, 1  acc:  6178 /  8276 =  74.650
1, 0  acc:  2858 /  2874 =  99.443
1, 1  acc:   177 /   182 =  97.253
------------------------------------
Average acc: 14384 / 19867 =  72.401
Robust  acc:  5171 /  8535 =  60.586
------------------------------------
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 74.281
Robust Acc: 66.274 | Best Acc: 99.153
-------------------------------------
Training, Epoch 78:
Accuracies by groups:
0, 0  acc:  6473 /  9767 =  66.274
0, 1  acc:  5727 /  7535 =  76.005
1, 0  acc:  2459 /  2480 =  99.153
1, 1  acc:   169 /   180 =  93.889
------------------------------------
Average acc: 14828 / 19962 =  74.281
Robust  acc:  6473 /  9767 =  66.274
------------------------------------
Accuracies by groups:
0, 0  acc:  6473 /  9767 =  66.274
0, 1  acc:  5727 /  7535 =  76.005
1, 0  acc:  2459 /  2480 =  99.153
1, 1  acc:   169 /   180 =  93.889
------------------------------------
Average acc: 14828 / 19962 =  74.281
Robust  acc:  6473 /  9767 =  66.274
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  6473 /  9767 =  66.274
0, 1  acc:  5727 /  7535 =  76.005
1, 0  acc:  2459 /  2480 =  99.153
1, 1  acc:   169 /   180 =  93.889
------------------------------------
Average acc: 14828 / 19962 =  74.281
Robust  acc:  6473 /  9767 =  66.274
------------------------------------
Epoch:  80 | Train Loss: 0.001 | Train Acc: 88.964 | Val Loss: 0.001 | Val Acc: 91.564
Training:
Accuracies by groups:
0, 0  acc: 44704 / 51321 =  87.107
0, 1  acc: 45008 / 47210 =  95.336
1, 0  acc: 51163 / 58194 =  87.918
1, 1  acc:  3932 /  6045 =  65.045
--------------------------------------
Average acc: 144807 / 162770 =  88.964
Robust  acc:  3932 /  6045 =  65.045
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7415 /  8535 =  86.878
0, 1  acc:  7967 /  8276 =  96.266
1, 0  acc:  2690 /  2874 =  93.598
1, 1  acc:   119 /   182 =  65.385
------------------------------------
Average acc: 18191 / 19867 =  91.564
Robust  acc:   119 /   182 =  65.385
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.586
Robust Acc: 64.444 | Best Acc: 96.629
-------------------------------------
Training, Epoch 79:
Accuracies by groups:
0, 0  acc:  8794 /  9767 =  90.038
0, 1  acc:  7281 /  7535 =  96.629
1, 0  acc:  2291 /  2480 =  92.379
1, 1  acc:   116 /   180 =  64.444
------------------------------------
Average acc: 18482 / 19962 =  92.586
Robust  acc:   116 /   180 =  64.444
------------------------------------
Accuracies by groups:
0, 0  acc:  8794 /  9767 =  90.038
0, 1  acc:  7281 /  7535 =  96.629
1, 0  acc:  2291 /  2480 =  92.379
1, 1  acc:   116 /   180 =  64.444
------------------------------------
Average acc: 18482 / 19962 =  92.586
Robust  acc:   116 /   180 =  64.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8794 /  9767 =  90.038
0, 1  acc:  7281 /  7535 =  96.629
1, 0  acc:  2291 /  2480 =  92.379
1, 1  acc:   116 /   180 =  64.444
------------------------------------
Average acc: 18482 / 19962 =  92.586
Robust  acc:   116 /   180 =  64.444
------------------------------------
Epoch:  81 | Train Loss: 0.001 | Train Acc: 89.274 | Val Loss: 0.002 | Val Acc: 75.220
Training:
Accuracies by groups:
0, 0  acc: 44452 / 50941 =  87.262
0, 1  acc: 45245 / 47369 =  95.516
1, 0  acc: 51654 / 58434 =  88.397
1, 1  acc:  3961 /  6026 =  65.732
--------------------------------------
Average acc: 145312 / 162770 =  89.274
Robust  acc:  3961 /  6026 =  65.732
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  5392 /  8535 =  63.175
0, 1  acc:  6516 /  8276 =  78.734
1, 0  acc:  2860 /  2874 =  99.513
1, 1  acc:   176 /   182 =  96.703
------------------------------------
Average acc: 14944 / 19867 =  75.220
Robust  acc:  5392 /  8535 =  63.175
------------------------------------
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 77.096
Robust Acc: 68.895 | Best Acc: 99.073
-------------------------------------
Training, Epoch 80:
Accuracies by groups:
0, 0  acc:  6729 /  9767 =  68.895
0, 1  acc:  6037 /  7535 =  80.119
1, 0  acc:  2457 /  2480 =  99.073
1, 1  acc:   167 /   180 =  92.778
------------------------------------
Average acc: 15390 / 19962 =  77.096
Robust  acc:  6729 /  9767 =  68.895
------------------------------------
Accuracies by groups:
0, 0  acc:  6729 /  9767 =  68.895
0, 1  acc:  6037 /  7535 =  80.119
1, 0  acc:  2457 /  2480 =  99.073
1, 1  acc:   167 /   180 =  92.778
------------------------------------
Average acc: 15390 / 19962 =  77.096
Robust  acc:  6729 /  9767 =  68.895
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  6729 /  9767 =  68.895
0, 1  acc:  6037 /  7535 =  80.119
1, 0  acc:  2457 /  2480 =  99.073
1, 1  acc:   167 /   180 =  92.778
------------------------------------
Average acc: 15390 / 19962 =  77.096
Robust  acc:  6729 /  9767 =  68.895
------------------------------------
Epoch:  82 | Train Loss: 0.001 | Train Acc: 89.290 | Val Loss: 0.001 | Val Acc: 91.327
Training:
Accuracies by groups:
0, 0  acc: 44682 / 51227 =  87.224
0, 1  acc: 45235 / 47511 =  95.210
1, 0  acc: 51440 / 58096 =  88.543
1, 1  acc:  3981 /  5936 =  67.065
--------------------------------------
Average acc: 145338 / 162770 =  89.290
Robust  acc:  3981 /  5936 =  67.065
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7381 /  8535 =  86.479
0, 1  acc:  7957 /  8276 =  96.145
1, 0  acc:  2688 /  2874 =  93.528
1, 1  acc:   118 /   182 =  64.835
------------------------------------
Average acc: 18144 / 19867 =  91.327
Robust  acc:   118 /   182 =  64.835
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.486
Robust Acc: 67.222 | Best Acc: 96.695
-------------------------------------
Training, Epoch 81:
Accuracies by groups:
0, 0  acc:  8757 /  9767 =  89.659
0, 1  acc:  7286 /  7535 =  96.695
1, 0  acc:  2298 /  2480 =  92.661
1, 1  acc:   121 /   180 =  67.222
------------------------------------
Average acc: 18462 / 19962 =  92.486
Robust  acc:   121 /   180 =  67.222
------------------------------------
Accuracies by groups:
0, 0  acc:  8757 /  9767 =  89.659
0, 1  acc:  7286 /  7535 =  96.695
1, 0  acc:  2298 /  2480 =  92.661
1, 1  acc:   121 /   180 =  67.222
------------------------------------
Average acc: 18462 / 19962 =  92.486
Robust  acc:   121 /   180 =  67.222
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8757 /  9767 =  89.659
0, 1  acc:  7286 /  7535 =  96.695
1, 0  acc:  2298 /  2480 =  92.661
1, 1  acc:   121 /   180 =  67.222
------------------------------------
Average acc: 18462 / 19962 =  92.486
Robust  acc:   121 /   180 =  67.222
------------------------------------
Epoch:  83 | Train Loss: 0.001 | Train Acc: 89.066 | Val Loss: 0.001 | Val Acc: 86.349
Training:
Accuracies by groups:
0, 0  acc: 44530 / 51249 =  86.890
0, 1  acc: 45088 / 47363 =  95.197
1, 0  acc: 51416 / 58207 =  88.333
1, 1  acc:  3938 /  5951 =  66.174
--------------------------------------
Average acc: 144972 / 162770 =  89.066
Robust  acc:  3938 /  5951 =  66.174
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6706 /  8535 =  78.571
0, 1  acc:  7473 /  8276 =  90.297
1, 0  acc:  2811 /  2874 =  97.808
1, 1  acc:   165 /   182 =  90.659
------------------------------------
Average acc: 17155 / 19867 =  86.349
Robust  acc:  6706 /  8535 =  78.571
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 87.812
Robust Acc: 83.106 | Best Acc: 97.500
-------------------------------------
Training, Epoch 82:
Accuracies by groups:
0, 0  acc:  8117 /  9767 =  83.106
0, 1  acc:  6835 /  7535 =  90.710
1, 0  acc:  2418 /  2480 =  97.500
1, 1  acc:   159 /   180 =  88.333
------------------------------------
Average acc: 17529 / 19962 =  87.812
Robust  acc:  8117 /  9767 =  83.106
------------------------------------
Accuracies by groups:
0, 0  acc:  8117 /  9767 =  83.106
0, 1  acc:  6835 /  7535 =  90.710
1, 0  acc:  2418 /  2480 =  97.500
1, 1  acc:   159 /   180 =  88.333
------------------------------------
Average acc: 17529 / 19962 =  87.812
Robust  acc:  8117 /  9767 =  83.106
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8117 /  9767 =  83.106
0, 1  acc:  6835 /  7535 =  90.710
1, 0  acc:  2418 /  2480 =  97.500
1, 1  acc:   159 /   180 =  88.333
------------------------------------
Average acc: 17529 / 19962 =  87.812
Robust  acc:  8117 /  9767 =  83.106
------------------------------------
Epoch:  84 | Train Loss: 0.001 | Train Acc: 89.198 | Val Loss: 0.001 | Val Acc: 84.869
Training:
Accuracies by groups:
0, 0  acc: 44375 / 50993 =  87.022
0, 1  acc: 44916 / 47036 =  95.493
1, 0  acc: 51909 / 58709 =  88.417
1, 1  acc:  3988 /  6032 =  66.114
--------------------------------------
Average acc: 145188 / 162770 =  89.198
Robust  acc:  3988 /  6032 =  66.114
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  6500 /  8535 =  76.157
0, 1  acc:  7363 /  8276 =  88.968
1, 0  acc:  2835 /  2874 =  98.643
1, 1  acc:   163 /   182 =  89.560
------------------------------------
Average acc: 16861 / 19867 =  84.869
Robust  acc:  6500 /  8535 =  76.157
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 86.504
Robust Acc: 81.161 | Best Acc: 98.145
-------------------------------------
Training, Epoch 83:
Accuracies by groups:
0, 0  acc:  7927 /  9767 =  81.161
0, 1  acc:  6747 /  7535 =  89.542
1, 0  acc:  2434 /  2480 =  98.145
1, 1  acc:   160 /   180 =  88.889
------------------------------------
Average acc: 17268 / 19962 =  86.504
Robust  acc:  7927 /  9767 =  81.161
------------------------------------
Accuracies by groups:
0, 0  acc:  7927 /  9767 =  81.161
0, 1  acc:  6747 /  7535 =  89.542
1, 0  acc:  2434 /  2480 =  98.145
1, 1  acc:   160 /   180 =  88.889
------------------------------------
Average acc: 17268 / 19962 =  86.504
Robust  acc:  7927 /  9767 =  81.161
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  7927 /  9767 =  81.161
0, 1  acc:  6747 /  7535 =  89.542
1, 0  acc:  2434 /  2480 =  98.145
1, 1  acc:   160 /   180 =  88.889
------------------------------------
Average acc: 17268 / 19962 =  86.504
Robust  acc:  7927 /  9767 =  81.161
------------------------------------
Epoch:  85 | Train Loss: 0.001 | Train Acc: 89.344 | Val Loss: 0.001 | Val Acc: 91.831
Training:
Accuracies by groups:
0, 0  acc: 44619 / 51160 =  87.215
0, 1  acc: 45289 / 47582 =  95.181
1, 0  acc: 51627 / 58142 =  88.795
1, 1  acc:  3891 /  5886 =  66.106
--------------------------------------
Average acc: 145426 / 162770 =  89.344
Robust  acc:  3891 /  5886 =  66.106
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7463 /  8535 =  87.440
0, 1  acc:  7981 /  8276 =  96.435
1, 0  acc:  2680 /  2874 =  93.250
1, 1  acc:   120 /   182 =  65.934
------------------------------------
Average acc: 18244 / 19867 =  91.831
Robust  acc:   120 /   182 =  65.934
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.766
Robust Acc: 66.667 | Best Acc: 96.642
-------------------------------------
Training, Epoch 84:
Accuracies by groups:
0, 0  acc:  8834 /  9767 =  90.447
0, 1  acc:  7282 /  7535 =  96.642
1, 0  acc:  2282 /  2480 =  92.016
1, 1  acc:   120 /   180 =  66.667
------------------------------------
Average acc: 18518 / 19962 =  92.766
Robust  acc:   120 /   180 =  66.667
------------------------------------
Accuracies by groups:
0, 0  acc:  8834 /  9767 =  90.447
0, 1  acc:  7282 /  7535 =  96.642
1, 0  acc:  2282 /  2480 =  92.016
1, 1  acc:   120 /   180 =  66.667
------------------------------------
Average acc: 18518 / 19962 =  92.766
Robust  acc:   120 /   180 =  66.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8834 /  9767 =  90.447
0, 1  acc:  7282 /  7535 =  96.642
1, 0  acc:  2282 /  2480 =  92.016
1, 1  acc:   120 /   180 =  66.667
------------------------------------
Average acc: 18518 / 19962 =  92.766
Robust  acc:   120 /   180 =  66.667
------------------------------------
Epoch:  86 | Train Loss: 0.001 | Train Acc: 89.254 | Val Loss: 0.001 | Val Acc: 89.223
Training:
Accuracies by groups:
0, 0  acc: 44471 / 51102 =  87.024
0, 1  acc: 45315 / 47574 =  95.252
1, 0  acc: 51538 / 58165 =  88.607
1, 1  acc:  3954 /  5929 =  66.689
--------------------------------------
Average acc: 145278 / 162770 =  89.254
Robust  acc:  3954 /  5929 =  66.689
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7172 /  8535 =  84.030
0, 1  acc:  7663 /  8276 =  92.593
1, 0  acc:  2745 /  2874 =  95.511
1, 1  acc:   146 /   182 =  80.220
------------------------------------
Average acc: 17726 / 19867 =  89.223
Robust  acc:   146 /   182 =  80.220
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 90.287
Robust Acc: 68.889 | Best Acc: 94.556
-------------------------------------
Training, Epoch 85:
Accuracies by groups:
0, 0  acc:  8542 /  9767 =  87.458
0, 1  acc:  7012 /  7535 =  93.059
1, 0  acc:  2345 /  2480 =  94.556
1, 1  acc:   124 /   180 =  68.889
------------------------------------
Average acc: 18023 / 19962 =  90.287
Robust  acc:   124 /   180 =  68.889
------------------------------------
Accuracies by groups:
0, 0  acc:  8542 /  9767 =  87.458
0, 1  acc:  7012 /  7535 =  93.059
1, 0  acc:  2345 /  2480 =  94.556
1, 1  acc:   124 /   180 =  68.889
------------------------------------
Average acc: 18023 / 19962 =  90.287
Robust  acc:   124 /   180 =  68.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8542 /  9767 =  87.458
0, 1  acc:  7012 /  7535 =  93.059
1, 0  acc:  2345 /  2480 =  94.556
1, 1  acc:   124 /   180 =  68.889
------------------------------------
Average acc: 18023 / 19962 =  90.287
Robust  acc:   124 /   180 =  68.889
------------------------------------
Epoch:  87 | Train Loss: 0.001 | Train Acc: 89.250 | Val Loss: 0.002 | Val Acc: 79.197
Training:
Accuracies by groups:
0, 0  acc: 44704 / 51421 =  86.937
0, 1  acc: 44777 / 47014 =  95.242
1, 0  acc: 51736 / 58366 =  88.641
1, 1  acc:  4056 /  5969 =  67.951
--------------------------------------
Average acc: 145273 / 162770 =  89.250
Robust  acc:  4056 /  5969 =  67.951
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  5850 /  8535 =  68.541
0, 1  acc:  6865 /  8276 =  82.951
1, 0  acc:  2845 /  2874 =  98.991
1, 1  acc:   174 /   182 =  95.604
------------------------------------
Average acc: 15734 / 19867 =  79.197
Robust  acc:  5850 /  8535 =  68.541
------------------------------------
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 81.104
Robust Acc: 74.230 | Best Acc: 98.952
-------------------------------------
Training, Epoch 86:
Accuracies by groups:
0, 0  acc:  7250 /  9767 =  74.230
0, 1  acc:  6320 /  7535 =  83.875
1, 0  acc:  2454 /  2480 =  98.952
1, 1  acc:   166 /   180 =  92.222
------------------------------------
Average acc: 16190 / 19962 =  81.104
Robust  acc:  7250 /  9767 =  74.230
------------------------------------
Accuracies by groups:
0, 0  acc:  7250 /  9767 =  74.230
0, 1  acc:  6320 /  7535 =  83.875
1, 0  acc:  2454 /  2480 =  98.952
1, 1  acc:   166 /   180 =  92.222
------------------------------------
Average acc: 16190 / 19962 =  81.104
Robust  acc:  7250 /  9767 =  74.230
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  7250 /  9767 =  74.230
0, 1  acc:  6320 /  7535 =  83.875
1, 0  acc:  2454 /  2480 =  98.952
1, 1  acc:   166 /   180 =  92.222
------------------------------------
Average acc: 16190 / 19962 =  81.104
Robust  acc:  7250 /  9767 =  74.230
------------------------------------
Epoch:  88 | Train Loss: 0.001 | Train Acc: 89.247 | Val Loss: 0.001 | Val Acc: 92.087
Training:
Accuracies by groups:
0, 0  acc: 44266 / 50893 =  86.979
0, 1  acc: 45002 / 47230 =  95.283
1, 0  acc: 51962 / 58570 =  88.718
1, 1  acc:  4038 /  6077 =  66.447
--------------------------------------
Average acc: 145268 / 162770 =  89.247
Robust  acc:  4038 /  6077 =  66.447
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7520 /  8535 =  88.108
0, 1  acc:  7969 /  8276 =  96.290
1, 0  acc:  2685 /  2874 =  93.424
1, 1  acc:   121 /   182 =  66.484
------------------------------------
Average acc: 18295 / 19867 =  92.087
Robust  acc:   121 /   182 =  66.484
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 92.781
Robust Acc: 65.556 | Best Acc: 96.417
-------------------------------------
Training, Epoch 87:
Accuracies by groups:
0, 0  acc:  8864 /  9767 =  90.755
0, 1  acc:  7265 /  7535 =  96.417
1, 0  acc:  2274 /  2480 =  91.694
1, 1  acc:   118 /   180 =  65.556
------------------------------------
Average acc: 18521 / 19962 =  92.781
Robust  acc:   118 /   180 =  65.556
------------------------------------
Accuracies by groups:
0, 0  acc:  8864 /  9767 =  90.755
0, 1  acc:  7265 /  7535 =  96.417
1, 0  acc:  2274 /  2480 =  91.694
1, 1  acc:   118 /   180 =  65.556
------------------------------------
Average acc: 18521 / 19962 =  92.781
Robust  acc:   118 /   180 =  65.556
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8864 /  9767 =  90.755
0, 1  acc:  7265 /  7535 =  96.417
1, 0  acc:  2274 /  2480 =  91.694
1, 1  acc:   118 /   180 =  65.556
------------------------------------
Average acc: 18521 / 19962 =  92.781
Robust  acc:   118 /   180 =  65.556
------------------------------------
Epoch:  89 | Train Loss: 0.001 | Train Acc: 89.276 | Val Loss: 0.001 | Val Acc: 92.450
Training:
Accuracies by groups:
0, 0  acc: 44431 / 51047 =  87.039
0, 1  acc: 45021 / 47353 =  95.075
1, 0  acc: 51766 / 58395 =  88.648
1, 1  acc:  4096 /  5975 =  68.552
--------------------------------------
Average acc: 145314 / 162770 =  89.276
Robust  acc:  4096 /  5975 =  68.552
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7560 /  8535 =  88.576
0, 1  acc:  8038 /  8276 =  97.124
1, 0  acc:  2656 /  2874 =  92.415
1, 1  acc:   113 /   182 =  62.088
------------------------------------
Average acc: 18367 / 19867 =  92.450
Robust  acc:   113 /   182 =  62.088
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.267
Robust Acc: 58.333 | Best Acc: 97.399
-------------------------------------
Training, Epoch 88:
Accuracies by groups:
0, 0  acc:  8900 /  9767 =  91.123
0, 1  acc:  7339 /  7535 =  97.399
1, 0  acc:  2274 /  2480 =  91.694
1, 1  acc:   105 /   180 =  58.333
------------------------------------
Average acc: 18618 / 19962 =  93.267
Robust  acc:   105 /   180 =  58.333
------------------------------------
Accuracies by groups:
0, 0  acc:  8900 /  9767 =  91.123
0, 1  acc:  7339 /  7535 =  97.399
1, 0  acc:  2274 /  2480 =  91.694
1, 1  acc:   105 /   180 =  58.333
------------------------------------
Average acc: 18618 / 19962 =  93.267
Robust  acc:   105 /   180 =  58.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8900 /  9767 =  91.123
0, 1  acc:  7339 /  7535 =  97.399
1, 0  acc:  2274 /  2480 =  91.694
1, 1  acc:   105 /   180 =  58.333
------------------------------------
Average acc: 18618 / 19962 =  93.267
Robust  acc:   105 /   180 =  58.333
------------------------------------
Epoch:  90 | Train Loss: 0.001 | Train Acc: 89.358 | Val Loss: 0.001 | Val Acc: 89.505
Training:
Accuracies by groups:
0, 0  acc: 44819 / 51457 =  87.100
0, 1  acc: 44813 / 47151 =  95.041
1, 0  acc: 51920 / 58422 =  88.871
1, 1  acc:  3896 /  5740 =  67.875
--------------------------------------
Average acc: 145448 / 162770 =  89.358
Robust  acc:  3896 /  5740 =  67.875
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7106 /  8535 =  83.257
0, 1  acc:  7765 /  8276 =  93.826
1, 0  acc:  2763 /  2874 =  96.138
1, 1  acc:   148 /   182 =  81.319
------------------------------------
Average acc: 17782 / 19867 =  89.505
Robust  acc:   148 /   182 =  81.319
------------------------------------
New max robust acc: 81.31868131868131
- Saving best checkpoint at epoch 89
replace: True
-> Updating checkpoint cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=74-cpre=-1-cpb=-1.pt...
Checkpoint saved at ./model/celebA/config/cp-debias-wga-best-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=89-cpre=-1-cpb=-1.pt
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 90.617
Robust Acc: 76.111 | Best Acc: 95.323
-------------------------------------
Training, Epoch 89:
Accuracies by groups:
0, 0  acc:  8497 /  9767 =  86.997
0, 1  acc:  7091 /  7535 =  94.107
1, 0  acc:  2364 /  2480 =  95.323
1, 1  acc:   137 /   180 =  76.111
------------------------------------
Average acc: 18089 / 19962 =  90.617
Robust  acc:   137 /   180 =  76.111
------------------------------------
Accuracies by groups:
0, 0  acc:  8497 /  9767 =  86.997
0, 1  acc:  7091 /  7535 =  94.107
1, 0  acc:  2364 /  2480 =  95.323
1, 1  acc:   137 /   180 =  76.111
------------------------------------
Average acc: 18089 / 19962 =  90.617
Robust  acc:   137 /   180 =  76.111
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8497 /  9767 =  86.997
0, 1  acc:  7091 /  7535 =  94.107
1, 0  acc:  2364 /  2480 =  95.323
1, 1  acc:   137 /   180 =  76.111
------------------------------------
Average acc: 18089 / 19962 =  90.617
Robust  acc:   137 /   180 =  76.111
------------------------------------
Epoch:  91 | Train Loss: 0.001 | Train Acc: 89.345 | Val Loss: 0.001 | Val Acc: 93.743
Training:
Accuracies by groups:
0, 0  acc: 44684 / 51312 =  87.083
0, 1  acc: 44634 / 46930 =  95.108
1, 0  acc: 52190 / 58660 =  88.970
1, 1  acc:  3919 /  5868 =  66.786
--------------------------------------
Average acc: 145427 / 162770 =  89.345
Robust  acc:  3919 /  5868 =  66.786
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8216 /  8535 =  96.262
0, 1  acc:  8215 /  8276 =  99.263
1, 0  acc:  2138 /  2874 =  74.391
1, 1  acc:    55 /   182 =  30.220
------------------------------------
Average acc: 18624 / 19867 =  93.743
Robust  acc:    55 /   182 =  30.220
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.289
Robust Acc: 27.778 | Best Acc: 99.509
-------------------------------------
Training, Epoch 90:
Accuracies by groups:
0, 0  acc:  9499 /  9767 =  97.256
0, 1  acc:  7498 /  7535 =  99.509
1, 0  acc:  1775 /  2480 =  71.573
1, 1  acc:    50 /   180 =  27.778
------------------------------------
Average acc: 18822 / 19962 =  94.289
Robust  acc:    50 /   180 =  27.778
------------------------------------
Accuracies by groups:
0, 0  acc:  9499 /  9767 =  97.256
0, 1  acc:  7498 /  7535 =  99.509
1, 0  acc:  1775 /  2480 =  71.573
1, 1  acc:    50 /   180 =  27.778
------------------------------------
Average acc: 18822 / 19962 =  94.289
Robust  acc:    50 /   180 =  27.778
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9499 /  9767 =  97.256
0, 1  acc:  7498 /  7535 =  99.509
1, 0  acc:  1775 /  2480 =  71.573
1, 1  acc:    50 /   180 =  27.778
------------------------------------
Average acc: 18822 / 19962 =  94.289
Robust  acc:    50 /   180 =  27.778
------------------------------------
Epoch:  92 | Train Loss: 0.001 | Train Acc: 89.545 | Val Loss: 0.001 | Val Acc: 90.572
Training:
Accuracies by groups:
0, 0  acc: 44518 / 51235 =  86.890
0, 1  acc: 45207 / 47470 =  95.233
1, 0  acc: 51924 / 58053 =  89.442
1, 1  acc:  4103 /  6012 =  68.247
--------------------------------------
Average acc: 145752 / 162770 =  89.545
Robust  acc:  4103 /  6012 =  68.247
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7271 /  8535 =  85.190
0, 1  acc:  7885 /  8276 =  95.275
1, 0  acc:  2706 /  2874 =  94.154
1, 1  acc:   132 /   182 =  72.527
------------------------------------
Average acc: 17994 / 19867 =  90.572
Robust  acc:   132 /   182 =  72.527
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.774
Robust Acc: 66.111 | Best Acc: 96.218
-------------------------------------
Training, Epoch 91:
Accuracies by groups:
0, 0  acc:  8631 /  9767 =  88.369
0, 1  acc:  7250 /  7535 =  96.218
1, 0  acc:  2320 /  2480 =  93.548
1, 1  acc:   119 /   180 =  66.111
------------------------------------
Average acc: 18320 / 19962 =  91.774
Robust  acc:   119 /   180 =  66.111
------------------------------------
Accuracies by groups:
0, 0  acc:  8631 /  9767 =  88.369
0, 1  acc:  7250 /  7535 =  96.218
1, 0  acc:  2320 /  2480 =  93.548
1, 1  acc:   119 /   180 =  66.111
------------------------------------
Average acc: 18320 / 19962 =  91.774
Robust  acc:   119 /   180 =  66.111
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8631 /  9767 =  88.369
0, 1  acc:  7250 /  7535 =  96.218
1, 0  acc:  2320 /  2480 =  93.548
1, 1  acc:   119 /   180 =  66.111
------------------------------------
Average acc: 18320 / 19962 =  91.774
Robust  acc:   119 /   180 =  66.111
------------------------------------
Epoch:  93 | Train Loss: 0.001 | Train Acc: 89.448 | Val Loss: 0.001 | Val Acc: 93.864
Training:
Accuracies by groups:
0, 0  acc: 44536 / 51274 =  86.859
0, 1  acc: 44917 / 47151 =  95.262
1, 0  acc: 52078 / 58422 =  89.141
1, 1  acc:  4063 /  5923 =  68.597
--------------------------------------
Average acc: 145594 / 162770 =  89.448
Robust  acc:  4063 /  5923 =  68.597
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8003 /  8535 =  93.767
0, 1  acc:  8163 /  8276 =  98.635
1, 0  acc:  2408 /  2874 =  83.786
1, 1  acc:    74 /   182 =  40.659
------------------------------------
Average acc: 18648 / 19867 =  93.864
Robust  acc:    74 /   182 =  40.659
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.575
Robust Acc: 41.667 | Best Acc: 98.792
-------------------------------------
Training, Epoch 92:
Accuracies by groups:
0, 0  acc:  9324 /  9767 =  95.464
0, 1  acc:  7444 /  7535 =  98.792
1, 0  acc:  2036 /  2480 =  82.097
1, 1  acc:    75 /   180 =  41.667
------------------------------------
Average acc: 18879 / 19962 =  94.575
Robust  acc:    75 /   180 =  41.667
------------------------------------
Accuracies by groups:
0, 0  acc:  9324 /  9767 =  95.464
0, 1  acc:  7444 /  7535 =  98.792
1, 0  acc:  2036 /  2480 =  82.097
1, 1  acc:    75 /   180 =  41.667
------------------------------------
Average acc: 18879 / 19962 =  94.575
Robust  acc:    75 /   180 =  41.667
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9324 /  9767 =  95.464
0, 1  acc:  7444 /  7535 =  98.792
1, 0  acc:  2036 /  2480 =  82.097
1, 1  acc:    75 /   180 =  41.667
------------------------------------
Average acc: 18879 / 19962 =  94.575
Robust  acc:    75 /   180 =  41.667
------------------------------------
Epoch:  94 | Train Loss: 0.001 | Train Acc: 89.660 | Val Loss: 0.001 | Val Acc: 92.374
Training:
Accuracies by groups:
0, 0  acc: 44635 / 51251 =  87.091
0, 1  acc: 45015 / 47265 =  95.240
1, 0  acc: 52135 / 58277 =  89.461
1, 1  acc:  4154 /  5977 =  69.500
--------------------------------------
Average acc: 145939 / 162770 =  89.660
Robust  acc:  4154 /  5977 =  69.500
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8311 /  8535 =  97.376
0, 1  acc:  8241 /  8276 =  99.577
1, 0  acc:  1760 /  2874 =  61.239
1, 1  acc:    40 /   182 =  21.978
------------------------------------
Average acc: 18352 / 19867 =  92.374
Robust  acc:    40 /   182 =  21.978
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.412
Robust Acc: 19.444 | Best Acc: 99.681
-------------------------------------
Training, Epoch 93:
Accuracies by groups:
0, 0  acc:  9583 /  9767 =  98.116
0, 1  acc:  7511 /  7535 =  99.681
1, 0  acc:  1518 /  2480 =  61.210
1, 1  acc:    35 /   180 =  19.444
------------------------------------
Average acc: 18647 / 19962 =  93.412
Robust  acc:    35 /   180 =  19.444
------------------------------------
Accuracies by groups:
0, 0  acc:  9583 /  9767 =  98.116
0, 1  acc:  7511 /  7535 =  99.681
1, 0  acc:  1518 /  2480 =  61.210
1, 1  acc:    35 /   180 =  19.444
------------------------------------
Average acc: 18647 / 19962 =  93.412
Robust  acc:    35 /   180 =  19.444
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9583 /  9767 =  98.116
0, 1  acc:  7511 /  7535 =  99.681
1, 0  acc:  1518 /  2480 =  61.210
1, 1  acc:    35 /   180 =  19.444
------------------------------------
Average acc: 18647 / 19962 =  93.412
Robust  acc:    35 /   180 =  19.444
------------------------------------
Epoch:  95 | Train Loss: 0.001 | Train Acc: 89.548 | Val Loss: 0.001 | Val Acc: 93.341
Training:
Accuracies by groups:
0, 0  acc: 44644 / 51416 =  86.829
0, 1  acc: 45225 / 47485 =  95.241
1, 0  acc: 51894 / 58039 =  89.412
1, 1  acc:  3995 /  5830 =  68.525
--------------------------------------
Average acc: 145758 / 162770 =  89.548
Robust  acc:  3995 /  5830 =  68.525
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7835 /  8535 =  91.798
0, 1  acc:  8064 /  8276 =  97.438
1, 0  acc:  2542 /  2874 =  88.448
1, 1  acc:   103 /   182 =  56.593
------------------------------------
Average acc: 18544 / 19867 =  93.341
Robust  acc:   103 /   182 =  56.593
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.044
Robust Acc: 58.333 | Best Acc: 97.651
-------------------------------------
Training, Epoch 94:
Accuracies by groups:
0, 0  acc:  9167 /  9767 =  93.857
0, 1  acc:  7358 /  7535 =  97.651
1, 0  acc:  2143 /  2480 =  86.411
1, 1  acc:   105 /   180 =  58.333
------------------------------------
Average acc: 18773 / 19962 =  94.044
Robust  acc:   105 /   180 =  58.333
------------------------------------
Accuracies by groups:
0, 0  acc:  9167 /  9767 =  93.857
0, 1  acc:  7358 /  7535 =  97.651
1, 0  acc:  2143 /  2480 =  86.411
1, 1  acc:   105 /   180 =  58.333
------------------------------------
Average acc: 18773 / 19962 =  94.044
Robust  acc:   105 /   180 =  58.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9167 /  9767 =  93.857
0, 1  acc:  7358 /  7535 =  97.651
1, 0  acc:  2143 /  2480 =  86.411
1, 1  acc:   105 /   180 =  58.333
------------------------------------
Average acc: 18773 / 19962 =  94.044
Robust  acc:   105 /   180 =  58.333
------------------------------------
Epoch:  96 | Train Loss: 0.001 | Train Acc: 89.437 | Val Loss: 0.001 | Val Acc: 90.411
Training:
Accuracies by groups:
0, 0  acc: 44296 / 51094 =  86.695
0, 1  acc: 45128 / 47454 =  95.098
1, 0  acc: 52082 / 58304 =  89.328
1, 1  acc:  4071 /  5918 =  68.790
--------------------------------------
Average acc: 145577 / 162770 =  89.437
Robust  acc:  4071 /  5918 =  68.790
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7222 /  8535 =  84.616
0, 1  acc:  7851 /  8276 =  94.865
1, 0  acc:  2749 /  2874 =  95.651
1, 1  acc:   140 /   182 =  76.923
------------------------------------
Average acc: 17962 / 19867 =  90.411
Robust  acc:   140 /   182 =  76.923
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.359
Robust Acc: 72.222 | Best Acc: 95.169
-------------------------------------
Training, Epoch 95:
Accuracies by groups:
0, 0  acc:  8586 /  9767 =  87.908
0, 1  acc:  7171 /  7535 =  95.169
1, 0  acc:  2350 /  2480 =  94.758
1, 1  acc:   130 /   180 =  72.222
------------------------------------
Average acc: 18237 / 19962 =  91.359
Robust  acc:   130 /   180 =  72.222
------------------------------------
Accuracies by groups:
0, 0  acc:  8586 /  9767 =  87.908
0, 1  acc:  7171 /  7535 =  95.169
1, 0  acc:  2350 /  2480 =  94.758
1, 1  acc:   130 /   180 =  72.222
------------------------------------
Average acc: 18237 / 19962 =  91.359
Robust  acc:   130 /   180 =  72.222
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  8586 /  9767 =  87.908
0, 1  acc:  7171 /  7535 =  95.169
1, 0  acc:  2350 /  2480 =  94.758
1, 1  acc:   130 /   180 =  72.222
------------------------------------
Average acc: 18237 / 19962 =  91.359
Robust  acc:   130 /   180 =  72.222
------------------------------------
Epoch:  97 | Train Loss: 0.001 | Train Acc: 89.499 | Val Loss: 0.001 | Val Acc: 94.201
Training:
Accuracies by groups:
0, 0  acc: 44642 / 51341 =  86.952
0, 1  acc: 45028 / 47387 =  95.022
1, 0  acc: 51883 / 58100 =  89.299
1, 1  acc:  4125 /  5942 =  69.421
--------------------------------------
Average acc: 145678 / 162770 =  89.499
Robust  acc:  4125 /  5942 =  69.421
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8116 /  8535 =  95.091
0, 1  acc:  8179 /  8276 =  98.828
1, 0  acc:  2346 /  2874 =  81.628
1, 1  acc:    74 /   182 =  40.659
------------------------------------
Average acc: 18715 / 19867 =  94.201
Robust  acc:    74 /   182 =  40.659
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.705
Robust Acc: 38.889 | Best Acc: 99.031
-------------------------------------
Training, Epoch 96:
Accuracies by groups:
0, 0  acc:  9414 /  9767 =  96.386
0, 1  acc:  7462 /  7535 =  99.031
1, 0  acc:  1959 /  2480 =  78.992
1, 1  acc:    70 /   180 =  38.889
------------------------------------
Average acc: 18905 / 19962 =  94.705
Robust  acc:    70 /   180 =  38.889
------------------------------------
Accuracies by groups:
0, 0  acc:  9414 /  9767 =  96.386
0, 1  acc:  7462 /  7535 =  99.031
1, 0  acc:  1959 /  2480 =  78.992
1, 1  acc:    70 /   180 =  38.889
------------------------------------
Average acc: 18905 / 19962 =  94.705
Robust  acc:    70 /   180 =  38.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9414 /  9767 =  96.386
0, 1  acc:  7462 /  7535 =  99.031
1, 0  acc:  1959 /  2480 =  78.992
1, 1  acc:    70 /   180 =  38.889
------------------------------------
Average acc: 18905 / 19962 =  94.705
Robust  acc:    70 /   180 =  38.889
------------------------------------
Epoch:  98 | Train Loss: 0.001 | Train Acc: 89.539 | Val Loss: 0.001 | Val Acc: 93.220
Training:
Accuracies by groups:
0, 0  acc: 44522 / 51263 =  86.850
0, 1  acc: 45268 / 47544 =  95.213
1, 0  acc: 51968 / 58116 =  89.421
1, 1  acc:  3984 /  5847 =  68.138
--------------------------------------
Average acc: 145742 / 162770 =  89.539
Robust  acc:  3984 /  5847 =  68.138
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7772 /  8535 =  91.060
0, 1  acc:  8076 /  8276 =  97.583
1, 0  acc:  2567 /  2874 =  89.318
1, 1  acc:   105 /   182 =  57.692
------------------------------------
Average acc: 18520 / 19867 =  93.220
Robust  acc:   105 /   182 =  57.692
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 93.984
Robust Acc: 57.778 | Best Acc: 97.638
-------------------------------------
Training, Epoch 97:
Accuracies by groups:
0, 0  acc:  9106 /  9767 =  93.232
0, 1  acc:  7357 /  7535 =  97.638
1, 0  acc:  2194 /  2480 =  88.468
1, 1  acc:   104 /   180 =  57.778
------------------------------------
Average acc: 18761 / 19962 =  93.984
Robust  acc:   104 /   180 =  57.778
------------------------------------
Accuracies by groups:
0, 0  acc:  9106 /  9767 =  93.232
0, 1  acc:  7357 /  7535 =  97.638
1, 0  acc:  2194 /  2480 =  88.468
1, 1  acc:   104 /   180 =  57.778
------------------------------------
Average acc: 18761 / 19962 =  93.984
Robust  acc:   104 /   180 =  57.778
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9106 /  9767 =  93.232
0, 1  acc:  7357 /  7535 =  97.638
1, 0  acc:  2194 /  2480 =  88.468
1, 1  acc:   104 /   180 =  57.778
------------------------------------
Average acc: 18761 / 19962 =  93.984
Robust  acc:   104 /   180 =  57.778
------------------------------------
Epoch:  99 | Train Loss: 0.001 | Train Acc: 89.491 | Val Loss: 0.002 | Val Acc: 71.506
Training:
Accuracies by groups:
0, 0  acc: 43986 / 50813 =  86.564
0, 1  acc: 45366 / 47665 =  95.177
1, 0  acc: 52141 / 58206 =  89.580
1, 1  acc:  4172 /  6086 =  68.551
--------------------------------------
Average acc: 145665 / 162770 =  89.491
Robust  acc:  4172 /  6086 =  68.551
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  5127 /  8535 =  60.070
0, 1  acc:  6048 /  8276 =  73.079
1, 0  acc:  2852 /  2874 =  99.235
1, 1  acc:   179 /   182 =  98.352
------------------------------------
Average acc: 14206 / 19867 =  71.506
Robust  acc:  5127 /  8535 =  60.070
------------------------------------
-------------------------------------------
Avg Test Loss: 0.002 | Avg Test Acc: 73.505
Robust Acc: 66.540 | Best Acc: 99.315
-------------------------------------
Training, Epoch 98:
Accuracies by groups:
0, 0  acc:  6499 /  9767 =  66.540
0, 1  acc:  5537 /  7535 =  73.484
1, 0  acc:  2463 /  2480 =  99.315
1, 1  acc:   174 /   180 =  96.667
------------------------------------
Average acc: 14673 / 19962 =  73.505
Robust  acc:  6499 /  9767 =  66.540
------------------------------------
Accuracies by groups:
0, 0  acc:  6499 /  9767 =  66.540
0, 1  acc:  5537 /  7535 =  73.484
1, 0  acc:  2463 /  2480 =  99.315
1, 1  acc:   174 /   180 =  96.667
------------------------------------
Average acc: 14673 / 19962 =  73.505
Robust  acc:  6499 /  9767 =  66.540
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  6499 /  9767 =  66.540
0, 1  acc:  5537 /  7535 =  73.484
1, 0  acc:  2463 /  2480 =  99.315
1, 1  acc:   174 /   180 =  96.667
------------------------------------
Average acc: 14673 / 19962 =  73.505
Robust  acc:  6499 /  9767 =  66.540
------------------------------------
Epoch: 100 | Train Loss: 0.001 | Train Acc: 89.631 | Val Loss: 0.001 | Val Acc: 93.688
Training:
Accuracies by groups:
0, 0  acc: 44447 / 51070 =  87.032
0, 1  acc: 44765 / 46969 =  95.308
1, 0  acc: 52672 / 58873 =  89.467
1, 1  acc:  4009 /  5858 =  68.436
--------------------------------------
Average acc: 145893 / 162770 =  89.631
Robust  acc:  4009 /  5858 =  68.436
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  7846 /  8535 =  91.927
0, 1  acc:  8117 /  8276 =  98.079
1, 0  acc:  2562 /  2874 =  89.144
1, 1  acc:    88 /   182 =  48.352
------------------------------------
Average acc: 18613 / 19867 =  93.688
Robust  acc:    88 /   182 =  48.352
------------------------------------
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.304
Robust Acc: 50.556 | Best Acc: 98.142
-------------------------------------
Training, Epoch 99:
Accuracies by groups:
0, 0  acc:  9185 /  9767 =  94.041
0, 1  acc:  7395 /  7535 =  98.142
1, 0  acc:  2154 /  2480 =  86.855
1, 1  acc:    91 /   180 =  50.556
------------------------------------
Average acc: 18825 / 19962 =  94.304
Robust  acc:    91 /   180 =  50.556
------------------------------------
Accuracies by groups:
0, 0  acc:  9185 /  9767 =  94.041
0, 1  acc:  7395 /  7535 =  98.142
1, 0  acc:  2154 /  2480 =  86.855
1, 1  acc:    91 /   180 =  50.556
------------------------------------
Average acc: 18825 / 19962 =  94.304
Robust  acc:    91 /   180 =  50.556
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9185 /  9767 =  94.041
0, 1  acc:  7395 /  7535 =  98.142
1, 0  acc:  2154 /  2480 =  86.855
1, 1  acc:    91 /   180 =  50.556
------------------------------------
Average acc: 18825 / 19962 =  94.304
Robust  acc:    91 /   180 =  50.556
------------------------------------
replace: True
Checkpoint saved at ./model/celebA/config/cp-debias-end-cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=100-bst=256-o=sgd-lr=1e-05-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=0-r=0-cpe=99-cpre=-1-cpb=-1.pt
