Arch: resnet50_pt
Bs trn: 128
Bs val: 128
Hidden dim: 256
Dataset: celebA
Resample class: 
Slice with: rep
Rep cluster method: gmm
Num anchor: 32
Num positive: 32
Num negative: 32
Num negative easy: 0
Weight anc by loss: False
Weight pos by loss: False
Weight neg by loss: False
Anc loss temp: 0.5
Pos loss temp: 0.5
Neg loss temp: 0.5
Data wide pos: False
Target sample ratio: 1
Balance targets: False
Additional negatives: False
Hard negative factor: 0
Full contrastive: False
Train encoder: False
No projection head: False
Projection dim: 128
Batch factor: None
Temperature: 0.05
Single pos: False
Supervised linear scale up: False
Supervised update delay: 0
Contrastive weight: 0.5
Classifier update interval: 8
Optim: sgd
Max epoch: 5
Lr: 0.0001
Momentum: 0.9
Weight decay: 0.1
Weight decay c: 0.1
Stopping window: 30
Load encoder: 
Freeze encoder: False
Finetune epochs: 0
Clip grad norm: False
Lr scheduler classifier: 
Lr scheduler: 
Grad clip grad norm: False
Erm: False
Erm only: False
Pretrained spurious path: 
Max epoch s: 1
Bs trn s: 32
Lr s: 0.001
Momentum s: 0.9
Weight decay s: 0.0005
Slice temp: 10
Log loss interval: 10
Checkpoint interval: 50
Grad checkpoint interval: 50
Log visual interval: 100
Log grad visual interval: 50
Verbose: True
Seed: 25
Replicate: 0
No cuda: False
Resume: False
New slice: False
Num workers: 12
Evaluate: False
Data cmap: hsv
Test cmap: 
P correlation: 0.9
P corr by class: None
Train classes: ['blond', 'nonblond']
Train class ratios: None
Test shift: random
Flipped: False
Q: 0.7
Pretrained bmodel: False
Cosine: False
Exp: stage_one_erm
Supervised contrast: True
Prioritize spurious pos: False
Contrastive type: cnc
Compute auroc: False
Model type: resnet50_pt_cnc
Criterion: cross_entropy
Pretrained: False
Max grad norm: 1.0
Adam epsilon: 1e-08
Warmup steps: 0
Max grad norm s: 1.0
Adam epsilon s: 1e-08
Warmup steps s: 0
Grad max grad norm: 1.0
Grad adam epsilon: 1e-08
Grad warmup steps: 0
Device: cuda
Img file type: .png
Display image: False
Image path: ./images/celebA/celebA/config/contrastive_umaps
Log interval: 1
Log path: ./logs/celebA/config
Results path: ./results/celebA/config
Model path: ./model/celebA/config
Loss factor: 1
Supersample labels: False
Subsample labels: False
Weigh slice samples by loss: True
Val split: 0.2
Spurious train split: 0.2
Subsample groups: False
Train method: sc
Max robust acc: -1
Max robust epoch: -1
Max robust group acc: (None, None)
Root dir: ./datasets/data/CelebA/
Target name: Blond_Hair
Confounder names: ['Male']
Image mean: 0.449
Image std: 0.226
Augment data: False
Task: celebA
Num classes: 2
Experiment configs: config
Experiment name: cnc-celebA-sw=re-na=32-np=32-nn=32-nne=0-tsr=1-t=0.05-bf=None-cw=0.5-sud=0-me=5-bst=128-o=sgd-lr=0.0001-mo=0.9-wd=0.1-wdc=0.1-spur-me=1-bst=32-lr=0.001-mo=0.9-wd=0.0005-sts=0.2-s=25-r=0
Mi resampled: None

Loading checkpoints for train split:
[-1 -1 -1 ... -1 -1 -1]
<class 'numpy.ndarray'>
[0 1 2 3] [71629 66874 22880  1387]
Loading checkpoints for val split:
[-1 -1 -1 ... -1  1 -1]
<class 'numpy.ndarray'>
[0 1 2 3] [8535 8276 2874  182]
Loading checkpoints for test split:
[-1 -1 -1 ... -1 -1  1]
<class 'numpy.ndarray'>
[0 1 2 3] [9767 7535 2480  180]
Train dataset:
    Blond_Hair = 0, Male = 0 : n = 71629
    Blond_Hair = 0, Male = 1 : n = 66874
    Blond_Hair = 1, Male = 0 : n = 22880
    Blond_Hair = 1, Male = 1 : n = 1387
Val dataset:
    Blond_Hair = 0, Male = 0 : n = 8535
    Blond_Hair = 0, Male = 1 : n = 8276
    Blond_Hair = 1, Male = 0 : n = 2874
    Blond_Hair = 1, Male = 1 : n = 182
Test dataset:
    Blond_Hair = 0, Male = 0 : n = 9767
    Blond_Hair = 0, Male = 1 : n = 7535
    Blond_Hair = 1, Male = 0 : n = 2480
    Blond_Hair = 1, Male = 1 : n = 180
Pretrained model loaded from 
Epoch:   1 | Train Loss: 0.000 | Train Acc: 84.570 | Val Loss: 0.003 | Val Acc: 84.618
Training:
Accuracies by groups:
0, 0  acc: 71112 / 71629 =  99.278
0, 1  acc: 66403 / 66874 =  99.296
1, 0  acc:   134 / 22880 =   0.586
1, 1  acc:     6 /  1387 =   0.433
--------------------------------------
Average acc: 137655 / 162770 =  84.570
Robust  acc:     6 /  1387 =   0.433
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8535 /  8535 = 100.000
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:     0 /  2874 =   0.000
1, 1  acc:     0 /   182 =   0.000
------------------------------------
Average acc: 16811 / 19867 =  84.618
Robust  acc:     0 /  2874 =   0.000
------------------------------------
Save biased model at epoch 0
replace: True
Checkpoint saved at ./model/celebA/config/stage_one_erm_model_b_epoch0_seed25.pt
New max average-worst acc gap: 84.61770775658127
bias model - Saving best checkpoint at epoch 0
replace: True
Checkpoint saved at ./model/celebA/config/stage_one_erm_model_b_worst_avg_gap_best_epoch0_seed25.pt
-------------------------------------------
Avg Test Loss: 0.003 | Avg Test Acc: 86.675
Robust Acc: 0.000 | Best Acc: 100.000
-------------------------------------
Training, Epoch 0:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9767 /  9767 = 100.000
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:     0 /  2480 =   0.000
1, 1  acc:     0 /   180 =   0.000
------------------------------------
Average acc: 17302 / 19962 =  86.675
Robust  acc:     0 /  2480 =   0.000
------------------------------------
Epoch:   2 | Train Loss: 0.001 | Train Acc: 86.678 | Val Loss: 0.002 | Val Acc: 91.227
Training:
Accuracies by groups:
0, 0  acc: 71428 / 71629 =  99.719
0, 1  acc: 66870 / 66874 =  99.994
1, 0  acc:  2783 / 22880 =  12.163
1, 1  acc:     5 /  1387 =   0.360
--------------------------------------
Average acc: 141086 / 162770 =  86.678
Robust  acc:     5 /  1387 =   0.360
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8315 /  8535 =  97.422
0, 1  acc:  8276 /  8276 = 100.000
1, 0  acc:  1528 /  2874 =  53.166
1, 1  acc:     5 /   182 =   2.747
------------------------------------
Average acc: 18124 / 19867 =  91.227
Robust  acc:     5 /   182 =   2.747
------------------------------------
Save biased model at epoch 1
replace: True
Checkpoint saved at ./model/celebA/config/stage_one_erm_model_b_epoch1_seed25.pt
New max average-worst acc gap: 88.47940452359842
bias model - Saving best checkpoint at epoch 1
replace: True
Checkpoint saved at ./model/celebA/config/stage_one_erm_model_b_worst_avg_gap_best_epoch1_seed25.pt
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 91.935
Robust Acc: 6.111 | Best Acc: 100.000
-------------------------------------
Training, Epoch 1:
Accuracies by groups:
0, 0  acc:  9616 /  9767 =  98.454
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:  1190 /  2480 =  47.984
1, 1  acc:    11 /   180 =   6.111
------------------------------------
Average acc: 18352 / 19962 =  91.935
Robust  acc:    11 /   180 =   6.111
------------------------------------
Accuracies by groups:
0, 0  acc:  9616 /  9767 =  98.454
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:  1190 /  2480 =  47.984
1, 1  acc:    11 /   180 =   6.111
------------------------------------
Average acc: 18352 / 19962 =  91.935
Robust  acc:    11 /   180 =   6.111
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9616 /  9767 =  98.454
0, 1  acc:  7535 /  7535 = 100.000
1, 0  acc:  1190 /  2480 =  47.984
1, 1  acc:    11 /   180 =   6.111
------------------------------------
Average acc: 18352 / 19962 =  91.935
Robust  acc:    11 /   180 =   6.111
------------------------------------
Epoch:   3 | Train Loss: 0.000 | Train Acc: 92.855 | Val Loss: 0.001 | Val Acc: 93.955
Training:
Accuracies by groups:
0, 0  acc: 69436 / 71629 =  96.938
0, 1  acc: 66754 / 66874 =  99.821
1, 0  acc: 14797 / 22880 =  64.672
1, 1  acc:   153 /  1387 =  11.031
--------------------------------------
Average acc: 151140 / 162770 =  92.855
Robust  acc:   153 /  1387 =  11.031
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8109 /  8535 =  95.009
0, 1  acc:  8258 /  8276 =  99.783
1, 0  acc:  2273 /  2874 =  79.088
1, 1  acc:    26 /   182 =  14.286
------------------------------------
Average acc: 18666 / 19867 =  93.955
Robust  acc:    26 /   182 =  14.286
------------------------------------
Save biased model at epoch 2
replace: True
Checkpoint saved at ./model/celebA/config/stage_one_erm_model_b_epoch2_seed25.pt
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.274
Robust Acc: 18.889 | Best Acc: 99.907
-------------------------------------
Training, Epoch 2:
Accuracies by groups:
0, 0  acc:  9411 /  9767 =  96.355
0, 1  acc:  7528 /  7535 =  99.907
1, 0  acc:  1846 /  2480 =  74.435
1, 1  acc:    34 /   180 =  18.889
------------------------------------
Average acc: 18819 / 19962 =  94.274
Robust  acc:    34 /   180 =  18.889
------------------------------------
Accuracies by groups:
0, 0  acc:  9411 /  9767 =  96.355
0, 1  acc:  7528 /  7535 =  99.907
1, 0  acc:  1846 /  2480 =  74.435
1, 1  acc:    34 /   180 =  18.889
------------------------------------
Average acc: 18819 / 19962 =  94.274
Robust  acc:    34 /   180 =  18.889
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9411 /  9767 =  96.355
0, 1  acc:  7528 /  7535 =  99.907
1, 0  acc:  1846 /  2480 =  74.435
1, 1  acc:    34 /   180 =  18.889
------------------------------------
Average acc: 18819 / 19962 =  94.274
Robust  acc:    34 /   180 =  18.889
------------------------------------
Epoch:   4 | Train Loss: 0.000 | Train Acc: 94.103 | Val Loss: 0.001 | Val Acc: 94.448
Training:
Accuracies by groups:
0, 0  acc: 68896 / 71629 =  96.185
0, 1  acc: 66648 / 66874 =  99.662
1, 0  acc: 17332 / 22880 =  75.752
1, 1  acc:   296 /  1387 =  21.341
--------------------------------------
Average acc: 153172 / 162770 =  94.103
Robust  acc:   296 /  1387 =  21.341
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8175 /  8535 =  95.782
0, 1  acc:  8258 /  8276 =  99.783
1, 0  acc:  2297 /  2874 =  79.923
1, 1  acc:    34 /   182 =  18.681
------------------------------------
Average acc: 18764 / 19867 =  94.448
Robust  acc:    34 /   182 =  18.681
------------------------------------
Save biased model at epoch 3
replace: True
Checkpoint saved at ./model/celebA/config/stage_one_erm_model_b_epoch3_seed25.pt
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 94.820
Robust Acc: 23.333 | Best Acc: 99.827
-------------------------------------
Training, Epoch 3:
Accuracies by groups:
0, 0  acc:  9484 /  9767 =  97.102
0, 1  acc:  7522 /  7535 =  99.827
1, 0  acc:  1880 /  2480 =  75.806
1, 1  acc:    42 /   180 =  23.333
------------------------------------
Average acc: 18928 / 19962 =  94.820
Robust  acc:    42 /   180 =  23.333
------------------------------------
Accuracies by groups:
0, 0  acc:  9484 /  9767 =  97.102
0, 1  acc:  7522 /  7535 =  99.827
1, 0  acc:  1880 /  2480 =  75.806
1, 1  acc:    42 /   180 =  23.333
------------------------------------
Average acc: 18928 / 19962 =  94.820
Robust  acc:    42 /   180 =  23.333
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9484 /  9767 =  97.102
0, 1  acc:  7522 /  7535 =  99.827
1, 0  acc:  1880 /  2480 =  75.806
1, 1  acc:    42 /   180 =  23.333
------------------------------------
Average acc: 18928 / 19962 =  94.820
Robust  acc:    42 /   180 =  23.333
------------------------------------
Epoch:   5 | Train Loss: 0.000 | Train Acc: 94.578 | Val Loss: 0.001 | Val Acc: 94.730
Training:
Accuracies by groups:
0, 0  acc: 68860 / 71629 =  96.134
0, 1  acc: 66591 / 66874 =  99.577
1, 0  acc: 18117 / 22880 =  79.183
1, 1  acc:   377 /  1387 =  27.181
--------------------------------------
Average acc: 153945 / 162770 =  94.578
Robust  acc:   377 /  1387 =  27.181
--------------------------------------
Validating:
Accuracies by groups:
0, 0  acc:  8160 /  8535 =  95.606
0, 1  acc:  8255 /  8276 =  99.746
1, 0  acc:  2367 /  2874 =  82.359
1, 1  acc:    38 /   182 =  20.879
------------------------------------
Average acc: 18820 / 19867 =  94.730
Robust  acc:    38 /   182 =  20.879
------------------------------------
Save biased model at epoch 4
replace: True
Checkpoint saved at ./model/celebA/config/stage_one_erm_model_b_epoch4_seed25.pt
-------------------------------------------
Avg Test Loss: 0.001 | Avg Test Acc: 95.216
Robust Acc: 27.222 | Best Acc: 99.761
-------------------------------------
Training, Epoch 4:
Accuracies by groups:
0, 0  acc:  9467 /  9767 =  96.928
0, 1  acc:  7517 /  7535 =  99.761
1, 0  acc:  1974 /  2480 =  79.597
1, 1  acc:    49 /   180 =  27.222
------------------------------------
Average acc: 19007 / 19962 =  95.216
Robust  acc:    49 /   180 =  27.222
------------------------------------
Accuracies by groups:
0, 0  acc:  9467 /  9767 =  96.928
0, 1  acc:  7517 /  7535 =  99.761
1, 0  acc:  1974 /  2480 =  79.597
1, 1  acc:    49 /   180 =  27.222
------------------------------------
Average acc: 19007 / 19962 =  95.216
Robust  acc:    49 /   180 =  27.222
------------------------------------
Testing:
Accuracies by groups:
0, 0  acc:  9467 /  9767 =  96.928
0, 1  acc:  7517 /  7535 =  99.761
1, 0  acc:  1974 /  2480 =  79.597
1, 1  acc:    49 /   180 =  27.222
------------------------------------
Average acc: 19007 / 19962 =  95.216
Robust  acc:    49 /   180 =  27.222
------------------------------------
replace: True
Checkpoint saved at ./model/celebA/config/bias-end_seed25.pt
training biased model is done
