Experiments / Detail
Run #1 test1
Status
Completed
Loss: 0.89096
Could not find config for 'default' in settings.STORAGES.
Hyperparameters
Input Dimension
768
Expansion Factor
4x
Latent Dimension
3072
K-Sparsity
32
Alpha Aux
0.03
Learning Rate
0.0001
Epochs
20
Training Log
20 steps| Epoch | Loss Value | Timestamp |
|---|---|---|
| #1 |
1.03772
|
|
| #2 |
1.02968
|
|
| #3 |
1.02247
|
|
| #4 |
1.01563
|
|
| #5 |
1.00903
|
|
| #6 |
1.00248
|
|
| #7 |
0.99608
|
|
| #8 |
0.98967
|
|
| #9 |
0.98327
|
|
| #10 |
0.97642
|
|
| #11 |
0.96949
|
|
| #12 |
0.96233
|
|
| #13 |
0.95469
|
|
| #14 |
0.94671
|
|
| #15 |
0.93844
|
|
| #16 |
0.92983
|
|
| #17 |
0.92072
|
|
| #18 |
0.91118
|
|
| #19 |
0.90140
|
|
| #20 |
0.89096
|