Updated 29/Nov/2021 by Yoshihisa Nitta  

Further Training of Cycle Generative Adversarial Network for VidTIMIT dataset with Tensorflow 2 on Google Colab (WGAN-GP)

Assuming that you have already executed CycleGAN_VidTIMIT_Train.ipynb, further train the Model.

VidTIMIT データセットに対して Cycle Generative Adversarial Network をGoogle Colab 上の Tensorflow 2 でさらに学習させる

既に CycleGAN_VidTIMIT_Train.ipynb を実行していることを前提とし、さらに学習を進める。

In [1]:
MAX_EPOCHS = 150     # Change this value and run this ipynb many times

save_path = '/content/drive/MyDrive/ColabRun/CycleGAN_VidTIMIT01'
VERBOSE = False
In [2]:
#! pip install tensorflow==2.7.0
In [3]:
! pip install tensorflow_addons
Requirement already satisfied: tensorflow_addons in /usr/local/lib/python3.7/dist-packages (0.15.0)
Requirement already satisfied: typeguard>=2.7 in /usr/local/lib/python3.7/dist-packages (from tensorflow_addons) (2.7.1)
In [4]:
%tensorflow_version 2.x

import tensorflow as tf
print(tf.__version__)
2.7.0
In [5]:
import numpy as np

np.random.seed(2022)

Check the Google Colab runtime environment

Google Colab 実行環境を調べる

In [6]:
if VERBOSE:
    ! nvidia-smi
    ! cat /proc/cpuinfo
    ! cat /etc/issue
    ! free -h

Mount Google Drive from Google Colab

Google Colab から GoogleDrive をマウントする

In [7]:
from google.colab import drive
drive.mount('/content/drive')
Drive already mounted at /content/drive; to attempt to forcibly remount, call drive.mount("/content/drive", force_remount=True).
In [8]:
if VERBOSE:
    ! ls /content/drive

Download source file from Google Drive or nw.tsuda.ac.jp

Basically, gdown from Google Drive. Download from nw.tsuda.ac.jp above only if the specifications of Google Drive change and you cannot download from Google Drive.

Google Drive または nw.tsuda.ac.jp からファイルをダウンロードする

基本的に、Google Drive から gdown してください。 Google Drive の仕様が変わってダウンロードができない場合にのみ、nw.tsuda.ac.jp からダウンロードしてください。

In [9]:
# Download source file
nw_path = './nw'
! rm -rf {nw_path}
! mkdir -p {nw_path}

if True:   # from Google Drive
    url_model =  'https://drive.google.com/uc?id=1aNvpPDNeDWYQFu_PA1kOtFlzcO5seHky'
    ! (cd {nw_path}; gdown {url_model})
else:      # from nw.tsuda.ac.jp
    URL_NW = 'https://nw.tsuda.ac.jp/lec/GoogleColab/pub'
    url_model = f'{URL_NW}/models/CycleGAN.py'
    ! wget -nd {url_model} -P {nw_path}
Downloading...
From: https://drive.google.com/uc?id=1aNvpPDNeDWYQFu_PA1kOtFlzcO5seHky
To: /content/nw/CycleGAN.py
100% 24.6k/24.6k [00:00<00:00, 21.4MB/s]
In [10]:
if VERBOSE:
    ! cat {nw_path}/CycleGAN.py

Preparing VidTIMIT dataset

Official WWW of VidTIMIT dataset: http://conradsanderson.id.au/vidtimit/

zip files of 2 persons of VidTIMIT dataset:
https://zenodo.org/record/158963/files/fadg0.zip
https://zenodo.org/record/158963/files/faks0.zip

zip files mirrored on my Google Drive:
https://drive.google.com/uc?id=

VidTIMIT データセットを用意する

VidTIMIT データセットの公式ページ: http://conradsanderson.id.au/vidtimit/

VidTIMIT の2名の顔写真の zip ファイル:
https://zenodo.org/record/158963/files/fadg0.zip
https://zenodo.org/record/158963/files/faks0.zip

自分の Google Drive 上にミラーした顔写真:
https://drive.google.com/uc?id= https://drive.google.com/uc?id=

In [11]:
# Download zip files
VidTIMIT_site = 'https://zenodo.org/record/158963/files/'
VidTIMIT_fnames = [ 'fadg0', 'faks0']

Mirrored_files = [
    'https://drive.google.com/uc?id=1_Fv4p9MDNphMZMnLpEvtCtnwXgN8N5Cj', 
    'https://drive.google.com/uc?id=1Y8j7ThPVqB0gbx4hb9aMEp9Ptr9wFuoz'
]

data_dir = './datasets'
! rm -rf $data_dir
! mkdir -p $data_dir

for i, fname in enumerate(VidTIMIT_fnames):
    fzip = fname + '.zip'
    if False:
        url = VidTIMIT_site + fzip
        !wget {url}
    else:
        url = Mirrored_files[i]
        !gdown {url}

    !unzip -q {fzip} -d {data_dir}
Downloading...
From: https://drive.google.com/uc?id=1_Fv4p9MDNphMZMnLpEvtCtnwXgN8N5Cj
To: /content/fadg0.zip
100% 81.6M/81.6M [00:00<00:00, 260MB/s]
Downloading...
From: https://drive.google.com/uc?id=1Y8j7ThPVqB0gbx4hb9aMEp9Ptr9wFuoz
To: /content/faks0.zip
100% 64.2M/64.2M [00:00<00:00, 201MB/s]

Make DataGenerator from the images of VidTIMIT

VidTIMIT の画像ファイルから DataGenerator を作る

In [12]:
IMAGE_SIZE = 128
In [13]:
import os
import glob

imgA_paths = glob.glob(os.path.join(data_dir, VidTIMIT_fnames[0], 'video/*/[0-9]*'))
imgB_paths = glob.glob(os.path.join(data_dir, VidTIMIT_fnames[1], 'video/*/[0-9]*'))
In [14]:
import numpy as np

validation_split = 0.05

nA, nB = len(imgA_paths), len(imgB_paths)
splitA = int(nA * (1 - validation_split))
splitB = int(nB * (1 - validation_split))

np.random.shuffle(imgA_paths)
np.random.shuffle(imgB_paths)

train_imgA_paths = imgA_paths[:splitA]
test_imgA_paths = imgA_paths[splitA:]
train_imgB_paths = imgB_paths[:splitB]
test_imgB_paths = imgB_paths[splitB:]
In [15]:
# Image: [-1, 1] --> [0, 1]
def M1P1_ZeroP1(imgs):
    imgs = (imgs + 1) * 0.5
    return np.clip(imgs, 0, 1)

# Image: [0, 1] --> [-1, 1]
def ZeroP1_M1P1(imgs):
    return imgs * 2 - 1
In [16]:
from nw.CycleGAN import PairDataset

pair_flow = PairDataset(train_imgA_paths, train_imgB_paths, target_size=(IMAGE_SIZE, IMAGE_SIZE))
test_pair_flow = PairDataset(test_imgA_paths, test_imgB_paths, target_size=(IMAGE_SIZE, IMAGE_SIZE))

Define the Neural Network Model

ニューラルネットワーク・モデルを定義する

In [17]:
from nw.CycleGAN import CycleGAN

gan = CycleGAN.load(save_path)

print(gan.epoch)
5

Train

訓練する

Further Training

さらに学習を進める

In [18]:
gan.train(
    pair_flow,
    epochs = MAX_EPOCHS,
    batch_size=1,
    run_folder = save_path,
    print_step_interval = 1000,
    save_epoch_interval = 50
)
WARNING:tensorflow:5 out of the last 5 calls to <function Model.make_train_function.<locals>.train_function at 0x7f561bd5d170> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/guide/function#controlling_retracing and https://www.tensorflow.org/api_docs/python/tf/function for  more details.
Epoch 6/150 1000/2595 [D loss: 0.062 acc: 1.000][G loss: 2.184 adv: 1.268 recon: 0.076 id: 0.076 time: 0:03:13.098820
Epoch 6/150 2000/2595 [D loss: 0.095 acc: 0.863][G loss: 2.319 adv: 1.147 recon: 0.098 id: 0.094 time: 0:06:14.734277
Epoch 6/150 [D loss: 0.079 acc: 0.927][G loss: 1.962 adv: 1.003 recon: 0.080 id: 0.079 time: 0:08:02.714840
Epoch 7/150 1000/2595 [D loss: 0.043 acc: 0.984][G loss: 2.668 adv: 1.744 recon: 0.077 id: 0.076 time: 0:11:03.594376
Epoch 7/150 2000/2595 [D loss: 0.034 acc: 0.995][G loss: 1.695 adv: 0.578 recon: 0.093 id: 0.092 time: 0:14:06.746020
Epoch 7/150 [D loss: 0.073 acc: 0.935][G loss: 2.009 adv: 1.061 recon: 0.079 id: 0.078 time: 0:15:55.227086
Epoch 8/150 1000/2595 [D loss: 0.060 acc: 0.981][G loss: 2.155 adv: 1.214 recon: 0.079 id: 0.078 time: 0:18:58.266541
Epoch 8/150 2000/2595 [D loss: 0.104 acc: 0.935][G loss: 3.006 adv: 1.872 recon: 0.094 id: 0.095 time: 0:22:02.163284
Epoch 8/150 [D loss: 0.075 acc: 0.934][G loss: 2.003 adv: 1.068 recon: 0.078 id: 0.077 time: 0:23:51.079122
Epoch 9/150 1000/2595 [D loss: 0.052 acc: 0.987][G loss: 2.040 adv: 1.105 recon: 0.079 id: 0.074 time: 0:26:54.876698
Epoch 9/150 2000/2595 [D loss: 0.122 acc: 0.847][G loss: 2.462 adv: 1.394 recon: 0.089 id: 0.089 time: 0:29:58.249684
Epoch 9/150 [D loss: 0.072 acc: 0.938][G loss: 2.009 adv: 1.087 recon: 0.077 id: 0.076 time: 0:31:48.129384
Epoch 10/150 1000/2595 [D loss: 0.032 acc: 0.994][G loss: 2.295 adv: 1.394 recon: 0.075 id: 0.075 time: 0:34:52.483878
Epoch 10/150 2000/2595 [D loss: 0.055 acc: 0.986][G loss: 2.222 adv: 1.125 recon: 0.092 id: 0.090 time: 0:37:56.018048
Epoch 10/150 [D loss: 0.070 acc: 0.942][G loss: 2.007 adv: 1.094 recon: 0.076 id: 0.075 time: 0:39:43.749403
Epoch 11/150 1000/2595 [D loss: 0.023 acc: 0.997][G loss: 2.208 adv: 1.331 recon: 0.073 id: 0.072 time: 0:42:45.145642
Epoch 11/150 2000/2595 [D loss: 0.072 acc: 0.935][G loss: 2.022 adv: 0.897 recon: 0.094 id: 0.090 time: 0:45:46.053091
Epoch 11/150 [D loss: 0.064 acc: 0.950][G loss: 2.058 adv: 1.153 recon: 0.076 id: 0.075 time: 0:47:34.524425
Epoch 12/150 1000/2595 [D loss: 0.019 acc: 0.998][G loss: 1.968 adv: 1.094 recon: 0.073 id: 0.071 time: 0:50:35.492434
Epoch 12/150 2000/2595 [D loss: 0.177 acc: 0.683][G loss: 2.431 adv: 1.344 recon: 0.091 id: 0.087 time: 0:53:36.317946
Epoch 12/150 [D loss: 0.068 acc: 0.943][G loss: 2.018 adv: 1.124 recon: 0.075 id: 0.074 time: 0:55:23.549150
Epoch 13/150 1000/2595 [D loss: 0.081 acc: 0.962][G loss: 2.519 adv: 1.663 recon: 0.071 id: 0.071 time: 0:58:26.072169
Epoch 13/150 2000/2595 [D loss: 0.055 acc: 0.966][G loss: 2.436 adv: 1.299 recon: 0.096 id: 0.090 time: 1:01:28.398208
Epoch 13/150 [D loss: 0.062 acc: 0.952][G loss: 2.120 adv: 1.221 recon: 0.075 id: 0.074 time: 1:03:18.003925
Epoch 14/150 1000/2595 [D loss: 0.041 acc: 1.000][G loss: 2.459 adv: 1.531 recon: 0.078 id: 0.073 time: 1:06:20.914943
Epoch 14/150 2000/2595 [D loss: 0.065 acc: 0.971][G loss: 2.499 adv: 1.427 recon: 0.089 id: 0.090 time: 1:09:25.004414
Epoch 14/150 [D loss: 0.060 acc: 0.956][G loss: 2.102 adv: 1.205 recon: 0.075 id: 0.074 time: 1:11:13.998680
Epoch 15/150 1000/2595 [D loss: 0.040 acc: 0.989][G loss: 2.237 adv: 1.358 recon: 0.073 id: 0.073 time: 1:14:18.445557
Epoch 15/150 2000/2595 [D loss: 0.028 acc: 0.997][G loss: 2.710 adv: 1.647 recon: 0.089 id: 0.088 time: 1:17:22.722413
Epoch 15/150 [D loss: 0.060 acc: 0.955][G loss: 2.121 adv: 1.232 recon: 0.074 id: 0.073 time: 1:19:12.882550
Epoch 16/150 1000/2595 [D loss: 0.045 acc: 0.977][G loss: 2.288 adv: 1.437 recon: 0.071 id: 0.072 time: 1:22:16.872028
Epoch 16/150 2000/2595 [D loss: 0.110 acc: 0.831][G loss: 2.564 adv: 1.478 recon: 0.091 id: 0.088 time: 1:25:22.465188
Epoch 16/150 [D loss: 0.060 acc: 0.956][G loss: 2.103 adv: 1.222 recon: 0.074 id: 0.073 time: 1:27:12.904729
Epoch 17/150 1000/2595 [D loss: 0.055 acc: 0.969][G loss: 2.320 adv: 1.465 recon: 0.071 id: 0.071 time: 1:30:19.573067
Epoch 17/150 2000/2595 [D loss: 0.085 acc: 0.934][G loss: 2.977 adv: 1.894 recon: 0.091 id: 0.088 time: 1:33:24.950847
Epoch 17/150 [D loss: 0.060 acc: 0.957][G loss: 2.110 adv: 1.231 recon: 0.073 id: 0.072 time: 1:35:15.792532
Epoch 18/150 1000/2595 [D loss: 0.035 acc: 0.999][G loss: 1.923 adv: 1.085 recon: 0.070 id: 0.071 time: 1:38:21.940078
Epoch 18/150 2000/2595 [D loss: 0.020 acc: 0.999][G loss: 2.315 adv: 1.231 recon: 0.091 id: 0.087 time: 1:41:26.944496
Epoch 18/150 [D loss: 0.061 acc: 0.954][G loss: 2.073 adv: 1.197 recon: 0.073 id: 0.072 time: 1:43:16.592577
Epoch 19/150 1000/2595 [D loss: 0.023 acc: 1.000][G loss: 2.372 adv: 1.507 recon: 0.072 id: 0.072 time: 1:46:22.803804
Epoch 19/150 2000/2595 [D loss: 0.031 acc: 0.987][G loss: 2.333 adv: 1.226 recon: 0.093 id: 0.089 time: 1:49:31.323355
Epoch 19/150 [D loss: 0.063 acc: 0.952][G loss: 2.099 adv: 1.216 recon: 0.074 id: 0.072 time: 1:51:21.891019
Epoch 20/150 1000/2595 [D loss: 0.041 acc: 0.990][G loss: 2.350 adv: 1.484 recon: 0.072 id: 0.073 time: 1:54:27.997146
Epoch 20/150 2000/2595 [D loss: 0.065 acc: 0.920][G loss: 2.557 adv: 1.518 recon: 0.087 id: 0.086 time: 1:57:33.075048
Epoch 20/150 [D loss: 0.061 acc: 0.953][G loss: 2.136 adv: 1.251 recon: 0.074 id: 0.073 time: 1:59:23.459784
Epoch 21/150 1000/2595 [D loss: 0.102 acc: 0.817][G loss: 2.764 adv: 1.896 recon: 0.073 id: 0.070 time: 2:02:28.915967
Epoch 21/150 2000/2595 [D loss: 0.027 acc: 0.994][G loss: 2.625 adv: 1.543 recon: 0.091 id: 0.087 time: 2:05:33.958521
Epoch 21/150 [D loss: 0.058 acc: 0.959][G loss: 2.154 adv: 1.274 recon: 0.074 id: 0.072 time: 2:07:24.272366
Epoch 22/150 1000/2595 [D loss: 0.019 acc: 0.998][G loss: 2.155 adv: 1.282 recon: 0.073 id: 0.072 time: 2:10:30.567161
Epoch 22/150 2000/2595 [D loss: 0.046 acc: 0.997][G loss: 2.210 adv: 1.144 recon: 0.089 id: 0.089 time: 2:13:36.323169
Epoch 22/150 [D loss: 0.056 acc: 0.960][G loss: 2.184 adv: 1.305 recon: 0.073 id: 0.072 time: 2:15:27.208474
Epoch 23/150 1000/2595 [D loss: 0.027 acc: 0.998][G loss: 2.522 adv: 1.580 recon: 0.079 id: 0.076 time: 2:18:31.704083
Epoch 23/150 2000/2595 [D loss: 0.018 acc: 1.000][G loss: 2.440 adv: 1.345 recon: 0.092 id: 0.088 time: 2:21:37.138137
Epoch 23/150 [D loss: 0.055 acc: 0.960][G loss: 2.189 adv: 1.309 recon: 0.074 id: 0.072 time: 2:23:26.736563
Epoch 24/150 1000/2595 [D loss: 0.036 acc: 0.992][G loss: 2.779 adv: 1.899 recon: 0.073 id: 0.073 time: 2:26:32.621088
Epoch 24/150 2000/2595 [D loss: 0.063 acc: 0.948][G loss: 2.595 adv: 1.530 recon: 0.089 id: 0.087 time: 2:29:38.426095
Epoch 24/150 [D loss: 0.054 acc: 0.962][G loss: 2.168 adv: 1.295 recon: 0.073 id: 0.072 time: 2:31:29.314592
Epoch 25/150 1000/2595 [D loss: 0.036 acc: 0.999][G loss: 2.168 adv: 1.294 recon: 0.073 id: 0.073 time: 2:34:34.085912
Epoch 25/150 2000/2595 [D loss: 0.109 acc: 0.900][G loss: 2.589 adv: 1.550 recon: 0.087 id: 0.085 time: 2:37:39.323185
Epoch 25/150 [D loss: 0.053 acc: 0.965][G loss: 2.193 adv: 1.323 recon: 0.073 id: 0.072 time: 2:39:29.818083
Epoch 26/150 1000/2595 [D loss: 0.072 acc: 0.982][G loss: 2.437 adv: 1.573 recon: 0.072 id: 0.073 time: 2:42:36.351539
Epoch 26/150 2000/2595 [D loss: 0.049 acc: 0.974][G loss: 2.954 adv: 1.846 recon: 0.092 id: 0.092 time: 2:45:42.200479
Epoch 26/150 [D loss: 0.057 acc: 0.959][G loss: 2.174 adv: 1.306 recon: 0.073 id: 0.072 time: 2:47:33.010013
Epoch 27/150 1000/2595 [D loss: 0.044 acc: 0.994][G loss: 2.221 adv: 1.386 recon: 0.069 id: 0.071 time: 2:50:38.156452
Epoch 27/150 2000/2595 [D loss: 0.037 acc: 0.999][G loss: 2.356 adv: 1.311 recon: 0.088 id: 0.084 time: 2:53:43.889973
Epoch 27/150 [D loss: 0.060 acc: 0.953][G loss: 2.130 adv: 1.263 recon: 0.072 id: 0.071 time: 2:55:34.209886
Epoch 28/150 1000/2595 [D loss: 0.051 acc: 0.983][G loss: 2.268 adv: 1.428 recon: 0.070 id: 0.069 time: 2:58:40.566678
Epoch 28/150 2000/2595 [D loss: 0.038 acc: 0.991][G loss: 3.002 adv: 1.961 recon: 0.087 id: 0.085 time: 3:01:46.369030
Epoch 28/150 [D loss: 0.057 acc: 0.959][G loss: 2.130 adv: 1.267 recon: 0.072 id: 0.071 time: 3:03:36.978733
Epoch 29/150 1000/2595 [D loss: 0.014 acc: 1.000][G loss: 2.142 adv: 1.294 recon: 0.071 id: 0.071 time: 3:06:42.639144
Epoch 29/150 2000/2595 [D loss: 0.027 acc: 1.000][G loss: 2.687 adv: 1.641 recon: 0.088 id: 0.085 time: 3:09:48.628458
Epoch 29/150 [D loss: 0.056 acc: 0.959][G loss: 2.166 adv: 1.303 recon: 0.072 id: 0.071 time: 3:11:39.020633
Epoch 30/150 1000/2595 [D loss: 0.029 acc: 0.995][G loss: 2.290 adv: 1.430 recon: 0.072 id: 0.072 time: 3:14:45.448632
Epoch 30/150 2000/2595 [D loss: 0.053 acc: 0.960][G loss: 2.900 adv: 1.873 recon: 0.086 id: 0.084 time: 3:17:50.619036
Epoch 30/150 [D loss: 0.057 acc: 0.957][G loss: 2.174 adv: 1.316 recon: 0.072 id: 0.071 time: 3:19:41.212781
Epoch 31/150 1000/2595 [D loss: 0.022 acc: 1.000][G loss: 2.232 adv: 1.389 recon: 0.070 id: 0.072 time: 3:22:47.340107
Epoch 31/150 2000/2595 [D loss: 0.087 acc: 0.931][G loss: 2.239 adv: 1.195 recon: 0.088 id: 0.084 time: 3:25:53.014267
Epoch 31/150 [D loss: 0.061 acc: 0.949][G loss: 2.142 adv: 1.284 recon: 0.072 id: 0.070 time: 3:27:43.623903
Epoch 32/150 1000/2595 [D loss: 0.085 acc: 0.930][G loss: 1.922 adv: 1.081 recon: 0.070 id: 0.071 time: 3:30:49.378037
Epoch 32/150 2000/2595 [D loss: 0.100 acc: 0.831][G loss: 1.795 adv: 0.759 recon: 0.087 id: 0.085 time: 3:33:54.589815
Epoch 32/150 [D loss: 0.061 acc: 0.954][G loss: 2.197 adv: 1.299 recon: 0.075 id: 0.074 time: 3:35:44.910875
Epoch 33/150 1000/2595 [D loss: 0.036 acc: 0.978][G loss: 2.856 adv: 1.827 recon: 0.086 id: 0.086 time: 3:38:49.746626
Epoch 33/150 2000/2595 [D loss: 0.036 acc: 0.996][G loss: 2.145 adv: 1.061 recon: 0.091 id: 0.089 time: 3:41:55.271380
Epoch 33/150 [D loss: 0.052 acc: 0.965][G loss: 2.249 adv: 1.301 recon: 0.079 id: 0.077 time: 3:43:45.662322
Epoch 34/150 1000/2595 [D loss: 0.016 acc: 0.997][G loss: 2.577 adv: 1.698 recon: 0.074 id: 0.072 time: 3:46:51.218941
Epoch 34/150 2000/2595 [D loss: 0.076 acc: 0.914][G loss: 2.039 adv: 0.972 recon: 0.090 id: 0.085 time: 3:49:56.605842
Epoch 34/150 [D loss: 0.055 acc: 0.961][G loss: 2.174 adv: 1.284 recon: 0.074 id: 0.073 time: 3:51:47.101668
Epoch 35/150 1000/2595 [D loss: 0.060 acc: 0.958][G loss: 2.803 adv: 1.951 recon: 0.071 id: 0.070 time: 3:54:52.515827
Epoch 35/150 2000/2595 [D loss: 0.059 acc: 0.943][G loss: 2.883 adv: 1.812 recon: 0.090 id: 0.086 time: 3:57:57.523766
Epoch 35/150 [D loss: 0.050 acc: 0.967][G loss: 2.259 adv: 1.378 recon: 0.074 id: 0.072 time: 3:59:47.855824
Epoch 36/150 1000/2595 [D loss: 0.035 acc: 0.999][G loss: 1.733 adv: 0.888 recon: 0.071 id: 0.070 time: 4:02:52.242039
Epoch 36/150 2000/2595 [D loss: 0.067 acc: 0.959][G loss: 2.315 adv: 1.280 recon: 0.087 id: 0.084 time: 4:05:57.739914
Epoch 36/150 [D loss: 0.053 acc: 0.962][G loss: 2.240 adv: 1.371 recon: 0.073 id: 0.071 time: 4:07:47.394656
Epoch 37/150 1000/2595 [D loss: 0.045 acc: 0.979][G loss: 1.723 adv: 0.905 recon: 0.068 id: 0.068 time: 4:10:52.379790
Epoch 37/150 2000/2595 [D loss: 0.046 acc: 0.998][G loss: 3.338 adv: 2.243 recon: 0.092 id: 0.088 time: 4:13:56.921740
Epoch 37/150 [D loss: 0.056 acc: 0.958][G loss: 2.141 adv: 1.282 recon: 0.072 id: 0.070 time: 4:15:47.533579
Epoch 38/150 1000/2595 [D loss: 0.018 acc: 1.000][G loss: 2.354 adv: 1.543 recon: 0.068 id: 0.067 time: 4:18:52.264550
Epoch 38/150 2000/2595 [D loss: 0.022 acc: 0.999][G loss: 2.165 adv: 1.101 recon: 0.089 id: 0.086 time: 4:21:57.797224
Epoch 38/150 [D loss: 0.053 acc: 0.965][G loss: 2.210 adv: 1.335 recon: 0.073 id: 0.071 time: 4:23:47.457921
Epoch 39/150 1000/2595 [D loss: 0.028 acc: 0.992][G loss: 2.403 adv: 1.548 recon: 0.071 id: 0.071 time: 4:26:52.969076
Epoch 39/150 2000/2595 [D loss: 0.036 acc: 0.999][G loss: 2.187 adv: 1.132 recon: 0.089 id: 0.085 time: 4:29:58.111219
Epoch 39/150 [D loss: 0.048 acc: 0.969][G loss: 2.299 adv: 1.415 recon: 0.074 id: 0.072 time: 4:31:48.421697
Epoch 40/150 1000/2595 [D loss: 0.022 acc: 1.000][G loss: 2.218 adv: 1.393 recon: 0.069 id: 0.069 time: 4:34:52.740982
Epoch 40/150 2000/2595 [D loss: 0.044 acc: 0.996][G loss: 2.555 adv: 1.528 recon: 0.086 id: 0.083 time: 4:37:57.834374
Epoch 40/150 [D loss: 0.046 acc: 0.971][G loss: 2.285 adv: 1.419 recon: 0.072 id: 0.071 time: 4:39:47.362697
Epoch 41/150 1000/2595 [D loss: 0.047 acc: 0.999][G loss: 2.989 adv: 2.115 recon: 0.073 id: 0.074 time: 4:42:52.615859
Epoch 41/150 2000/2595 [D loss: 0.080 acc: 0.944][G loss: 2.051 adv: 1.025 recon: 0.086 id: 0.083 time: 4:45:57.002274
Epoch 41/150 [D loss: 0.050 acc: 0.966][G loss: 2.237 adv: 1.375 recon: 0.072 id: 0.071 time: 4:47:47.040448
Epoch 42/150 1000/2595 [D loss: 0.019 acc: 1.000][G loss: 2.650 adv: 1.805 recon: 0.071 id: 0.069 time: 4:50:51.854794
Epoch 42/150 2000/2595 [D loss: 0.046 acc: 1.000][G loss: 2.842 adv: 1.802 recon: 0.088 id: 0.082 time: 4:53:56.298720
Epoch 42/150 [D loss: 0.051 acc: 0.965][G loss: 2.196 adv: 1.337 recon: 0.072 id: 0.070 time: 4:55:45.785264
Epoch 43/150 1000/2595 [D loss: 0.022 acc: 1.000][G loss: 1.984 adv: 1.152 recon: 0.070 id: 0.069 time: 4:58:50.604572
Epoch 43/150 2000/2595 [D loss: 0.037 acc: 0.996][G loss: 2.638 adv: 1.604 recon: 0.087 id: 0.084 time: 5:01:54.873099
Epoch 43/150 [D loss: 0.052 acc: 0.965][G loss: 2.180 adv: 1.328 recon: 0.071 id: 0.070 time: 5:03:45.125369
Epoch 44/150 1000/2595 [D loss: 0.053 acc: 0.997][G loss: 2.489 adv: 1.660 recon: 0.069 id: 0.069 time: 5:06:49.372884
Epoch 44/150 2000/2595 [D loss: 0.087 acc: 0.969][G loss: 3.199 adv: 2.170 recon: 0.086 id: 0.083 time: 5:09:53.965545
Epoch 44/150 [D loss: 0.053 acc: 0.964][G loss: 2.190 adv: 1.341 recon: 0.071 id: 0.070 time: 5:11:43.631578
Epoch 45/150 1000/2595 [D loss: 0.050 acc: 0.965][G loss: 2.214 adv: 1.416 recon: 0.066 id: 0.068 time: 5:14:48.132611
Epoch 45/150 2000/2595 [D loss: 0.018 acc: 1.000][G loss: 2.488 adv: 1.442 recon: 0.088 id: 0.083 time: 5:17:52.791835
Epoch 45/150 [D loss: 0.054 acc: 0.959][G loss: 2.205 adv: 1.359 recon: 0.071 id: 0.069 time: 5:19:42.996186
Epoch 46/150 1000/2595 [D loss: 0.065 acc: 0.986][G loss: 2.263 adv: 1.429 recon: 0.070 id: 0.069 time: 5:22:47.656645
Epoch 46/150 2000/2595 [D loss: 0.038 acc: 0.990][G loss: 3.163 adv: 2.144 recon: 0.086 id: 0.081 time: 5:25:52.012794
Epoch 46/150 [D loss: 0.054 acc: 0.961][G loss: 2.204 adv: 1.360 recon: 0.071 id: 0.069 time: 5:27:42.116659
Epoch 47/150 1000/2595 [D loss: 0.015 acc: 1.000][G loss: 2.182 adv: 1.365 recon: 0.068 id: 0.067 time: 5:30:46.271509
Epoch 47/150 2000/2595 [D loss: 0.062 acc: 0.974][G loss: 2.377 adv: 1.307 recon: 0.090 id: 0.084 time: 5:33:51.209543
Epoch 47/150 [D loss: 0.053 acc: 0.964][G loss: 2.249 adv: 1.394 recon: 0.072 id: 0.070 time: 5:35:40.204410
Epoch 48/150 1000/2595 [D loss: 0.021 acc: 1.000][G loss: 2.483 adv: 1.659 recon: 0.069 id: 0.069 time: 5:38:41.542643
Epoch 48/150 2000/2595 [D loss: 0.086 acc: 0.866][G loss: 2.502 adv: 1.495 recon: 0.084 id: 0.083 time: 5:41:42.579689
Epoch 48/150 [D loss: 0.053 acc: 0.964][G loss: 2.196 adv: 1.346 recon: 0.071 id: 0.069 time: 5:43:30.174600
Epoch 49/150 1000/2595 [D loss: 0.042 acc: 0.992][G loss: 3.137 adv: 2.270 recon: 0.073 id: 0.071 time: 5:46:29.125294
Epoch 49/150 2000/2595 [D loss: 0.081 acc: 0.964][G loss: 2.645 adv: 1.619 recon: 0.086 id: 0.083 time: 5:49:29.454908
Epoch 49/150 [D loss: 0.056 acc: 0.960][G loss: 2.173 adv: 1.323 recon: 0.071 id: 0.069 time: 5:51:15.530280
Epoch 50/150 1000/2595 [D loss: 0.020 acc: 1.000][G loss: 2.069 adv: 1.264 recon: 0.067 id: 0.066 time: 5:54:14.694723
Epoch 50/150 2000/2595 [D loss: 0.052 acc: 0.957][G loss: 2.345 adv: 1.317 recon: 0.086 id: 0.082 time: 5:57:12.821335
Epoch 50/150 [D loss: 0.057 acc: 0.958][G loss: 2.153 adv: 1.311 recon: 0.070 id: 0.069 time: 5:58:59.576782
Epoch 51/150 1000/2595 [D loss: 0.016 acc: 1.000][G loss: 2.339 adv: 1.542 recon: 0.067 id: 0.066 time: 6:01:59.633310
Epoch 51/150 2000/2595 [D loss: 0.033 acc: 0.996][G loss: 2.972 adv: 1.911 recon: 0.089 id: 0.085 time: 6:04:58.769062
Epoch 51/150 [D loss: 0.052 acc: 0.967][G loss: 2.200 adv: 1.349 recon: 0.071 id: 0.069 time: 6:06:45.192936
Epoch 52/150 1000/2595 [D loss: 0.060 acc: 0.946][G loss: 2.240 adv: 1.445 recon: 0.066 id: 0.067 time: 6:09:44.969406
Epoch 52/150 2000/2595 [D loss: 0.077 acc: 0.922][G loss: 3.271 adv: 2.199 recon: 0.090 id: 0.084 time: 6:12:43.316948
Epoch 52/150 [D loss: 0.054 acc: 0.962][G loss: 2.245 adv: 1.390 recon: 0.072 id: 0.069 time: 6:14:30.083192
Epoch 53/150 1000/2595 [D loss: 0.076 acc: 0.939][G loss: 2.411 adv: 1.586 recon: 0.069 id: 0.069 time: 6:17:28.870494
Epoch 53/150 2000/2595 [D loss: 0.028 acc: 1.000][G loss: 2.242 adv: 1.228 recon: 0.084 id: 0.085 time: 6:20:28.645928
Epoch 53/150 [D loss: 0.051 acc: 0.965][G loss: 2.259 adv: 1.407 recon: 0.071 id: 0.069 time: 6:22:15.125090
Epoch 54/150 1000/2595 [D loss: 0.023 acc: 0.999][G loss: 2.597 adv: 1.772 recon: 0.069 id: 0.068 time: 6:25:14.420199
Epoch 54/150 2000/2595 [D loss: 0.022 acc: 0.998][G loss: 3.163 adv: 2.122 recon: 0.087 id: 0.086 time: 6:28:13.718188
Epoch 54/150 [D loss: 0.047 acc: 0.972][G loss: 2.258 adv: 1.404 recon: 0.072 id: 0.069 time: 6:30:00.980146
Epoch 55/150 1000/2595 [D loss: 0.033 acc: 1.000][G loss: 2.789 adv: 1.947 recon: 0.070 id: 0.069 time: 6:33:00.407668
Epoch 55/150 2000/2595 [D loss: 0.040 acc: 0.977][G loss: 2.918 adv: 1.873 recon: 0.088 id: 0.084 time: 6:35:59.794653
Epoch 55/150 [D loss: 0.049 acc: 0.967][G loss: 2.249 adv: 1.396 recon: 0.071 id: 0.069 time: 6:37:46.414743
Epoch 56/150 1000/2595 [D loss: 0.028 acc: 1.000][G loss: 2.606 adv: 1.773 recon: 0.070 id: 0.069 time: 6:40:46.387588
Epoch 56/150 2000/2595 [D loss: 0.026 acc: 1.000][G loss: 2.695 adv: 1.668 recon: 0.086 id: 0.084 time: 6:43:45.509763
Epoch 56/150 [D loss: 0.045 acc: 0.972][G loss: 2.311 adv: 1.452 recon: 0.072 id: 0.070 time: 6:45:32.382935
Epoch 57/150 1000/2595 [D loss: 0.018 acc: 1.000][G loss: 2.484 adv: 1.648 recon: 0.070 id: 0.070 time: 6:48:31.566145
Epoch 57/150 2000/2595 [D loss: 0.019 acc: 1.000][G loss: 2.433 adv: 1.415 recon: 0.085 id: 0.085 time: 6:51:30.823351
Epoch 57/150 [D loss: 0.046 acc: 0.971][G loss: 2.270 adv: 1.417 recon: 0.071 id: 0.070 time: 6:53:17.244884
Epoch 58/150 1000/2595 [D loss: 0.021 acc: 1.000][G loss: 2.179 adv: 1.350 recon: 0.069 id: 0.068 time: 6:56:17.202282
Epoch 58/150 2000/2595 [D loss: 0.052 acc: 0.978][G loss: 2.776 adv: 1.772 recon: 0.084 id: 0.083 time: 6:59:16.694820
Epoch 58/150 [D loss: 0.052 acc: 0.962][G loss: 2.263 adv: 1.417 recon: 0.071 id: 0.069 time: 7:01:03.974931
Epoch 59/150 1000/2595 [D loss: 0.044 acc: 0.995][G loss: 2.511 adv: 1.685 recon: 0.069 id: 0.068 time: 7:04:03.371036
Epoch 59/150 2000/2595 [D loss: 0.020 acc: 0.999][G loss: 2.675 adv: 1.665 recon: 0.085 id: 0.083 time: 7:07:03.447681
Epoch 59/150 [D loss: 0.053 acc: 0.961][G loss: 2.218 adv: 1.376 recon: 0.070 id: 0.069 time: 7:08:50.238642
Epoch 60/150 1000/2595 [D loss: 0.038 acc: 0.996][G loss: 2.147 adv: 1.354 recon: 0.066 id: 0.067 time: 7:11:49.868451
Epoch 60/150 2000/2595 [D loss: 0.052 acc: 0.975][G loss: 2.526 adv: 1.517 recon: 0.084 id: 0.083 time: 7:14:48.372867
Epoch 60/150 [D loss: 0.049 acc: 0.967][G loss: 2.238 adv: 1.398 recon: 0.070 id: 0.069 time: 7:16:34.900658
Epoch 61/150 1000/2595 [D loss: 0.019 acc: 0.999][G loss: 2.076 adv: 1.272 recon: 0.067 id: 0.067 time: 7:19:34.061726
Epoch 61/150 2000/2595 [D loss: 0.021 acc: 0.997][G loss: 2.708 adv: 1.660 recon: 0.088 id: 0.084 time: 7:22:33.511664
Epoch 61/150 [D loss: 0.048 acc: 0.967][G loss: 2.260 adv: 1.421 recon: 0.070 id: 0.069 time: 7:24:20.209820
Epoch 62/150 1000/2595 [D loss: 0.034 acc: 0.999][G loss: 2.570 adv: 1.737 recon: 0.070 id: 0.068 time: 7:27:20.672228
Epoch 62/150 2000/2595 [D loss: 0.016 acc: 1.000][G loss: 2.672 adv: 1.649 recon: 0.086 id: 0.083 time: 7:30:20.183659
Epoch 62/150 [D loss: 0.049 acc: 0.965][G loss: 2.253 adv: 1.419 recon: 0.070 id: 0.068 time: 7:32:07.548868
Epoch 63/150 1000/2595 [D loss: 0.082 acc: 0.889][G loss: 2.473 adv: 1.686 recon: 0.065 id: 0.067 time: 7:35:06.869715
Epoch 63/150 2000/2595 [D loss: 0.025 acc: 1.000][G loss: 2.516 adv: 1.464 recon: 0.088 id: 0.086 time: 7:38:06.769816
Epoch 63/150 [D loss: 0.050 acc: 0.965][G loss: 2.240 adv: 1.410 recon: 0.069 id: 0.068 time: 7:39:53.603877
Epoch 64/150 1000/2595 [D loss: 0.052 acc: 1.000][G loss: 2.399 adv: 1.564 recon: 0.070 id: 0.070 time: 7:42:54.185724
Epoch 64/150 2000/2595 [D loss: 0.018 acc: 1.000][G loss: 2.621 adv: 1.599 recon: 0.085 id: 0.083 time: 7:45:53.766283
Epoch 64/150 [D loss: 0.045 acc: 0.972][G loss: 2.268 adv: 1.435 recon: 0.070 id: 0.068 time: 7:47:41.185944
Epoch 65/150 1000/2595 [D loss: 0.065 acc: 0.965][G loss: 2.934 adv: 2.098 recon: 0.070 id: 0.069 time: 7:50:40.627816
Epoch 65/150 2000/2595 [D loss: 0.050 acc: 0.996][G loss: 3.059 adv: 2.028 recon: 0.086 id: 0.084 time: 7:53:40.227058
Epoch 65/150 [D loss: 0.044 acc: 0.974][G loss: 2.272 adv: 1.433 recon: 0.070 id: 0.069 time: 7:55:26.989760
Epoch 66/150 1000/2595 [D loss: 0.020 acc: 1.000][G loss: 2.900 adv: 2.055 recon: 0.070 id: 0.071 time: 7:58:26.328519
Epoch 66/150 2000/2595 [D loss: 0.061 acc: 0.937][G loss: 2.823 adv: 1.816 recon: 0.084 id: 0.083 time: 8:01:25.262732
Epoch 66/150 [D loss: 0.049 acc: 0.968][G loss: 2.230 adv: 1.395 recon: 0.070 id: 0.069 time: 8:03:12.812476
Epoch 67/150 1000/2595 [D loss: 0.026 acc: 1.000][G loss: 2.594 adv: 1.789 recon: 0.067 id: 0.066 time: 8:06:12.604175
Epoch 67/150 2000/2595 [D loss: 0.128 acc: 0.806][G loss: 2.106 adv: 1.087 recon: 0.085 id: 0.086 time: 8:09:12.223631
Epoch 67/150 [D loss: 0.045 acc: 0.972][G loss: 2.283 adv: 1.437 recon: 0.071 id: 0.069 time: 8:10:58.877701
Epoch 68/150 1000/2595 [D loss: 0.018 acc: 1.000][G loss: 2.402 adv: 1.563 recon: 0.070 id: 0.068 time: 8:13:58.734120
Epoch 68/150 2000/2595 [D loss: 0.015 acc: 1.000][G loss: 3.138 adv: 2.148 recon: 0.082 id: 0.084 time: 8:16:58.120213
Epoch 68/150 [D loss: 0.047 acc: 0.970][G loss: 2.289 adv: 1.445 recon: 0.071 id: 0.069 time: 8:18:45.067919
Epoch 69/150 1000/2595 [D loss: 0.041 acc: 0.998][G loss: 2.423 adv: 1.596 recon: 0.069 id: 0.067 time: 8:21:44.076774
Epoch 69/150 2000/2595 [D loss: 0.070 acc: 0.923][G loss: 2.253 adv: 1.249 recon: 0.084 id: 0.081 time: 8:24:43.630610
Epoch 69/150 [D loss: 0.049 acc: 0.967][G loss: 2.249 adv: 1.408 recon: 0.070 id: 0.069 time: 8:26:30.301595
Epoch 70/150 1000/2595 [D loss: 0.012 acc: 1.000][G loss: 2.893 adv: 2.087 recon: 0.067 id: 0.067 time: 8:29:29.741340
Epoch 70/150 2000/2595 [D loss: 0.404 acc: 0.349][G loss: 2.281 adv: 1.266 recon: 0.085 id: 0.082 time: 8:32:28.625559
Epoch 70/150 [D loss: 0.050 acc: 0.966][G loss: 2.261 adv: 1.423 recon: 0.070 id: 0.069 time: 8:34:16.194892
Epoch 71/150 1000/2595 [D loss: 0.013 acc: 1.000][G loss: 2.493 adv: 1.684 recon: 0.068 id: 0.067 time: 8:37:15.461141
Epoch 71/150 2000/2595 [D loss: 0.028 acc: 1.000][G loss: 2.614 adv: 1.606 recon: 0.084 id: 0.082 time: 8:40:14.833194
Epoch 71/150 [D loss: 0.047 acc: 0.970][G loss: 2.277 adv: 1.441 recon: 0.070 id: 0.069 time: 8:42:01.328077
Epoch 72/150 1000/2595 [D loss: 0.080 acc: 0.925][G loss: 2.533 adv: 1.737 recon: 0.066 id: 0.065 time: 8:45:00.939926
Epoch 72/150 2000/2595 [D loss: 0.021 acc: 1.000][G loss: 2.455 adv: 1.441 recon: 0.085 id: 0.083 time: 8:47:59.783210
Epoch 72/150 [D loss: 0.048 acc: 0.968][G loss: 2.283 adv: 1.448 recon: 0.070 id: 0.069 time: 8:49:46.465880
Epoch 73/150 1000/2595 [D loss: 0.023 acc: 0.998][G loss: 2.311 adv: 1.487 recon: 0.069 id: 0.067 time: 8:52:46.187368
Epoch 73/150 2000/2595 [D loss: 0.019 acc: 1.000][G loss: 2.754 adv: 1.762 recon: 0.083 id: 0.080 time: 8:55:46.216843
Epoch 73/150 [D loss: 0.049 acc: 0.967][G loss: 2.248 adv: 1.416 recon: 0.069 id: 0.068 time: 8:57:32.694069
Epoch 74/150 1000/2595 [D loss: 0.030 acc: 1.000][G loss: 2.291 adv: 1.496 recon: 0.066 id: 0.065 time: 9:00:31.713187
Epoch 74/150 2000/2595 [D loss: 0.028 acc: 0.998][G loss: 3.100 adv: 2.063 recon: 0.087 id: 0.083 time: 9:03:30.401607
Epoch 74/150 [D loss: 0.048 acc: 0.968][G loss: 2.247 adv: 1.416 recon: 0.069 id: 0.068 time: 9:05:17.239908
Epoch 75/150 1000/2595 [D loss: 0.043 acc: 0.993][G loss: 2.436 adv: 1.627 recon: 0.068 id: 0.067 time: 9:08:16.462308
Epoch 75/150 2000/2595 [D loss: 0.019 acc: 1.000][G loss: 2.505 adv: 1.503 recon: 0.084 id: 0.083 time: 9:11:16.229808
Epoch 75/150 [D loss: 0.044 acc: 0.972][G loss: 2.288 adv: 1.458 recon: 0.069 id: 0.068 time: 9:13:03.080915
Epoch 76/150 1000/2595 [D loss: 0.195 acc: 0.689][G loss: 2.062 adv: 1.220 recon: 0.070 id: 0.070 time: 9:16:02.915716
Epoch 76/150 2000/2595 [D loss: 0.020 acc: 1.000][G loss: 2.589 adv: 1.577 recon: 0.085 id: 0.081 time: 9:19:02.561653
Epoch 76/150 [D loss: 0.048 acc: 0.967][G loss: 2.301 adv: 1.464 recon: 0.070 id: 0.069 time: 9:20:49.751369
Epoch 77/150 1000/2595 [D loss: 0.247 acc: 0.717][G loss: 1.880 adv: 1.074 recon: 0.067 id: 0.067 time: 9:23:48.625259
Epoch 77/150 2000/2595 [D loss: 0.045 acc: 0.996][G loss: 2.742 adv: 1.738 recon: 0.084 id: 0.082 time: 9:26:47.047803
Epoch 77/150 [D loss: 0.045 acc: 0.971][G loss: 2.318 adv: 1.484 recon: 0.070 id: 0.069 time: 9:28:34.144020
Epoch 78/150 1000/2595 [D loss: 0.291 acc: 0.599][G loss: 2.214 adv: 1.408 recon: 0.067 id: 0.068 time: 9:31:32.721858
Epoch 78/150 2000/2595 [D loss: 0.102 acc: 0.927][G loss: 3.338 adv: 2.321 recon: 0.085 id: 0.083 time: 9:34:31.743595
Epoch 78/150 [D loss: 0.044 acc: 0.971][G loss: 2.314 adv: 1.487 recon: 0.069 id: 0.068 time: 9:36:18.319896
Epoch 79/150 1000/2595 [D loss: 0.021 acc: 1.000][G loss: 2.385 adv: 1.584 recon: 0.067 id: 0.067 time: 9:39:17.761826
Epoch 79/150 2000/2595 [D loss: 0.042 acc: 0.995][G loss: 2.717 adv: 1.710 recon: 0.084 id: 0.083 time: 9:42:16.944070
Epoch 79/150 [D loss: 0.051 acc: 0.963][G loss: 2.263 adv: 1.439 recon: 0.069 id: 0.068 time: 9:44:03.893668
Epoch 80/150 1000/2595 [D loss: 0.021 acc: 1.000][G loss: 2.026 adv: 1.242 recon: 0.065 id: 0.065 time: 9:47:02.586640
Epoch 80/150 2000/2595 [D loss: 0.043 acc: 0.988][G loss: 2.717 adv: 1.696 recon: 0.085 id: 0.084 time: 9:50:02.758711
Epoch 80/150 [D loss: 0.047 acc: 0.969][G loss: 2.258 adv: 1.435 recon: 0.069 id: 0.068 time: 9:51:50.041663
Epoch 81/150 1000/2595 [D loss: 0.018 acc: 1.000][G loss: 2.039 adv: 1.245 recon: 0.066 id: 0.065 time: 9:54:49.831591
Epoch 81/150 2000/2595 [D loss: 0.038 acc: 0.996][G loss: 3.062 adv: 2.064 recon: 0.083 id: 0.082 time: 9:57:48.616867
Epoch 81/150 [D loss: 0.050 acc: 0.964][G loss: 2.267 adv: 1.444 recon: 0.069 id: 0.068 time: 9:59:35.555490
Epoch 82/150 1000/2595 [D loss: 0.017 acc: 1.000][G loss: 2.569 adv: 1.775 recon: 0.066 id: 0.065 time: 10:02:34.180989
Epoch 82/150 2000/2595 [D loss: 0.089 acc: 0.940][G loss: 2.298 adv: 1.299 recon: 0.084 id: 0.081 time: 10:05:33.137426
Epoch 82/150 [D loss: 0.050 acc: 0.966][G loss: 2.240 adv: 1.417 recon: 0.069 id: 0.068 time: 10:07:20.092094
Epoch 83/150 1000/2595 [D loss: 0.093 acc: 0.913][G loss: 1.859 adv: 1.075 recon: 0.065 id: 0.066 time: 10:10:19.638767
Epoch 83/150 2000/2595 [D loss: 0.089 acc: 0.937][G loss: 2.360 adv: 1.367 recon: 0.083 id: 0.082 time: 10:13:18.590749
Epoch 83/150 [D loss: 0.047 acc: 0.969][G loss: 2.297 adv: 1.475 recon: 0.069 id: 0.068 time: 10:15:05.017007
Epoch 84/150 1000/2595 [D loss: 0.161 acc: 0.718][G loss: 2.275 adv: 1.472 recon: 0.067 id: 0.066 time: 10:18:03.510610
Epoch 84/150 2000/2595 [D loss: 0.047 acc: 0.985][G loss: 2.795 adv: 1.814 recon: 0.082 id: 0.081 time: 10:21:02.311143
Epoch 84/150 [D loss: 0.045 acc: 0.972][G loss: 2.334 adv: 1.501 recon: 0.070 id: 0.069 time: 10:22:49.283528
Epoch 85/150 1000/2595 [D loss: 0.025 acc: 0.997][G loss: 2.438 adv: 1.619 recon: 0.068 id: 0.068 time: 10:25:48.705173
Epoch 85/150 2000/2595 [D loss: 0.075 acc: 0.928][G loss: 2.271 adv: 1.251 recon: 0.085 id: 0.083 time: 10:28:48.580970
Epoch 85/150 [D loss: 0.046 acc: 0.970][G loss: 2.316 adv: 1.487 recon: 0.069 id: 0.069 time: 10:30:35.388568
Epoch 86/150 1000/2595 [D loss: 0.029 acc: 1.000][G loss: 2.378 adv: 1.577 recon: 0.067 id: 0.067 time: 10:33:34.707859
Epoch 86/150 2000/2595 [D loss: 0.058 acc: 0.963][G loss: 2.977 adv: 1.965 recon: 0.085 id: 0.083 time: 10:36:33.763657
Epoch 86/150 [D loss: 0.043 acc: 0.973][G loss: 2.350 adv: 1.523 recon: 0.069 id: 0.068 time: 10:38:20.259803
Epoch 87/150 1000/2595 [D loss: 0.040 acc: 1.000][G loss: 2.833 adv: 1.954 recon: 0.074 id: 0.067 time: 10:41:19.325180
Epoch 87/150 2000/2595 [D loss: 0.024 acc: 0.997][G loss: 2.941 adv: 1.937 recon: 0.084 id: 0.083 time: 10:44:19.136957
Epoch 87/150 [D loss: 0.044 acc: 0.973][G loss: 2.377 adv: 1.538 recon: 0.070 id: 0.069 time: 10:46:05.460124
Epoch 88/150 1000/2595 [D loss: 0.029 acc: 1.000][G loss: 3.056 adv: 2.214 recon: 0.070 id: 0.069 time: 10:49:06.156491
Epoch 88/150 2000/2595 [D loss: 0.012 acc: 1.000][G loss: 2.898 adv: 1.878 recon: 0.085 id: 0.084 time: 10:52:05.706665
Epoch 88/150 [D loss: 0.043 acc: 0.974][G loss: 2.376 adv: 1.530 recon: 0.071 id: 0.069 time: 10:53:53.137640
Epoch 89/150 1000/2595 [D loss: 0.087 acc: 0.864][G loss: 3.225 adv: 2.419 recon: 0.067 id: 0.067 time: 10:56:52.165669
Epoch 89/150 2000/2595 [D loss: 0.039 acc: 0.991][G loss: 2.666 adv: 1.655 recon: 0.085 id: 0.082 time: 10:59:51.788630
Epoch 89/150 [D loss: 0.047 acc: 0.969][G loss: 2.274 adv: 1.443 recon: 0.069 id: 0.069 time: 11:01:38.390787
Epoch 90/150 1000/2595 [D loss: 0.032 acc: 1.000][G loss: 2.597 adv: 1.787 recon: 0.068 id: 0.067 time: 11:04:37.955680
Epoch 90/150 2000/2595 [D loss: 0.263 acc: 0.522][G loss: 2.208 adv: 1.207 recon: 0.084 id: 0.081 time: 11:07:37.741100
Epoch 90/150 [D loss: 0.050 acc: 0.965][G loss: 2.246 adv: 1.418 recon: 0.069 id: 0.069 time: 11:09:25.259284
Epoch 91/150 1000/2595 [D loss: 0.031 acc: 1.000][G loss: 2.488 adv: 1.666 recon: 0.069 id: 0.069 time: 11:12:25.310384
Epoch 91/150 2000/2595 [D loss: 0.056 acc: 0.944][G loss: 2.439 adv: 1.428 recon: 0.084 id: 0.083 time: 11:15:25.228785
Epoch 91/150 [D loss: 0.050 acc: 0.964][G loss: 2.238 adv: 1.414 recon: 0.069 id: 0.068 time: 11:17:11.557938
Epoch 92/150 1000/2595 [D loss: 0.035 acc: 0.997][G loss: 3.344 adv: 2.454 recon: 0.074 id: 0.075 time: 11:20:10.735102
Epoch 92/150 2000/2595 [D loss: 0.054 acc: 0.957][G loss: 2.972 adv: 1.902 recon: 0.090 id: 0.087 time: 11:23:09.788371
Epoch 92/150 [D loss: 0.050 acc: 0.965][G loss: 2.264 adv: 1.437 recon: 0.069 id: 0.068 time: 11:24:57.197563
Epoch 93/150 1000/2595 [D loss: 0.025 acc: 1.000][G loss: 2.255 adv: 1.456 recon: 0.066 id: 0.067 time: 11:27:56.149030
Epoch 93/150 2000/2595 [D loss: 0.015 acc: 1.000][G loss: 2.662 adv: 1.656 recon: 0.084 id: 0.081 time: 11:30:55.372618
Epoch 93/150 [D loss: 0.049 acc: 0.964][G loss: 2.252 adv: 1.427 recon: 0.069 id: 0.068 time: 11:32:41.632924
Epoch 94/150 1000/2595 [D loss: 0.057 acc: 0.959][G loss: 2.888 adv: 2.089 recon: 0.067 id: 0.066 time: 11:35:41.573200
Epoch 94/150 2000/2595 [D loss: 0.060 acc: 0.933][G loss: 2.345 adv: 1.335 recon: 0.085 id: 0.082 time: 11:38:40.481836
Epoch 94/150 [D loss: 0.046 acc: 0.970][G loss: 2.296 adv: 1.467 recon: 0.069 id: 0.068 time: 11:40:27.078669
Epoch 95/150 1000/2595 [D loss: 0.012 acc: 1.000][G loss: 2.798 adv: 1.989 recon: 0.067 id: 0.067 time: 11:43:25.494473
Epoch 95/150 2000/2595 [D loss: 0.038 acc: 0.997][G loss: 2.575 adv: 1.556 recon: 0.086 id: 0.082 time: 11:46:24.826669
Epoch 95/150 [D loss: 0.044 acc: 0.972][G loss: 2.311 adv: 1.480 recon: 0.069 id: 0.068 time: 11:48:11.029749
Epoch 96/150 1000/2595 [D loss: 0.030 acc: 1.000][G loss: 2.857 adv: 2.048 recon: 0.067 id: 0.068 time: 11:51:10.317062
Epoch 96/150 2000/2595 [D loss: 0.027 acc: 0.993][G loss: 2.983 adv: 1.975 recon: 0.084 id: 0.082 time: 11:54:08.898165
Epoch 96/150 [D loss: 0.045 acc: 0.970][G loss: 2.340 adv: 1.499 recon: 0.070 id: 0.069 time: 11:55:56.157955
Epoch 97/150 1000/2595 [D loss: 0.024 acc: 1.000][G loss: 2.102 adv: 1.283 recon: 0.069 id: 0.065 time: 11:58:54.727899
Epoch 97/150 2000/2595 [D loss: 0.017 acc: 1.000][G loss: 2.962 adv: 1.961 recon: 0.084 id: 0.081 time: 12:01:54.058545
Epoch 97/150 [D loss: 0.046 acc: 0.968][G loss: 2.316 adv: 1.478 recon: 0.070 id: 0.069 time: 12:03:40.684588
Epoch 98/150 1000/2595 [D loss: 0.053 acc: 0.962][G loss: 2.508 adv: 1.679 recon: 0.070 id: 0.066 time: 12:06:40.146891
Epoch 98/150 2000/2595 [D loss: 0.016 acc: 1.000][G loss: 2.878 adv: 1.881 recon: 0.084 id: 0.081 time: 12:09:39.631970
Epoch 98/150 [D loss: 0.045 acc: 0.969][G loss: 2.332 adv: 1.496 recon: 0.070 id: 0.068 time: 12:11:27.197769
Epoch 99/150 1000/2595 [D loss: 0.029 acc: 0.993][G loss: 2.296 adv: 1.486 recon: 0.068 id: 0.066 time: 12:14:26.238419
Epoch 99/150 2000/2595 [D loss: 0.053 acc: 0.960][G loss: 2.939 adv: 1.940 recon: 0.084 id: 0.081 time: 12:17:26.360329
Epoch 99/150 [D loss: 0.044 acc: 0.972][G loss: 2.325 adv: 1.491 recon: 0.070 id: 0.068 time: 12:19:13.038078
Epoch 100/150 1000/2595 [D loss: 0.015 acc: 1.000][G loss: 2.419 adv: 1.622 recon: 0.066 id: 0.067 time: 12:22:13.094845
Epoch 100/150 2000/2595 [D loss: 0.048 acc: 0.943][G loss: 2.438 adv: 1.455 recon: 0.082 id: 0.081 time: 12:25:12.166336
Epoch 100/150 [D loss: 0.042 acc: 0.974][G loss: 2.344 adv: 1.511 recon: 0.070 id: 0.068 time: 12:26:59.344969
Epoch 101/150 1000/2595 [D loss: 0.182 acc: 0.680][G loss: 2.078 adv: 1.190 recon: 0.074 id: 0.072 time: 12:30:02.654584
Epoch 101/150 2000/2595 [D loss: 0.014 acc: 1.000][G loss: 2.473 adv: 1.471 recon: 0.084 id: 0.084 time: 12:33:02.976838
Epoch 101/150 [D loss: 0.043 acc: 0.974][G loss: 2.359 adv: 1.522 recon: 0.070 id: 0.069 time: 12:34:50.469157
Epoch 102/150 1000/2595 [D loss: 0.019 acc: 1.000][G loss: 2.510 adv: 1.683 recon: 0.069 id: 0.068 time: 12:37:50.413936
Epoch 102/150 2000/2595 [D loss: 0.031 acc: 0.997][G loss: 2.579 adv: 1.571 recon: 0.084 id: 0.085 time: 12:40:49.755482
Epoch 102/150 [D loss: 0.044 acc: 0.973][G loss: 2.365 adv: 1.526 recon: 0.070 id: 0.069 time: 12:42:37.092950
Epoch 103/150 1000/2595 [D loss: 0.020 acc: 1.000][G loss: 3.229 adv: 2.414 recon: 0.068 id: 0.067 time: 12:45:36.962093
Epoch 103/150 2000/2595 [D loss: 0.058 acc: 0.997][G loss: 3.083 adv: 2.072 recon: 0.084 id: 0.085 time: 12:48:37.290924
Epoch 103/150 [D loss: 0.043 acc: 0.974][G loss: 2.376 adv: 1.538 recon: 0.070 id: 0.069 time: 12:50:23.794837
Epoch 104/150 1000/2595 [D loss: 0.044 acc: 1.000][G loss: 2.879 adv: 2.064 recon: 0.068 id: 0.066 time: 12:53:23.257109
Epoch 104/150 2000/2595 [D loss: 0.045 acc: 0.966][G loss: 2.772 adv: 1.749 recon: 0.086 id: 0.082 time: 12:56:23.199787
Epoch 104/150 [D loss: 0.040 acc: 0.977][G loss: 2.396 adv: 1.561 recon: 0.070 id: 0.069 time: 12:58:10.433593
Epoch 105/150 1000/2595 [D loss: 0.040 acc: 0.981][G loss: 2.793 adv: 1.996 recon: 0.067 id: 0.065 time: 13:01:10.650486
Epoch 105/150 2000/2595 [D loss: 0.028 acc: 1.000][G loss: 3.089 adv: 2.088 recon: 0.084 id: 0.082 time: 13:04:10.902935
Epoch 105/150 [D loss: 0.045 acc: 0.970][G loss: 2.372 adv: 1.544 recon: 0.069 id: 0.068 time: 13:05:57.391620
Epoch 106/150 1000/2595 [D loss: 0.024 acc: 1.000][G loss: 2.651 adv: 1.859 recon: 0.066 id: 0.066 time: 13:08:57.887264
Epoch 106/150 2000/2595 [D loss: 0.031 acc: 1.000][G loss: 2.725 adv: 1.711 recon: 0.085 id: 0.084 time: 13:12:01.021898
Epoch 106/150 [D loss: 0.047 acc: 0.966][G loss: 2.344 adv: 1.523 recon: 0.069 id: 0.068 time: 13:13:50.116010
Epoch 107/150 1000/2595 [D loss: 0.040 acc: 1.000][G loss: 2.843 adv: 2.028 recon: 0.068 id: 0.067 time: 13:16:51.585026
Epoch 107/150 2000/2595 [D loss: 0.020 acc: 1.000][G loss: 2.685 adv: 1.682 recon: 0.083 id: 0.084 time: 13:19:53.096760
Epoch 107/150 [D loss: 0.046 acc: 0.970][G loss: 2.344 adv: 1.516 recon: 0.069 id: 0.068 time: 13:21:40.940190
Epoch 108/150 1000/2595 [D loss: 0.025 acc: 1.000][G loss: 2.515 adv: 1.693 recon: 0.069 id: 0.067 time: 13:24:42.813889
Epoch 108/150 2000/2595 [D loss: 0.104 acc: 0.871][G loss: 2.940 adv: 1.897 recon: 0.087 id: 0.087 time: 13:27:44.273657
Epoch 108/150 [D loss: 0.048 acc: 0.967][G loss: 2.288 adv: 1.466 recon: 0.069 id: 0.068 time: 13:29:32.068730
Epoch 109/150 1000/2595 [D loss: 0.034 acc: 0.998][G loss: 2.353 adv: 1.561 recon: 0.066 id: 0.066 time: 13:32:32.734603
Epoch 109/150 2000/2595 [D loss: 0.035 acc: 0.957][G loss: 2.739 adv: 1.748 recon: 0.083 id: 0.083 time: 13:35:34.582085
Epoch 109/150 [D loss: 0.050 acc: 0.965][G loss: 2.283 adv: 1.460 recon: 0.069 id: 0.068 time: 13:37:22.208069
Epoch 110/150 1000/2595 [D loss: 0.022 acc: 0.995][G loss: 2.487 adv: 1.693 recon: 0.066 id: 0.067 time: 13:40:23.228542
Epoch 110/150 2000/2595 [D loss: 0.035 acc: 0.997][G loss: 2.718 adv: 1.726 recon: 0.083 id: 0.082 time: 13:43:23.266817
Epoch 110/150 [D loss: 0.049 acc: 0.964][G loss: 2.315 adv: 1.494 recon: 0.069 id: 0.068 time: 13:45:10.600919
Epoch 111/150 1000/2595 [D loss: 0.040 acc: 1.000][G loss: 2.936 adv: 2.120 recon: 0.068 id: 0.068 time: 13:48:10.853690
Epoch 111/150 2000/2595 [D loss: 0.028 acc: 0.996][G loss: 2.683 adv: 1.705 recon: 0.082 id: 0.081 time: 13:51:11.174334
Epoch 111/150 [D loss: 0.048 acc: 0.964][G loss: 2.307 adv: 1.480 recon: 0.069 id: 0.068 time: 13:52:58.427303
Epoch 112/150 1000/2595 [D loss: 0.018 acc: 1.000][G loss: 2.859 adv: 2.008 recon: 0.070 id: 0.073 time: 13:56:00.368907
Epoch 112/150 2000/2595 [D loss: 0.070 acc: 0.886][G loss: 2.297 adv: 1.304 recon: 0.083 id: 0.082 time: 13:59:00.476445
Epoch 112/150 [D loss: 0.047 acc: 0.967][G loss: 2.331 adv: 1.504 recon: 0.069 id: 0.068 time: 14:00:47.724408
Epoch 113/150 1000/2595 [D loss: 0.038 acc: 0.978][G loss: 3.017 adv: 2.183 recon: 0.069 id: 0.071 time: 14:03:47.526642
Epoch 113/150 2000/2595 [D loss: 0.018 acc: 1.000][G loss: 2.528 adv: 1.561 recon: 0.081 id: 0.081 time: 14:06:47.640412
Epoch 113/150 [D loss: 0.045 acc: 0.968][G loss: 2.349 adv: 1.528 recon: 0.069 id: 0.068 time: 14:08:34.577823
Epoch 114/150 1000/2595 [D loss: 0.010 acc: 1.000][G loss: 2.563 adv: 1.785 recon: 0.065 id: 0.065 time: 14:11:35.741485
Epoch 114/150 2000/2595 [D loss: 0.038 acc: 1.000][G loss: 2.517 adv: 1.531 recon: 0.082 id: 0.084 time: 14:14:34.515705
Epoch 114/150 [D loss: 0.044 acc: 0.968][G loss: 2.343 adv: 1.521 recon: 0.069 id: 0.068 time: 14:16:21.119809
Epoch 115/150 1000/2595 [D loss: 0.011 acc: 1.000][G loss: 3.427 adv: 2.490 recon: 0.078 id: 0.078 time: 14:19:20.436836
Epoch 115/150 2000/2595 [D loss: 0.047 acc: 0.999][G loss: 2.652 adv: 1.679 recon: 0.081 id: 0.081 time: 14:22:19.606633
Epoch 115/150 [D loss: 0.046 acc: 0.968][G loss: 2.332 adv: 1.511 recon: 0.069 id: 0.068 time: 14:24:06.193996
Epoch 116/150 1000/2595 [D loss: 0.019 acc: 0.999][G loss: 2.913 adv: 2.102 recon: 0.067 id: 0.069 time: 14:27:05.448502
Epoch 116/150 2000/2595 [D loss: 0.021 acc: 0.998][G loss: 2.443 adv: 1.459 recon: 0.082 id: 0.080 time: 14:30:04.400091
Epoch 116/150 [D loss: 0.043 acc: 0.971][G loss: 2.362 adv: 1.542 recon: 0.069 id: 0.067 time: 14:31:51.205155
Epoch 117/150 1000/2595 [D loss: 0.018 acc: 1.000][G loss: 2.515 adv: 1.730 recon: 0.065 id: 0.066 time: 14:34:51.080407
Epoch 117/150 2000/2595 [D loss: 0.010 acc: 1.000][G loss: 2.839 adv: 1.858 recon: 0.082 id: 0.081 time: 14:37:51.127148
Epoch 117/150 [D loss: 0.040 acc: 0.975][G loss: 2.369 adv: 1.547 recon: 0.069 id: 0.068 time: 14:39:39.554119
Epoch 118/150 1000/2595 [D loss: 0.034 acc: 1.000][G loss: 2.925 adv: 2.119 recon: 0.067 id: 0.068 time: 14:42:40.923369
Epoch 118/150 2000/2595 [D loss: 0.019 acc: 1.000][G loss: 2.883 adv: 1.890 recon: 0.083 id: 0.082 time: 14:45:41.664838
Epoch 118/150 [D loss: 0.040 acc: 0.975][G loss: 2.358 adv: 1.539 recon: 0.068 id: 0.068 time: 14:47:29.310989
Epoch 119/150 1000/2595 [D loss: 0.011 acc: 1.000][G loss: 2.601 adv: 1.817 recon: 0.065 id: 0.067 time: 14:50:32.682504
Epoch 119/150 2000/2595 [D loss: 0.069 acc: 0.897][G loss: 2.309 adv: 1.319 recon: 0.082 id: 0.084 time: 14:53:37.790991
Epoch 119/150 [D loss: 0.041 acc: 0.973][G loss: 2.351 adv: 1.532 recon: 0.068 id: 0.068 time: 14:55:28.440301
Epoch 120/150 1000/2595 [D loss: 0.032 acc: 1.000][G loss: 2.225 adv: 1.429 recon: 0.066 id: 0.066 time: 14:58:29.951191
Epoch 120/150 2000/2595 [D loss: 0.037 acc: 0.995][G loss: 2.543 adv: 1.568 recon: 0.081 id: 0.080 time: 15:01:31.273915
Epoch 120/150 [D loss: 0.043 acc: 0.972][G loss: 2.354 adv: 1.538 recon: 0.068 id: 0.067 time: 15:03:18.562778
Epoch 121/150 1000/2595 [D loss: 0.025 acc: 1.000][G loss: 2.612 adv: 1.800 recon: 0.067 id: 0.070 time: 15:06:19.171855
Epoch 121/150 2000/2595 [D loss: 0.054 acc: 0.976][G loss: 2.573 adv: 1.618 recon: 0.079 id: 0.080 time: 15:09:20.241432
Epoch 121/150 [D loss: 0.043 acc: 0.970][G loss: 2.359 adv: 1.542 recon: 0.068 id: 0.067 time: 15:11:08.241102
Epoch 122/150 1000/2595 [D loss: 0.030 acc: 0.999][G loss: 2.982 adv: 2.160 recon: 0.068 id: 0.070 time: 15:14:09.545466
Epoch 122/150 2000/2595 [D loss: 0.104 acc: 0.957][G loss: 2.128 adv: 1.162 recon: 0.080 id: 0.081 time: 15:17:11.231897
Epoch 122/150 [D loss: 0.041 acc: 0.971][G loss: 2.389 adv: 1.576 recon: 0.068 id: 0.067 time: 15:18:58.961838
Epoch 123/150 1000/2595 [D loss: 0.027 acc: 1.000][G loss: 2.495 adv: 1.707 recon: 0.066 id: 0.066 time: 15:21:59.860038
Epoch 123/150 2000/2595 [D loss: 0.217 acc: 0.637][G loss: 1.853 adv: 0.869 recon: 0.082 id: 0.081 time: 15:25:00.473281
Epoch 123/150 [D loss: 0.042 acc: 0.970][G loss: 2.357 adv: 1.547 recon: 0.068 id: 0.067 time: 15:26:48.295832
Epoch 124/150 1000/2595 [D loss: 0.032 acc: 1.000][G loss: 3.210 adv: 2.384 recon: 0.069 id: 0.069 time: 15:29:49.002634
Epoch 124/150 2000/2595 [D loss: 0.190 acc: 0.733][G loss: 1.935 adv: 0.963 recon: 0.081 id: 0.081 time: 15:32:51.379679
Epoch 124/150 [D loss: 0.040 acc: 0.972][G loss: 2.393 adv: 1.584 recon: 0.067 id: 0.067 time: 15:34:38.033566
Epoch 125/150 1000/2595 [D loss: 0.039 acc: 1.000][G loss: 2.569 adv: 1.793 recon: 0.065 id: 0.065 time: 15:37:38.615272
Epoch 125/150 2000/2595 [D loss: 0.094 acc: 0.849][G loss: 2.787 adv: 1.802 recon: 0.083 id: 0.080 time: 15:40:39.174788
Epoch 125/150 [D loss: 0.041 acc: 0.970][G loss: 2.381 adv: 1.571 recon: 0.068 id: 0.067 time: 15:42:26.872832
Epoch 126/150 1000/2595 [D loss: 0.020 acc: 1.000][G loss: 2.779 adv: 1.984 recon: 0.066 id: 0.066 time: 15:45:26.553145
Epoch 126/150 2000/2595 [D loss: 0.030 acc: 1.000][G loss: 3.305 adv: 2.346 recon: 0.080 id: 0.080 time: 15:48:28.641213
Epoch 126/150 [D loss: 0.041 acc: 0.973][G loss: 2.359 adv: 1.547 recon: 0.068 id: 0.067 time: 15:50:16.627698
Epoch 127/150 1000/2595 [D loss: 0.015 acc: 1.000][G loss: 2.565 adv: 1.785 recon: 0.065 id: 0.065 time: 15:53:20.586049
Epoch 127/150 2000/2595 [D loss: 0.013 acc: 1.000][G loss: 3.089 adv: 2.079 recon: 0.084 id: 0.084 time: 15:56:23.904216
Epoch 127/150 [D loss: 0.045 acc: 0.968][G loss: 2.318 adv: 1.511 recon: 0.067 id: 0.067 time: 15:58:13.006682
Epoch 128/150 1000/2595 [D loss: 0.007 acc: 1.000][G loss: 2.395 adv: 1.598 recon: 0.067 id: 0.066 time: 16:01:17.524226
Epoch 128/150 2000/2595 [D loss: 0.052 acc: 0.986][G loss: 2.731 adv: 1.760 recon: 0.081 id: 0.082 time: 16:04:21.721351
Epoch 128/150 [D loss: 0.047 acc: 0.965][G loss: 2.326 adv: 1.519 recon: 0.067 id: 0.067 time: 16:06:10.366813
Epoch 129/150 1000/2595 [D loss: 0.026 acc: 1.000][G loss: 2.273 adv: 1.511 recon: 0.063 id: 0.065 time: 16:09:13.706731
Epoch 129/150 2000/2595 [D loss: 0.020 acc: 1.000][G loss: 2.625 adv: 1.652 recon: 0.081 id: 0.081 time: 16:12:17.968288
Epoch 129/150 [D loss: 0.044 acc: 0.970][G loss: 2.350 adv: 1.541 recon: 0.068 id: 0.067 time: 16:14:07.880939
Epoch 130/150 1000/2595 [D loss: 0.009 acc: 1.000][G loss: 2.738 adv: 1.948 recon: 0.066 id: 0.067 time: 16:17:10.919384
Epoch 130/150 2000/2595 [D loss: 0.011 acc: 1.000][G loss: 2.471 adv: 1.497 recon: 0.081 id: 0.081 time: 16:20:16.030657
Epoch 130/150 [D loss: 0.041 acc: 0.974][G loss: 2.376 adv: 1.568 recon: 0.067 id: 0.067 time: 16:22:05.978040
Epoch 131/150 1000/2595 [D loss: 0.013 acc: 1.000][G loss: 2.576 adv: 1.768 recon: 0.068 id: 0.066 time: 16:25:09.239695
Epoch 131/150 2000/2595 [D loss: 0.041 acc: 0.998][G loss: 3.027 adv: 2.034 recon: 0.083 id: 0.082 time: 16:28:11.463026
Epoch 131/150 [D loss: 0.038 acc: 0.979][G loss: 2.389 adv: 1.566 recon: 0.069 id: 0.067 time: 16:30:00.223615
Epoch 132/150 1000/2595 [D loss: 0.038 acc: 0.992][G loss: 2.838 adv: 2.029 recon: 0.068 id: 0.065 time: 16:33:02.044194
Epoch 132/150 2000/2595 [D loss: 0.009 acc: 1.000][G loss: 3.082 adv: 2.091 recon: 0.083 id: 0.082 time: 16:36:03.957870
Epoch 132/150 [D loss: 0.036 acc: 0.982][G loss: 2.434 adv: 1.605 recon: 0.069 id: 0.068 time: 16:37:52.112475
Epoch 133/150 1000/2595 [D loss: 0.016 acc: 0.999][G loss: 2.351 adv: 1.534 recon: 0.069 id: 0.066 time: 16:40:53.890123
Epoch 133/150 2000/2595 [D loss: 0.014 acc: 1.000][G loss: 2.454 adv: 1.477 recon: 0.081 id: 0.083 time: 16:43:55.673722
Epoch 133/150 [D loss: 0.041 acc: 0.976][G loss: 2.391 adv: 1.558 recon: 0.070 id: 0.068 time: 16:45:43.162424
Epoch 134/150 1000/2595 [D loss: 0.024 acc: 0.996][G loss: 2.854 adv: 2.030 recon: 0.069 id: 0.068 time: 16:48:46.809792
Epoch 134/150 2000/2595 [D loss: 0.033 acc: 0.990][G loss: 2.803 adv: 1.824 recon: 0.082 id: 0.081 time: 16:51:48.602172
Epoch 134/150 [D loss: 0.044 acc: 0.974][G loss: 2.318 adv: 1.489 recon: 0.069 id: 0.068 time: 16:53:37.494248
Epoch 135/150 1000/2595 [D loss: 0.016 acc: 1.000][G loss: 2.116 adv: 1.296 recon: 0.068 id: 0.067 time: 16:56:41.444427
Epoch 135/150 2000/2595 [D loss: 0.029 acc: 1.000][G loss: 3.257 adv: 2.264 recon: 0.083 id: 0.084 time: 16:59:46.701686
Epoch 135/150 [D loss: 0.045 acc: 0.972][G loss: 2.286 adv: 1.464 recon: 0.069 id: 0.068 time: 17:01:35.488995
Epoch 136/150 1000/2595 [D loss: 0.014 acc: 1.000][G loss: 2.467 adv: 1.682 recon: 0.065 id: 0.066 time: 17:04:37.950055
Epoch 136/150 2000/2595 [D loss: 0.014 acc: 1.000][G loss: 3.020 adv: 2.013 recon: 0.084 id: 0.084 time: 17:07:42.264930
Epoch 136/150 [D loss: 0.041 acc: 0.978][G loss: 2.358 adv: 1.531 recon: 0.069 id: 0.068 time: 17:09:32.899995
Epoch 137/150 1000/2595 [D loss: 0.050 acc: 0.973][G loss: 2.018 adv: 1.221 recon: 0.067 id: 0.065 time: 17:12:38.550187
Epoch 137/150 2000/2595 [D loss: 0.043 acc: 0.972][G loss: 3.112 adv: 2.118 recon: 0.083 id: 0.083 time: 17:15:45.066226
Epoch 137/150 [D loss: 0.040 acc: 0.979][G loss: 2.368 adv: 1.539 recon: 0.069 id: 0.068 time: 17:17:35.863759
Epoch 138/150 1000/2595 [D loss: 0.038 acc: 0.998][G loss: 3.065 adv: 2.233 recon: 0.070 id: 0.066 time: 17:20:42.107439
Epoch 138/150 2000/2595 [D loss: 0.022 acc: 0.997][G loss: 2.877 adv: 1.865 recon: 0.084 id: 0.084 time: 17:23:48.141206
Epoch 138/150 [D loss: 0.039 acc: 0.981][G loss: 2.399 adv: 1.567 recon: 0.070 id: 0.069 time: 17:25:39.785241
Epoch 139/150 1000/2595 [D loss: 0.023 acc: 1.000][G loss: 2.665 adv: 1.827 recon: 0.071 id: 0.066 time: 17:28:45.551898
Epoch 139/150 2000/2595 [D loss: 0.049 acc: 0.966][G loss: 2.146 adv: 1.158 recon: 0.083 id: 0.081 time: 17:31:52.579327
Epoch 139/150 [D loss: 0.038 acc: 0.983][G loss: 2.424 adv: 1.590 recon: 0.070 id: 0.069 time: 17:33:43.352833
Epoch 140/150 1000/2595 [D loss: 0.035 acc: 0.984][G loss: 2.569 adv: 1.741 recon: 0.069 id: 0.067 time: 17:36:50.064859
Epoch 140/150 2000/2595 [D loss: 0.044 acc: 0.967][G loss: 2.644 adv: 1.649 recon: 0.083 id: 0.082 time: 17:39:56.606298
Epoch 140/150 [D loss: 0.042 acc: 0.976][G loss: 2.386 adv: 1.558 recon: 0.069 id: 0.068 time: 17:41:47.840500
Epoch 141/150 1000/2595 [D loss: 0.014 acc: 1.000][G loss: 2.923 adv: 2.121 recon: 0.067 id: 0.065 time: 17:44:53.916967
Epoch 141/150 2000/2595 [D loss: 0.044 acc: 0.988][G loss: 2.934 adv: 1.955 recon: 0.082 id: 0.081 time: 17:48:00.755993
Epoch 141/150 [D loss: 0.041 acc: 0.976][G loss: 2.409 adv: 1.587 recon: 0.069 id: 0.068 time: 17:49:53.604293
Epoch 142/150 1000/2595 [D loss: 0.029 acc: 1.000][G loss: 3.268 adv: 2.454 recon: 0.068 id: 0.066 time: 17:53:00.693807
Epoch 142/150 2000/2595 [D loss: 0.023 acc: 0.988][G loss: 2.691 adv: 1.695 recon: 0.083 id: 0.083 time: 17:56:08.851478
Epoch 142/150 [D loss: 0.041 acc: 0.976][G loss: 2.360 adv: 1.537 recon: 0.069 id: 0.068 time: 17:58:00.132056
Epoch 143/150 1000/2595 [D loss: 0.016 acc: 1.000][G loss: 1.777 adv: 0.971 recon: 0.067 id: 0.067 time: 18:01:05.699185
Epoch 143/150 2000/2595 [D loss: 0.052 acc: 0.999][G loss: 2.707 adv: 1.737 recon: 0.081 id: 0.082 time: 18:04:13.739679
Epoch 143/150 [D loss: 0.046 acc: 0.971][G loss: 2.322 adv: 1.497 recon: 0.069 id: 0.068 time: 18:06:04.363830
Epoch 144/150 1000/2595 [D loss: 0.051 acc: 0.983][G loss: 2.455 adv: 1.649 recon: 0.067 id: 0.067 time: 18:09:11.145805
Epoch 144/150 2000/2595 [D loss: 0.029 acc: 1.000][G loss: 2.682 adv: 1.709 recon: 0.081 id: 0.082 time: 18:12:16.843750
Epoch 144/150 [D loss: 0.047 acc: 0.966][G loss: 2.303 adv: 1.483 recon: 0.068 id: 0.068 time: 18:14:07.306573
Epoch 145/150 1000/2595 [D loss: 0.022 acc: 1.000][G loss: 2.318 adv: 1.479 recon: 0.070 id: 0.068 time: 18:17:13.765528
Epoch 145/150 2000/2595 [D loss: 0.028 acc: 1.000][G loss: 2.153 adv: 1.161 recon: 0.082 id: 0.083 time: 18:20:20.189642
Epoch 145/150 [D loss: 0.041 acc: 0.976][G loss: 2.376 adv: 1.549 recon: 0.069 id: 0.068 time: 18:22:09.708146
Epoch 146/150 1000/2595 [D loss: 0.023 acc: 1.000][G loss: 1.822 adv: 1.032 recon: 0.066 id: 0.065 time: 18:25:14.974180
Epoch 146/150 2000/2595 [D loss: 0.047 acc: 0.998][G loss: 3.135 adv: 2.149 recon: 0.082 id: 0.081 time: 18:28:19.758202
Epoch 146/150 [D loss: 0.042 acc: 0.972][G loss: 2.371 adv: 1.548 recon: 0.069 id: 0.068 time: 18:30:09.739241
Epoch 147/150 1000/2595 [D loss: 0.332 acc: 0.672][G loss: 2.136 adv: 1.323 recon: 0.068 id: 0.067 time: 18:33:14.771759
Epoch 147/150 2000/2595 [D loss: 0.021 acc: 1.000][G loss: 2.929 adv: 1.949 recon: 0.082 id: 0.081 time: 18:36:18.983751
Epoch 147/150 [D loss: 0.043 acc: 0.970][G loss: 2.385 adv: 1.561 recon: 0.069 id: 0.068 time: 18:38:08.788309
Epoch 148/150 1000/2595 [D loss: 0.034 acc: 1.000][G loss: 2.292 adv: 1.511 recon: 0.065 id: 0.064 time: 18:41:14.026107
Epoch 148/150 2000/2595 [D loss: 0.010 acc: 1.000][G loss: 2.661 adv: 1.682 recon: 0.081 id: 0.082 time: 18:44:21.139943
Epoch 148/150 [D loss: 0.041 acc: 0.973][G loss: 2.390 adv: 1.570 recon: 0.068 id: 0.068 time: 18:46:12.242750
Epoch 149/150 1000/2595 [D loss: 0.017 acc: 1.000][G loss: 2.587 adv: 1.772 recon: 0.068 id: 0.067 time: 18:49:19.072639
Epoch 149/150 2000/2595 [D loss: 0.025 acc: 0.999][G loss: 2.601 adv: 1.602 recon: 0.083 id: 0.083 time: 18:52:25.563950
Epoch 149/150 [D loss: 0.041 acc: 0.973][G loss: 2.389 adv: 1.569 recon: 0.068 id: 0.068 time: 18:54:16.562985
Epoch 150/150 1000/2595 [D loss: 0.034 acc: 0.991][G loss: 2.080 adv: 1.238 recon: 0.071 id: 0.068 time: 18:57:22.047125
Epoch 150/150 2000/2595 [D loss: 0.016 acc: 1.000][G loss: 2.719 adv: 1.761 recon: 0.080 id: 0.081 time: 19:00:27.826595
Epoch 150/150 [D loss: 0.042 acc: 0.972][G loss: 2.398 adv: 1.579 recon: 0.068 id: 0.068 time: 19:02:18.047102
In [19]:
! ls {save_path}/weights
combined-weights_100.h5  d_A-weights_5.h5     g_AB-weights_3.h5
combined-weights_150.h5  d_A-weights.h5       g_AB-weights_50.h5
combined-weights_1.h5	 d_B-weights_100.h5   g_AB-weights_5.h5
combined-weights_3.h5	 d_B-weights_150.h5   g_AB-weights.h5
combined-weights_50.h5	 d_B-weights_1.h5     g_BA-weights_100.h5
combined-weights_5.h5	 d_B-weights_3.h5     g_BA-weights_150.h5
combined-weights.h5	 d_B-weights_50.h5    g_BA-weights_1.h5
d_A-weights_100.h5	 d_B-weights_5.h5     g_BA-weights_3.h5
d_A-weights_150.h5	 d_B-weights.h5       g_BA-weights_50.h5
d_A-weights_1.h5	 g_AB-weights_100.h5  g_BA-weights_5.h5
d_A-weights_3.h5	 g_AB-weights_150.h5  g_BA-weights.h5
d_A-weights_50.h5	 g_AB-weights_1.h5

Generate Images

画像を生成する

In [20]:
# Display images
# 画像を表示する。
%matplotlib inline
import matplotlib.pyplot as plt
import numpy as np

def showImages(imgs, rows=-1, cols=-1, w=2, h=2):
    N = len(imgs)
    if rows < 0: rows = 1
    if cols < 0: cols = (N + rows -1) // rows
    fig, ax = plt.subplots(rows, cols, figsize=(w*cols, h*rows))
    idx = 0
    for row in range(rows):
        for col in range(cols) :
            if rows == 1 and cols == 1:
                axis = ax
            elif rows == 1:
                axis = ax[col]
            elif cols == 1:
                axis = ax[row]
            else:
                axis = ax[row][col]

            if idx < N:
                axis.imshow(imgs[idx])
            axis.axis('off')
            idx += 1
    plt.show()
In [21]:
# Display generated and cycle images.
# 生成画像とサイクル画像を表示する。

test_pairs = test_pair_flow[:5]

test_imgsA = test_pairs[:,0]
test_imgsB = test_pairs[:,1]

imgsAB = gan.generate_image_from_A(test_imgsA)
imgsBA = gan.generate_image_from_B(test_imgsB)

print('A-->B-->A, ID')
showImages(M1P1_ZeroP1(imgsAB), 4)

print('B-->A-->B, ID')
showImages(M1P1_ZeroP1(imgsBA), 4)
A-->B-->A, ID
B-->A-->B, ID

Check the loss and accuracy of the training process.

学習過程のlossと精度を確認する

In [22]:
# Display the graph of losses in training
%matplotlib inline

gan.showLoss()
loss AB
loss BA

Check the saved files

保存されているファイルを確認する

In [23]:
! ls -lR {save_path}
/content/drive/MyDrive/ColabRun/CycleGAN_VidTIMIT01:
total 128
-rw------- 1 root root 27155 Nov 30 02:00 params_100.pkl
-rw------- 1 root root 40955 Nov 30 08:35 params_150.pkl
-rw------- 1 root root   413 Nov 29 12:52 params_1.pkl
-rw------- 1 root root   895 Nov 29 13:08 params_3.pkl
-rw------- 1 root root 13355 Nov 29 19:32 params_50.pkl
-rw------- 1 root root  1416 Nov 29 13:25 params_5.pkl
-rw------- 1 root root 40955 Nov 30 08:35 params.pkl
drwx------ 2 root root  4096 Nov 30 08:35 weights

/content/drive/MyDrive/ColabRun/CycleGAN_VidTIMIT01/weights:
total 246442
-rw------- 1 root root 17974272 Nov 30 02:00 combined-weights_100.h5
-rw------- 1 root root 17974272 Nov 30 08:35 combined-weights_150.h5
-rw------- 1 root root 17974272 Nov 29 12:52 combined-weights_1.h5
-rw------- 1 root root 17974272 Nov 29 13:08 combined-weights_3.h5
-rw------- 1 root root 17974272 Nov 29 19:32 combined-weights_50.h5
-rw------- 1 root root 17974272 Nov 29 13:25 combined-weights_5.h5
-rw------- 1 root root 17974272 Nov 30 08:35 combined-weights.h5
-rw------- 1 root root  2805136 Nov 30 02:00 d_A-weights_100.h5
-rw------- 1 root root  2805136 Nov 30 08:35 d_A-weights_150.h5
-rw------- 1 root root  2805136 Nov 29 12:52 d_A-weights_1.h5
-rw------- 1 root root  2805136 Nov 29 13:08 d_A-weights_3.h5
-rw------- 1 root root  2805136 Nov 29 19:32 d_A-weights_50.h5
-rw------- 1 root root  2805136 Nov 29 13:25 d_A-weights_5.h5
-rw------- 1 root root  2805136 Nov 30 08:35 d_A-weights.h5
-rw------- 1 root root  2805136 Nov 30 02:00 d_B-weights_100.h5
-rw------- 1 root root  2805136 Nov 30 08:35 d_B-weights_150.h5
-rw------- 1 root root  2805136 Nov 29 12:52 d_B-weights_1.h5
-rw------- 1 root root  2805136 Nov 29 13:08 d_B-weights_3.h5
-rw------- 1 root root  2805136 Nov 29 19:32 d_B-weights_50.h5
-rw------- 1 root root  2805136 Nov 29 13:25 d_B-weights_5.h5
-rw------- 1 root root  2805136 Nov 30 08:35 d_B-weights.h5
-rw------- 1 root root  6232880 Nov 30 02:00 g_AB-weights_100.h5
-rw------- 1 root root  6232880 Nov 30 08:35 g_AB-weights_150.h5
-rw------- 1 root root  6232880 Nov 29 12:52 g_AB-weights_1.h5
-rw------- 1 root root  6232880 Nov 29 13:08 g_AB-weights_3.h5
-rw------- 1 root root  6232880 Nov 29 19:32 g_AB-weights_50.h5
-rw------- 1 root root  6232880 Nov 29 13:25 g_AB-weights_5.h5
-rw------- 1 root root  6232880 Nov 30 08:35 g_AB-weights.h5
-rw------- 1 root root  6232880 Nov 30 02:00 g_BA-weights_100.h5
-rw------- 1 root root  6232880 Nov 30 08:35 g_BA-weights_150.h5
-rw------- 1 root root  6232880 Nov 29 12:52 g_BA-weights_1.h5
-rw------- 1 root root  6232880 Nov 29 13:08 g_BA-weights_3.h5
-rw------- 1 root root  6232880 Nov 29 19:32 g_BA-weights_50.h5
-rw------- 1 root root  6232880 Nov 29 13:25 g_BA-weights_5.h5
-rw------- 1 root root  6232880 Nov 30 08:35 g_BA-weights.h5
In [23]: