Evaluate sample qualities of GANs in browser



This is the demo of evaluation metric from “ Quantitatively Evaluating GANs with Divergences proposed for Training”. This paper shows how to measure the similarity between the data distribution and model distribution by constructing a critic network based on certain divergence or distance metrics used in training GANs, e.g., least square divergence, Jenson-Shannon divergence, Wasserstein distance, etc. Therefore the evaluation process does not need external model and data labels.

Instructions:



Click " Show Image" to inference samples from data distribution and model distribution.

Click " Evaluate" on each card to evaluate sample qualities.

Real data distribution, as a baseline, has the best quality.

Click " Upload Sample" to upload sample data. To generate one, follow the python code here, reshape a batch of sample images of shape (batchSize, 28,28,1) to (batchSize,28*28,1) and save it to a gray scale png image of shape (batchSize, 28*28).

Example sample Images: LSGAN

Click " Upload Weights" to upload generator weights. You can download trained generator weights from the GAN demo.

Example weight file: 700s






Real Data
Real Data Distribution:

Eval Examples/sec:
Examples evaluated:

Real Data Eval Result:
chart0
Generator of a GAN
Generated Data Distribution:

Eval Examples/sec:
Examples evaluated:

Generated Data Eval Result:
chart1

Example Evaluation Results:

Sample Name Sample Type JS score LS score
data-images Dataset-MNIST 1.4006 0.2584
10s-gen-weight GAN-MNIST 0.00007 0.0032
700s-gen-weight GAN-MNIST 0.321 0.0785
4300s-gen-weight GAN-MNIST 0.598 0.1213
runes-sample-28x28 Sample-Runes 0.011 0.0217
LS-sample-28x28 Sample-MNIST 0.0754 0.0514





Credits: