Some techniques used to improve mode collapse are as follows:
- Take the output of some layer of the discriminator
- Reshape the input of the discriminator to a matrix
- Compute the L1 distance
- Calculate the sum of the exponentials of the L1 distances
- Concatenate results to the input (some layer of discriminator)