We need two parameters to keep track and to enforce our VAE model to produce a normal distribution in the latent space:

• Mean (should be zero)
• Standard deviation (should be one)

In the following diagram, we have example of normal distributions with different mean and standard deviation values. With just these two values, we can produce a normal distribution that we can sample from: