Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Could you explain transformations before applying MAS? #55

Closed
Subuday opened this issue Feb 12, 2024 · 4 comments
Closed

Could you explain transformations before applying MAS? #55

Subuday opened this issue Feb 12, 2024 · 4 comments

Comments

@Subuday
Copy link

Subuday commented Feb 12, 2024

Could you explain intuition behind these lines of code? What formulas does it refer? In Glow-TTS I've found only description precisely algo of MAS, but not these transformations....

image
@shivammehta25
Copy link
Owner

Hello,

This is to compute the log-likelihood for a given data point under a multivariate isotropic Gaussian distribution with mean mu_x.
Log-likelihood is numerically stable to compute than just likelihood as probabilities for very small numbers can cause underflow when multiplied together. Also, log transformation helps to transform multiplication in the linear domain to a summation which is faster to compute.

Hope this helps,
Regards,
Shivam

@Subuday
Copy link
Author

Subuday commented Feb 15, 2024

Could you please provide maybe some references of formula or smth that gives me more intuition around this code, please?

@shivammehta25
Copy link
Owner

It is similar to the one in Glow-TTS, jaywalnut310/glow-tts#72 (comment) just x_logs is constant (1) here.

More info about it can be: https://stats.stackexchange.com/questions/351549/maximum-likelihood-estimators-multivariate-gaussian
Since, this implementation is same as grad-tts the authors there provide a very good explanation regarding this:
huawei-noah/Speech-Backbones#18

@Subuday
Copy link
Author

Subuday commented Feb 15, 2024

Thanks

@Subuday Subuday closed this as completed Feb 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants