For some reason i stopped having this problem ever since i started caring about audio quality and started to collect flacs only.

Technically original distributed media can have volume differences but the only times i ever recall it being problematically different is if its audio from yucktube.