Lactose tolerance is the ability to process a particular sugar. Allergies are adverse reactions to specific proteins.

My guess is that most people (from lactose tolerant populations) with dairy allergies are probably lactose tolerant, it’s just not useful to them.