No one lived on common land – it was far to precious to waste it as living space.
Witch hunts were a town thing, not a rural thing, so feudal lords and serfs were not involved. It was mostly town councils and citicens.
The men and women accused of witchery were avarage citizens, nobody special. (We still have the protocols of the trials)
The accusations were brought forward not by feudal lords or any other ruling class, but by neighbours and relatives.
Most state rulers tried to restrict witch hunts, as they were aware that they were based on superstition and were detrimental to the economy of their countries.
At least in my region, this is false.