I'm fine with this, but why do referals take priority over regular job applicants?

The person who works for the company would only refer someone if they could vouch that they are a good employee and a good candidate for the company. That means already they have a better chance of success if hired than a random resume, and that's what gets them to the front of the line.