[Japo]

I think it's after you fight your first dragon near Whiterun they will start hunting you. It can be annoying specially by killing NPCs. Some people like to delay this quest.

But it isn't as bad as the vampires. I hope for your sanity that you either don't have the vampire extension installed yet (even though it isn't bad), or install the mod that can disable their sneak attacks.