Large and small character scales

Hi

We're working on a game where characters play as both dwarfs and giants. The scale of the scene is correct to Unity's 1 Unity unit to 1 meter.

However when playing as the giant we'd need the head tracking to move much larger distances than when playing as the dwarf due to their differences in character size. How would we go about setting this up?

Thanks for any help.