v1.24 adds an option for "coupled" head movement. This shall make you move in the direction you are looking at all times, instead of "decoupled" movement where you walk in the direction pressed on the touchpad (relative to where you were looking when starting to move).

The default is "decoupled" movement, which was the only "free movement" mode before this update.

You can change this option in the main menu options when playing in VR.