As noted, the main fix here is D-pad support. You can use your controller's D-pad the same as keyboard keys now, instead of tapping rapidly--as intended.
More details about the other, more minor fixes here:
https://epiblitikos.games/devlog/2020/07/31/convergence-compulsion-1.0.4-patch-notes
Happy Release Day! And thanks for playing!