Aight so I adjusted a few of the gamepad controls: (changes are marked as bold)
-Movement is handled by the left thumbstick
-Attacking/Casting/Using items is handled by the right thumbstick (simply push in the direction that you want to attack. If you don't like the way it holds your attacks until you release it again, you might wanna try it with the auto-attack mode inside the options set to ON. But keep in mind this will restrict the ability to do heavy attacks and combos.)
-Inventory is mapped to the upper button (Y / Triangle)
-Char Switch is mapped to the right button (B / Circle)
-Interacting is mapped to the lower button (A / X)
-Party/Solo mode is mapped to the left button (X / Square)
-Shoulder bumpers are handling the hotbar item selection
-Left shoulder trigger is mapped to the dash-skill
-Right shoulder trigger + right thumbstick into any direction will perform your special-attack
-Pressing the left thumbstick will fast-skip through dialogue (same as return on keyboard)
-Pressing the right thumbstick will do a parry
-Start will open/close the in-game menu
-Select/Back is a shortcut for returning near a stone of provenance
If you have other controllers with different button mappings (such as a Switch Pro Controller), I strongly recommend to use the Steam Input feature to translate them to Xbox layout.