The native version of Unity on Linux is known to have controller issues. Often times the game wouldn't recognize my controller, have input lag, or only recognize one input at a time. I fixed this issue by enabling steam input for my controller (strange). If you don't want to do this though, I recommend you run the game through Proton.