You need to pass through the device, add it to the VM, set Memory to be fully locked/allocated and then edit the VMX File. I downloaded it then re-uploaded it. But you could use VIM on the CLI.
Add this line to the VMX at the bottom:
Here is the reddit post I started as thats where I got the info on HowTo make this work!
Here is a YouTube Video Demo!