You need to pass through the device, add it to the VM, set Memory to be fully locked/allocated and then edit the VMX File. I downloaded it then re-uploaded it. But you could use VIM on the CLI.

 

Add this line to the VMX at the bottom:

hypervisor.cpuid.v0 = FALSE

 

Here is the reddit post I started as thats where I got the info on HowTo make this work!

 

https://www.reddit.com/r/VirtualHTPC/comments/5h2vnq/virtualized_htpc_gaming_rig_esxi_6_w_nvidia_gt/

 

Here is a YouTube Video Demo!