So the troubles seemed to be over with the ESXi server crashing when I was starting VMs that used PCI devices which had been passed
Have had some problems with getting the GTX480 (turned Quadro 6000) to not crash ESXi 6.0.0. All afternoon it would lock up the entire ESXi
vSphere / ESXi 6 homelab setup video PCI Passthrough of GPU http://www.webbosworld.co.uk/blog/?p=471