As mentioned by Linjo, the ESXi console is a text console. The virtual machines will have a virtual video adapter which has nothing in common with the physically installed one. To use the VM's - i.e. open their display - you need to connect remotely.
André