Running 64 bit guest OS in virtual ESXi

So to get around the limitation of having a single ESXi host, I blatted my installation of ESXi 5 and installed Windows Server 2008 R2 on my physical machine. Chucked on Workstation 7.1 and created a virtual ESXi 5 host. When I boot up a 64 bit guest Windows Server 2008 R2 on the virtual ESXi host, I get:

This virtual machine is configured for 64-bit guest operating systems. However, 64-bit operation is not possible.
Longmode is disabled for this virtual machine. Continue without 64 bit support?

I googled the error and people seem to suggest to ssh to the ESXi server and follow the instructions in this link. I managed to somehow add the required line, but I still get the same error. VM version = 8.

Help!

error.jpg

Find more posts tagged with

Comments

JDMurray

Does your physical machine have a 64-bit processor and virtualization is turned ON in its BIOS?

Essendon

It sure does have all the jazz turned on JD. I had physical ESXi running without issues.

JDMurray

I have seen that same message in VMware Player 3 running on a 64-bit machine with 64-bit guest OSes, but I ignored it and didn't have a problem.

Essendon

Yeah, but then I cannot install vCenter. Googling away...

GAngel

What processor are you running?

In the processor options for that esx box under workstation is VT enabled on that?
I'm running WS8.0.1 with the exact same setup on multiple physical boxes without an issue.

Essendon

I have an e6550 running on that box. Like I said, I can create Windows Server 2008 R2 VM's in Workstation with no issues at all. It's only when I try to create a guest VM within the virtual ESXi is when I have this issue.

undomiel

Why not try nesting ESXi inside ESXi instead of using Workstation? I haven't tried it myself but I know it is possible with 4 so I would imagine it would be possible with 5 as well. Here's a guide I found on it: VMware vSphere 5 makes it even easier to run ESXi on ESXi, and now supports 64-bit nested guests | VCritical

Essendon

Okay I tried that too Jeff, now when I try installing ESXi inside the physical ESXi box, I get the message:

Hardware virtualisation is not a feature of this CPU, or is not turned on in BIOS.

It sure as hell is, VT-x and VT-d are both enabled, Trusted Execution is off. I have even done a BIOS update, but still get the same message. Any other ideas?

jibbajabba

Essendon wrote: »

Okay I tried that too Jeff, now when I try installing ESXi inside the physical ESXi box, I get the message:

Hardware virtualisation is not a feature of this CPU, or is not turned on in BIOS.

It sure as hell is, VT-x and VT-d are both enabled, Trusted Execution is off. I have even done a BIOS update, but still get the same message. Any other ideas?

Ensure that 'Execute Disable Bit' is enabled too in the bios .. If that is the same as 'Trusted Execution' then turn it on and not off ...

MentholMoose

Essendon wrote: »

Okay I tried that too Jeff, now when I try installing ESXi inside the physical ESXi box, I get the message:

Hardware virtualisation is not a feature of this CPU, or is not turned on in BIOS.

It sure as hell is, VT-x and VT-d are both enabled, Trusted Execution is off. I have even done a BIOS update, but still get the same message. Any other ideas?

Did you enable vhv.allow on the host?

Essendon

Sure did Moose. I just double checked and that entry is there. Followed the instructions in the link I alluded to in my opening post.

undomiel

For the ESXi nested virtual machine do you have Expose Nx Flag set?

petedude

Essendon wrote: »

Sure did Moose. I just double checked and that entry is there. Followed the instructions in the link I alluded to in my opening post.

I'm no VMWare expert, but my question would be-- do you need a firmware/BIOS update on that box? Maybe your CMOS settings aren't visible to VMWare due to some glitch in BIOS.

Just my dumb two cents.

Essendon

Done that too mate - a few posts up.

Essendon

undomiel wrote: »

For the ESXi nested virtual machine do you have Expose Nx Flag set?

Yes Jeff, I've tried both the expose and the hide option with the same result.

Essendon

Here's the error I get just after my virtual ESXi server boots up:

error3.jpg

jibbajabba

Essendon wrote: »

Here's the error I get just after my virtual ESXi server boots up:

jibbajabba wrote: »

Ensure that 'Execute Disable Bit' is enabled too in the bios .. If that is the same as 'Trusted Execution' then turn it on and not off ...

That is the error you're getting if the above isn't enabled in the bios, sometimes called "No-Execute Memory Protection" ..

Everyone

You need Workstation 8, nested 64-bit is NOT supported on 7...

64-bit guests on nested ESXi/vSphere now possible thanks to Workstation 8 | Fix the Exchange!

jibbajabba

Everyone wrote: »

You need Workstation 8, nested 64-bit is NOT supported on 7...

64-bit guests on nested ESXi/vSphere now possible thanks to Workstation 8 | Fix the Exchange!

*double facepalm* - didn't even read that (that he is using 7) ... Everyone is right (no pun intended) - VMW8 is what you need mate otherwise you will only be able to use vSphere 4.x with a bit of hacking and it is bearly useable ....

Essendon

I'll give WS8 a go tonight and tell you guys how I go. A colleague has been able to run nested ESXi inside WS8 with no issues, just as Josh has indicated.

jibbajabba

Essendon wrote: »

I'll give WS8 a go tonight and tell you guys how I go. A colleague has been able to run nested ESXi inside WS8 with no issues, just as Josh has indicated.

Done so since the beta - it really is a no brainer - no tinkering needed - just works .

Essendon

Awright guys, here's an update. Managed to get it working using this link here > VMware Communities: Help Nested Esxi 5 VM Issues!!!

Apparently you need to update the vmx file of the virtual ESXi to allow the passthrough of VT-x. Did not have to go with WS8, but I'll keep it handy in case it's needed down the track - who knows how many curve balls are coming my way in my quest for the VCP5!

Thank you guys for taking the time to post up, taught me a fair bit.

Everyone

I would still recommend upgrading to 8. No hacks needed for it to work there, and lots of other nice new features in it.

undomiel

Glad to hear you found the solution! I'm pretty sure he is nesting ESXi in ESXi, not Workstation.

Everyone

undomiel wrote: »

Glad to hear you found the solution! I'm pretty sure he is nesting ESXi in ESXi, not Workstation.

Read the OP...

Essendon wrote:

Chucked on Workstation 7.1 and created a virtual ESXi 5 host.

Nesting vSphere (not called ESXi anymore ya know. :P) 5 on vSphere 5 should work too though, and allow 64 bit guests.

undomiel

Not to start an argument about these things but later on down in the thread there's this.

Essendon wrote: »

... now when I try installing ESXi inside the physical ESXi box ...

jibbajabba

Everyone wrote: »

Nesting vSphere (not called ESXi anymore ya know. :P) 5 on vSphere 5 should work too though, and allow 64 bit guests.

Actually that is my home lab. I got a dual 5620 box with 64GB of ram, running three hosts nested and a couple of VMs on the physical host for management (vcenter, vcma, vma and the sorts).

Works perfectly fine.

http://www.vcritical.com/2011/07/vmware-vsphere-can-virtualize-itself/

Essendon

I'll clarify guys, I had WS7.1 earlier but then undomiel suggested nesting ESXi inside ESXi, and this is what I went with in the end.

Essendon

Everyone wrote: »

Nesting vSphere (not called ESXi anymore ya know. :P) 5 on vSphere 5 should work too though, and allow 64 bit guests.

Yeah doesnt work right away though, you got to allow VT-x to pass through to the virtual ESXi, umm vSphere 5 box. I followed this link.