Hyper-V Access Denied on VHD

I was recently installing Hyper-V and received an error about not having access to a VHD attached to the VM.

It turns out, the Network Service account needs Read/Write/Execute access to the VM, which might not be the case when using customized locations for VHDs.