Not a good idea to get the head, methinks...
For a start, it risks losing bolts etc. Then there's also the possibility that someone will say of the rest, "Ah, it's got no head on it now, let's sell it for scrap." That might even happen without the manifold.
Go in and get the lot!