Some of them are vented one way so they let air in but not out. Check to make sure it is vacuum and not pressure coming out when you open the cap.

1950 Chevy pickup with '62 261, 4 speed.