The Hold Steady are planning to release a new album called "Heaven Is Whenever" on May 4th through Vagrant Records.