How Can I Undo IRS Passport Revocation?
As we observed previously, there are considerable parallels between losing your drivers’ license for non-driving reasons and losing your passport for non-travel reasons. The IRS cannot suspend your license, because it is a federal agency with no jurisdiction in that area. But your U.S.-issued passport is another matter.
Courts have consistently held that traveling abroad is a privilege and not a right. That stance allows government agencies to invent their own rules when it comes to things like IRS passport revocation.