Making payments on your tax debt is easy. Set up a payment plan with the Internal Revenue Service (IRS) to avoid penalty fees and reduce interest.