The US doesn't have a "tax residency/non-residency" notion for its citizens/permanent residents. If you're a US citizen/permanent resident - you're considered to be under the US tax jurisdiction, wherever you are and wherever you get your income from.
However, the US law allows certain ways to avoid double taxation (for example, foreign tax credit or foreign earned income exclusion). If your foreign residency is in a country with a high income tax rate (comparable to the US, or higher, which is most of the Western world), you'll probably just be burdened by the paperwork, but won't pay additional taxes. That is, if you're not self employed, since the SE taxes are still there (unless there's a totalization agreement).
Tax treaties also mitigate some of the taxes, but many of them have savings clauses that exempt citizens from most of the provisions. These treaties come handy, however, for pensions and other government-paid benefits - these are usually exempt from the US taxation by most of the treaties, and the exemption includes US citizens (savings clause usually doesn't apply to pensions/social security benefits articles).
That said, if you want to avoid the US taxation altogether the only way would be to renounce your citizenship, but even then you'd still be subject to the US taxes.
First of all, when you renounce your citizenship, you need to provide a certification that your tax issues are in order (no delinquencies, all taxes paid, all returns submitted, etc).
Then, if you have high net worth (>$2MM or above >~$150K/year tax liability in the last several years), you'll have to pay taxes on deemed sale of all your assets (in the US and abroad, since all your income is taxable).
Then, for the next 10 years, you shouldn't spend more than 30 days/year in the US, if you do - that year you're considered a US tax resident and pay taxes on worldwide income as if you were still a citizen.
After 10 years after you renounced your citizenship, your love affair with the IRS will finally be over.
I'd suggest, instead of renouncing your citizenship, calling your senators and representatives and urge them to change the law and welcome the US into the 20th century, where countries only tax their residents. Maybe even 21st century, where the tax code can take less than a book...