For the case of normal income, usually income tax is paid to the country where you are working. The U.S. also claims the ability to tax the income of U.S. citizens working in other countries, but for incomes below $97k/year the Foreign Income Exclusion prevents double taxation.

http://www.irs.gov/Individuals/International-Taxpayers/Forei...