What the right books are depends on your level of ability and the areas you need to work on. But you could have a look at "Problems in Elementary Mathematics" by Lidsky, "Mathematical Problems: An Anthology" by Dynkin, and "The USSR Olympiad Problem Book" by Shklarsky (also spelled Shklyarsky in other editions).