I know this is not that new of a thread, but thought I would contribute anyway.
I don't have any good advice on newer or top end equipment. I can only talk about what I use, which is real old, but reliable equipment, and good if you're on a very tight budget.
I use a Garmin eMap as my GPSr. It can fit just 500 waypoints, but that is more than enough for my occasional caching. The screen is monochrome, but of a good readable size. And as the name suggests it has map capabilities. This cost me £50 second hand a couple of years ago, and came with a memory card installed with basic maps of the south of the UK and a car power lead. It takes two AA batteries, which I have a couple of sets of.
If I am going out to do more than just one or two caches, which is not that often at the moment, I load a html formatted PQ using GSAK to my now quite dated K800i phone so I don't need paper print outs.