One feature i'd definitely look for is a rechargable battery or lithium battery - if it takes a AA battery, run away..
I second that. The first camera I had took AA's, and it was a total pain. Only the really expensive ones worked at all, and even those ran out after about 10 pics if you used the flash.