I use phrasebooks a lot when I'm travelling, as an aid to using and yes, learning, the language. However, I always start by trying to get a grasp of the basic grammar of the language from other books before I go ( although the best phrasebooks do have a grammar section - shame Berlitz dummed down theirs).
This basic grasp means that I can then use the phrasebook as a huge body of examples of the language in use, and I hope to pick up a set of model sentences that can be used in different situations and with different vocabulary - which is where the vocabulary part of the phrasebook is essential.
A good phrasebook will often suggest more natural ways of saying things, which may not be obvious from a study of grammar only, eg. if I want to say ' is there an XYZ round here' it is better to have a dozen examples in the phrasebook than work out for yourself how you will translate 'round here'.
As for understanding replies, a phrasebook is little better than any other method. You're a learner, it'll be difficult at first, and the more you've studied in advance by whatever method, the better equipped you'll be. I would never hand over a phrasebook and expect the native speaker to point out a reply, but that's just me.
So I suppose to summarise, a phrasebook will rarely be a starting point to learning a language, but it can be a very valuable aid in the learning process. And great fun.