Personally I have never had a problem with Prologues or Epilogues. Usually I just think of them as another chapter (albeit a chapter that is either stylistically or temporally removed from the main narrative enough to not be a "regular" chapter). I don't think I have ever skipped either.
For my own novel I have both a Prologue and an Epilogue. The former takes place twenty years before the main narrative, while the latter takes place immediately afterward. They serve as "bookends' to the main narrative, and also feature characters who do not have POV's in the rest of the book. I am still not sure if my Epilogue character will have chapters in the second book or not...