I'm sure that the Moderators at some level can access them. It has been said by OS iirc that they can and do read them for settling disputes, questionable activity, and when requested by LE.definately not the PM`s for sure.
Other than that, a skilled hacker could gain access.
That is my level of perceived privacy with the PM function.