To have knowledge of the unpleasant secrets of a person or organisation.
From the movie Citizen Kane (1941). Used to indicate knowledge of buried or secret information that others may want to keep hidden.