Thinking about it, I have been cleared for a contact approach (done a gazillion of them at a certain airport) and also instructed to follow/reference another aircraft. Sounds like the contact approach clearance wasn't legally based on following the other aircraft, that was just a separation advisory sort of thing.