Ed Sheeran had to turn down a chance to party with The Rolling Stones because he'd already had a few wild nights out.