John Mayer preferred a quiet Jessica Simpson