Graham in his great speech also added on how he voted for Sotomayor (or Kagan, unsure of which, he probably voted for both). Graham voted for them on merit.
Anyway, we really should get away from nominees (in general) who are basically elite, from Ivy League schools. That is as a general statement and I am sure there would be exceptions. Also, the court should reflect America more not have some segments of the population over-represented.