Here's a list of colleges that I'd rank "higher" or "lower" (whatever that means) than Swarthmore, in no particular order. No need to debate this endlessly, but let me know if I'm fairly close to the correct assessment ...
Aiming "higher" than Swarthmore: Stanford, Penn, UVa, Princeton, Columbia, Cornell, Dartmouth, Duke, Yale, Georgetown, Brown, Chicago, Harvard, Oxford
About the same as Swarthmore: Wesleyan, Colby, Northwestern, Trinity, Vanderbilt, Amherst, Carnegie Mellon, Michigan, NYU, Washington Univ (St. Louis), Edinburgh, Middlebury, Oberlin, Pomona, USC
Aiming "lower" than Swarthmore: Colgate, Tufts, BC, Bowdoin, Dickinson, Haverford, Kenyon, UNC, Tulane, Vermont, W&M, Indiana, Maryland