Drugs aside, a lot of astronomers are cool, too.
Maybe I'm just parsing things wrong, because it's almost like he's saying "Exclude the use of drugs by astronomers, and you can consider them cool." But then what am I to make of the "too"? He's saying astronomers are cool in addition to something else? What? Phil, are drugs cool, too?
....Sincerely, William Safire :)