You may not be able to go in (only local residents have the key), but you can peer through the fence and imagine the romantic scenes that have transpired here – or the tough-guy ones, as James Cagney used to live at 34 Gramercy Park E. It's the core of this English-style neighborhood, built by Samuel Ruggles in 1831 after he drained the area’s swamp.
At 15 Gramercy Park S stands the National Arts Club, whose members include Martin Scorsese, Uma Thurman and Ethan Hawke.