The house, with an address of 3 Harvard Place, is just off Harvard Street, once a neighborhood of the wealthy.