The building housing Neue Galerie New York is located at 1048 Fifth Avenue, at 86th Street, in an area known as Museum Mile. The building was completed in 1914 by Carrère & Hastings, also architects of the New York Public Library. It has been designated a landmark by the New York Landmarks Commission and is generally considered to be one of the most distinguished buildings ever erected on Fifth Avenue. Commissioned by industrialist William Starr Miller, it was later occupied by society doyenne Mrs. Cornelius Vanderbilt III and subsequently by the YIVO Institute for Jewish Research. It was purchased by Ronald S. Lauder and Serge Sabarsky in 1994.
Annabelle Selldorf is the architect for the renovation of the building. Her work for Neue Galerie New York has involved restoring 1048 Fifth Avenue to its original state, while adapting it to the most stringent museum standards with regard to the display and preservation of works of art.