The Witherspoon Street School for Colored Children educated the African-American children of Princeton, New Jersey from 1858 until the Princeton Public Schools were integrated in 1948. The school was originally located at the building still standing at 184 Witherspoon Street. As enrollment increased it moved, in 1909, to 35 Quarry Street. The Quarry Street building was expanded in 1939 and again in 1966, giving it its present appearance. The former school has since been turned into an apartment building. It was added to the National Register of Historic Places on March 9, 2005, for its significance in education.

The school is built with brick and features Colonial Revival architecture. An ornate cupola is centered on the roof. In 1948 the Journal of Negro Education wrote that the Witherspoon Street School had empty spaces while the school for white children was overcrowded.