James L. Pierpont (1822-1893), composer of “Jingle Bells,” served as music director of this church in the 1850s when it was a Unitarian Church located on Oglethorpe Square.