The Memorial and Library Association of Westerly was established in 1892 to commemorate the volunteer soldiers and sailors who fought in the Civil War. The library originally included a bowling alley, gymnasium, art gallery, museum and meeting spaces.

In the 1990s, a major addition to the historic building nearly doubled its size. At that time, a variety of Pella aluminum-clad wood windows, in many different shapes, sizes, and combinations, were used to complement the architecture of the original building. In the first floor reading area, large groupings of fixed and operable Architect Series awning windows provide fresh air, abundant natural light and a view to historic Wilcox Park. On the second floor, Architect Series half-circle windows with custom grille patterns add a sense of grandeur to the space while their stained wood interiors complement the interior wood finishes.