In a letter to the state’s Department of Housing and Community Development, the Swampscott Select Board voiced its opposition to the proposed 40B affordable housing development on Elm Place. At the board’s meeting Wednesday