Closing this issue because the resolution is as follows:

You can call the Department of Public Works at (203) 946-7700, but they're just going to tell you that you need to separate out the recyclables from the trash. Put all the trash (bagged) in the brown bin and the recyclables in the blue bin, and they'll pick everything up. They are no longer allowed to pick up trash in the blue bins since the new brown bins for trash have been in use for quite some time now; residents need to properly sort their trash from their recyclables.

Information on what is recyclable is available here:
http://www.cityofnewhaven.com/Sustainability/Recycling/Single_Stream.asp