I moved here recently from Lowell, where I was woken regularly by sirens, and people yelling on the street. I wouldn't say I am a light sleeper, but on trash day, I experience the same thing as you, even though we do leave our bottles and things out for people to take, just to be considerate. Our bedroom is at the rear of the house, and it's still audible, and I agree, annoying. It goes on from 11pm all the way through to 3-4am at times.

I don't think it's rude or disrespectful to wish that people would be more considerate, it goes along the same lines of people with oversensitive car alarms or nervous dogs. If you're living in a high density area, think of others when making noise at sleepy-o clock in the morning :)