I like the idea of a superhero movie taking place in a setting that isn't present day New York, sure. But, my favorite aspect of Captain America's story is what happens after WWII, when he becomes an unfrozen caveman superhero* and has to deal with the strangeness of life in our modern times while fighting for ideals that seem to have been lost by our society and coping with the fact that everyone he knew is either elderly or dead.
I guess we'll get that in "The Avengers," though. Either way, I'll be planted squarely in the theater when this comes out.
*Obscure Phil Hartman reference.