I think this has, at least partially, to do with gallery not having valid HTML code. It looks like there is some bad nesting of tags and that the HTML between the gallery and the right blocks has a bit extra HTML. I'd have to look at your theme's thtml files (and if you made any changes) to figure out exactly what is wrong.
I'd suggest, for a quick fix, just disabling right blocks when displaying your gallery. Otherwise your best bet is to mess around with the theme and see if you can get things working. Using the w3c's html validator (http://validator.w3c.org/) may help with this.
-Vinny