I'm guessing you don't have the fonts installed to properly render the glyphs for the font. IE looks in your font library to see whether you have the font needed to display the appropriate glyph. If the font isn't available, you end up with some cryptic garbage.
The way around this is to install the font called 'Arial Unicode MS'. This unicode font can display most of the worlds languages. It is on the Office 2000 and Office XP CD's and you can install it simply by inserting the CD, Add/Remove > International Tools (I think) > Univeral Font. It is also on the MS Publisher CD.
The font is no longer available for download, but if you don't have these CD's you can copy it from another CD (from C:\Windows\Fonts). It is about 24MB
Once you have this font, I'll be suprised if it doesn't solve your problems, as it has in most cases I have come across.