Things like gnome-terminal require an UTF-8 locale and although we
expect gnome-session to set this up it's better to have a UTF-8 locale
right away.