in a GNU Emacs buffer:
M-x (Meta-x or Alt-x) iso-accents-mode
Then for the umlaut: " followed by letter, eg. "u
see:
http://www.gnu.org/software/emacs/manual/html_node/Minor-Modes.html