How can I keep the language in the Web Client after log-out?

The Web Client uses the language settings of the operating system. If you are running an English Windows the Web Client will automatically choose English for the Web Client.
If you want to change the language of the Web Client permanent, you have to change the language in the "Regional and Language Options" of Windows.