One of the first things that I do after installing the operating system is remap the Caps Lock key to the Backspace key. This is because I have rarely seen any need for the Caps Lock key, while the Backspace is much more useful. You can remap this in Windows using a very nice program called SharpKeys. In Linux there are several ways to accomplish this. You can change the underlying keyboard layout, or if you do not use the terminal directly and instead use the command line interface only through X then you can accomplish this very easily by using xmodmap.
Basically there are two steps.
remove lock = Caps_Lock keysym Caps_Lock = BackSpace
Save the above code to a file (~/bin/map_caps_lock_to_backspace.txt
, may I suggest), and then execute xmodmap map_caps_lock_to_backspace.txt. Try it out, assuming you are in an X session, now the Caps Lock key will act as Backspace!
There you have it. Now, to do this every time that X starts, you can add this to your favorite window manager (XFCE > Settings > Autostarted Application).