How do I keep track of configuration changes?

Occasionally I ask how to do some configuration, and people tell me to do stuff like edit some config file in an XYZ directory. But if I configure everything this way, it will turn into a mess, ...