From the quest "Purified" which is the quest right after "Drinking Mud"in the 1.1.0 version:
Dirty water is useful in a pinch, but for long term survival you need a way to purify it. Fire will work nicely. Drop the dirty water bottle into a furnace, apply heat, get clean water. Science!