I don't know what the ramifications are...but we ran with them noisy for several months. My local garage could not figure out the issue a few months back and they did not want to replace any parts unless they were 100% positive (they are a good, honest independent).
We did not noticed performance issues but I really wasn't checking gas mileage, etc. I then remembered this forum and saw the post a few weeks ago and realized it was the dampers.
Next time, the first thing I will do is to check here.