My A4 2.0 Tdi quattro has a slight noise too. Interestingly, this wasn't noticeable in my Audi 90 quattro, even when it had covered 135k miles.
The 90 quattro only had 195mm wide tyres fitted so the tyre width may be a factor ? The A4 has 235mm wide tyres fitted.