I'll assume that this exhibits itself if you push the armrest back/upright (which I do to stop my dog jumping from the back to the front) and the lid opens and the contents empty themselves in the rear footwells?

If so you need to order the kit 4F0898173D6PS £20.18 inc VAT* which I have just done, seems like an awfully complex change procedure and have never had problems on any other car with a similar armrest storage on new or used cars in 15yrs. Another unique Audi trait maybe?

*Worthwhile having the part no listed in this forum, this is for the black one and the D is the superceded part no for black.