If you plan on using it for pay and play regularly then I would just rip them out!
I use mine as daily driver as well as abusing it off road and I have no carpets, its OK, noisier than standard, but OK!!
There was a guy on Ebay selling replacement boot mats (as the originals are sponges) which are very good but he seems to have disappeared? I have one and it helps dampen a bit of noise.