hi mate,
you can remove them it will do no damage but, they are there to stop the exhaust from dropping and scrapping on the floor if it snaps,
try getting smaller rubbers to pull the exhaust clear from the bracket,
or realign the exhaust to move it clear,
hope this helps,
regards jon.