I too removed the rubber mats for similar reasons, (not big feet, but little room at the pedals).
I then went a step further and secured the carpeted mats to the floor with double edged tape, as they tended to move around under spirited driving events, especially on the track.
Jeff