Triangle cover on the inside of the door just pryce off. You will then see the three bolt head that hold the mirror on.
Sounds to me like the use of a hot glue gun will fix it, if not then 2nd hand replacements are fairly cheap. Pre-face lift Discovery 1 have the same door mirrors as 4-dr RRC if that helps if/when you look for a replacement.
HTH