Stimuli-responsive colorimetric sensors are promising for various industrial and medical applications due to the capability of simple, fast, and inexpensive visualization of external stimuli. Here we demonstrate a thermoresponsive, smart colorimetric patch based on a thermoresponsive plasmonic microgel embedded in a stretchable hydrogel film. To achieve a fast and efficient thermoresponsive color change, raspberry-shaped plasmonic microgels were fabricated by decorating gold nanoparticles (AuNPs) on poly(N-isopropylacrylamide) (PNIPAM) microgels, which exhibit reversible and strain-insensitive color shifts (between red and grayish violet) in response to a temperature change. The smart colorimetric patch containing a plasmonic microgels exhibits a significant extinction peak shift (176 nm) in a short time (1 s), with a temperature-sensing resolution of 0.2 degrees C. Moreover, the transition temperature of the plasmonic microgel can be finely tuned by additives and comonomers, so that the exquisite temperature visualization can be conducted over a wide temperature range of 25-40 degrees C by assembling plasmonic microgel films with different transition temperatures into an array patch. For proof-of-concept demonstrations, a freestanding smart colorimetric patch was utilized as a spatial temperature scanner and a colorimetric thermometer for a thermoresponsive actuator, which is potentially applicable in smart, wearable sensors and soft robotics.