That landlord who did a 'drive-by' inspection caught me off guard

Honestly, last Tuesday I was moving boxes into my new spot in Austin and this property manager, Gary, rolls up unannounced in his truck. He didn't knock, just walked around the back and started peeking through the windows. When I called him out, he said, 'Just making sure you're not running a grow house, I've been burned before.' He never even introduced himself or asked for ID. I checked my lease after and there's a 48-hour notice rule, so he was straight up violating it. Ngl, if I hadn't caught him on camera I'd have thought I was imagining it. Has anyone else had a landlord or manager show up without warning like this, and did you push back or just let it slide?