That was me up until April when I finally sold my 03 GSX-R1000. I gave up riding street back in 2013 and did track days only, been riding track since 2006. Now, I have no bike and if I do get back into it, I'm going with a cruiser. Already owned a 1999 Sportster 1200 and loved that thing when it came to riding to work. But with as bad as people drive these days, it really doesn't hurt my feelings to not ride the street anymore.
As far as picking on you for riding the street fast. I can't really do that, as I've done just about everything bad under the sun when it comes to street riding.
I've had two bad crashes in my time, one at the track and one on the street. Luckily, I walked away with mainly just bad headaches from both of them, due to get slammed on the ground.