Port Rowan a little village located on the shores of Lake Erie looks like a part of paradise to me because I do not like noise and "bustling" activities.
It is certainly a good and quiet place to stay if you want to relax and explore the surrounding area. There is so much to see and to do.
Great Provincial Parks are close by with direct access to Lake Erie for swimming, hiking, bird watching, canoeing, enjoying protected fauna and flora. Just use the links which have provided to some of them or search the Internet.
They offer great camping facilities.
We have to visit Long Point again. We were there in winter and we loved it even then. We did some hiking. (I did not have any problems with that at this time.) Also Turkey Point is not far away.
But you must not necessary travel with a motor home or put up a tent to enjoy all that. Look for a nice B & B or a clean motel.
It all depends what you want and of your budget.