I agree you got off lucky... I had a very close call a few weeks ago on my boat. I was trying to "outsmart" the fish and try doing some "S" turns on the back side of Rattlesnake... Yup, turned a bit too close to the island and found a hump. I had all four downriggers jumping up and down from the balls jerking through the rocks... I ran back and flipped them all up just in time to only lose the back half of a dave davies spinner rig. Phew!
I have to give my boat the "Adrien" treatment. Put downrigger toggles right on the steering helm! Another idea stolen from the YoA... hehe.