Rosemary for remembrance?

This was a house I recently came across in Advocate Bay, NS About a 90 min drive from where we live. This house had the most amazing spot overlooking the whole bay, I wonder how the previous owners could bare to leave it?

Did they ever comes back? I found an old brick at the front of the house, with what looks like the name Margaret inscribed into it & the year 1976. On the back of the someone had drawn a sprig of rosemary.

Rosemary for remembrance?