Sometimes if you get a board that is thin, about 1/4 and make a 45 degree cut at one end, the point will take off caulking without damaging the surface. Try it.