Hi,
Talk to your dentist about your concerns to see what they can suggest. They might be able to use a different material with better retention. These holes are generally sealed with composite resin, a filling material which can be removed by your dentist without damaging your prosthetic, but I wouldn’t have thought it would come out that easily.