You should check your diaphragm regularly for holes or tears by filling it with water and checking for tiny leaks. If you see one, replace your diaphragm immediately (and you might want to take a pregnancy test if you think you used it while it was damaged).
Even diaphragms without tears should be replaced every 2 years. You should also be refitted after pregnancy or if you lose or gain 10 or more pounds.