Water eventually dissolves CA... it can take a very long time though.
If its normal CA and that didn't eat the foam then you are may be dealing with EPO If so, carefully flex the area (to avoid permanent deformation) and the CA will pop off. EPO is the next best thing to Teflon. Nothing really bonds to it. Some glues stick well enough to fly but you can disassemble it every time.