The material has to be identified, in my mind. If this is copper RTV, I would not be concerned. Well maybe a little. By grinding the
oil filter open, again I'm not certain the grit was in the filter before the grinding. I hate to see you tear an engine down for nothing. Also hate to see it damaged more by doing nothing.