A swimming pool operator has removed safety pins from their locker keys on H&S grounds