No, the entry signing_keyin your gemspec will not be deleted. It will be publicly available, so people will be able to see the location of your signature key file.
As you already mentioned, this does not mean that people will have access to it, but they will know where it would be if they could access your system.
, gemspec , gem unpack
gem unpack GEMNAME
, !