If you share xpubs of other currencies to other people, there will be no security issues, but they can monitor your assets.