If you have an APC Smart UPS (and it is Internet connected) then either sever the Internet connection or check out the mitigations that APC(Schneider) have supplied.
The UPS has all the classic PC software security bugs imaginable (buffer overflow etc.) so is open to attack if network connected. I cannot think how it can be attacked if not network connected, but you may know otherwise.