Is there an app to comprehensively test the security of a router?

One usually runs Nmap or similar from WAN side to check for open ports.

How to test if a router permits UPnP?

Checking that UPnP is disabled in router’s GUI is not sufficient. An app should try to punch holes, and run tests for various things.

Also, what else needs to be checked?