I address this issue in the security caveats. If you keep scanning local, no problem. If you use a scanning server, every key is like a root equivalent. BIP 352, because you have hardened derivation from the nsec, this is not a problem. With this approach, you do.
https://gist.github.com/trbouma/77648ebe1005b181b67d1c4b42c7f31d
