Only run Clippy on nightly?

We have a lot of boilerplate code which is meant to work around old Clippy warnings that have been more recently removed. If we were to only run Clippy on nightly in CI, we could clean up a lot of this code. Are there any downsides to not running Clippy on MSRV or stable?