Unused extensions should be automatically unloaded. SQLite does this when the connections that loaded the extensions are closed (see https://www.sqlite.org/loadext.html, section Persistent Loadable Extensions).
See this thread for more information: #1447 (comment) - specifically this comment, as some extensions cannot be released on connection close.