Azure Storage SDK is deprecated #622
Description
Description
This app is using the deprecated Azue storage SDK
https://github.com/Azure/azure-storage-node
SDK has not had a release since 2019.
The new SDK is actually multiple libraries rather than just one.
We likely need
https://www.npmjs.com/package/@azure/storage-blob
https://www.npmjs.com/package/@azure/storage-queue
Requirement
The crawler can connect to 2 different storage queues. One for submitting harvests and one for processing queue.
We need to ensure we maintain that functionality as third parties are running crawlers in this way