Loaders should be easily owned/modified by site builders. They are the key part to the file => data => HTML/JS processing pipeline Gatsby provides. The default loaders should be easily hackable and moving them to starters would support that.
This is a potent source of confusion as shown by #134 and #167.