Even looking at the example given by threejs I think you will find that when one drags the scale controls the object goes to size extremes. I think for a small amount of movement the controls should be somewhat calibrated to produce smal but meaningful changes in scale
https://threejs.org/examples/misc_controls_transform.html