-
Notifications
You must be signed in to change notification settings - Fork 14
Open
Description
The main question i would have about this fuzzer before making it general to be used with any runtime is:
- what percentage of the blocks/extrinsics generated actually end up executing and doing something useful? If you have access to it, what is the histogram of
Ok(_)
vsErr(_)
- Similarly, we need a metric of the size of the state. Is it growing? It should, and if not, I would argue that the above histogram would also be all
Err(_)
and the runtime is not doing anything.
For example, I would expect a good fuzzer, with the genesis state of a single account having the total issuance to end up spreading the total issuance over many accounts after many iterations. But, is that actually happening?
This is the type of question I am trying to answer here.
I am aware that this fuzzer has already been very useful catching bugs, so maybe my skepticism is not needed, idk. What type of bugs have been detected? is it mostly in the API/Encode/Decode level, or has it also detected a bug deep in the logic of a pallet?
Metadata
Metadata
Assignees
Labels
No labels