[llm_bench] Add possibility to run tool with models in gguf format #2302
Job | Run time |
---|---|
40s | |
56s | |
34m 38s | |
2m 58s | |
3m 54s | |
0s | |
1m 35s | |
54s | |
53s | |
48s | |
51s | |
44s | |
39s | |
46m 9s | |
46s | |
3s | |
1h 36m 28s |
Job | Run time |
---|---|
40s | |
56s | |
34m 38s | |
2m 58s | |
3m 54s | |
0s | |
1m 35s | |
54s | |
53s | |
48s | |
51s | |
44s | |
39s | |
46m 9s | |
46s | |
3s | |
1h 36m 28s |