Skip to content

change duration compute methods #49

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
Jan 19, 2018
Merged

change duration compute methods #49

Changes from 5 commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
26f5b2d
change duration compute methods
Jan 11, 2018
78cce58
modify time calculation method and print mean loss,acc of every pass
Jan 15, 2018
3713d12
modify time calculation method and print mean loss,acc of every pass
Jan 15, 2018
8d5b1aa
delete redundant line and change judge iter
Jan 15, 2018
6e9b36b
Merge branch 'master' of github.com:dzhwinter/benchmark
Jan 15, 2018
0157ed8
Merge branch 'master' of github.com:dzhwinter/benchmark
Jan 17, 2018
c838e11
modify GPUPlace to CUDAPlace
Jan 17, 2018
ba60b28
move line 173 to line 212
Jan 17, 2018
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
25 changes: 15 additions & 10 deletions fluid/resnet50.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -198,7 +198,7 @@ def run_benchmark(model, args):
buf_size=5120),
batch_size=args.batch_size)

place = core.CPUPlace() if args.device == 'CPU' else core.CUDAPlace(0)
place = core.CPUPlace() if args.device == 'CPU' else core.GPUPlace(0)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I remember CUDAPlace is used in the latest PaddlePaddle. Could you refer to the source codes to confirm this.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

exe = fluid.Executor(place)
exe.run(fluid.default_startup_program())

Expand All @@ -209,14 +209,17 @@ def run_benchmark(model, args):
label = np.array(map(lambda x: x[1], data)).astype('int64')
label = label.reshape([-1, 1])

iter = 0
im_num = 0
for pass_id in range(args.pass_num):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

https://github.com/ccmteorljh/benchmark/blob/6e9b36b2cd318f308b80c984617f79f6eccdce5e/fluid/resnet50.py#L170 Maybe moving L170 before L213 is better.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

every_pass_loss = []
every_pass_acc = []
accuracy.reset(exe)
if iter == args.iterations:
break
iter = 0
for batch_id, data in enumerate(train_reader()):
if iter == args.skip_batch_num:
if iter < args.skip_batch_num:
iter += 1
continue
if pass_id == 0 and iter == args.skip_batch_num:
start_time = time.time()
Copy link
Contributor

@ranqiu92 ranqiu92 Jan 15, 2018 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For all batches in pass 0, this line will be executed. Is this what you want?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

modified

if iter == args.iterations:
break
Expand All @@ -229,16 +232,18 @@ def run_benchmark(model, args):
feed={'data': image,
'label': label},
fetch_list=[avg_cost] + accuracy.metrics)
every_pass_acc.append(acc)
every_pass_loss.append(loss)
pass_acc = accuracy.eval(exe)
print("Iter: %d, loss: %s, acc: %s, pass_acc: %s" %
(iter, str(loss), str(acc), str(pass_acc)))
print("Pass: %d, Iter: %d, loss: %s, acc: %s, pass_acc: %s" %
(pass_id, iter, str(loss), str(acc), str(pass_acc)))
iter += 1
im_num += label.shape[0]

print("Pass: %d, Loss: %f, Accuray: %f\n" %
(pass_id, np.mean(every_pass_loss), np.mean(every_pass_acc)))
duration = time.time() - start_time
im_num = im_num - args.skip_batch_num * args.batch_size
examples_per_sec = im_num / duration
sec_per_batch = duration / (iter - args.skip_batch_num)
sec_per_batch = duration / (iter - args.skip_batch_num) / args.pass_num

print('\nTotal examples: %d, total time: %.5f' % (im_num, duration))
print('%.5f examples/sec, %.5f sec/batch \n' %
Expand Down