Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Commit 60fa4b1

Browse files
authored
Update benchmark of gpt2 model with past state (microsoft#4043)
* update benchmark_gpt2 to use past state only * update dynamic axes of input/output tensors * Remove --use_openmp option since it is default for onnxruntime 1.3 cpu. * Use same option names as benchmark.py
1 parent ed0a8e5 commit 60fa4b1

2 files changed

Lines changed: 163 additions & 117 deletions

File tree

onnxruntime/python/tools/transformers/BertOnnxModel.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -224,7 +224,7 @@ def postprocess(self):
224224
self.clean_graph()
225225
self.prune_graph()
226226

227-
def optimize(self, options: BertOptimizationOptions = None):
227+
def optimize(self, options: BertOptimizationOptions = None, add_dynamic_axes=False):
228228
if (options is None) or options.enable_layer_norm:
229229
self.fuse_layer_norm()
230230

@@ -263,7 +263,8 @@ def optimize(self, options: BertOptimizationOptions = None):
263263
self.remove_unused_constant()
264264

265265
# Use symbolic batch dimension in input and output.
266-
self.use_dynamic_axes()
266+
if add_dynamic_axes:
267+
self.use_dynamic_axes()
267268

268269
logger.info(f"opset verion: {self.model.opset_import[0].version}")
269270

0 commit comments

Comments
 (0)