Compilation Info for [7/2]

Dynamo Output:

dynamo_output_graph.txt

Stack

Compile Time(seconds)

Entire Frame [?]: 2.0282950401306152

Backend [?]: 1.217193603515625

Inductor [?]: 0.6493504047393799

Code Gen Time: 0.41071414947509766

Dynamo Time Before Restart [?]: 0.0

Restarts and Failures

No failures!

No restarts!

Cache Metrics

Cache Size: 2

Accumulated Cache Size: 2

Graph Metrics

Guard Count: 109

Shape Env Guards: 25

Graph Ops: 27

Graph Nodes: 41

Graph Inputs: 13

Custom Ops

Compliant Custom Ops:

Non-Compliant Custom Ops:

Symbolic shape specializations

Sym Source(s) Value User stack Framework stack
s2 L['h']
 68
  • /workspace/networks/layers/attention.py:373 in torch_dynamo_resume_in_forward_at_346
  • /workspace/networks/layers/attention.py:394 in local2global
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/polyfill.py:54 in list_cmp
  • /workspace/tools/eval.py:135 in <module>
  • /workspace/tools/eval.py:130 in main
  • /workspace/tools/eval.py:30 in main_worker
  • /workspace/networks/managers/evaluator.py:474 in evaluating
  • /workspace/networks/engines/aotv3_engine.py:657 in match_propogate_one_frame
  • /workspace/networks/engines/aotv3_engine.py:384 in match_propogate_one_frame
  • /workspace/networks/models/aotv3.py:189 in LSTT_forward
  • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1552 in _wrapped_call_impl
  • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1561 in _call_impl
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/eval_frame.py:432 in _fn
  • /workspace/networks/layers/transformer.py:582 in forward
  • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1552 in _wrapped_call_impl
  • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1561 in _call_impl
  • /workspace/networks/layers/transformer.py:753 in forward
  • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1552 in _wrapped_call_impl
  • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1561 in _call_impl
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/eval_frame.py:432 in _fn
  • /workspace/networks/layers/attention.py:314 in forward
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:1115 in __call__
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:947 in __call__
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:471 in __call__
  • /opt/conda/lib/python3.11/site-packages/torch/_utils_internal.py:83 in wrapper_function
  • /opt/conda/lib/python3.11/site-packages/torch/_strobelight/compile_time_profiler.py:129 in profile_compile_time
  • /opt/conda/lib/python3.11/contextlib.py:81 in inner
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:816 in _compile
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/utils.py:232 in time_wrapper
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:635 in compile_inner
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/bytecode_transformation.py:1184 in transform_code_object
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:177 in _fn
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:581 in transform
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2455 in run
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:897 in run
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:809 in step
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:503 in wrapper
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2063 in CALL
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:747 in call_function
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/functions.py:342 in call_function
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/functions.py:294 in call_function
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/functions.py:91 in call_function
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:753 in inline_user_function_return
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2670 in inline_call
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2786 in inline_call_
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:897 in run
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:809 in step
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:1454 in COMPARE_OP
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/builtin.py:962 in call_function
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/builtin.py:846 in builtin_dipatch
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/builtin.py:753 in call_binop_handlers
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/builtin.py:509 in list_compare_nocheck
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/lists.py:149 in list_compare
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/functions.py:294 in call_function
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/functions.py:91 in call_function
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:753 in inline_user_function_return
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2670 in inline_call
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2786 in inline_call_
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:897 in run
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:809 in step
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:457 in inner
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/tensor.py:1041 in evaluate_expr
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/symbolic_shapes.py:778 in guard_scalar
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/symbolic_shapes.py:951 in guard_bool
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/sym_node.py:413 in guard_bool
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/recording.py:244 in wrapper
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/symbolic_shapes.py:5228 in evaluate_expr
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/symbolic_shapes.py:4929 in _maybe_guard_rel
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/symbolic_shapes.py:4797 in _set_replacement
  • /opt/conda/lib/python3.11/site-packages/torch/_logging/_internal.py:1073 in trace_structured
s3 L['w']
 68
  • /workspace/networks/layers/attention.py:373 in torch_dynamo_resume_in_forward_at_346
  • /workspace/networks/layers/attention.py:394 in local2global
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/polyfill.py:54 in list_cmp
  • /workspace/tools/eval.py:135 in <module>
  • /workspace/tools/eval.py:130 in main
  • /workspace/tools/eval.py:30 in main_worker
  • /workspace/networks/managers/evaluator.py:474 in evaluating
  • /workspace/networks/engines/aotv3_engine.py:657 in match_propogate_one_frame
  • /workspace/networks/engines/aotv3_engine.py:384 in match_propogate_one_frame
  • /workspace/networks/models/aotv3.py:189 in LSTT_forward
  • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1552 in _wrapped_call_impl
  • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1561 in _call_impl
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/eval_frame.py:432 in _fn
  • /workspace/networks/layers/transformer.py:582 in forward
  • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1552 in _wrapped_call_impl
  • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1561 in _call_impl
  • /workspace/networks/layers/transformer.py:753 in forward
  • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1552 in _wrapped_call_impl
  • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1561 in _call_impl
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/eval_frame.py:432 in _fn
  • /workspace/networks/layers/attention.py:314 in forward
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:1115 in __call__
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:947 in __call__
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:471 in __call__
  • /opt/conda/lib/python3.11/site-packages/torch/_utils_internal.py:83 in wrapper_function
  • /opt/conda/lib/python3.11/site-packages/torch/_strobelight/compile_time_profiler.py:129 in profile_compile_time
  • /opt/conda/lib/python3.11/contextlib.py:81 in inner
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:816 in _compile
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/utils.py:232 in time_wrapper
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:635 in compile_inner
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/bytecode_transformation.py:1184 in transform_code_object
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:177 in _fn
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:581 in transform
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2455 in run
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:897 in run
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:809 in step
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:503 in wrapper
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2063 in CALL
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:747 in call_function
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/functions.py:342 in call_function
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/functions.py:294 in call_function
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/functions.py:91 in call_function
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:753 in inline_user_function_return
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2670 in inline_call
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2786 in inline_call_
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:897 in run
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:809 in step
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:1454 in COMPARE_OP
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/builtin.py:962 in call_function
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/builtin.py:846 in builtin_dipatch
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/builtin.py:753 in call_binop_handlers
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/builtin.py:509 in list_compare_nocheck
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/lists.py:149 in list_compare
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/functions.py:294 in call_function
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/functions.py:91 in call_function
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:753 in inline_user_function_return
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2670 in inline_call
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2786 in inline_call_
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:897 in run
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:809 in step
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:457 in inner
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/tensor.py:1041 in evaluate_expr
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/symbolic_shapes.py:778 in guard_scalar
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/symbolic_shapes.py:951 in guard_bool
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/sym_node.py:413 in guard_bool
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/recording.py:244 in wrapper
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/symbolic_shapes.py:5228 in evaluate_expr
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/symbolic_shapes.py:4929 in _maybe_guard_rel
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/symbolic_shapes.py:4797 in _set_replacement
  • /opt/conda/lib/python3.11/site-packages/torch/_logging/_internal.py:1073 in trace_structured
s9 L['v'].size()[3]
 4624
  • /workspace/networks/layers/attention.py:375 in torch_dynamo_resume_in_forward_at_346
  • /workspace/tools/eval.py:135 in <module>
  • /workspace/tools/eval.py:130 in main
  • /workspace/tools/eval.py:30 in main_worker
  • /workspace/networks/managers/evaluator.py:474 in evaluating
  • /workspace/networks/engines/aotv3_engine.py:657 in match_propogate_one_frame
  • /workspace/networks/engines/aotv3_engine.py:384 in match_propogate_one_frame
  • /workspace/networks/models/aotv3.py:189 in LSTT_forward
  • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1552 in _wrapped_call_impl
  • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1561 in _call_impl
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/eval_frame.py:432 in _fn
  • /workspace/networks/layers/transformer.py:582 in forward
  • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1552 in _wrapped_call_impl
  • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1561 in _call_impl
  • /workspace/networks/layers/transformer.py:753 in forward
  • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1552 in _wrapped_call_impl
  • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1561 in _call_impl
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/eval_frame.py:432 in _fn
  • /workspace/networks/layers/attention.py:314 in forward
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:1115 in __call__
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:947 in __call__
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:471 in __call__
  • /opt/conda/lib/python3.11/site-packages/torch/_utils_internal.py:83 in wrapper_function
  • /opt/conda/lib/python3.11/site-packages/torch/_strobelight/compile_time_profiler.py:129 in profile_compile_time
  • /opt/conda/lib/python3.11/contextlib.py:81 in inner
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:816 in _compile
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/utils.py:232 in time_wrapper
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:635 in compile_inner
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/bytecode_transformation.py:1184 in transform_code_object
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:177 in _fn
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:581 in transform
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2455 in run
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:897 in run
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:809 in step
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2027 in BINARY_OP
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:233 in impl
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/builtin.py:962 in call_function
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/builtin.py:941 in _handle_insert_op_in_graph
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/builder.py:1713 in wrap_fx_proxy
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/builder.py:1798 in wrap_fx_proxy_cls
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/utils.py:1786 in get_fake_value
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/utils.py:1301 in wrap_fake_exception
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/utils.py:1787 in <lambda>
  • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/utils.py:1904 in run_node
  • /opt/conda/lib/python3.11/site-packages/torch/_prims_common/wrappers.py:263 in _fn
  • /opt/conda/lib/python3.11/site-packages/torch/_decomp/decompositions.py:4290 in matmul
  • /opt/conda/lib/python3.11/site-packages/torch/utils/_stats.py:20 in wrapper
  • /opt/conda/lib/python3.11/site-packages/torch/_subclasses/fake_tensor.py:1060 in __torch_dispatch__
  • /opt/conda/lib/python3.11/site-packages/torch/_subclasses/fake_tensor.py:1449 in dispatch
  • /opt/conda/lib/python3.11/site-packages/torch/_subclasses/fake_tensor.py:1152 in _cached_dispatch_impl
  • /opt/conda/lib/python3.11/site-packages/torch/_subclasses/fake_tensor.py:1756 in _dispatch_impl
  • /opt/conda/lib/python3.11/site-packages/torch/_ops.py:666 in __call__
  • /opt/conda/lib/python3.11/site-packages/torch/_meta_registrations.py:3704 in meta_bmm
  • /opt/conda/lib/python3.11/site-packages/torch/_meta_registrations.py:3682 in common_meta_baddbmm_bmm
  • /opt/conda/lib/python3.11/site-packages/torch/__init__.py:1352 in _check
  • /opt/conda/lib/python3.11/site-packages/torch/__init__.py:1317 in _check_with
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/symbolic_shapes.py:945 in expect_true
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/sym_node.py:429 in expect_true
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/sym_node.py:413 in guard_bool
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/recording.py:244 in wrapper
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/symbolic_shapes.py:5228 in evaluate_expr
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/symbolic_shapes.py:4929 in _maybe_guard_rel
  • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/symbolic_shapes.py:4797 in _set_replacement
  • /opt/conda/lib/python3.11/site-packages/torch/_logging/_internal.py:1073 in trace_structured