Compilation Info for [2/5_1]

Dynamo Output:

dynamo_output_graph.txt

Stack

Compile Time(seconds)

Entire Frame [?]: 6.923046588897705

Backend [?]: 3.7789692878723145

Inductor [?]: 2.319436550140381

Code Gen Time: 1.0104684829711914

Dynamo Time Before Restart [?]: 1.5915143489837646

Restarts and Failures

No failures!

Restart Reasons:

  • Graph break due to unsupported builtin spatial_correlation_sampler_backend.PyCapsule.forward. This function is either a Python builtin (e.g. _warnings.warn) or a third-party C/C++ Python extension (perhaps created with pybind). If it is a Python builtin, please file an issue on GitHub so the PyTorch team can add support for it and see the next case for a workaround. If it is a third-party C/C++ Python extension, please either wrap it into a PyTorch-understood custom operator (see https://pytorch.org/docs/main/notes/custom_operators.html for more details) or, if it is traceable, use torch.compiler.allow_in_graph.

    • Cache Metrics

    Cache Size: 5

    Accumulated Cache Size: 5

    Graph Metrics

    Guard Count: 378

    Shape Env Guards: 118

    Graph Ops: 42

    Graph Nodes: 69

    Graph Inputs: 26

    Custom Ops

    Compliant Custom Ops:

    Non-Compliant Custom Ops:

    Symbolic shape specializations

    Sym Source(s) Value User stack Framework stack
    s7 L['size_2d'][0]
    		 68
    • /workspace/networks/layers/transformer.py:836 in forward
    • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1561 in _call_impl
    • /workspace/networks/layers/attention.py:337 in forward
    • /workspace/tools/eval.py:135 in <module>
    • /workspace/tools/eval.py:130 in main
    • /workspace/tools/eval.py:30 in main_worker
    • /workspace/networks/managers/evaluator.py:474 in evaluating
    • /workspace/networks/engines/aotv3_engine.py:657 in match_propogate_one_frame
    • /workspace/networks/engines/aotv3_engine.py:384 in match_propogate_one_frame
    • /workspace/networks/models/aotv3.py:189 in LSTT_forward
    • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1552 in _wrapped_call_impl
    • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1561 in _call_impl
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/eval_frame.py:432 in _fn
    • /workspace/networks/layers/transformer.py:582 in forward
    • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1552 in _wrapped_call_impl
    • /opt/conda/lib/python3.11/site-packages/torch/nn/modules/module.py:1561 in _call_impl
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:1115 in __call__
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:947 in __call__
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:471 in __call__
    • /opt/conda/lib/python3.11/site-packages/torch/_utils_internal.py:83 in wrapper_function
    • /opt/conda/lib/python3.11/site-packages/torch/_strobelight/compile_time_profiler.py:129 in profile_compile_time
    • /opt/conda/lib/python3.11/contextlib.py:81 in inner
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:816 in _compile
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/utils.py:232 in time_wrapper
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:635 in compile_inner
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/bytecode_transformation.py:1184 in transform_code_object
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:177 in _fn
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/convert_frame.py:581 in transform
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2455 in run
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:897 in run
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:809 in step
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:503 in wrapper
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2063 in CALL
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:747 in call_function
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/lazy.py:132 in realize_and_forward
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/nn_module.py:841 in call_function
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/functions.py:294 in call_function
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/functions.py:91 in call_function
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:753 in inline_user_function_return
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2670 in inline_call
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2786 in inline_call_
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:897 in run
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:809 in step
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:503 in wrapper
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:1504 in CALL_FUNCTION_EX
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:747 in call_function
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/functions.py:342 in call_function
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/functions.py:294 in call_function
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/functions.py:91 in call_function
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:753 in inline_user_function_return
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2670 in inline_call
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2786 in inline_call_
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:897 in run
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:809 in step
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:503 in wrapper
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:2063 in CALL
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/symbolic_convert.py:747 in call_function
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/misc.py:692 in call_function
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/tensor.py:476 in call_method
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/builder.py:1713 in wrap_fx_proxy
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/variables/builder.py:1798 in wrap_fx_proxy_cls
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/utils.py:1786 in get_fake_value
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/utils.py:1301 in wrap_fake_exception
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/utils.py:1787 in <lambda>
    • /opt/conda/lib/python3.11/site-packages/torch/_dynamo/utils.py:1906 in run_node
    • /opt/conda/lib/python3.11/site-packages/torch/utils/_stats.py:20 in wrapper
    • /opt/conda/lib/python3.11/site-packages/torch/_subclasses/fake_tensor.py:1060 in __torch_dispatch__
    • /opt/conda/lib/python3.11/site-packages/torch/_subclasses/fake_tensor.py:1449 in dispatch
    • /opt/conda/lib/python3.11/site-packages/torch/_subclasses/fake_tensor.py:1152 in _cached_dispatch_impl
    • /opt/conda/lib/python3.11/site-packages/torch/_subclasses/fake_tensor.py:1689 in _dispatch_impl
    • /opt/conda/lib/python3.11/site-packages/torch/_refs/__init__.py:4551 in view
    • /opt/conda/lib/python3.11/site-packages/torch/_refs/__init__.py:3685 in _reshape_view_helper
    • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/symbolic_shapes.py:246 in guard_size_oblivious
    • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/sym_node.py:465 in guard_size_oblivious
    • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/recording.py:244 in wrapper
    • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/symbolic_shapes.py:5228 in evaluate_expr
    • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/symbolic_shapes.py:4929 in _maybe_guard_rel
    • /opt/conda/lib/python3.11/site-packages/torch/fx/experimental/symbolic_shapes.py:4797 in _set_replacement
    • /opt/conda/lib/python3.11/site-packages/torch/_logging/_internal.py:1073 in trace_structured