DarkenStar

I can not import fx `File "/code/torch-mlir/test/python/fx_importer/basic_test.py", line 16, in from torch_mlir import fx ImportError: cannot import name 'fx' from 'torch_mlir'`

OK，thank you very much!!! Let me write a test case

@Qubitium Hello, I write a new script with only using quantized model forward to get hidden states and logits ```python import argparse import pickle from pathlib import Path import torch...

@Qubitium I collected the hidden states and logits using a small debug script: ```python CUDA_VISIBLE_DEVICES=6 python -m evaluation.inference_gptq_hidden_debug \ --save-path ./gptq_single_hidden_debug.pkl \ --dtype float16 CUDA_VISIBLE_DEVICES=6,7 python -m evaluation.inference_gptq_hidden_debug \ --save-path...

@Qubitium Hello, could you please help me to fix or explan this error ? I think I have minimized the problem.