GitHub

AssertionError: Please install FlashAttention first, e.g., with pip install flash-attn

os.environ["CUDA_VISIBLE_DEVICES"] = '0' model_path="/home/zhanghui/models/Tele-AI/telechat-7B-int4" tokenizer = AutoTokenizer.from_pretrained(model_path,trust_remote ...