g jddlZddlmZddlmZddlmZejeZ GddeZ y)N)Fusion)helper) OnnxModelc*eZdZdeffd ZdZxZS)FusionQuickGelumodelc*t||ddgy)N QuickGeluMul)super__init__)selfr __class__s ^/var/www/openai/venv/lib/python3.12/site-packages/onnxruntime/transformers/fusion_quickgelu.pyr zFusionQuickGelu.__init__s  eW5c4|jdk7rtjdy|}|jd}|jj |dgdg}|tjdy|d}|jj |dgdg}|tjdy|d}|jj |jdj}t|dz d k\rtjd y|jd|k7rtjd ytjd |g|jdg|jjd  } d| _ | jjtj d|g|j"j|||g|j$j'| |j(|j*| j,<|j/d y)Nr z/fuse_quickgelu: failed to match second Mul noderSigmoidz,fuse_quickgelu: failed to match Sigmoid nodez.fuse_quickgelu: failed to match first Mul nodegrBs1    8 $;+f;+r