Skip to content

Instantly share code, notes, and snippets.

View Anemll's full-sized avatar

Anemll Anemll

View GitHub Profile
@smpanaro
smpanaro / compare.py
Last active June 17, 2025 16:41
FPTQuant Query-Key Transform Fusion
import torch
from torch import nn
"""
Proof-of-concept that you can fuse a transformation matrix
into q_proj and k_proj without changing model outputs.
As described in FPTQuant: https://arxiv.org/pdf/2506.04985
"""

ANE Boards

By Device

Marketing name Product SoC ANE Name ANE type
Mac mini (M1, 2020) J274AP T8103 ane 64
MacBook Pro (13-inch, M1, 2020) J293AP T8103 ane 64
MacBook Air (M1, 2020) J313AP T8103 ane 64
iMac (24-inch (4-port), M1, 2021) J456AP T8103 ane 64