67 min read
THOR: Non-Interactive Transformer Inference with Pure HE
ACM CCS 2025: diagonal representation + compact packing drive the rotation count down to 2%–5% of BOLT in the two most expensive CC-MM cases, and BERT-base with 128 tokens runs in 10 minutes on a single GPU; but 56% of a layer's time goes to bootstrapping.