KTransformers open source framework allows 24GB consumer-grade graphics card to successfully run 671B MoE large model
Recently, China’s Tsinghua University released a set of open source framework GitHub projects called KTransformers, achieving the goal of using ...