• refalo@programming.dev
    link
    fedilink
    arrow-up
    0
    ·
    edit-2
    9 days ago

    Now that is cool… it’s a custom 64-core RISC-V implementation with its own matrix instructions that can run desktop inference at 30tok/s (with Qwen3.8-27B) without a GPU.

    However, this is technically just an IP core. And even though it has been tested in hardware prototypes, there are no mass-produced products that are using it yet that we know of.