New tool builds on deepset’s Haystack toward a “decentralized open source AI ecosystem.”...
  • NotSteve_@lemmy.caEnglish
    3·
    2 days ago

    You can actually run simple purpose-built models with very little RAM. I self host immich in a 4GB proxmox VM and it’s able to run its built in image subject recognition AI model without even breaking 50% of that 4GB of RAM