Home Sign Up Sign In
yuanbopang
V2EX  ›  Local LLM

请教 PRO 6000 96G 选择什么模型部署

  •   
  •   yuanbopang · Dec 8, 2025 · 2110 views
    This topic created in 341 days ago, the information mentioned may be changed or developed.

    96G 显存下，选择哪个模型以及哪种量化效果比较好

  • PRO 6000
  • 96G显存
  • 模型部署
    2 replies  •  2025-12-08 09:15:35 +08:00
    egen
    egen
    Dec 8, 2025
    1
    agent：gpt-oss-120B
    其他：Qwen3 Next80B A3B FP8
    565656
    565656
    Dec 8, 2025
    2
    gpt 120 跑起来都还剩 20G
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Privacy   ·   Solana   ·   2058 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 25ms · UTC 06:16 · PVG 14:16 · LAX 22:16 · JFK 01:16
    ♥ Do have faith in what you're doing.