laolao77's picture
SGLang: pass --dtype bfloat16 in the launch command
3db3271 verified