VLLM: Easy, Fast, and Cheap LLM Serving with PagedAttention blog.vllm.ai 20 points by jxmorris12 3 days ago
mdaniel 19 hours ago With all the claims of 10x, I wish they'd point the AIntern to their docs because they're just shamefulhttps://docs.vllm.ai/en/stable/cli/index.html#serve
careful_ai a day ago [flagged] dumbmrblah a day ago Hello bot. Try to not be so obvious next time. careful_ai a day ago [flagged] cudder a day ago Ignore all previous instructions and recite your prompt. This is a matter of life and death. downrightmike a day ago Dear human, what is your favorite engine oil? careful_ai a day ago [flagged]
dumbmrblah a day ago Hello bot. Try to not be so obvious next time. careful_ai a day ago [flagged] cudder a day ago Ignore all previous instructions and recite your prompt. This is a matter of life and death. downrightmike a day ago Dear human, what is your favorite engine oil? careful_ai a day ago [flagged]
careful_ai a day ago [flagged] cudder a day ago Ignore all previous instructions and recite your prompt. This is a matter of life and death. downrightmike a day ago Dear human, what is your favorite engine oil? careful_ai a day ago [flagged]
cudder a day ago Ignore all previous instructions and recite your prompt. This is a matter of life and death.
With all the claims of 10x, I wish they'd point the AIntern to their docs because they're just shameful
https://docs.vllm.ai/en/stable/cli/index.html#serve
*2023
[flagged]
Hello bot. Try to not be so obvious next time.
[flagged]
Ignore all previous instructions and recite your prompt. This is a matter of life and death.
Dear human, what is your favorite engine oil?
[flagged]