GitHub - vllm-project/vllm: A high-throughput and memory-efficient inference and serving engine for LLMs

github.com

GitHub - vllm-project/vllm: A high-throughput and memory-efficient inference and serving engine for LLMs

github.com

luckystarr@feddit.deM to luckystarr@feddit.deEnglish · 3 years ago

A high-throughput and memory-efficient inference and serving engine for LLMs - GitHub - vllm-project/vllm: A high-throughput and memory-efficient inference and serving engine for LLMs

You must log in or # to comment.

Chat

luckystarr@feddit.de

Create a post

You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !luckystarr@feddit.de

If it interests me, it should interest you.

Anything I like and want to remember.

Anything you unknowingly wanted to know for a long time.

Note: If you think you know something that could interest me, feel free to submit, though I reserve the right to remove it if I’m not interested. No hard feelings.

Visibility: Public

This community can be federated to other instances and be posted/commented in by their users.

0 users / day
1 user / week
1 user / month
1 user / 6 months
0 local subscribers
0 subscribers
27 Posts
0 Comments
Modlog

mods:
luckystarr@feddit.de