windson / inferentia-deployments Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Deploy Large Models on AWS Inferentia (Inf2) instances.

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
deploy-llama-2-13b-chat-inferentia-2-lmi.ipynb		deploy-llama-2-13b-chat-inferentia-2-lmi.ipynb
deploy-tinyllama-inferentia-2-lmi.ipynb		deploy-tinyllama-inferentia-2-lmi.ipynb

Repository files navigation

inferentia-deployments

About

Deploy Large Models on AWS Inferentia (Inf2) instances.

aws lmi inf2 large-model llm inferentia large-language-model large-model-inference aws-inferentia inferentia-2

Report repository

Releases

No releases published

Packages

No packages published

Languages

Jupyter Notebook 100.0%