Skip to content

Support 4bit quantization #7

New issue
New issue
Open
Open
Support 4bit quantization#7
Assignees
kerthcet
Labels
featureCategorizes issue or PR as related to a new feature.
@kerthcet

Description

@kerthcet
kerthcet
opened on Oct 26, 2023

To save GPU memory.

Metadata

Metadata

Assignees

Labels

featureCategorizes issue or PR as related to a new feature.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions