Search Results for author:
Found 2 papers, 0 papers with code
KV Cache is 1 Bit Per Channel: Efficient Large Language Model Inference with Coupled Quantization
We observe that distinct channels of a key/value activation embedding are highly inter-dependent, and the joint entropy of multiple channels grows at a slower rate than the sum of their marginal entropies.
CAPS: A Practical Partition Index for Filtered Similarity Search
With the surging popularity of approximate near-neighbor search (ANNS), driven by advances in neural representation learning, the ability to serve queries accompanied by a set of constraints has become an area of intense interest.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
