A Rate-Distortion Framework for Black-Box Language Models
[Submitted on 22 Jul 2024 (v1), last revised 11 Dec 2024 (this version, v2)] View a PDF of the paper ...
Read more
Benchmarking and Enhancing Multimodal Models on Visual Illusions
[Submitted on 11 Dec 2024] View a PDF of the paper titled Illusory VQA: Benchmarking and Enhancing Multimodal Models on ...
Read more
Simulating Legislative System for Roll Call Votes Prediction with Large Language Models
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals ...
Read more
Extreme Context Compression for Retrieval-augmented Generation with One Token
[Submitted on 22 May 2024 (v1), last revised 9 Dec 2024 (this version, v2)] View a PDF of the paper ...
Read more
[2404.02657] Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models
[Submitted on 3 Apr 2024 (v1), last revised 8 Dec 2024 (this version, v4)] View a PDF of the paper ...
Read more
Benchmarking Open-ended Audio Dialogue Understanding for Large Audio-Language Models
arXiv:2412.05167v1 Announce Type: cross Abstract: Large Audio-Language Models (LALMs) have unclocked audio dialogue capabilities, where audio dialogues are a direct ...
Read more
[2412.04787] Direct Quantized Training of Language Models with Stochastic Rounding
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals ...
Read more
Democratized LLM Scaling for A Large Model Zoo in the Wild
[Submitted on 7 Oct 2024 (v1), last revised 5 Dec 2024 (this version, v2)] Authors:Xinyu Zhao, Guoheng Sun, Ruisi Cai, ...
Read more
[2407.02820] Investigating the Contextualised Word Embedding Dimensions Specified for Contextual and Temporal Semantic Changes
[Submitted on 3 Jul 2024 (v1), last revised 3 Dec 2024 (this version, v2)] View a PDF of the paper ...
Read more
[2311.17696] How to Build an AI Tutor that Can Adapt to Any Course and Provide Accurate Answers Using Large Language Model and Retrieval-Augmented Generation
[Submitted on 29 Nov 2023 (v1), last revised 4 Dec 2024 (this version, v4)] View a PDF of the paper ...
Read more
