[2404.02657] Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models
![[2404.02657] Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models](https://i0.wp.com/arxiv.org/static/browse/0.3.4/images/arxiv-logo-fb.png?w=1200&resize=1200,700&ssl=1 "[2404.02657] Rethinking Kullback-Leibler Divergence in Knowledge Distillation for Large Language Models"){kind=logo}
[Submitted on 3 Apr 2024 (v1), last revised 8 Dec 2024 (this version, v4)] View a PDF of the paper ...
Read more
Benchmarking Open-ended Audio Dialogue Understanding for Large Audio-Language Models
arXiv:2412.05167v1 Announce Type: cross Abstract: Large Audio-Language Models (LALMs) have unclocked audio dialogue capabilities, where audio dialogues are a direct ...
Read more
[2412.04787] Direct Quantized Training of Language Models with Stochastic Rounding
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals ...
Read more
Democratized LLM Scaling for A Large Model Zoo in the Wild
[Submitted on 7 Oct 2024 (v1), last revised 5 Dec 2024 (this version, v2)] Authors:Xinyu Zhao, Guoheng Sun, Ruisi Cai, ...
Read more
[2407.02820] Investigating the Contextualised Word Embedding Dimensions Specified for Contextual and Temporal Semantic Changes
[Submitted on 3 Jul 2024 (v1), last revised 3 Dec 2024 (this version, v2)] View a PDF of the paper ...
Read more
[2311.17696] How to Build an AI Tutor that Can Adapt to Any Course and Provide Accurate Answers Using Large Language Model and Retrieval-Augmented Generation
[Submitted on 29 Nov 2023 (v1), last revised 4 Dec 2024 (this version, v4)] View a PDF of the paper ...
Read more
Incorporating Cultural Differences into Large Language Models
[Submitted on 9 Feb 2024 (v1), last revised 3 Dec 2024 (this version, v3)] View a PDF of the paper ...
Read more
[2406.10086] Discovering influential text using convolutional neural networks
[Submitted on 14 Jun 2024 (v1), last revised 2 Dec 2024 (this version, v3)] View a PDF of the paper ...
Read more
[2403.06832] Noise-powered Multi-modal Knowledge Graph Representation Framework
[Submitted on 11 Mar 2024 (v1), last revised 30 Nov 2024 (this version, v3)] View a PDF of the paper ...
Read more
[2306.13549] A Survey on Multimodal Large Language Models
[Submitted on 23 Jun 2023 (v1), last revised 29 Nov 2024 (this version, v4)] View a PDF of the paper ...
Read more
