[2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics
![[2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics [2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics](https://i0.wp.com/arxiv.org/static/browse/0.3.4/images/arxiv-logo-fb.png?w=1200&resize=1200,700&ssl=1)
[Submitted on 3 Oct 2024 (v1), last revised 31 Oct 2024 (this version, v2)] View a PDF of the paper ...
Read more
Enhancing Table QA Accuracy with Semantic Extraction
![[2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics [2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics](https://i0.wp.com/arxiv.org/static/browse/0.3.4/images/arxiv-logo-fb.png?w=1200&resize=1200,700&ssl=1)
This paper has been withdrawn by Hossein Sholehrasa [Submitted on 21 Sep 2024 (v1), last revised 29 Oct 2024 (this ...
Read more
Multilingual Large Language Models Can Not (Yet) Disambiguate Cross-Lingual Word Sense
![[2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics [2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics](https://i0.wp.com/arxiv.org/static/browse/0.3.4/images/arxiv-logo-fb.png?w=1200&resize=1200,700&ssl=1)
[Submitted on 28 Oct 2024 (v1), last revised 30 Oct 2024 (this version, v2)] View a PDF of the paper ...
Read more
A Model-Agnostic Framework Boosting LLM-based Machine Translation to the Next Level
![[2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics [2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics](https://i0.wp.com/arxiv.org/static/browse/0.3.4/images/arxiv-logo-fb.png?w=1200&resize=1200,700&ssl=1)
[Submitted on 22 Jun 2024 (v1), last revised 29 Oct 2024 (this version, v3)] View a PDF of the paper ...
Read more
Building Specialized Generalists in Biomedicine
![[2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics [2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics](https://i0.wp.com/arxiv.org/static/browse/0.3.4/images/arxiv-logo-fb.png?w=1200&resize=1200,700&ssl=1)
[Submitted on 6 Jun 2024 (v1), last revised 29 Oct 2024 (this version, v2)] Authors:Kaiyan Zhang, Sihang Zeng, Ermo Hua, ...
Read more
Fast Generation from Convolutional Sequence Models
![[2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics [2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics](https://i0.wp.com/arxiv.org/static/browse/0.3.4/images/arxiv-logo-fb.png?w=1200&resize=1200,700&ssl=1)
[Submitted on 2 Oct 2024 (v1), last revised 25 Oct 2024 (this version, v2)] View a PDF of the paper ...
Read more
[2311.09335] Investigating Hallucinations in Pruned Large Language Models for Abstractive Summarization
![[2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics [2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics](https://i0.wp.com/arxiv.org/static/browse/0.3.4/images/arxiv-logo-fb.png?w=1200&resize=1200,700&ssl=1)
[Submitted on 15 Nov 2023 (v1), last revised 24 Oct 2024 (this version, v3)] View a PDF of the paper ...
Read more
[2410.15115] On Designing Effective RL Reward at Training Time for LLM Reasoning
![[2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics [2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics](https://i0.wp.com/arxiv.org/static/browse/0.3.4/images/arxiv-logo-fb.png?w=1200&resize=1200,700&ssl=1)
[Submitted on 19 Oct 2024 (v1), last revised 25 Oct 2024 (this version, v2)] View a PDF of the paper ...
Read more
Improving Open-Domain QA Performance and Interpretability with Relevance Estimator in Retrieval-Augmented Generation
![[2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics [2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics](https://i0.wp.com/arxiv.org/static/browse/0.3.4/images/arxiv-logo-fb.png?w=1200&resize=1200,700&ssl=1)
[Submitted on 9 Jun 2024 (v1), last revised 24 Oct 2024 (this version, v3)] View a PDF of the paper ...
Read more
A Study of Compositional Generalization on OOD Prompts
![[2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics [2410.02691] On the Proper Treatment of Tokenization in Psycholinguistics](https://i0.wp.com/arxiv.org/static/browse/0.3.4/images/arxiv-logo-fb.png?w=1200&resize=1200,700&ssl=1)
[Submitted on 9 Sep 2024 (v1), last revised 24 Oct 2024 (this version, v2)] View a PDF of the paper ...
Read more