[2406.16030] Zero-Shot Cross-Lingual NER Using Phonemic Representations for Low-Resource Languages

[Submitted on 23 Jun 2024 (v1), last revised 22 Oct 2024 (this version, v2)]

View a PDF of the paper titled Zero-Shot Cross-Lingual NER Using Phonemic Representations for Low-Resource Languages, by Jimin Sohn and 5 other authors

View PDF
HTML (experimental)

Abstract:Existing zero-shot cross-lingual NER approaches require substantial prior knowledge of the target language, which is impractical for low-resource languages. In this paper, we propose a novel approach to NER using phonemic representation based on the International Phonetic Alphabet (IPA) to bridge the gap between representations of different languages. Our experiments show that our method significantly outperforms baseline models in extremely low-resource languages, with the highest average F1 score (46.38%) and lowest standard deviation (12.67), particularly demonstrating its robustness with non-Latin scripts. Our codes are available at this https URL

Submission history

From: Jimin Sohn Ms. [view email]
[v1]
Sun, 23 Jun 2024 06:38:56 UTC (231 KB)
[v2]
Tue, 22 Oct 2024 01:31:31 UTC (240 KB)

Source link

#ZeroShot #CrossLingual #NER #Phonemic #Representations #LowResource #Languages

Unlock the potential of cutting-edge AI solutions with our comprehensive offerings. As a leading provider in the AI landscape, we harness the power of artificial intelligence to revolutionize industries. From machine learning and data analytics to natural language processing and computer vision, our AI solutions are designed to enhance efficiency and drive innovation. Explore the limitless possibilities of AI-driven insights and automation that propel your business forward. With a commitment to staying at the forefront of the rapidly evolving AI market, we deliver tailored solutions that meet your specific needs. Join us on the forefront of technological advancement, and let AI redefine the way you operate and succeed in a competitive landscape. Embrace the future with AI excellence, where possibilities are limitless, and competition is surpassed.