MTEB: Massive Text Embedding Benchmark

Crosslingual Generalization through Multitask Finetuning

EMNLP 2023 Papers: Explore cutting-edge research from EMNLP 2023, the premier conference for advancing empirical methods in natural language processing. Stay updated on the latest in machine learning, deep learning, and natural language processing with code included. ⭐ support NLP!

[ACL 2023] Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages

[EMNLP 2023] The Vault: A Comprehensive Multilingual Dataset for Advancing Code Understanding and Generation

This repo supports various cross-lingual transfer learning & multilingual NLP models.

Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".

This repository contains the code, data, and models of the paper titled "CrossSum: Beyond English-Centric Cross-Lingual Summarization for 1,500+ Language Pairs" published in Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL’23), July 9-14, 2023.

WorkRB: Work Research Benchmark

An open-source Python package that uses AI to predict Nigerian languages, including English, Pidgin, Yoruba, Hausa, and Igbo.

TUMLU: A Unified and Native Language Understanding Benchmark for Turkic Languages

Official codebase for the ACL 2025 Findings paper: Optimized Text Embedding Models and Benchmarks for Amharic Passage Retrieval.

Generate synthetic labeled data for extremely low-resource languages using bilingual lexicons.

M-ABSA: A Multilingual Dataset for Aspect-Based Sentiment Analysis

Parity-Aware Byte-Pair Encoding: Improving Cross-lingual Fairness in Tokenization [ACL 2026]

Code for "Preference Tuning For Toxicity Mitigation Generalizes Across Languages." Paper accepted at Findings of EMNLP 2024

This repository provides the official resources for EMNLP 2025 Paper Grounding Multilingual Multimodal LLMs With Cultural Knowledge

On Bilingual Lexicon Induction with Large Language Models (EMNLP 2023). Keywords: Bilingual Lexicon Induction, Word Translation, Large Language Models, LLMs.

Cross Lingual Language models for making search engines for Holy Quran and Sahih Hadiths

[ACL 2025] 🔍 Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment