Publications

Publications in reverse chronological order. My work centers on NLP for the Balochi language and multilingual evaluation of large language models.

2026
Global PIQA: Evaluating Physical Commonsense Reasoning Across 100+ Languages and Cultures Submitted to NeurIPS
Tyler A. Chang, et al. โ€” including Hafeez Ullah (co-author, Balochi language)
arXiv preprint arXiv:2510.24081
A massive participatory commonsense-reasoning benchmark built by 350+ researchers from 65+ countries, covering 141 language varieties across five continents, 19 language families, and 24 writing systems. I verified translations and integrated culturally specific elements for the Balochi language, helping assess cross-lingual performance gaps โ€” up to 68% accuracy difference between languages โ€” in state-of-the-art LLMs.
2026
BalToken: Sub-word Tokenization for a Low-Resource Language Balochi In preparation
Hafeez Ullah
Ready for publication
Proposes a sub-word tokenization scheme tailored to Balochi's morphology and Perso-Arabic script, reducing out-of-vocabulary rates and improving downstream NLP performance compared to standard tokenizers trained on high-resource languages.
2026
Language Identification for Low-Resource Language Balochi In preparation
Hafeez Ullah
Ready for publication
Develops a language identification model that distinguishes Balochi from closely related Perso-Arabic-script languages, supporting reliable corpus collection and filtering for low-resource NLP pipelines.
2025
Balochi Named Entity Recognition Using Machine Learning Approach In preparation
Hafeez Ullah
Ready for publication
Introduces BNer, the first gold-standard Named Entity Recognition dataset for the Balochi language โ€” 58,893 tokens across five domains. Evaluates CRFs, SVMs, and KNNs; SVM achieves an optimal 96% F1-score by leveraging POS features and the BILOU tagging scheme.
2025
Natural Language Processing for Perso-Arabic Languages โ€” A Survey In preparation
Hafeez Ullah
Ready for publication
A comprehensive systematic review of 100+ research papers (2013โ€“2025) tracking the evolution of NLP techniques โ€” from static word embeddings to large language models โ€” across Perso-Arabic-script languages. Identifies critical resource gaps for understudied languages like Balochi and outlines future directions for a unified NLP ecosystem.

Theses

2022
Balochi Named Entity Recognition Using Machine Learning Approach MS Thesis
Hafeez Ullah
Mohammad Ali Jinnah University, Karachi
Ongoing
Corpus Construction, Contextual Embedding Generation, Named Entity Recognition, and Fine-Tuning LLMs for a Low-Resource Language: Balochi PhD Research
Hafeez Ullah
FAST โ€” National University of Computer and Emerging Sciences, Karachi