On the Impact of Chunking Strategies in NLP Pipelines: A Multi-Task Empirical Study

Publications

On the Impact of Chunking Strategies in NLP Pipelines: A Multi-Task Empirical Study

Author : Dr Sawan Rai

Year : 2025

Publisher : Institute of Electrical and Electronics Engineers Inc.

Source Title : OCIT 2025 - Proceedings 23rd OITS International Conference on Information Technology

Document Type :

Abstract

Chunking input text is a crucial preprocessing step when using Large Language Models (LLMs) for long or structured documents. However, its impact on downstream task performance remains underexplored. This study presents a comprehensive empirical analysis evaluating the effect of various chunking strategies: fixed-size, overlapping, sentence-based, and paragraph-based, across three fundamental NLP tasks: question answering, text classification, and abstractive summarization. Experiments were conducted using lightweight, open-access models such as Flan-T5, GPT-2, DistilBERT, and RoBERTa on benchmark datasets including SQuAD, CoQA, QuAC, IMDB, Amazon Polarity, CNN/DailyMail, and XSum. Performance was measured using task-appropriate metrics (ROUGE, EM, F1, precision, recall) along with latency. Results reveal that chunking strategies significantly affect performance and latency, with no single approach universally optimal. These findings highlight the need for task-specific chunking choices in practical LLM deployments, especially under resource constraints.