The rapid development in the field of artificial intelligence reshapes industries and humankind every day-a remarkable evolution. The machines can think and make decisions because of the availability of a large amount of data. The advancements in technology and the ease with which internet users can generate vast amounts of data daily, the visual representation of the data has a high impact. Image generation based on text is a revolutionary change in AI research advancements, in which machines can interpret and generate visual representations of text. This work aims to collect the data set to build the text-to-image model for Indian scenarios. The diverse data set that pairs textual descriptions with the image content is collected for the various parts of India with different environments to make a robust system. A systematic approach to the collection of data is applied to this work. Further, it explains the annotation approaches and challenges faced during the data collection and annotation stages.