Faculty Dr Shaik Rafi
Dr Shaik Rafi SRM-AP

Dr Shaik Rafi

Assistant Professor

Department of Computer Science and Engineering

Contact Details

rafi.s@srmap.edu.in

Office Location

Homi J Bhabha Block, Level 3, Cubical No: 23

Social Links

Education

2025
Ph.D
National Institute of Technology Mizoram, Mizoram
India
2020
AMIE
Institute of Engineers
India
2014
M.Tech (CSE)
JNTU Kakinada
India
2012
MCA
JNTU Kakinada
India

Personal Website

Experience

  • 2013-2018 Assistant Professor – Tirumala Engineering College, Narasaraopet
  • 2018-2019 Assistant Professor – Eswar College of Engineering, Narasaraopet
  • 2019-2025 Assistant Professor – Narasaraopeta Engineering College (Autonomous), Narasaraopet

Research Interest

  • Considering two types of modalities such as text and image modalities and extracting features from multimodalities to generate Multimodal Abstractive Text Summarization.
  • My interest also includes to retrieve relevant images to the generated Multimodal Abstractive Summaries using different techniques from deep learning.

Awards

  • Gold Medal in M.Tech – Narasaraopeta Engineering College (2013)
  • Best Paper Award – DoSCI-2025

Memberships

  • ACM
  • IAENG

Publications

  • Generation of Semantic and Contextual Captions to the Images Using ViT

    Srinivas A.V.S.S.P.S.S., TirumalaRao S.N., Narasimha Reddy K.V., Rafi S., Reddy S.

    Conference paper, Lecture Notes in Networks and Systems, 2026, DOI Link

    View abstract ⏷

    Generation of sentences to the images like human is an important task in computer vision which this task can also be called as image caption. This process bridges the computer vision to natural language processing tasks which generate descriptions to the images. This paper highlights to extract semantical and contextual features from images to capture the effective relationship features with Vision Transformer (ViT) in the form of high-level features like objects, meaningful scenes, attributes from the visionary images. These extracted features particularly from the images helps in deep level understanding to the user, that shows context features and spatial feature information from the images. On these extracted essential features this paper utilizes attention mechanism to particularly focus on dynamic regions that helps the model to generate more semantical and contextual text descriptions to the images. Then these integrated features are utilized by the proposed model and enhances the ability to produce captions that are very fluent and descriptions human-like sentences. A standard dataset has been utilized to experiment and to generate captions such like Flickr8k that resembles the effectiveness in its method in generation of descriptions like humans for improving performance over other baseline methods.
  • AI Document Search Chatbot Using Retrieval-Augmented Generation (RAG)

    Rafi S., Siva Rama Krishna Boddu L.V., Lakshmi Pujitha G., Yella S.C., Gangireddy G., Nishanth Bhuvaneswar P.Y.

    Conference paper, Proceeding of International Conference on Computing, Communication, Control and Cyber-Physical Systems, I5CPS 2026, 2026, DOI Link

    View abstract ⏷

    This work describes the design and the implementation of an AI document search chatbot using a Retrieval-Augmented Generation (RAG) architecture that combines generative modelling with information retrieval to provide an accurate and verifiable responses. The system supports PDF, DOCX, CSV, and TXT uploads, which are automatically processed, segmented, and indexed in a vector database for semantic search. It is implemented in Python using LangChain for orchestration, Facebook AI Similarity Search (FAISS) for vector retrieval, and multiple large-language-model Application Programming Interface (API), including OpenAI, Google Generative AI, and Hugging Face. For each query, embeddings are computed and the most relevant document segments are retrieved using cosine similarity before being passed to the selected model to ensure responses are grounded in user-supplied content. Owing to its modular design, the architecture is scalable, maintainable, and easily extensible for enterprise and academic knowledge-management applications.
  • A Hybrid Machine Learning Framework for Personalized Weight Loss through Protein Intake Pattern Analysis

    Siva Rama Krishna B.L.V., Rafi S., Sri Sai Praneeth B.V.S., Sri Nag P.V., Sireesh T.N., Harshitha S.A.

    Conference paper, 2026 IEEE International Conference on Emerging Computing and Intelligent Technologies, ICoECIT 2026, 2026, DOI Link

    View abstract ⏷

    Conventional weight loss programs often apply generalized nutritional guidelines, ignoring individual variations in metabolism and dietary response. Such limitations result in inconsistent progress and reduced long-term success rates. This research presents a data-driven framework to enhance personalized weight management by analyzing protein intake patterns using machine learning and deep learning models. The study employs data from the MyFitnessPal dataset and user-provided records, including diet logs, anthropometric parameters, and demographic details. Pre-processing is performed using a Target Encoding Wavelet Transform Filter (TEWTF) to remove noise and normalize heterogeneous data. Advanced algorithms such as Random Forest Generative Adversarial Networks (RFGAN) and Preference-Aware Inverse Optimization (PAIO) are implemented to create adaptive diet plans aligned with user preferences. Furthermore, Hierarchical Clustering combined with Multi-Layer Perceptron (HCMLP) is utilized to identify protein consumption trends and predict optimal intake levels for diverse user groups. The model dynamically refines nutritional recommendations based on individual behavior and physiological responses. Experimental evaluation shows consistent predictive accuracy, maintaining 95% performance across iterative testing from 100 to 900 posts. This framework demonstrates that machine learning can effectively translate nutritional data into personalized, real-time diet guidance, advancing the field of AI-driven health optimization.
  • Multimodal abstractive summarization and retrieving relevant images to be multimodal output

    Rafi S., Das R., Rizwana S.

    Article, Knowledge and Information Systems, 2026, DOI Link

    View abstract ⏷

    This paper presents a novel multimodal summarization and image retrieval framework, termed Context-Aware CLIP with Hybrid Image-Text Fusion (CA-CLIP-HIT), for generating semantically coherent multimodal abstractive summaries and retrieving contextually relevant images. Existing multimodal summarization approaches often exhibit limitations in contextual understanding, semantic alignment between textual and visual modalities, and retrieval accuracy due to shallow feature representations and insufficient cross-modal interaction. To address these challenges, the proposed framework integrates textual and visual information through a Hybrid Image-Text (HIT) fusion mechanism, which generates context-aware multimodal representations capable of preserving semantic dependencies and contextual relationships across modalities. The extracted multimodal features are fused within the HIT layer to construct a comprehensive contextual representation, which is subsequently processed using a sequence-to-sequence encoder-decoder architecture based on Long Short-Term Memory (LSTM) networks for multimodal abstractive summary generation. To strengthen semantic correspondence between generated summaries (SUMMA) and candidate images, the framework employs the CLIP text encoder for summary representation and the CLIP image encoder for visual representation within a shared semantic embedding space. Cosine similarity is utilized to identify and retrieve the image that exhibits the highest semantic relevance to the generated multimodal summary. In addition, a Caption-Assisted Post-Processing Alignment (CAPPA) mechanism is introduced to address ambiguity during image retrieval. In scenarios where multiple candidate images obtain similar similarity scores, the CAPPA module performs caption-level semantic analysis to determine the image that demonstrates the highest contextual alignment with the generated summary. This refinement mechanism enhances retrieval precision, semantic consistency, and robustness in visually ambiguous retrieval scenarios. The proposed framework is evaluated on the MSMO dataset using ROUGE-1, ROUGE-2, ROUGE-L, BLEU, and Image Precision (IP) metrics. Experimental results demonstrate that the proposed CA-CLIP-HIT framework outperforms existing state-of-the-art methods. Furthermore, statistical significance analysis using a paired Student’s t-test confirms that the observed performance improvements are statistically significant. Overall, the proposed CA-CLIP-HIT framework provides an effective and scalable solution for multimodal abstractive summarization and context-aware image retrieval.
  • Detection of Skin Lesion for Classifying as Benign and Malignant Skin Cancer

    Sankuru H.B., Chandana Y., Rafi S., Reddy K.V.N.

    Conference paper, Lecture Notes in Networks and Systems, 2026, DOI Link

    View abstract ⏷

    Skin cancer is one of the dangerous diseases. This study proposes an automated skin lesion detection and classification system leveraging image processing and deep learning techniques. The methodology includes image acquisition, preprocessing (noise reduction, contrast enhancement, and segmentation), and feature extraction using both handcrafted methods (color, texture, and shape analysis) and deep learning-based approaches (CNNs, Vision Transformers), which is challenging in extracting only particular features. This challenge places an important observation in classifying and extracting features. For classification, deep learning architecture ResNet-50 is employed to differentiate between benign and malignant lesions to classify as skin cancer. Results show that deep learning models surpass traditional approaches in achieving superior accuracy with 89.63 for precision and 91.5 score with F1 and 93.6% with accuracy, sensitivity, and robustness in skin cancer detection. However, challenges such as dataset bias, model interpretability, and real-time deployment remain.
  • A Bio-Nature Inspire Algorithm: Ant Colony Optimization for Classifying Benign and Malignant Tumors in Breast Cancer

    Kanakam S., Narasimha Reddy K.V., Rafi S., Reddy V., Rambabu K.

    Conference paper, Lecture Notes in Networks and Systems, 2026, DOI Link

    View abstract ⏷

    This research presents a novel hybrid framework combining Ant Colony Optimization (ACO) and ResNet-50 deep learning architecture for efficient breast cancer detection and classification in mammographic images. The proposed methodology leverages the strengths of both bio-inspired computing and deep learning to enhance detection accuracy and reduce false positives. ResNet-50’s pre-trained architecture is utilized for robust feature extraction from mammogram images, while ACO optimizes the feature selection and classification process. The system operates in multiple phases: initial preprocessing enhances image quality through adaptive histogram equalization and noise reduction; ResNet-50 extracts hierarchical features from the preprocessed images; ACO then optimizes the feature selection process by treating the feature space as a graph where artificial ants traverse to identify the most discriminative feature combinations. This hybrid approach demonstrated superior performance compared to traditional methods, achieving 97% accuracy sensitivity on the DDSM dataset.
  • Generating Semantic-Based Extractive Summaries in Summarization

    Mandhatha P.C., Narasimha Reddy K.V., Suresh M., Tirumala Rao S.N., Venkata Reddy D., Rafi S.

    Conference paper, Lecture Notes in Networks and Systems, 2026, DOI Link

    View abstract ⏷

    In order to produce succinct and contextually appropriate summaries, this work examines Bidirectional Encoder Representations from Transformers (BERT) for extractive semantic summarization, highlighting its capacity to recognize and utilize keywords and important phrases. BERT outperforms conventional frequency-based keyword extraction techniques by identifying semantical properties from text sentences and visual pictures thanks to its contextual embeddings and self-attention processes. In order to evaluate BERT’s performance in extractive summarization tasks, the article describes a thorough experimental setup that includes dataset selection, preprocessing, model construction, and evaluation measures. To maximize model performance, important hyperparameters are discussed, including batch size, learning rate, and optimization techniques. Findings show that BERT has a strong knowledge of semantics, context-aware extraction, and cross-domain adaptation, which makes it an effective tool for producing high-quality summaries in a variety of applications, including news aggregation, scientific research.
  • Entity-Aware Medical Image Captioning

    Rafi S., Rizwana S., Drutika P., Srija R., Susmitha C.H.S., Sahasra J.

    Article, IEEE Access, 2026, DOI Link

    View abstract ⏷

    In order to produce meaningful textual interpretations of intricate clinical images, medical image captioning has become a significant field of study at the nexus of computer vision and natural language processing. Due to the lack of explicit modeling of medical entities, current methods frequently fail to produce descriptions that are both semantically valid and clinically useful, despite notable advances in deep learning and vision language modeling. Typical captioning methods in particular, fall short of being able to retrieve fine grained diagnostic information and maintain semantic consistency with clinical findings as they focus on global features. This paper addresses these limitations by presenting an entity-aware medical image captioning approach which aims to identify and incorporate clinically relevant entities into the caption generation, including but not limited to, diagnostic finding, anatomical structures, or diagnostic characteristics. The proposed method utilizes entity level representations as a means of guiding the captioning process thereby ensuring a tighter semantic consistency between visual modalities and the resultant textual output. Consequently, this leads to more comprehensible, informative and clinically relevant generated reports. Additionally, inclusion of entity awareness can aid the model in effectively understanding the relationships between medical concepts leading to captions more consistent with medical expertise. The results demonstrate that explicit modeling with structured semantic information within vision-language frameworks are crucial and that entity-aware methods have the potential to greatly improve captioning. This work has the ability to help advance health intelligence applications which will serve to better assist clinical decision making, scale the processing of medical images, and facilitate accurate medical documentation.
  • Feature Augmentation and Convolutional Neural Networks for Accurate Prediction of Heart Disease

    Ramnadh Babu T.G., Bhavana K., Chaitanya G., Sravani M., Shaik R., Moturi S.

    Conference paper, Smart Innovation, Systems and Technologies, 2026, DOI Link

    View abstract ⏷

    Heart diseases are considered the foremost cause of death within developing nations; therefore, prediction of heart disease is crucial for evaluating the risk of patients. This paper will introduce a new method to enhance prediction accuracy by combining CNNs with SAE for feature enhancement. Our method uses a dataset of 918 patient records with 11 clinical variables, and it removes the drawback of traditional classifiers by using feature augmentation to build more informative features. Experimental results show that our model’s accuracy is 93.478%, an improvement over traditional classifiers like MLP and RF by 4.98%. Latent space size is also optimized, and 100 best features are obtained. The results suggest that the deep learning methods, especially the combination of SAE with CNN, bring in notable benefits for heart disease prediction, which might further be used for the clinical purpose of earlier interventions.
  • Reducing extrinsic hallucination in multimodal abstractive summaries with post-processing technique

    Rafi S., Laitonjam L., Das R.

    Article, Neural Computing and Applications, 2025, DOI Link

    View abstract ⏷

    Multimodal abstractive summarization integrates information from diverse modalities, such as text and images, to generate concise, coherent summaries. Despite its advancements, extrinsic hallucination, a phenomenon where generated summaries include content not present in the source, remains a critical challenge, leading to inaccuracies and reduced reliability. Existing techniques largely focus on intrinsic hallucinations and often require substantial architectural changes, leaving extrinsic hallucination inadequately addressed. This paper proposes a novel post-processing approach to mitigate extrinsic hallucination by leveraging external knowledge vocabularies as a corrective mechanism. The framework identifies hallucinated tokens in generated summaries using a cosine similarity metric and replaces them with factually consistent tokens sourced from external knowledge, ensuring improved coherence and faithfulness. By operating at the token level, the approach preserves linguistic, semantic, and syntactic structures, effectively reducing unfaithful content. The proposed method incorporates domain knowledge through a Word2Vec-based vocabulary, offering a scalable solution to enhance factual consistency without modifying model architectures. The contributions of this study include a detailed methodology for identifying and correcting hallucinated tokens, a robust post-processing pipeline for refining summaries, and a demonstration of the method’s effectiveness in reducing extrinsic hallucinations. Experimental results on MSMO dataset highlight the approach’s potential to improve the accuracy, coherence, and reliability of multimodal abstractive summarization systems, addressing a significant gap in the field and shows the state-of-the-art results with RMS-Prop Optimizer.
  • Detecting Chronic Kidney Disease at an Early Stage Through Machine Learning

    Reddy N.M., Rafi S.

    Conference paper, 2025 IEEE 7th International Conference on Cybernetics, Cognition and Machine Learning Applications, ICCCMLA 2025, 2025, DOI Link

    View abstract ⏷

    The objective of the current research is to implement the Random forest approach to predict chronic kidney disease. One of the main chronic ailments is kidney disease. It is extremely cost-effective to identify the problem at an early stage. As the problem is extremely cost-effective, there is a constant concern of the global economic pressure. The aim of the research work is to create a practical model which will be able to predict the disease accurately at an early stage. The initial system relying on the K Nearest Neighbor KNN classification approach. The model as a whole suffers from scalability as does the data, as well as the It suffers from overfitting and poor performance on selection and tuned data. The Random forest approach is an improvement over the KNN model. The Random forest model has proven itself to be better than the KNN approach, and shows l prediction accuracy on chronic kidney disease case. The research work shows how advancement in machine learning could improve prediction on the specified ailment. Aspects like feature projection, data preprocessing data, and alternate ensemble learning methods could be used in future work to improve. Such results but point towards the essential need of Indic.
  • Multimodal Image Caption Generation with Semantic and Temporal Context

    Rafi S., Das R., Rao P.A., Rizwana S.

    Conference paper, Proceedings of the International Conference on Soft Computing and Machine Intelligence, ISCMI, 2025, DOI Link

    View abstract ⏷

    Multimodal semantic image captioning is a cutting-edge approach that combines visual and textual modalities to generate accurate and contextually rich natural language descriptions of images. This method extends beyond traditional captioning by incorporating semantic understanding and capturing high-level concepts such as object attributes, relationships, and scene using temporal context. The proposed model effectively align visual content with multimodal linguistic meaning by combining visual features extracted from deep convolutional networks like ResNet-101 with semantic representations derived from textual embedding's enriched by external knowledge bases and the language description generation is typically handled by sequence models like LSTM which is conditioned on the fused multimodal inputs. The semantic option helps the model to generate meaningful captions semantically aligned with the image content, leading to improved relevance, diversity, and human likeness. As Multimodal semantic image captioning progress with Flickr-30k data that consider multimodalities of information in the form of images and text descriptions trained with Adam Optimizer for 30 epochs. The proposed model shows greater performance with 63% Bleu and Meteor metric when compared with other models.
  • LSTM based DDos Attacks Prevention and Detection for EV Charging Batteries

    Saida S.J., Tiwari B.K., Rafi S.

    Conference paper, 3rd International Conference on Power Electronics and Energy, ICPEE 2025, 2025, DOI Link

    View abstract ⏷

    Electric Vehicle charging infrastructure is crucial to the sustainable energy transition but it is also susceptible to cyberattacks. Protection against possible cyberattacks, such as Distributed Denial of Service (DDoS) assaults, has become crucial with the growth of electric vehicle supply equipment (EVSE) networks. The extensive Electric Vehicle Supply Equipment (EVSE) dataset, which includes high-performance computing (HPC) statistics, system performance indicators, and network traffic data, is used to analyze the proposed approach, and to create a strong anomaly detection framework by utilising deep learning techniques, to analyse host-based data, such as kernel eventlogs and HPC data. LSTM based model is used for sequence-based learning, analysing high-granularity event sequences to identify anomalous patterns, and putting in place a preprocessing pipeline that guarantees dependable data input for the model are some of the main contributions.
  • Abstractive Text Summarization with Semantic and Contextual Alignment using BART

    Rafi S., Boddu L.V.S.R.K., Pidikiti D., Rayavarapu S., Chimirala S.S., Javvadi S.

    Conference paper, Proceedings of 2025 International Conference on Signal Processing, Computation, Electronics, Power and Telecommunication, IConSCEPT 2025, 2025, DOI Link

    View abstract ⏷

    The enormous information overload caused by the exponential growth of digital content across businesses is making it more challenging to adopt effective automatic summarizing solutions. Abstractive text summarizing has grown to be an important area in NLP with the aim of creating concise, clear, and instructive summaries that go beyond basic source text extraction. Summarization systems continue to struggle with issues of semantic purity, factual correctness, and contextual alignment despite tremendous advancements made possible by deep learning and transformer-based architectures. The study uses the BART model, which has been refined on a sizable news dataset, to examine abstractive summarization with an emphasis on semantic and contextual alignment. The suggested system incorporates contextual alignment techniques and semantic-aware preprocessing to guarantee that generated summaries maintain coherence and fluency while preserving meaning fidelity. The main evaluation metric used in the study is ROUGE, which is supplemented by knowledge from more modern semantic similarity-based methodologies. When compared to baseline summarization systems, experimental results show significant gains in content selection, semantic consistency, and textual coherence, especially for longer inputs. The evaluation further highlights the benefits of incorporating semantic and contextual representations into training pipelines, showing that such improvements can reduce factual inconsistencies and improve the total informativeness of summaries that were produced.
  • The Perils of Naive Truncation: A Context Ablation Study for Dialogue Summarization on DialogSum

    Rafi S., Boddu L.V.S.R.K., Kolla D.V., Pothuguntla C., Myla R.B.

    Conference paper, 2025 5th International Conference on Artificial Intelligence and Signal Processing, AISP 2025, 2025, DOI Link

    View abstract ⏷

    A common shortcut in dialogue summarization is to truncate a conversation to its most recent turns, assuming this reduces cost without hurting summary quality. We test this assumption through a controlled context ablation study on DialogSum using DistilBART as the main model, with T5- small and BART-large for confirmation. Truncation consistently hurts quality: BERTScore drops by -0.0115 and ROUGE-L by -0.0705 (p < 0.0001), showing that removing early context acts as lossy compression that distorts meaning. Meanwhile, efficiency barely improves - shrinking input length by about 75% yields only a ~ 10% gain in throughput on an NVIDIA T4 GPU. These findings reveal that naive truncation is counterproductive; future dialogue summarization systems should adopt adaptive, content- aware context selection rather than blunt length reduction.
  • Analysis on Data by Deterioration Ambiguity Technique Using Data Analysis for Agriculture

    Rafi S., Manohar T.V., Siva Rama Krishna B.L.V., Narasimha Raju B.N.V.

    Conference paper, 2025 5th International Conference on Artificial Intelligence and Signal Processing, AISP 2025, 2025, DOI Link

    View abstract ⏷

    This research investigates the evolving advantages of diverse career trajectories while critically examining the current absence of standardized frameworks within the data science discipline. The pervasive dissemination of misinformation across the internet has precipitated an unprecedented surge in data generation, thereby necessitating the emergence of data mining as a crucial analytical paradigm. Over the forthcoming decade, the capability to extract contextually significant and substantively relevant insights from vast datasets is projected to become a fundamental determinant of progress across multiple domains.In particular, this study analyzes five case studies that collectively endeavor to establish a unified understanding of occupational structures within the data science ecosystem. The examination and utilization of data-driven insights to support empirical observation and informed decision-making constitute essential components, especially within the agricultural sector. Building upon these contextual analyses, the research delineates the distinct yet complementary roles of data engineers and data scientists in shaping effective data-centric strategies.To evaluate crop productivity, the study applies data mining methodologies with an emphasis on regression analysis. The estimation of individual crop yields is conducted through the identification of underlying patterns in parameter-specific variables and historical data records. This methodological approach facilitates the derivation of predictive insights, thereby contributing to enhanced agricultural output assessment and strategic planning.
  • A Novel Approach for Early Detection of Forest Fire from Images with Deep Learning: A Machine Vision Course Experiment

    Udaya Lakshmi B.N.V., Lakshminadh K., Suresh Babu K., Narasimha Reddy K.V., Rafi S., Swathi P.

    Conference paper, Lecture Notes in Networks and Systems, 2025, DOI Link

    View abstract ⏷

    Rapid and precise detection systems are necessary because wild forest fires are a serious hazard to infrastructure, human lives, and ecosystems. The ResNet-50 convolutional neural network (CNN) is used in this work to provide a deep learning-based method for detecting wild forest fires. By utilizing ResNet-50’s potent feature extraction capabilities, the model is optimized to categorize images as “Fire” or “No Fire,” guaranteeing excellent precision and recall. To improve model performance on a variety of image datasets, the system integrates a strong data preprocessing pipeline that includes scaling, normalization, and data augmentation techniques including flipping, rotation, and brightness correction. The model is trained used Adam optimizer and emphasizing early stopping mechanism with learning rate of le-4. The model efficiencies on fire forest dataset which includes satellite, drone, and ground captured images.
  • Topic-guided abstractive multimodal summarization with multimodal output

    Rafi S., Das R.

    Article, Neural Computing and Applications, 2025, DOI Link

    View abstract ⏷

    Summarization is a technique that produces condensed text from large text documents by using different deep-learning techniques. Over the past few years, abstractive summarization has drawn much attention because of the capability of generating human-like sentences with the help of machines. However, it must improve repetition, redundancy and lexical problems while generating sentences. Previous studies show that incorporating images with text modality in the abstractive summary may reduce redundancy, but the concentration still needs to lay on the semantics of the sentences. This paper considers adding a topic to a multimodal summary to address semantics and linguistics problems. This stress the need to develop a multimodal summarization system with the topic. Multimodal summarization uses two or more modalities to extract the essential features to increase user satisfaction in generating an abstractive summary. However, the paper’s primary aim is to explore the generation of user preference summaries of a particular topic by proposing a Hybrid Image Text Topic (HITT) to guide the extracted essential information from text and image modalities with the help of topic that addresses semantics and linguistic problems to generate a topic-guided abstractive multimodal summary. Furthermore, a caption-summary order space technique has been introduced in this proposed work to retrieve the relevant image for the generated summary. Finally, the MSMO dataset compares and validates the results with rouge and image precision scores. Besides, we also calculated the model’s loss using sparse categorical cross entropy and showed significant improvement over other state-of-the-art techniques.
  • Recognizing Image Manipulations Utilizing CNN and ELA

    Nallamothu K., Rafi S., Kokkiligadda S., Jany S.M.

    Conference paper, Lecture Notes in Networks and Systems, 2025, DOI Link

    View abstract ⏷

    Tampering of digital photos or images is known as image forgery. The ability to create phony images or information has become easier due to the rapid advancement of technology. In order to detect image forgeries, this paper proposes a model that employs Error Level Analysis (ELA) with Convolutional Neural Networks (CNN). ELA is used as a preprocessing step to highlight regions of an image that may have been tampered with. CNN is then trained on this enhanced data to classify images based on their authenticity and detect digital modifications. This initiative’s main goals include image classification, attribute extraction, image authenticity verification, and digital image modification detection. Our suggested solution makes use of CNNs’ deep learning capabilities and the refinement found by ELA.
  • Multimodal: A Text-Image based Cyber-Bullying Detecting with Deep Learning

    Ankarao A., Rafi S., Eluri R.K., Reddy K.V.N.

    Conference paper, 2025 IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation, IATMSI 2025, 2025, DOI Link

    View abstract ⏷

    The practice of categorizing and identifying cyber-bullying behavior, which include using technology to harass or intimidate people - usually through online platforms - is known as cyberbullying detection. To tackle this, we took a look at a dataset that was made public and labeled as bully or non-bully based on text, image, and image-text. Then, we proposed a deep learning model that could identify cyberbullying in multimodal data. Bullying in text is detected using the XLM-RoBERTa with BiGRU model, while bullying in images is identified by the VGG16 pre-trained model. Using attention processes, CLIP, feedback mechanisms, CentralNet, and other tools, we combined these models (VGG16 + XLM-RoBERTa and BiGRU) and developed a model for identifying cyberbullying in image-text based memes.With a respectable accuracy of 72%, our final model demonstrated that the system is capable of identifying the majority of cyberbullying incidents.
  • Detecting multimodal cyber-bullying behaviour in social-media using deep learning techniques

    MohammedJany S., Killi C.B.R., Rafi S., Rizwana S.

    Article, Journal of Supercomputing, 2025, DOI Link

    View abstract ⏷

    Cyberbullying detection refers to the process of classifying and identifying of cyberbullying behavior—which involves the use of technology to harass, or bullying individuals, typically through online platforms. A growing concern is the spread of bullying memes on social media, which can perpetuate harmful behavior. While much of the existing research focuses on detecting cyberbullying in text-based data, image-based cyberbullying has not received as much attention. This is a significant issue because many social media posts combine images with text, and the visual content can be a key component of cyberbullying. To address this, our research aims to develop a multimodal cyberbullying detection modal (MCB) that is capable of detecting bullying in both images and text. For this, we used VGG16 pretrained model to detect bullying in images and XLM-RoBERTa with BiGRU model to detect bullying in text. Together we integrated these models (VGG16 + XLM-RoBERTa and BiGRU) using attention mechanisms, CLIP, feedback mechanisms, CentralNet, etc., and proposed a model used for detecting cyberbullying in image-text-based memes. Our accomplished model produced a reasonable accuracy of 74%, pointing that the system is effective in recognizing most cyberbullying activity.
  • Multiple Disease Detection using CNN based Model from Chest X-rays

    Seviappan A., Chethan D., Sri P.K., Rafi S., Shahi S.G.

    Conference paper, Proceedings of 3rd International Conference on Sustainable Computing and Data Communication Systems, ICSCDS 2025, 2025, DOI Link

    View abstract ⏷

    Chest X-rays are one of the most widely used diagnostic tools for identifying lung-related diseases such as pneumonia, tuberculosis, and lung cancer. However, manual interpretation of these images can be time-consuming and subject to inconsistencies, especially in high-pressure clinical settings or areas with limited access to radiologists. To address these challenges, this study introduces a deep learning-based system that leverages Convolutional Neural Networks (CNNs) for automatic disease detection from chest X-ray images. The model is trained on a large, diverse dataset and incorporates essential preprocessing steps like histogram equalization to improve image quality and enhance diagnostic accuracy.The CNN-based framework is designed to automatically extract features and classify X-ray images into multiple disease categories. It aims to reduce diagnostic delays and support radiologists by offering fast and consistent evaluations. The system's performance is assessed using standard metrics such as accuracy, sensitivity, specificity, and F1-score, demonstrating its effectiveness as a decision-support tool in clinical workflows. By reducing dependence on manual review, this approach enhances both scalability and reliability in medical imaging diagnostics.Beyond automated image analysis, this paper also explores the integration of a real-time health monitoring solution for elderly individuals using a smartwatch-based system. This wearable device tracks vital signs such as heart rate and physical activity and provides instant alerts to caregivers in the event of abnormal readings. The combined application of AI-powered diagnostics and wearable health tracking presents a dual solution that supports early disease detection and improves continuous patient monitoring - paving the way for more responsive, accessible, and patient-centered healthcare.
  • AI vs Human Text Detector: Identifying AI-Generated Content Using NLP

    Reddy C.R.G.R., Muthukumar D.S., Thogai Rani B., Ganesh N., Rafi S.M., Vamsi P.

    Conference paper, Proceedings of the 2025 3rd International Conference on Inventive Computing and Informatics, ICICI 2025, 2025, DOI Link

    View abstract ⏷

    The evolving capabilities of AI models such as GPT -3 and GPT -4, and Deepseek have rendered it ever more difficult to distinguish between human-written text and AI-generated text. The issue raises serious concerns regarding plagiarism, disinformation, and authorship of electronic content in academic, journalistic, and educational spheres. For this aim, an innovative tool - AI vs Human Text Detector is introduced, it is a web application created to ascertain whether information was authored by a human or by an artificial intelligence model. The system uses Natural Language Processing (NLP) methods to examine prominent linguistic characteristics like perplexity and burstiness that distinguish the homogeneous pattern of AI text from the naturally heterogeneous patterns of human writing. The pre-trained GPT -2 is utilized to quantify textual predictability and variability, thus improving classification accuracy. Visualization of results is facilitated through Matplotlib and Plotly. The software tool is optimized to run on low-cost, commonly available resources, ensuring both accessibility and scalability. The proposed model achieves a high accuracy of 99.2% in detecting AI-generated content, outperforming existing models like ERT, CNN, and BERT-CNN. Future enhancements involve multilingual detection, hybrid detection models. The contribution of this work lies in supporting content integrity and ethical AI use in digital communication.
  • Optimizing English Learning with AI: Machine Learning Techniques and Tools

    Jayaranjan M., Shekhar G.R., Rafi S., Ramesh J.V.N., Kiran A., Vimochana M.

    Conference paper, International Conference on Intelligent Systems and Computational Networks, ICISCN 2025, 2025, DOI Link

    View abstract ⏷

    This research presents a new AI-driven approach to optimizing English language learning with a TF-IDF-based Gated Recurrent Unit model. It provides an effective framework for assessing and improving student writing competency by using advanced text classification approaches. Here, the six criteria evaluated on the basis of the ELLIPSE corpus of essays by grade 8-12 learners include coherence, syntax, vocabulary, phraseology, grammar, and conventions. Extensive preprocessing in terms of tokenization, stop word removal, stemming, and lemmatization, TF-IDF extracts key text features into numerical representations and feed into a GRU model that captures long-term dependencies as well as contextual meaning followed by classification with a dense layer and softmax activation. It has been implemented in Python: The GRU model yields an accuracy of 99.7%, precision at 99.04%, recall at 99.56%, and F1-score of 99.54. The work provides a rigorous methodology for text classification which improves the students' writing skills and propels AI tools in education.
  • Multimodal Multi-objective Grey Wolf Optimisation with SVM and Random Forest as Classifier in Feature Selection

    Das R., Rafi S., Purwar H., Laskar R.H., Rajshekhar A., Chandrawanshi N.

    Conference paper, Lecture Notes in Networks and Systems, 2025, DOI Link

    View abstract ⏷

    A technique called feature selection, often referred as attribute subset selection, selects the optimal subset of features for a given set of data by reducing the dimensionality and eliminating unnecessary characteristics. There can be 2n feasible solutions for a dataset with “n” features that is challenging to address using the conventional attribute selection method. Meta heuristic-based approaches perform better than traditional procedures in such situations. Numerous evolutionary computing techniques have been effectively used in Feature Selection challenges. On the distribution of options in the choice space, some research has been done. Achieving one, however, necessitates advancing the other since many optimisation problems contain two or more competing goals. The multi-objective optimisation technique discussed in this research finds the best effective trade-off between numerous objectives. Multi-objective Programs require multiple non-dominated solutions that could be found as opposite to just one. In the initial stage, we applied the Grey Wolf Optimisation (GWO) to acquire the optimised features. On the basis of the features selected, we trained the classifiers—Support Vector Machine (SVM) and Random Forest (RF) in the second phase. Experiment has been carried out on three benchmark datasets namely Glass, Wine and Breast Cancer Datasets retrieved from the UCI repository to show the supremacy of the proposed technique, the effectiveness of the recommended feature selection approach has been evaluated. The testing results show that the suggested GWO with Random Forest performs better than GWO with SVM.
  • Chronic Kidney Disease Prediction Using Machine Learning and Deep Learning Models

    Rafi S., Revanth N., Reddy K.V.R., Babu K.M., Kumar Y.L.P., Kumar N.V.

    Conference paper, 2025 IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation, IATMSI 2025, 2025, DOI Link

    View abstract ⏷

    Chronic kidney disease is a noticeable health condition that can persist throughout an individual's life, resulting from either kidney malignancy or diminished kidney function. In this work, we investigate how several machine learning techniques might provide an early CKD diagnosis. While previous research has extensively explored this area, our aim is to refine our approach by employing predictive modeling techniques. Initially, we considered 25 variables alongside the class property. The data set used in this study underwent extensive processing, including changing the names of colours for clarity, converting identified colours to numbers, treating unique values with letters handling of partitioned values, fixing incorrect values, filling null values with mean, and encoding categorical values into mathematical notation. In addition, Principal component analysis (PCA) was also employed to lower dimensionality. Our findings demonstrated that the XG Boost classifier surpassed e very other algorithm, with an accuracy of 0.991.
  • Detecting Sarcasm Across Headlines and Text

    Rafi S., Niharika A.L., Neelima S., Nikhitha K., Reddy M.S., Sireesha M.

    Conference paper, 2025 IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation, IATMSI 2025, 2025, DOI Link

    View abstract ⏷

    In this era with the rapid growth in social media usage among the current generation, a huge amount of content and comments, most of them sarcastic, is seen. Sarcasm has turned out to be an important part of daily life, especially in news and social media, where sarcastic comments are often used for better attention. However, detecting sarcasm is always challenging because it deals with understanding the difference between what has been said and what is meant. The current paper focuses on the detection of sarcasm in news headlines with the help of deep learning. Previous works were based on a wide range of datasets; however, these had limitations regarding either size or quality. In this respect, the authors propose creating a new dataset of headlines from sarcastic news sites and real news sites that is large and of high quality, hence appropriate for machine learning model training. The authors have also used the CNN-BILSTM architecture for text analysis, identifying sarcasm expression and deciding whether it is sarcastic or not-sarcastic which gained an accuracy of 97%. This dataset is made publicly available to enable further research in this direction.
  • Smartphone Price Patterns Prediction Using Machine Learning Algorithms

    Rafi S., Rambabu Y., Rajasekhar P., Suhas B., Reddy M.S., Moturi S., Doda V.R.

    Conference paper, 6th IEEE International Conference on Recent Advances in Information Technology, RAIT 2025, 2025, DOI Link

    View abstract ⏷

    Selecting the best smartphone can be challenging due to the wide range of models available on the market. This study shows how the machine learning models can predict mobile phone prices based on their features We evaluated several machine learning techniques, including Logistic Regression, Decision Trees, Random Forest, SVC, K-Neighbors Classifier, Gaussian Naive Bayes (GaussianNB), AdaBoost, Gradient Boosting, Extra Trees, Bagging Classifiers, and XGBoost. The primary objective was to identify the most effective model for price forecasting and to investigate the factors influencing phone prices. Our research offers insights to both consumers and manufacturers, helping them make more informed decisions about phone features and pricing. We emphasize the importance of using diverse datasets that accurately represent various smartphone models and pricing points. Key factors affecting phone costs were identified, and model performance was assessed using metrics such as accuracy, F1-score, and classification reports. Model performance was further enhanced through hyperparameter tuning with GridSearchCV, achieving 97% accuracy with the Decision Tree, K-Neighbors Classifier, SVC, AdaBoost, and Random Forest models. Among these, the Decision Tree and SVC was selected as the optimal models, offering a good tradeoff between accuracy, flexibility, and time complexity. This study aims to provide valuable data to guide consumers in making informed choices about mobile phone features and price ranges.
  • SCT: Summary Caption Technique for Retrieving Relevant Images in Alignment with Multimodal Abstractive Summary

    Rafi S., Das R.

    Article, ACM Transactions on Asian and Low-Resource Language Information Processing, 2024, DOI Link

    View abstract ⏷

    This work proposes an efficient Summary Caption Technique that considers the multimodal summary and image captions as input to retrieve the correspondence images from the captions that are highly influential to the multimodal summary. Matching a multimodal summary with an appropriate image is a challenging task in computer vision and natural language processing. Merging in these fields is tedious, though the research community has steadily focused on cross-modal retrieval. These issues include the visual question-answering, matching queries with the images, and semantic relationship matching between two modalities for retrieving the corresponding image. Relevant works consider questions to match the relationship of visual information and object detection and to match the text with visual information and employing structural-level representation to align the images with the text. However, these techniques are primarily focused on retrieving the images to text or for image captioning. But less effort has been spent on retrieving relevant images for the multimodal summary. Hence, our proposed technique extracts and merge features in the Hybrid Image Text layer and captions in the semantic embeddings with word2vec where the contextual features and semantic relationships are compared and matched with each vector between the modalities, with cosine semantic similarity. In cross-modal retrieval, we achieve top five related images and align the relevant images to the multimodal summary that achieves the highest cosine score among the retrieved images. The model has been trained with seq-to-seq modal with 100 epochs, besides reducing the information loss by the sparse categorical cross entropy. Further, experimenting with the multimodal summarization with multimodal output dataset, in cross-modal retrieval, helps to evaluate the quality of image alignment with an image-precision metric that demonstrate the best results.
  • Automatic Attendance Management System Using CNN

    Sreenivasu S.V.N., Rajani C., Rani B.U., Dasaradha A., Rafi S.

    Conference paper, 2024 4th International Conference on Artificial Intelligence and Signal Processing, AISP 2024, 2024, DOI Link

    View abstract ⏷

    Facial recognition technology plays a crucial role in various applications, from enhancing security at banks and organizations to streamlining attendance tracking in public gatherings and educational institutions. Traditional methods of attendance marking, such as signatures, names, and biometrics, can be time-consuming and error-prone. To address these challenges, a smart attendance system is proposed, leveraging Deep Learning, Convolutional Neural Networks (CNN), and the OpenCV library in Python for efficient face detection and recognition. The system utilizes advanced algorithms, including Eigen faces and fisher faces, to recognize faces accurately. While deep learning models excel with large datasets, they may not perform optimally with few samples. By comparing input faces with images in the dataset, the system automatically updates recognized names and timestamps into a CSV file, which is then sent to the respective organization's head. Additionally, the system allows users to upload a single photo or a group photo, and it returns matched photos as output using a CNN. This feature enhances the system's flexibility and usability, providing users with a convenient way.
  • ChronicNet: Randome Forest Classifier-based Chronic Heart Failure Detection with CNN Feature Analysis

    Malleswari D., Vazram B.J., Shaik R.

    Conference paper, Proceedings - 2024 13th IEEE International Conference on Communication Systems and Network Technologies, CSNT 2024, 2024, DOI Link

    View abstract ⏷

    Chronic heart failure (CHF) is a common illness that affects the heart. The conventional machine learning and deep learning algorithms failed to identify CHF in the early stages. So, this work implemented the ChronicNet by combining the properties of both deep learning and machine learning. This study is all about creating a network for finding out CHF from sound recordings of the heart. These are called phonocardiogram data, or PCG. The first step, which is noise removal, signal boosting, and dividing parts, makes sure that heartbeat sounds are of good quality. We use Mel and pitchbased coefficients (MFCC) to analyze the frequency changes in a heartbeat signal. This helps pick out features that show what makes CHF heart disease more special. The convolutional neural network (CNN) feature extraction, using deep learning, helps the MFCC automatically find out special features on its own. The Random Forest classifier (RFC) is used to build a model that can predict CHF faster. In groups with problems to classify, the RFC uses a set of decision trees. This gives benefits such as holding up, fitting to big sizes, and being highly accurate. The proposed system uses CNN features to find CHF from PCG data and correctly identify it using RFC. The simulation results show that the proposed ChronicNet outperformed traditional approaches with 98.84% accuracy.
  • Classification of Music Genre Using Deep Learning Approaches

    Srinivas U.M., Rafi S., Manohar T.V., Rao M.V.

    Conference paper, 2024 4th International Conference on Artificial Intelligence and Signal Processing, AISP 2024, 2024, DOI Link

    View abstract ⏷

    Music genre classification is a pivotal area of research within audio technology, holding immense importance for content organization and recommendation. Audio feature extraction and Music genre classification constitute a complete recognition system. Audio feature analysis and Music genre classification together form an integrated recognition system for comprehensive music genre identification and organization. This technology is frequently utilized to accurately detect and classify various types of music genres or characteristics present in audio signals, contributing significantly to the effective organization and recommendation of music content. Our experiment was conducted with the dataset from GTZAN that is taken from Kaggle repository. Convolutional neural networks (CNN) are employed to train our model, which is subsequently utilized for the classification of music genres in audio signals.
  • Rainfall Prediction Using Machine Learning

    Sreenivasu S.V.N., Rafi S., Lakshmi V.V.A.S., Sivanageswara Rao S., Rajani Ch.

    Conference paper, Proceedings of 2024 2nd International Conference on Recent Trends in Microelectronics, Automation, Computing, and Communications Systems: Exploration and Blend of Emerging Technologies for Future Innovation, ICMACC 2024, 2024, DOI Link

    View abstract ⏷

    The title is 'Rainfall Prediction Using Machine Learning'. The initiative's dataset is written in Python and stored in Microsoft Excel. A wide range of machine learning algorithms are used to discover which strategy generates the best accurate predictions. In many sections of the country, rainfall forecasting is critical for avoiding major natural disasters. This forecast was created using a variety of machine learning approaches, including catboost, xgboost, decision tree, random forest, logistic regression, neural network, and light gbm. It incorporates several components. The Weather Dataset was utilized. The primary goal of the research is to evaluate a variety of algorithms and determine which one performs best. Farmers may greatly profit from growing the appropriate crops based on the amount of water they require.
  • Unveiling Student Success: A Multifaceted Approach with Learning Coefficients and Beyond

    VijayaKumar N., Rafi S., Mahith T., Reddy D.V., Naik K.R., Raju K.

    Conference paper, 2nd IEEE International Conference on Integrated Intelligence and Communication Systems, ICIICS 2024, 2024, DOI Link

    View abstract ⏷

    The student performance is examined in this study using a number of methods of Educational Data Mining (EDM), Clustering and classification techniques are employed to classify the course as well as the performance in the entrance examination. The results obtained show that the Random Forest and XG Boost which are machine learning models outperform traditional methods for predicting student success. Moreover, CNN and LSTM Networks, which are deep learning models, improve prediction accuracy even further. Conducted through metrics like accuracy, precision, recall and F1-score, this study shows that any form of recognition of the pattern, in this case, the early one, helps to reduce failure rates to considerable extents. The results of this study suggest that there is a potential scope for further improving prediction algorithms and management of educational resources, which are of great relevance to the institutions to further the student success.
  • Machine Learning Framework for Women Safety Prediction using Decision Tree

    Sowmika P.S., Rao S.S.N., Rafi S.

    Conference paper, Proceedings - 5th International Conference on Smart Systems and Inventive Technology, ICSSIT 2023, 2023, DOI Link

    View abstract ⏷

    In every city, harassment and violence becomes one of the major problems for women. Further, women's personal life is suffered by the bullying and abusive content presented in Online Social Networking (OSN). Therefore, it is necessary to identify the women safety in OSN environment. When it came to predicting the maximum safety analysis, however, traditional methodologies came up short. This study, then, employs a decision tree (WSP-DT) classifier to make predictions about women's safety. After considering the Twitter dataset for system implementation, it is pre-processed to get rid of the blanks and the unknowns. The tweets were then processed by a natural language toolkit (NLTK) that handled tasks including tokenization, case-conversion, stop-word detection, stemming, and lemmatization. Next, we create a text blob protocol to determine the positive, negative, and neutral polarity of pre-processed tweets. To further extract the data characteristics based on word and character frequency, term frequency-inverse document frequency (TF-IDF) is used. At last, a decision tree classifier was used, based on several rounds of training, to determine if a tweet was phoney or real. Testing on the Twitter dataset demonstrates that the proposed WSP-DT classifier outperforms the competition in simulations.
  • Abstractive Text Summarization Using Multimodal Information

    Rafi S., Das R.

    Conference paper, 2023 10th International Conference on Soft Computing and Machine Intelligence, ISCMI 2023, 2023, DOI Link

    View abstract ⏷

    Much text generates over the internet through news articles, story writing and blogs. Reading and understanding such an enormous amount of data to the user is problematic, including time and effort. Automatic abstractive text summarization has gained more importance to increase the user's understanding and reduce time. It shortens the given input by preserving the meaning and identifying the context of the whole document to generate meaningful sentences. The research community has proposed different methods for text reduction and generating abstractive summaries. However, problems like semantics and contextual relationship in the summary generation process must be still need to improve. The multimodal abstractive text summarization is a technique that combines text and image information which helps in addressing the semantics and contextual relationship by proposing Multimodality Image Text (MIT) layer that fuses the text-extracted global features by glove embedding and preserves the semantics of the vocabulary and text-related images are used to identify the contextual relationship features from inception v3, which cope in the MIT layer to generate efficient multimodal abstractive text summaries by training and testing with seq-to-seq model. Experiments with the MSMO dataset achieve superior performance on other state-of-art results.
  • Detection of Active Attacks Using Ensemble Machine Learning Approach

    Revathy S., Sathya Priya S., Rafi S., Pranideep P., Rajesh D.

    Conference paper, Lecture Notes in Networks and Systems, 2022, DOI Link

    View abstract ⏷

    Cyber attackers entrap online users and companies by stealing their sensitive information without their knowledge. Sensitive information such as login credentials, bank card details, and centralized servers of organizations are hacked by the attackers. Some of the cyber attacks are phishing attack where attackers make the online users to trust their websites as a legitimate website and retrieve their personal information by making them as a prey for cyber attacks. Malware attack is a one where attacker will inject a malicious software into the company server or any online user’s device, without their knowledge and steal all the data in their devices and servers. Intrusion is an invasion, where attacker will attack the network and theft all the network resources. But, there are many types of cyber attacks solutions such as visual similarity-based approaches, intrusion detection system, signature-based, heuristic-based, specification-based, anomaly-based methods that are proposed, but they have some disadvantages. Because of few unsecured HTTP websites and lack of cyber knowledge, cyber attacks are increasing day by day. In our proposed system, a unified ensemble approach (UEA) is proposed by combining different machine learning algorithms using ensemble approach that gives better accuracy and detection rate. This model aims to detect the intrusion, phishing attack and prevent the malwares thereby mitigating the cyber attacks encountered by individual and organization.
  • Sentiment-Based Abstractive Text Summarization Using Attention Oriented LSTM Model

    Debnath D., Das R., Rafi S.

    Conference paper, Smart Innovation, Systems and Technologies, 2022, DOI Link

    View abstract ⏷

    Product reviews are essential as they help customers to make purchase decisions. Often these product reviews are used to be too abundant, lengthy and descriptive. However, the abstractive text summarization (ATS) system can help to build an internal semantic representation of the text with the use of natural language processing to create sentiment-based summaries of the entire reviews. An ATS system is proposed in this work, which is called a many-to-many sequence problem where attention-based long short-term memory (LSTM) is incorporated to generate the summary of the product reviews. The proposed ATS system works in two stages. In the first stage, a data processing module is designed to create the structured representation of the text, where noise and other irrelevant data are also removed. In the second stage, the attention-based long short-term memory (LSTM) model is designed to train, validate and test the system. It is found that the proposed approach can better deal with the rare words, also can generate readable, short and informative summaries. An experimental analysis has been carried out over the Amazon product review dataset, and to validate the result, the ROUGE measure is used. The obtained result reflects the efficacy of the proposed method over other state-of-the-art methods.
  • RNN Encoder and Decoder with Teacher Forcing Attention Mechanism for Abstractive Summarization

    Rafi S., Das R.

    Conference paper, Proceedings of the 2021 IEEE 18th India Council International Conference, INDICON 2021, 2021, DOI Link

    View abstract ⏷

    Automatic text summarization is utilized to address the sustained increasing proportion of text data available in online, to address such numerous data to short data summarization is preferred. In this work, abstractive text summarization is reviewed with Recurrent Neural Network based Long Short Term Memory with encoder and attention decoder. In recent years, this type of summarization has carried out with Recurrent Neural Network which learns from the previous time steps. In this paper, we propose Teacher Forcing Technique to improve the slow convergence and poor performance of Recurrent Neural Network. Our technique improves the performance of text summarization by using Attention Decoder which learns from ground truth instead of learning from previous time steps and minimizes the error rate with Stochastic Gradient Descent optimizer with more accurate results on Wikihow dataset when measured with metric of ROUGE and performed well when compared our result with the state of art results.
  • A Linear Sub-Structure with Co-Variance Shift for Image Captioning

    Rafi S., Das R.

    Conference paper, 2021 8th International Conference on Soft Computing and Machine Intelligence, ISCMI 2021, 2021, DOI Link

    View abstract ⏷

    Automatic description of image has attracted many researchers in the field of computer vision for captioning the image in artificial intelligence which connects with Natural Language Processing. Exact generation of captions to image is necessary but it lacks due to Gradient Diminishing problem, LSTM can overcome this problem by fusing local and global characteristics of image and text that generates sequenced word prediction for accurate image captioning. We consider Flickr 8k data-set which consists of text as descriptions of images. The use of GLoVe embedding helps for the word representation to consider the global and local features of images which finds distance with Euclidean to understand the relationship between words in vector space. Inception V3 architecture which is pretrained on ImageNet used to extract image features of different objects in scenes. We propose Linear Sub-Structure that helps to generate sequenced order of words for captioning by understanding relationship between words. For extracting image features considers co-variance shift which mainly concentrates on moving parts of the image to generate accurate description of the image to maintain a semantic visual grammar relationship between the predicted text for image as the caption, the proposed model evaluated with the help of BLEU score which achieves state of art model in our work while compared with others that has greater than 81% of accuracy.
  • Enhanced biomedical data modeling using unsupervised probabilistic machine learning technique

    Rizwana S., Challa K., Rafi S., Imambi S.S.

    Article, International Journal of Recent Technology and Engineering, 2019,

    View abstract ⏷

    Text mining approaches uses feature similarity techniques or distributed keyword searching techniques. But machine learning techniques develop a statistical model to categorize documents by learning from vast amount of medical documents available at pubmed. It is unsupervised techniques. The proposed algorithm enhances the traditional document clustering techniques.and generate accurate and reliable model. We experimented the algorithm with 1000 document data set It showed the significant improvement over other traditional algorithms.

Patents

  • System And Method For Detecting Hallucinated Information In Ai-Generated Summaries

    Dr Shaik Rafi

    Patent Application No: 202641085130, Date Filed: 11/07/2026, Date Published: 17/07/2026, Status: Published

  • System And Method For Entity-Aware Medical Image Captioning From Radiology Images

    Dr Shaik Rafi

    Patent Application No: 202641091623, Date Filed: 28/07/2026, Date Published: 31/07/2026, Status: Published

Projects

Scholars

Interests

  • Computer Vision
  • Content-Based Image Retrieval
  • Natural Language Processing

Thought Leaderships

There are no Thought Leaderships associated with this faculty.

Top Achievements

Research Area

No research areas found for this faculty.

Computer Science and Engineering is a fast-evolving discipline and this is an exciting time to become a Computer Scientist!

Computer Science and Engineering is a fast-evolving discipline and this is an exciting time to become a Computer Scientist!

Recent Updates

No recent updates found.

Education
2012
MCA
JNTU Kakinada
India
2014
M.Tech (CSE)
JNTU Kakinada
India
2020
AMIE
Institute of Engineers
India
2025
Ph.D
National Institute of Technology Mizoram
India
Experience
  • 2013-2018 Assistant Professor – Tirumala Engineering College, Narasaraopet
  • 2018-2019 Assistant Professor – Eswar College of Engineering, Narasaraopet
  • 2019-2025 Assistant Professor – Narasaraopeta Engineering College (Autonomous), Narasaraopet
Research Interests
  • Considering two types of modalities such as text and image modalities and extracting features from multimodalities to generate Multimodal Abstractive Text Summarization.
  • My interest also includes to retrieve relevant images to the generated Multimodal Abstractive Summaries using different techniques from deep learning.
Awards & Fellowships
  • Gold Medal in M.Tech – Narasaraopeta Engineering College (2013)
  • Best Paper Award – DoSCI-2025
Memberships
  • ACM
  • IAENG
Publications
  • Generation of Semantic and Contextual Captions to the Images Using ViT

    Srinivas A.V.S.S.P.S.S., TirumalaRao S.N., Narasimha Reddy K.V., Rafi S., Reddy S.

    Conference paper, Lecture Notes in Networks and Systems, 2026, DOI Link

    View abstract ⏷

    Generation of sentences to the images like human is an important task in computer vision which this task can also be called as image caption. This process bridges the computer vision to natural language processing tasks which generate descriptions to the images. This paper highlights to extract semantical and contextual features from images to capture the effective relationship features with Vision Transformer (ViT) in the form of high-level features like objects, meaningful scenes, attributes from the visionary images. These extracted features particularly from the images helps in deep level understanding to the user, that shows context features and spatial feature information from the images. On these extracted essential features this paper utilizes attention mechanism to particularly focus on dynamic regions that helps the model to generate more semantical and contextual text descriptions to the images. Then these integrated features are utilized by the proposed model and enhances the ability to produce captions that are very fluent and descriptions human-like sentences. A standard dataset has been utilized to experiment and to generate captions such like Flickr8k that resembles the effectiveness in its method in generation of descriptions like humans for improving performance over other baseline methods.
  • AI Document Search Chatbot Using Retrieval-Augmented Generation (RAG)

    Rafi S., Siva Rama Krishna Boddu L.V., Lakshmi Pujitha G., Yella S.C., Gangireddy G., Nishanth Bhuvaneswar P.Y.

    Conference paper, Proceeding of International Conference on Computing, Communication, Control and Cyber-Physical Systems, I5CPS 2026, 2026, DOI Link

    View abstract ⏷

    This work describes the design and the implementation of an AI document search chatbot using a Retrieval-Augmented Generation (RAG) architecture that combines generative modelling with information retrieval to provide an accurate and verifiable responses. The system supports PDF, DOCX, CSV, and TXT uploads, which are automatically processed, segmented, and indexed in a vector database for semantic search. It is implemented in Python using LangChain for orchestration, Facebook AI Similarity Search (FAISS) for vector retrieval, and multiple large-language-model Application Programming Interface (API), including OpenAI, Google Generative AI, and Hugging Face. For each query, embeddings are computed and the most relevant document segments are retrieved using cosine similarity before being passed to the selected model to ensure responses are grounded in user-supplied content. Owing to its modular design, the architecture is scalable, maintainable, and easily extensible for enterprise and academic knowledge-management applications.
  • A Hybrid Machine Learning Framework for Personalized Weight Loss through Protein Intake Pattern Analysis

    Siva Rama Krishna B.L.V., Rafi S., Sri Sai Praneeth B.V.S., Sri Nag P.V., Sireesh T.N., Harshitha S.A.

    Conference paper, 2026 IEEE International Conference on Emerging Computing and Intelligent Technologies, ICoECIT 2026, 2026, DOI Link

    View abstract ⏷

    Conventional weight loss programs often apply generalized nutritional guidelines, ignoring individual variations in metabolism and dietary response. Such limitations result in inconsistent progress and reduced long-term success rates. This research presents a data-driven framework to enhance personalized weight management by analyzing protein intake patterns using machine learning and deep learning models. The study employs data from the MyFitnessPal dataset and user-provided records, including diet logs, anthropometric parameters, and demographic details. Pre-processing is performed using a Target Encoding Wavelet Transform Filter (TEWTF) to remove noise and normalize heterogeneous data. Advanced algorithms such as Random Forest Generative Adversarial Networks (RFGAN) and Preference-Aware Inverse Optimization (PAIO) are implemented to create adaptive diet plans aligned with user preferences. Furthermore, Hierarchical Clustering combined with Multi-Layer Perceptron (HCMLP) is utilized to identify protein consumption trends and predict optimal intake levels for diverse user groups. The model dynamically refines nutritional recommendations based on individual behavior and physiological responses. Experimental evaluation shows consistent predictive accuracy, maintaining 95% performance across iterative testing from 100 to 900 posts. This framework demonstrates that machine learning can effectively translate nutritional data into personalized, real-time diet guidance, advancing the field of AI-driven health optimization.
  • Multimodal abstractive summarization and retrieving relevant images to be multimodal output

    Rafi S., Das R., Rizwana S.

    Article, Knowledge and Information Systems, 2026, DOI Link

    View abstract ⏷

    This paper presents a novel multimodal summarization and image retrieval framework, termed Context-Aware CLIP with Hybrid Image-Text Fusion (CA-CLIP-HIT), for generating semantically coherent multimodal abstractive summaries and retrieving contextually relevant images. Existing multimodal summarization approaches often exhibit limitations in contextual understanding, semantic alignment between textual and visual modalities, and retrieval accuracy due to shallow feature representations and insufficient cross-modal interaction. To address these challenges, the proposed framework integrates textual and visual information through a Hybrid Image-Text (HIT) fusion mechanism, which generates context-aware multimodal representations capable of preserving semantic dependencies and contextual relationships across modalities. The extracted multimodal features are fused within the HIT layer to construct a comprehensive contextual representation, which is subsequently processed using a sequence-to-sequence encoder-decoder architecture based on Long Short-Term Memory (LSTM) networks for multimodal abstractive summary generation. To strengthen semantic correspondence between generated summaries (SUMMA) and candidate images, the framework employs the CLIP text encoder for summary representation and the CLIP image encoder for visual representation within a shared semantic embedding space. Cosine similarity is utilized to identify and retrieve the image that exhibits the highest semantic relevance to the generated multimodal summary. In addition, a Caption-Assisted Post-Processing Alignment (CAPPA) mechanism is introduced to address ambiguity during image retrieval. In scenarios where multiple candidate images obtain similar similarity scores, the CAPPA module performs caption-level semantic analysis to determine the image that demonstrates the highest contextual alignment with the generated summary. This refinement mechanism enhances retrieval precision, semantic consistency, and robustness in visually ambiguous retrieval scenarios. The proposed framework is evaluated on the MSMO dataset using ROUGE-1, ROUGE-2, ROUGE-L, BLEU, and Image Precision (IP) metrics. Experimental results demonstrate that the proposed CA-CLIP-HIT framework outperforms existing state-of-the-art methods. Furthermore, statistical significance analysis using a paired Student’s t-test confirms that the observed performance improvements are statistically significant. Overall, the proposed CA-CLIP-HIT framework provides an effective and scalable solution for multimodal abstractive summarization and context-aware image retrieval.
  • Detection of Skin Lesion for Classifying as Benign and Malignant Skin Cancer

    Sankuru H.B., Chandana Y., Rafi S., Reddy K.V.N.

    Conference paper, Lecture Notes in Networks and Systems, 2026, DOI Link

    View abstract ⏷

    Skin cancer is one of the dangerous diseases. This study proposes an automated skin lesion detection and classification system leveraging image processing and deep learning techniques. The methodology includes image acquisition, preprocessing (noise reduction, contrast enhancement, and segmentation), and feature extraction using both handcrafted methods (color, texture, and shape analysis) and deep learning-based approaches (CNNs, Vision Transformers), which is challenging in extracting only particular features. This challenge places an important observation in classifying and extracting features. For classification, deep learning architecture ResNet-50 is employed to differentiate between benign and malignant lesions to classify as skin cancer. Results show that deep learning models surpass traditional approaches in achieving superior accuracy with 89.63 for precision and 91.5 score with F1 and 93.6% with accuracy, sensitivity, and robustness in skin cancer detection. However, challenges such as dataset bias, model interpretability, and real-time deployment remain.
  • A Bio-Nature Inspire Algorithm: Ant Colony Optimization for Classifying Benign and Malignant Tumors in Breast Cancer

    Kanakam S., Narasimha Reddy K.V., Rafi S., Reddy V., Rambabu K.

    Conference paper, Lecture Notes in Networks and Systems, 2026, DOI Link

    View abstract ⏷

    This research presents a novel hybrid framework combining Ant Colony Optimization (ACO) and ResNet-50 deep learning architecture for efficient breast cancer detection and classification in mammographic images. The proposed methodology leverages the strengths of both bio-inspired computing and deep learning to enhance detection accuracy and reduce false positives. ResNet-50’s pre-trained architecture is utilized for robust feature extraction from mammogram images, while ACO optimizes the feature selection and classification process. The system operates in multiple phases: initial preprocessing enhances image quality through adaptive histogram equalization and noise reduction; ResNet-50 extracts hierarchical features from the preprocessed images; ACO then optimizes the feature selection process by treating the feature space as a graph where artificial ants traverse to identify the most discriminative feature combinations. This hybrid approach demonstrated superior performance compared to traditional methods, achieving 97% accuracy sensitivity on the DDSM dataset.
  • Generating Semantic-Based Extractive Summaries in Summarization

    Mandhatha P.C., Narasimha Reddy K.V., Suresh M., Tirumala Rao S.N., Venkata Reddy D., Rafi S.

    Conference paper, Lecture Notes in Networks and Systems, 2026, DOI Link

    View abstract ⏷

    In order to produce succinct and contextually appropriate summaries, this work examines Bidirectional Encoder Representations from Transformers (BERT) for extractive semantic summarization, highlighting its capacity to recognize and utilize keywords and important phrases. BERT outperforms conventional frequency-based keyword extraction techniques by identifying semantical properties from text sentences and visual pictures thanks to its contextual embeddings and self-attention processes. In order to evaluate BERT’s performance in extractive summarization tasks, the article describes a thorough experimental setup that includes dataset selection, preprocessing, model construction, and evaluation measures. To maximize model performance, important hyperparameters are discussed, including batch size, learning rate, and optimization techniques. Findings show that BERT has a strong knowledge of semantics, context-aware extraction, and cross-domain adaptation, which makes it an effective tool for producing high-quality summaries in a variety of applications, including news aggregation, scientific research.
  • Entity-Aware Medical Image Captioning

    Rafi S., Rizwana S., Drutika P., Srija R., Susmitha C.H.S., Sahasra J.

    Article, IEEE Access, 2026, DOI Link

    View abstract ⏷

    In order to produce meaningful textual interpretations of intricate clinical images, medical image captioning has become a significant field of study at the nexus of computer vision and natural language processing. Due to the lack of explicit modeling of medical entities, current methods frequently fail to produce descriptions that are both semantically valid and clinically useful, despite notable advances in deep learning and vision language modeling. Typical captioning methods in particular, fall short of being able to retrieve fine grained diagnostic information and maintain semantic consistency with clinical findings as they focus on global features. This paper addresses these limitations by presenting an entity-aware medical image captioning approach which aims to identify and incorporate clinically relevant entities into the caption generation, including but not limited to, diagnostic finding, anatomical structures, or diagnostic characteristics. The proposed method utilizes entity level representations as a means of guiding the captioning process thereby ensuring a tighter semantic consistency between visual modalities and the resultant textual output. Consequently, this leads to more comprehensible, informative and clinically relevant generated reports. Additionally, inclusion of entity awareness can aid the model in effectively understanding the relationships between medical concepts leading to captions more consistent with medical expertise. The results demonstrate that explicit modeling with structured semantic information within vision-language frameworks are crucial and that entity-aware methods have the potential to greatly improve captioning. This work has the ability to help advance health intelligence applications which will serve to better assist clinical decision making, scale the processing of medical images, and facilitate accurate medical documentation.
  • Feature Augmentation and Convolutional Neural Networks for Accurate Prediction of Heart Disease

    Ramnadh Babu T.G., Bhavana K., Chaitanya G., Sravani M., Shaik R., Moturi S.

    Conference paper, Smart Innovation, Systems and Technologies, 2026, DOI Link

    View abstract ⏷

    Heart diseases are considered the foremost cause of death within developing nations; therefore, prediction of heart disease is crucial for evaluating the risk of patients. This paper will introduce a new method to enhance prediction accuracy by combining CNNs with SAE for feature enhancement. Our method uses a dataset of 918 patient records with 11 clinical variables, and it removes the drawback of traditional classifiers by using feature augmentation to build more informative features. Experimental results show that our model’s accuracy is 93.478%, an improvement over traditional classifiers like MLP and RF by 4.98%. Latent space size is also optimized, and 100 best features are obtained. The results suggest that the deep learning methods, especially the combination of SAE with CNN, bring in notable benefits for heart disease prediction, which might further be used for the clinical purpose of earlier interventions.
  • Reducing extrinsic hallucination in multimodal abstractive summaries with post-processing technique

    Rafi S., Laitonjam L., Das R.

    Article, Neural Computing and Applications, 2025, DOI Link

    View abstract ⏷

    Multimodal abstractive summarization integrates information from diverse modalities, such as text and images, to generate concise, coherent summaries. Despite its advancements, extrinsic hallucination, a phenomenon where generated summaries include content not present in the source, remains a critical challenge, leading to inaccuracies and reduced reliability. Existing techniques largely focus on intrinsic hallucinations and often require substantial architectural changes, leaving extrinsic hallucination inadequately addressed. This paper proposes a novel post-processing approach to mitigate extrinsic hallucination by leveraging external knowledge vocabularies as a corrective mechanism. The framework identifies hallucinated tokens in generated summaries using a cosine similarity metric and replaces them with factually consistent tokens sourced from external knowledge, ensuring improved coherence and faithfulness. By operating at the token level, the approach preserves linguistic, semantic, and syntactic structures, effectively reducing unfaithful content. The proposed method incorporates domain knowledge through a Word2Vec-based vocabulary, offering a scalable solution to enhance factual consistency without modifying model architectures. The contributions of this study include a detailed methodology for identifying and correcting hallucinated tokens, a robust post-processing pipeline for refining summaries, and a demonstration of the method’s effectiveness in reducing extrinsic hallucinations. Experimental results on MSMO dataset highlight the approach’s potential to improve the accuracy, coherence, and reliability of multimodal abstractive summarization systems, addressing a significant gap in the field and shows the state-of-the-art results with RMS-Prop Optimizer.
  • Detecting Chronic Kidney Disease at an Early Stage Through Machine Learning

    Reddy N.M., Rafi S.

    Conference paper, 2025 IEEE 7th International Conference on Cybernetics, Cognition and Machine Learning Applications, ICCCMLA 2025, 2025, DOI Link

    View abstract ⏷

    The objective of the current research is to implement the Random forest approach to predict chronic kidney disease. One of the main chronic ailments is kidney disease. It is extremely cost-effective to identify the problem at an early stage. As the problem is extremely cost-effective, there is a constant concern of the global economic pressure. The aim of the research work is to create a practical model which will be able to predict the disease accurately at an early stage. The initial system relying on the K Nearest Neighbor KNN classification approach. The model as a whole suffers from scalability as does the data, as well as the It suffers from overfitting and poor performance on selection and tuned data. The Random forest approach is an improvement over the KNN model. The Random forest model has proven itself to be better than the KNN approach, and shows l prediction accuracy on chronic kidney disease case. The research work shows how advancement in machine learning could improve prediction on the specified ailment. Aspects like feature projection, data preprocessing data, and alternate ensemble learning methods could be used in future work to improve. Such results but point towards the essential need of Indic.
  • Multimodal Image Caption Generation with Semantic and Temporal Context

    Rafi S., Das R., Rao P.A., Rizwana S.

    Conference paper, Proceedings of the International Conference on Soft Computing and Machine Intelligence, ISCMI, 2025, DOI Link

    View abstract ⏷

    Multimodal semantic image captioning is a cutting-edge approach that combines visual and textual modalities to generate accurate and contextually rich natural language descriptions of images. This method extends beyond traditional captioning by incorporating semantic understanding and capturing high-level concepts such as object attributes, relationships, and scene using temporal context. The proposed model effectively align visual content with multimodal linguistic meaning by combining visual features extracted from deep convolutional networks like ResNet-101 with semantic representations derived from textual embedding's enriched by external knowledge bases and the language description generation is typically handled by sequence models like LSTM which is conditioned on the fused multimodal inputs. The semantic option helps the model to generate meaningful captions semantically aligned with the image content, leading to improved relevance, diversity, and human likeness. As Multimodal semantic image captioning progress with Flickr-30k data that consider multimodalities of information in the form of images and text descriptions trained with Adam Optimizer for 30 epochs. The proposed model shows greater performance with 63% Bleu and Meteor metric when compared with other models.
  • LSTM based DDos Attacks Prevention and Detection for EV Charging Batteries

    Saida S.J., Tiwari B.K., Rafi S.

    Conference paper, 3rd International Conference on Power Electronics and Energy, ICPEE 2025, 2025, DOI Link

    View abstract ⏷

    Electric Vehicle charging infrastructure is crucial to the sustainable energy transition but it is also susceptible to cyberattacks. Protection against possible cyberattacks, such as Distributed Denial of Service (DDoS) assaults, has become crucial with the growth of electric vehicle supply equipment (EVSE) networks. The extensive Electric Vehicle Supply Equipment (EVSE) dataset, which includes high-performance computing (HPC) statistics, system performance indicators, and network traffic data, is used to analyze the proposed approach, and to create a strong anomaly detection framework by utilising deep learning techniques, to analyse host-based data, such as kernel eventlogs and HPC data. LSTM based model is used for sequence-based learning, analysing high-granularity event sequences to identify anomalous patterns, and putting in place a preprocessing pipeline that guarantees dependable data input for the model are some of the main contributions.
  • Abstractive Text Summarization with Semantic and Contextual Alignment using BART

    Rafi S., Boddu L.V.S.R.K., Pidikiti D., Rayavarapu S., Chimirala S.S., Javvadi S.

    Conference paper, Proceedings of 2025 International Conference on Signal Processing, Computation, Electronics, Power and Telecommunication, IConSCEPT 2025, 2025, DOI Link

    View abstract ⏷

    The enormous information overload caused by the exponential growth of digital content across businesses is making it more challenging to adopt effective automatic summarizing solutions. Abstractive text summarizing has grown to be an important area in NLP with the aim of creating concise, clear, and instructive summaries that go beyond basic source text extraction. Summarization systems continue to struggle with issues of semantic purity, factual correctness, and contextual alignment despite tremendous advancements made possible by deep learning and transformer-based architectures. The study uses the BART model, which has been refined on a sizable news dataset, to examine abstractive summarization with an emphasis on semantic and contextual alignment. The suggested system incorporates contextual alignment techniques and semantic-aware preprocessing to guarantee that generated summaries maintain coherence and fluency while preserving meaning fidelity. The main evaluation metric used in the study is ROUGE, which is supplemented by knowledge from more modern semantic similarity-based methodologies. When compared to baseline summarization systems, experimental results show significant gains in content selection, semantic consistency, and textual coherence, especially for longer inputs. The evaluation further highlights the benefits of incorporating semantic and contextual representations into training pipelines, showing that such improvements can reduce factual inconsistencies and improve the total informativeness of summaries that were produced.
  • The Perils of Naive Truncation: A Context Ablation Study for Dialogue Summarization on DialogSum

    Rafi S., Boddu L.V.S.R.K., Kolla D.V., Pothuguntla C., Myla R.B.

    Conference paper, 2025 5th International Conference on Artificial Intelligence and Signal Processing, AISP 2025, 2025, DOI Link

    View abstract ⏷

    A common shortcut in dialogue summarization is to truncate a conversation to its most recent turns, assuming this reduces cost without hurting summary quality. We test this assumption through a controlled context ablation study on DialogSum using DistilBART as the main model, with T5- small and BART-large for confirmation. Truncation consistently hurts quality: BERTScore drops by -0.0115 and ROUGE-L by -0.0705 (p < 0.0001), showing that removing early context acts as lossy compression that distorts meaning. Meanwhile, efficiency barely improves - shrinking input length by about 75% yields only a ~ 10% gain in throughput on an NVIDIA T4 GPU. These findings reveal that naive truncation is counterproductive; future dialogue summarization systems should adopt adaptive, content- aware context selection rather than blunt length reduction.
  • Analysis on Data by Deterioration Ambiguity Technique Using Data Analysis for Agriculture

    Rafi S., Manohar T.V., Siva Rama Krishna B.L.V., Narasimha Raju B.N.V.

    Conference paper, 2025 5th International Conference on Artificial Intelligence and Signal Processing, AISP 2025, 2025, DOI Link

    View abstract ⏷

    This research investigates the evolving advantages of diverse career trajectories while critically examining the current absence of standardized frameworks within the data science discipline. The pervasive dissemination of misinformation across the internet has precipitated an unprecedented surge in data generation, thereby necessitating the emergence of data mining as a crucial analytical paradigm. Over the forthcoming decade, the capability to extract contextually significant and substantively relevant insights from vast datasets is projected to become a fundamental determinant of progress across multiple domains.In particular, this study analyzes five case studies that collectively endeavor to establish a unified understanding of occupational structures within the data science ecosystem. The examination and utilization of data-driven insights to support empirical observation and informed decision-making constitute essential components, especially within the agricultural sector. Building upon these contextual analyses, the research delineates the distinct yet complementary roles of data engineers and data scientists in shaping effective data-centric strategies.To evaluate crop productivity, the study applies data mining methodologies with an emphasis on regression analysis. The estimation of individual crop yields is conducted through the identification of underlying patterns in parameter-specific variables and historical data records. This methodological approach facilitates the derivation of predictive insights, thereby contributing to enhanced agricultural output assessment and strategic planning.
  • A Novel Approach for Early Detection of Forest Fire from Images with Deep Learning: A Machine Vision Course Experiment

    Udaya Lakshmi B.N.V., Lakshminadh K., Suresh Babu K., Narasimha Reddy K.V., Rafi S., Swathi P.

    Conference paper, Lecture Notes in Networks and Systems, 2025, DOI Link

    View abstract ⏷

    Rapid and precise detection systems are necessary because wild forest fires are a serious hazard to infrastructure, human lives, and ecosystems. The ResNet-50 convolutional neural network (CNN) is used in this work to provide a deep learning-based method for detecting wild forest fires. By utilizing ResNet-50’s potent feature extraction capabilities, the model is optimized to categorize images as “Fire” or “No Fire,” guaranteeing excellent precision and recall. To improve model performance on a variety of image datasets, the system integrates a strong data preprocessing pipeline that includes scaling, normalization, and data augmentation techniques including flipping, rotation, and brightness correction. The model is trained used Adam optimizer and emphasizing early stopping mechanism with learning rate of le-4. The model efficiencies on fire forest dataset which includes satellite, drone, and ground captured images.
  • Topic-guided abstractive multimodal summarization with multimodal output

    Rafi S., Das R.

    Article, Neural Computing and Applications, 2025, DOI Link

    View abstract ⏷

    Summarization is a technique that produces condensed text from large text documents by using different deep-learning techniques. Over the past few years, abstractive summarization has drawn much attention because of the capability of generating human-like sentences with the help of machines. However, it must improve repetition, redundancy and lexical problems while generating sentences. Previous studies show that incorporating images with text modality in the abstractive summary may reduce redundancy, but the concentration still needs to lay on the semantics of the sentences. This paper considers adding a topic to a multimodal summary to address semantics and linguistics problems. This stress the need to develop a multimodal summarization system with the topic. Multimodal summarization uses two or more modalities to extract the essential features to increase user satisfaction in generating an abstractive summary. However, the paper’s primary aim is to explore the generation of user preference summaries of a particular topic by proposing a Hybrid Image Text Topic (HITT) to guide the extracted essential information from text and image modalities with the help of topic that addresses semantics and linguistic problems to generate a topic-guided abstractive multimodal summary. Furthermore, a caption-summary order space technique has been introduced in this proposed work to retrieve the relevant image for the generated summary. Finally, the MSMO dataset compares and validates the results with rouge and image precision scores. Besides, we also calculated the model’s loss using sparse categorical cross entropy and showed significant improvement over other state-of-the-art techniques.
  • Recognizing Image Manipulations Utilizing CNN and ELA

    Nallamothu K., Rafi S., Kokkiligadda S., Jany S.M.

    Conference paper, Lecture Notes in Networks and Systems, 2025, DOI Link

    View abstract ⏷

    Tampering of digital photos or images is known as image forgery. The ability to create phony images or information has become easier due to the rapid advancement of technology. In order to detect image forgeries, this paper proposes a model that employs Error Level Analysis (ELA) with Convolutional Neural Networks (CNN). ELA is used as a preprocessing step to highlight regions of an image that may have been tampered with. CNN is then trained on this enhanced data to classify images based on their authenticity and detect digital modifications. This initiative’s main goals include image classification, attribute extraction, image authenticity verification, and digital image modification detection. Our suggested solution makes use of CNNs’ deep learning capabilities and the refinement found by ELA.
  • Multimodal: A Text-Image based Cyber-Bullying Detecting with Deep Learning

    Ankarao A., Rafi S., Eluri R.K., Reddy K.V.N.

    Conference paper, 2025 IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation, IATMSI 2025, 2025, DOI Link

    View abstract ⏷

    The practice of categorizing and identifying cyber-bullying behavior, which include using technology to harass or intimidate people - usually through online platforms - is known as cyberbullying detection. To tackle this, we took a look at a dataset that was made public and labeled as bully or non-bully based on text, image, and image-text. Then, we proposed a deep learning model that could identify cyberbullying in multimodal data. Bullying in text is detected using the XLM-RoBERTa with BiGRU model, while bullying in images is identified by the VGG16 pre-trained model. Using attention processes, CLIP, feedback mechanisms, CentralNet, and other tools, we combined these models (VGG16 + XLM-RoBERTa and BiGRU) and developed a model for identifying cyberbullying in image-text based memes.With a respectable accuracy of 72%, our final model demonstrated that the system is capable of identifying the majority of cyberbullying incidents.
  • Detecting multimodal cyber-bullying behaviour in social-media using deep learning techniques

    MohammedJany S., Killi C.B.R., Rafi S., Rizwana S.

    Article, Journal of Supercomputing, 2025, DOI Link

    View abstract ⏷

    Cyberbullying detection refers to the process of classifying and identifying of cyberbullying behavior—which involves the use of technology to harass, or bullying individuals, typically through online platforms. A growing concern is the spread of bullying memes on social media, which can perpetuate harmful behavior. While much of the existing research focuses on detecting cyberbullying in text-based data, image-based cyberbullying has not received as much attention. This is a significant issue because many social media posts combine images with text, and the visual content can be a key component of cyberbullying. To address this, our research aims to develop a multimodal cyberbullying detection modal (MCB) that is capable of detecting bullying in both images and text. For this, we used VGG16 pretrained model to detect bullying in images and XLM-RoBERTa with BiGRU model to detect bullying in text. Together we integrated these models (VGG16 + XLM-RoBERTa and BiGRU) using attention mechanisms, CLIP, feedback mechanisms, CentralNet, etc., and proposed a model used for detecting cyberbullying in image-text-based memes. Our accomplished model produced a reasonable accuracy of 74%, pointing that the system is effective in recognizing most cyberbullying activity.
  • Multiple Disease Detection using CNN based Model from Chest X-rays

    Seviappan A., Chethan D., Sri P.K., Rafi S., Shahi S.G.

    Conference paper, Proceedings of 3rd International Conference on Sustainable Computing and Data Communication Systems, ICSCDS 2025, 2025, DOI Link

    View abstract ⏷

    Chest X-rays are one of the most widely used diagnostic tools for identifying lung-related diseases such as pneumonia, tuberculosis, and lung cancer. However, manual interpretation of these images can be time-consuming and subject to inconsistencies, especially in high-pressure clinical settings or areas with limited access to radiologists. To address these challenges, this study introduces a deep learning-based system that leverages Convolutional Neural Networks (CNNs) for automatic disease detection from chest X-ray images. The model is trained on a large, diverse dataset and incorporates essential preprocessing steps like histogram equalization to improve image quality and enhance diagnostic accuracy.The CNN-based framework is designed to automatically extract features and classify X-ray images into multiple disease categories. It aims to reduce diagnostic delays and support radiologists by offering fast and consistent evaluations. The system's performance is assessed using standard metrics such as accuracy, sensitivity, specificity, and F1-score, demonstrating its effectiveness as a decision-support tool in clinical workflows. By reducing dependence on manual review, this approach enhances both scalability and reliability in medical imaging diagnostics.Beyond automated image analysis, this paper also explores the integration of a real-time health monitoring solution for elderly individuals using a smartwatch-based system. This wearable device tracks vital signs such as heart rate and physical activity and provides instant alerts to caregivers in the event of abnormal readings. The combined application of AI-powered diagnostics and wearable health tracking presents a dual solution that supports early disease detection and improves continuous patient monitoring - paving the way for more responsive, accessible, and patient-centered healthcare.
  • AI vs Human Text Detector: Identifying AI-Generated Content Using NLP

    Reddy C.R.G.R., Muthukumar D.S., Thogai Rani B., Ganesh N., Rafi S.M., Vamsi P.

    Conference paper, Proceedings of the 2025 3rd International Conference on Inventive Computing and Informatics, ICICI 2025, 2025, DOI Link

    View abstract ⏷

    The evolving capabilities of AI models such as GPT -3 and GPT -4, and Deepseek have rendered it ever more difficult to distinguish between human-written text and AI-generated text. The issue raises serious concerns regarding plagiarism, disinformation, and authorship of electronic content in academic, journalistic, and educational spheres. For this aim, an innovative tool - AI vs Human Text Detector is introduced, it is a web application created to ascertain whether information was authored by a human or by an artificial intelligence model. The system uses Natural Language Processing (NLP) methods to examine prominent linguistic characteristics like perplexity and burstiness that distinguish the homogeneous pattern of AI text from the naturally heterogeneous patterns of human writing. The pre-trained GPT -2 is utilized to quantify textual predictability and variability, thus improving classification accuracy. Visualization of results is facilitated through Matplotlib and Plotly. The software tool is optimized to run on low-cost, commonly available resources, ensuring both accessibility and scalability. The proposed model achieves a high accuracy of 99.2% in detecting AI-generated content, outperforming existing models like ERT, CNN, and BERT-CNN. Future enhancements involve multilingual detection, hybrid detection models. The contribution of this work lies in supporting content integrity and ethical AI use in digital communication.
  • Optimizing English Learning with AI: Machine Learning Techniques and Tools

    Jayaranjan M., Shekhar G.R., Rafi S., Ramesh J.V.N., Kiran A., Vimochana M.

    Conference paper, International Conference on Intelligent Systems and Computational Networks, ICISCN 2025, 2025, DOI Link

    View abstract ⏷

    This research presents a new AI-driven approach to optimizing English language learning with a TF-IDF-based Gated Recurrent Unit model. It provides an effective framework for assessing and improving student writing competency by using advanced text classification approaches. Here, the six criteria evaluated on the basis of the ELLIPSE corpus of essays by grade 8-12 learners include coherence, syntax, vocabulary, phraseology, grammar, and conventions. Extensive preprocessing in terms of tokenization, stop word removal, stemming, and lemmatization, TF-IDF extracts key text features into numerical representations and feed into a GRU model that captures long-term dependencies as well as contextual meaning followed by classification with a dense layer and softmax activation. It has been implemented in Python: The GRU model yields an accuracy of 99.7%, precision at 99.04%, recall at 99.56%, and F1-score of 99.54. The work provides a rigorous methodology for text classification which improves the students' writing skills and propels AI tools in education.
  • Multimodal Multi-objective Grey Wolf Optimisation with SVM and Random Forest as Classifier in Feature Selection

    Das R., Rafi S., Purwar H., Laskar R.H., Rajshekhar A., Chandrawanshi N.

    Conference paper, Lecture Notes in Networks and Systems, 2025, DOI Link

    View abstract ⏷

    A technique called feature selection, often referred as attribute subset selection, selects the optimal subset of features for a given set of data by reducing the dimensionality and eliminating unnecessary characteristics. There can be 2n feasible solutions for a dataset with “n” features that is challenging to address using the conventional attribute selection method. Meta heuristic-based approaches perform better than traditional procedures in such situations. Numerous evolutionary computing techniques have been effectively used in Feature Selection challenges. On the distribution of options in the choice space, some research has been done. Achieving one, however, necessitates advancing the other since many optimisation problems contain two or more competing goals. The multi-objective optimisation technique discussed in this research finds the best effective trade-off between numerous objectives. Multi-objective Programs require multiple non-dominated solutions that could be found as opposite to just one. In the initial stage, we applied the Grey Wolf Optimisation (GWO) to acquire the optimised features. On the basis of the features selected, we trained the classifiers—Support Vector Machine (SVM) and Random Forest (RF) in the second phase. Experiment has been carried out on three benchmark datasets namely Glass, Wine and Breast Cancer Datasets retrieved from the UCI repository to show the supremacy of the proposed technique, the effectiveness of the recommended feature selection approach has been evaluated. The testing results show that the suggested GWO with Random Forest performs better than GWO with SVM.
  • Chronic Kidney Disease Prediction Using Machine Learning and Deep Learning Models

    Rafi S., Revanth N., Reddy K.V.R., Babu K.M., Kumar Y.L.P., Kumar N.V.

    Conference paper, 2025 IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation, IATMSI 2025, 2025, DOI Link

    View abstract ⏷

    Chronic kidney disease is a noticeable health condition that can persist throughout an individual's life, resulting from either kidney malignancy or diminished kidney function. In this work, we investigate how several machine learning techniques might provide an early CKD diagnosis. While previous research has extensively explored this area, our aim is to refine our approach by employing predictive modeling techniques. Initially, we considered 25 variables alongside the class property. The data set used in this study underwent extensive processing, including changing the names of colours for clarity, converting identified colours to numbers, treating unique values with letters handling of partitioned values, fixing incorrect values, filling null values with mean, and encoding categorical values into mathematical notation. In addition, Principal component analysis (PCA) was also employed to lower dimensionality. Our findings demonstrated that the XG Boost classifier surpassed e very other algorithm, with an accuracy of 0.991.
  • Detecting Sarcasm Across Headlines and Text

    Rafi S., Niharika A.L., Neelima S., Nikhitha K., Reddy M.S., Sireesha M.

    Conference paper, 2025 IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation, IATMSI 2025, 2025, DOI Link

    View abstract ⏷

    In this era with the rapid growth in social media usage among the current generation, a huge amount of content and comments, most of them sarcastic, is seen. Sarcasm has turned out to be an important part of daily life, especially in news and social media, where sarcastic comments are often used for better attention. However, detecting sarcasm is always challenging because it deals with understanding the difference between what has been said and what is meant. The current paper focuses on the detection of sarcasm in news headlines with the help of deep learning. Previous works were based on a wide range of datasets; however, these had limitations regarding either size or quality. In this respect, the authors propose creating a new dataset of headlines from sarcastic news sites and real news sites that is large and of high quality, hence appropriate for machine learning model training. The authors have also used the CNN-BILSTM architecture for text analysis, identifying sarcasm expression and deciding whether it is sarcastic or not-sarcastic which gained an accuracy of 97%. This dataset is made publicly available to enable further research in this direction.
  • Smartphone Price Patterns Prediction Using Machine Learning Algorithms

    Rafi S., Rambabu Y., Rajasekhar P., Suhas B., Reddy M.S., Moturi S., Doda V.R.

    Conference paper, 6th IEEE International Conference on Recent Advances in Information Technology, RAIT 2025, 2025, DOI Link

    View abstract ⏷

    Selecting the best smartphone can be challenging due to the wide range of models available on the market. This study shows how the machine learning models can predict mobile phone prices based on their features We evaluated several machine learning techniques, including Logistic Regression, Decision Trees, Random Forest, SVC, K-Neighbors Classifier, Gaussian Naive Bayes (GaussianNB), AdaBoost, Gradient Boosting, Extra Trees, Bagging Classifiers, and XGBoost. The primary objective was to identify the most effective model for price forecasting and to investigate the factors influencing phone prices. Our research offers insights to both consumers and manufacturers, helping them make more informed decisions about phone features and pricing. We emphasize the importance of using diverse datasets that accurately represent various smartphone models and pricing points. Key factors affecting phone costs were identified, and model performance was assessed using metrics such as accuracy, F1-score, and classification reports. Model performance was further enhanced through hyperparameter tuning with GridSearchCV, achieving 97% accuracy with the Decision Tree, K-Neighbors Classifier, SVC, AdaBoost, and Random Forest models. Among these, the Decision Tree and SVC was selected as the optimal models, offering a good tradeoff between accuracy, flexibility, and time complexity. This study aims to provide valuable data to guide consumers in making informed choices about mobile phone features and price ranges.
  • SCT: Summary Caption Technique for Retrieving Relevant Images in Alignment with Multimodal Abstractive Summary

    Rafi S., Das R.

    Article, ACM Transactions on Asian and Low-Resource Language Information Processing, 2024, DOI Link

    View abstract ⏷

    This work proposes an efficient Summary Caption Technique that considers the multimodal summary and image captions as input to retrieve the correspondence images from the captions that are highly influential to the multimodal summary. Matching a multimodal summary with an appropriate image is a challenging task in computer vision and natural language processing. Merging in these fields is tedious, though the research community has steadily focused on cross-modal retrieval. These issues include the visual question-answering, matching queries with the images, and semantic relationship matching between two modalities for retrieving the corresponding image. Relevant works consider questions to match the relationship of visual information and object detection and to match the text with visual information and employing structural-level representation to align the images with the text. However, these techniques are primarily focused on retrieving the images to text or for image captioning. But less effort has been spent on retrieving relevant images for the multimodal summary. Hence, our proposed technique extracts and merge features in the Hybrid Image Text layer and captions in the semantic embeddings with word2vec where the contextual features and semantic relationships are compared and matched with each vector between the modalities, with cosine semantic similarity. In cross-modal retrieval, we achieve top five related images and align the relevant images to the multimodal summary that achieves the highest cosine score among the retrieved images. The model has been trained with seq-to-seq modal with 100 epochs, besides reducing the information loss by the sparse categorical cross entropy. Further, experimenting with the multimodal summarization with multimodal output dataset, in cross-modal retrieval, helps to evaluate the quality of image alignment with an image-precision metric that demonstrate the best results.
  • Automatic Attendance Management System Using CNN

    Sreenivasu S.V.N., Rajani C., Rani B.U., Dasaradha A., Rafi S.

    Conference paper, 2024 4th International Conference on Artificial Intelligence and Signal Processing, AISP 2024, 2024, DOI Link

    View abstract ⏷

    Facial recognition technology plays a crucial role in various applications, from enhancing security at banks and organizations to streamlining attendance tracking in public gatherings and educational institutions. Traditional methods of attendance marking, such as signatures, names, and biometrics, can be time-consuming and error-prone. To address these challenges, a smart attendance system is proposed, leveraging Deep Learning, Convolutional Neural Networks (CNN), and the OpenCV library in Python for efficient face detection and recognition. The system utilizes advanced algorithms, including Eigen faces and fisher faces, to recognize faces accurately. While deep learning models excel with large datasets, they may not perform optimally with few samples. By comparing input faces with images in the dataset, the system automatically updates recognized names and timestamps into a CSV file, which is then sent to the respective organization's head. Additionally, the system allows users to upload a single photo or a group photo, and it returns matched photos as output using a CNN. This feature enhances the system's flexibility and usability, providing users with a convenient way.
  • ChronicNet: Randome Forest Classifier-based Chronic Heart Failure Detection with CNN Feature Analysis

    Malleswari D., Vazram B.J., Shaik R.

    Conference paper, Proceedings - 2024 13th IEEE International Conference on Communication Systems and Network Technologies, CSNT 2024, 2024, DOI Link

    View abstract ⏷

    Chronic heart failure (CHF) is a common illness that affects the heart. The conventional machine learning and deep learning algorithms failed to identify CHF in the early stages. So, this work implemented the ChronicNet by combining the properties of both deep learning and machine learning. This study is all about creating a network for finding out CHF from sound recordings of the heart. These are called phonocardiogram data, or PCG. The first step, which is noise removal, signal boosting, and dividing parts, makes sure that heartbeat sounds are of good quality. We use Mel and pitchbased coefficients (MFCC) to analyze the frequency changes in a heartbeat signal. This helps pick out features that show what makes CHF heart disease more special. The convolutional neural network (CNN) feature extraction, using deep learning, helps the MFCC automatically find out special features on its own. The Random Forest classifier (RFC) is used to build a model that can predict CHF faster. In groups with problems to classify, the RFC uses a set of decision trees. This gives benefits such as holding up, fitting to big sizes, and being highly accurate. The proposed system uses CNN features to find CHF from PCG data and correctly identify it using RFC. The simulation results show that the proposed ChronicNet outperformed traditional approaches with 98.84% accuracy.
  • Classification of Music Genre Using Deep Learning Approaches

    Srinivas U.M., Rafi S., Manohar T.V., Rao M.V.

    Conference paper, 2024 4th International Conference on Artificial Intelligence and Signal Processing, AISP 2024, 2024, DOI Link

    View abstract ⏷

    Music genre classification is a pivotal area of research within audio technology, holding immense importance for content organization and recommendation. Audio feature extraction and Music genre classification constitute a complete recognition system. Audio feature analysis and Music genre classification together form an integrated recognition system for comprehensive music genre identification and organization. This technology is frequently utilized to accurately detect and classify various types of music genres or characteristics present in audio signals, contributing significantly to the effective organization and recommendation of music content. Our experiment was conducted with the dataset from GTZAN that is taken from Kaggle repository. Convolutional neural networks (CNN) are employed to train our model, which is subsequently utilized for the classification of music genres in audio signals.
  • Rainfall Prediction Using Machine Learning

    Sreenivasu S.V.N., Rafi S., Lakshmi V.V.A.S., Sivanageswara Rao S., Rajani Ch.

    Conference paper, Proceedings of 2024 2nd International Conference on Recent Trends in Microelectronics, Automation, Computing, and Communications Systems: Exploration and Blend of Emerging Technologies for Future Innovation, ICMACC 2024, 2024, DOI Link

    View abstract ⏷

    The title is 'Rainfall Prediction Using Machine Learning'. The initiative's dataset is written in Python and stored in Microsoft Excel. A wide range of machine learning algorithms are used to discover which strategy generates the best accurate predictions. In many sections of the country, rainfall forecasting is critical for avoiding major natural disasters. This forecast was created using a variety of machine learning approaches, including catboost, xgboost, decision tree, random forest, logistic regression, neural network, and light gbm. It incorporates several components. The Weather Dataset was utilized. The primary goal of the research is to evaluate a variety of algorithms and determine which one performs best. Farmers may greatly profit from growing the appropriate crops based on the amount of water they require.
  • Unveiling Student Success: A Multifaceted Approach with Learning Coefficients and Beyond

    VijayaKumar N., Rafi S., Mahith T., Reddy D.V., Naik K.R., Raju K.

    Conference paper, 2nd IEEE International Conference on Integrated Intelligence and Communication Systems, ICIICS 2024, 2024, DOI Link

    View abstract ⏷

    The student performance is examined in this study using a number of methods of Educational Data Mining (EDM), Clustering and classification techniques are employed to classify the course as well as the performance in the entrance examination. The results obtained show that the Random Forest and XG Boost which are machine learning models outperform traditional methods for predicting student success. Moreover, CNN and LSTM Networks, which are deep learning models, improve prediction accuracy even further. Conducted through metrics like accuracy, precision, recall and F1-score, this study shows that any form of recognition of the pattern, in this case, the early one, helps to reduce failure rates to considerable extents. The results of this study suggest that there is a potential scope for further improving prediction algorithms and management of educational resources, which are of great relevance to the institutions to further the student success.
  • Machine Learning Framework for Women Safety Prediction using Decision Tree

    Sowmika P.S., Rao S.S.N., Rafi S.

    Conference paper, Proceedings - 5th International Conference on Smart Systems and Inventive Technology, ICSSIT 2023, 2023, DOI Link

    View abstract ⏷

    In every city, harassment and violence becomes one of the major problems for women. Further, women's personal life is suffered by the bullying and abusive content presented in Online Social Networking (OSN). Therefore, it is necessary to identify the women safety in OSN environment. When it came to predicting the maximum safety analysis, however, traditional methodologies came up short. This study, then, employs a decision tree (WSP-DT) classifier to make predictions about women's safety. After considering the Twitter dataset for system implementation, it is pre-processed to get rid of the blanks and the unknowns. The tweets were then processed by a natural language toolkit (NLTK) that handled tasks including tokenization, case-conversion, stop-word detection, stemming, and lemmatization. Next, we create a text blob protocol to determine the positive, negative, and neutral polarity of pre-processed tweets. To further extract the data characteristics based on word and character frequency, term frequency-inverse document frequency (TF-IDF) is used. At last, a decision tree classifier was used, based on several rounds of training, to determine if a tweet was phoney or real. Testing on the Twitter dataset demonstrates that the proposed WSP-DT classifier outperforms the competition in simulations.
  • Abstractive Text Summarization Using Multimodal Information

    Rafi S., Das R.

    Conference paper, 2023 10th International Conference on Soft Computing and Machine Intelligence, ISCMI 2023, 2023, DOI Link

    View abstract ⏷

    Much text generates over the internet through news articles, story writing and blogs. Reading and understanding such an enormous amount of data to the user is problematic, including time and effort. Automatic abstractive text summarization has gained more importance to increase the user's understanding and reduce time. It shortens the given input by preserving the meaning and identifying the context of the whole document to generate meaningful sentences. The research community has proposed different methods for text reduction and generating abstractive summaries. However, problems like semantics and contextual relationship in the summary generation process must be still need to improve. The multimodal abstractive text summarization is a technique that combines text and image information which helps in addressing the semantics and contextual relationship by proposing Multimodality Image Text (MIT) layer that fuses the text-extracted global features by glove embedding and preserves the semantics of the vocabulary and text-related images are used to identify the contextual relationship features from inception v3, which cope in the MIT layer to generate efficient multimodal abstractive text summaries by training and testing with seq-to-seq model. Experiments with the MSMO dataset achieve superior performance on other state-of-art results.
  • Detection of Active Attacks Using Ensemble Machine Learning Approach

    Revathy S., Sathya Priya S., Rafi S., Pranideep P., Rajesh D.

    Conference paper, Lecture Notes in Networks and Systems, 2022, DOI Link

    View abstract ⏷

    Cyber attackers entrap online users and companies by stealing their sensitive information without their knowledge. Sensitive information such as login credentials, bank card details, and centralized servers of organizations are hacked by the attackers. Some of the cyber attacks are phishing attack where attackers make the online users to trust their websites as a legitimate website and retrieve their personal information by making them as a prey for cyber attacks. Malware attack is a one where attacker will inject a malicious software into the company server or any online user’s device, without their knowledge and steal all the data in their devices and servers. Intrusion is an invasion, where attacker will attack the network and theft all the network resources. But, there are many types of cyber attacks solutions such as visual similarity-based approaches, intrusion detection system, signature-based, heuristic-based, specification-based, anomaly-based methods that are proposed, but they have some disadvantages. Because of few unsecured HTTP websites and lack of cyber knowledge, cyber attacks are increasing day by day. In our proposed system, a unified ensemble approach (UEA) is proposed by combining different machine learning algorithms using ensemble approach that gives better accuracy and detection rate. This model aims to detect the intrusion, phishing attack and prevent the malwares thereby mitigating the cyber attacks encountered by individual and organization.
  • Sentiment-Based Abstractive Text Summarization Using Attention Oriented LSTM Model

    Debnath D., Das R., Rafi S.

    Conference paper, Smart Innovation, Systems and Technologies, 2022, DOI Link

    View abstract ⏷

    Product reviews are essential as they help customers to make purchase decisions. Often these product reviews are used to be too abundant, lengthy and descriptive. However, the abstractive text summarization (ATS) system can help to build an internal semantic representation of the text with the use of natural language processing to create sentiment-based summaries of the entire reviews. An ATS system is proposed in this work, which is called a many-to-many sequence problem where attention-based long short-term memory (LSTM) is incorporated to generate the summary of the product reviews. The proposed ATS system works in two stages. In the first stage, a data processing module is designed to create the structured representation of the text, where noise and other irrelevant data are also removed. In the second stage, the attention-based long short-term memory (LSTM) model is designed to train, validate and test the system. It is found that the proposed approach can better deal with the rare words, also can generate readable, short and informative summaries. An experimental analysis has been carried out over the Amazon product review dataset, and to validate the result, the ROUGE measure is used. The obtained result reflects the efficacy of the proposed method over other state-of-the-art methods.
  • RNN Encoder and Decoder with Teacher Forcing Attention Mechanism for Abstractive Summarization

    Rafi S., Das R.

    Conference paper, Proceedings of the 2021 IEEE 18th India Council International Conference, INDICON 2021, 2021, DOI Link

    View abstract ⏷

    Automatic text summarization is utilized to address the sustained increasing proportion of text data available in online, to address such numerous data to short data summarization is preferred. In this work, abstractive text summarization is reviewed with Recurrent Neural Network based Long Short Term Memory with encoder and attention decoder. In recent years, this type of summarization has carried out with Recurrent Neural Network which learns from the previous time steps. In this paper, we propose Teacher Forcing Technique to improve the slow convergence and poor performance of Recurrent Neural Network. Our technique improves the performance of text summarization by using Attention Decoder which learns from ground truth instead of learning from previous time steps and minimizes the error rate with Stochastic Gradient Descent optimizer with more accurate results on Wikihow dataset when measured with metric of ROUGE and performed well when compared our result with the state of art results.
  • A Linear Sub-Structure with Co-Variance Shift for Image Captioning

    Rafi S., Das R.

    Conference paper, 2021 8th International Conference on Soft Computing and Machine Intelligence, ISCMI 2021, 2021, DOI Link

    View abstract ⏷

    Automatic description of image has attracted many researchers in the field of computer vision for captioning the image in artificial intelligence which connects with Natural Language Processing. Exact generation of captions to image is necessary but it lacks due to Gradient Diminishing problem, LSTM can overcome this problem by fusing local and global characteristics of image and text that generates sequenced word prediction for accurate image captioning. We consider Flickr 8k data-set which consists of text as descriptions of images. The use of GLoVe embedding helps for the word representation to consider the global and local features of images which finds distance with Euclidean to understand the relationship between words in vector space. Inception V3 architecture which is pretrained on ImageNet used to extract image features of different objects in scenes. We propose Linear Sub-Structure that helps to generate sequenced order of words for captioning by understanding relationship between words. For extracting image features considers co-variance shift which mainly concentrates on moving parts of the image to generate accurate description of the image to maintain a semantic visual grammar relationship between the predicted text for image as the caption, the proposed model evaluated with the help of BLEU score which achieves state of art model in our work while compared with others that has greater than 81% of accuracy.
  • Enhanced biomedical data modeling using unsupervised probabilistic machine learning technique

    Rizwana S., Challa K., Rafi S., Imambi S.S.

    Article, International Journal of Recent Technology and Engineering, 2019,

    View abstract ⏷

    Text mining approaches uses feature similarity techniques or distributed keyword searching techniques. But machine learning techniques develop a statistical model to categorize documents by learning from vast amount of medical documents available at pubmed. It is unsupervised techniques. The proposed algorithm enhances the traditional document clustering techniques.and generate accurate and reliable model. We experimented the algorithm with 1000 document data set It showed the significant improvement over other traditional algorithms.
Contact Details

rafi.s@srmap.edu.in

Scholars
Interests

  • Computer Vision
  • Content-Based Image Retrieval
  • Natural Language Processing

Education
2012
MCA
JNTU Kakinada
India
2014
M.Tech (CSE)
JNTU Kakinada
India
2020
AMIE
Institute of Engineers
India
2025
Ph.D
National Institute of Technology Mizoram
India
Experience
  • 2013-2018 Assistant Professor – Tirumala Engineering College, Narasaraopet
  • 2018-2019 Assistant Professor – Eswar College of Engineering, Narasaraopet
  • 2019-2025 Assistant Professor – Narasaraopeta Engineering College (Autonomous), Narasaraopet
Research Interests
  • Considering two types of modalities such as text and image modalities and extracting features from multimodalities to generate Multimodal Abstractive Text Summarization.
  • My interest also includes to retrieve relevant images to the generated Multimodal Abstractive Summaries using different techniques from deep learning.
Awards & Fellowships
  • Gold Medal in M.Tech – Narasaraopeta Engineering College (2013)
  • Best Paper Award – DoSCI-2025
Memberships
  • ACM
  • IAENG
Publications
  • Generation of Semantic and Contextual Captions to the Images Using ViT

    Srinivas A.V.S.S.P.S.S., TirumalaRao S.N., Narasimha Reddy K.V., Rafi S., Reddy S.

    Conference paper, Lecture Notes in Networks and Systems, 2026, DOI Link

    View abstract ⏷

    Generation of sentences to the images like human is an important task in computer vision which this task can also be called as image caption. This process bridges the computer vision to natural language processing tasks which generate descriptions to the images. This paper highlights to extract semantical and contextual features from images to capture the effective relationship features with Vision Transformer (ViT) in the form of high-level features like objects, meaningful scenes, attributes from the visionary images. These extracted features particularly from the images helps in deep level understanding to the user, that shows context features and spatial feature information from the images. On these extracted essential features this paper utilizes attention mechanism to particularly focus on dynamic regions that helps the model to generate more semantical and contextual text descriptions to the images. Then these integrated features are utilized by the proposed model and enhances the ability to produce captions that are very fluent and descriptions human-like sentences. A standard dataset has been utilized to experiment and to generate captions such like Flickr8k that resembles the effectiveness in its method in generation of descriptions like humans for improving performance over other baseline methods.
  • AI Document Search Chatbot Using Retrieval-Augmented Generation (RAG)

    Rafi S., Siva Rama Krishna Boddu L.V., Lakshmi Pujitha G., Yella S.C., Gangireddy G., Nishanth Bhuvaneswar P.Y.

    Conference paper, Proceeding of International Conference on Computing, Communication, Control and Cyber-Physical Systems, I5CPS 2026, 2026, DOI Link

    View abstract ⏷

    This work describes the design and the implementation of an AI document search chatbot using a Retrieval-Augmented Generation (RAG) architecture that combines generative modelling with information retrieval to provide an accurate and verifiable responses. The system supports PDF, DOCX, CSV, and TXT uploads, which are automatically processed, segmented, and indexed in a vector database for semantic search. It is implemented in Python using LangChain for orchestration, Facebook AI Similarity Search (FAISS) for vector retrieval, and multiple large-language-model Application Programming Interface (API), including OpenAI, Google Generative AI, and Hugging Face. For each query, embeddings are computed and the most relevant document segments are retrieved using cosine similarity before being passed to the selected model to ensure responses are grounded in user-supplied content. Owing to its modular design, the architecture is scalable, maintainable, and easily extensible for enterprise and academic knowledge-management applications.
  • A Hybrid Machine Learning Framework for Personalized Weight Loss through Protein Intake Pattern Analysis

    Siva Rama Krishna B.L.V., Rafi S., Sri Sai Praneeth B.V.S., Sri Nag P.V., Sireesh T.N., Harshitha S.A.

    Conference paper, 2026 IEEE International Conference on Emerging Computing and Intelligent Technologies, ICoECIT 2026, 2026, DOI Link

    View abstract ⏷

    Conventional weight loss programs often apply generalized nutritional guidelines, ignoring individual variations in metabolism and dietary response. Such limitations result in inconsistent progress and reduced long-term success rates. This research presents a data-driven framework to enhance personalized weight management by analyzing protein intake patterns using machine learning and deep learning models. The study employs data from the MyFitnessPal dataset and user-provided records, including diet logs, anthropometric parameters, and demographic details. Pre-processing is performed using a Target Encoding Wavelet Transform Filter (TEWTF) to remove noise and normalize heterogeneous data. Advanced algorithms such as Random Forest Generative Adversarial Networks (RFGAN) and Preference-Aware Inverse Optimization (PAIO) are implemented to create adaptive diet plans aligned with user preferences. Furthermore, Hierarchical Clustering combined with Multi-Layer Perceptron (HCMLP) is utilized to identify protein consumption trends and predict optimal intake levels for diverse user groups. The model dynamically refines nutritional recommendations based on individual behavior and physiological responses. Experimental evaluation shows consistent predictive accuracy, maintaining 95% performance across iterative testing from 100 to 900 posts. This framework demonstrates that machine learning can effectively translate nutritional data into personalized, real-time diet guidance, advancing the field of AI-driven health optimization.
  • Multimodal abstractive summarization and retrieving relevant images to be multimodal output

    Rafi S., Das R., Rizwana S.

    Article, Knowledge and Information Systems, 2026, DOI Link

    View abstract ⏷

    This paper presents a novel multimodal summarization and image retrieval framework, termed Context-Aware CLIP with Hybrid Image-Text Fusion (CA-CLIP-HIT), for generating semantically coherent multimodal abstractive summaries and retrieving contextually relevant images. Existing multimodal summarization approaches often exhibit limitations in contextual understanding, semantic alignment between textual and visual modalities, and retrieval accuracy due to shallow feature representations and insufficient cross-modal interaction. To address these challenges, the proposed framework integrates textual and visual information through a Hybrid Image-Text (HIT) fusion mechanism, which generates context-aware multimodal representations capable of preserving semantic dependencies and contextual relationships across modalities. The extracted multimodal features are fused within the HIT layer to construct a comprehensive contextual representation, which is subsequently processed using a sequence-to-sequence encoder-decoder architecture based on Long Short-Term Memory (LSTM) networks for multimodal abstractive summary generation. To strengthen semantic correspondence between generated summaries (SUMMA) and candidate images, the framework employs the CLIP text encoder for summary representation and the CLIP image encoder for visual representation within a shared semantic embedding space. Cosine similarity is utilized to identify and retrieve the image that exhibits the highest semantic relevance to the generated multimodal summary. In addition, a Caption-Assisted Post-Processing Alignment (CAPPA) mechanism is introduced to address ambiguity during image retrieval. In scenarios where multiple candidate images obtain similar similarity scores, the CAPPA module performs caption-level semantic analysis to determine the image that demonstrates the highest contextual alignment with the generated summary. This refinement mechanism enhances retrieval precision, semantic consistency, and robustness in visually ambiguous retrieval scenarios. The proposed framework is evaluated on the MSMO dataset using ROUGE-1, ROUGE-2, ROUGE-L, BLEU, and Image Precision (IP) metrics. Experimental results demonstrate that the proposed CA-CLIP-HIT framework outperforms existing state-of-the-art methods. Furthermore, statistical significance analysis using a paired Student’s t-test confirms that the observed performance improvements are statistically significant. Overall, the proposed CA-CLIP-HIT framework provides an effective and scalable solution for multimodal abstractive summarization and context-aware image retrieval.
  • Detection of Skin Lesion for Classifying as Benign and Malignant Skin Cancer

    Sankuru H.B., Chandana Y., Rafi S., Reddy K.V.N.

    Conference paper, Lecture Notes in Networks and Systems, 2026, DOI Link

    View abstract ⏷

    Skin cancer is one of the dangerous diseases. This study proposes an automated skin lesion detection and classification system leveraging image processing and deep learning techniques. The methodology includes image acquisition, preprocessing (noise reduction, contrast enhancement, and segmentation), and feature extraction using both handcrafted methods (color, texture, and shape analysis) and deep learning-based approaches (CNNs, Vision Transformers), which is challenging in extracting only particular features. This challenge places an important observation in classifying and extracting features. For classification, deep learning architecture ResNet-50 is employed to differentiate between benign and malignant lesions to classify as skin cancer. Results show that deep learning models surpass traditional approaches in achieving superior accuracy with 89.63 for precision and 91.5 score with F1 and 93.6% with accuracy, sensitivity, and robustness in skin cancer detection. However, challenges such as dataset bias, model interpretability, and real-time deployment remain.
  • A Bio-Nature Inspire Algorithm: Ant Colony Optimization for Classifying Benign and Malignant Tumors in Breast Cancer

    Kanakam S., Narasimha Reddy K.V., Rafi S., Reddy V., Rambabu K.

    Conference paper, Lecture Notes in Networks and Systems, 2026, DOI Link

    View abstract ⏷

    This research presents a novel hybrid framework combining Ant Colony Optimization (ACO) and ResNet-50 deep learning architecture for efficient breast cancer detection and classification in mammographic images. The proposed methodology leverages the strengths of both bio-inspired computing and deep learning to enhance detection accuracy and reduce false positives. ResNet-50’s pre-trained architecture is utilized for robust feature extraction from mammogram images, while ACO optimizes the feature selection and classification process. The system operates in multiple phases: initial preprocessing enhances image quality through adaptive histogram equalization and noise reduction; ResNet-50 extracts hierarchical features from the preprocessed images; ACO then optimizes the feature selection process by treating the feature space as a graph where artificial ants traverse to identify the most discriminative feature combinations. This hybrid approach demonstrated superior performance compared to traditional methods, achieving 97% accuracy sensitivity on the DDSM dataset.
  • Generating Semantic-Based Extractive Summaries in Summarization

    Mandhatha P.C., Narasimha Reddy K.V., Suresh M., Tirumala Rao S.N., Venkata Reddy D., Rafi S.

    Conference paper, Lecture Notes in Networks and Systems, 2026, DOI Link

    View abstract ⏷

    In order to produce succinct and contextually appropriate summaries, this work examines Bidirectional Encoder Representations from Transformers (BERT) for extractive semantic summarization, highlighting its capacity to recognize and utilize keywords and important phrases. BERT outperforms conventional frequency-based keyword extraction techniques by identifying semantical properties from text sentences and visual pictures thanks to its contextual embeddings and self-attention processes. In order to evaluate BERT’s performance in extractive summarization tasks, the article describes a thorough experimental setup that includes dataset selection, preprocessing, model construction, and evaluation measures. To maximize model performance, important hyperparameters are discussed, including batch size, learning rate, and optimization techniques. Findings show that BERT has a strong knowledge of semantics, context-aware extraction, and cross-domain adaptation, which makes it an effective tool for producing high-quality summaries in a variety of applications, including news aggregation, scientific research.
  • Entity-Aware Medical Image Captioning

    Rafi S., Rizwana S., Drutika P., Srija R., Susmitha C.H.S., Sahasra J.

    Article, IEEE Access, 2026, DOI Link

    View abstract ⏷

    In order to produce meaningful textual interpretations of intricate clinical images, medical image captioning has become a significant field of study at the nexus of computer vision and natural language processing. Due to the lack of explicit modeling of medical entities, current methods frequently fail to produce descriptions that are both semantically valid and clinically useful, despite notable advances in deep learning and vision language modeling. Typical captioning methods in particular, fall short of being able to retrieve fine grained diagnostic information and maintain semantic consistency with clinical findings as they focus on global features. This paper addresses these limitations by presenting an entity-aware medical image captioning approach which aims to identify and incorporate clinically relevant entities into the caption generation, including but not limited to, diagnostic finding, anatomical structures, or diagnostic characteristics. The proposed method utilizes entity level representations as a means of guiding the captioning process thereby ensuring a tighter semantic consistency between visual modalities and the resultant textual output. Consequently, this leads to more comprehensible, informative and clinically relevant generated reports. Additionally, inclusion of entity awareness can aid the model in effectively understanding the relationships between medical concepts leading to captions more consistent with medical expertise. The results demonstrate that explicit modeling with structured semantic information within vision-language frameworks are crucial and that entity-aware methods have the potential to greatly improve captioning. This work has the ability to help advance health intelligence applications which will serve to better assist clinical decision making, scale the processing of medical images, and facilitate accurate medical documentation.
  • Feature Augmentation and Convolutional Neural Networks for Accurate Prediction of Heart Disease

    Ramnadh Babu T.G., Bhavana K., Chaitanya G., Sravani M., Shaik R., Moturi S.

    Conference paper, Smart Innovation, Systems and Technologies, 2026, DOI Link

    View abstract ⏷

    Heart diseases are considered the foremost cause of death within developing nations; therefore, prediction of heart disease is crucial for evaluating the risk of patients. This paper will introduce a new method to enhance prediction accuracy by combining CNNs with SAE for feature enhancement. Our method uses a dataset of 918 patient records with 11 clinical variables, and it removes the drawback of traditional classifiers by using feature augmentation to build more informative features. Experimental results show that our model’s accuracy is 93.478%, an improvement over traditional classifiers like MLP and RF by 4.98%. Latent space size is also optimized, and 100 best features are obtained. The results suggest that the deep learning methods, especially the combination of SAE with CNN, bring in notable benefits for heart disease prediction, which might further be used for the clinical purpose of earlier interventions.
  • Reducing extrinsic hallucination in multimodal abstractive summaries with post-processing technique

    Rafi S., Laitonjam L., Das R.

    Article, Neural Computing and Applications, 2025, DOI Link

    View abstract ⏷

    Multimodal abstractive summarization integrates information from diverse modalities, such as text and images, to generate concise, coherent summaries. Despite its advancements, extrinsic hallucination, a phenomenon where generated summaries include content not present in the source, remains a critical challenge, leading to inaccuracies and reduced reliability. Existing techniques largely focus on intrinsic hallucinations and often require substantial architectural changes, leaving extrinsic hallucination inadequately addressed. This paper proposes a novel post-processing approach to mitigate extrinsic hallucination by leveraging external knowledge vocabularies as a corrective mechanism. The framework identifies hallucinated tokens in generated summaries using a cosine similarity metric and replaces them with factually consistent tokens sourced from external knowledge, ensuring improved coherence and faithfulness. By operating at the token level, the approach preserves linguistic, semantic, and syntactic structures, effectively reducing unfaithful content. The proposed method incorporates domain knowledge through a Word2Vec-based vocabulary, offering a scalable solution to enhance factual consistency without modifying model architectures. The contributions of this study include a detailed methodology for identifying and correcting hallucinated tokens, a robust post-processing pipeline for refining summaries, and a demonstration of the method’s effectiveness in reducing extrinsic hallucinations. Experimental results on MSMO dataset highlight the approach’s potential to improve the accuracy, coherence, and reliability of multimodal abstractive summarization systems, addressing a significant gap in the field and shows the state-of-the-art results with RMS-Prop Optimizer.
  • Detecting Chronic Kidney Disease at an Early Stage Through Machine Learning

    Reddy N.M., Rafi S.

    Conference paper, 2025 IEEE 7th International Conference on Cybernetics, Cognition and Machine Learning Applications, ICCCMLA 2025, 2025, DOI Link

    View abstract ⏷

    The objective of the current research is to implement the Random forest approach to predict chronic kidney disease. One of the main chronic ailments is kidney disease. It is extremely cost-effective to identify the problem at an early stage. As the problem is extremely cost-effective, there is a constant concern of the global economic pressure. The aim of the research work is to create a practical model which will be able to predict the disease accurately at an early stage. The initial system relying on the K Nearest Neighbor KNN classification approach. The model as a whole suffers from scalability as does the data, as well as the It suffers from overfitting and poor performance on selection and tuned data. The Random forest approach is an improvement over the KNN model. The Random forest model has proven itself to be better than the KNN approach, and shows l prediction accuracy on chronic kidney disease case. The research work shows how advancement in machine learning could improve prediction on the specified ailment. Aspects like feature projection, data preprocessing data, and alternate ensemble learning methods could be used in future work to improve. Such results but point towards the essential need of Indic.
  • Multimodal Image Caption Generation with Semantic and Temporal Context

    Rafi S., Das R., Rao P.A., Rizwana S.

    Conference paper, Proceedings of the International Conference on Soft Computing and Machine Intelligence, ISCMI, 2025, DOI Link

    View abstract ⏷

    Multimodal semantic image captioning is a cutting-edge approach that combines visual and textual modalities to generate accurate and contextually rich natural language descriptions of images. This method extends beyond traditional captioning by incorporating semantic understanding and capturing high-level concepts such as object attributes, relationships, and scene using temporal context. The proposed model effectively align visual content with multimodal linguistic meaning by combining visual features extracted from deep convolutional networks like ResNet-101 with semantic representations derived from textual embedding's enriched by external knowledge bases and the language description generation is typically handled by sequence models like LSTM which is conditioned on the fused multimodal inputs. The semantic option helps the model to generate meaningful captions semantically aligned with the image content, leading to improved relevance, diversity, and human likeness. As Multimodal semantic image captioning progress with Flickr-30k data that consider multimodalities of information in the form of images and text descriptions trained with Adam Optimizer for 30 epochs. The proposed model shows greater performance with 63% Bleu and Meteor metric when compared with other models.
  • LSTM based DDos Attacks Prevention and Detection for EV Charging Batteries

    Saida S.J., Tiwari B.K., Rafi S.

    Conference paper, 3rd International Conference on Power Electronics and Energy, ICPEE 2025, 2025, DOI Link

    View abstract ⏷

    Electric Vehicle charging infrastructure is crucial to the sustainable energy transition but it is also susceptible to cyberattacks. Protection against possible cyberattacks, such as Distributed Denial of Service (DDoS) assaults, has become crucial with the growth of electric vehicle supply equipment (EVSE) networks. The extensive Electric Vehicle Supply Equipment (EVSE) dataset, which includes high-performance computing (HPC) statistics, system performance indicators, and network traffic data, is used to analyze the proposed approach, and to create a strong anomaly detection framework by utilising deep learning techniques, to analyse host-based data, such as kernel eventlogs and HPC data. LSTM based model is used for sequence-based learning, analysing high-granularity event sequences to identify anomalous patterns, and putting in place a preprocessing pipeline that guarantees dependable data input for the model are some of the main contributions.
  • Abstractive Text Summarization with Semantic and Contextual Alignment using BART

    Rafi S., Boddu L.V.S.R.K., Pidikiti D., Rayavarapu S., Chimirala S.S., Javvadi S.

    Conference paper, Proceedings of 2025 International Conference on Signal Processing, Computation, Electronics, Power and Telecommunication, IConSCEPT 2025, 2025, DOI Link

    View abstract ⏷

    The enormous information overload caused by the exponential growth of digital content across businesses is making it more challenging to adopt effective automatic summarizing solutions. Abstractive text summarizing has grown to be an important area in NLP with the aim of creating concise, clear, and instructive summaries that go beyond basic source text extraction. Summarization systems continue to struggle with issues of semantic purity, factual correctness, and contextual alignment despite tremendous advancements made possible by deep learning and transformer-based architectures. The study uses the BART model, which has been refined on a sizable news dataset, to examine abstractive summarization with an emphasis on semantic and contextual alignment. The suggested system incorporates contextual alignment techniques and semantic-aware preprocessing to guarantee that generated summaries maintain coherence and fluency while preserving meaning fidelity. The main evaluation metric used in the study is ROUGE, which is supplemented by knowledge from more modern semantic similarity-based methodologies. When compared to baseline summarization systems, experimental results show significant gains in content selection, semantic consistency, and textual coherence, especially for longer inputs. The evaluation further highlights the benefits of incorporating semantic and contextual representations into training pipelines, showing that such improvements can reduce factual inconsistencies and improve the total informativeness of summaries that were produced.
  • The Perils of Naive Truncation: A Context Ablation Study for Dialogue Summarization on DialogSum

    Rafi S., Boddu L.V.S.R.K., Kolla D.V., Pothuguntla C., Myla R.B.

    Conference paper, 2025 5th International Conference on Artificial Intelligence and Signal Processing, AISP 2025, 2025, DOI Link

    View abstract ⏷

    A common shortcut in dialogue summarization is to truncate a conversation to its most recent turns, assuming this reduces cost without hurting summary quality. We test this assumption through a controlled context ablation study on DialogSum using DistilBART as the main model, with T5- small and BART-large for confirmation. Truncation consistently hurts quality: BERTScore drops by -0.0115 and ROUGE-L by -0.0705 (p < 0.0001), showing that removing early context acts as lossy compression that distorts meaning. Meanwhile, efficiency barely improves - shrinking input length by about 75% yields only a ~ 10% gain in throughput on an NVIDIA T4 GPU. These findings reveal that naive truncation is counterproductive; future dialogue summarization systems should adopt adaptive, content- aware context selection rather than blunt length reduction.
  • Analysis on Data by Deterioration Ambiguity Technique Using Data Analysis for Agriculture

    Rafi S., Manohar T.V., Siva Rama Krishna B.L.V., Narasimha Raju B.N.V.

    Conference paper, 2025 5th International Conference on Artificial Intelligence and Signal Processing, AISP 2025, 2025, DOI Link

    View abstract ⏷

    This research investigates the evolving advantages of diverse career trajectories while critically examining the current absence of standardized frameworks within the data science discipline. The pervasive dissemination of misinformation across the internet has precipitated an unprecedented surge in data generation, thereby necessitating the emergence of data mining as a crucial analytical paradigm. Over the forthcoming decade, the capability to extract contextually significant and substantively relevant insights from vast datasets is projected to become a fundamental determinant of progress across multiple domains.In particular, this study analyzes five case studies that collectively endeavor to establish a unified understanding of occupational structures within the data science ecosystem. The examination and utilization of data-driven insights to support empirical observation and informed decision-making constitute essential components, especially within the agricultural sector. Building upon these contextual analyses, the research delineates the distinct yet complementary roles of data engineers and data scientists in shaping effective data-centric strategies.To evaluate crop productivity, the study applies data mining methodologies with an emphasis on regression analysis. The estimation of individual crop yields is conducted through the identification of underlying patterns in parameter-specific variables and historical data records. This methodological approach facilitates the derivation of predictive insights, thereby contributing to enhanced agricultural output assessment and strategic planning.
  • A Novel Approach for Early Detection of Forest Fire from Images with Deep Learning: A Machine Vision Course Experiment

    Udaya Lakshmi B.N.V., Lakshminadh K., Suresh Babu K., Narasimha Reddy K.V., Rafi S., Swathi P.

    Conference paper, Lecture Notes in Networks and Systems, 2025, DOI Link

    View abstract ⏷

    Rapid and precise detection systems are necessary because wild forest fires are a serious hazard to infrastructure, human lives, and ecosystems. The ResNet-50 convolutional neural network (CNN) is used in this work to provide a deep learning-based method for detecting wild forest fires. By utilizing ResNet-50’s potent feature extraction capabilities, the model is optimized to categorize images as “Fire” or “No Fire,” guaranteeing excellent precision and recall. To improve model performance on a variety of image datasets, the system integrates a strong data preprocessing pipeline that includes scaling, normalization, and data augmentation techniques including flipping, rotation, and brightness correction. The model is trained used Adam optimizer and emphasizing early stopping mechanism with learning rate of le-4. The model efficiencies on fire forest dataset which includes satellite, drone, and ground captured images.
  • Topic-guided abstractive multimodal summarization with multimodal output

    Rafi S., Das R.

    Article, Neural Computing and Applications, 2025, DOI Link

    View abstract ⏷

    Summarization is a technique that produces condensed text from large text documents by using different deep-learning techniques. Over the past few years, abstractive summarization has drawn much attention because of the capability of generating human-like sentences with the help of machines. However, it must improve repetition, redundancy and lexical problems while generating sentences. Previous studies show that incorporating images with text modality in the abstractive summary may reduce redundancy, but the concentration still needs to lay on the semantics of the sentences. This paper considers adding a topic to a multimodal summary to address semantics and linguistics problems. This stress the need to develop a multimodal summarization system with the topic. Multimodal summarization uses two or more modalities to extract the essential features to increase user satisfaction in generating an abstractive summary. However, the paper’s primary aim is to explore the generation of user preference summaries of a particular topic by proposing a Hybrid Image Text Topic (HITT) to guide the extracted essential information from text and image modalities with the help of topic that addresses semantics and linguistic problems to generate a topic-guided abstractive multimodal summary. Furthermore, a caption-summary order space technique has been introduced in this proposed work to retrieve the relevant image for the generated summary. Finally, the MSMO dataset compares and validates the results with rouge and image precision scores. Besides, we also calculated the model’s loss using sparse categorical cross entropy and showed significant improvement over other state-of-the-art techniques.
  • Recognizing Image Manipulations Utilizing CNN and ELA

    Nallamothu K., Rafi S., Kokkiligadda S., Jany S.M.

    Conference paper, Lecture Notes in Networks and Systems, 2025, DOI Link

    View abstract ⏷

    Tampering of digital photos or images is known as image forgery. The ability to create phony images or information has become easier due to the rapid advancement of technology. In order to detect image forgeries, this paper proposes a model that employs Error Level Analysis (ELA) with Convolutional Neural Networks (CNN). ELA is used as a preprocessing step to highlight regions of an image that may have been tampered with. CNN is then trained on this enhanced data to classify images based on their authenticity and detect digital modifications. This initiative’s main goals include image classification, attribute extraction, image authenticity verification, and digital image modification detection. Our suggested solution makes use of CNNs’ deep learning capabilities and the refinement found by ELA.
  • Multimodal: A Text-Image based Cyber-Bullying Detecting with Deep Learning

    Ankarao A., Rafi S., Eluri R.K., Reddy K.V.N.

    Conference paper, 2025 IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation, IATMSI 2025, 2025, DOI Link

    View abstract ⏷

    The practice of categorizing and identifying cyber-bullying behavior, which include using technology to harass or intimidate people - usually through online platforms - is known as cyberbullying detection. To tackle this, we took a look at a dataset that was made public and labeled as bully or non-bully based on text, image, and image-text. Then, we proposed a deep learning model that could identify cyberbullying in multimodal data. Bullying in text is detected using the XLM-RoBERTa with BiGRU model, while bullying in images is identified by the VGG16 pre-trained model. Using attention processes, CLIP, feedback mechanisms, CentralNet, and other tools, we combined these models (VGG16 + XLM-RoBERTa and BiGRU) and developed a model for identifying cyberbullying in image-text based memes.With a respectable accuracy of 72%, our final model demonstrated that the system is capable of identifying the majority of cyberbullying incidents.
  • Detecting multimodal cyber-bullying behaviour in social-media using deep learning techniques

    MohammedJany S., Killi C.B.R., Rafi S., Rizwana S.

    Article, Journal of Supercomputing, 2025, DOI Link

    View abstract ⏷

    Cyberbullying detection refers to the process of classifying and identifying of cyberbullying behavior—which involves the use of technology to harass, or bullying individuals, typically through online platforms. A growing concern is the spread of bullying memes on social media, which can perpetuate harmful behavior. While much of the existing research focuses on detecting cyberbullying in text-based data, image-based cyberbullying has not received as much attention. This is a significant issue because many social media posts combine images with text, and the visual content can be a key component of cyberbullying. To address this, our research aims to develop a multimodal cyberbullying detection modal (MCB) that is capable of detecting bullying in both images and text. For this, we used VGG16 pretrained model to detect bullying in images and XLM-RoBERTa with BiGRU model to detect bullying in text. Together we integrated these models (VGG16 + XLM-RoBERTa and BiGRU) using attention mechanisms, CLIP, feedback mechanisms, CentralNet, etc., and proposed a model used for detecting cyberbullying in image-text-based memes. Our accomplished model produced a reasonable accuracy of 74%, pointing that the system is effective in recognizing most cyberbullying activity.
  • Multiple Disease Detection using CNN based Model from Chest X-rays

    Seviappan A., Chethan D., Sri P.K., Rafi S., Shahi S.G.

    Conference paper, Proceedings of 3rd International Conference on Sustainable Computing and Data Communication Systems, ICSCDS 2025, 2025, DOI Link

    View abstract ⏷

    Chest X-rays are one of the most widely used diagnostic tools for identifying lung-related diseases such as pneumonia, tuberculosis, and lung cancer. However, manual interpretation of these images can be time-consuming and subject to inconsistencies, especially in high-pressure clinical settings or areas with limited access to radiologists. To address these challenges, this study introduces a deep learning-based system that leverages Convolutional Neural Networks (CNNs) for automatic disease detection from chest X-ray images. The model is trained on a large, diverse dataset and incorporates essential preprocessing steps like histogram equalization to improve image quality and enhance diagnostic accuracy.The CNN-based framework is designed to automatically extract features and classify X-ray images into multiple disease categories. It aims to reduce diagnostic delays and support radiologists by offering fast and consistent evaluations. The system's performance is assessed using standard metrics such as accuracy, sensitivity, specificity, and F1-score, demonstrating its effectiveness as a decision-support tool in clinical workflows. By reducing dependence on manual review, this approach enhances both scalability and reliability in medical imaging diagnostics.Beyond automated image analysis, this paper also explores the integration of a real-time health monitoring solution for elderly individuals using a smartwatch-based system. This wearable device tracks vital signs such as heart rate and physical activity and provides instant alerts to caregivers in the event of abnormal readings. The combined application of AI-powered diagnostics and wearable health tracking presents a dual solution that supports early disease detection and improves continuous patient monitoring - paving the way for more responsive, accessible, and patient-centered healthcare.
  • AI vs Human Text Detector: Identifying AI-Generated Content Using NLP

    Reddy C.R.G.R., Muthukumar D.S., Thogai Rani B., Ganesh N., Rafi S.M., Vamsi P.

    Conference paper, Proceedings of the 2025 3rd International Conference on Inventive Computing and Informatics, ICICI 2025, 2025, DOI Link

    View abstract ⏷

    The evolving capabilities of AI models such as GPT -3 and GPT -4, and Deepseek have rendered it ever more difficult to distinguish between human-written text and AI-generated text. The issue raises serious concerns regarding plagiarism, disinformation, and authorship of electronic content in academic, journalistic, and educational spheres. For this aim, an innovative tool - AI vs Human Text Detector is introduced, it is a web application created to ascertain whether information was authored by a human or by an artificial intelligence model. The system uses Natural Language Processing (NLP) methods to examine prominent linguistic characteristics like perplexity and burstiness that distinguish the homogeneous pattern of AI text from the naturally heterogeneous patterns of human writing. The pre-trained GPT -2 is utilized to quantify textual predictability and variability, thus improving classification accuracy. Visualization of results is facilitated through Matplotlib and Plotly. The software tool is optimized to run on low-cost, commonly available resources, ensuring both accessibility and scalability. The proposed model achieves a high accuracy of 99.2% in detecting AI-generated content, outperforming existing models like ERT, CNN, and BERT-CNN. Future enhancements involve multilingual detection, hybrid detection models. The contribution of this work lies in supporting content integrity and ethical AI use in digital communication.
  • Optimizing English Learning with AI: Machine Learning Techniques and Tools

    Jayaranjan M., Shekhar G.R., Rafi S., Ramesh J.V.N., Kiran A., Vimochana M.

    Conference paper, International Conference on Intelligent Systems and Computational Networks, ICISCN 2025, 2025, DOI Link

    View abstract ⏷

    This research presents a new AI-driven approach to optimizing English language learning with a TF-IDF-based Gated Recurrent Unit model. It provides an effective framework for assessing and improving student writing competency by using advanced text classification approaches. Here, the six criteria evaluated on the basis of the ELLIPSE corpus of essays by grade 8-12 learners include coherence, syntax, vocabulary, phraseology, grammar, and conventions. Extensive preprocessing in terms of tokenization, stop word removal, stemming, and lemmatization, TF-IDF extracts key text features into numerical representations and feed into a GRU model that captures long-term dependencies as well as contextual meaning followed by classification with a dense layer and softmax activation. It has been implemented in Python: The GRU model yields an accuracy of 99.7%, precision at 99.04%, recall at 99.56%, and F1-score of 99.54. The work provides a rigorous methodology for text classification which improves the students' writing skills and propels AI tools in education.
  • Multimodal Multi-objective Grey Wolf Optimisation with SVM and Random Forest as Classifier in Feature Selection

    Das R., Rafi S., Purwar H., Laskar R.H., Rajshekhar A., Chandrawanshi N.

    Conference paper, Lecture Notes in Networks and Systems, 2025, DOI Link

    View abstract ⏷

    A technique called feature selection, often referred as attribute subset selection, selects the optimal subset of features for a given set of data by reducing the dimensionality and eliminating unnecessary characteristics. There can be 2n feasible solutions for a dataset with “n” features that is challenging to address using the conventional attribute selection method. Meta heuristic-based approaches perform better than traditional procedures in such situations. Numerous evolutionary computing techniques have been effectively used in Feature Selection challenges. On the distribution of options in the choice space, some research has been done. Achieving one, however, necessitates advancing the other since many optimisation problems contain two or more competing goals. The multi-objective optimisation technique discussed in this research finds the best effective trade-off between numerous objectives. Multi-objective Programs require multiple non-dominated solutions that could be found as opposite to just one. In the initial stage, we applied the Grey Wolf Optimisation (GWO) to acquire the optimised features. On the basis of the features selected, we trained the classifiers—Support Vector Machine (SVM) and Random Forest (RF) in the second phase. Experiment has been carried out on three benchmark datasets namely Glass, Wine and Breast Cancer Datasets retrieved from the UCI repository to show the supremacy of the proposed technique, the effectiveness of the recommended feature selection approach has been evaluated. The testing results show that the suggested GWO with Random Forest performs better than GWO with SVM.
  • Chronic Kidney Disease Prediction Using Machine Learning and Deep Learning Models

    Rafi S., Revanth N., Reddy K.V.R., Babu K.M., Kumar Y.L.P., Kumar N.V.

    Conference paper, 2025 IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation, IATMSI 2025, 2025, DOI Link

    View abstract ⏷

    Chronic kidney disease is a noticeable health condition that can persist throughout an individual's life, resulting from either kidney malignancy or diminished kidney function. In this work, we investigate how several machine learning techniques might provide an early CKD diagnosis. While previous research has extensively explored this area, our aim is to refine our approach by employing predictive modeling techniques. Initially, we considered 25 variables alongside the class property. The data set used in this study underwent extensive processing, including changing the names of colours for clarity, converting identified colours to numbers, treating unique values with letters handling of partitioned values, fixing incorrect values, filling null values with mean, and encoding categorical values into mathematical notation. In addition, Principal component analysis (PCA) was also employed to lower dimensionality. Our findings demonstrated that the XG Boost classifier surpassed e very other algorithm, with an accuracy of 0.991.
  • Detecting Sarcasm Across Headlines and Text

    Rafi S., Niharika A.L., Neelima S., Nikhitha K., Reddy M.S., Sireesha M.

    Conference paper, 2025 IEEE International Conference on Interdisciplinary Approaches in Technology and Management for Social Innovation, IATMSI 2025, 2025, DOI Link

    View abstract ⏷

    In this era with the rapid growth in social media usage among the current generation, a huge amount of content and comments, most of them sarcastic, is seen. Sarcasm has turned out to be an important part of daily life, especially in news and social media, where sarcastic comments are often used for better attention. However, detecting sarcasm is always challenging because it deals with understanding the difference between what has been said and what is meant. The current paper focuses on the detection of sarcasm in news headlines with the help of deep learning. Previous works were based on a wide range of datasets; however, these had limitations regarding either size or quality. In this respect, the authors propose creating a new dataset of headlines from sarcastic news sites and real news sites that is large and of high quality, hence appropriate for machine learning model training. The authors have also used the CNN-BILSTM architecture for text analysis, identifying sarcasm expression and deciding whether it is sarcastic or not-sarcastic which gained an accuracy of 97%. This dataset is made publicly available to enable further research in this direction.
  • Smartphone Price Patterns Prediction Using Machine Learning Algorithms

    Rafi S., Rambabu Y., Rajasekhar P., Suhas B., Reddy M.S., Moturi S., Doda V.R.

    Conference paper, 6th IEEE International Conference on Recent Advances in Information Technology, RAIT 2025, 2025, DOI Link

    View abstract ⏷

    Selecting the best smartphone can be challenging due to the wide range of models available on the market. This study shows how the machine learning models can predict mobile phone prices based on their features We evaluated several machine learning techniques, including Logistic Regression, Decision Trees, Random Forest, SVC, K-Neighbors Classifier, Gaussian Naive Bayes (GaussianNB), AdaBoost, Gradient Boosting, Extra Trees, Bagging Classifiers, and XGBoost. The primary objective was to identify the most effective model for price forecasting and to investigate the factors influencing phone prices. Our research offers insights to both consumers and manufacturers, helping them make more informed decisions about phone features and pricing. We emphasize the importance of using diverse datasets that accurately represent various smartphone models and pricing points. Key factors affecting phone costs were identified, and model performance was assessed using metrics such as accuracy, F1-score, and classification reports. Model performance was further enhanced through hyperparameter tuning with GridSearchCV, achieving 97% accuracy with the Decision Tree, K-Neighbors Classifier, SVC, AdaBoost, and Random Forest models. Among these, the Decision Tree and SVC was selected as the optimal models, offering a good tradeoff between accuracy, flexibility, and time complexity. This study aims to provide valuable data to guide consumers in making informed choices about mobile phone features and price ranges.
  • SCT: Summary Caption Technique for Retrieving Relevant Images in Alignment with Multimodal Abstractive Summary

    Rafi S., Das R.

    Article, ACM Transactions on Asian and Low-Resource Language Information Processing, 2024, DOI Link

    View abstract ⏷

    This work proposes an efficient Summary Caption Technique that considers the multimodal summary and image captions as input to retrieve the correspondence images from the captions that are highly influential to the multimodal summary. Matching a multimodal summary with an appropriate image is a challenging task in computer vision and natural language processing. Merging in these fields is tedious, though the research community has steadily focused on cross-modal retrieval. These issues include the visual question-answering, matching queries with the images, and semantic relationship matching between two modalities for retrieving the corresponding image. Relevant works consider questions to match the relationship of visual information and object detection and to match the text with visual information and employing structural-level representation to align the images with the text. However, these techniques are primarily focused on retrieving the images to text or for image captioning. But less effort has been spent on retrieving relevant images for the multimodal summary. Hence, our proposed technique extracts and merge features in the Hybrid Image Text layer and captions in the semantic embeddings with word2vec where the contextual features and semantic relationships are compared and matched with each vector between the modalities, with cosine semantic similarity. In cross-modal retrieval, we achieve top five related images and align the relevant images to the multimodal summary that achieves the highest cosine score among the retrieved images. The model has been trained with seq-to-seq modal with 100 epochs, besides reducing the information loss by the sparse categorical cross entropy. Further, experimenting with the multimodal summarization with multimodal output dataset, in cross-modal retrieval, helps to evaluate the quality of image alignment with an image-precision metric that demonstrate the best results.
  • Automatic Attendance Management System Using CNN

    Sreenivasu S.V.N., Rajani C., Rani B.U., Dasaradha A., Rafi S.

    Conference paper, 2024 4th International Conference on Artificial Intelligence and Signal Processing, AISP 2024, 2024, DOI Link

    View abstract ⏷

    Facial recognition technology plays a crucial role in various applications, from enhancing security at banks and organizations to streamlining attendance tracking in public gatherings and educational institutions. Traditional methods of attendance marking, such as signatures, names, and biometrics, can be time-consuming and error-prone. To address these challenges, a smart attendance system is proposed, leveraging Deep Learning, Convolutional Neural Networks (CNN), and the OpenCV library in Python for efficient face detection and recognition. The system utilizes advanced algorithms, including Eigen faces and fisher faces, to recognize faces accurately. While deep learning models excel with large datasets, they may not perform optimally with few samples. By comparing input faces with images in the dataset, the system automatically updates recognized names and timestamps into a CSV file, which is then sent to the respective organization's head. Additionally, the system allows users to upload a single photo or a group photo, and it returns matched photos as output using a CNN. This feature enhances the system's flexibility and usability, providing users with a convenient way.
  • ChronicNet: Randome Forest Classifier-based Chronic Heart Failure Detection with CNN Feature Analysis

    Malleswari D., Vazram B.J., Shaik R.

    Conference paper, Proceedings - 2024 13th IEEE International Conference on Communication Systems and Network Technologies, CSNT 2024, 2024, DOI Link

    View abstract ⏷

    Chronic heart failure (CHF) is a common illness that affects the heart. The conventional machine learning and deep learning algorithms failed to identify CHF in the early stages. So, this work implemented the ChronicNet by combining the properties of both deep learning and machine learning. This study is all about creating a network for finding out CHF from sound recordings of the heart. These are called phonocardiogram data, or PCG. The first step, which is noise removal, signal boosting, and dividing parts, makes sure that heartbeat sounds are of good quality. We use Mel and pitchbased coefficients (MFCC) to analyze the frequency changes in a heartbeat signal. This helps pick out features that show what makes CHF heart disease more special. The convolutional neural network (CNN) feature extraction, using deep learning, helps the MFCC automatically find out special features on its own. The Random Forest classifier (RFC) is used to build a model that can predict CHF faster. In groups with problems to classify, the RFC uses a set of decision trees. This gives benefits such as holding up, fitting to big sizes, and being highly accurate. The proposed system uses CNN features to find CHF from PCG data and correctly identify it using RFC. The simulation results show that the proposed ChronicNet outperformed traditional approaches with 98.84% accuracy.
  • Classification of Music Genre Using Deep Learning Approaches

    Srinivas U.M., Rafi S., Manohar T.V., Rao M.V.

    Conference paper, 2024 4th International Conference on Artificial Intelligence and Signal Processing, AISP 2024, 2024, DOI Link

    View abstract ⏷

    Music genre classification is a pivotal area of research within audio technology, holding immense importance for content organization and recommendation. Audio feature extraction and Music genre classification constitute a complete recognition system. Audio feature analysis and Music genre classification together form an integrated recognition system for comprehensive music genre identification and organization. This technology is frequently utilized to accurately detect and classify various types of music genres or characteristics present in audio signals, contributing significantly to the effective organization and recommendation of music content. Our experiment was conducted with the dataset from GTZAN that is taken from Kaggle repository. Convolutional neural networks (CNN) are employed to train our model, which is subsequently utilized for the classification of music genres in audio signals.
  • Rainfall Prediction Using Machine Learning

    Sreenivasu S.V.N., Rafi S., Lakshmi V.V.A.S., Sivanageswara Rao S., Rajani Ch.

    Conference paper, Proceedings of 2024 2nd International Conference on Recent Trends in Microelectronics, Automation, Computing, and Communications Systems: Exploration and Blend of Emerging Technologies for Future Innovation, ICMACC 2024, 2024, DOI Link

    View abstract ⏷

    The title is 'Rainfall Prediction Using Machine Learning'. The initiative's dataset is written in Python and stored in Microsoft Excel. A wide range of machine learning algorithms are used to discover which strategy generates the best accurate predictions. In many sections of the country, rainfall forecasting is critical for avoiding major natural disasters. This forecast was created using a variety of machine learning approaches, including catboost, xgboost, decision tree, random forest, logistic regression, neural network, and light gbm. It incorporates several components. The Weather Dataset was utilized. The primary goal of the research is to evaluate a variety of algorithms and determine which one performs best. Farmers may greatly profit from growing the appropriate crops based on the amount of water they require.
  • Unveiling Student Success: A Multifaceted Approach with Learning Coefficients and Beyond

    VijayaKumar N., Rafi S., Mahith T., Reddy D.V., Naik K.R., Raju K.

    Conference paper, 2nd IEEE International Conference on Integrated Intelligence and Communication Systems, ICIICS 2024, 2024, DOI Link

    View abstract ⏷

    The student performance is examined in this study using a number of methods of Educational Data Mining (EDM), Clustering and classification techniques are employed to classify the course as well as the performance in the entrance examination. The results obtained show that the Random Forest and XG Boost which are machine learning models outperform traditional methods for predicting student success. Moreover, CNN and LSTM Networks, which are deep learning models, improve prediction accuracy even further. Conducted through metrics like accuracy, precision, recall and F1-score, this study shows that any form of recognition of the pattern, in this case, the early one, helps to reduce failure rates to considerable extents. The results of this study suggest that there is a potential scope for further improving prediction algorithms and management of educational resources, which are of great relevance to the institutions to further the student success.
  • Machine Learning Framework for Women Safety Prediction using Decision Tree

    Sowmika P.S., Rao S.S.N., Rafi S.

    Conference paper, Proceedings - 5th International Conference on Smart Systems and Inventive Technology, ICSSIT 2023, 2023, DOI Link

    View abstract ⏷

    In every city, harassment and violence becomes one of the major problems for women. Further, women's personal life is suffered by the bullying and abusive content presented in Online Social Networking (OSN). Therefore, it is necessary to identify the women safety in OSN environment. When it came to predicting the maximum safety analysis, however, traditional methodologies came up short. This study, then, employs a decision tree (WSP-DT) classifier to make predictions about women's safety. After considering the Twitter dataset for system implementation, it is pre-processed to get rid of the blanks and the unknowns. The tweets were then processed by a natural language toolkit (NLTK) that handled tasks including tokenization, case-conversion, stop-word detection, stemming, and lemmatization. Next, we create a text blob protocol to determine the positive, negative, and neutral polarity of pre-processed tweets. To further extract the data characteristics based on word and character frequency, term frequency-inverse document frequency (TF-IDF) is used. At last, a decision tree classifier was used, based on several rounds of training, to determine if a tweet was phoney or real. Testing on the Twitter dataset demonstrates that the proposed WSP-DT classifier outperforms the competition in simulations.
  • Abstractive Text Summarization Using Multimodal Information

    Rafi S., Das R.

    Conference paper, 2023 10th International Conference on Soft Computing and Machine Intelligence, ISCMI 2023, 2023, DOI Link

    View abstract ⏷

    Much text generates over the internet through news articles, story writing and blogs. Reading and understanding such an enormous amount of data to the user is problematic, including time and effort. Automatic abstractive text summarization has gained more importance to increase the user's understanding and reduce time. It shortens the given input by preserving the meaning and identifying the context of the whole document to generate meaningful sentences. The research community has proposed different methods for text reduction and generating abstractive summaries. However, problems like semantics and contextual relationship in the summary generation process must be still need to improve. The multimodal abstractive text summarization is a technique that combines text and image information which helps in addressing the semantics and contextual relationship by proposing Multimodality Image Text (MIT) layer that fuses the text-extracted global features by glove embedding and preserves the semantics of the vocabulary and text-related images are used to identify the contextual relationship features from inception v3, which cope in the MIT layer to generate efficient multimodal abstractive text summaries by training and testing with seq-to-seq model. Experiments with the MSMO dataset achieve superior performance on other state-of-art results.
  • Detection of Active Attacks Using Ensemble Machine Learning Approach

    Revathy S., Sathya Priya S., Rafi S., Pranideep P., Rajesh D.

    Conference paper, Lecture Notes in Networks and Systems, 2022, DOI Link

    View abstract ⏷

    Cyber attackers entrap online users and companies by stealing their sensitive information without their knowledge. Sensitive information such as login credentials, bank card details, and centralized servers of organizations are hacked by the attackers. Some of the cyber attacks are phishing attack where attackers make the online users to trust their websites as a legitimate website and retrieve their personal information by making them as a prey for cyber attacks. Malware attack is a one where attacker will inject a malicious software into the company server or any online user’s device, without their knowledge and steal all the data in their devices and servers. Intrusion is an invasion, where attacker will attack the network and theft all the network resources. But, there are many types of cyber attacks solutions such as visual similarity-based approaches, intrusion detection system, signature-based, heuristic-based, specification-based, anomaly-based methods that are proposed, but they have some disadvantages. Because of few unsecured HTTP websites and lack of cyber knowledge, cyber attacks are increasing day by day. In our proposed system, a unified ensemble approach (UEA) is proposed by combining different machine learning algorithms using ensemble approach that gives better accuracy and detection rate. This model aims to detect the intrusion, phishing attack and prevent the malwares thereby mitigating the cyber attacks encountered by individual and organization.
  • Sentiment-Based Abstractive Text Summarization Using Attention Oriented LSTM Model

    Debnath D., Das R., Rafi S.

    Conference paper, Smart Innovation, Systems and Technologies, 2022, DOI Link

    View abstract ⏷

    Product reviews are essential as they help customers to make purchase decisions. Often these product reviews are used to be too abundant, lengthy and descriptive. However, the abstractive text summarization (ATS) system can help to build an internal semantic representation of the text with the use of natural language processing to create sentiment-based summaries of the entire reviews. An ATS system is proposed in this work, which is called a many-to-many sequence problem where attention-based long short-term memory (LSTM) is incorporated to generate the summary of the product reviews. The proposed ATS system works in two stages. In the first stage, a data processing module is designed to create the structured representation of the text, where noise and other irrelevant data are also removed. In the second stage, the attention-based long short-term memory (LSTM) model is designed to train, validate and test the system. It is found that the proposed approach can better deal with the rare words, also can generate readable, short and informative summaries. An experimental analysis has been carried out over the Amazon product review dataset, and to validate the result, the ROUGE measure is used. The obtained result reflects the efficacy of the proposed method over other state-of-the-art methods.
  • RNN Encoder and Decoder with Teacher Forcing Attention Mechanism for Abstractive Summarization

    Rafi S., Das R.

    Conference paper, Proceedings of the 2021 IEEE 18th India Council International Conference, INDICON 2021, 2021, DOI Link

    View abstract ⏷

    Automatic text summarization is utilized to address the sustained increasing proportion of text data available in online, to address such numerous data to short data summarization is preferred. In this work, abstractive text summarization is reviewed with Recurrent Neural Network based Long Short Term Memory with encoder and attention decoder. In recent years, this type of summarization has carried out with Recurrent Neural Network which learns from the previous time steps. In this paper, we propose Teacher Forcing Technique to improve the slow convergence and poor performance of Recurrent Neural Network. Our technique improves the performance of text summarization by using Attention Decoder which learns from ground truth instead of learning from previous time steps and minimizes the error rate with Stochastic Gradient Descent optimizer with more accurate results on Wikihow dataset when measured with metric of ROUGE and performed well when compared our result with the state of art results.
  • A Linear Sub-Structure with Co-Variance Shift for Image Captioning

    Rafi S., Das R.

    Conference paper, 2021 8th International Conference on Soft Computing and Machine Intelligence, ISCMI 2021, 2021, DOI Link

    View abstract ⏷

    Automatic description of image has attracted many researchers in the field of computer vision for captioning the image in artificial intelligence which connects with Natural Language Processing. Exact generation of captions to image is necessary but it lacks due to Gradient Diminishing problem, LSTM can overcome this problem by fusing local and global characteristics of image and text that generates sequenced word prediction for accurate image captioning. We consider Flickr 8k data-set which consists of text as descriptions of images. The use of GLoVe embedding helps for the word representation to consider the global and local features of images which finds distance with Euclidean to understand the relationship between words in vector space. Inception V3 architecture which is pretrained on ImageNet used to extract image features of different objects in scenes. We propose Linear Sub-Structure that helps to generate sequenced order of words for captioning by understanding relationship between words. For extracting image features considers co-variance shift which mainly concentrates on moving parts of the image to generate accurate description of the image to maintain a semantic visual grammar relationship between the predicted text for image as the caption, the proposed model evaluated with the help of BLEU score which achieves state of art model in our work while compared with others that has greater than 81% of accuracy.
  • Enhanced biomedical data modeling using unsupervised probabilistic machine learning technique

    Rizwana S., Challa K., Rafi S., Imambi S.S.

    Article, International Journal of Recent Technology and Engineering, 2019,

    View abstract ⏷

    Text mining approaches uses feature similarity techniques or distributed keyword searching techniques. But machine learning techniques develop a statistical model to categorize documents by learning from vast amount of medical documents available at pubmed. It is unsupervised techniques. The proposed algorithm enhances the traditional document clustering techniques.and generate accurate and reliable model. We experimented the algorithm with 1000 document data set It showed the significant improvement over other traditional algorithms.
Contact Details

rafi.s@srmap.edu.in

Scholars