Maintaining road infrastructure is essential to effective transportation systems and public safety. This research provides a new method for pothole depth estimation and automatic road crack detection using computer vision techniques. Our method utilizes convolutional neural networks (CNNs) for classifying road images into ‘With Crack’ or ‘Without Crack’ categories with high accuracy. Additionally, we employ image processing algorithms to detect and highlight cracks, providing insights into their lengths and percentages. Furthermore, we introduce a monocular depth estimation model to assess pothole depths, aiding in prioritizing road repair efforts. Experimental results demonstrate the effectiveness of our approach in accurately identifying road defects and estimating their severity. This research contributes to the advancement of intelligent infrastructure management systems, enabling proactive maintenance and ensuring safer roads for communities.