Home and industrial intelligent automation systems are now possible as a result of the rapid advancement in artificial intelligence (AI) and robotics. A design and implementation of an AI-controlled robot arm that automatically recognizes, classifies, and sorts objects by their colors are discussed in this paper. The system uses a camera and OpenCV for grabbing live video streams and HSV thresholding to recognize the colors of the objects. An Arduino microcontroller receives detected color information, decodes command, and employs an L293D motor driver to drive movements of robotic arm. Pick-and-place actions are performed by robotic arm, which precisely sorts objects with color into bins based on pre-defined color classes. Furthermore, an Internet of Things module is implemented to achieve remote monitoring and control and facilitate users to start, stop, and rewind processes remotely using a smartphone or web interface. The proposed system is suitable for installation in computerized shops, manufacturing industries, and intelligent waste disposal because it has greater object identification and sorting accuracy and provides remote access. The system’s efficiency and real-time flexibility is validated by experimental results.