ProfessionResearchCase-Study
April 19, 2024
zenodo.org
Project Research
Status: Published

VOICE CONTROLLED ROBOT WITH COMPUTER VISION AND ROBOTIC ARM

The proposed project aims to create a sophisticated Voice-Controlled Robot with Computer Vision and Robotic Arm, using the latest technologies in voice recognition, computer vision, and robotics. It uses computer vision to detect an object, ultrasonic sensor to find the distance and robotic arm to pick up that object. The main goal is to build a versatile and user-friendly robot that can understand spoken commands through speech to text conversion, move around independently using computer vision, and perform complex tasks accurately using its robotic arm. This combination of smart features aims to provide a smooth and flexible robot that can be used in different areas based on user requirements.


Background
---------------------------
The development of intelligent and interactive robotic systems has been making
possible considerable breakthroughs in the field of robotics, artificial intelligence and
computer vision in this era. An innovative integration of voice recognition, computer
vision, and robotics technology, this proposal describes a project to build and
implement a voice-controlled robot with a computer vision-based robotic arm. The
goal of the project is to develop a flexible and user-friendly robotic system that can
interact with things in its environment using a robotic arm, comprehend spoken
commands, and see its environment through computer vision

Motivation
---------------------------
The goal of this project is to build a smart robot capable of handling activities with
little assistance from humans and interacting with users in a straightforward and
natural manner. The robot can comprehend user instructions and analyzes visual clues
by support of combination of voice control and computer vision, enabling a smooth
and effective interaction between humans and robots. A robot with this much
versatility might be used in a wide range of fields, including healthcare, education, and
industrial automation, as well as home and office automation.

Problem Statement
---------------------------
The problem statement proposes the development of an innovative Voice-Controlled
Robot with a Computer Vision-Based Robotic Arm. The primary aim is to overcome
the limitations of conventional robotics by creating a user-friendly system that can be
controlled using natural language voice commands. By integrating computer vision
technology, the robot will have enhanced spatial awareness and object recognition
capabilities, enabling it to perform tasks with higher precision. The project seeks to
revolutionize human-robot interaction and open up possibilities for various
applications in manufacturing, healthcare, household assistance, and more.

For extensive detail, go to Published Site or Related Important Files section:

Published Site

Conclusion & Result

Through the integration of voice recognition, computer vision, and robotic manipulation technologies, this project enables the creation of a versatile and interactive robotic system capable of performing various tasks and responding to user commands. In summary, the voice-controlled robot with a computer vision-based robotic arm project serves as a compelling platform for innovation, learning, and exploration in the exciting field of robotics and artificial intelligence. Through creativity, dedication, and a spirit of inquiry, we can unlock new possibilities and shape the future of human-robot interaction.

Authors

  • Er. Mahesh Bogati (Project Lead)

    Tribhuvan University

    076bei018@ioepc.edu.np

    Personal-Website

  • Er. Sangram Bhandari (Project Manager)

    Tribhuvan University

    076bei030@ioepc.edu.np

  • Er. Sarthak Chaudary (Project Member)

    Tribhuvan University

    076bei034@ioepc.edu.np

  • Ankita Rai Khaling (Project Member)

    Tribhuvan University

    075bei005@ioepc.edu.np

Related Important Files

1. VOICE CONTROLLED ROBOT WITH COMPUTER VISION AND ROBOTIC ARM PAPER.pdf

About file: Project Detailed Final Submitted Report at Defense

Technologies & Tags

PythonRaspberry Pi OS(Raspbian)CameraVNC ViewerElectronics Devices
ElectronicsCommunicationRoboticsInverse KinematicsReinforcement LearningDeep Learning

Code Repository

voice-controlled-robot-with-computer-vision-and-robotic-arm.github

Citations & References

  • REFERENCE :- S. Yuvaraj, A. Badholia, P. William, K. Vengatesan, and R. Bibave, “Speech recognition based robotic arm writing,” in Proceedings of International Conference on Communication and Artificial Intelligence: ICCAI 2021. Springer, 2022, pp. 23-33.

  • REFERENCE :- B. S. Babu, V. Priyadharshini, and P. Patel, “Review of voice controlled robotic arm-raspberry pi,” European Journal of Electrical Engineering and Computer Science, vol. 5, no. 2, pp. 1–4, 2021.

  • REFERENCE :- M. Abdullah-Al-Noman, A. N. Eva, T. B. Yeahyea, and R. Khan, “Computer vision-based robotic arm for object color, shape, and size detection,” Journal of Robotics and Control (JRC), vol. 3, no. 2, pp. 180–186, 2022.

  • REFERENCE :- J. I.-Z. Chen and J.-T. Chang, “Applying a 6-axis mechanical arm combine with computer vision to the research of object recognition in plane inspection,” Journal of Artificial Intelligence and Capsule Networks, vol. 2, no. 2, pp. 77–99, 2020.

  • REFERENCE :- P. Kanade, P. Alva, S. Kanade, and S. Ghatwal, “Automated robot arm using ultrasonic sensor in assembly line,” International Research Journal of Engineering and Technology (IRJET), vol. 7, no. 12, pp. 615–620, 2020.

External Links and Works

Gallery

Complete_VCR_Robot_Model.jpeg
Figure: Rover Robot Model
Complete_VCR_Robot_Model2.jpeg
Figure: Rover Robot Model
Object_Detection_Matchbox.jpeg
Figure: test & train of Object Identification model of shuttle and matchbox
Object_Detection_Shuttle.jpeg
Figure: test & train of Object Identification model of shuttle and matchbox
Mahesh_Bogati_suprised_by_VCR_accomplishment.jpeg
Figure: Er.Mahesh Bogati suprised After The Project Accomplishment
Sangram_Bandari_on_Left_and_Mahesh_Bogati_on_Right_with_VCR_Robot.jpeg
Figure: Er.Mahesh Bogati on Right and Er.Sangram Bhandari on Left with VCR Robot on his hands

Engineering Since 2019

Life will not be cool always, so you have to be cool.