CHAPTER-1 INTRODUCTION 1.1 Introduction:Nowa days, robots are increasingly being integrated into working tasks to replacehuman beings especially to perform the repetitive task. These robots arecurrently used in many fields of applications including office, military tasks,hospital operations, dangerous environment and agriculture. Besides, it mightbe difficult or dangerous for humans to do some specific tasks like picking upexplosive chemicals, defusing bombs or in worst case scenario to pick and placethe bomb somewhere for containment and for repeated pick and place action inindustries robots can also be used for sorting of colors and in library toplace the books at their right place.
Therefore a robot can be replaced humanto do work. 1.1.2 Sign Language RoboticManipulator:Formaking a sign language robotic manipulator we are proposing a robotic hand andwith each finger of the hand we will be use servo motors for the movement ofthe fingers and hand in a particular way. It will be done with the help of amicrocontroller. We will also be use a bluetooth module for transfer of voicesignals towards the controller for the action of robotic hand. The basicoperation of the robotic hand will be to make a sign of that word which aperson will speak in mic.it is basically for deaf person who cannot hear butcan understand sign language1.
1.3 IndustrialPerspective: Atindustrial level gesture communication or sign language is preferred Our Signlanguage manipulator helps to communicate with deaf persons and those who arehard of hearing .sign language robotic manipulator can also be used forteaching purpose at special schools colleges and universities by a normalteacher who do not even know the sign language. He can communicate through thisrobotic manipulator to deaf students. This robotic manipulator can also be usedfor communication at noisy places of industry to communicate easily just byspeaking in Bluetooth mic. 1.
2 Literature Survey:The term HSI (hearing/speech impaired) or deaf refers tothe person who has disability to hear voices and sounds. The sign language (SL)is one of effective means used by HSI people to communicate with people butunfortunately, the number of people including the HSI people, who are familiarwith sign language is very limited. This is a major hindrance communication. Asevery region has their own language, so there is no universal sign language.
Forexample, Recognizing & interpretingIndian Sign Language gesture for Human Robot Interaction was made forcommunication of human being to robotbut it was in Indian sign language as 1.Tamil alphabets signlanguage translator was also made to communicate easily with the people fromdifferent areas who was not familiar with tamil so it was very impressive workto communicate with sign translator 2. Realtime Indian sign language recognition system to aid deaf-dumb people was madeby indian group of engineers who worked for real time communication through indian sign language3. ANarrow-Band Video Communication System for the Transmission of Sign LanguageOver Ordinary Telephone Lines was made for making the communication moreunderstandable and easy 4. Gesturerecognition project was also done through flex sensor in which a man can traina robot by making different gestures 5.Recognizing complex, parameterized gestures from monocular image sequences 6.Introduction to the Special Issue on Human–Robot Interaction7..
1.2.1Starting Point of Technology: Figure 1. 1: Sign language gestures American Sign Language is, as the name suggests, native to the UnitedStates. It has its linguistic origins in Langue des Signs Français (French SignLanguage). It is a manual language with its own linguistic complexities andrules. The hands, body, and facial expressions are used to communicate withoutusing sound.
American Sign Language is considered to be a creolization ofLangue des Signes Français, not a dialect (Padden et al, 2010). Before 1817 andthe establishment for the first school for the deaf, there were only a fewvague documentations of limited Deaf communities in the United States (Groce,1985). Since the founding of the first school for the deaf those schools havebecome epicenters for socialization and the development of Deaf culture.
Sincedeafness affects people of any race, class, or orientation deafness is foundanywhere, creating a diverse community.1.2.2 Current Status of Technology:Sign language is recognized as the main means ofcommunication between deaf persons and others. There are government measures toencourage media and other forms of public information for making their servicesaccessible to persons with disabilities. Aids for communication are possiblefor people with sensory disabilities. All supplementary equipment needed bydeaf people for their vocational and private life can be subsidized as cantechnical equipment. If a deaf person needs a sign language interpreter foressential business or medical investigation different sign language robots arebeing made for better conversation.
1.3 Problem Statement:Formaking a sign language translator by robotic hand we will make a robotic handand with each figure of the hand are connected with servo motors for themovement of the figures and hand in a particular way. It all will be done withthe help of a microcontroller. We will also use a VR-shield that is a kind ofvoice reorganization shield for Arduino. The basic operation of the robotichand will be to make a sign of that word which a person will speak in a mic.
Itis basically for deaf person who cannot hear but can understand sign language.1.4 Methodology of Project:We are making a robotic hand for deaf persons so that anormal man can easily communicate with disable people. Our hand will consist ofservo motors with each finger .The movement of robotic hand is controlled withArduino. The hand movement is done by sending a voice signal through VR shieldor Bluetooth module .by adjusting the angle of servo motor we can control themovement of each finger of the robotic hand for making particular sign ofAmerican sign language .for example if a person wants to say “A” to the deafperson he will speak out this word “A” in the mic of VR shield or bluetoothmodule the fingers of the robotic hand will make the sign of “A” physically.
1.5 Description of the block diagram: Figure 1. 2: Block DiagramWe are using an android application of bluetooth serialfor sending data through sending end module of bluetooth to the receiving endmodule of bluetooth and our receiving end module is connected with amicrocontroller arduino mega that is connected by a 16 channel servo driver ICto the servo motors .Every servo motor is connected with each finger of therobotic hand that will be operated at specific angles through the microcontroller.The movement of the fingers will be according to the word spoken by the normal personin the bluetooth mic. 1.
6 American Sign Language Symbol Figure 1. 3: American Sign Language Symbols References: 1 Nandy,S.Mondal, J.
S. Prasad, P.Chakraborty & G.
C.Nandi, “Recognizing & interpreting Indian Sign Language gesture forHuman Robot Interaction”, IEEEInternational Conference on Computer and Communication Technology (ICCCT),Page(s): 712-717,2010.2 Jayanthi,P., and K.
K. Thyagharajan. “Tamilalphabets sign language translator.” Advanced Computing(ICoAC), 2013 Fifth International Conference on.
IEEE, 2013. 3 P.Subha Rajam, G. Balakrishnan, “Real time Indian sign languagerecognition system to aid deaf-dumb people”, IEEE International Conference on Computing Communication and NetworkingTechnologies (ICCCNT), Page(s): 1-9, Trichy, India, 2010.4 J.F.
Abramatic, P. Letellier, and M. Nadler,”A Narrow-Band Video Communication System for the Transmission of SignLanguage Over Ordinary Telephone Lines,” Image Sequences Processing and Dynamic Scene Analysis, T.S. Huang, ed.,pp.
314-336.Berlin and Heidelberg: Springer-Verlag, 20.5 S.Mitra, “Gecture recognition”, IEEE Transactions on Systems, Man, and Cybernetics- Part C: Applications and Reviews, vol. 37, N.
3, May 2007, p311-324. 6 Axenbeck, T.,Bennewitz, M., Behnke, S., & Burgard, W.
(2008)”Recognizing complex, parameterized gestures from monocular imagesequences”, IEEE-RAS international conference on humanoid robots(Humanoids’08), Daejeon, SouthKorea, December 2008. 7 J. A.
Adams , M. Skubic, “Introduction to the Special Issue on Human–Robot Interaction”, IEEE Transactions on Systems, Man, andCybernetics, Part A: Systems and Humans, v.35 n.4, p.433-437, July2005