KR100917796B1 - Robot Mount Type Emergency Rescue Communication Apparatus and Emergency Rescue Communication System Using the Same - Google Patents

Abstract

The present invention provides a shortcut key corresponding to a predetermined counterpart contact, a shortcut key input means for performing one-key operation of a shortcut key for making a call connection with a predetermined counterpart contact for rescue communication, and a voice call for a call with the counterpart contact. Call input / output means for inputting and outputting a spoken voice, a call signal processing means for performing call signal processing of a call voice and a sign language voice for a call with a counterpart contact, and connecting to a communication network for rescue communication Network communication means for transmitting and receiving data for the call of the call and the transmission and reception of the call signal, mounted on the device and connected to the other party's contact by the shortcut key input means to operate in conjunction with the call progress state during the call progress Robot to perform a drive for operating the robot The controller generates an information signal for a call connection with a predetermined counterpart contact by a robot driving means and a one-key operation of the shortcut key input unit, and controls transmission and reception of a call signal through the network communication means. And controlling means for driving control of the robot driving means to interoperate the robot according to the call progress state.

Description

Robot mounted communication device and communication system using same {Robot Mount Type Emergency Rescue Communication Apparatus and Emergency Rescue Communication System Using the Same}

The present invention relates to a robot-mounted communication device and a communication system using the same to enable rescue communication using a voice / video call function and a robot operation through a communication network.

In general, a wired telephone network system that allows voice calls between wired telephones through a wired telephone network has been used as a main communication means. In recent years, wireless base stations have been distributed from a wide range of wired telephone network systems. A mobile communication network system capable of making a voice call wirelessly between mobile communication terminals capable of making a phone call while being mobile and allowing a user to carry the mobile communication network has been developed and commercialized.

In addition, recently, an internet call function has been developed and used to allow a voice call to be carried out by exchanging voice packets using a voice over internet protocol (VoIP) call. By using a computer terminal equipped with a function application for a telephone or an Internet telephone provided exclusively for an internet call, a voice call can be made with a computer terminal, an internet telephone, a landline telephone, or a mobile communication terminal on the other side.

On the other hand, in recent years, with the help of advanced medicine, the longevity of people can be extended, and the aging population is accelerating worldwide, and the aging population is not only becoming a general social phenomenon, but also the majority of the middle class. In the case of the following families, couples are earnestly working for the household economy, and the time for parents to take care of their children is gradually decreasing according to the couples' earnests.

Therefore, elderly people living alone or children who spend a lot of time alone without parents have a high possibility of theft and robbery due to outsider intrusions, and they are incapable of responding quickly to accidents in the house such as fire or gas leaks. Not only is it unprotected at constant risk, but especially in older people, there is a high possibility of aggravation of the disease caused by old age, and even worse, they can die without proper contact with their children.

As a result, when an accident situation or danger occurs to an elderly person who spends a lot of time alone without a parent or a parent using a wired telephone network system, a mobile communication network system, or an Internet telephone function, an appropriate guardian or related person There is an urgent need for the development of more effective communication systems that allow for rapid contact with institutions.

Accordingly, the present invention has been made in view of the above-described conventional circumstances, and an object thereof is to enable a related key contact previously designated by a shortcut key function to be called by one-key operation, and more efficient communication can be performed using the operation of the mounted robot. It is to provide a robot-mounted communication device and a communication system using the same.

Another object of the present invention is to provide a robot-mounted communication device and a communication system using the same, which enables the robot to be operated by motion data synchronized with the multimedia data, as well as the multimedia data provided from a remote party. It is.

Still another object of the present invention is to provide an abnormality detection sensor for detecting an abnormality of the living space, when detecting the abnormal state of the surroundings by the abnormality detection sensor to automatically connect the call to the contact associated with the detected abnormal state An on-board communication device and a communication system using the same are provided.

According to the device of the present invention for achieving the above object, and having a shortcut key corresponding to a predetermined counterpart contact, the shortcut key input means for performing a one-key operation of the shortcut key for making a call connection with the counterpart contact specified in advance for rescue communication; Call input / output means for inputting a spoken voice and outputting a spoken voice for a call with a contact of the other party, a call signal processing means for performing a call signal processing of a talk voice and a sign language for a call with a contact of the other party Network communication means for connecting to the communication network for transmitting and receiving data and call signal for the call with the other party's contact, mounted on the device and connected to the other party's contact by the hot key input means when the call is in progress Robot that works in conjunction with the call progress A robot driving means for driving the robot and generating an information signal for a call connection with a predetermined counterpart contact by a one-key operation of the shortcut key input means to transmit and receive a call signal through the network communication means; The control unit to control the progression, and provides a robot-mounted communication device comprising a control means for controlling the driving of the robot drive means for interlocking operation of the robot according to the call progress state with the other contact. .

In order to achieve the above object, according to the system of the present invention, a shortcut key corresponding to a predetermined counterpart contact is provided, and one-key operation of a shortcut key for accessing a call with a predetermined counterpart contact for rescue communication is performed. The robot-mounted communication device which performs a voice call and interoperates the mounted robot according to the call progress state with the other party, and a shortcut key according to the one-key operation of the shortcut key for rescue communication from the robot-mounted communication device. The communication management server for making a voice call by making a call connection with a corresponding counterpart contact, and the robot-mounted communication device being connected by a call through the relay of the communication management server by a shortcut key operation of the robot-mounted communication device. Communication terminal on the other party's contact It provides a communication system using a robot-mounted communication apparatus, characterized in that configured to include.

As described above, according to the present invention, when the user is faced with an emergency situation, there is provided a communication device capable of conducting a voice call with a desired counterpart via an internet network by one-key operation of a preset shortcut key, and the video camera in the communication device. Equipped with a robot attached to the robot, it is possible to quickly cope with the emergency situation that can occur to the elderly who live alone or without a parent, a child who has to spend a lot of time alone, and can prevent large accidents in advance. Applied at the time of a voice call for rescue communication has an effect that can be used more efficiently rescue rescue, which is bound to only have a voice call.

Further, in the present invention, by providing the robot with a communication device to the motion data having the music data and motion information synchronized with the music data to enable the operation of the robot synchronized with the music output, the communication device as a play tool As it can be used as a combined, it has the effect of providing great convenience to the user.

In addition, in the present invention, when the abnormal state is detected from the abnormality sensor by applying an abnormality detection sensor to the robot-mounted communication device to detect the various abnormal state of the space in which the user lives, the relevant organ corresponding to the type of occurrence of the abnormality By enabling the notification of the occurrence, it is possible to quickly respond to an emergency situation that the user of the communication device is not expected.

Hereinafter, the present invention configured as described above will be described in detail with reference to the accompanying drawings.

1 is a view showing the overall appearance of the robot-mounted communication device according to the present invention.

As shown in FIG. 1, in the robot-mounted communication device 2 according to the present invention, a human-shaped robot is mounted on a main body of the device, and the robot is fixed to the main body 6. The robot head 4 is coupled to the robot, and the robot right arm 8 and the robot left arm 10 are coupled to both sides of the body 6, respectively.

The robot head 4, the robot right arm 8, and the robot left arm 10 may be freely manipulated in an up / down direction or left and right directions according to driving control of independent motors, respectively.

The image camera 12 is mounted at the front position of the robot head 4, so that the robot head 4 can photograph the sharp position which the robot head 4 rotates in the up / down direction or the left / right direction.

In addition, the body of the robot-mounted communication device 2 is provided with right and left speakers 14 and 16 on both sides, respectively, and right and left microphones 18 and 20 on both front ends of the body, respectively. have.

In addition, the front of the body is provided with a plurality of key buttons that can be manipulated by the user, the plurality of key buttons are a plurality of shortcut buttons 22, which can be called by the one-key operation to pre-specified related contacts 24, 26, 28, 30, the volume key button 32 for adjusting the volume of the speaker 14, 16 during the telephone call or voice output of music data, the input of the other party's telephone number and various functions 10-key button 34 having a number key and a special key for operation, a call key button 36 for operating a button for initiating a call with the other party, and a call-end key button for operating a button for terminating a call state (38) ).

The plurality of shortcut keys 22, 24, 26, 28, and 30 may be called by a guardian call shortcut button 22 which is operated to call a contact of a predetermined guardian, and may be called to call a contact of a predetermined friend. Friend call hotkey button 24, hospital call hotkey button 26, which is operated to call a predetermined hospital contact, police station call hotkey button 28, which is operated to call a contact of a predetermined police station, predefined It is composed of a fire station call hotkey button 30 which is operated to call the contacts of the fire station.

Next, Fig. 2 is a diagram showing the overall configuration of a communication system using the robot-mounted communication device according to the present invention.

As shown in FIG. 2, the communication system using the robot-mounted communication device includes a robot-mounted communication device 2, an internet network, a communication management server 40, an information database 42, and an internet phone 44. ), A computer terminal 46, a wired telephone network, a wired telephone 48, a mobile communication network, and a mobile communication terminal 50.

The communication management server 40 relays a call connection with the counterpart contact designated by the inputted shortcut key by inputting a shortcut key for the counterpart call from the robot-mounted communication device 2 and the communication device 2. A telephone call with the counterpart party is made, and control information for controlling the operation of the robot mounted in the robot-mounted communication device 2 is generated by remote control from the counterpart related party computer terminal.

Meanwhile, in FIG. 2, the communication management server 40 manages one robot-mounted communication device 2 for convenience of description. However, the communication management server 40 substantially manages a plurality of robot-mounted communication devices 2. It is supposed to be managed.

The information database 42 stores contact information of a counterpart designated in advance for a shortcut key of the robot-mounted communication device 2 managed by the communication management server 40.

The Internet phone 44 is an Internet phone dedicated terminal for making an internet call by connecting a VoIP call to the other party through an internet network, which is the robot-mounted communication by the relay of the communication management server 40. An internet voice call is conducted with the device 2.

The computer terminal 46 is equipped with a dedicated software application or dedicated hardware for the Internet phone, it is possible to proceed with the Internet call by the VoIP call connection with the other party through the Internet network, which is the communication management server 40 Internet voice call is carried out with the robot-mounted communication device 2 by relaying, and image is taken from the video camera 12 of the robot-mounted communication device 2 by video communication simultaneously with the Internet voice call. The surrounding image is displayed on the monitor screen.

The computer terminal 46 is equipped with a control application for remote control of the robot, and by the operation of the control application, the up / down direction or the left / right with respect to the robot head 4 of the robot-mounted communication device 2 By remotely controlling the rotation operation in the right direction, it is possible to arbitrarily adjust the photographing position of the image camera 12 installed in the robot head 4.

The wired telephone 48 is for carrying out a voice call with a counterpart via a wired telephone network in a wired manner, which performs a voice call with the robot-mounted communication device 2 by relaying the communication management server 40. .

The mobile communication terminal 50 is for wirelessly communicating with the other party through a mobile communication network, which is a wireless communication with the robot-mounted communication device 2 by a relay of the communication management server 40. Perform

Meanwhile, as shown in FIG. 3, the robot-mounted communication device 2 includes an image camera 12, right and left speakers 14 and 16, right and left microphones 18 and 20, and a shortcut key input unit ( 60, a key input unit 62, an image signal input unit 64, a digital signal processor (DSP) 66, a network communication module 68, a power amplification unit 70, and a signal amplification unit 72. , Program memory 74, data memory 76, control unit 78, motor drive unit 80, first to fourth motors 82, 84, 86, 88, upper and lower drive mechanisms 90, head left and right The driving mechanism 92, the right arm driving mechanism 94, the left arm driving mechanism 96, and the voice tracking unit 98 are configured.

The shortcut input unit 60 is the guardian call hot key button 22, the friend call hot key button 24, the hospital call hot key button 26, the police station call hot key button 28, the fire department call hot key shown in FIG. Button 30.

The key input unit 62 includes the volume key button 32 shown in FIG. 1, a 10-key button 34, a call key button 36, and a call end key button 38.

The video signal input unit 64 receives a video signal photographed from the video camera 12 and preprocesses the video signal to be output to the digital signal processor 66.

The digital signal processor 66 digitally processes the video signal from the video camera 12 through the video signal input unit 64 and outputs the digital signal to the network communication module 68, and from the network communication module 68. Processing the received voice data according to the Internet call of the voice signal and outputting to the power amplifier 70, and processing the digital voice signal of the transmitted voice signal according to the Internet call input from each of the microphones 18 and 20 Output to the network communication module 68.

The network communication module 68 accesses the communication management server 40 through an internet network, transmits code data according to a shortcut button operation, and receives a received voice packet from the other party according to an internet call by a VoIP call connection. In addition to receiving, the voice signal transmitted from the digital signal processor 66 is transmitted to the Internet as a voice packet.

The power amplifier 70 amplifies a sign language voice signal from a counterpart processed by the digital signal processor 66 to output a voice through the speakers 14 and 16.

The signal amplifier 72 amplifies a voice signal of a voice input from each of the microphones 18 and 20 and outputs the amplified voice signal to the digital signal processor 66.

The program memory 74 stores a system operation program of the corresponding communication device, a drive control program for controlling the drive of the motor, and guidement data for own voice guidance of the corresponding communication device. The data memory 76 Stores state data generated according to the operation of the communication device.

The controller 78 transmits code data according to a shortcut key input from the shortcut key input unit 60 to the communication management server 40 so that a voice call can be made with the counterpart contact designated by the shortcut key, and the counterpart computer terminal 46 When the arbitrary operation command of the robot by the remote operation is received, the motor driving unit 80 is controlled so that the first and second motors 82 and 84 may move the head up and down driving mechanism 90 and the head left and right driving mechanism ( 92).

In addition, when the other side of the voice call is the computer terminal 46, the controller 78 operates the video camera 12 under the control of the communication management server 40 to take a picture of the surrounding image. It can be transmitted to the computer terminal 46 via the Internet network.

The motor driver 80 performs motor driving for individually operating the first to fourth motors 82, 84, 86, and 88, respectively, under the control of the controller 78.

The first motor 82 is to operate the robot head 4 in the up / down direction by operating the head up and down driving mechanism 90 in accordance with the drive of the motor driving unit 80.

The second motor 84 is to operate the robot head 4 in the left / right direction by operating the left and right driving mechanisms 92 in accordance with the driving of the motor driver 80.

The third motor 86 operates the right arm driving mechanism 94 according to the driving of the motor driving unit 80 to operate the robot right arm 8 in the up / down direction.

The fourth motor 88 is for operating the robot left arm 10 in the up / down direction by operating the left arm drive mechanism 96 in accordance with the driving of the motor driver 80.

Here, the head up and down driving mechanism 90, the head left and right driving mechanism 92, the right arm driving mechanism 94 and the left arm driving mechanism 96 are the up / down movement and the left / right direction of the robot head 4, respectively. To perform a mechanical operation for the operation, the up / down direction of the right arm 8, the up / down direction of the left arm 10, which may be applied to any mechanical mechanism generally used.

On the other hand, the shortcut key input unit 60, as shown in Figure 4, each guardian call shortcut button 22, friend call shortcut button 24, hospital call shortcut button 26, police station call shortcut button 26 When the fire station call hot key button 28 is operated by a user, the network communication module 68 generates hot key code data corresponding to each hot key button and phone unique identification code data of the corresponding communication device from the control unit 78. Through the communication management server 40 to be transmitted.

Here, the shortcut code data set corresponding to each shortcut button is to set a unique shortcut code for each shortcut button when registering the corresponding robot-mounted communication device 2 to the communication management server 40. Preferably, in the case of a guardian, a friend, a contact of a hospital designated by the shortcut key, a user of the communication device 2 or a guardian of the user may be set arbitrarily, but in the case of a police station and a fire station, the communication management The server 40 sets itself.

When the communication management server 40 receives a shortcut code and a phone unique identification code transmitted from the robot-mounted communication device 2 according to a button operation of the shortcut button, the communication management server 40 is registered in advance by the phone unique identification code. The information of the communication device is extracted from the information database 42, and the information of the contact information to be called in the communication device is obtained by the shortcut code, and the contact information (e.g., guardian internet phone or friend mobile communication terminal, hospital computer terminal, police station wired) A call connection is attempted with a telephone and a fire station computer terminal), and a voice call is made between the robot-mounted communication device 2 and the contact.

On the other hand, in the present invention, the other party's contact corresponding to the shortcut button, i.e., guardian, friend, hospital, police station, fire department, etc. can be set in the communication management server 40, the robot-mounted communication device (2) in the shortcut key code and Although it is possible to generate a unique identification code for the telephone, the information of the other party's contact information corresponding to the shortcut key is not limited thereto, and may be stored and managed in the data memory 76 of the robot-mounted communication device 2. It is also possible to make a direct call from the communication device 2 by performing a call connection to a predetermined counterpart contact in response to the shortcut key when the one-key operation of the shortcut key button is performed without the relay of the communication management server 40. It is possible.

Next, FIG. 5 is a diagram showing the configuration of the computer terminal for adjusting the position of the video camera by remotely controlling the robot of the robot-mounted communication device in the remote computer terminal.

As shown in FIG. 5, the computer terminal 46 includes a network communication module 100, a microprocessor 102, a voice signal processor 104, a speaker 106, a microphone 108, and a video signal processor ( 110, a display monitor 112, and a key input unit 114.

The network communication module 100 receives web page data through an internet network or transmits / receives voice packet data according to a VoIP call connection, and the video camera 12 of the counterpart communication device 2 according to the progress of video communication. In addition to receiving the image data photographed from the), the robot operation command from the computer terminal 46 is transmitted.

The microprocessor 102 makes an Internet voice call through voice packet transmission and reception of the network communication module 100 according to execution of an application program for Internet telephony, and the robot-mounted communication by driving an application program for image communication. The video signal is requested to the device 2, and the video signal processor 110 is controlled so that the video data photographed from the communication device 2 is displayed on the video communication interface screen of the display monitor 112.

In addition, the microprocessor 102 up / down / bottoms the robot head 4 of the robot-mounted communication device 2 in response to a user operation of the key input unit 114 by executing a robot manipulation application program. Generate a robot operation command to operate in the left / right direction.

The voice signal processor 104 performs voice signal processing for outputting a voice signal from the other party through the speaker 106 as the internet voice call with the robot-mounted communication device 2 proceeds, and the microphone ( 108 processes the voice signal input from the voice signal and outputs the voice signal to the network communication module 100.

The image signal processing unit 110 processes an image signal from the robot-mounted communication device 2 received through the network communication module 100 and displays an image screen on an image communication interface screen on the display monitor 112. Be sure to

The key input unit 114 is formed of a computer keyboard, and generates a key input signal for operation in the up / down / left / right directions by user manipulation of the four-way key 114a.

In FIG. 5, the control unit 78 of the robot-mounted communication device 2 performs the Internet voice call through the VoIP call with the computer terminal 46 through the Internet network. When the four-way key 114a is operated by the user and a robot operation command is received, the first motor 82 drives the head up and down driving mechanism 90 by driving control of the motor driver 80 according to the robot operation command. Or the second motor 84 operates the head left and right driving mechanism 92 so that the robot head 4 can be operated in the up / down direction or the left / right direction.

When the robot head 4 is operated in the up / down direction or the left / right direction, the photographing position of the image camera 12 to which the robot head 4 is attached is changed so that the user of the computer terminal 46 You can take a picture of the desired surrounding location.

Here, although the present invention has been described that the remote control of the robot for the image communication is performed only in the computer terminal 46, but not limited to this, the mobile communication terminal 50 having an image capturing function through an image camera and an internet web browsing function. Through the user's manipulation through the keypad to enable the remote control of the robot. However, in the mobile communication terminal 50, an application program for image communication and an application program for remote control of a robot should be mounted.

On the other hand, the controller 78 is a direction in which sound is generated in accordance with the detection of the sound generation direction input through the right microphone 18 and the left microphone 20 by the voice tracking processing of the voice tracking unit 98. By controlling the driving of the motor so that the robot can operate in response.

That is, as shown in FIG. 6A, when the user generates a popularity chuck at a position close to the right microphone 18 of the robot-mounted communication device 2, the voice tracking unit 98 uses the right microphone 18. And comparing input times of the voice signals input from the left microphone 20 to track the direction in which the sound is generated, and provide the voice tracking signal according to the result to the controller 78.

The controller 78 determines that the user is in a position close to the right microphone 18 by the voice tracking signal from the voice tracking unit 98, thereby controlling the motor driver 80 to control the motor driver 80. The second motor 84 drives the head left and right driving mechanism 92 so that the robot head 4 can be rotated to the user's position, and the third and fourth motors 86 and 88 are right arms. The driving mechanism 94 and the left arm driving mechanism 96 are driven so that the robot right arm 8 and the left arm 10 are repeatedly operated in the up / down direction, and the voice signal of the preset announcement is applied to each speaker 14, 16) to output audio.

Accordingly, as shown in FIG. 6B, the robot head 4 mounted on the robot-mounted communication device 2 is rotated to the installation position side of the right microphone 18, while the right arm 8 and the left arm 10 are rotated. ) Repeatedly in the up / down direction.

Next, another embodiment of the present invention will be described in detail with reference to the accompanying drawings.

That is, Figure 7 is a robot-mounted communication device according to another preferred embodiment of the present invention receives music data and motion data synchronized with the music data from a remote computer terminal in operation of the robot synchronized with the music output music It is a figure which shows the state in which control is performed.

As shown in FIG. 7, in another embodiment of the present invention, when the robot-mounted communication device 2 presents and transmits motion data including predetermined music data and motion information synchronized with the music data, the robot-mounted communication device 2 is remotely present. In addition to voice outputting the music data received from the robot-mounted communication device 2, the robot head 4, the right arm 8, and the left arm 10 are operated in accordance with movement data synchronized with the music data. By doing so, the robot mounted on the communication device 2 shows an effect of being operated in accordance with music.

In FIG. 7, the computer terminal 46 accesses the communication management server 40 through the Internet network to select music to be provided to the robot-mounted communication device 2.

Here, the information database 42 holds various genres and vast amounts of music data selectable by the computer terminal 46, and holds motion data in which motion information is written to be synchronized with each music data.

The communication management server 40 provides a music inquiry list, which can inquire music data of the information database 42, to the computer terminal 46 in the form of an Internet web page, and supplies the computer terminal 46 to the computer terminal 46. When the specific music is selected by the music data and motion data according to the music is transmitted to the robot-mounted communication device (2).

In the robot-mounted communication device 2, the music data received from the computer terminal 46 through the communication management server 40 is reproduced by the voice signal processing of the digital signal processing unit 66 and the speakers 14, 16 Voice output through).

In addition, the control unit 78 of the robot-mounted communication device 2 analyzes the motion information included in the motion data provided with the music data to operate the motor driver 80 according to the motion synchronized with the music. By controlling the driving, the first to fourth motors 82, 84, 86 and 88 are driven to rotate the robot head 4 in the up / down direction or the left / right direction, or the right arm 8 and the left arm. The 10 is operated in the up / down direction.

That is, as shown in FIG. 8, the motion data is provided in the form of text data encoded with the motion information of the robot. For example, the motion data is assigned to the robot by giving a start tag such as "[robotff]". It indicates that the code information for controlling the movement is included, and for example, a time tag such as "[00:05:11]" is assigned to each movement code to indicate the reproduction time of the music data synchronized with the movement. Each time tag is assigned a motion code value that defines the robot's movement.

In FIG. 8, the motion code value may be set by way of example, and the motion code value is merely an example to easily describe motion data synchronized with sound data, and any other type of motion code value may be used. Applicable

In the motion code value, for example, "hdlr_laud" repeatedly rotates the robot head (hd) in the left / right direction (Left / Right; lr) and rotates the left arm (la) in the up / down direction ( Up / Down; ud) indicates a command to repeatedly operate, for example, " hdud # 2_hdlr3 " operates the robot head hd twice in the up / down direction ud and the robot head hd right and left. An instruction to operate three times in the direction lr is shown.

On the other hand, the robot-mounted communication device 2 utilizes the call key button 36 of the key input unit 62 as a play key button when playing the music data provided from the communication management server 40. In the case where there are a plurality of provided music data, a number is assigned to each music by the 10-key button 34 of the key input unit 62, and the corresponding music data is selected by selecting the assigned number. To be regenerated.

In addition, in order to assign a number to the plurality of pieces of music data through the 10-key button 34, and to select the assigned number, the display unit 140 shown in FIG. It is preferable to allow the user to visually determine the selection and reproduction state of the music data by enabling the screen display of the selected music number.

Next, another embodiment of the present invention will be described in detail with reference to the accompanying drawings.

That is, FIG. 9 is a diagram illustrating a configuration of a communication system in which an abnormality detection sensor is mounted in a robot-mounted communication device according to another embodiment of the present invention.

As shown in FIG. 9, in another embodiment of the present invention, the robot-mounted communication device 2 includes an abnormality detection sensor for detecting various abnormalities around a location where the corresponding communication device is installed. When an abnormality is detected around the communication device 2 by the built-in abnormality detection sensor, the communication management server 40 is automatically connected to notify the engine related to the abnormality of the occurrence of the abnormality. By transmitting a peripheral image taken from the image camera 12 of the communication device 2 by the remote control to the relevant organs so that the abnormal situation can be identified.

In FIG. 9, the robot-mounted communication device 2 is an abnormality detection sensor for detecting various abnormal conditions of the surroundings, and includes a gas detection sensor 120 that detects leakage of household city gas, and a fire caused by a fire in a room. A heat sensor 122 for detecting high heat, a smoke sensor 124 for detecting smoke generated by a fire in the room, and an intrusion sensor 126 for detecting an intruder intrusion into the room are built in.

Here, the robot-mounted communication device 2 is described that only the gas sensor 120, the heat sensor 122, the smoke sensor 124, the intrusion detection sensor 126 is built, The present invention is not limited thereto, and any abnormality detection sensor may be applied to detect an abnormal situation that may occur variously at a location where the communication device 2 is installed.

When the controller 78 of the robot-mounted communication device 2 detects an abnormality from the gas sensor 120, the heat sensor 122, the smoke sensor 124, or the intrusion detection sensor 126, The alarm sound is generated in the speakers 14 and 16 through the power amplification unit 70, and connected to the communication management server 40 through the network communication module 68 to provide the kind of the detected abnormal state (for example, gas). Leaks, fires, intruders, etc.).

When the communication management server 40 is informed of the type of the abnormal state from the robot-mounted communication device 2, the communication management server 40 calls the relevant authority appropriate to the type of the abnormal state to make the communication device 2 of the robot-mounted communication device 2 stand out. In addition to providing your personal information (i.e. your name, home address, phone number of your communication device, guardian's phone number, etc.), you may also receive an error message (e.g. voice prompt, text message, etc.) that is appropriate for your condition. Will occur.

On the other hand, the computer terminals 46a1 to 46an of each relevant organization receive the user information and the error occurrence guidance message of the robot-mounted communication device 2 in response to a call from the communication management server 40. By transmitting a robot operation command to the robot-mounted communication device 2 on the Internet web by means of an image communication application program operation, the robot head 4 of the communication device 2 is moved up / down or left / right. By operating in the right direction, the image camera 12 attached to the robot head 4 can provide a captured image of the position where the abnormality occurred.

The control unit 78 of the robot-mounted communication device 2 transmits a robot operation command from a specific computer terminal among the computer terminals 46a1 to 46an of the relevant engine. While driving and controlling the motor driver 80 to operate, the image data captured from the image camera 12 is controlled to be transmitted to the corresponding computer terminal through the network communication module 68.

In FIG. 9, various abnormality detection sensors are embedded in the robot-mounted communication device 2, but as another embodiment of the present invention, although not embedded in the communication device 2, the specific communication device 2 is located. It is also possible to receive an abnormality detection signal from the abnormality detection sensor already installed in the space.

That is, as shown in FIG. 10, the gas sensor 120a, the heat sensor 122a, the smoke sensor 24a, and the intrusion detection sensor 126a are respectively installed at the place where the robot-mounted communication device 2 is installed. ), Each abnormality detection sensor is provided with a wireless communication module (128, 130, 132, 134) for short-range wireless communication.

In addition, the robot-mounted communication device 2 includes a wireless communication module provided in each of the gas sensor 120a, the heat sensor 122a, the smoke sensor 24a, and the intrusion detection sensor 126a. And a short range wireless communication unit 136 for performing short range wireless communication with the 128, 130, 132 and 134.

Here, the wireless communication module (128, 130, 132, 134) and the short-range wireless communication unit 136 by applying any one of the communication method of Bluetooth (Bluetooth), infrared (IrDA) communication, Zigbee, Binary CDMA to enable wireless communication in a short distance to each other Proceed with wireless communication.

The controller 78 of the robot-mounted communication device 2 communicates with the gas sensor 120a, the heat sensor 122a, the smoke sensor 24a, and the intrusion detection sensor 126a through the short range wireless communication unit 136. When receiving an abnormal detection signal from the), the alarm sound is generated in the speaker (14, 16) through the power amplification unit 70, and connected to the communication management server 40 through the network communication module 68 To notify the type of the detected abnormal condition.

Next, FIG. 11 is a view showing a state in which a display unit is additionally configured in the robot-mounted communication device according to the present invention.

As shown in FIG. 11, the robot-mounted communication device 2 of the present invention includes a display unit 140 at a predetermined front surface thereof, and the shortcut key input unit 60 and the key input unit 62 are provided via the display unit 140. It displays the function execution status by the key input of), and displays the video data provided from the counterpart through the Internet network.

That is, the robot-mounted communication device 2 transmits the image data photographed from the video camera 12 to the counterpart computer terminal if the counterpart is a computer terminal capable of video communication during the Internet voice call with the counterpart via a VoIP call. In addition to the transmission, the video data received from the video camera attached to the counterpart computer terminal is received and displayed on the display unit 140 so that the video call can be made.

While specific embodiments of the present invention have been described and illustrated above, it will be apparent that the present invention may be embodied in various modifications by those skilled in the art. Such modified embodiments should not be understood individually from the technical spirit or the prospect of the present invention, but should fall within the claims appended to the present invention.

1 is a view showing the overall appearance of a robot-mounted communication device according to the invention,

2 is a view showing the overall configuration of a communication system using a robot-mounted communication device according to the present invention;

3 is a view showing the internal configuration of the robot-mounted communication device shown in FIG.

4 is a view showing a state in which a call connection with the designated party via a shortcut button of the robot-mounted communication device according to an embodiment of the present invention,

5 is a view showing the configuration of a computer terminal for adjusting the position of the image camera by remotely controlling the robot of the robot-mounted communication device from a remote computer terminal;

6A and 6B illustrate a state in which a robot is operated by detecting a direction in which a sound is generated in a robot-mounted communication device according to an embodiment of the present invention;

FIG. 7 is a view illustrating a motion control operation of a robot synchronized with music by receiving music data and motion data synchronized with the music data from a remote computer terminal according to another exemplary embodiment of the present invention. A drawing showing a state of being made,

8 illustrates a data format of motion data synchronized with music data;

9 is a view showing a configuration of a communication system in which an abnormality detection sensor is mounted in a robot-mounted communication device according to another embodiment of the present invention;

FIG. 10 is a diagram illustrating a configuration of a communication system in which a robot-mounted communication device is configured to enable short-range communication with an abnormality sensor configured separately; FIG.

11 is a view illustrating a state in which a display unit is additionally configured in the robot-mounted communication device according to the present invention.

<Explanation of symbols for the main parts of the drawings>

2: robot-mounted communication device, 4: robot head,

8,10: robot arm, 12: video camera,

14, 16: speakers, 18, 20: microphone,

22, 24, 26, 28, 30: Hotkey button, 32: Control key button,

34: 10-key button, 36: call key button,

38: call end key button, 40: rescue communication management server,

42: information database, 44: Internet telephone,

46: computer terminal, 48: wired telephone,

50: mobile communication terminal.

Claims (24)

A shortcut key input means having a shortcut key corresponding to a predetermined counterpart contact and performing one-key operation of a shortcut key for making a call connection with the counterpart contact specified in advance for rescue communication; Call input / output means for inputting a spoken voice and outputting a spoken voice for a call with a counterpart contact; Call signal processing means for performing call signal processing of a talk voice and a sign voice for a call with a counterpart contact; Network communication means for connecting to a communication network for rescue communication and transmitting and receiving data and a call signal for a call with a counterpart contact; A robot mounted on the device and connected to the other party's contact by the hot key input unit and interoperably operated according to the call progress state during the call; Robot driving means for driving to operate the robot; And By generating the information signal for the call connection with the contact of the other party specified in advance by the one-key operation of the shortcut key input means to control the transmission and reception of the call signal through the network communication means, according to the call progress state with the other contact And a control means for controlling the drive of the robot driving means to operate the robot in an interlocked manner. The method of claim 1, The information of the contact information designated in advance corresponding to the key code data of each shortcut key provided in the shortcut key input means is registered and managed in the communication management server on the network. The control means provides key code data of the corresponding shortcut key and unique identification code data of the corresponding shortcut key to the communication management server through a network when the one-key operation of each shortcut key of the shortcut key input means is performed. Robot-mounted communication device characterized in that the call connection is made. The method of claim 1, The call input / output means includes a microphone for receiving a voice of a user for a voice call, a signal amplifier for amplifying a voice signal input through the microphone, a power amplifier for power amplifying a sign language voice signal from the other party, and a power amplifier. It is configured to include a speaker for voice output the sign language voice signal of the amplified counterpart through, The call signal processing means digitally processes the voice signal from the signal amplification unit, outputs the digital signal to the network communication unit, and processes the speech signal of the other party received from the network communication unit. Robot-mounted communication device comprising a digital signal processing unit (DSP) to output. The method of claim 1, And said network communication means is configured to perform transmission and reception of internet packet data through an internet network, and to transmit and receive a voice packet for an internet voice call through a VoIP call of the internet network. The method of claim 1, The robot is a robot head attached to the body fixed to the main body to enable the operation in the up / down and left / right direction, the robot right arm attached to the operation in the up / down direction on both sides of the body and Composed of the left arm, The robot driving means includes a motor driving part driven by drive control of the control means, a first motor for driving a motor for operating the robot head in an up / down direction, and operating the robot head in a left / right direction. A second motor performing a motor drive for driving the motor, a third motor performing a motor drive for operating the robot right arm in the up / down direction, and a motor performing a motor drive for operating the robot left arm in the up / down direction 4 motors, a head up and down driving mechanism for operating the robot head in an up / down direction by driving a motor of the first motor, and a head left and right driving mechanism for operating the robot head in a left / right direction by driving a motor of the second motor. A right arm driving mechanism for operating the robot's right arm in an up / down direction by driving the motor of the third motor; and the motor of the fourth motor. And a left arm driving mechanism configured to operate the robot left arm in an up / down direction by driving. The method of claim 5, wherein The robot-mounted communication device, characterized in that the head of the robot further comprises an image camera for taking a peripheral image. The method of claim 6, Robot control information for controlling the operation of the robot head is transmitted from the contact information of the other party, The control means drives and controls the robot driving means according to the robot control information from the counterpart contact so that the robot head is operated in the up / down direction or the left / right direction, and the image data photographed from the video camera is counterparted. Robot-mounted communication device, characterized in that the transmission to the contact. The method according to claim 3 or 5, It is located on the right and left sides of the device, respectively, and compares the input time of the voice signals input to the right and left microphones and the right and left microphones, and tracks the direction in which the sound is generated. It further comprises a voice tracking unit for generating a voice tracking signal, And the control means causes the robot head to operate in a direction in which sound is generated by the voice tracking signal of the voice tracking unit, and the robot right and left arms to operate. The method of claim 1, Music data including a predetermined sound source and motion data including motion information synchronized with the music data are transmitted from the counterpart contact information; And the control means reproduces the music data, outputs music, and controls the movement of the robot by synchronizing with the music based on the motion data. The method of claim 9, And the motion data is provided in the form of text data in which motion code values obtained by encoding motion information of the robot are prepared for each playing time of music. The method of claim 1, It is configured to further include an abnormality detection sensor for detecting the abnormal state of the surroundings and generates an abnormality detection signal accordingly, And the control means performs a call connection with a related organization corresponding to the detected abnormal state when receiving the abnormality detection signal. The method of claim 1, An abnormality detection sensor installed in a specific space outside the device and detecting an ambient abnormality condition and generating an abnormality detection signal according thereto, and a wireless communication module for wirelessly transmitting the abnormality detection signal from the abnormality detection sensor by near field communication. It is configured to include more And a short range wireless communication unit embedded in a corresponding device and wirelessly receiving an abnormality detection signal from the abnormality detection sensor through short range wireless communication through the wireless communication module. And the control means performs a call connection with a related organization corresponding to the detected abnormal state when receiving the abnormality detection signal through the short range wireless communication unit. The method according to claim 11 or 12, The abnormality sensor is a robot-mounted communication device, characterized in that at least any one of a gas sensor, a heat sensor, a smoke sensor, an intrusion detection sensor. The method of claim 1, And a display unit configured to display a video camera that photographs and provides a surrounding image for video communication with a counterpart contact, and to display a counterpart image data captured and provided from the counterpart contact, and to display a function execution state of the corresponding device. Robot-mounted communication device, characterized in that. Having a shortcut key corresponding to a predetermined counterpart contact, and performing a one-key operation of a shortcut key for accessing a call with a predetermined counterpart contact for rescue communication, proceeds with a voice call with the counterpart contact and according to the call progress status with the counterpart. A robot-mounted communication device for interoperating the mounted robot; A communication management server for making a voice call by making a call connection with a contact of a counterpart corresponding to the shortcut key according to a one-key operation of the shortcut key for rescue communication from the robot-mounted communication device; And The robot-mounted communication device is configured to include a counterpart contact side communication terminal which is connected to a call through the relay of the communication management server by a shortcut key operation of the robot-mounted communication device and performs a voice call with the robot-mounted communication device. Communication system using a communication device. The method of claim 15, The robot-mounted communication device transmits the keycode data of the shortcut key and the phone identification code data uniquely assigned to the robot-mounted communication device to the communication management server through a network when the one-key operation of the shortcut key is performed. The communication management server distinguishes the robot-mounted communication device through the phone unique identification code data, and calls the counterpart contact side communication terminal based on the information of a predetermined counterpart contact registered and managed in correspondence to the key code data of the shortcut key. Communication system using a robot-mounted communication device characterized in that the call connection is made. The method of claim 15, The robot-mounted communication device is a communication system using a robot-mounted communication device, characterized in that for performing the transmission and reception of Internet packet data through the Internet network, and the Internet voice call via a VoIP call of the Internet network. The method of claim 17, The communication terminal on the other party's contact side includes an Internet telephone for making an Internet voice call through the Internet network, a computer terminal for carrying out an Internet voice call through the Internet network, and a dedicated application or dedicated hardware for the Internet phone. It is any one of a landline telephone for making a voice call with the robot-mounted communication device via a telephone network, an internet network and a mobile communication terminal for making a voice call with the robot-mounted communication device via a mobile communication network. Communication system using robot-mounted communication device. The method of claim 15, The robot-mounted communication device includes a robot head mounted on the body fixed to the apparatus main body so as to be operable in an up / down direction and a left / right direction, and installed on the head of the robot to photograph surrounding images. An image camera, a robot right arm and left arm capable of operating in both up and down directions on both sides of the body, a motor driver driven to operate the robot head and the robot right arm and left arm, and the robot driven by the motor driver. First and second motors that perform motor driving for operating the head in the up / down direction and the left / right directions, respectively, for operating the robot right arm and the left arm in the up / down directions by driving the motor driving unit. Third and fourth motors for driving the motor, and head upper and lower spheres for operating the robot head in an up / down direction by driving the motor of the first motor. Mechanism, Head left and right drive mechanism for operating the robot head in the left / right direction by the motor drive of the second motor, Right arm drive mechanism for operating the robot right arm in the up / down direction by the motor drive of the third motor, And a left arm driving mechanism for operating the robot's left arm in an up / down direction by driving a motor of a fourth motor. The method of claim 19, The counterpart contact side communication terminal controls a robot to remotely control an up / down direction or a left / right direction of the robot head to which the video camera is attached in order to obtain image data captured by the video camera according to video communication. Send information, The robot-mounted communication device controls driving of the motor driving unit according to the robot control information from the counterpart contact side communication terminal so that the robot head is operated in the up / down direction or the left / right direction so that the photographing position of the image camera is adjusted. And adjust and transmit the image data photographed from the image camera to a counterpart contact. The method of claim 20, The counterpart contact side communication terminal includes a computer terminal having an application for video communication, an application for remote control of a robot and generating and transmitting robot control information through a user operation of a keyboard, an application for video communication, and a robot remote control. Is equipped with an application for the communication system using a robot-mounted communication device, characterized in that any one of the mobile communication terminal to generate and transmit the robot control information by the user operation of the keypad. The method of claim 20, The counterpart contact side communication terminal transmits the peripheral image data photographed from the video camera to the robot-mounted communication device for video communication, The robot-mounted communication device displays a video camera that photographs and provides a surrounding image for image communication with the counterpart contact side communication terminal, and displays the counterpart image data captured and provided from the counterpart contact side communication terminal, A communication system using a robot-mounted communication device, characterized in that it further comprises a display unit for displaying the function execution state of the robot-mounted communication device. The method of claim 15, The communication management server transmits music data including a predetermined sound source selected by the counterpart contact side communication terminal and motion data including motion information synchronized with the music data, The robot-mounted communication device is a communication system using a robot-mounted communication device, characterized in that for reproducing the music data to output music, and controlling the movement of the robot in synchronization with the music based on the movement data. The method of claim 15, The robot-mounted communication device is configured to further include an abnormality detection sensor for detecting an abnormal condition of the surroundings and generating an abnormal detection signal according to the robot. When the abnormality is detected from the abnormality detection sensor, the communication management is performed on the type of the abnormal condition. Notify the server, The communication management server is a robot-mounted communication device, characterized in that for generating the user personal information and the error occurrence guidance message of the robot-mounted communication device to the communication terminal of the counterpart contact side of the relevant organization corresponding to the type of the abnormal state. Communication system using.

Images