KR101256054B1 - Pet care system and method using two-way communication - Google Patents

Abstract

PURPOSE: A pet protection system using bidirectional communication and a method thereof are provided to supply a feedback signal to a pet, thereby enabling the pet to receive a voice of an owner, image information of the owner, and healing music. CONSTITUTION: A main terminal(30) receives a voice and image information from home appliances, an embedded camera, and a microphone. A user terminal receives and outputs the voice and the image information from the main terminal through a wired/wireless network. The user terminal receives the voice, the image information, and a control command which is inputted by a user. The user terminal transmits the control command and the information to the main terminal. A server(5) performs an authentication process for real time bidirectional communication between the main terminal and the user terminal. An automatic feeding device(50) provides water, a feed, and a snack to a pet. [Reference numerals] (AA,BB) Wired/wireless network;

Description

PET CARE SYSTEM AND METHOD USING TWO-WAY COMMUNICATION}

The present invention relates to a pet protection system and method using bi-directional communication.

Recently, with the rapid growth of households that grow pets, pets are becoming more important as mates, not mere animals. Accordingly, people are going to a veterinary clinic to treat or prevent a pet's disease, take a lot of effort to take a haircut to a beauty salon, or to walk every day.

However, modern people have many people living alone, and many working couples have left their pets alone while they are at work. In this case, pets such as dogs or cats are susceptible to stress alone, and are prone to diseases such as depression.

Therefore, even when the owner of the pet is out of the house, it is necessary to check the condition of the pet and protect the pet as if it is next to the owner.

KR 10-2004-0009025 A

The present invention has been made to solve the problems described above, by using a wired or wireless network, the user checks the status of the dog to the user terminal, provides a feedback signal to the pet, the pet voice and video of the owner The purpose of the present invention is to provide a pet protection system and method for receiving information and healing music of a pet.

To this end, the pet protection system according to an embodiment of the present invention controls the operation of a home appliance connected to a wired / wireless network, and receives a main terminal for receiving voice and video information from the home appliance, an automatic feeding machine or a built-in camera and a microphone. And a user terminal for receiving and outputting the voice and video information from the main terminal through a wired / wireless network, receiving a control command input by a user, voice and image information of the user, and transmitting the same to the main terminal. The main terminal outputs the voice and image information of the user transmitted from the user terminal through the home appliance, an automatic feeding machine or a built-in display unit and a speaker, and controls the operation of the home appliance or the main terminal according to the control command. can do.

The user terminal may set the feed and snack time of the automatic feeding machine in the terminal, and communicate the set data with the main terminal to send the set data to the main terminal, the main terminal sends the data to the user terminal to synchronize with each other The automatic feeding machine is configured to provide feed, snack and drinking water integrated.

The main terminal includes a communication unit for transmitting and receiving data to and from the home appliance, an automatic feeding machine or the user terminal through a wired / wireless network, a camera unit for obtaining image information, a microphone unit for obtaining voice information, and outputting a voice signal. It may include a speaker unit, a display unit for displaying the operation state of the main terminal, an infrared communication unit for performing infrared communication with the home appliance, and a main processor for controlling the overall operation of the main terminal.

The user terminal includes a communication unit for transmitting and receiving data to and from the main terminal through a wired and wireless network, a camera unit for acquiring image information of the user, a microphone unit for acquiring voice information of the user, a display unit for outputting image information, It may include a speaker unit for outputting voice information, an input unit for receiving a control command of the user, and a control unit for controlling the overall operation of the user terminal.

The main terminal may determine the emotional state of the pet based on the received voice information.

The main terminal may extract feature point information from the received image information and distinguish between a person and a pet using the extracted feature point information.

In addition, the main terminal builds a feature point information of a pet learned in real time based on the feature point information of the pre-built pet or the extracted feature point information into a database, and distinguishes a person from a pet based on the database. Each pet can be distinguished.

The main terminal may determine a pet state based on the received voice and image information of the pet, and transmit the determined state information to the user terminal through a wired / wireless network.

The main terminal determines a pet's state based on the received voice and video information of the pet, and automatically determines an output signal required for the pet based on a predetermined algorithm based on the determined state information. The electronic device may control the home appliance or the main terminal to generate the determined output signal.

In this case, the main terminal may determine sound information necessary for the pet based on the determined state information, and output the determined sound information through the speaker of the home appliance or the main terminal.

In addition, the pet protection system according to an embodiment of the present invention further includes an automatic food feeder for providing water or food to the pet, and the main terminal, when the feeding command is input to the user at a predetermined time, the pet When it is determined that the situation is hungry, the main terminal may control the automatic feeding machine through the wired / wireless network to provide water or food to the pet.

The automatic feeding machine further includes a lighting unit, and the main terminal communicates a control command or illuminance sensor value input by the user with the main terminal, and controls the on / off of the lighting unit through a wired or wireless network based on the user terminal. can do.

Pet protection method according to an embodiment of the present invention, if you want to use the main terminal and the user terminal, the main terminal and the user terminal can be mutual communication by being authenticated by the registered use after authentication to the server Acquiring audio and video information in a home using a main terminal; transmitting, by the main terminal, the acquired audio and video information to a user terminal through a wired or wireless network; Receiving a control command, voice and image information of the user, transmitting, by the user terminal, the input control command, voice and image information of the user to the main terminal, and transmitting from the user terminal to the main terminal; Voice and image information of the user through a wired or wireless network Outputting through an electric machine or outputting through a built-in display unit and a speaker; and controlling the operation of the home appliance or the main terminal by the main terminal according to the control command transmitted from the user terminal. .

In addition, the pet protection method according to an embodiment of the present invention, the main terminal may further comprise the step of determining the emotional state of the pet based on the obtained voice information.

In addition, the pet protection method according to an embodiment of the present invention, the main terminal extracts the feature point information from the obtained image information, the main terminal using the extracted feature point information, the person and pet It may further comprise the step of distinguishing.

In addition, the pet protection method according to an embodiment of the present invention, the main terminal is built in the feature point information of the pet learned in real time based on the feature point information or the extracted feature point information of the pre-built pet to the database And the main terminal distinguishing a person from a pet or distinguishing each pet from the database based on the database.

In addition, the pet protection method according to an embodiment of the present invention, the main terminal to determine the status of the pet based on the acquired voice and video information of the pet, and the determined state information, wired or wireless The method may further include transmitting to the user terminal through a network.

In addition, the pet protection method according to an embodiment of the present invention, the main terminal determines the state of the pet based on the acquired voice and image information of the pet, and the main terminal is determined Automatically determining an output signal required for the pet based on the state information according to a preset algorithm, and controlling, by the main terminal, the home appliance or the main terminal to generate the determined output signal; Can be.

In addition, the pet protection method according to an embodiment of the present invention, the main terminal determines the sound information necessary for the pet based on the determined state information, the home appliance or the speaker of the main terminal The method may further include outputting the determined sound information.

In addition, the pet protection method according to an embodiment of the present invention, the wired and wireless network in at least one of the case that the main terminal is a predetermined time, when the feed command is input to the user, it is determined that the pet is hungry situation Issuing a control command to the main terminal through, the main terminal controls the automatic feeder through wireless communication to provide water or food to the pet, wired and wireless based on the control command or illuminance sensor value input by the user The method may further include providing light to the automatic feeding machine by controlling on / off of the lighting unit through a network.

According to the pet protection system and method according to the present invention, even when only a pet is left in the home, the pet and the landlord can perform bidirectional communication remotely through the main terminal and remotely access home appliances such as automatic feeders Control the pets effectively.

In addition, the main terminal obtains voice and image information of the pet, distinguishes each of the pets based on the obtained data, analyzes the sound information to grasp the emotional state of the pet, The user can effectively receive the alarm information without executing the application.

Also, the main terminal can automatically output a feedback signal to the user without giving notification information to the user according to the setting of the user, so that the user can effectively protect the pets even in an urgent situation such as an important meeting schedule .

In addition, the present footing can be a large number of users, and when there are a large number of users who can give effective management of pets by telling when and how much food and snacks were given and who used the healing music at what time and when. The diary can be transmitted from the main terminal to the user terminal, so that the user can easily check the history information on the user terminal to effectively care for the pet.

1 is a schematic block diagram of a pet protection system according to an embodiment of the present invention.
2 is a detailed configuration diagram of the user terminal 10 of FIG.
3 is a detailed configuration diagram of the main terminal 30 of FIG.
4 is a detailed configuration diagram of the automatic feeding section 50 of FIG.
5 is a detailed configuration diagram of a software application applied to a pet protection system according to an embodiment of the present invention.
6 is a view for explaining the output of the sound signal according to the determined state of the pet.
7 is a schematic flowchart of a pet protection method according to an embodiment of the present invention.
8 is a schematic flowchart of a pet protection method according to another embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Embodiments of the present invention are provided to more fully describe the present invention to those skilled in the art, and the following embodiments may be modified in various other forms, The present invention is not limited to the following embodiments. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the invention to those skilled in the art.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used herein, the singular forms "a", "an," and "the" include plural forms unless the context clearly dictates otherwise. Also, " comprise " and / or " comprising " as used herein specify the presence of stated shapes, numbers, steps, operations, elements, elements, and / , But does not preclude the presence or addition of one or more other features, integers, operations, elements, elements, and / or groups. As used herein, the term " and / or " includes any and all combinations of any of the listed items.

Although the terms first, second, etc. are used herein to describe various elements, regions and / or regions, it should be understood that these elements, components, regions, layers and / Do. These terms do not imply any particular order, top, bottom, or top row, and are used only to distinguish one member, region, or region from another member, region, or region. Thus, the first member, region or region described below may refer to a second member, region or region without departing from the teachings of the present invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings schematically showing embodiments of the present invention. In the figures, for example, variations in the shape shown may be expected, depending on manufacturing techniques and / or tolerances. Accordingly, embodiments of the present invention should not be construed as limited to any particular shape of the regions illustrated herein, but should include variations in shape resulting from, for example, manufacture.

1 is a schematic block diagram of a pet protection system according to an embodiment of the present invention.

Referring to FIG. 1, a pet protection system 100 according to an embodiment of the present invention includes a server 5, a user terminal 10, a user terminal 20, a main terminal 30, a television 40, An automatic feeder 50, a camera 60, an audio device 70, and a gas stove 80. [

The user terminal 10 is a mobile terminal, such as a smart phone, a PDA, or the like. The user terminal 20 is also a stationary terminal such as a desktop PC. The user terminals 10 and 20 are connected to the main terminal 30 through a wired or wireless network such as a Wi-Fi, a wired LAN, a mobile communication network such as CDMA, or a WiBro.

The user terminals 10 and 20 receive and output the voice and image information from the main terminal 30 through the wired or wireless network and receive the control command, user's voice and image information input by the user, As shown in FIG. The detailed structure and operation will be described later.

The main terminal 30 is a device installed in a home, and controls the operation of home appliances connected to a wired / wireless network and receives voice and image information from a home appliance or a camera and a microphone built in the main terminal 30 itself do. Examples of home appliances are a television 40, an automatic feeding machine 50, a camera 60, an audio device 70, and a gas stove 80.

The server 5 functions as a SIP server so as to enable bidirectional communication with a function of managing information of the user terminals 10 and 20 and the main terminal 30. [ That is, when the user terminal 10 or 20 logs in, the information is transmitted to the server 5, and the server 5 performs an authentication process to determine whether the user is a registered user or not. Way communication between the user terminals 10 and 20 and the main terminal 30 to manage mutual communication.

If it is determined that the user is an unregistered user, the main terminal 30 and the user terminals 10 and 20 are instructed to register in the server 5. At this time, if the ID and password information such as the assigned authentication number are incorrect, the authentication is not permitted.

At this time, the authentication may be configured such that a plurality of users perform authentication with respect to one main terminal 30. [ In other words, when there are a plurality of members in the home, all members can subscribe to a separate ID, authenticate the main terminal 30, and control the home.

When a plurality of users perform authentication, each user may be provided with the pet management history information for each user through the main terminal 30 through an interface such as a diary.

The television 40 may be a device in which a home has already been installed. The automatic feeding machine 50 is a device that automatically provides water or food to a pet in one terminal.

The camera 60 corresponds to a camera module for a CCTV installed in a building or the like, and one or more cameras may be installed in the home. Of course, the shape of the camera 60 may be applied to other types of cameras.

The audio device 70 is a device for generating a sound signal such as a cassette player or a radio and outputs audio data stored in a storage medium such as a tape, a CD, a USB memory stick, or an SD card, And can output the data received from the main terminal 30 via the network.

The gas stove 80 may be installed in the kitchen and receive a control signal from the main terminal 30 to control the on / off of the electronic gas valve or control the operation of the gas stove.

The television 40, the automatic feeder 50, the camera 60, the audio device 70 and the gas range 80 can be connected to the main terminal 30 via a wire / wireless network to transmit / However, it is also possible to transmit / receive the control signal by the infrared communication method, which is a method used for the remote controller.

The pet protection system 30 according to an embodiment of the present invention collects voice and image information of pets in the home through the main terminal 30 installed in the home, ) To allow the user to remotely verify voice and video information of the pet.

A camera module and a microphone module are installed in the user terminals 10 and 20 to collect voice and image information of the user and transmit the collected voice and image information to the main terminal 30 through the wired / wireless network, The user can output voice and image information through a speaker or a display unit, or output voice and image information through a television 40 connected to a wired / wireless network.

That is, even when the pet is alone in the house, the face and the voice of the owner can be confirmed through the device such as the television 40, so that the pet is emotionally stable without being lonely.

In addition, the pet protection system 100 according to the present invention can remotely control the operation of household appliances through the main terminal 30, output a feedback signal to a pet according to a control command of the user, It is possible to determine the state of the pet by a predetermined algorithm and automatically output a feedback signal according to the state of the determined pet.

2 to 8, the detailed configuration and operation of another pet protection system 100 according to an embodiment of the present invention will be described in detail.

2 is a detailed configuration diagram of the user terminal 10 of FIG.

2, the user terminal 10 includes a communication unit 11, a control unit 12, a camera unit 13, a speaker unit 14, a microphone unit 14, a display unit 16, And an input unit 17.

The communication unit 11 plays a role of transmitting and receiving data with the main terminal 30 through a wired or wireless network. The types of wired and wireless networks are the same as those mentioned above, and data to be transmitted and received may include voice and image information of a pet, voice and image information of a user, and control commands of a user.

The control unit 12 processes the data received from the communication unit 11 and controls the overall operation of the user terminal 10 according to the received data or a user's control command input by the input unit 17 .

The camera unit 13 is constituted by a CCD, a CMOS camera, or the like, and serves to photograph the face of the owner of the user, that is, the pet.

The speaker unit 14 outputs a voice sound of the pet received from the main terminal 30. [

The microphone unit 15 serves to receive voice information of the user, that is, the owner of the pet.

The display unit 16 is a display unit such as an LCD or an LED, and outputs video image information of a pet received from the main terminal 30.

The input unit 17 includes a separate button, a keypad, or a touch panel, and is integrally formed with the display unit 16 to receive a control command from a user.

3 is a detailed configuration diagram of the main terminal 30 of FIG.

Referring to FIG. 3, the main terminal 30 includes a communication unit 31, a camera unit 32, a speaker unit 33, a microphone unit 34, a memory unit 35, and a main processor 36. ), A display unit 27a, an input unit 37b, an infrared communication unit 38, a TV OUT port 39a, and an SD CARD port 39b.

The communication unit 31 transmits and receives data to / from the home appliances or the user terminal 10 through a wired / wireless network.

The camera unit 32 is installed on the front surface of the main terminal 30 and serves to acquire image information of pets in the home.

The speaker unit 33 outputs the voice information of the user received from the user terminal 10 or outputs other voice information.

The microphone unit 34 plays a role of acquiring voice information in the home, in particular, to acquire voice information of a pet.

The memory unit 35 stores data received from the user terminal 10 or stores data acquired by the main terminal 30 itself.

The display unit 27a serves to display an operation state of the main terminal 30 through an LCD window. In addition, according to the design, when the display unit 27a is formed to be large, image information of the user obtained from the user terminal 10 may be displayed.

The input unit 37b serves to receive a control command so that the user can directly set when the user is in the home.

The infrared communication unit 38 serves to perform infrared communication such as IRDA, and transmits and receives a control command while communicating with the infrared communication unit of the home appliance.

The TV OUT port 39a is connected to the VEDIO IN terminal of the television 40 and transmits the video information received from the user terminal 10 to the television 40.

The SD CARD port 39b inserts an SD memory card so that the main terminal 30 can process data stored in the SD memory card.

The main processor 36 is responsible for controlling the overall operation of the components.

4 is a detailed configuration diagram of the automatic feeder 50 of FIG.

4, the automatic feeder 50 includes an infrared communication unit 51, a microcomputer 52, a driving unit 53, a snack bar 54, a feeding box 55, and a drinking water tank 56 .

The infrared communication unit 51 serves to receive a control command of the main terminal 30 by an infrared communication method.

The microcomputer 52 controls the driving unit 53 constituted by a motor or the like in accordance with the control command received via the infrared communication unit 51 so that at least one of the snack barrel 54, the feeding box 55 and the drinking water bottle 56 And serves to provide pets with snacks, feed or drinking water.

In particular, the automatic feeding machine 50 of the present invention can provide a snack, feed, and drinking water separately, and can effectively provide only necessary food, depending on the state of the dog.

In addition, the automatic feeding machine 50 may make a transparent portion on one side of the container to allow the user to check the amount of feed, etc., respectively, by installing infrared transmission and reception sensors on the left and right sides of a certain height of the container, the infrared signal is left and right It can be configured to detect the amount of feed or water depending on whether it is detected.

Using this, when the infrared signal is not detected by the infrared transmission / reception sensor, an alarm signal indicating that the amount of feed or water is insufficient is automatically transmitted to the user terminal 10 through the main terminal 30.

5 is a detailed configuration diagram of a software application applied to a pet protection system according to an embodiment of the present invention.

5, an application to be applied to the pet protection system 100 includes a user interface application (UI App), an M + Media Engine, an Echo canceller, an H.264 Encoder / Decoder, a SIP, (RTP), RTSP / RSVP / RTCP / HTTP, UDP / TCP, IP, and iOS / Android / Linux / Window / xOS fields.

The pet-specific Audio Decoder uses the sensitive hearing of the pet to play the sound according to the situation. Specifically, the sound that stabilizes the breathing and heart rate of a pet can be heard, the sound that calms the aggression caused by the pain can be heard, or the sound that relaxes the anxiety state and reduces the stress can be heard. In particular, using specific frequencies can provide a sound that can not be heard by humans, and can use pet-specific decoding methods when using wav and raw file formats.

The audio signal uses a bidirectional G.729 Encoder / Decoder codec, and the video signal uses the H.264 Encoder / Decoder codec.

Also, echo canceller is applied to prevent howling, and bi-directional communication is performed by applying SIP protocol among mVoip communication protocols.

The configuration of the software application is merely an embodiment, and it is apparent that any other method can be used as long as it implements the same operation.

6 is a view for explaining the output of the sound signal according to the determined state of the pet.

As shown in FIG. 6, if the dog is left alone at home or is in the hospital, it is determined that the dog is lonely, and the acoustic signal that stimulates hearing may be provided by changing the beat, thereby relieving the anxiety of the pet. It can relieve stress and keep your appetite. At this time, Fast Pan Effect is used to prevent the decrease of the pet's momentum.

Also, if you feel that your pet is the first person to be adopted, stressed when you first come to a stranger's home, when you are struggling, when you are nervous, when you are moving, etc., To induce the pet to be stable. At this time, the vibration wavelength of the low frequency is directly stimulated, so that the excitation of the pet is calmed down.

In addition, when the pet has an abnormality in health, such as when it does not eat rice, does not play, or appears sick, a 3D sound is generated to stimulate the reflex nerve of the pet, Increase appetite by inducing exercise. At this time, you can compensate for the change by using the tone change and Pan effect.

7 is a schematic flowchart of a pet protection method according to an embodiment of the present invention.

The user executes the pet protection application installed in the user terminal 10 (S100), and the user terminal 10 automatically transmits a data request message to the main terminal 30 (S100).

The main terminal 30 receives a data request message from the user terminal 10 through the wired / wireless network (S200), and transmits the data request message to at least one of a camera module installed in the home, a camera module installed in the main terminal 30, (S210). ≪ / RTI >

At this time, the main terminal 30 analyzes the voice and image data of the received pet to determine the state of the pet (S200). At this time, the voice recognition method can be used as a method of determining the state of the pet.

In other words, it recognizes the sound of a pet, analyzes the recognized data, grasps the state of the pet, and takes appropriate measures to maintain the state of the pet at its best.

For example, in the case of a dog, the sound is divided into six emotions, such as sadness, stress, anger, demand, pleasure, and self-expression, to be analyzed in detail to the user terminal 10. Can be sent to take appropriate action.

The types of dogs crying are summarized in the table below.

Crying type division Contents Outer demand
Self expression If a dog makes a cry of a wolf, find a far-off coworker or stay alone in the house and call the owner of the dog growl aggro
demand This sounds like a sign that your dog is attacking, threatening or dominating or asking you to play. Woof woof Stress pleasure When it is borderline or surprised, excited, or when you are happy with the barking when you are happy, you are short-lived. Ke sadness
stress It is the sound of a young puppy falling off the mother or the owner, with a cry of sadness, loneliness and anxiety. Beginning Self-expression sorrow
stress It is a sound when you notice a wound or pain, or when you feel fear.

As shown in Table 1, the cry of a pet dog can be received and analyzed, and the emotional state of each type of pet dog can be classified. In the pet protection system 100 according to the embodiment of the present invention, in advance, a sound for each type of pet such as a pet dog is constructed in advance in a database, and the sound of the input pet is compared with the built- The animal's emotional state can be judged.

Referring back to FIG. 7, if the pet state is determined in step 220, the voice, image, and state information of the pet is transmitted to the user terminal 10 (S230). At this time, the voice and image information of the pet is information received through a camera, a microphone, and the like, and the status information corresponds to information determined by the main terminal 30 based on the voice and image information of the pet received.

The user terminal 10 receives the voice, image, and status information of the pet from the main terminal 30 (S120), and outputs the voice, image, and status information to the user. The user confirms the voice, image, and status information of the pet, inputs a control command to the input unit of the user terminal 10, or allows the user to record his / her appearance and voice information to the camera and micro record.

The user terminal 10 receives the user's voice, image, and command information (S130) and transmits it to the main terminal 30 (S140).

In this case, the voice and image information of the user are information obtained from the camera unit 13 and the microphone unit 15 installed in the user terminal 10, and the control command corresponds to the information input to the input unit 17.

The main terminal 30 receives the user's voice, image and command information (S240), outputs the user's sound island and image information (S250), and outputs a feedback signal according to the user's control command (S260).

At this time, the output of the user's voice and image information can be performed through the display unit 37a and the speaker unit 33 of the main terminal 30 itself, or through the home appliance, that is, the television 40 or the like.

When the feedback signal is output, the voice and image data information of the subsequent pet is transmitted to the user terminal 10, and the user terminal 10 receives the voice and image data of the pet (S150) do.

The user confirms the changed state of the pet and ends the application (S160).

8 is a schematic flowchart of a pet protection method according to another embodiment of the present invention.

7 illustrates that the user executes an application on the user terminal 10 to actively check the state of the pet and transmits a control command, but in FIG. 8, the state of the pet actively in the main terminal 30 is illustrated. It will be described with reference to the embodiment of automatically outputting a feedback signal after determining the or transmitting the notification information on the status of the pet to the user terminal 10, such as a push alarm.

Referring to FIG. 8, the main terminal 30 receives voice and image data of a pet (S400) and determines a pet's state (S410).

At this time, the state of the pet is judged by using a method of analyzing the sound of the pet as described above.

In addition, judgment as to whether the object of the received image data is a pet or not can also be performed. This process can be applied to the determination of the position of a pet, the case of a large number of pets, the environment where a person and a pet are together.

Such an operation can be performed by a motion recognition method. It is possible to extract feature points from specifically acquired image data, and determine whether the object is a person, an animal, or an individual or a cat based on the minutiae. This can be done by building a minutiae type according to the type of object in advance in a database and comparing it with an input signal.

In addition, by adopting the learning mode, feature points are extracted while photographing real-time pets in the home, and IDs and minutiae information about the animals are stored, so that minutia information about individual pets is more accurately constructed as a database You can judge.

If it is determined in step 410 that the current setting mode is the automatic mode or the manual mode in step S420, a feedback signal is automatically determined in step S430, (S440)

At this time, the main terminal 30 is preset with the algorithm used in the automatic mode adoption, and this algorithm has already adopted the default mode, and the user can correct this by some input.

If it is determined in step 420 that the mode is the manual mode, voice, image, and status information of the pet are transmitted to the user terminal 10 in a push alarm or the like (S450).

The user can receive the notification message even when the user terminal does not execute the application on the user terminal 10 because it is transmitted through a push alarm method or the like. S300).

In particular, this method is very effective because the main terminal 30 itself determines the state of the pet and transmits the state information of the pet to the user according to the determined state by the push alarm.

Depending on the setting, it may be possible to set only the status information set by the user to be provided as notification information.

At this time, the user terminal 10 receives the voice, image, and command information of the user (S310) and transmits it to the main terminal 30.

The main terminal 10 receives the user's voice, image and command information (S460), outputs the user's voice and image signal (S470), and outputs a feedback signal (S475).

Likewise, voice and image data of the pet after outputting the feedback signal is transmitted to the user terminal 10 (S480).

The user terminal 10 receives the voice and image data of the pet (S330), outputs the voice and image data, and transmits a confirmation message to the main terminal 30 when the user confirms it.

When the main terminal 30 receives the confirmation message 490, the operation of the notification mode ends.

In addition, the pet hobo system and method according to the present invention may adopt an embodiment in which a plurality of main terminals are configured, and may support a plurality of air feeders for households with several pets. .

That is, for example, a main terminal is provided for a living room, a main terminal is installed in another room such as a baby's room, a main terminal capable of photographing both the outside and inside of the door is installed in the entrance door, A plurality of main terminals may be installed where necessary.

In this case, the image information of a place such as a living room, a kitchen, a baby room, etc. can be acquired through a camera installed in the main terminal, and an infrared communication module installed in the main terminal can be used to control a living room TV, an air conditioner, The operation can be controlled.

In particular, the main terminal installed in the door is made compact so that the camera module can photograph both inside and outside the door, so that the user can check the visitor through the user terminal to automatically open or close the door, or voice the visitor in connection with home automation. And you can also talk directly to the video.

Such a system can be extended to a solution that can grasp the movement of the elderly for the elderly living alone and send a message to the guardian and the related institution in cooperation with the elderly living alone. In addition, as mentioned briefly above, mVoIP solution which enables bi-directional communication is activated by the visitor pushing the doorbell in connection with home automation in the home, and the visitor checks the face of the visitor and the visitor confirms the landlord's face and makes a video call in both directions If the visitor is a relative or a child, the system can be extended to a system that automatically opens and closes the front door at a remote location.

That is, when the house is emptied, it can be applied to other places as long as it can control home appliances in the home using bidirectional communication or perform bidirectional voice and video communication with a person or an animal in the home.

The embodiment of the present invention has been described above with reference to the drawings. However, this is only for the purpose of describing the present invention and is not described to limit or limit the contents of the present invention. Therefore, those skilled in the art can make various modifications and equivalents therefrom. It will be possible to implement one other embodiment, therefore, the true technical protection scope of the invention should be defined by the technical details of the appended claims.

5: server 10, 20: user terminal
30: main terminal 40: television
50: automatic feeder 60: camera
70: audio device 80: stove

Claims (20)

A main terminal for controlling an operation of a home appliance connected to a wired / wireless network and receiving voice and video information from the home appliance or a built-in camera and a microphone;
A user terminal for receiving and outputting the voice and image information from the main terminal through a wired / wireless network, receiving a control command, user voice and image information input by a user, and transmitting the voice and image information to the main terminal;
A server performing an authentication procedure to enable real-time two-way communication between the main terminal and the user terminal; And
Includes an automatic feeding machine for providing water, feed and snacks to pets,
The main terminal and the user terminal are each composed of one or more and can perform an authentication procedure through the server. The main terminal and the user terminal are connected to each other via an Internet network including a mobile communication network, a Wi- , One-to-many, many-to-many, and many-to-many,
The main terminal outputs the voice and image information of the user transmitted from the user terminal through the home appliance or a built-in display unit and a speaker, and operates the home appliance, the automatic feeding machine or the main terminal according to the control command. Control the automatic feeder through one wire or wireless network when one or more of the pets are determined to be hungry when the user's feed command is inputted. Pet protection system, characterized in that provided. The method of claim 1,
The main terminal,
Communication unit for transmitting and receiving data with the home appliance or the user terminal through a wired or wireless network;
A camera unit obtaining image information;
A microphone unit for acquiring voice information;
A speaker unit for outputting a voice signal;
A display unit for displaying an operation state of the main terminal;
An infrared communication unit for performing infrared communication with the home appliance; And
Pet protection system comprising a main processor for controlling the overall operation of the main terminal. The method of claim 1,
The user terminal comprises:
A communication unit for transmitting and receiving data to and from the main terminal through a wire / wireless network;
A camera unit for acquiring image information of a user;
A microphone unit for acquiring voice information of a user;
A display unit for outputting image information;
A speaker unit for outputting audio information;
An input unit for receiving a user control command; And
Pet control system comprising a control unit for controlling the overall operation of the user terminal. The method of claim 1,
The main terminal,
Pet protection system, characterized in that for determining the emotional state of the pet based on the received voice information. The method of claim 1,
The main terminal,
And extracting feature point information from the received image information, and distinguishing a person from a pet using the extracted feature point information. The method of claim 5,
The main terminal,
Based on the feature point information of the pre-built pet or the extracted feature point information, the feature point information of the pet learned in real time is built into a database, and a person and a pet are distinguished based on the database, or each pet is Pet protection system, characterized in that distinguishing. The method of claim 1,
The main terminal,
The pet protection system, characterized in that for determining the status of the pet based on the received voice and video information of the pet, and transmits the determined status information to the user terminal via a wired or wireless network. The method of claim 1,
The main terminal,
The pet's state is determined based on the received voice and video information of the pet, and the output signal required for the pet is automatically determined according to a preset algorithm based on the determined state information. And controlling the main terminal to generate the determined output signal.
9. The method of claim 8,
The main terminal,
And determine the sound information necessary for the pet based on the determined state information, and output the determined sound information through a speaker of the home appliance or the main terminal. delete The method of claim 1,
The automatic feeder further includes a lighting unit,
The main terminal pet protection system, characterized in that for controlling the on and off of the lighting unit via a wired or wireless network based on the control command or the illumination sensor value input by the user. One or more user terminals access the server and perform an authentication procedure to enable one-to-one, one-to-many, many-to-one, or many-to-one real-time bidirectional communication through one or more main terminals and an Internet network including a mobile communication network and a Wi- ;
Acquiring voice and video information in a home using a main terminal;
Transmitting the obtained voice and image information to the user terminal through the wired / wireless network;
Receiving user control commands, user voice and image information from the user terminal;
Transmitting, by the user terminal, the input control command, user's voice and image information to the main terminal;
Outputting, by the main terminal, the voice and image information of the user transmitted from the user terminal through a home appliance through a wired or wireless network or through a built-in display unit and a speaker;
Controlling, by the main terminal, an operation of the home appliance or the main terminal according to the control command transmitted from the user terminal; And
The main terminal controls the automatic feeder through a wired or wireless network when one or more of the pets are determined to be hungry when a feed command is input by a user. Pet protection method comprising the step of providing an ideal. The method of claim 12,
And determining, by the main terminal, an emotional state of the pet based on the obtained voice information. The method of claim 12,
Extracting, by the main terminal, feature point information from the obtained image information;
The main terminal further comprises the step of distinguishing between the person and the pet using the extracted feature point information. The method of claim 12,
Constructing, by the main terminal, feature point information of a pet learned in real time based on the feature point information of the previously built pet or the extracted feature point information into a database; And
The main terminal further comprises the step of distinguishing between the person and the pet, or each pet based on the database. The method of claim 12,
The main terminal judging the state of the pet based on the obtained voice and image information of the pet; And
And transmitting the determined state information to the user terminal through a wired or wireless network. The method of claim 12,
The main terminal judging the state of the pet based on the obtained voice and image information of the pet;
The main terminal automatically determining an output signal required for a pet based on the determined state information according to a predetermined algorithm; And
And controlling, by the main terminal, the home appliance or the main terminal to generate the determined output signal. 18. The method of claim 17,
The main terminal determining sound information necessary for a pet based on the determined state information; And
And outputting the determined sound information through a speaker of the home appliance or the main terminal. delete The method of claim 12,
And providing the light to the automatic feeding machine by controlling the on / off of the lighting unit through the wired / wireless network based on the control command or the illumination sensor value input by the user. Way.

Images