KR20140089740A - Portable terminal, electric equipment and monitoring system - Google Patents

Abstract

The present invention comprises a monitoring device for collecting at least one piece of monitoring information among sound information and image information from an object to be monitored, and selectively transmitting the collected monitoring information; at least one electrical appliance for identifying a current mode, and controlling the output of the monitoring information transmitted by the monitoring device based on the identified current mode; and a network for connecting the monitoring device and at least one electrical appliance by communications. According to the present invention, by monitoring a baby using an electrical appliance and a smartphone, a guardian can do house chores such as cooking without worrying about the baby because the guardian watches a situation of the baby when the baby sleeps alone in a room, and can quickly recognize emergency situations, for example crying or falling out of a bed, and can take an action.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a portable terminal,

The present invention relates to a portable terminal for monitoring an object to be monitored, an electric appliance for communicating with the portable terminal, and a surveillance system including the same.

In recent years, as crimes such as murder, robbery, thieves, and arson have increased, interest in security has increased, and a surveillance system has been developed to monitor the emergency situation.

The surveillance system is a video storage device (DVR) composed of a plurality of cameras, computers, information transmission cables and displays installed on buildings, roads, etc., and someone has to check images in real time for security and surveillance. And the stored image was used to check the event occurrence after the event.

On the other hand, in such a surveillance system, if the subject to be monitored is a baby, the parent or guardian who raises the baby should always protect and monitor the baby. However, guardians often need to do other things while caring for the baby, especially after the baby is asleep, watching television or doing other work.

In such cases, the guardian may not be aware of the condition of the baby, so it is often difficult to recognize that the baby is waking up and crying, leaving the baby for long periods of time, and taking appropriate action when a sudden There was a time lapse, and there was a problem that the baby could not move to an emergency and could not solve the emergency situation.

Therefore, there is a need for a technology that can monitor the status of a surveillance target such as a baby in real time and inform the guardian thereof.

A portable terminal for collecting monitoring information of a monitoring object in real time using a portable and movable monitoring device and selectively transmitting monitoring information of the collected monitoring object to at least one electric device, Provides a surveillance system.

Another aspect provides an electric device that selectively performs a monitoring function while performing a predetermined inherent function, and outputs monitoring information of a monitored object collected by the monitoring device in a monitoring mode, and a monitoring system including the electric device.

Another aspect of the present invention provides a mobile terminal for changing operation information output in response to a received voice communication signal when a voice communication signal is received in a monitoring mode, and a monitoring system including the monitoring device.

According to one aspect of the present invention, there is provided a portable terminal comprising: a communication unit for communicating with at least one electric appliance installed in a house through a network; A monitoring information collecting unit for collecting at least one monitoring information of the sound information and the image information from the monitoring target; And a control unit for determining an emergency state of the monitoring target based on the collected monitoring information and generating a signal to be transmitted to at least one electric device through the network.

If the collected sound information is equal to or greater than the reference dB, the control unit determines that the monitoring target state is an emergency.

The control unit reads the baby's crying sound from the collected sound information, and judges whether the state of the monitored object is in an emergency state.

The control unit generates the sound information as a signal, and the communication unit transmits the generated signal to at least one electric device.

The portable terminal may further include a storage unit for storing the content and an execution program for executing the content, and the control unit operates the execution program to execute the content stored in the storage unit.

The control unit reads the motion of the object to be monitored from the collected image information and determines whether the state of the object to be monitored is an emergency state.

The control unit generates the image information as a signal, and the communication unit transmits the generated signal to at least one electric device.

The portable terminal further includes a storage unit for storing the content and an execution program for executing the content, and the control unit operates the execution program to execute the content stored in the storage unit.

According to another aspect of the present invention, there is provided an electric device comprising: a communication unit for communicating with a portable terminal in another room in a house through a network; Determining whether the current mode is the normal mode or the surveillance mode, and reading out at least one of surveillance information among the signals transmitted from the portable terminal, if the current mode is the surveillance mode, and controlling the output; And an output unit for outputting monitoring information of at least one of sound information and image information.

The electric device further includes a human body detecting unit for detecting the presence of a person located in the vicinity, and the controller determines the current mode as a monitoring mode when the presence of a person is detected.

And determines the current mode based on the signal transmitted from the portable terminal.

The electric device further includes a mode input unit for receiving the current mode, and the controller determines that the current mode is the monitoring mode when the monitoring mode is input to the mode input unit.

The controller may further include at least one of a sound and an image input from the information input unit through a communication unit to a monitor device when the current mode is the monitor mode, .

The monitoring system includes a monitoring device for collecting monitoring information of at least one of sound information and image information from a monitored object, and selectively transmitting the collected monitoring information; At least one electric device for judging a current mode and controlling the output of the monitoring information transmitted from the monitoring device based on the determined current mode; And a network for communicatively connecting the monitoring device and the at least one electrical device.

The monitoring device includes a portable terminal.

The monitoring device is selected from a normal mode or a monitoring mode among the current modes of at least one electric device.

The electric device includes at least one of a refrigerator, a washing machine, a cooking appliance, a dishwasher, an air conditioner, and a television.

The surveillance device reads the baby's crying sound from the collected sound information and judges whether the state of the monitored object is in an emergency state.

The monitoring device reads out the motion of the monitoring object from the collected image information and judges whether the state of the monitoring object is an emergency state.

The monitoring device includes a storage unit for storing contents and an execution program for executing the contents, and when it is determined that the state of the monitoring object is an emergency state, an execution program is operated to execute predetermined contents stored in the storage unit.

According to one aspect, by monitoring the situation of a baby through an electric device and a smartphone, even when the baby is sleeping in the room alone, the guardian can rest assured that the baby can perform housework such as cooking while watching the baby's condition, The caregiver can quickly recognize and cope with an emergency situation in which the person has fallen from the hospital.

In addition, by outputting both images and voices that can determine the state of the baby through a plurality of electric devices disposed in the grooves, it is possible to eliminate the inconvenience that a guardian has to carry a separate monitoring device for monitoring the state of the baby .

In addition, when the caregiver detects an abnormality in the course of other work, it can immediately detect it and immediately take measures to provide convenience and stability in caring for the baby. It is possible to prevent troublesome situations from occurring.

In addition, when there is a possibility of an emergency, it notifies the caregiver of the possibility of an emergency, so it is not necessary to observe the baby's image continuously and provides convenience to the caregiver and allows the caregiver to concentrate on other tasks .

In addition, when a voice communication signal transmitted from another communication terminal is received, the output of information related to the voice communication can be changed so that an obstacle such as awakening the baby can be eliminated in advance.

In addition, it is possible to efficiently monitor the monitoring target state by outputting the monitoring target information to the electric device selected by the guardian or automatically outputting the monitoring target information to the electric device disposed at the place where the guardian is located.

1 is an exemplary diagram of a surveillance system according to an embodiment.
2 is a configuration diagram of a monitoring system according to an embodiment.
3 is a detailed configuration diagram of a monitoring apparatus provided in the monitoring system according to the embodiment.
4 is a configuration diagram of a mounting portion of the monitoring apparatus provided in the monitoring system according to the embodiment.
5 is a detailed configuration diagram of an electric device provided in the monitoring system according to the embodiment.
6 is a control flowchart of the monitoring apparatus provided in the monitoring system according to the embodiment.
FIGS. 7A, 7B, 7C and 7D are control examples of a smartphone when a smartphone is used as a monitoring device.
8 is a control flowchart of the electric apparatus provided in the monitoring system according to the embodiment.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

2 is a block diagram of a monitoring system according to an embodiment of the present invention. The monitoring system includes a monitoring device 100, a network 200, and a plurality of electric devices 300a, 300b, 300c.

The surveillance system collects surveillance information of the surveillance object in the first space using the surveillance apparatus 100 arranged in the first space Room 1 and transmits surveillance information of the surveillance surveillance object to the surveillance system 100 in a different space Room 4 to monitor the state of the monitored object in a space different from that of the monitored object.

The monitoring device 100 may be a portable device such as a smart phone or a notebook computer, an IP camera, or a cleaning robot.

When a device such as a smart phone, which is difficult to fix itself, is used as a monitoring device, the monitoring device 100 further includes a mounting portion 170 for fixing the posture.

At this time, it is possible to orient the camera and the microphone of the smartphone toward the object to be monitored by adjusting the direction and position of the mounting part.

The monitoring device communicates with at least one electric device among a plurality of electric devices through wired / wireless communication.

The network 200 is a home network in which all the electric / electronic devices used in the home are connected to one wired / wireless system and bidirectional communication is possible.

More specifically, the network 200 allows information to be shared between an electric device and a monitoring device such as a refrigerator, an air conditioner, a cooking device, a television, a washing machine, and a dishwasher through a wired / wireless Internet.

Home transmission schemes can be divided into wired and wireless, and typical examples of the wired type are Home Phoneline Networking Alliance (PNA), IEEE 1394, and power line using conventional telephone lines, and Home Radio Frequency ), Bluetooth, IrDA (Infrared Data Association), and wireless LAN (Wifi).

The electric devices 300a, 300b, and 300c include an output unit capable of outputting information, and perform predetermined functions. The electric devices 300a, 300b, and 300c perform a monitoring function to output monitoring information to be monitored through an output unit as an additional function.

Such electric devices include devices 300a and 300b disposed in a space different from that of the object to be monitored and outputting monitoring information of the object to be monitored and devices for outputting care information disposed in the same space as the object to be monitored 300c.

The electric device may be a home appliance 300a that is not portable such as a washing machine, a dishwasher, a cooking appliance, an air conditioner, or a television set disposed in a groove, and a terminal 300b used in a home such as a notebook PC, .

FIG. 3 is a detailed configuration diagram of a monitoring apparatus provided in the monitoring system according to the embodiment, and FIG. 4 is a configuration diagram of the mounting unit of the monitoring apparatus provided in the monitoring system according to the embodiment.

3, the monitoring apparatus 100 includes a monitoring information collection unit 110, a first input unit 120, a first control unit 130, a storage unit 140, a first output unit 150, And a first communication unit (160).

In addition, the monitoring apparatus 100 further includes a mounting portion 170 for fixing the main body when the apparatus is difficult to fix itself.

That is, the monitoring apparatus 100 includes a first monitoring information collection unit 110, a first input unit 120, a first control unit 130, a storage unit 140, a first output unit 150, and a first communication unit 160 And a mounting portion for supporting the main body detachably coupled to the main body and coupled to the main body.

The monitoring information collection unit 110 collects the monitoring information of the monitoring object in real time in the monitoring mode and transmits the collected monitoring information to the first control unit 130. [

The monitoring information collecting unit 110 collects images and sounds to be monitored as information for determining the state of the monitoring target. To this end, the surveillance apparatus further includes a camera, which is a video collecting unit, and a microphone, which is a sound collecting unit.

Here, the microphone collects the voice of the guardian in voice recording of the guardian and transmits the voice to the first controller 130.

The first input unit 120 receives a monitoring mode from the user and transmits an input signal of the monitoring mode to the first control unit 130.

The first input unit 120 selectively receives an electric device for transmitting monitoring information to be monitored, receives age information of a monitoring target, and transmits the input information to the first control unit 130.

The first input unit 120 receives a command for automatically outputting care information.

The first input unit 120 includes a recording button for voice recording of a guardian.

The first control unit 140 controls the monitoring information collection unit 110 and the first communication unit 160 to operate in the monitoring mode. This will be explained in more detail.

The first controller 130 switches the current mode to the monitoring mode and controls the operations of the camera and the microphone, which are the monitoring information collecting unit 110, when the execution command of the monitoring mode is input to the first input unit 120. [

The first control unit 130 detects the amount of the battery and outputs the monitoring information to be monitored in the same manner as the at least one electric device based on the detected amount of the battery or collects only the sound information, It is also possible to operate the camera.

The first control unit 130 can determine whether the commercial power supply AC is supplied from the outside in a state where the main body is mounted on the mounting unit 170 and control the information collection according to whether the commercial power supply is supplied.

For example, if the external power supply is supplied to the surveillance system, both the camera and the microphones are operated. If the commercial power is off, only the microphones are operated and the camera is operated only when there is a possibility of emergency.

The first control unit 130 compares and analyzes the monitoring information and the reference information to be monitored, determines an emergency condition to be monitored based on the comparison analysis result, and notifies the at least one electric device of the notification information Lt; / RTI >

This will be explained in more detail.

The first controller 130 compares the video information of the monitored object collected in real time on a reference time basis to determine the number of movements of the monitored object for a predetermined time, compares the determined number of movements with the reference number, Determine the likelihood.

The first controller 130 determines an area where the object to be monitored is located in the image to be monitored, compares the determined object area with the reference area, and if it is determined that the object is located outside the reference area, .

The first controller 130 compares the sound information of the monitored object collected in real time with the reference decibel (dB) to determine an emergency condition.

That is, the first controller 130 determines the sound size from the collected sound information, compares the determined sound size with the reference decibel, and determines that the monitored object is in a critical state if the determined sound size is equal to or greater than the reference decibel size.

In addition, the first controller 130 determines the occurrence frequency of the sound based on the sound information collected in real time, compares the occurrence frequency of the sound with the reference occurrence frequency, and if the sound occurrence frequency is more than the reference occurrence frequency, It is determined that the target is in an emergency state.

In addition, the first controller 130 may determine the emergency state based on both the magnitude of the sound and the frequency of sound generation.

The first control unit 130 changes the reference information for determining the emergency state based on the inputted age or month number information of the monitoring target and also changes the reference information for determining the emergency state based on the inputted age or month number information of the monitoring target, The care information output from the control unit 150 is changed.

The first control unit 130 determines whether the automatic output of the care information is set by the caregiver and controls the care information to be output based on whether or not the automatic output of the care information is set.

For example, when the care information is an image, the first controller 130 controls the operation of the display device, which is set in advance so that the image is automatically output to the display device disposed in the same space as the monitored object.

The first control unit 130 controls the operation of the first sound unit 152 of the first output unit so that preset music is automatically output when the care information is music.

In addition, when the care information is voice, the first controller 130 controls the operation of the first sound unit 152 of the first output unit so that a preset voice is automatically output.

The first control unit 130 controls the first sound unit 152 so that audio information of a guardian transmitted from at least one electric device is output in real time when audio information is received from at least one electric device.

The first controller 130 controls the sound output of the voice communication when the signal of the voice communication transmitted from the external terminal is received, and controls the information on the received voice communication to be transmitted to at least one electric device.

For example, the first control unit 130 reduces the size of the sound, mutes the sound, or changes the type of the sound.

The first controller 130 may remove the sound indicating that the voice communication signal is received and block the reception of the voice communication signal when the voice communication signal is received.

The first control unit 130 monitors the communication state with the first communication unit 160 and transmits information on the communication failure to at least one electric device when the monitored communication state is in a bad state.

At this time, at least one electric device is an electric device or other electric device that outputs monitoring information to be monitored.

The first control unit 130 prevents the switching to the sleep mode at the time of the monitoring mode, thereby making it possible to continuously monitor the monitoring target.

Also, the first control unit 130 may collect the sound information while maintaining the sleep mode in the monitoring mode, and may control the operation of the monitoring information collecting unit to collect image information only when it is determined that the monitored object is in a critical state.

The first control unit 130 determines which of the plurality of electric devices is the electric device to which the monitoring command is input, and controls the determined electric device to transmit monitoring information to be monitored.

The first controller 130 controls the first controller 130 to transmit the monitoring information to the other electric device when the monitoring command is input from another electric device during the monitoring mode.

The storage unit 140 stores reference sound volume, reference frequency of sound, reference frequency of motion, and the like. In this case, it is also possible to store different information by age.

The storage unit 140 stores voice recorded by a guardian, preset video, preset channel information, and also stores music such as a song, a melody, and a lullaby. At this time, the stored video, channel, voice, and music are used as care information.

The storage unit 140 further stores contents for performing the monitoring mode.

The monitoring device further includes an execution program for executing the content stored in the storage unit 140. The first control unit 130 controls the execution of the execution program in the monitoring mode so that the content stored in the storage unit is operated.

It is also possible to store different information for different age groups.

The storage unit 140 stores sound intensity and vibration intensity of a bell or a melody to be output when a voice communication signal is received from an external terminal.

The first output unit 150 outputs the image information among the information collected by the monitoring information collection unit 110. That is, the first output unit 150 outputs image information output through at least one electric device equally.

In addition, displaying the image to be monitored on the first display unit 151 includes selectively displaying the image in accordance with the amount of the battery in the monitoring apparatus.

The first output unit 150 includes a first display unit 151 for outputting image information collected through a camera and a first sound unit 152 for outputting care information.

The first communication unit 160 performs wired / wireless communication with at least one electric device through the network 200. The first communication unit 160 transmits the collected monitoring information to the at least one electric device in real time.

The first communication unit 160 transmits the received voice information to the first control unit when the monitoring mode execution request signal and the voice information are received from at least one electric device.

The mounting portion 170 is mechanically and electrically connected to an external commercial power supply, and supplies power required for driving the main body from an external commercial power supply to the main body.

The mounting portion 170 can be rotatably provided by the rotation of the rotary member 175.

4, the mounting portion 170 includes a power supply portion 171, a signal input portion 172, an auxiliary control portion 173, and a driving portion 174. [

The power supply unit 171 is connected to an external commercial power supply, receives power from an external commercial power supply, and transmits the supplied power to the main body.

The signal input unit 172 receives the direction information of the monitored object transmitted from the first control unit and transmits the direction information to the auxiliary control unit 173.

At this time, the first control unit recognizes the monitored object, determines the direction of the recognized monitored object, and transmits information on the determined direction of the monitored object to the signal input unit.

The sub control unit 173 controls the pan tilting of the rotary member 175 based on the direction information of the monitored object so that the main body faces the monitored object.

The driving unit 174 pans the rotary member 175 in response to a command from the auxiliary control unit 173.

5 is a detailed configuration of an electric device provided in the monitoring system according to the embodiment. The electric device includes a second input unit 310, a human body detection unit 320, a sound collecting unit 330, a second communication unit 340, A control unit 350, a second output unit 360, and a load unit 370.

Except for the load unit 370 that performs a specific function of the electric device, the remaining components 310 to 360 are configured to perform a monitoring function, which is an additional function, and all of the plurality of electric devices are the same.

The second input unit 310 receives an execution command of the monitoring mode from the mode input unit and transmits an execution command of the input monitoring mode to the second control unit 350.

The second input unit 310 receives a dialogue command for conversation with the guardian and transmits the entered dialogue command to the second control unit 350.

The human body detection unit 320 detects a human body located in the vicinity and transmits a detection signal to the second control unit 350.

The third input unit 330 is an information input unit, and receives information of a guardian or a user. That is, the third input unit 330 collects the voice of the guardian and transmits the collected voice information to the second control unit 350 when the conversation command is input.

In addition, the third input unit 330 may collect the guardian's image and transmit the collected image information to the second control unit 350.

The third input unit 330 includes at least one of a camera and a microphone.

The second communication unit 340 performs wired / wireless communication with the monitoring device 100 through the network 200. [

The second communication unit 340 transmits an execution command signal of the received monitoring mode to the second control unit 350 when the monitoring mode execution command signal is received from the monitoring apparatus.

The second communication unit 340 receives monitoring information transmitted from the monitoring apparatus 100 to the second control unit 350 in real time and also transmits emergency notification information and voice communication information to the second control unit 350 350).

The second control unit 350 controls the entry of the monitoring mode when the human body is detected by the human body detecting unit 320 and controls the entry of the monitoring mode into which the input request command of the monitoring mode is input to the second input unit 310, 2 communication unit 340 receives the execution command of the monitoring mode.

That is, the second control unit 350 controls the second output unit 360 to output the operation information of the unique function related to the load unit 370. If the second control unit 350 enters the monitoring mode, Notification information, information of voice communication, and the like.

The second control unit 350 controls the operation of the second communication unit 340 so that the collected voice information is transmitted to the monitoring apparatus 1000 when the voice of the guardian is collected in the sound collecting unit 330.

The second output unit 360 outputs the operation of the unique function associated with the load unit 370 in the normal mode and outputs monitoring information of the monitoring object transmitted from the monitoring apparatus 100 in the monitoring mode, Information of communication, and the like.

The second output unit 360 includes a second display unit 361 for displaying image information and a second sound unit 362 for outputting sound information.

The load unit 370 is a variety of components that perform a specific function of the electric device, and operates based on commands of the second control unit.

FIG. 6 is a flowchart of a control process of the surveillance system according to the embodiment. FIG. 6 illustrates an example in which the subject is a baby.

First, the monitoring control procedure of the monitoring apparatus 100 will be described.

When the monitoring mode is input (401) to the first input unit, the monitoring apparatus 100 enters the monitoring mode. At this time, the monitoring apparatus 100 operates an information detecting unit for obtaining status information of a monitoring object such as a camera and a microphone.

Also, when the monitoring mode is input, the monitoring apparatus 100 receives (402) information for setting an operating condition.

Here, the operating conditions include a transmission condition for transmitting monitoring information for monitoring, a determination condition for determining an emergency state of a monitoring target, and an output condition for outputting care information to be provided to the monitoring target .

More specifically, the monitoring apparatus 100 selects at least one electric device for outputting monitoring information to be monitored from a guardian.

At this time, the monitoring apparatus 100 communicates with the selected at least one electric device to determine whether or not the state of at least one electric device is capable of executing the monitoring mode. If it is determined that the state of the at least one electric device is executable, And informs the guardian that it is impossible to execute the monitoring mode and that it is necessary to select another electric device.

The electric device selected here is an electric device disposed at a position where the first guardian moves to at least one electric device among a plurality of electric devices, and is also an electric device for first transmitting monitoring information to be monitored.

A plurality of electric devices are devices capable of wired / wireless communication and include terminals used in the home such as a refrigerator, a kimchi refrigerator, an air conditioner, a washing machine, an electric appliance such as a dishwasher, a cooking appliance, a television, and a PC, a tablet and a notebook do.

Also, the monitoring apparatus 100 receives the number of years or months, which is the age information to be monitored. Here, the age information is information used for changing judgment conditions and output conditions.

That is, the monitoring apparatus 100 changes the reference information for determining the emergency state when the monitored object is in the emergency state based on the inputted age information, and changes the care information to be output when stabilizing the monitored object.

Here, the reference information includes the size of the reference sound (i.e., the reference decibel) for each month of the baby, the reference occurrence frequency of the sound, the reference frequency of the motion, the reference area which is the safe range, and the like.

Next, the monitoring apparatus 100 operates an information detecting unit such as a camera and a microphone to collect (403) the monitoring information of the monitoring target in real time.

Next, the monitoring apparatus 100 analyzes the collected monitoring information of the monitored object and simultaneously transmits the collected monitoring information of the monitored object to the selected at least one electric device (404).

Next, the monitoring apparatus 100 compares and analyzes the collected monitoring information of the monitored object with the reference information, determines whether the monitored object is in an emergency state based on the comparative analysis result (Step 405), and if it is determined that the monitored object is in a critical state (406) notification information indicating that the monitored object is in an emergency state to at least one electric device selected by the user.

For example, the monitoring apparatus 100 compares the magnitude of the sound of the monitoring target inputted into the microphone of the monitoring information collecting unit with the magnitude of the reference decibel, and if the sound volume of the monitoring target is larger than the size of the reference decibel, .

Also, the monitoring apparatus 100 compares the frequency of occurrence of the sound to be monitored inputted to the microphone of the monitoring information collecting unit with the frequency of occurrence of the reference, and if there is a frequency of occurrence of the sound to be monitored is greater than the reference occurrence frequency, .

In addition, the monitoring apparatus 100 compares the current image of the monitoring object inputted to the camera of the monitoring information collecting unit with the previous image to determine the number of motions for a predetermined time, and compares the number of judged motions with the reference number, If it is determined that the number of movements is equal to or greater than the reference number, it is determined that there is a possibility of an emergency.

In addition, the monitoring apparatus 100 determines an area where the monitoring object is located based on the image of the monitoring object input to the camera of the monitoring information collecting unit, determines whether the determined area to be monitored is within the reference area, If it is determined that the region is outside the reference region, it is determined that there is a possibility that an emergency occurs.

In addition, the surveillance apparatus 100 outputs care information for assisting the surveillance target when it is determined that the state of the surveillance target state corresponds to a behavior with a low degree of urgency, such as a drool that acts while sleeping.

Here, the care information includes information that allows the baby to feel relieved when provided to the surveillance target, and includes a baby's favorite song, a voice of a guardian, and a video.

Care information is recorded and stored directly by the caregiver or preset information.

That is, the surveillance apparatus 100 outputs a song or a voice of a mother in a sound unit provided therein, or outputs a cartoon image or the like in a display device installed in a space where the baby is located.

In addition, when the information is transmitted from the at least one electric device, the monitoring device 100 may determine whether the transmitted information is voice information, and if the transmitted information is voice information, voice of the guardian, which is voice information, may be output in real time .

Next, the monitoring apparatus 100 determines whether an entry request signal of a monitoring mode is received from any one of the electric devices (407). If it is determined that an entrance request signal of the monitoring mode is received from any one of the electric devices, It is determined whether any one of the electric devices that transmitted the request signal is an electric device that can transmit monitoring information to be monitored.

When the monitoring device 100 determines that any one of the electric devices is an electric device capable of transmitting the monitoring information of the monitoring object, the monitoring device 100 approves any one of the electric devices as an electric device for transmitting monitoring information to be monitored.

When the monitoring is completed, the monitoring device 100 selects one of the electric devices as an electric device to transmit the monitoring information to be monitored (step 408), and performs bidirectional communication with one of the electric devices, And transmits the monitoring information of the monitoring target in real time.

At this time, the monitoring apparatus 100 selects one or a plurality of electric devices to transmit monitoring information to be monitored based on predetermined transmission conditions or information transmitted from any one of the electric devices, And transmits monitoring information.

For example, when the surveillance apparatus 100 transmits the surveillance request signal of the surveillance mode to the first electrical device, the second electrical device transmits the surveillance request signal of the surveillance mode to the second electrical device, Only the monitoring information of the monitored object is transmitted to the device.

On the other hand, when the surveillance apparatus 100 transmits the surveillance request signal of the monitoring mode to the second electrical device in a state of transmitting the monitoring target information to the first electrical device, when the simultaneous transmission request signal is received, 2 Transfer monitoring information to the electric device.

Also, in the case where the monitoring device 100 is set to transmit monitoring information of only a single electric device to the monitoring device 100, the monitoring device 100 monitors the monitoring device 100 in a state of transmitting monitoring information to be monitored to the first electric device Mode transmission request signal is transmitted, monitoring information of the monitoring object is transmitted only to the second electric device.

Next, the monitoring apparatus 100 changes the electric apparatus to which the monitoring information to be monitored is to be transmitted, and then transmits the information on the urgency of the monitoring target to the changed electric apparatus.

Next, the monitoring apparatus 100 determines the communication state with the electric device that transmits monitoring information to be monitored while performing real-time monitoring on the monitored object. If it is determined that the communication state is not good at this time, To electrical equipment or other electrical equipment.

FIGS. 7A, 7B, 7C, and 7D illustrate control examples of a smartphone when a smart phone is used as a mobile terminal as a monitoring device. This will be described with reference to FIG.

As shown in FIG. 7A, when the surveillance application M is selected by the guardian, the smartphone executes the selected surveillance app. M.

The next smartphone displays an input window for receiving an operation condition among execution screens of the monitoring application (M). At this time, the operating condition is inputted by the user.

As shown in FIG. 7B, the smart phone displays a list of output devices to output monitoring information to be monitored, and also displays a list of age and month number for inputting the age information of the monitoring target.

The next smartphone enters the monitoring mode by operating the camera 101 and the microphone 102 when an operation condition for monitoring is inputted.

As shown in FIG. 7C, the smart phone collects surveillance information of the surveillance object in the first space ROOM1 using the camera 101 and the microphone 102, and outputs the surveillance information to the first output unit.

As shown in FIG. 7D, the smartphone transmits the collected monitoring information to the refrigerator 300a of the second room ROOM2, and outputs the monitored information to the output units 360: 361 and 362 of the refrigerator.

At this time, the smartphone is placed on the mount and the camera 101 and the microphone 102 of the smartphone are directed to the baby to be monitored.

The smart phone is selectively supplied with external power in a state of being mounted on the stationary part 170. At this time, the smartphone can control the operations of the information detecting unit and the output unit according to whether external power is supplied or not.

More specifically, when it is determined that power is supplied from an external commercial power supply, the smartphone executes a monitoring mode while being supplied with power from an external commercial power supply. At this time, the smartphone operates both the camera and the microphones in a state in which the present mode is prevented from being switched to the sleep mode, collects the monitoring information of the monitoring object, and transmits the collected monitoring information to the electric device. It is also possible for the smart phone to simultaneously output the monitoring information to be monitored in the output unit.

On the other hand, when the smart phone is determined to be in a state where the power supplied from the external commercial power source is blocked (for example, when the connector is disconnected from the external commercial power source), the current mode is switched to the sleep mode So that the power consumption is minimized. Then, only the microphone 102 is operated to collect only the sound information, and the monitoring mode is executed. If it is determined that the monitored object is in an emergency state based on the sound information, And transmits them to the electric device. It is also possible for the smart phone to block the output of monitoring information of the monitoring object from the output unit.

The next smartphone minimizes or mutes the bell / melody sound when a signal of voice communication transmitted from an external terminal is received during monitoring mode.

At this time, it is also possible to change the bell / melody to a bell / melody such as a lullaby that can stabilize the monitored object.

In addition, when the notification setting according to the reception of the voice call signal is vibration, the smart phone can minimize the intensity of the vibration or stop the output of the vibration when a signal of the voice communication transmitted from the external terminal is received.

And the smart phone transmits information about voice communication to the electric device. Herein, the information on the voice communication includes the number of the caller and the received time.

In addition, when the smart phone receives a voice communication signal transmitted from an external terminal during execution of the monitoring mode, it is possible to block the reception of voice communication.

The smartphone can determine whether the current time is the alarm time during the monitoring mode, and change the output information of the alarm when it is determined that the current time is the alarm time.

For example, you can change the alarm sound to a bell / melody like lullaby, or minimize or mute the sound of the alarm sound.

If it is determined that the state of the surveillance target is low, the smartphone may output the lullaby, the voice of the guardian, and the like, which are care information previously stored through the speaker 152 of the smartphone.

Also, if it is determined that the status of the monitored object is low, the smart phone can transmit the ON signal and the channel signal of the display device disposed in the space where the monitored object is located. In this way, it is possible to output a video image that the monitoring object likes in the display device.

The smart phone determines the communication state with the first electric device that transmits the monitoring information to be monitored and transmits the communication failure information to the first electric device when it is determined that the communication state with the first electric device is not good, It is also possible to transmit the communication failure information with the first electric device to the second electric device disposed in the same space as the first electric device or to the third electric device arranged adjacent to the first electric device.

The arrangement information of a plurality of electric devices is set in the smartphone.

In addition, the surveillance app on your smartphone includes more features such as channel settings, bell / melody / lap settings and recording. That is, the user can record the voice of the guardian etc. on the smartphone after selecting the recording function.

At this time, the set channel, the bell / melody / lullaby, and the recorded voice are stored in the smartphone and used as care information provided to the monitored object.

In this way, by monitoring the situation of the baby through the electric device and the smartphone, even when the baby is sleeping in the room alone, the guardian can rest assured that the child can perform housework such as cooking while watching the baby's situation, The caregiver can quickly recognize and respond to emergencies.

Fig. 8 is a control flow chart of an electric device provided in the monitoring system according to the embodiment, with reference to Fig. 1. Fig.

As shown in FIG. 1, a space in which a monitoring object is positioned and a monitoring device 100 is disposed is referred to as a first space Room1, a space different from the first space is defined as a second space Room2, a third space Room3, 4 room (Room 4). In the second room (Room 2), a refrigerator (300a), a dishwasher and a cooking device are arranged, and a washing machine is disposed in a third space (Room 3). In the fourth room (Room 4) And a notebook computer 300b are arranged in the first space and a display device 300c as a third electric device is further disposed in the first space Room1.

It is assumed that the refrigerator 300a in which the first electric device can not be carried, the second electric device in which the portable device is movable is the notebook 300b, and the third electric device arranged in the same space as the monitor device is the display device 300c.

The first electric device 300a performs a unique refrigeration function and a freezing function. When the execution of the monitoring mode is requested 501, the first electric device 300a enters the monitoring mode (502).

At this time, the first electric device 300a determines whether execution of the monitoring mode is requested.

Here, the execution request of the monitoring mode is executed when the execution request signal is transmitted from the monitoring apparatus 100, a monitoring command is input to the input unit of the first electric device 300a, or when the human body of the protector is detected by the human body detecting unit Is requested.

In addition, the human body detection unit of the electric device arranged in the same space as the object to be monitored is deactivated in order to prevent the monitoring object from being detected as a guardian.

The first electric device 300a communicates with the monitoring device and activates the operation of the display unit and the sound unit, which are the output unit, so that the monitoring target image is displayed in real time on the display unit, and the sound of the monitoring target is output 503).

At this time, the guardian located in the second space can grasp the state of the monitoring object located in the first space through the image and sound of the monitoring object outputted to the refrigerator which is the first electric device 300a.

Next, the first electrical apparatus 300a judges whether notification information indicating that the monitoring target is in a critical state is received (504) from the monitoring apparatus 100. If it is determined that the notification information has been received from the monitoring apparatus at this time, (505) that the emergency state is present.

At this time, the guardian confirms the image of the monitoring object outputted on the display unit of the first electric device 300a, and recognizes the emergency situation to be monitored. If it is determined that the state of the monitoring target is not in the critical state or the emergency state is low Inputting commands for outputting care information and for requesting conversation.

That is, when the reset command is inputted by the guardian, the first electric device 300a stops the output of the notification information and outputs the care information to the monitoring device 100 so that the care information is outputted when the output instruction of the care information is inputted. Signal.

At this time, when commanding the output of image information to the care information, the monitoring apparatus 100 communicates with the display device 300a as the third electric device, turns on the display device, changes the channel to a previously stored channel, and outputs the broadcast .

The first electric device 300a performs bidirectional communication with the monitoring device 100 when the conversation command is input 506 and transmits the voice information to the monitoring device 100 through the monitoring device 100 So that the voice of the guardian is outputted.

Next, the first electric device 300a determines whether the voice communication information is received (508). If it is determined that the voice communication information is received, the first electric device 300a displays the voice communication information on the display unit, (509).

Here, the order of judging the reception of the notification information, the input of the dialogue command, and the reception of the voice communication information may be variable.

Next, when the communication failure information is received from the monitoring device, the first electric device outputs a communication failure with the monitoring device so that the guardian can recognize the communication failure between the monitoring device and the first electric device.

In addition, when the first electric device receives communication failure information from the monitoring device while outputting monitoring information to be monitored from another electric device, the first electric device outputs communication failure information between the other electric device and the monitoring device.

While the first electric device is outputting the monitoring information to be monitored, when the monitoring mode is executed in the second electric device (300b), which is another electric device, the output of the monitoring information to be monitored is stopped and the refrigerator . At this time, the second electric device 300b enters the monitoring mode.

Here, the device for outputting the monitoring information of the monitoring object is changed if another output device is input to the input unit of the monitoring device, a monitoring command is input to the second electric device 300b, And changing when a human body is detected.

When the second electric device 300b is requested to execute the monitoring mode during the performance of its own function, the second electric device 300b enters the monitoring mode.

At this time, if a monitoring command is input to the second electric device 300b or if a human body is detected in the second electric device 300b, the communication unit is operated to transmit a request signal for entering the monitoring mode to the monitoring device 100, 100 to the monitoring apparatus 100 to receive the monitoring information to be monitored from the monitoring apparatus 100 and operates the output unit to monitor the received monitoring information in real time .

The subsequent steps are the same as those performed when the first electric device is used to perform the monitoring mode, and thus the description thereof will be omitted.

By outputting both the video and the voice capable of judging the state of the baby through the plurality of electric devices arranged in the groove in this way, it is possible to eliminate the inconvenience that the guardian has to carry a separate monitoring device for monitoring the state of the baby can do.

In addition, when the caregiver detects an abnormality in the course of other work, it can immediately detect it and immediately take measures to provide convenience and stability in caring for the baby. It is possible to prevent troublesome situations from occurring.

In addition, when there is a possibility of an emergency, it notifies the caregiver of the possibility of an emergency, so it is not necessary to observe the baby's image continuously and provides convenience to the caregiver and allows the caregiver to concentrate on other tasks .

In addition, when a voice communication signal transmitted from another communication terminal is received, the output of information related to the voice communication can be changed so that an obstacle such as awakening the baby can be eliminated in advance.

In addition, it is possible to efficiently monitor the monitoring target state by outputting the monitoring target information to the electric device selected by the guardian or automatically outputting the monitoring target information to the electric device disposed at the place where the guardian is located.

100: Monitoring device 200: Network
300a, 300b, 300c: electrical equipment

Claims (20)

A communication unit for communicating with at least one electric appliance installed in the house through a network;
A monitoring information collecting unit for collecting at least one monitoring information of the sound information and the image information from the monitoring target; And
And a control unit for determining an emergency state of the monitoring target based on the collected monitoring information and generating a signal to be transmitted to the at least one electric device through the network. The apparatus of claim 1,
And determines that the monitoring target state is an emergency if the collected sound information is equal to or greater than a reference dB. The apparatus of claim 1,
And reading a cry of the baby from the collected sound information to determine whether the state of the monitored object is in an emergency state. The method of claim 3,
The control unit generates the sound information as a signal,
And the communication unit transmits the generated signal to the at least one electric device. 5. The method of claim 4,
Further comprising: a storage unit for storing contents; and an execution program for executing the contents,
And the control unit operates the execution program to execute the content stored in the storage unit. The apparatus of claim 1,
And reads the motion of the monitoring target from the collected image information to determine whether the monitoring target state is an emergency state. The method according to claim 6,
The control unit generates the video information as a signal,
And the communication unit transmits the generated signal to the at least one electric device. 8. The method of claim 7,
Further comprising: a storage unit for storing contents; and an execution program for executing the contents,
And the control unit operates the execution program to execute the content stored in the storage unit. A communication unit for communicating with a portable terminal in another room in the house through a network;
A control unit for determining whether the current mode is a normal mode or a monitoring mode and reading out at least one monitoring information among sound signals and image information among the signals transmitted from the portable terminal when the current mode is determined to be a monitoring mode; And
And outputting at least one of the sound information and the image information. 10. The method of claim 9,
Further comprising a human body detecting section for detecting presence or absence of a person located in the vicinity,
Wherein the controller determines that the current mode is the monitoring mode when the presence of the person is detected. 10. The method of claim 9,
And determines the current mode based on a signal transmitted from the portable terminal. 10. The method of claim 9,
And a mode input unit receiving the current mode,
Wherein the control unit determines that the current mode is the monitoring mode when the monitoring mode is input to the mode input unit. 10. The method of claim 9,
And an information input unit for receiving at least one of information, sound, and image,
Wherein the control unit controls the at least one of the sound and the image input from the information input unit to be transmitted to the monitoring device through the communication unit when the current mode is the monitoring mode. A monitoring device for collecting monitoring information of at least one of sound information and image information from a monitored object and selectively transmitting the collected monitoring information;
At least one electric device for determining a current mode and controlling the output of the monitoring information transmitted from the monitoring device based on the determined current mode; And
And a network connecting said monitoring device and said at least one electrical device in communication. 15. The method of claim 14,
The monitoring system includes a portable terminal. The apparatus according to claim 15,
Wherein the normal mode or the surveillance mode is selected from the current mode of the at least one electric device. 16. The method of claim 15,
Wherein the electric device includes at least one of a refrigerator, a washing machine, a cooking device, a dishwasher, an air conditioner, and a television. 15. The method of claim 14,
Wherein the surveillance device reads the baby's crying sound from the collected sound information to determine whether the state of the monitored object is in an emergency state. 15. The method of claim 14,
Wherein the monitoring device reads the motion of the monitored object from the collected image information and determines whether the monitored state is an emergency state. 15. The method of claim 14,
Wherein the monitoring apparatus includes a storage unit for storing contents and an execution program for executing the contents,
And activates the execution program to execute the predetermined content stored in the storage unit when it is determined that the state of the monitoring object is in an emergency state.

Images