WO2015068302A1 - Monitoring device, monitoring system, and method for providing information - Google Patents

Monitoring device, monitoring system, and method for providing information Download PDF

Info

Publication number
WO2015068302A1
WO2015068302A1 PCT/JP2013/080432 JP2013080432W WO2015068302A1 WO 2015068302 A1 WO2015068302 A1 WO 2015068302A1 JP 2013080432 W JP2013080432 W JP 2013080432W WO 2015068302 A1 WO2015068302 A1 WO 2015068302A1
Authority
WO
WIPO (PCT)
Prior art keywords
person
unit
storage unit
information storage
image
Prior art date
Application number
PCT/JP2013/080432
Other languages
French (fr)
Japanese (ja)
Inventor
具徳 野村
鈴木　基之
Original Assignee
日立マクセル株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日立マクセル株式会社 filed Critical 日立マクセル株式会社
Priority to PCT/JP2013/080432 priority Critical patent/WO2015068302A1/en
Publication of WO2015068302A1 publication Critical patent/WO2015068302A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/441—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card
    • H04N21/4415—Acquiring end-user identification, e.g. using personal code sent by the remote control or by inserting a card using biometric characteristics of the user, e.g. by voice recognition or fingerprint scanning
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program

Definitions

  • the present invention relates to a monitoring device, a monitoring system, and an information providing method for detecting a person and performing a predetermined process.
  • Patent Document 1 proposes a television receiver capable of storing a video or audio message and reproducing it as necessary.
  • Patent Document 2 proposes a television receiver that includes a human sensor, determines whether there is a person in the room, and turns off the power when the person is not watching.
  • the usability is not sufficient for the user in various usage environments and usage situations. For example, when a person is detected while absent, a family member and other family members who want to message or another person other than the family member (suspicious person) are not discriminated, and processing according to the discrimination result is not performed, so that the usability is bad.
  • An object of the present invention is to provide a monitoring device, a monitoring system, and an information providing method capable of performing processing according to a detected person when a person is detected while the user is away and improving usability. .
  • the monitoring device includes a human detection unit that detects a person, a camera unit that captures an image of the person, and an individual information storage unit that registers and stores a face image of a specific person in advance.
  • the human detection unit detects a person
  • the camera unit captures an image of the person
  • an individual information storage unit registers and stores a face image of a specific person in advance.
  • the face image captured by the camera unit is compared with the face image stored in the individual information storage unit, and the detected human face is recognized. Based on the recognition result, different processing is performed by a person registered in the individual information storage unit and an unregistered person. If the person is a registered person, the message processing is performed. If the person is not registered, the suspicious person handling process is performed.
  • the notification result is notified to a preset notification destination.
  • the block block diagram which shows one Example of the monitoring system of this invention.
  • the block diagram which shows the structural example of the television receiver 1 as a monitoring apparatus.
  • the block diagram which shows the structural example of a mail server.
  • the whole flowchart which shows the answering machine operation
  • movement The flowchart which shows the modification of an answering machine operation setting process.
  • the block block diagram which shows the 2nd Example of the monitoring system.
  • the block diagram which shows the structural example of a video recording server. 12 is a detailed flowchart of an answering machine operation setting process according to the second embodiment.
  • FIG. 1 is a block diagram showing an embodiment of the monitoring system of the present invention.
  • the monitoring system includes a television receiver 1, a mobile terminal device 2, a mail server 3, routers 4 and 5, an external network 6, a base station 7, and a broadcast station 8.
  • the television receiver 1 and the mobile terminal device 2 are connected to the routers 4 and 5 via a wireless LAN (Local Area Network) or a wired LAN, respectively. Can send and receive. Further, the television receiver 1 can receive and watch a digital broadcast transmitted from the broadcast station 8.
  • a wireless LAN Local Area Network
  • wired LAN Wireless Local Area Network
  • the routers 4 and 5 have a wireless LAN function or a wired LAN function based on Wi-Fi (Wireless Fidelity: trademark) standards such as IEEE802.11a / b / n, and can be connected to the external network 6 via a communication line.
  • Wi-Fi Wireless Fidelity: trademark
  • the portable terminal device 2 is a mail server from the base station 7 via the external network 6 by long-distance wireless communication such as W-CDMA (Wideband Code Division Multiple Access) or GSM (registered trademark) (Global System for Mobile communications). 3 can send and receive emails.
  • W-CDMA Wideband Code Division Multiple Access
  • GSM Global System for Mobile communications
  • FIG. 2 is a block diagram illustrating a configuration example of the television receiver 1 as a monitoring device.
  • the television receiver 1 includes a control unit 101, a face recognition unit 102, a memory 103, a storage 104, a power supply unit 105, an operation key 106, a remote control light receiving unit 107, a human detection unit 108, a communication unit 109, a tuner unit 112, and a demodulation unit 113.
  • the system bus 110 is a data communication path for performing data transmission / reception between the control unit 101 and each unit in the television receiver 1.
  • the television receiver 1 is connected to an antenna 111 and an external device 140 and can be operated with the operation key 106 or the remote controller 150.
  • the control unit 101 includes a CPU and the like, and controls the entire television receiving apparatus 1 according to an operating system, various application programs, and the like stored in the memory 103.
  • the face recognition unit 102 captures an image captured by the camera unit 125 and processed by the image processing unit 118 via the system bus 110, and recognizes a person's face shown on the camera unit 125.
  • the storage unit 104 has a storage area for various information.
  • the individual information storage area 104a stores information on the account of the user connected to the mail server 3, information for recognizing the face used by the face recognition unit 102, setting information related to the answering machine operation, and the like.
  • the program recording storage area 104b stores broadcast program recording and information related to broadcast program recording (reservation information, etc.).
  • the message storage area 104c an image captured by the camera unit 125 and / or a voice captured by the microphone 126 is stored as a message.
  • the answering machine information storage area 104d an image captured by the camera unit 125 and an audio captured by the microphone 126 during the answering machine operation are stored.
  • the operation key 106 detects that the user has pressed the key, and based on the detected key, the control unit 101 instructs channel switching, volume change, and the like.
  • the remote control light receiving unit 107 receives a remote control signal (infrared signal) emitted from the remote controller 150. Based on the remote control signal received by remote control light receiving unit 107, control unit 101 instructs channel selection in channel selection unit 115, change of OSD to be drawn, and the like.
  • the person detection unit 108 is a sensor that detects whether or not there is a person around the television receiver 1. For example, the person detection unit 108 detects whether or not a person is present around by detecting the movement of the heat source or by detecting the difference between the temperature of the heat source and the ambient temperature. An output signal of the human detection unit 108 (hereinafter referred to as a human detection signal) is amplified by an amplifier circuit (not shown) and then converted into a digital signal by an ADC (Analog Digital Converter) (not shown). Via the control unit 101. When there is a person around the television receiver 1 (more precisely, the detection range of the human detection unit 108), the temperature change detected by the human detection unit 108 becomes large.
  • the control unit 101 can determine whether or not there is a person around the television receiver 1 by referring to the value of the human detection signal supplied from the human detection unit 108.
  • the communication unit 109 is connected to the router 4 by a wired LAN or a wireless LAN, and transmits / receives information, voice, image signal, or mail via an external network 6 such as the Internet.
  • the tuner unit 112 extracts a signal superimposed on the channel selected by the channel selection unit 115 from the broadcast signal received by the antenna 111, and supplies the extracted signal to the demodulation unit 113.
  • the demodulation unit 113 generates stream data in a predetermined format (for example, MPEG2-TS format) from the signal extracted by the tuner unit 112 and supplies the generated stream data to the separation unit 114.
  • the separation unit 114 separates the stream data supplied from the demodulation unit 113 into video data, audio data, and additional data.
  • the video data, audio data, and additional data separated by the separation unit 114 are supplied to the video decoding unit 116, the audio decoding unit 123, and the EPG / OSD processing unit 117, respectively.
  • the video decoding unit 116 decodes the video data separated by the separation unit 114.
  • the video signal obtained by the video decoding unit 116 is supplied to the video processing unit 118.
  • the audio decoding unit 122 decodes the audio data separated by the separation unit 114.
  • the audio signal obtained by the audio decoding unit 122 is supplied to the audio processing unit 124.
  • the EPG / OSD processing unit 117 Based on the additional data separated by the separation unit 114, the EPG / OSD processing unit 117 generates a video signal representing a video to be OSD displayed. Examples of the video to be OSD-displayed include EPG and subtitles.
  • the video signal generated by the EPG / OSD processing unit 117 is supplied to the synthesis unit 119.
  • the video processing unit 118 in addition to the video signal from the video decoding unit 116 described above, a video signal output from the external device 140 (for example, an optical disc device) via the external input unit 129, and face recognition at the time of answering machine And a video signal output from the camera unit 125 used for message input or the like.
  • the video processing unit 118 processes a target video signal from among these video signals based on a command from the control unit 101. Examples of the processing here include frame rate conversion.
  • the video signal processed by the video processing unit 118 is supplied to the synthesis unit 119.
  • the synthesizing unit 119 synthesizes the video signal processed by the video processing unit 118 and the video signal generated by the EPG / OSD processing unit 117 and supplies the synthesized signal to the display control unit 120.
  • the display control unit 120 drives the display unit 121 based on the synthesized video signal.
  • the audio processing unit 123 includes an audio signal output from the external device 130 via the external input unit 127 and a microphone 126 that is used when a message is input. The audio signal output from is supplied. The audio processing unit 123 amplifies a target audio signal from among these audio signals based on a command from the control unit 101, and supplies the amplified audio signal to the speaker 124.
  • the camera unit 125 is used for photographing a person / object around the television receiver 1 during face recognition or answering machine operation and for capturing an image when inputting a message.
  • the image captured from the camera unit 125 is a video processing unit 118.
  • the microphone 126 is used for capturing sound from a person / object around the television receiver 1 during the answering machine operation and capturing sound when inputting a message.
  • the sound captured from the microphone 126 is supplied to the sound processing unit 125.
  • FIG. 3 is a block diagram showing a configuration example of the mail server 3.
  • the mail server 3 includes a control unit 301, a memory 302, a communication unit 303, and a storage 304, which are mutually connected by a bus 300.
  • the control unit 301 includes a CPU (Central Processing Unit) and the like, and controls each component by executing a program stored in the memory 302 to perform various processes.
  • the communication unit 303 is an interface for connecting to the external network 6, and sends mail from the external network 6 via the base station 7 or the routers 4, 5 to the television receiver 1, portable terminal device 2, etc. that support network connection. Send and receive.
  • the storage 304 has an area 304a for storing user information such as an account and a password for authenticating each user connected to the mail server 3, and an area 304b for storing each user's mail information.
  • FIG. 4 is an overall flowchart showing the answering machine operation by the television receiver 1.
  • S400 as initial settings for user registration, personal information such as facial images of family members and acquaintances and e-mail addresses is registered.
  • face recognition registration each camera user's face is imaged by the camera 125 and stored in the individual information recording area 104 a of the storage 104.
  • the mail address information is input using the remote controller 150 or the operation key 106, and stored in the individual information recording area 104a in the same manner.
  • the answering machine operation mode includes not only a normal “answering machine mode” in which the user is absent, but also “at-home mode” when the user is at home and is in a room different from the room where the television receiver 1 is installed. Prepare and switch according to the situation. Of course, when the user is in the room where the television receiver 1 is installed, the answering mode is turned off.
  • S402 answering machine setting processing is performed.
  • “suspicious person response”, “notification function”, “message function”, and the like are selected as answering machine functions, and the conditions are set. Details of S402 will be described later with reference to FIG.
  • step S403 the control unit 101 captures the output of the human detection signal from the human detection unit 108.
  • step S ⁇ b> 404 the control unit 101 determines whether there is a person within the detection range of the human detection unit 108 by comparing the value of the human detection signal with a predetermined threshold value. If it is determined in S404 that there is no person (No), the process returns to S403 and takes in the output of the person detection unit 108 again.
  • S404 If it is determined in S404 that there is a person (Yes), the process proceeds to S405, and the control unit 101 captures an image captured by the camera unit 125.
  • face recognition processing is performed based on the user's face recognition registration information stored in advance in the individual information storage area 104a of the storage 104.
  • the face recognized in the face recognition process S406 is compared with the registered user's face to determine whether or not they match. If it does not match the registered user's face (No), the process proceeds to S408, and suspicious person handling processing (warning sound generation, etc.) is executed. Details of the suspicious person handling process in S408 will be described later with reference to FIG.
  • the process proceeds to S409 to determine whether the user is registered in the message destination. If the user is a message destination registered (Yes), the process proceeds to S410, and a message output process is performed.
  • the message output process of S410 the message content (video, audio message, etc.) stored in the message storage area 104c of the storage 104 is output from the display unit 121 or the speaker 124. Thereby, the message content can be transmitted to the person registered in the message destination. If the user is not registered as a message destination in S409 (No), the process proceeds to S411.
  • S411 it is determined whether a notification destination is set.
  • the process proceeds to S412 to perform notification processing.
  • the result of the face recognition process S406 or the like is sent by e-mail to a preset notification destination.
  • the mobile terminal device 2 can receive the mail transmitted in the notification process S412 from the mail server 3 and confirm whether the user registered for face recognition has returned home or whether a suspicious person has entered.
  • the recipient can confirm whether the user is registered for face recognition or a suspicious person by attaching an image when the face is further recognized.
  • the notification method is not limited to e-mail, and may be by telephone.
  • the answering machine operation mode is canceled and the process ends.
  • the answering machine operation of the present embodiment when a person is detected by the camera during absence, it is determined whether or not the person is a registrant based on the user's face recognition registration information, and a suspicious person is handled according to the detected person. Processing such as message processing and notification processing can be performed appropriately.
  • FIG. 5 is a detailed flowchart of the answering machine operation setting process (S402).
  • S501 a screen for selecting an item for setting an answering machine operation is displayed on the display unit 121 (see FIG. 6A).
  • S502 the user selects and inputs setting items displayed on the screen using the operation keys 106 (or the remote controller 150, the same applies hereinafter).
  • S503 the process branches according to the selected setting item. If “end” is selected in the selection input in S502, the answering machine operation setting process ends.
  • S502 If “suspicious person correspondence” is selected in the selection input in S502, the process proceeds to S504, and a suspicious person correspondence setting screen is displayed (see FIG. 6B).
  • S505 the user inputs a suspicious person setting using the remote controller 150, and in S506, the input item is set and registered. Thereafter, the process returns to S501 and the answering machine operation setting selection screen is displayed, and the setting contents can be added or updated.
  • FIG. 6A to 6D are diagrams showing display examples of the display unit 121 in the answering machine operation setting process (S402).
  • FIG. 6A is an example of screen display in the answering machine operation setting selection screen display process (S501), in which the current setting states of the “suspicious person correspondence”, “notification destination”, and “message” items are displayed.
  • the user operates the operation key 106 to change (update) the setting state, that is, the “suspicious person response” button (6a-2), the “notification destination” button (6a-3), and the “message” button (6a-4). ) Is selected. If all the setting states are not changed, the “end” button (6a-1) is selected.
  • FIG. 6B is an example of screen display in the suspicious person setting screen display process (S504), and “warning sound” (6b-2), “warning display” (6b-3), “recording (6b-4)”.
  • “Notification” (6b-5), “Notification destination” (6b-6) the current setting status is displayed.
  • the user selects the “ON” button or the “OFF” button for each setting item using the operation key 106, thereby changing the ON / OFF setting for each item.
  • a mail address of a report destination such as a security company can be input and registered with the remote controller 150.
  • suspicious person information can also be transmitted to the residence area.
  • the e-mail address may be input directly using a numeric keypad (not shown) of the remote controller 150, or a software keyboard is displayed on the screen, and the software is displayed on the remote controller 150 or the like. You may operate by operating the keyboard.
  • the “end” button (6b-1) is selected.
  • FIG. 6C is an example of screen display in the notification destination setting screen display process (S507), and a plurality of notification destinations can be set.
  • a check box (6c-2) for setting whether or not to notify each notification destination, a user registration name (6c-3) of the notification destination, and a mail address (6c-4) of the notification destination can be set.
  • the check box (6c-2) is switched in accordance with whether or not the notification is performed by determining the selected state.
  • the user registration name (6c-3) of the notification destination and the mail address (6c-4) of the notification destination may be directly input using a numeric keypad (numeric key) (not shown) of the remote controller 150.
  • a software keyboard may be displayed on the screen, and the software keyboard may be operated with the remote controller 150 or the like.
  • FIG. 6D is an example of screen display in the message setting screen display process (S510), where the registered user's face (6d-2 to 5) is displayed, and a plurality of message destinations can be set. By selecting the user's face from these, it is switched and set as to whether or not to be the message destination. Further, by selecting the “message input” button (6d-6), it is possible to input a message.
  • a message input method for example, the video and / or voice of the message input person is input and registered by the camera unit 125 and the microphone 126. Alternatively, a message is input by inputting characters with the remote controller 150.
  • the “end” button (6d-1) is selected.
  • FIG. 7 is a detailed flowchart of the suspicious person handling process (S408).
  • processing is performed according to the conditions set in FIG. 6B.
  • S701 it is determined whether the warning sound setting is set to ON in the suspicious person handling setting. If it is set to ON (Yes), the process proceeds to a warning sound output process S702, and a warning sound is generated from the speaker 124.
  • S703 it is determined whether the warning display setting is set to ON. If it is set to ON (Yes), the process proceeds to the warning screen display process S704, and the warning screen is displayed on the display unit 121.
  • S705 it is determined whether the recording setting is set to ON. If it is set to ON (Yes), the process proceeds to the recording process S706, and the video captured by the camera unit 126 and the audio input from the microphone 126 are stored in the answering machine information storage area 104d of the storage 104.
  • S707 it is determined whether the notification setting is set to ON. If it is set to ON, the process proceeds to report process S708, and a report is sent to a preset report destination via the communication unit 109. For example, it is more effective if a security company is set as the report destination. Security companies will contribute to the local crime prevention effect by collecting information (face images) of suspicious persons transmitted from the monitoring devices of each household and reporting them to the police.
  • a process for inputting a password within a predetermined time may be provided at the beginning of the suspicious person processing S408, and the suspicious person processing may be terminated when a correct password is input within the predetermined time.
  • the suspicious person handling process S408 may not be performed.
  • the user's face is recognized and an appropriate process is performed.
  • a pet dog, cat
  • the suspicious person may be handled as a suspicious person.
  • no malfunction will occur if a domestic pet is added to face recognition registration, no malfunction will occur.
  • a method of judging a pet its size and / or shape may be registered and judged. For example, if it is recognized as a pet, it may be determined that there is no person, and the process returns to S403 to capture the output of the person detection unit 108 again.
  • FIG. 8 is an overall flowchart showing a modification of the answering machine operation. This is a modification from FIG. 4, and the same processing parts as those in FIG. In this example, a step S420 for displaying a specific screen after human detection is added, and then the image captured by the camera unit 125 is captured to perform face recognition.
  • the process proceeds to S420, and a specific screen is displayed on the display unit 121. Subsequently, in S405, an image captured by the camera unit 125 is captured, and face recognition processing is performed in S406.
  • the specific screen to be displayed here is preferably a bright screen that is noticed by a detected person. Thereby, the detected person turns his / her face in the direction of the television receiver 1 (camera unit 125), and a bright screen illuminates the detected person as a lighting tool. As a result, it is possible to capture a clear face image even in a dark room, improve the accuracy of face recognition, and easily discriminate between registered users and unregistered suspicious persons.
  • a specific screen is displayed on the display unit 121.
  • a process in which the detected person turns his / her face toward the television receiver 1 may be performed, and a specific sound is output from the speaker 124.
  • produces may be performed and both a screen display and generation
  • FIG. 9 is a flowchart showing a modification of the answering machine operation setting process. This is a modification of FIG. 5, and the same processing parts as those in FIG. In this example, steps S520 to S522 are added in which the user who sets the answering machine is face-recognized and the recognized user is set as the notification destination.
  • an image captured by the camera unit 125 (a user who performs setting work) is captured.
  • face recognition processing is performed based on the user's face recognition registration information stored in advance in the individual information storage area 104a of the storage 104.
  • the recognized user is set as a notification destination. Thereafter, as in FIG. 5, the answering machine operation setting selection screen is displayed on the display unit 121 (S501), and various setting operations are performed.
  • the notification destination setting performed in S507 to S509 can be simplified. If it is desired to set a user other than the setter as the notification destination, the setting may be made through S507 to S509.
  • FIG. 10 is a block diagram showing a second embodiment of the monitoring system of the present invention.
  • the recording server 9 is added to the configuration of the first embodiment (FIG. 1), and the other configuration is the same as that of FIG.
  • the recording server 9 is additionally connected to the external network 6.
  • the television receiver 1 stores in the recording server 9 via the router 4 answering machine information consisting of video captured by the camera unit during voice mail operation and voice input from the microphone.
  • the portable terminal device 2 is connected to the external network 6 via the router 5 by wireless LAN or by the long-distance wireless communication such as W-CDMA or GSM via the base station 7 and stored in the recording server 9. Can be viewed.
  • the hardware configuration of the television receiver 1 is the same as that in FIG.
  • FIG. 11 is a block diagram illustrating a configuration example of the recording server 9.
  • the recording server 9 includes a control unit 901, a memory 902, a communication unit 903, and a storage 904, which are mutually connected by a bus 900.
  • the control unit 901 is configured by a CPU or the like, and controls each component by executing a program stored in the memory 902 to perform various processes.
  • a communication unit 903 is an interface for connecting to the external network 6, and can send and receive answering machine information to and from the television receiver 1 or the mobile terminal device 2 corresponding to the network connection.
  • the storage 904 has an area 904a for storing user information such as an authentication account and a password for each user connected to the recording server 9, and an area 904b for storing answering machine information.
  • the answering machine operation of the television receiver 1 in this embodiment is the same as that shown in FIG. 4 or FIG. 8 except for the answering machine operation setting process S402.
  • FIG. 12 is a detailed flowchart of the answering machine operation setting process (S402) in the present embodiment.
  • the video received by the camera unit 125 and the audio input from the microphone 126 during the answering operation of the television receiver 1 are stored in the recording server 9 or the storage unit as answering information.
  • Recording destination setting processes S530 to S532 for this purpose are added.
  • a recording destination setting screen is displayed in S530.
  • the user inputs a recording destination setting by the remote controller 150.
  • the item input by the user is set and registered, and the process returns to S501.
  • FIG. 13A to 13C are diagrams showing display examples of the display unit 121 in the answering machine operation setting process of FIG.
  • FIG. 13A is an example of screen display in the answering machine operation setting selection screen display process (S501), and an item “recording destination” is added to the screen display example of FIG. 6A.
  • the “recording destination” button (13a-1) using the operation key 106, the screen proceeds to the recording destination setting screen.
  • FIG. 13B is an example of screen display in the recording destination setting screen display processing (S530), and “built-in storage” and “recording server” can be selected as recording destinations.
  • the recording destination is set (or changed).
  • FIG. 13C is an example of a screen display when “recording server” is selected, and an “account name” (13c-1) and “password” (13c-2) for user authentication to connect to the recording server are input. Set up.
  • the recorded contents are stored in the recording server 9, even if the information in the internal storage 104 of the television receiver 1 is destroyed, the recorded contents can be reproduced.
  • the notification destination user can view the recorded content stored in the recording server 9 via the external network 6 without attaching an image to the notification mail to the mobile terminal device 2.
  • the monitoring device in the present invention is not limited to a television receiver, and may be an information display terminal device having a camera unit, a face recognition unit, and the like. Specifically, a personal computer or a pet-type robot may be used.
  • the present invention is not limited to the above-described embodiments, and includes various modifications.
  • the above-described embodiments are described in detail for the entire system in order to explain the present invention in an easy-to-understand manner, and are not necessarily limited to those having all the configurations described.
  • a part of the configuration of one embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can be added to the configuration of one embodiment.
  • each of the above-described configurations, functions, processing units, processing means, and the like may be realized by hardware by designing a part or all of them with, for example, an integrated circuit.
  • Each of the above-described configurations, functions, and the like may be realized by software by interpreting and executing a program that realizes each function by the processor.
  • Information such as programs, tables, and files for realizing each function can be stored in a recording device such as a memory, a hard disk, an SSD (Solid State Drive), or a recording medium such as an IC card or an SD card.
  • the face recognition information and the setting information related to the answering machine operation are stored in the storage 104, but may be stored in the memory 103.
  • each processing example may be independent programs, or a plurality of programs may constitute one application program. Further, the order of performing each process may be changed and executed.
  • control lines and information lines indicate what is considered necessary for the explanation, and not all the control lines and information lines on the product are necessarily shown. Actually, it may be considered that almost all the components are connected to each other.

Abstract

　The present invention provides a monitoring device for performing, upon detection of a person during absence, a process corresponding to the detected person. A monitoring device (television receiver (1)) is provided with a person detection unit (108) for detecting a person, a camera unit (125) for capturing a person's image, and an individual information storage unit (104a) for preregistering and storing the face image of a specific person. When a person is detected by the person detection unit, face recognition of the detected person is performed by comparing the face image captured by the camera unit and the face image stored in the individual information storage unit. A process is executed, on the basis of the recognition result, differently for a person registered and a person not registered in the individual information storage unit. A message process is performed for the case of the registered person, and a suspicious person response process is performed for the case of the non-registered person. Furthermore, a recognition result is notified to a preset notification destination.

Description

監視装置、監視システム、及び情報提供方法Monitoring device, monitoring system, and information providing method
　本発明は、人を検知して所定の処理を行う監視装置、監視システム、及び情報提供方法に関する。 The present invention relates to a monitoring device, a monitoring system, and an information providing method for detecting a person and performing a predetermined process.
　近年テレビ受信装置には、テレビ放送を受信するという基本機能に加えて、家庭内の情報端末機として利用できる機能、即ち、ホームコミュニケーション機能を付加した高付加価値化が要求されている。この付加機能の１つとして、映像あるいは音声による伝言を記憶しておき、必要に応じて再生することが可能なテレビ受信装置が特許文献１に提案されている。また、人感センサを備え、部屋の中に人がいるか否かを判断し、人が見ていないときには電源をオフするテレビ受信装置が特許文献２に提案されている。 Recently, in addition to the basic function of receiving television broadcasts, television receivers are required to have high added value by adding a function that can be used as an information terminal in the home, that is, a home communication function. As one of the additional functions, Patent Document 1 proposes a television receiver capable of storing a video or audio message and reproducing it as necessary. Further, Patent Document 2 proposes a television receiver that includes a human sensor, determines whether there is a person in the room, and turns off the power when the person is not watching.
特開平９－６５２２４号公報JP-A-9-65224 特開２０１１-１３９１４４号公報JP 2011-139144 A
　しかし、前記特許文献では、様々な使用環境、使用状況においてユーザにとって使い勝手が十分ではなかった。例えば、留守中に人を検知したときに伝言したい家族と他の家族、あるいは家族以外の他人（不審者）を判別し、判別結果に応じた処理を行うものではなく、使い勝手が悪かった。 However, in the above-mentioned patent document, the usability is not sufficient for the user in various usage environments and usage situations. For example, when a person is detected while absent, a family member and other family members who want to message or another person other than the family member (suspicious person) are not discriminated, and processing according to the discrimination result is not performed, so that the usability is bad.
　本発明の目的は、留守中に人を検知したときに、検知した人に応じた処理を行うことが可能で、使い勝手を向上した監視装置、監視システム、及び情報提供方法を提供することにある。 An object of the present invention is to provide a monitoring device, a monitoring system, and an information providing method capable of performing processing according to a detected person when a person is detected while the user is away and improving usability. .
　上記課題を解決するための手段として、請求の範囲に記載の構成を採用すればよい。一例を挙げるならば、監視装置は、人を検知する人検知部と、人の画像を撮像するカメラ部と、特定の人の顔画像を予め登録して記憶する個別情報記憶部とを備える。人検知部で人を検知したとき、カメラ部で撮像した顔画像と個別情報記憶部に記憶されている顔画像を比較して、検知した人の顔認識を行う。認識結果に基づき、個別情報記憶部に登録した人と未登録の人とで異なる処理を行う。登録した人の場合は伝言処理を行い、未登録の人の場合は不審者対応処理を行う。また、予め設定された通知先には認識結果を通知する。 As a means for solving the above problems, the configuration described in the claims may be adopted. For example, the monitoring device includes a human detection unit that detects a person, a camera unit that captures an image of the person, and an individual information storage unit that registers and stores a face image of a specific person in advance. When a person is detected by the human detection unit, the face image captured by the camera unit is compared with the face image stored in the individual information storage unit, and the detected human face is recognized. Based on the recognition result, different processing is performed by a person registered in the individual information storage unit and an unregistered person. If the person is a registered person, the message processing is performed. If the person is not registered, the suspicious person handling process is performed. The notification result is notified to a preset notification destination.
　本発明によれば、留守中に人を検知したときに、検知した人に応じた処理を行うことが可能となり、使い勝手が向上する。 According to the present invention, when a person is detected during absence, processing according to the detected person can be performed, and usability is improved.
本発明の監視システムの一実施例を示すブロック構成図。The block block diagram which shows one Example of the monitoring system of this invention. 監視装置としてのテレビ受信装置１の構成例を示すブロック図。The block diagram which shows the structural example of the television receiver 1 as a monitoring apparatus. メールサーバの構成例を示すブロック図。The block diagram which shows the structural example of a mail server. テレビ受信装置による留守番動作を示す全体フローチャート。The whole flowchart which shows the answering machine operation | movement by a television receiver. 留守番動作設定処理の詳細フローチャート。The detailed flowchart of an answering machine operation setting process. 留守番動作設定処理における表示部の表示例を示す図。The figure which shows the example of a display of the display part in an answering machine operation setting process. 留守番動作設定処理における表示部の表示例を示す図。The figure which shows the example of a display of the display part in an answering machine operation setting process. 留守番動作設定処理における表示部の表示例を示す図。The figure which shows the example of a display of the display part in an answering machine operation setting process. 留守番動作設定処理における表示部の表示例を示す図。The figure which shows the example of a display of the display part in an answering machine operation setting process. 不審者対応処理の詳細フローチャート。The detailed flowchart of a suspicious person response process. 留守番動作の変形例を示す全体フローチャート。The whole flowchart which shows the modification of an answering machine operation | movement. 留守番動作設定処理の変形例を示すフローチャート。The flowchart which shows the modification of an answering machine operation setting process. 監視システムの第２の実施例を示すブロック構成図。The block block diagram which shows the 2nd Example of the monitoring system. 録画サーバの構成例を示すブロック図。The block diagram which shows the structural example of a video recording server. 実施例２における留守番動作設定処理の詳細フローチャート。12 is a detailed flowchart of an answering machine operation setting process according to the second embodiment. 図１２の留守番動作設定処理における表示部の表示例を示す図。The figure which shows the example of a display of the display part in the answering machine operation setting process of FIG. 図１２の留守番動作設定処理における表示部の表示例を示す図。The figure which shows the example of a display of the display part in the answering machine operation setting process of FIG. 図１２の留守番動作設定処理における表示部の表示例を示す図。The figure which shows the example of a display of the display part in the answering machine operation setting process of FIG.
　以下、本発明の実施形態について図面を参照しつつ詳細に説明する。 Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
　図１は、本発明の監視システムの一実施例を示すブロック構成図である。本実施例では、監視装置としてテレビ受信装置を用いた場合について説明する。監視システムは、テレビ受信装置１、携帯端末装置２、メールサーバ３、ルータ４、５、外部ネットワーク６、基地局７、放送局８を備えて構成される。 FIG. 1 is a block diagram showing an embodiment of the monitoring system of the present invention. In the present embodiment, a case where a television receiver is used as a monitoring device will be described. The monitoring system includes a television receiver 1, a mobile terminal device 2, a mail server 3, routers 4 and 5, an external network 6, a base station 7, and a broadcast station 8.
　テレビ受信装置１、携帯端末装置２は、無線ＬＡＮ（Local Area Network）あるいは有線ＬＡＮでそれぞれルータ４、５と接続されており、ルータ４、５から外部ネットワーク６を介してメールサーバ３とメールの送受信を行うことができる。また、テレビ受信装置１は放送局８から送信されたデジタル放送を受信して視聴することができる。 The television receiver 1 and the mobile terminal device 2 are connected to the routers 4 and 5 via a wireless LAN (Local Area Network) or a wired LAN, respectively. Can send and receive. Further, the television receiver 1 can receive and watch a digital broadcast transmitted from the broadcast station 8.
　ルータ４、５は、IEEE802.11a/b/nなどのＷｉ－Ｆｉ（Wireless Fidelity：商標）規格による無線ＬＡＮ機能あるいは有線ＬＡＮ機能を備え、通信回線を経由して外部ネットワーク６に接続できる。 The routers 4 and 5 have a wireless LAN function or a wired LAN function based on Wi-Fi (Wireless Fidelity: trademark) standards such as IEEE802.11a / b / n, and can be connected to the external network 6 via a communication line.
　さらに、携帯端末装置２はＷ－ＣＤＭＡ（Wideband Code Division Multiple Access）やＧＳＭ（登録商標）（Global System for Mobile communications）などの遠距離無線通信により、基地局７から外部ネットワーク６を介してメールサーバ３とメールを送受信することができる。 Further, the portable terminal device 2 is a mail server from the base station 7 via the external network 6 by long-distance wireless communication such as W-CDMA (Wideband Code Division Multiple Access) or GSM (registered trademark) (Global System for Mobile communications). 3 can send and receive emails.
　図２は、監視装置としてのテレビ受信装置１の構成例を示すブロック図である。テレビ受信装置１は、制御部１０１、顔認識部１０２、メモリ１０３、ストレージ１０４、電源部１０５、操作キー１０６、リモコン受光部１０７、人検知部１０８、通信部１０９、チューナー部１１２、復調部１１３、分離部１１４、選局部１１５、ビデオデコード部１１６、ＥＰＧ(Electronic Program Guide：電子番組表)／ＯＳＤ(On-Screen Display)処理部１１７、映像処理部１１８、表示制御部１２０、表示部１２１、オーディオデコード部１２３、音声処理部１２３、スピーカ１２４、カメラ部１２５、マイク１２６、外部入力部１２７、を有して構成されている。システムバス１１０は、制御部１０１とテレビ受信装置１内の各部との間でデータ送受信を行うためのデータ通信路である。また、テレビ受信装置１には、アンテナ１１１、及び外部機器１４０が接続されており、操作キー１０６あるいはリモートコントローラ１５０による操作が可能である。 FIG. 2 is a block diagram illustrating a configuration example of the television receiver 1 as a monitoring device. The television receiver 1 includes a control unit 101, a face recognition unit 102, a memory 103, a storage 104, a power supply unit 105, an operation key 106, a remote control light receiving unit 107, a human detection unit 108, a communication unit 109, a tuner unit 112, and a demodulation unit 113. , Separation unit 114, channel selection unit 115, video decoding unit 116, EPG (Electronic Program Guide) / OSD (On-Screen Display) processing unit 117, video processing unit 118, display control unit 120, display unit 121, The audio decoding unit 123, the audio processing unit 123, a speaker 124, a camera unit 125, a microphone 126, and an external input unit 127 are configured. The system bus 110 is a data communication path for performing data transmission / reception between the control unit 101 and each unit in the television receiver 1. The television receiver 1 is connected to an antenna 111 and an external device 140 and can be operated with the operation key 106 or the remote controller 150.
　以下、各部の構成を説明する。
  制御部１０１は、ＣＰＵ等で構成され、メモリ１０３に記憶されたオペレーティングシステムや各種のアプリケーションプログラムなどに従ってテレビ受信装置１の全体を制御する。また、顔認識部１０２は、カメラ部１２５で撮像し映像処理部１１８で処理した映像をシステムバス１１０を介して取り込み、カメラ部１２５に映った人物の顔を認識するものである。 Hereinafter, the configuration of each unit will be described.
The control unit 101 includes a CPU and the like, and controls the entire television receiving apparatus 1 according to an operating system, various application programs, and the like stored in the memory 103. The face recognition unit 102 captures an image captured by the camera unit 125 and processed by the image processing unit 118 via the system bus 110, and recognizes a person's face shown on the camera unit 125.
　ストレージ部１０４は、各種情報の記憶領域を有する。個別情報記憶領域１０４ａには、メールサーバ３に接続するユーザのアカウントの情報や顔認識部１０２で使用する顔を認識するための情報、留守番動作に関する設定情報等を記憶する。番組録画記憶領域１０４ｂには、放送番組の録画及び放送番組録画に関連する情報（予約情報等）を記憶する。伝言記憶領域１０４ｃには、カメラ部１２５で撮像した画像及び/あるいはマイク１２６で取り込んだ音声を伝言として記憶する。留守番情報記憶領域１０４ｄには、留守番動作時にカメラ部１２５で撮像した画像及びマイク１２６で取り込んだ音声を記憶する。 The storage unit 104 has a storage area for various information. The individual information storage area 104a stores information on the account of the user connected to the mail server 3, information for recognizing the face used by the face recognition unit 102, setting information related to the answering machine operation, and the like. The program recording storage area 104b stores broadcast program recording and information related to broadcast program recording (reservation information, etc.). In the message storage area 104c, an image captured by the camera unit 125 and / or a voice captured by the microphone 126 is stored as a message. In the answering machine information storage area 104d, an image captured by the camera unit 125 and an audio captured by the microphone 126 during the answering machine operation are stored.
　操作キー１０６は、ユーザがキーを押下げたことを検知し、検知したキーに基づいて制御部１０１はチャンネルの切り替えや音量の変更などを指示する。リモコン受光部１０７は、リモートコントローラ１５０から発せられるリモコン信号（赤外線信号）を受け付ける。リモコン受光部１０７において受け付けられたリモコン信号に基づいて、制御部１０１は、選局部１１５におけるチャンネルの選局、描画するＯＳＤの変更などを指示する。 The operation key 106 detects that the user has pressed the key, and based on the detected key, the control unit 101 instructs channel switching, volume change, and the like. The remote control light receiving unit 107 receives a remote control signal (infrared signal) emitted from the remote controller 150. Based on the remote control signal received by remote control light receiving unit 107, control unit 101 instructs channel selection in channel selection unit 115, change of OSD to be drawn, and the like.
　人検知部１０８は、テレビ受信装置１の周囲に人が存在するか否かを検知するセンサである。人検知部１０８は、例えば、熱源の移動を検出することによって、あるいは、熱源の温度と周囲の温度との差を検出することによって、周囲に人が存在するか否かを検知する。人検知部１０８の出力信号（以下、人感信号）は、増幅回路（不図示）によって増幅された後、ＡＤＣ(Analog to Digital Converter)（不図示）によってデジタル信号に変換され、システムバス１１０を介して制御部１０１に供給される。テレビ受信装置１の周囲（正確には、人検知部１０８の検出範囲）に人が居る場合、人検知部１０８により検出される温度変化が大きくなる。一方、テレビ受信装置１の周囲に人が居ない場合、人検知部１０８により検出される温度変化が小さくなる。このため制御部１０１は、人検知部１０８から供給される人感信号の値を参照することにより、テレビ受信装置１の周囲に人がいるか否かを判定することができる。 The person detection unit 108 is a sensor that detects whether or not there is a person around the television receiver 1. For example, the person detection unit 108 detects whether or not a person is present around by detecting the movement of the heat source or by detecting the difference between the temperature of the heat source and the ambient temperature. An output signal of the human detection unit 108 (hereinafter referred to as a human detection signal) is amplified by an amplifier circuit (not shown) and then converted into a digital signal by an ADC (Analog Digital Converter) (not shown). Via the control unit 101. When there is a person around the television receiver 1 (more precisely, the detection range of the human detection unit 108), the temperature change detected by the human detection unit 108 becomes large. On the other hand, when there is no person around the television receiver 1, the temperature change detected by the person detection unit 108 becomes small. Therefore, the control unit 101 can determine whether or not there is a person around the television receiver 1 by referring to the value of the human detection signal supplied from the human detection unit 108.
　通信部１０９は、有線ＬＡＮまたは無線ＬＡＮによりルータ４と接続し、インターネット等の外部ネットワーク６を介して情報、あるいは音声や画像信号あるいはメールの送受信を行う。 The communication unit 109 is connected to the router 4 by a wired LAN or a wireless LAN, and transmits / receives information, voice, image signal, or mail via an external network 6 such as the Internet.
　その他、以下のテレビ受信機能を有する。
  チューナー部１１２は、アンテナ１１１において受信した放送信号から、選局部１１５にて選択されたチャンネルに重畳された信号を抽出し、抽出した信号を復調部１１３に供給する。復調部１１３は、チューナー部１１２にて抽出された信号から、所定の形式（例えば、ＭＰＥＧ２－ＴＳ形式）のストリームデータを生成し、生成したストリームデータを分離部１１４に供給する。 In addition, it has the following television reception functions.
The tuner unit 112 extracts a signal superimposed on the channel selected by the channel selection unit 115 from the broadcast signal received by the antenna 111, and supplies the extracted signal to the demodulation unit 113. The demodulation unit 113 generates stream data in a predetermined format (for example, MPEG2-TS format) from the signal extracted by the tuner unit 112 and supplies the generated stream data to the separation unit 114.
　分離部１１４は、復調部１１３から供給されたストリームデータを映像データ、音声データ、及び付加データに分離する。分離部１１４にて分離された映像データ、音声データ、及び付加データは、それぞれ、ビデオデコード部１１６、オーディオデコード部１２３、及び、ＥＰＧ／ＯＳＤ処理部１１７に供給される。 The separation unit 114 separates the stream data supplied from the demodulation unit 113 into video data, audio data, and additional data. The video data, audio data, and additional data separated by the separation unit 114 are supplied to the video decoding unit 116, the audio decoding unit 123, and the EPG / OSD processing unit 117, respectively.
　ビデオデコード部１１６は、分離部１１４において分離された映像データをデコードする。ビデオデコード部１１６にて得られた映像信号は、映像処理部１１８に供給される。オーディオデコード部１２２は、分離部１１４において分離された音声データをデコードする。オーディオデコード部１２２にて得られた音声信号は、音声処理部１２４に供給される。ＥＰＧ／ＯＳＤ処理部１１７は、分離部１１４にて分離された付加データに基づいて、ＯＳＤ表示すべき映像を表す映像信号を生成する。ＯＳＤ表示する映像としては、ＥＰＧや字幕などが挙げられる。ＥＰＧ／ＯＳＤ処理部１１７にて生成された映像信号は、合成部１１９に供給される。 The video decoding unit 116 decodes the video data separated by the separation unit 114. The video signal obtained by the video decoding unit 116 is supplied to the video processing unit 118. The audio decoding unit 122 decodes the audio data separated by the separation unit 114. The audio signal obtained by the audio decoding unit 122 is supplied to the audio processing unit 124. Based on the additional data separated by the separation unit 114, the EPG / OSD processing unit 117 generates a video signal representing a video to be OSD displayed. Examples of the video to be OSD-displayed include EPG and subtitles. The video signal generated by the EPG / OSD processing unit 117 is supplied to the synthesis unit 119.
　映像処理部１１８には、上述したビデオデコード部１１６からの映像信号の他に、外部入力部１２９を介して外部機器１４０（例えば、光ディスク装置）から出力された映像信号、及び留守番時の顔認識や伝言入力等の時に使用されるカメラ部１２５から出力される映像信号が供給される。映像処理部１１８は、制御部１０１からの指令に基づき、これらの映像信号のうちから対象とする映像信号の処理を行う。ここでの処理としては、例えばフレームレート変換などを挙げることができる。映像処理部１１８にて処理された映像信号は、合成部１１９に供給される。合成部１１９は、映像処理部１１８にて処理された映像信号と、ＥＰＧ／ＯＳＤ処理部１１７にて生成された映像信号とを合成し、表示制御部１２０に供給する。表示制御部１２０は、合成された映像信号に基づき、表示部１２１を駆動する。 In the video processing unit 118, in addition to the video signal from the video decoding unit 116 described above, a video signal output from the external device 140 (for example, an optical disc device) via the external input unit 129, and face recognition at the time of answering machine And a video signal output from the camera unit 125 used for message input or the like. The video processing unit 118 processes a target video signal from among these video signals based on a command from the control unit 101. Examples of the processing here include frame rate conversion. The video signal processed by the video processing unit 118 is supplied to the synthesis unit 119. The synthesizing unit 119 synthesizes the video signal processed by the video processing unit 118 and the video signal generated by the EPG / OSD processing unit 117 and supplies the synthesized signal to the display control unit 120. The display control unit 120 drives the display unit 121 based on the synthesized video signal.
　音声処理部１２３には、上述したオーディオデコード部１２２からの音声信号の他に、外部入力部１２７を介して外部機器１３０から出力された音声信号、及び伝言入力の時等に使用されるマイク１２６から出力される音声信号が供給される。音声処理部１２３は、制御部１０１からの指令に基づき、これらの音声信号のうちから対象とする音声信号を増幅し、増幅された音声信号をスピーカ１２４に供給する。 In addition to the audio signal from the audio decoding unit 122 described above, the audio processing unit 123 includes an audio signal output from the external device 130 via the external input unit 127 and a microphone 126 that is used when a message is input. The audio signal output from is supplied. The audio processing unit 123 amplifies a target audio signal from among these audio signals based on a command from the control unit 101, and supplies the amplified audio signal to the speaker 124.
　カメラ部１２５は、顔認識や留守番動作時にテレビ受信装置１の周囲に居る人物・物体等の撮影と、伝言入力時の画像取り込みに使用され、カメラ部１２５から取り込まれた画像は映像処理部１１８に供給される。マイク１２６は、留守番動作時にテレビ受信装置１の周囲に居る人物・物体等からの音声の取り込み、伝言入力時の音声取り込みに使用され、マイク１２６から取り込まれた音声は音声処理部１２５に供給される。 The camera unit 125 is used for photographing a person / object around the television receiver 1 during face recognition or answering machine operation and for capturing an image when inputting a message. The image captured from the camera unit 125 is a video processing unit 118. To be supplied. The microphone 126 is used for capturing sound from a person / object around the television receiver 1 during the answering machine operation and capturing sound when inputting a message. The sound captured from the microphone 126 is supplied to the sound processing unit 125. The
　図３は、メールサーバ３の構成例を示すブロック図である。メールサーバ３は、制御部３０１、メモリ３０２、通信部３０３、ストレージ３０４を備え、それぞれはバス３００で相互に接続されている。制御部３０１はＣＰＵ（Central Processing Unit）等で構成され、メモリ３０２に記憶したプログラムを実行することによって各構成部を制御し、各種の処理を行う。通信部３０３は外部ネットワーク６と接続するためのインターフェースであり、外部ネットワーク６から基地局７あるいはルータ４、５を介して、ネットワーク接続に対応したテレビ受信装置１、携帯端末装置２等とメールを送受信する。ストレージ３０４は、メールサーバ３に接続する各ユーザを認証するアカウントやパスワード等のユーザ情報を記憶する領域３０４ａと、各ユーザのメール情報を記憶する領域３０４ｂを有している。 FIG. 3 is a block diagram showing a configuration example of the mail server 3. The mail server 3 includes a control unit 301, a memory 302, a communication unit 303, and a storage 304, which are mutually connected by a bus 300. The control unit 301 includes a CPU (Central Processing Unit) and the like, and controls each component by executing a program stored in the memory 302 to perform various processes. The communication unit 303 is an interface for connecting to the external network 6, and sends mail from the external network 6 via the base station 7 or the routers 4, 5 to the television receiver 1, portable terminal device 2, etc. that support network connection. Send and receive. The storage 304 has an area 304a for storing user information such as an account and a password for authenticating each user connected to the mail server 3, and an area 304b for storing each user's mail information.
　以下、テレビ受信装置１による監視動作（留守番動作）について説明する。
  図４は、テレビ受信装置１による留守番動作を示す全体フローチャートである。
  Ｓ４００ではユーザ登録の初期設定として、家族・知人等の顔画像やメールアドレスなどの個人情報の登録を行う。顔認識登録では、カメラ１２５で各ユーザの顔を撮影し、ストレージ１０４の個別情報記録領域１０４ａに記憶する。メールアドレスについては、リモートコントローラ１５０もしくは操作キー１０６などで情報を入力し、同様に個別情報記録領域１０４ａに記憶する。 Hereinafter, the monitoring operation (answering machine operation) by the television receiver 1 will be described.
FIG. 4 is an overall flowchart showing the answering machine operation by the television receiver 1.
In S400, as initial settings for user registration, personal information such as facial images of family members and acquaintances and e-mail addresses is registered. In face recognition registration, each camera user's face is imaged by the camera 125 and stored in the individual information recording area 104 a of the storage 104. As for the mail address, information is input using the remote controller 150 or the operation key 106, and stored in the individual information recording area 104a in the same manner.
　Ｓ４０１では、ユーザがリモートコントローラ１５０もしくは操作キー１０６により留守番動作モードを選択する。留守番動作モードには、ユーザが不在となる通常の「留守番モード」だけでなく、ユーザが在宅しテレビ受信装置１の設置部屋とは異なる部屋に在室している場合の「在宅モード」などを備え、状況に応じて切り替える。勿論、ユーザがテレビ受信装置１の設置部屋に在室しているときは留守番動作モードをオフにする。 In S401, the user selects the answering mode using the remote controller 150 or the operation key 106. The answering machine operation mode includes not only a normal “answering machine mode” in which the user is absent, but also “at-home mode” when the user is at home and is in a room different from the room where the television receiver 1 is installed. Prepare and switch according to the situation. Of course, when the user is in the room where the television receiver 1 is installed, the answering mode is turned off.
　Ｓ４０２では、留守番動作の設定処理を行う。ここでは、留守番機能として「不審者対応」、「通知機能」、「伝言機能」などを選択し、その条件を設定する。Ｓ４０２の詳細は図５で後述する。 In S402, answering machine setting processing is performed. Here, “suspicious person response”, “notification function”, “message function”, and the like are selected as answering machine functions, and the conditions are set. Details of S402 will be described later with reference to FIG.
　Ｓ４０３では、制御部１０１は人検知部１０８の人感信号の出力を取り込む。Ｓ４０４では、人感信号の値と所定の閾値とを比較することによって、制御部１０１は人検知部１０８の検出範囲内に人がいるか否かを判定する。Ｓ４０４で人がいないと判定した場合（Ｎｏ）は、Ｓ４０３に戻り再度人検知部１０８の出力を取り込む。 In step S403, the control unit 101 captures the output of the human detection signal from the human detection unit 108. In S <b> 404, the control unit 101 determines whether there is a person within the detection range of the human detection unit 108 by comparing the value of the human detection signal with a predetermined threshold value. If it is determined in S404 that there is no person (No), the process returns to S403 and takes in the output of the person detection unit 108 again.
　Ｓ４０４で人がいると判断した場合（Ｙｅｓ）は、Ｓ４０５へ進み、制御部１０１はカメラ部１２５で撮像した画像を取り込む。Ｓ４０６では、予めストレージ１０４の個別情報記憶領域１０４ａに記憶されたユーザの顔認識登録情報に基づいて、顔認識処理を行う。 If it is determined in S404 that there is a person (Yes), the process proceeds to S405, and the control unit 101 captures an image captured by the camera unit 125. In S406, face recognition processing is performed based on the user's face recognition registration information stored in advance in the individual information storage area 104a of the storage 104.
　Ｓ４０７では、顔認識処理Ｓ４０６で認識した顔と登録されたユーザの顔とを比較し、一致するか否かを判定する。登録されたユーザの顔に一致しない場合（Ｎｏ）にはＳ４０８に進み、不審者対応処理（警告音発生など）を実行する。Ｓ４０８の不審者対応処理の詳細は図７で後述する。 In S407, the face recognized in the face recognition process S406 is compared with the registered user's face to determine whether or not they match. If it does not match the registered user's face (No), the process proceeds to S408, and suspicious person handling processing (warning sound generation, etc.) is executed. Details of the suspicious person handling process in S408 will be described later with reference to FIG.
　Ｓ４０７で登録されたユーザの顔に一致する場合（Ｙｅｓ）は、Ｓ４０９へ進み、伝言宛先に登録されたユーザかの判定を行う。伝言宛先登録されたユーザの場合（Ｙｅｓ）はＳ４１０へ進み、伝言出力処理を行う。Ｓ４１０の伝言出力処理では、ストレージ１０４の伝言記憶領域１０４ｃに記憶されている伝言内容（映像、音声メッセージなど）を、表示部１２１やスピーカ１２４から出力する。これにより、伝言宛先に登録された人に対し、伝言内容を伝えることができる。Ｓ４０９で伝言宛先に登録されていないユーザの場合（Ｎｏ）はＳ４１１へ進む。 If it matches the face of the user registered in S407 (Yes), the process proceeds to S409 to determine whether the user is registered in the message destination. If the user is a message destination registered (Yes), the process proceeds to S410, and a message output process is performed. In the message output process of S410, the message content (video, audio message, etc.) stored in the message storage area 104c of the storage 104 is output from the display unit 121 or the speaker 124. Thereby, the message content can be transmitted to the person registered in the message destination. If the user is not registered as a message destination in S409 (No), the process proceeds to S411.
　Ｓ４１１では、通知先が設定されているかの判定を行う。通知先が設定されている場合（Ｙｅｓ）は、Ｓ４１２へ進み通知処理を行う。Ｓ４１２の通知処理では、予め設定された通知先に顔認識処理Ｓ４０６の結果等をメール送信する。これにより携帯端末装置２では、メールサーバ３から通知処理Ｓ４１２で送信されたメールを受信し、顔認識登録されたユーザが帰宅したか、あるいは不審者が侵入したかなどを確認することができる。このときのメール送信では、さらに顔認識したときの画像を添付することで、受信者は顔認識登録されたユーザか不審者かを確認することができる。また、通知方法はメールに限定されず、通話によるものでも良い。
  Ｓ４１３では、留守番動作モードを解除して終了する。 In S411, it is determined whether a notification destination is set. When the notification destination is set (Yes), the process proceeds to S412 to perform notification processing. In the notification process in S412, the result of the face recognition process S406 or the like is sent by e-mail to a preset notification destination. As a result, the mobile terminal device 2 can receive the mail transmitted in the notification process S412 from the mail server 3 and confirm whether the user registered for face recognition has returned home or whether a suspicious person has entered. In the mail transmission at this time, the recipient can confirm whether the user is registered for face recognition or a suspicious person by attaching an image when the face is further recognized. Also, the notification method is not limited to e-mail, and may be by telephone.
In S413, the answering machine operation mode is canceled and the process ends.
　このように本実施例の留守番動作では、留守中にカメラで人を検知したとき、ユーザの顔認識登録情報に基づいて登録者か否かを判定し、検知した人に応じて不審者対応、伝言処理、通知処理などの処理を適切に行うことができる。 Thus, in the answering machine operation of the present embodiment, when a person is detected by the camera during absence, it is determined whether or not the person is a registrant based on the user's face recognition registration information, and a suspicious person is handled according to the detected person. Processing such as message processing and notification processing can be performed appropriately.
　次に、図４における各処理工程の詳細を説明する。
  図５は、留守番動作設定処理（Ｓ４０２）の詳細フローチャートである。
  Ｓ５０１では、表示部１２１に留守番動作設定を行う項目を選択する画面を表示する（図６Ａ参照）。Ｓ５０２では、画面に表示された設定項目を操作キー１０６（あるいはリモートコントローラ１５０、以下同じ）によりユーザが選択入力する。Ｓ５０３では、選択した設定項目に応じて分岐する。なお、Ｓ５０２の選択入力で「終了」が選択された場合には、留守番動作設定処理を終了する。 Next, details of each processing step in FIG. 4 will be described.
FIG. 5 is a detailed flowchart of the answering machine operation setting process (S402).
In S501, a screen for selecting an item for setting an answering machine operation is displayed on the display unit 121 (see FIG. 6A). In S502, the user selects and inputs setting items displayed on the screen using the operation keys 106 (or the remote controller 150, the same applies hereinafter). In S503, the process branches according to the selected setting item. If “end” is selected in the selection input in S502, the answering machine operation setting process ends.
　Ｓ５０２の選択入力で「不審者対応」が選択された場合には、Ｓ５０４へ進み不審者対応設定画面を表示する（図６Ｂ参照）。Ｓ５０５では、ユーザがリモートコントローラ１５０により不審者対応設定を入力し、Ｓ５０６では入力した項目を設定登録する。その後Ｓ５０１に戻り留守番動作設定選択画面を表示し、設定内容の追加や更新が可能となる。 If “suspicious person correspondence” is selected in the selection input in S502, the process proceeds to S504, and a suspicious person correspondence setting screen is displayed (see FIG. 6B). In S505, the user inputs a suspicious person setting using the remote controller 150, and in S506, the input item is set and registered. Thereafter, the process returns to S501 and the answering machine operation setting selection screen is displayed, and the setting contents can be added or updated.
　Ｓ５０２の選択入力で「通知先」が選択された場合には、Ｓ５０７へ進み通知先設定画面を表示する（図６Ｃ参照）。Ｓ５０８では、ユーザがリモートコントローラ１５０により通知先設定を入力し、Ｓ５０９では入力した項目を設定登録する。その後Ｓ５０１に戻る。 When “notification destination” is selected in the selection input in S502, the process proceeds to S507 to display a notification destination setting screen (see FIG. 6C). In S508, the user inputs notification destination settings using the remote controller 150, and in S509, the input items are set and registered. Thereafter, the process returns to S501.
　Ｓ５０２の選択入力で「伝言」が選択された場合には、Ｓ５１０へ進み伝言設定画面を表示する（図６Ｄ参照）。Ｓ５１１では、ユーザがリモートコントローラ１５０、カメラ部１２５、あるいはマイク１２６により伝言設定を入力し、Ｓ５１２では入力した項目を設定登録する。その後Ｓ５０１に戻る。 When “message” is selected in the selection input in S502, the process proceeds to S510 and a message setting screen is displayed (see FIG. 6D). In S511, the user inputs message settings using the remote controller 150, the camera unit 125, or the microphone 126, and in S512, the input items are set and registered. Thereafter, the process returns to S501.
　図６Ａ～図６Ｄは、留守番動作設定処理（Ｓ４０２）における表示部１２１の表示例を示す図である。
  図６Ａは、留守番動作設定選択画面表示処理（Ｓ５０１）における画面表示の例であり、「不審者対応」、「通知先」、「伝言」の項目の現在の設定状態が表示されている。ユーザは、操作キー１０６により、設定状態を変更（更新）したい項目、すなわち「不審者対応」ボタン（６ａ－２）、「通知先」ボタン（６ａ－３）、「伝言」ボタン（６ａ－４）の何れかを選択する。全ての設定状態に変更がなければ、「終了」ボタン（６ａ－１）を選択する。 6A to 6D are diagrams showing display examples of the display unit 121 in the answering machine operation setting process (S402).
FIG. 6A is an example of screen display in the answering machine operation setting selection screen display process (S501), in which the current setting states of the “suspicious person correspondence”, “notification destination”, and “message” items are displayed. The user operates the operation key 106 to change (update) the setting state, that is, the “suspicious person response” button (6a-2), the “notification destination” button (6a-3), and the “message” button (6a-4). ) Is selected. If all the setting states are not changed, the “end” button (6a-1) is selected.
　図６Ｂは、不審者対応設定画面表示処理（Ｓ５０４）における画面表示の例であり、「警告音」（６ｂ－２）、「警告表示」（６ｂ－３）、「録画（６ｂ－４）」、「通報」（６ｂ－５）、「通報先」（６ｂ－６）の項目の現在の設定状態が表示されている。ユーザは操作キー１０６により各設定項目の「ＯＮ」ボタンあるいは「ＯＦＦ」ボタンを選択することにより、各項目のＯＮ/ＯＦＦ設定の変更が行われる。また、警備会社等の通報先のメールアドレスをリモートコントローラ１５０で入力し、登録することができる。さらには、通報先として近所の人を追加しておけば、居住地域内に不審者情報を伝えることもできる。メールアドレスの入力は、リモートコントローラ１５０の図示を省略したテンキー（数字キー）等を使用して直接入力しても良いし、画面上にソフトウエアキーボードを表示し、リモートコントローラ１５０等で前記ソフトウエアキーボードを操作して行っても良い。不審者対応の設定入力が終了したら、「終了」ボタン（６ｂ－１）を選択する。 FIG. 6B is an example of screen display in the suspicious person setting screen display process (S504), and “warning sound” (6b-2), “warning display” (6b-3), “recording (6b-4)”. , “Notification” (6b-5), “Notification destination” (6b-6), the current setting status is displayed. The user selects the “ON” button or the “OFF” button for each setting item using the operation key 106, thereby changing the ON / OFF setting for each item. In addition, a mail address of a report destination such as a security company can be input and registered with the remote controller 150. Furthermore, if a neighbor is added as a report destination, suspicious person information can also be transmitted to the residence area. The e-mail address may be input directly using a numeric keypad (not shown) of the remote controller 150, or a software keyboard is displayed on the screen, and the software is displayed on the remote controller 150 or the like. You may operate by operating the keyboard. When the setting input for the suspicious person is completed, the “end” button (6b-1) is selected.
　図６Ｃは、通知先設定画面表示処理（Ｓ５０７）における画面表示の例であり、複数の通知先が設定可能となっている。各通知先に通知を行うか否かを設定するチェックボックス（６ｃ－２）、通知先のユーザ登録名（６ｃ－３）、通知先のメールアドレス（６ｃ－４）が設定可能となっている。ここではユーザ２に通知を行う設定の例である。チェックボックス（６ｃ－２）は、選択した状態で決定することで通知を行うか否かが切り替わる。また、通知先のユーザ登録名（６ｃ－３）、通知先のメールアドレス（６ｃ－４）はリモートコントローラ１５０の図示を省略したテンキー（数字キー）等を使用して直接入力しても良いし、画面上にソフトウエアキーボードを表示し、リモートコントローラ１５０等で前記ソフトウエアキーボードを操作して行っても良い。また、通知先設定入力が終了したら、「終了」ボタン（６ｃ－１）を選択する。 FIG. 6C is an example of screen display in the notification destination setting screen display process (S507), and a plurality of notification destinations can be set. A check box (6c-2) for setting whether or not to notify each notification destination, a user registration name (6c-3) of the notification destination, and a mail address (6c-4) of the notification destination can be set. . Here, an example of a setting for notifying the user 2 is shown. The check box (6c-2) is switched in accordance with whether or not the notification is performed by determining the selected state. Further, the user registration name (6c-3) of the notification destination and the mail address (6c-4) of the notification destination may be directly input using a numeric keypad (numeric key) (not shown) of the remote controller 150. Alternatively, a software keyboard may be displayed on the screen, and the software keyboard may be operated with the remote controller 150 or the like. When the notification destination setting input is completed, the “end” button (6c-1) is selected.
　図６Ｄは、伝言設定画面表示処理（Ｓ５１０）における画面表示の例であり、登録されたユーザの顔（６ｄ－２～５）が表示され、複数の伝言宛先が設定可能となっている。この中からユーザの顔を選択することで、伝言の宛先とするか否かが切り替わって設定される。また、「伝言入力」ボタン（６ｄ－６）を選択することにより、伝言の入力を行うことができる。伝言の入力方法としては、例えばカメラ部１２５及びマイク１２６により伝言入力者の映像及び/あるいは音声を入力して登録する。あるいはリモートコントローラ１５０による文字入力により伝言を入力する。伝言設定入力が終了したら、「終了」ボタン（６ｄ－１）を選択する。 FIG. 6D is an example of screen display in the message setting screen display process (S510), where the registered user's face (6d-2 to 5) is displayed, and a plurality of message destinations can be set. By selecting the user's face from these, it is switched and set as to whether or not to be the message destination. Further, by selecting the “message input” button (6d-6), it is possible to input a message. As a message input method, for example, the video and / or voice of the message input person is input and registered by the camera unit 125 and the microphone 126. Alternatively, a message is input by inputting characters with the remote controller 150. When the message setting input is completed, the “end” button (6d-1) is selected.
　図７は、不審者対応処理（Ｓ４０８）の詳細フローチャートである。ここでは、図６Ｂで設定された条件に従って処理を行う。
  Ｓ７０１では、不審者対応設定で警告音設定がＯＮに設定されているかを判定する。ＯＮに設定されている場合（Ｙｅs）には警告音出力処理Ｓ７０２に進み、スピーカ１２４から警告音を発生する。
  Ｓ７０３では、警告表示設定がＯＮに設定されているかを判定する。ＯＮに設定されている場合（Ｙｅｓ）には警告画面表示処理Ｓ７０４に進み、警告画面を表示部１２１に表示する。 FIG. 7 is a detailed flowchart of the suspicious person handling process (S408). Here, processing is performed according to the conditions set in FIG. 6B.
In S701, it is determined whether the warning sound setting is set to ON in the suspicious person handling setting. If it is set to ON (Yes), the process proceeds to a warning sound output process S702, and a warning sound is generated from the speaker 124.
In S703, it is determined whether the warning display setting is set to ON. If it is set to ON (Yes), the process proceeds to the warning screen display process S704, and the warning screen is displayed on the display unit 121.
　Ｓ７０５では、録画設定がＯＮに設定されているかを判定する。ＯＮに設定されている場合（Ｙｅｓ）には録画処理Ｓ７０６に進み、カメラ部１２６で撮像した映像とマイク１２６から入力される音声を、ストレージ１０４の留守番情報記憶領域１０４ｄに記憶する。 In S705, it is determined whether the recording setting is set to ON. If it is set to ON (Yes), the process proceeds to the recording process S706, and the video captured by the camera unit 126 and the audio input from the microphone 126 are stored in the answering machine information storage area 104d of the storage 104.
　Ｓ７０７では、通報設定がＯＮに設定されているかを判定する。ＯＮに設定されている場合には通報処理Ｓ７０８に進み、通信部１０９を介して予め設定された通報先に通報を行う。通報先として例えば警備会社などを設定しておけばより有効である。警備会社では、各家庭の監視装置から送信される不審者の情報（顔画像）を収集し、さらに警察へ通報するなどして地域の防犯効果にも寄与することになる。 In S707, it is determined whether the notification setting is set to ON. If it is set to ON, the process proceeds to report process S708, and a report is sent to a preset report destination via the communication unit 109. For example, it is more effective if a security company is set as the report destination. Security companies will contribute to the local crime prevention effect by collecting information (face images) of suspicious persons transmitted from the monitoring devices of each household and reporting them to the police.
　以上のように本実施例によれば、留守番動作を設定した状態において人検知部１０８により人を検知したときに、カメラ部１２５で撮像した画像により顔認識を行い、登録されたユーザと登録されていない不審者とを判別し、判別結果により適切な処理を行うことが可能となる。 As described above, according to the present embodiment, when a person is detected by the human detection unit 108 in a state in which an answering machine is set, face recognition is performed using an image captured by the camera unit 125, and a registered user is registered. It is possible to discriminate a suspicious person who has not been identified, and perform appropriate processing based on the discrimination result.
　なお、不審者対応処理Ｓ４０８の最初に所定の時間内にパスワード入力する処理を設け、所定の時間内に正しいパスワードが入力された場合には不審者対応処理を終了するようにしてもよい。これにより、顔認識処理の誤認識によって顔認識登録されたユーザが不審者として認識された場合に誤って不審者対応処理が実行されるのを防止することができる。 Note that a process for inputting a password within a predetermined time may be provided at the beginning of the suspicious person processing S408, and the suspicious person processing may be terminated when a correct password is input within the predetermined time. Thereby, it is possible to prevent the suspicious person handling process from being erroneously executed when a user registered for face recognition is recognized as a suspicious person due to misrecognition of the face recognition process.
　また、顔認識登録されたユーザとともに顔認識登録されてない人が同時に入室しているような場合にも、不審者対応処理を終了させるのが望ましい。そのためには、Ｓ４０７の判定において、検知した複数人のうち、少なくとも１人が顔認識登録されたユーザであれば不審者対応処理Ｓ４０８を行わないようにすれば良い。 Also, it is desirable to end the suspicious person handling process when a person who is not registered for face recognition is entering the room at the same time as a user who is registered for face recognition. For this purpose, in the determination of S407, if at least one of the detected plurality of users is a user who has been registered for face recognition, the suspicious person handling process S408 may not be performed.
　本実施例では、ユーザの顔を認識して適切な処理を行うものであるが、室内にペット（犬、猫）がいる場合、これを不審者として不審者対応処理を行う恐れがある。これを回避するため、家庭内ペットについても顔認識登録に加えておけば、誤動作することはない。 In this embodiment, the user's face is recognized and an appropriate process is performed. However, when there is a pet (dog, cat) in the room, there is a possibility that the suspicious person may be handled as a suspicious person. In order to avoid this, if a domestic pet is added to face recognition registration, no malfunction will occur.
　また、ペットを判断する方法として、その大きさ及び/或いは形を登録して判別するようにしてもよい。例えばペットと認識した場合には人がいないと判定し、Ｓ４０３に戻り再度人検知部１０８の出力を取り込むようにすればよい。 Also, as a method of judging a pet, its size and / or shape may be registered and judged. For example, if it is recognized as a pet, it may be determined that there is no person, and the process returns to S403 to capture the output of the person detection unit 108 again.
　以下、本実施例の変形例を説明する。
  図８は、留守番動作の変形例を示す全体フローチャートである。これは図４からの変形であって、図４と同一処理部分には同じ番号を付し、説明を省略する。本例では人検知した後に特定の画面を表示する工程Ｓ４２０を追加して、その後カメラ部１２５で撮像した画像の取り込みを行い、顔認識を行うようにしている。 Hereinafter, modifications of the present embodiment will be described.
FIG. 8 is an overall flowchart showing a modification of the answering machine operation. This is a modification from FIG. 4, and the same processing parts as those in FIG. In this example, a step S420 for displaying a specific screen after human detection is added, and then the image captured by the camera unit 125 is captured to perform face recognition.
　Ｓ４０４にて人がいると判定した場合（Ｙｅｓ）は、Ｓ４２０に進み、表示部１２１に特定の画面を表示する。続いてＳ４０５では、カメラ部１２５で撮像した画像を取り込み、Ｓ４０６にて顔認識処理を行う。ここで表示する特定の画面とは、検知された人が注目し、さらには明るい画面が好ましい。これにより、検知された人はテレビ受信装置１（カメラ部１２５）の方向に顔を向けるとともに、明るい画面が照明具となって検知された人を照射する。その結果、暗い部屋でも鮮明な顔画像を撮像し、顔認識の精度を向上し、登録されたユーザと登録されていない不審者とを容易に判別することが可能となる。 If it is determined in S404 that there is a person (Yes), the process proceeds to S420, and a specific screen is displayed on the display unit 121. Subsequently, in S405, an image captured by the camera unit 125 is captured, and face recognition processing is performed in S406. The specific screen to be displayed here is preferably a bright screen that is noticed by a detected person. Thereby, the detected person turns his / her face in the direction of the television receiver 1 (camera unit 125), and a bright screen illuminates the detected person as a lighting tool. As a result, it is possible to capture a clear face image even in a dark room, improve the accuracy of face recognition, and easily discriminate between registered users and unregistered suspicious persons.
　なお、上記例では、表示部１２１に特定の画面を表示するようにしたが、検知した人がテレビ受信装置１の方向に顔を向けるような処理を行えばよく、スピーカ１２４から特定の音を発生する処理を行ってもよく、画面表示と特定音の発生の両方を行ってもよい。 In the above example, a specific screen is displayed on the display unit 121. However, a process in which the detected person turns his / her face toward the television receiver 1 may be performed, and a specific sound is output from the speaker 124. The process which generate | occur | produces may be performed and both a screen display and generation | occurrence | production of a specific sound may be performed.
　図９は、留守番動作設定処理の変形例を示すフローチャートである。これは図５からの変形であって、図５と同一処理部分には同じ番号を付し、説明を省略する。本例では留守番設定するユーザを顔認識し、認識したユーザを通知先として設定する工程Ｓ５２０～Ｓ５２２を追加している。 FIG. 9 is a flowchart showing a modification of the answering machine operation setting process. This is a modification of FIG. 5, and the same processing parts as those in FIG. In this example, steps S520 to S522 are added in which the user who sets the answering machine is face-recognized and the recognized user is set as the notification destination.
　Ｓ５２０では、カメラ部１２５で撮像した画像（設定作業を行うユーザ）を取り込む。Ｓ５２１では、予めストレージ１０４の個別情報記憶領域１０４ａに記憶されたユーザの顔認識登録情報に基づいて顔認識処理を行う。Ｓ５２２では、認識したユーザを通知先として設定する。以降、図５にと同様に留守番動作設定選択画面を表示部１２１に表示し（Ｓ５０１）、各種の設定作業を行う。 In S520, an image captured by the camera unit 125 (a user who performs setting work) is captured. In S521, face recognition processing is performed based on the user's face recognition registration information stored in advance in the individual information storage area 104a of the storage 104. In S522, the recognized user is set as a notification destination. Thereafter, as in FIG. 5, the answering machine operation setting selection screen is displayed on the display unit 121 (S501), and various setting operations are performed.
　本例によれば、留守番設定するユーザは通知先として自動的に設定されるので、Ｓ５０７～Ｓ５０９で行う通知先設定を簡略化できる。なお、設定者以外のユーザを通知先として設定したい場合には、Ｓ５０７～Ｓ５０９により設定すればよい。 According to this example, since the user who sets the answering machine is automatically set as the notification destination, the notification destination setting performed in S507 to S509 can be simplified. If it is desired to set a user other than the setter as the notification destination, the setting may be made through S507 to S509.
　図１０は、本発明の監視システムの第２の実施例を示すブロック構成図である。本実施例では、第１の実施例（図１）の構成に録画サーバ９を追加したものであり、それ以外の構成は図１と同様であり、重複する説明は省略する。 FIG. 10 is a block diagram showing a second embodiment of the monitoring system of the present invention. In this embodiment, the recording server 9 is added to the configuration of the first embodiment (FIG. 1), and the other configuration is the same as that of FIG.
　外部ネットワーク６には録画サーバ９を追加接続する。テレビ受信装置１は、留守番動作時にカメラ部で撮像した映像とマイクから入力される音声からなる留守番情報を、ルータ４を介して録画サーバ９に保存する。さらに携帯端末装置２では、無線ＬＡＮによりルータ５を介して、あるいはＷ－ＣＤＭＡやＧＳＭなどの遠距離無線通信により基地局７を介して外部ネットワーク６に接続し、録画サーバ９に保存した留守番情報を閲覧することができる。テレビ受信装置１のハードウェア構成は図２と同一であり、説明を省略する。 The recording server 9 is additionally connected to the external network 6. The television receiver 1 stores in the recording server 9 via the router 4 answering machine information consisting of video captured by the camera unit during voice mail operation and voice input from the microphone. Further, the portable terminal device 2 is connected to the external network 6 via the router 5 by wireless LAN or by the long-distance wireless communication such as W-CDMA or GSM via the base station 7 and stored in the recording server 9. Can be viewed. The hardware configuration of the television receiver 1 is the same as that in FIG.
　図１１は、録画サーバ９の構成例を示すブロック図である。録画サーバ９は、制御部９０１、メモリ９０２、通信部９０３、ストレージ９０４を備え、それぞれはバス９００で相互に接続されている。制御部９０１はＣＰＵ等で構成され、メモリ９０２に記憶したプログラムを実行することによって、各構成部を制御し、各種の処理を行っている。通信部９０３は外部ネットワーク６と接続するためのインターフェースであり、ネットワーク接続に対応したテレビ受信装置１あるいは携帯端末装置２と留守番情報を送受信することができる。ストレージ９０４は、録画サーバ９に接続する各ユーザの認証のアカウントやパスワード等のユーザ情報を記憶する領域９０４ａと、留守番情報を記憶する領域９０４ｂを有している。 FIG. 11 is a block diagram illustrating a configuration example of the recording server 9. The recording server 9 includes a control unit 901, a memory 902, a communication unit 903, and a storage 904, which are mutually connected by a bus 900. The control unit 901 is configured by a CPU or the like, and controls each component by executing a program stored in the memory 902 to perform various processes. A communication unit 903 is an interface for connecting to the external network 6, and can send and receive answering machine information to and from the television receiver 1 or the mobile terminal device 2 corresponding to the network connection. The storage 904 has an area 904a for storing user information such as an authentication account and a password for each user connected to the recording server 9, and an area 904b for storing answering machine information.
　本実施例におけるテレビ受信装置１の留守番動作は、留守番動作設定処理Ｓ４０２を除いて図４あるいは図８と同じである。 The answering machine operation of the television receiver 1 in this embodiment is the same as that shown in FIG. 4 or FIG. 8 except for the answering machine operation setting process S402.
　図１２は、本実施例における留守番動作設定処理（Ｓ４０２）の詳細フローチャートである。図５と同一処理部分には同じ番号を付し、説明を省略する。本実施例では、テレビ受信装置１が留守番動作時にカメラ部１２５で撮像した映像とマイク１２６から入力される音声を、留守番情報として録画サーバ９あるいはストレージ部に保存するものである。そのための録画先設定処理Ｓ５３０～Ｓ５３２を追加している。 FIG. 12 is a detailed flowchart of the answering machine operation setting process (S402) in the present embodiment. The same processing parts as those in FIG. In the present embodiment, the video received by the camera unit 125 and the audio input from the microphone 126 during the answering operation of the television receiver 1 are stored in the recording server 9 or the storage unit as answering information. Recording destination setting processes S530 to S532 for this purpose are added.
　選択入力Ｓ５０２で「録画先」が選択された場合には、Ｓ５３０で録画先設定画面を表示する。Ｓ５３１では、ユーザはリモートコントローラ１５０により録画先設定を入力する。Ｓ５３２では、ユーザが入力した項目を設定登録して、Ｓ５０１に戻る。 If “recording destination” is selected in the selection input S502, a recording destination setting screen is displayed in S530. In S531, the user inputs a recording destination setting by the remote controller 150. In S532, the item input by the user is set and registered, and the process returns to S501.
　図１３Ａ～図１３Ｃは、図１２の留守番動作設定処理における表示部１２１の表示例を示す図である。
  図１３Ａは、留守番動作設定選択画面表示処理（Ｓ５０１）における画面表示の例であり、図６Ａの画面表示の例に対して「録画先」の項目が追加されている。ユーザが操作キー１０６により「録画先」ボタン（１３ａ－１）を選択すると、録画先の設定画面に進む。 13A to 13C are diagrams showing display examples of the display unit 121 in the answering machine operation setting process of FIG.
FIG. 13A is an example of screen display in the answering machine operation setting selection screen display process (S501), and an item “recording destination” is added to the screen display example of FIG. 6A. When the user selects the “recording destination” button (13a-1) using the operation key 106, the screen proceeds to the recording destination setting screen.
　図１３Ｂは、録画先設定画面表示処理（Ｓ５３０）における画面表示の例であり、録画先として「内蔵ストレージ」と「録画サーバ」が選択可能となっている。ユーザが操作キー１０６により「内蔵ストレージ」ボタン（１３ｂ－１）あるいは「録画サーバ」ボタン（１３ｂ－２）を選択することにより、録画先の設定（または変更）が行われる。 FIG. 13B is an example of screen display in the recording destination setting screen display processing (S530), and “built-in storage” and “recording server” can be selected as recording destinations. When the user selects the “built-in storage” button (13 b-1) or the “recording server” button (13 b-2) using the operation key 106, the recording destination is set (or changed).
　図１３Ｃは、「録画サーバ」を選択した場合の画面表示の例であり、録画サーバに接続するユーザ認証の「アカウント名」（１３ｃ－１）や「パスワード」（１３ｃ－２）を入力し、設定を行う。 FIG. 13C is an example of a screen display when “recording server” is selected, and an “account name” (13c-1) and “password” (13c-2) for user authentication to connect to the recording server are input. Set up.
　本実施例によれば、録画サーバ９に録画内容を保存しているので、テレビ受信装置１の内蔵ストレージ１０４の情報が仮に破壊されても、録画内容を再現可能である。また、携帯端末装置２への通知メールに画像を添付しなくても、通知先のユーザは外部ネットワーク６を介して録画サーバ９に保存した録画内容を閲覧することができる利点がある。 According to the present embodiment, since the recorded contents are stored in the recording server 9, even if the information in the internal storage 104 of the television receiver 1 is destroyed, the recorded contents can be reproduced. In addition, there is an advantage that the notification destination user can view the recorded content stored in the recording server 9 via the external network 6 without attaching an image to the notification mail to the mobile terminal device 2.
　本発明における監視装置は、テレビ受信装置に限定されるものではなく、カメラ部や顔認識部等を有する情報表示端末装置であればよい。具体的には、パーソナルコンピュータやペット型ロボットであっても構わない。 The monitoring device in the present invention is not limited to a television receiver, and may be an information display terminal device having a camera unit, a face recognition unit, and the like. Specifically, a personal computer or a pet-type robot may be used.
　本発明は上記した各実施例に限定されるものではなく、様々な変形例が含まれる。例えば、上記した実施例は本発明を分かりやすく説明するためにシステム全体を詳細に説明したものであり、必ずしも説明した全ての構成を備えるものに限定されるものではない。また、ある実施例の構成の一部を他の実施例の構成に置き換えることが可能であり、また、ある実施例の構成に他の実施例の構成を加えることも可能である。また、各実施例の構成の一部について、他の構成の追加・削除・置換をすることが可能である。 The present invention is not limited to the above-described embodiments, and includes various modifications. For example, the above-described embodiments are described in detail for the entire system in order to explain the present invention in an easy-to-understand manner, and are not necessarily limited to those having all the configurations described. Further, a part of the configuration of one embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can be added to the configuration of one embodiment. Further, it is possible to add, delete, and replace other configurations for a part of the configuration of each embodiment.
　また、上記の各構成、機能、処理部、処理手段等は、それらの一部又は全部を、例えば集積回路で設計する等によりハードウェアで実現してもよい。また、上記の各構成、機能等は、プロセッサがそれぞれの機能を実現するプログラムを解釈し、実行することによりソフトウェアで実現してもよい。各機能を実現するプログラム、テーブル、ファイル等の情報は、メモリや、ハードディスク、ＳＳＤ（Solid State Drive）等の記録装置、または、ＩＣカード、ＳＤカード等の記録媒体に置くことができる。例えば、上記の実施例では顔認識情報、留守番動作に関する設定情報をストレージ１０４に記憶するようにしたが、メモリ１０３に記憶するようにしてもよい。 In addition, each of the above-described configurations, functions, processing units, processing means, and the like may be realized by hardware by designing a part or all of them with, for example, an integrated circuit. Each of the above-described configurations, functions, and the like may be realized by software by interpreting and executing a program that realizes each function by the processor. Information such as programs, tables, and files for realizing each function can be stored in a recording device such as a memory, a hard disk, an SSD (Solid State Drive), or a recording medium such as an IC card or an SD card. For example, in the above embodiment, the face recognition information and the setting information related to the answering machine operation are stored in the storage 104, but may be stored in the memory 103.
　また、各処理例で説明したプログラムは、それぞれ独立したプログラムでもよく、複数のプログラムが一つのアプリケーションプログラムを構成していてもよい。また、各処理を行う順番を入れ替えて実行するようにしてもよい。 Further, the programs described in each processing example may be independent programs, or a plurality of programs may constitute one application program. Further, the order of performing each process may be changed and executed.
　また、制御線や情報線は説明上必要と考えられるものを示しており、製品上必ずしも全ての制御線や情報線を示しているとは限らない。実際には殆ど全ての構成が相互に接続されていると考えてもよい。 Also, the control lines and information lines indicate what is considered necessary for the explanation, and not all the control lines and information lines on the product are necessarily shown. Actually, it may be considered that almost all the components are connected to each other.
　１…テレビ受信装置、２…携帯端末装置、３…メールサーバ、６…外部ネットワーク、７…基地局、９…録画サーバ、１０１…制御部、１０２…顔認識部、１０４…ストレージ、１０４ａ…個別情報記憶領域、１０４ｃ…伝言記憶領域、１０４ｄ…留守番情報記憶領域、１０８…人検知部、１０９…通信部、１２１…表示部、１２４…スピーカ、１２５…カメラ部、１２６…マイク。 DESCRIPTION OF SYMBOLS 1 ... Television receiver, 2 ... Portable terminal device, 3 ... Mail server, 6 ... External network, 7 ... Base station, 9 ... Recording server, 101 ... Control part, 102 ... Face recognition part, 104 ... Storage, 104a ... Individual Information storage area 104c ... Message storage area 104d ... Answering machine information storage area 108 ... Human detection section 109 ... Communication section 121 ... Display section 124 ... Speaker 125 ... Camera section 126 ... Microphone.

Claims (10)

  1. 　人を検知して所定の処理を行う監視装置において、
    　少なくとも人を検知する人検知部と、
    　人の画像を撮像するカメラ部と、
    　特定の人の顔画像を予め登録して記憶する個別情報記憶部と、
    　前記人検知部で人を検知したとき、前記カメラ部で撮像した顔画像と前記個別情報記憶部に記憶されている顔画像を比較して前記検知した人の顔認識を行う顔認識部と、
    　前記顔認識部の認識結果に基づき、前記個別情報記憶部に登録した人と未登録の人とで異なる処理を行う制御部と、を備えたことを特徴とする監視装置。     In a monitoring device that detects a person and performs a predetermined process,
    A human detection unit for detecting at least a person,
    A camera unit for capturing an image of a person;
    An individual information storage unit for registering and storing a face image of a specific person in advance;
    A face recognition unit that performs face recognition of the detected person by comparing a face image captured by the camera unit with a face image stored in the individual information storage unit when a person is detected by the person detection unit;
    A monitoring apparatus comprising: a control unit that performs different processing for a person registered in the individual information storage unit and an unregistered person based on a recognition result of the face recognition unit.
  2. 　請求項１に記載の監視装置において、
    　音声を入力するマイクと、
    　画像を表示する表示部と、
    　音声を出力するスピーカと、
    　前記カメラ部で撮像される画像、または前記マイクから入力される音声を伝言内容とし、該伝言の宛先を設定して記憶する伝言記憶部と、を備え、
    　前記制御部は、前記顔認識部による認識の結果、前記検知した人が前記伝言記憶部に設定された宛先である場合には、前記伝言記憶部に記憶された画像を前記表示部に表示し、または前記伝言記憶部に記憶された音声を前記スピーカから出力することを特徴とする監視装置。     The monitoring device according to claim 1,
    A microphone for voice input,
    A display for displaying an image;
    A speaker that outputs sound;
    An image captured by the camera unit or a voice input from the microphone as a message content, and a message storage unit that sets and stores a destination of the message,
    When the detected person is a destination set in the message storage unit as a result of recognition by the face recognition unit, the control unit displays an image stored in the message storage unit on the display unit. Or the monitoring apparatus characterized by outputting the voice memorize | stored in the said message memory | storage part from the said speaker.
  3. 　請求項１に記載の監視装置において、
    　メールを送信する通信部を備え、
    　前記個別情報記憶部には前記メールの通知先を設定して記憶しておき、
    　前記制御部は、前記顔認識部による認識結果の情報を、前記個別情報記憶部に設定された通知先にメール送信することを特徴とする監視装置。     The monitoring device according to claim 1,
    It has a communication unit that sends mail,
    In the individual information storage unit, the notification destination of the mail is set and stored,
    The monitoring device, wherein the control unit transmits information of a recognition result by the face recognition unit to a notification destination set in the individual information storage unit.
  4. 　請求項３に記載の監視装置において、
    　前記顔認識部による認識結果の情報として、前記カメラ部で撮像した前記検知した人の顔画像を添付してメール送信することを特徴とする監視装置。     The monitoring device according to claim 3,
    A monitoring apparatus, wherein the detected face image of the person imaged by the camera unit is attached and sent as information of the recognition result by the face recognition unit.
  5. 　請求項１に記載の監視装置において、
    　画像を表示する表示部と、
    　音声を出力するスピーカと、を備え、
    　前記制御部は、前記顔認識部による認識の結果、前記検知した人が前記個別情報記憶部に登録されていない場合には、前記表示部に所定の警告画像を表示し、及び/あるいは前記スピーカから所定の警告音を発生することを特徴とする監視装置。     The monitoring device according to claim 1,
    A display for displaying an image;
    A speaker for outputting sound;
    If the detected person is not registered in the individual information storage unit as a result of recognition by the face recognition unit, the control unit displays a predetermined warning image on the display unit and / or the speaker. A monitoring device that generates a predetermined warning sound from
  6. 　請求項１に記載の監視装置において、
    　音声を入力するマイクと、
    　前記カメラ部で撮像される画像、及び/または前記マイクから入力される音声を留守番情報として記憶する留守番情報記憶部と、を備え、
    　前記制御部は、前記顔認識部による認識の結果、前記検知した人が前記個別情報記憶部に登録されていない場合には、前記カメラ部で撮像される画像、及び/または前記マイクから入力される音声を前記留守番情報記憶部に記憶することを特徴とする監視装置。     The monitoring device according to claim 1,
    A microphone for voice input,
    An answering machine information storage unit for storing an image captured by the camera unit and / or voice input from the microphone as answering machine information,
    When the detected person is not registered in the individual information storage unit as a result of recognition by the face recognition unit, the control unit is input from an image captured by the camera unit and / or the microphone. The monitoring device is characterized in that the voice message is stored in the answering machine information storage unit.
  7. 　請求項１に記載の監視装置において、
    　不審者通報を送信する通信部を備え、
    　前記個別情報記憶部には前記不審者通報の通報先を設定して記憶しておき、
    　前記制御部は、前記顔認識部による認識の結果、前記検知した人が前記個別情報記憶部に登録されていない場合には、前記個別情報記憶部に設定されている通報先に、前記不審者通報を送信することを特徴とする監視装置。     The monitoring device according to claim 1,
    It has a communication unit that sends suspicious person reports,
    The individual information storage unit sets and stores a report destination of the suspicious person report,
    When the detected person is not registered in the individual information storage unit as a result of recognition by the face recognition unit, the control unit sends the suspicious person to the report destination set in the individual information storage unit. A monitoring device characterized by transmitting a report.
  8. 　請求項１に記載の監視装置は、テレビ受信装置または情報表示装置であることを特徴とする監視装置。 The monitoring device according to claim 1 is a television receiver or an information display device.
  9. 　人を検知して所定の処理を行う監視装置と、画像を記憶する録画サーバとをネットワークを介して接続した監視システムにおいて、
    　前記監視装置は、
    　少なくとも人を検知する人検知部と、
    　人の画像を撮像するカメラ部と、
    　音声を入力するマイクと、
    　特定の人の顔画像を予め登録して記憶する個別情報記憶部と、
    　前記人検知部で人を検知したとき、前記カメラ部で撮像した顔画像と前記個別情報記憶部に記憶されている顔画像を比較して前記検知した人の顔認識を行う顔認識部と、
    　画像と音声を送受信する第１の通信部と、
    　前記顔認識部の認識結果に基づき、前記個別情報記憶部に登録した人と未登録の人とで異なる処理を行う制御部と、を備え、
    　前記録画サーバは、
    　画像及び/または音声を送受信する第２の通信部と、
    　前記第２の通信部で受信した画像及び/または音声を記憶する留守番情報記憶部と、を備え、
    　前記監視装置の前記制御部は、前記顔認識部による認識の結果、前記検知した人が前記個別情報記憶部に登録されていない場合には、前記カメラ部で撮像される画像、及び/または前記マイクから入力される音声を、前記第１の通信部から前記ネットワークを介して前記録画サーバに送信し、
    　前記録画サーバは、前記第２の通信部にて受信した前記画像及び/または音声を前記留守番情報記憶部に記憶することを特徴とする監視システム。     In a monitoring system in which a monitoring device that detects a person and performs a predetermined process and a recording server that stores an image are connected via a network,
    The monitoring device
    A human detection unit for detecting at least a person,
    A camera unit for capturing an image of a person;
    A microphone for voice input,
    An individual information storage unit for registering and storing a face image of a specific person in advance;
    A face recognition unit that performs face recognition of the detected person by comparing a face image captured by the camera unit with a face image stored in the individual information storage unit when a person is detected by the person detection unit;
    A first communication unit for transmitting and receiving images and sound;
    A control unit that performs different processing between a person registered in the individual information storage unit and an unregistered person based on the recognition result of the face recognition unit,
    The recording server
    A second communication unit that transmits and receives images and / or sounds;
    An answering machine information storage unit for storing an image and / or sound received by the second communication unit,
    When the detected person is not registered in the individual information storage unit as a result of recognition by the face recognition unit, the control unit of the monitoring device is an image captured by the camera unit, and / or the Audio input from a microphone is transmitted from the first communication unit to the recording server via the network;
    The recording system, wherein the recording server stores the image and / or sound received by the second communication unit in the answering machine information storage unit.
  10. 　人を検知して所定の情報を提供する情報提供方法において、
    　特定の人の顔画像を予め登録するステップと、
    　人を検知してその画像を撮像するステップと、
    　撮像した顔画像と前記登録している顔画像を比較して前記検知した人の顔認識を行うステップと、
    　前記認識結果に基づき、前記検知した人が登録されている場合は、予め設定された伝言情報を提供し、
    　前記検知した人が登録されていない場合には、不審者対応処理を行い、
    　予め設定された通知先には、前記認識結果の情報を提供することを特徴とする情報提供方法。     In an information providing method for detecting a person and providing predetermined information,
    Pre-registering a face image of a specific person;
    Detecting a person and capturing the image;
    Comparing the captured face image with the registered face image to perform face detection of the detected person;
    Based on the recognition result, if the detected person is registered, provide pre-set message information,
    If the detected person is not registered, suspicious person handling processing is performed,
    An information providing method comprising providing information of the recognition result to a preset notification destination.
PCT/JP2013/080432 2013-11-11 2013-11-11 Monitoring device, monitoring system, and method for providing information WO2015068302A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2013/080432 WO2015068302A1 (en) 2013-11-11 2013-11-11 Monitoring device, monitoring system, and method for providing information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2013/080432 WO2015068302A1 (en) 2013-11-11 2013-11-11 Monitoring device, monitoring system, and method for providing information

Publications (1)

Publication Number Publication Date
WO2015068302A1 true WO2015068302A1 (en) 2015-05-14

Family

ID=53041103

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2013/080432 WO2015068302A1 (en) 2013-11-11 2013-11-11 Monitoring device, monitoring system, and method for providing information

Country Status (1)

Country Link
WO (1) WO2015068302A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE202016105934U1 (en) 2016-10-21 2017-08-22 Krones Ag Docking station for a labeling unit

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008294939A (en) * 2007-05-28 2008-12-04 Funai Electric Co Ltd Television receiver
JP2010074551A (en) * 2008-09-18 2010-04-02 Sony Corp Television receiver and recording method
JP2010226541A (en) * 2009-03-25 2010-10-07 Brother Ind Ltd Reception apparatus, visitor reception method, and visitor reception control program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008294939A (en) * 2007-05-28 2008-12-04 Funai Electric Co Ltd Television receiver
JP2010074551A (en) * 2008-09-18 2010-04-02 Sony Corp Television receiver and recording method
JP2010226541A (en) * 2009-03-25 2010-10-07 Brother Ind Ltd Reception apparatus, visitor reception method, and visitor reception control program

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE202016105934U1 (en) 2016-10-21 2017-08-22 Krones Ag Docking station for a labeling unit
WO2018072901A1 (en) 2016-10-21 2018-04-26 Krones Ag Docking station for a labeling unit

Similar Documents

Publication Publication Date Title
KR102110457B1 (en) Device and method for displaying missed message in terminal
EP3799404B1 (en) Device capable of notifying operation state change thereof through network and communication method of the device
EP3160151B1 (en) Video display device and operation method therefor
KR20200034376A (en) Apparatus and method for providing a notification by interworking a plurality of electronic devices
US9912627B2 (en) Generation and transmission of event notification content based on score
CN104601674A (en) Method, device and method for synchronizing notification message
JP2005072764A (en) Equipment control system and device thereof, and equipment control method
KR20140104286A (en) Device and method for controlling messenger in terminal
KR100703330B1 (en) Method for searching devices for bluetooth in wireless terminal
KR20060112933A (en) Method for displaying data in wireless terminal
CN105516944A (en) Short message canceling method and device
CN106453032B (en) Information-pushing method and device, system
JP4953850B2 (en) Content output system, portable communication terminal, and content output device
CN101783063A (en) Function setting method for remote control device and correlative function setting device
KR20170047316A (en) Method and terminal for processing media file
JPWO2009019890A1 (en) Communication apparatus and event processing method thereof
US20100171634A1 (en) Function Configuration Method and Related Device for a Remote Control Device
WO2015068302A1 (en) Monitoring device, monitoring system, and method for providing information
CN105376318A (en) File transmission method, device and system
KR100879996B1 (en) Wireless multi-functional kitchen display apparatus
EP2922306A1 (en) Personalization service method and system linked to user terminal
JP2004289625A (en) Car security apparatus, system, and method
US10212476B2 (en) Image display apparatus and image displaying method
WO2015004840A1 (en) Video reception device, information display method, and video reception system
KR102067644B1 (en) Device and method for outputing message receiving tone

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13896955

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13896955

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP