JP5308714B2 - Display device with camera - Google Patents

Description

  The present invention relates to an application in a display device such as a television set with a built-in camera.

A method for capturing a user's gesture with a camera and obtaining a command indicated by the gesture has been proposed. (See Patent Documents 1 and 2)
If this mechanism is installed in a television, the user can remotely operate the television without using a dedicated device such as a remote control.

In addition, a method for recognizing a user with a camera and causing a television to perform an operation corresponding to the user has been proposed. (See Patent Document 3)
In this proposal, the camera captures the user's iris, thereby identifying the user. When the user is an infant or a minor, when a screen that adversely affects education is displayed, the channel can be switched, a warning can be issued, and the power can be turned off.

  On the other hand, a security monitoring system has been proposed in which an image from an outdoor camera is displayed on a monitor television set in an indoor security room or the like. (See Patent Document 4).

JP 7-73289 A JP 10-255052 JP2001-16514 JP 5-314381

  In the inventions disclosed in Patent Documents 1 to 3, even if a camera is added to or built in the television, the camera is only used as a television and when the user is out. It is also considered long when the user is not in use, such as when the user is sleeping.

  On the other hand, although the invention disclosed in Patent Document 4 performs outdoor monitoring, indoor monitoring is not considered.

  Here, when it is desired to monitor indoors, the camera can be used effectively by using a camera added to or built in the television.

  In this case, when the user wants to perform monitoring, a method of starting / ending shooting / recording with a switch or the like can be considered. However, with this method, the user must always operate the switch or the like while being aware of monitoring. No longer.

  In addition, in order to detect an intruder and take a picture / record, complicated control is required in the apparatus.

  Therefore, an object of the present invention is to provide a camera-equipped display device that can monitor indoors with a simple device without making the user aware of it.

  To achieve the above object, the camera-equipped display device of the present invention includes a receiving unit that receives broadcast waves, a decoder that decodes the broadcast waves received by the receiving unit and outputs broadcast data, and captures the surroundings. An imaging unit that outputs imaging data, broadcast data output from the decoder, or a storage unit that stores imaging data output from the imaging unit, and broadcast data output from the decoder, or the storage unit A display device with a camera, comprising: an output unit that outputs broadcast data stored in the control unit; and a control unit that receives an operation command from a user and controls the decoder, the imaging unit, the storage unit, and the output unit, and the control unit Then, except that the specific operation based on the operation command from the user is being performed, control is performed to store the imaging data output from the imaging unit in the storage unit

  The operation command from the user is a broadcast data output command output from the decoder or a broadcast data playback command stored in the storage unit.

  In the storage unit, user information is stored in advance, and in the control unit, information based on shooting data output from the shooting unit is compared with user information stored in the storage unit to match. In some cases, an operation command from the user may be received.

  Further, the output unit can output shooting data output from the shooting unit or shooting data stored in the storage unit.

  Further, when the shooting data output from the shooting unit is not stored in the storage unit, the shooting unit may stop the shooting itself.

  The output unit may indicate that the storage operation is being performed while the storage unit stores the shooting data.

  The output unit may indicate that the photographing operation is being performed while the photographing unit is photographing.

  According to the present invention, indoor monitoring can be performed with a simple device without making the user conscious.

(First embodiment)
FIG. 1 is a functional block diagram of the camera-equipped display device 100 and the infrared remote controller 200 according to the first embodiment of the present invention.

  The control unit 110 performs various calculations and controls various hardware mounted on the camera-equipped display device 100. The CPU (Central Processing Unit) 111 executes various programs, and controls hardware. Flash ROM (Read Only Memory) 112 for storing a driver for receiving an operation instruction from the user and moving the hardware in response to a user, and a RAM (Random Access) used as a work area for the application program Memory) 113. The antenna 120 receives the broadcast wave transmitted from the broadcast station and transfers it to the decoder 130. The decoder 130 decodes the broadcast wave transferred from the antenna 120, converts it into reproducible moving image data, still image data, and audio data, and transfers them to the control unit 110. The camera 140 captures the surroundings and transfers the captured moving image data, still image data, and audio data to the control unit 110. An HDD (Hard Disk Drive) 150 is a large-capacity nonvolatile storage device that stores moving image data, still image data, and audio data. An LCD (Liquid Crystal Display) 160 receives moving image data and still image data and displays them on the screen in accordance with instructions from the control unit 110. The speaker 170 receives sound data and generates sound according to a command from the control unit 110. The infrared light receiving unit 180 receives an infrared ray emitted from the infrared remote controller 200 by the user, and transfers a command from the user notified by the infrared ray to the control unit 110. The infrared remote controller 200 transmits a user's command to the camera-equipped display device 100 by infrared rays.

  Next, FIG. 2 shows a processing flow from the power-on of the display device with camera 100 to the monitoring stop recording start, the recording stop, and the recording restart.

  After the power is turned on (S100 in FIG. 2), the control unit 110 causes the camera 140 to take a picture and transfers the taken moving image data and audio data to the HDD 150 for storage (S101 in FIG. 2).

  When there is an instruction to record a program transmitted by broadcast waves from the user (Yes in S102 in FIG. 2), the control unit 110 transfers the moving image data transferred from the decoder 130 to the HDD 150 and stores it (see FIG. 2). S103).

  When there is a command to output a program transmitted by broadcast waves from the user (Yes in S104 in FIG. 2), the control unit 110 stops the recording of the camera 140 (S105 in FIG. 2) and is transferred from the decoder 130. The moving image data and still image data are transferred to the LCD 160 for display, and the audio data is transferred to the speaker 170 to generate sound (S106 in FIG. 2).

  The control unit 110 stops shooting and recording of the camera 140 (S105 in FIG. 2) when the user gives a reproduction command for moving image data, still image data, and audio data stored in the HDD 150 (Yes in S104 in FIG. 2). The moving image data and still image data stored in the HDD 150 and instructed by the user are transferred to the LCD 160 for display, and the audio data is transferred to the speaker 170 to generate audio (S106 in FIG. 2).

  When the user gives an instruction to stop the reproduction of the moving image data, the still image data, and the audio data (Yes in S107 in FIG. 2), the control unit 110 stops the reproduction (S108 in FIG. 2), and the camera 140 takes a picture. The captured video data and audio data are transferred to the HDD 150 and stored (S101 in FIG. 2).

  In the above operation, the control unit 110 stops shooting and recording of the camera 140 when a playback command is issued from the user. In this case, the shooting of the camera 140 is continued and the output video data and audio data are output. May be stopped in the HDD 150.

  In addition, the control unit 110 causes the camera 140 to perform shooting, and transfers the captured moving image data and audio data to the HDD 150 and stores the moving image data or still image data indicating that the monitoring shooting is being performed. It may be transferred to the LCD 160 for display, or audio data indicating that surveillance shooting is being performed may be transferred to the speaker 170 to generate audio.

  In addition, the control unit 110 transfers the moving image data or still image data indicating that the monitoring shooting is being performed to the LCD 160 and displays the monitoring data while the camera 140 is shooting. May be transmitted to the speaker 170 to generate sound.

  In this embodiment, monitoring recording is stopped and started according to the start and stop of playback.However, monitoring recording is stopped and started not only according to playback but also according to operations that can be performed by another remote controller. You may go.

According to the present embodiment, monitoring and recording is performed in association with the operation as a TV function such as reproduction, so that indoor monitoring can be performed without complicated control and without being conscious of the user. it can.
(Second embodiment)
Also in the second embodiment of the present invention, the functional block diagram of FIG. 1 is obtained, and the basic functions and operations are the same as those in the first embodiment. In this embodiment, a user's gesture is further image | photographed with the camera 140, The command to the display apparatus 100 with a camera is allocated to various gestures, and is performed. The controller 110 implements a program for identifying the palm in the moving image data transferred from the camera 140, and recognizes the gesture by recognizing how the identified palm moves in the moving image. For example, when the palm moves from the stationary state of 1 second to the right, the channel of the broadcast wave selected by the decoder 130 is raised by one, and the palm moves from the stationary state of 1 second to the left. When the channel of the broadcast wave selected by the decoder 130 is lowered, the volume of the sound generated by the speaker 170 is increased when the palm moves up from the stationary state of 1 second. The palm is stationary state of 1 second. The sound volume generated by the speaker 170 is lowered when moving from the lower position to the lower position.

  In addition, the user's face is recognized by the camera 140. Face recognition uses various facial features such as the shape and position of the eyes, nose, mouth, ears, and eyebrows that make up the face, their interrelationships, and facial contours. To identify individuals. The user's facial features are registered in advance in the HDD 150 as a database, and if they match the facial features photographed by the camera 140, they are recognized as valid users.

  Next, FIG. 3 shows a processing flow from the start of power-on of the display device with camera 100 to the stop of recording and the resumption of recording of monitoring imaging including face authentication.

After the power is turned on (S200 in FIG. 3), the control unit 110 causes the camera 140 to take a picture and transfers the taken moving image data and audio data to the HDD 150 for storage (S201 in FIG. 3). At the same time, the moving image captured by the camera 140 is checked against the facial features of the user stored in the HDD 150 to check whether a matching face is captured, that is, whether a valid user is captured ( S202 in FIG. 3). When a legitimate user has been photographed and the camera 140 has photographed a reproduction instruction by gesture, or when a legitimate user has been photographed and the infrared light receiving unit 180 has received a reproduction instruction by infrared ( 3, the control unit 110 stops storing the moving image data and audio data captured by the camera 140 in the HDD 150 (S204 in FIG. 3). However, in order to recognize the user's gesture, the photographing with the camera 140 is continued. The moving image data and still image data for which a reproduction command has been issued are transferred to the LCD 160 for display, and the audio data is transferred to the speaker 170 to generate audio (S205 in FIG. 3). During this time, the control unit 110 does not store the moving image data and audio data captured by the camera 140 in the HDD 150 (Yes in S206 in FIG. 3). When a user gives a playback stop command using the gesture to the camera 140 or the infrared remote controller 200 and stops playback, a certain time (which can be arbitrarily set by user designation) has elapsed (Yes in S207 in FIG. 3). The control unit 110 starts an operation of storing the moving image data and audio data captured by the camera 140 in the HDD 150. (S201 in FIG. 3)
In the above operation, when a legitimate user is photographed and the camera 140 photographs a command by a gesture, or when a legitimate user is photographed and the infrared light receiving unit 180 receives an infrared operation command. When received, the control unit 110 stops storing the moving image data and audio data captured by the camera 140 in the HDD 150. In this case, the camera 140 may stop capturing itself.

  In addition, the control unit 110 causes the camera 140 to perform shooting, and transfers the captured moving image data and audio data to the HDD 150 and stores the moving image data or still image data indicating that the monitoring shooting is being performed. It may be transferred to the LCD 160 for display, or audio data indicating that surveillance shooting is being performed may be transferred to the speaker 170 to generate audio.

  In addition, the control unit 110 transfers the moving image data or still image data indicating that the monitoring shooting is being performed to the LCD 160 and displays the monitoring data while the camera 140 is shooting. May be transmitted to the speaker 170 to generate sound.

  In the above operation, a legitimate user is identified by face authentication. However, the present invention is not limited to this, and features of the hand such as a shape, accessories such as a fingerprint, a bag, a ring, a tag for personal identification, etc. It may be recognized and identified accordingly.

  Also in this embodiment, monitoring recording is stopped and started according to the start and stop of playback. However, monitoring recording is stopped and started not only according to playback but also according to operations that can be performed by another remote controller. May be performed.

  According to the present embodiment, monitoring and recording is performed in association with the operation as a TV function such as reproduction, so that indoor monitoring can be performed without complicated control and without being conscious of the user. In addition, it is possible to prevent monitoring shooting from being stopped by an unauthorized user.

(Third embodiment)
FIG. 4 is a functional block diagram of the camera-equipped display device 100 and the infrared remote controller 200 according to the third embodiment of the present invention. Basic functions and operations are the same as those in the first embodiment. In the present embodiment, a wireless LAN (Local Area Network) 190 is further provided, and wireless communication is performed with the external nonvolatile mass storage device 300 via the wireless LAN to enable data transmission / reception.

  FIG. 5 shows a functional block diagram of the nonvolatile mass storage device 300.

  The non-volatile mass storage device 300 is a storage device that can transmit and receive data wirelessly, and the control unit 310 performs various operations and executes various programs to control the wireless LAN 320 and the HDD 330 (Centralized CPU). Processing Unit (Central Processing Unit) 311, driver for hardware control, Flash ROM (Read Only Memory) 312 for storing application programs that accept hardware commands and move hardware, and used as a work area for application programs RAM (Random Access Memory) 313, which is a volatile storage area. The wireless LAN 320 performs wireless communication with an external device through the wireless LAN, and transmits and receives data. The HDD 330 is a nonvolatile mass storage device that actually stores data. The control unit 310 causes the wireless LAN 320 to communicate with an external device, receives a data transmission / reception command from the external device, receives data to be stored in the HDD 330, and transmits data from the HDD 330.

  In the camera-equipped display device 100, when the control unit 110 causes the camera 140 to take a picture and stores the captured moving image data and audio data, the wireless LAN 190 transfers the data to the nonvolatile mass storage device 300 for storage. Let In addition, when the controller 110 is requested to reproduce moving image data and audio data captured by the camera 140 and stored in the non-volatile mass storage device 300, the control unit 110 transmits the data to the non-volatile mass storage device 300 via the wireless LAN 190. In response to the request, the non-volatile mass storage device 300 causes the wireless LAN 320 to transmit the moving image data and audio data stored in the HDD 330 to the display device with camera 100. When the wireless LAN 190 receives the data, the wireless LAN 190 transfers the data to the control unit 110. The control unit 110 transfers the data to the LCD 160 for display if it is moving image data, and transfers it to the speaker 170 for reproduction if it is audio data.

  Although the wireless LAN is used for communication between the display device with camera 100 and the nonvolatile mass storage device 300, the wireless communication method is not limited to this. For example, a wired LAN may be used, or public wireless communication using a mobile phone wireless communication network may be used.

According to the present embodiment, in addition to the effects in the first and second embodiments, the HDD storing the video data and audio data that have been monitored and photographed can be installed at a location away from the camera 140, which is irregular. It is possible to prevent physical destruction of surveillance shooting data by the user.

It is a functional block diagram of the display apparatus with a camera in a first embodiment. It is a flowchart which shows the start and stop of monitoring imaging | photography recording in 1st Embodiment, and the start and stop of reproduction | regeneration. It is a flowchart which shows the start and stop of monitoring imaging | photography recording in 2nd Embodiment, and the start and stop of reproduction | regeneration. It is a functional block diagram of the display apparatus with a camera in a third embodiment. It is a functional block diagram of the mass storage device in the third embodiment.

Explanation of symbols

100 Display Device with Camera 110 Control Unit 111 CPU
112 Flash ROM
113 RAM
120 Antenna 130 Decoder 140 Camera 150 HDD
160 LCD
170 Speaker 180 Infrared light receiver 190 Wireless LAN
200 Infrared remote control 300 Non-volatile mass storage device 310 Control unit 311 CPU
312 Flash ROM
313 RAM
320 wireless LAN
330 HDD

Claims (4)

A receiver for receiving broadcast waves;
A decoder for decoding broadcast waves received by the receiver and outputting broadcast data;
A shooting unit that shoots the surroundings and outputs the shooting data;
Broadcast data output from the decoder, or storage unit for storing shooting data output from the shooting unit,
Broadcast data output from the decoder, or an output unit that outputs broadcast data stored in the storage unit,
A camera comprising: a control unit that controls the decoder, the imaging unit, the storage unit, and the output unit in response to a broadcast data output command output from the decoder or a broadcast data playback command stored in the storage unit An attached display device,
Wherein the control unit, while the output operation based on the output instruction is performed or, except during the output operation based on the reproduction command is being performed, the stored imaging data outputted from the imaging unit And a camera-equipped display device. The display device with a camera according to claim 1, wherein the output unit is capable of outputting shooting data output from the shooting unit or shooting data stored in the storage unit. The camera-equipped display device according to claim 1 , wherein the shooting unit stops the shooting itself when shooting data output from the shooting unit is not stored in the storage unit. 2. The display device with a camera according to claim 1 , wherein the output unit indicates that the photographing operation is being performed while the photographing unit is photographing .

Images