JP2008160612A - Recording system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a compact and inexpensive recording system which allows the user to analyze or re-experience later almost all the behaviors in every day life. <P>SOLUTION: When the environment around a remote controller 4 changes or the remote controller 4 is operated, imaging by an imaging device 2 is started and at the same time, recording of the captured images by a recording device 3 is started. Therefore, the user can analyze or re-experience later almost all the behaviors in every day life. Moreover, since recording of unwanted captured images not necessary for the user to analyze or re-experience later his/her behaviors is suppressed, the memory capacity required of the recording device 3 for recording the captured images is sufficiently suppressed. Consequently, the system can be constructed compact at a low cost. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a recording system in which a user's behavior can be tracked later by capturing and recording the user's behavior.

  2. Description of the Related Art Conventionally, there is a technology called life log that allows a user to track the behavior at that time later by capturing and recording the behavior of the user. This technology is a technology that enables the user to analyze and relive past behavior by tracking their own recorded behavior. In particular, it is a technique that has been proposed to track all user operations and operations performed when using a personal computer later.

Also, unlike the technology related to the life log described above, when the doorbell ring bell is pressed, the camera provided on the doorphone starts imaging and starts recording the captured image. There has been a proposal to record a videophone at the time of setting (see Patent Document 1). Also, a proposal is made to monitor changes in the surrounding sound with a microphone installed outdoors, determine that it is abnormal when the change is large, start imaging with the outdoor camera, and start recording the captured image (See Patent Document 2).
JP-A-9-65224 JP 2002-158996 A

  However, with the technology related to the life log that has been proposed in the past, the recording of the user's behavior is started and the recording is started when the user himself / herself performs an operation related to the recording end or when a specific device such as a personal computer is activated. However, the recording is stopped when the apparatus is stopped. That is, only actions based on the premise that the user will perform analysis or pursuit experience later can be recorded and left. On the other hand, the behavior premised on the user performing later analysis or pursuit experience is a very small amount of behavior in the user's daily life. Therefore, the user cannot analyze or perform a re-experience on most behaviors in daily life. In other words, the actions that the user can analyze and relive later are limited to some actions in daily life.

  If the user's behavior is continuously imaged and recorded, most behaviors in daily life can be recorded and left. However, in this case, a captured image in which the user is not captured, that is, a wasteful captured image that is not necessary for the user to perform analysis or a follow-up experience later is recorded. Therefore, the storage capacity necessary for recording the captured image becomes very large. As a result, problems such as an increase in system size and cost increase occur.

  It is an object of the present invention to provide a small and inexpensive recording system that allows a user to analyze most of the activities in daily life or perform a re-experience later.

  The recording system of the present invention has the following configuration in order to solve the above problems.

(1) An imaging device including an imaging unit that images an imaging region, and a captured image output unit that outputs a captured image of the imaging region captured by the imaging unit;
A recording apparatus comprising recording means for capturing and recording the captured image output by the captured image output means of the imaging apparatus;
In a recording system comprising: the imaging device; and a remote controller provided with a remote control means for remotely controlling the recording device.
The remote control is
Environmental change detection means for detecting environmental changes around the main body;
When the environmental change detection unit detects an environmental change around the main body, the remote control unit instructs the imaging device to start imaging of the imaging region and starts recording the captured image to the recording device. Start instruction means for instructing.

  In this configuration, the environment change detection means provided in the remote controller detects the environment change around the remote controller. For example, a change in voice or vibration in the vicinity is detected as a change in the surrounding environment. When the environmental change detection unit detects an environmental change around the remote controller, the start instruction unit instructs the imaging apparatus to start imaging and instructs the recording apparatus to start recording of the captured image by the imaging apparatus. Thereby, the picked-up image imaged with the imaging device is recorded with a recording device.

  In many cases, when a person comes around the remote control or when a person leaves the remote control, the environment around the remote control changes. In addition, many users decide on the table or the like as the place for the remote control in consideration of the usability of the remote control. For this reason, the location of the remote controller does not change frequently. Therefore, if the imaging apparatus is installed so that the area around the remote control is located in the imaging area, the actions performed by the user around the remote control can be recorded as a life log. In addition, recording of the captured image when the user is not in the imaging area is suppressed. That is, it is possible to suppress the recording of useless captured images that are not necessary for the user to perform analysis or a follow-up experience later. Therefore, the user can analyze most of the activities in daily life or perform a re-experience later, and the necessary storage capacity required for the recording apparatus that records the captured image can be sufficiently suppressed. For this reason, the system can be constructed small and inexpensively.

(2) The remote control
Voice signal sending means for collecting voice around the main body and sending voice signal based on the collected voice,
The recording means of the recording device comprises:
A means for capturing and recording an audio signal transmitted by the audio signal transmitting means of the remote control and a captured image captured by the imaging apparatus;

  In this configuration, not only the captured image but also the sound is recorded, so that the behavior analysis and the re-experience performed later by the user can be performed more accurately.

(3) The start instruction means of the remote control is
Even when an input operation is performed on the main body, the remote control means instructs the imaging apparatus to start imaging of the imaging area and instructs the recording apparatus to start recording the captured image. is there.

  In this configuration, it is possible to record and leave the user's behavior immediately after operating the remote control, and it is possible to reliably analyze and follow up the behavior related to the operation of the remote control.

(4) The imaging device includes:
An imaging start timing control unit that starts imaging of the imaging area by the imaging unit at a predetermined timing is provided.

  In this configuration, imaging by the imaging unit of the imaging apparatus is started at a predetermined timing, and the captured image is recorded in the recording apparatus.

(5) The imaging device includes:
Change determination means for determining whether or not a change has occurred in a captured image of an imaging region captured by the imaging means;
When the change determining unit determines that a change has occurred in the captured image, the imaging unit continues imaging of the imaging region, and when it is determined that the captured image has not changed, the imaging unit Imaging control means for stopping imaging of the imaging area.

  In this configuration, the recording device allows the user to perform later analysis or re-experience, such as a captured image when the user is not in the imaging area, or a captured image when the user is hardly acting in the imaging area. Recording of unnecessary captured images that are not necessary can be more sufficiently suppressed. Therefore, the system can be constructed more compactly and inexpensively.

  According to the present invention, the user can analyze most of the activities in daily life or perform a re-experience later, and the required storage capacity required for the recording apparatus for recording the captured image is sufficiently suppressed. It is done. For this reason, the system can be constructed small and inexpensively.

  Hereinafter, a recording system according to an embodiment of the present invention will be described.

  FIG. 1 is a diagram showing a recording system according to an embodiment of the present invention. The recording system of this embodiment includes a television receiver 1, an imaging device 2, a recording device 3, and a remote controller 4. This recording system is a system that enables the user to analyze and relive the user's behavior by capturing and recording the user's behavior. This recording system is a system that leaves the user's behavior as a life log in a place where the user spends a relatively long time in daily life, such as a living room where the television receiver 1 is installed.

  The television receiver 1 extracts a channel signal selected from a television broadcast signal received by an antenna (not shown), and outputs video and audio of a program broadcast on the channel. The imaging device 2 is installed with its imaging area determined so that a user viewing a program on the television receiver 1 can take an image. Many users, when installing the television receiver 1 in a room, determine the installation location in consideration of their location in the room. Therefore, in many cases, when a user is in a room in which the television receiver 1 is installed, the user can view the program on the television receiver 1 regardless of whether the television receiver 1 is viewing the program. In place. That is, when the user is in the room where the television receiver 1 is installed, the user is in the imaging area of the imaging device 2. The recording device 3 records the captured image captured by the imaging device 2 on a recording medium such as a hard disk. The television receiver 1, the imaging device 2, and the recording device 3 are connected to each other. The television receiver 1 can also display a captured image captured by the imaging device 2 and a recorded image recorded in the recording device 3.

  The remote controller 4 remotely controls the television receiver 1, the imaging device 2, and the recording device 3. In this embodiment, the television receiver 1 receives a control signal transmitted from the remote controller 4 by radio waves or infrared rays. The television receiver 1 determines to which device the control signal from the remote controller 4 is, and if not, it transfers the received control signal to the corresponding device. When the television receiver 1 receives a control signal for itself, the television receiver 1 performs an operation based on the control signal. For example, power on / off and channel switching are performed. In addition, when a control signal is sent from the remote controller 4 via the television receiver 1, the imaging device 2 and the recording device 3 perform an operation based on the control signal. As described above, in the recording system of this embodiment, the remote controller 4 performs remote control of the imaging device 2 and the recording device 3 via the television receiver 1. As described above, since the remote controller 4 remotely controls the television receiver 1, many users decide where to place the remote controller 4 in the vicinity of their location when viewing the program on the television receiver 1. ing.

  In this embodiment, the television receiver 1, the imaging device 2, and the recording device 3 are described as separate devices, but they may be configured as an integrated device that is housed in one housing. Any two devices may be housed in one housing.

  Next, the configuration of each device will be described. FIG. 2 is a diagram illustrating a configuration of a main part of the television receiver. The television receiver 1 includes a control unit 10, an external input / output unit 11, a receiving unit 12, a display unit 13, an audio output unit 14, an operation unit 15, and a remote control receiving unit 16. The control unit 10 controls the operation of each part of the main body. An imaging device 2 and a recording device 3 are connected to the external input / output unit 11. The external input / output unit 11 receives an input of a captured image from the imaging device 2 and an input of a recorded image from the recording device 3. The external input / output unit 11 outputs an image to the recording device 3. The external input / output unit 11 also has a function of inputting / outputting control signals to / from the imaging device 2 and inputting / outputting control signals to / from the recording device 3.

  The receiving unit 12 is connected to an antenna (not shown), and receives a television broadcast signal received by the antenna. A captured image and a recorded image input to the external input / output unit 11 are also input. The receiving unit 12 has a tuner that extracts a television broadcast signal of a selected channel. The receiving unit 12 outputs an image signal and an audio signal of the selected channel. The receiving unit 12 can also select an input channel from the external input / output unit 11. The display unit 13 includes a display, and displays an image based on the image signal output from the reception unit 12 on the display. The audio output unit 14 includes a speaker and emits sound based on the audio signal output from the receiving unit 12 through the speaker. The operation unit 15 receives an input operation on the main body. The remote control receiver 16 receives a control signal from the remote controller 4.

  FIG. 3 is a diagram illustrating a configuration of a main part of the imaging apparatus. The imaging device 2 includes a control unit 20, an imaging unit 21, a captured image output unit 22, and a control signal input / output unit 23. The control unit 20 controls the operation of each part of the main body. The imaging unit 21 has an imaging optical system including an imaging element such as a CCD, an objective lens, and the like, and images an imaging area. The captured image output unit 22 outputs the captured image captured by the imaging unit 21 to the display device 1 or the recording device 3. The control signal input / output unit 23 transmits and receives control signals to and from the display device 1 and the recording device 3.

  In addition, the control part 20 has an image processing function which processes the captured image imaged by the imaging part 21, so that it may mention later.

  FIG. 4 is a diagram illustrating a configuration of a main part of the recording apparatus. The recording apparatus 3 includes a control unit 30, an image input / output unit 31, a recording unit 32, and a control signal input / output unit 33. The control unit 30 controls the operation of each part of the main body. The image input / output unit 31 controls image input / output with the television receiver 1 and the imaging device 2. The recording unit 32 records the image input to the image input / output unit 31 on a recording medium such as a hard disk. The recording unit 32 also has a function of reading and outputting an image recorded on a recording medium (so-called reproduction function). The control signal input / output unit 23 transmits and receives control signals to and from the display device 1 and the imaging device 2.

  FIG. 5 is a diagram showing the configuration of the main part of the remote controller. The remote controller 4 includes a control unit 40, an operation unit 41, a transmission unit 42, a vibration detection unit 43, and a sound collection unit 44. The control unit 40 controls the operation of each part of the main body. The operation unit 41 receives an input operation by a user. The transmission unit 42 transmits a control signal corresponding to the input operation in the operation unit 41. The vibration detection unit 43 includes a vibration detection sensor, and the vibration detection sensor detects the vibration of the main body. The sound collection unit 44 includes a microphone (hereinafter simply referred to as a microphone) and collects sound around the main body. The vibration detecting unit 43 and the sound collecting unit 44 constitute the environmental change detecting means in the present invention.

  The operation of each device in the recording system according to the embodiment of the present invention will be described below. FIG. 6 is a flowchart showing the operation of the television receiver. FIG. 7 is a flowchart showing the operation of the imaging apparatus 2. FIG. 8 is a flowchart showing the operation of the recording apparatus 3. FIG. 9 is a flowchart showing the operation of the remote controller.

  When the television receiver 1 receives a control signal from the remote controller 4 at the remote control receiver 16, whether the control signal is for the own device, or the imaging device 2 or the recording device 3 Is determined (s2). The control signal transmitted from the remote controller 4 includes a code indicating a device that provides the control signal. From this code, the television receiver 1 determines to which device the control signal from the remote controller 4 received this time is directed. If the control signal from the remote control received this time is for the own device, the television receiver 1 performs an operation based on the control signal (s3, s4), and returns to s1. In s4, operations related to power on / off, channel switching, and the like are performed. If the television receiver 1 is not intended for the own device, the control signal from the remote controller 4 received this time is transferred to the device determined in s2 (s5), and the process returns to s1. In s5, the control signal received this time is output from the external input / output unit 11.

  Thus, the control signal from the remote controller 4 is sent to the imaging device 2 and the recording device 3 via the television receiver 1. Therefore, the user can remotely control the television receiver 1, the imaging device 2, and the recording device 3 with the remote controller 4.

  Here, the control signal from the remote controller 4 is sent to the imaging device 2 and the recording device 3 via the television receiver 1, but the television receiver 1, the imaging device 2, and the recording device 3 are sent to the imaging device 2 and the recording device 3. A remote control receiving unit may be provided, and if the received control signal from the remote control 4 is for the own device, an operation based on the control signal is performed, and if it is not for the own device, it may be ignored. Even with this configuration, the user can remotely control the television receiver 1, the imaging device 2, and the recording device 3 with the remote controller 4.

  Next, the operation of the imaging apparatus 2 will be described with reference to FIG. The imaging device 2 waits for a predetermined imaging timing or to receive a control signal related to an imaging start instruction from the remote controller 4 (s11, s12). For example, a timing at which a predetermined time (for example, 30 minutes) has elapsed since the previous imaging stop may be set as the imaging timing, or a time such as every hour may be set as the imaging timing. When there is a predetermined timing or an instruction to start imaging, the imaging device 2 starts imaging of the imaging area by the imaging unit 21 (s13). The imaging device 2 outputs a captured image captured by the imaging unit 21 from the captured image output unit 22 when imaging of the imaging region is started in s13. The image output from the captured image output unit 22 is input to the television receiver 1 and the recording device 3. When the imaging apparatus 2 starts imaging in s13, the imaging apparatus 2 instructs the recording apparatus 3 to start recording the captured image output (s14). This instruction to start recording is output from the control signal input / output unit 23. The instruction according to s14 may be output as necessary after judging the state of the recording apparatus 3. In other words, the recording apparatus 3 may be configured to output if the current captured image is not recorded, and not output if the recorded image is being recorded.

  The imaging device 2 processes the captured image captured by the imaging unit 21 in the control unit 2, and determines whether there is a change in the captured image (s15). In s15, a difference image between the captured image captured at that time and a captured image captured a predetermined time ago (for example, 5 seconds before) is generated, and the captured image changes based on the difference image. Determine if it exists. When the imaging device 2 determines that there is no change in the captured image, that is, when there is no moving object in the imaging region, the imaging device 2 instructs the recording device 3 to stop recording the captured image (s16). . This recording stop instruction is also output from the control signal input / output unit 23. The instruction relating to s16 may be output as necessary after judging the state of the recording apparatus 3. In other words, the recording apparatus 3 may be configured to output if the current captured image is being recorded, and not output if the recorded image is not being recorded. The imaging device 2 stops the imaging of the imaging area in the imaging unit 21 (s17), and returns to s11.

  Next, the operation of the recording apparatus 3 will be described with reference to FIG. The recording device 3 waits for an instruction to start recording (s21). The instruction to start recording may be sent via the television receiver 1 or may be sent from the imaging device 2. When the recording device 3 is instructed to start recording, the recording device 3 starts a recording process in which the captured image output from the captured image output unit 22 by the imaging device 2 is recorded in the recording unit 32 (s22). When the recording apparatus 3 starts recording the captured image in s22, the recording apparatus 3 waits for an instruction to stop recording (s23). This recording stop instruction may be sent via the television receiver 1 or may be sent from the imaging device 2. When the recording apparatus 3 is instructed to stop recording, the recording apparatus 3 stops recording the captured image output from the captured image output unit 22 in the recording unit 32 (s24), and returns to s21.

  As described above, when the imaging device 2 starts imaging of the imaging area in the imaging unit 21, the imaging device 2 instructs the recording device 3 to start recording the captured image, and stops imaging of the imaging region in the imaging unit 21. Sometimes, the recording device 3 is instructed to stop recording of the captured image. The recording device 3 starts recording of the captured image when there is an instruction to start recording, and when there is an instruction to stop recording, the recording device 3 Stop recording. Therefore, the recording device 3 can record the captured image of the imaging region captured by the imaging device 2.

  Next, the operation of the remote controller 4 will be described with reference to FIG. The remote controller 4 determines whether the vibration level of the main body detected by the vibration detection unit 43 exceeds a predetermined level, whether the level of the sound collected by the sound collection unit 44 exceeds a predetermined level, Or it waits for some input operation to be performed in the operation part 41 (s31-s33). In s31 and s32, an environmental change around the remote controller 4 is detected. In s31, it is possible to detect when a person comes around the remote controller 4 or when a person leaves the remote controller 4 or the like. In s32, it is possible to detect when a user in the vicinity of the remote controller suddenly screams. For example, it is possible to detect when a user who is watching a program laughs.

  When the vibration level of the main body exceeds a predetermined constant level or the sound level exceeds a predetermined constant level, the remote controller 4 sends a control signal instructing the imaging device 2 to start imaging, A control signal for instructing the recording device 3 to start recording the captured image is sent (s35, s36), and the process returns to s31. As described above, the control signal transmitted from the transmission unit 42 of the remote controller 4 is notified to the corresponding device (the imaging device 2 or the recording device 3) via the television receiver 1. Then, the imaging device 2 starts imaging the imaging area in accordance with the control signal from the remote controller 4, and the recording device 3 starts recording the captured image. Therefore, when the environment around the remote controller 4 changes, the imaging device 2 can automatically start imaging the imaging region, and the captured image can be recorded in the recording device 3 and left. Therefore, the action taken by the user around the remote control can be recorded as a life log.

  When any input operation is performed on the operation unit 41, the remote controller 4 sends a control signal corresponding to the input operation (s34), and executes the processes related to s35 and s36 described above. Therefore, the user's action immediately after operating the remote controller 4 can be recorded.

  As described above, according to the recording system of this embodiment, the user can analyze most of the activities in daily life or perform a re-experience later. In addition, since the imaging device 2 performs the processes related to s15 to s17 described above, the user can view a captured image when the user is not in the imaging region, a captured image when the user is hardly acting in the imaging region, or the like. However, it is possible to suppress the useless picked-up image that is not necessary for later analysis or re-experience from being recorded in the recording device 3. For this reason, the necessary storage capacity required for the recording apparatus 3 for recording the captured image is sufficiently suppressed, and the system can be constructed in a small size and at a low cost.

  Alternatively, the remote controller 4 may transmit the sound collected by the sound collection unit 44, and the recording device 3 may record the sound transmitted from the remote controller 4 together with the captured image. In this case, the remote controller 4 may be configured to transmit an audio signal related to the sound collected by the sound collection unit 44 at the transmission unit 42, or may be configured to separately transmit an audio signal. This audio signal may be sent to the recording device 3 via the television receiver 1 as described above, or may be sent directly to the recording device 3. In this way, since not only the captured image but also the sound is recorded, the behavior analysis and the re-experience performed later by the user can be performed more accurately.

  The remote controller 4 may be configured to be used as a telephone handset, and the captured image and sound may be recorded in the recording device 3 during a call. In this way, it is possible to record the behavior when making a call and the contents of the call in the recording device 3.

  Further, the remote controller 4 may be configured so as to be used as a receiver of a videophone, and the captured image, voice, and received image sent from the other party may be recorded in the recording device 3 during a call. In this way, the behavior when making a call, the contents of the call, and also the received image of the other party can be recorded in the recording device 3.

  When the remote controller 4 is configured as a receiver, the configuration relating to the main body part of the telephone function may be provided in the remote controller 4 or in another device such as the television receiver 1.

It is a figure which shows the recording system which is embodiment of this invention. It is a figure which shows the structure of the principal part of a television receiver. It is a figure which shows the structure of the principal part of an imaging device. It is a figure which shows the structure of the principal part of a recording device. It is a flowchart which shows operation | movement of a remote control. It is a flowchart which shows operation | movement of a television receiver. It is a flowchart which shows operation | movement of an imaging device. 3 is a flowchart showing the operation of the recording apparatus. It is a flowchart which shows operation | movement of a remote control.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1- Television receiver 2- Imaging device 3- Recording device 4- Remote control device 10- Control part 11- External input / output part 12- Reception part 13- Display part 14- Audio | voice output part 15- Operation part 16- Remote control reception part 20 -Control unit 21-Imaging unit 22-Captured image output unit 23-Control signal input / output unit 30-Control unit 31-Image input / output unit 32-Recording unit 33-Control signal input / output unit 40-Control unit 41-Operation unit 42 -Transmitter 43-Vibration detector 44-Sound collector

Claims (6)

An imaging device including an imaging unit for imaging an imaging region, and a captured image output unit for outputting a captured image of the imaging region captured by the imaging unit;
A recording apparatus comprising recording means for capturing and recording the captured image output by the captured image output means of the imaging apparatus;
In a recording system comprising: the imaging device; and a remote controller provided with a remote control means for remotely controlling the recording device.
The remote control is
Environmental change detection means for detecting environmental changes around the main body;
When the environmental change detection means detects an environmental change around the main body and when an input operation is performed on the main body, the remote control means instructs the imaging device to start imaging of the imaging area, Start instruction means for instructing the recording apparatus to start recording of a captured image;
Voice signal sending means for collecting voice around the main body and sending a voice signal based on the collected voice;
The recording device comprises:
The recording unit is a unit that captures and records the audio signal transmitted by the audio signal transmission unit of the remote controller and the captured image captured by the imaging apparatus;
The imaging device
Imaging start timing control means for starting imaging of the imaging area by the imaging means at a predetermined timing;
Change determination means for determining whether or not a change has occurred in a captured image of an imaging region captured by the imaging means;
When the change determining unit determines that a change has occurred in the captured image, the imaging unit continues imaging of the imaging region, and when it is determined that the captured image has not changed, the imaging unit Imaging control means for stopping imaging of the imaging area,
Recording system. An imaging device including an imaging unit for imaging an imaging region, and a captured image output unit for outputting a captured image of the imaging region captured by the imaging unit;
A recording apparatus comprising recording means for capturing and recording the captured image output by the captured image output means of the imaging apparatus;
In a recording system comprising: the imaging device; and a remote controller provided with a remote control means for remotely controlling the recording device.
The remote control is
Environmental change detection means for detecting environmental changes around the main body;
When the environmental change detection unit detects an environmental change around the main body, the remote control unit instructs the imaging device to start imaging of the imaging region and starts recording the captured image to the recording device. Starting instruction means for instructing
Recording system. The remote control is
Voice signal sending means for collecting voice around the main body and sending voice signal based on the collected voice,
The recording means of the recording device comprises:
Means for capturing and recording the audio signal transmitted by the audio signal transmission means of the remote control and the captured image captured by the imaging device;
The recording system according to claim 2. The start instruction means of the remote control is
Even when an input operation is performed on the main body, the remote control means instructs the imaging apparatus to start imaging of the imaging area and instructs the recording apparatus to start recording the captured image. is there,
The recording system according to claim 2 or 3. The imaging device
Imaging start timing control means for starting imaging of the imaging region by the imaging means at a predetermined timing;
The recording system according to claim 2. The imaging device
Change determination means for determining whether or not a change has occurred in a captured image of an imaging region captured by the imaging means;
When the change determining unit determines that a change has occurred in the captured image, the imaging unit continues imaging of the imaging region, and when it is determined that the captured image has not changed, the imaging unit Imaging control means for stopping imaging of the imaging area,
The recording system according to claim 2.

Images