JP2004207842A - Image processor and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To make an image processor able to extract a desired image from a series of images and record and preserve it by simply registering a target image for specifying an object to be preserved previously and arbitrarily. <P>SOLUTION: When a monitor image including a registered target is recognized as a result of sequential analysis of monitor images from a camera photographing section 6 based on the registered target under a state where the target image for specifying an object to be stored is registered in a storage section 2, a CPU 1 extracts that image as the object to be stored and stores it in a recording medium 3. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an image photographing apparatus and a program for extracting a desired image from a series of images and recording and saving the image, or extracting and reproducing and outputting a desired image from a series of stored images.
[0002]
[Prior art]
Conventionally, as an automatic recording apparatus for television broadcasting, a part of the pre-image information of a broadcast program designated for reservation is stored in advance, and recording is started when the information matches the image information of the broadcast program designated for reservation. A designated broadcast program automatic recording device is known (see Patent Document 1).
Also, of the weather forecast program, a similar screen is stored as a key each time, and when a broadcast corresponding to this key screen is detected, recording is started and the broadcast content is recorded for a predetermined time. An automatic recording apparatus configured as described above is known (see Patent Document 2).
[0003]
By the way, in a video camera, after a series of captured images are sequentially stored in a recording medium, the stored images are reproduced and output to perform image editing while erasing unnecessary images. In other words, even when a desired subject is photographed, many unnecessary images not including the subject are often included, and such unnecessary images are deleted during image reproduction by performing image editing. However, editing requires time and effort.
Therefore, in the related art, as a video camera device that performs automatic shooting, a video camera device that performs automatic shooting by reading a program code recorded on a mounted PC card and controlling the device is known. (See Patent Document 3).
[0004]
[Patent Document 1]
JP 05-056386 A
[Patent Document 2]
JP-A-10-042247
[Patent Document 3]
JP-A-11-341339
[0005]
[Problems to be solved by the invention]
However, in the above-described automatic recording apparatus for a broadcast program, by setting the front image information or the key screen in advance, the corresponding designated program can be automatically recorded. The key screen functions as a “start trigger” for instructing the start of recording. Since recording is started, all of the reserved programs are recorded. Even if you want, you have to play the recorded reserved program from the beginning.
In particular, if the broadcast is a long program, it will take a lot of time to play back the recording, and even if fast-forward playback is performed, it is necessary to check whether the desired screen appears from the fast-forward screen. The operator has to keep checking and not only has to perform cumbersome work, but also has a risk of missing a desired scene.
On the other hand, in a video camera device that performs automatic photographing according to a program code in a PC card, automatic photographing can be performed by mounting a PC card, but it can be said that it is suitable for end users who can easily use it. In addition, a problem remains in terms of versatility.
[0006]
A first object of the present invention is to enable a desired image to be extracted from a series of images and recorded and stored by simply arbitrarily registering a target image for specifying a storage target in advance. .
A second object of the present invention is to allow a desired image to be extracted from a series of stored images and reproduced and output by simply arbitrarily registering a target image for specifying a reproduction target in advance. It is to be.
[0007]
[Means for Solving the Problems]
The invention according to claim 1 (first invention) is an image photographing apparatus that extracts a desired image from a series of images, records and saves the image, and arbitrarily sets a target image for specifying a storage object in advance. Registering means for registering, image analyzing means for sequentially analyzing a series of images based on the registered targets registered by the registering means, and performing image analysis by the image analyzing means to recognize an image including the registered target. In this case, a recording control unit is provided for extracting the image as a storage target, and recording and storing the extracted image.
Further, the present invention provides a computer with a program for realizing the main functions described in the first aspect of the present invention.
[0008]
Therefore, according to the first and ninth aspects of the present invention, a target image (for example, a person image) for specifying a storage target is arbitrarily registered in advance, and a series of images (for example, a photographed image In the case where an image including a registration target is recognized as a result of sequentially analyzing broadcast programs, the image is extracted and recorded and stored as a storage target. It is possible to record and save only the image of the subject such as the desired person from the captured image, and it is possible to greatly reduce the amount of image storage, and to delete unnecessary images during image playback. Editing work is not required, and in a recording device that automatically records a reserved broadcast program, for example, in a song program, only the image of a portion where a desired specific singer appears appears. Even if the reserved broadcast is a long-time program, it is possible to greatly reduce the amount of recording and to eliminate the need for fast-forward playback during image playback. An apparatus can be provided.
[0009]
The invention described in claim 1 may be as follows.
When a plurality of types of target images are registered by the registration unit, the recording control unit extracts and records and saves this image as a storage target every time an image including any of the registered targets is recognized. The recording range in which the stored image is recorded is detected and recorded for each target, and when one of the plurality of registered targets is selected and designated as a reproduction target, the recording range corresponding to the selected target is selected. The stored image is searched based on the attached recording range, and an image within this range is extracted and reproduced and output (the invention according to claim 2).
[0010]
Therefore, according to the second aspect of the present invention, in addition to having the same effect as the first aspect of the present invention, when a plurality of types of target images are registered, an image including any of the registered targets is recognized. Each time the image is extracted and recorded and saved as a storage target, a recording range in which the stored image is recorded is detected and recorded for each target, and one of the registered targets is selected and designated as a reproduction target. In this case, the stored image is searched based on the recording range associated with the selected target, and the images within the range are extracted and reproduced and output. Therefore, a plurality of types of target images are registered. You can record and save an image including the registered target for each registered target, and even select the desired registered target even during playback. In, it is possible to reproduce an image containing the registration target immediately.
[0011]
If an image arbitrarily input and supplied from the outside or an image arbitrarily selected and designated from among captured images is registered as the target image (the invention according to claim 6), the image arbitrarily input and supplied from the outside can be registered. Can be selected as a target image or registered as a target image using an image taken in the past, and the registration work can be easily performed.
Further, by sequentially analyzing a series of captured images based on the registered targets, it is possible to recognize whether the registered targets are included in the series of images (the invention according to claim 7). It is possible to cope with free-spirited shooting by a video camera or a digital still camera, and it is possible to eliminate a situation where shooting timing is missed.
[0012]
An invention according to claim 3 (second invention) is an image processing apparatus that extracts a desired image from a series of stored images and reproduces and outputs the extracted image, and a target for specifying a reproduction target. A registration unit for arbitrarily registering an image in advance, an image analysis unit for analyzing the series of stored images based on a registration target registered by the registration unit, and a result of performing image analysis by the image analysis unit. When an image including a target is recognized, the image processing apparatus includes a reproduction control unit that extracts and outputs the image as a reproduction target.
Further, the present invention provides a computer with a program for realizing the main functions described in the third aspect of the present invention (the tenth aspect of the present invention).
[0013]
Therefore, according to the third and tenth aspects of the present invention, a target image for specifying a reproduction target is arbitrarily registered in advance, and a series of stored images (for example, a captured image, a recording of a broadcast program, As a result of analyzing the image, when an image including the registration target is recognized, this image is extracted and output as a reproduction target. For example, in a camera device, a large Can reproduce only the image in which the subject, such as a desired person, is shown, eliminating the need for editing work such as erasing unnecessary images during image reproduction, and a recording device for automatically recording a broadcast program specified in advance. For example, it is possible to reproduce only the partial image in which the desired singer appears, and even if the reserved broadcast is a long program, there is no need to perform fast-forward reproduction work. It is possible to provide a high image processing apparatus.
[0014]
The third aspect of the present invention may be as follows.
When any of the registered targets is selected and designated as a reproduction target among the plural types of target images registered by the registration unit, the reproduction control unit extracts an image including the selected target as a reproduction target. And outputs it (the invention according to claim 4).
Therefore, according to the invention described in claim 4, in addition to having the same effect as the invention described in claim 3, even when a plurality of types of target images are registered, only by selecting a desired registered target, An image including the registered target can be immediately reproduced.
[0015]
When extracting and reproducing and outputting a desired image from a recording medium in which a plurality of types of stored images are recorded as a series of stored images, the image analysis unit registers the plurality of types of stored images. The analysis is sequentially performed based on the target, and the reproduction control unit extracts and outputs an image including the registered target as a reproduction target for each of a plurality of types of stored images (the invention according to claim 5).
Therefore, according to the fifth aspect of the present invention, in addition to having the same effect as the third aspect of the present invention, an image including a registration target is extracted and output as a reproduction target for each of a plurality of types of stored images. As a result, it is possible to reproduce a plurality of types of stored images.
[0016]
If an image arbitrarily input and supplied from the outside or an image arbitrarily selected and designated from among captured images is registered as the target image (the invention according to claim 6), the image arbitrarily input and supplied from the outside can be registered. Can be selected as a target image or registered as a target image using an image taken in the past, and the registration work can be easily performed.
[0017]
Further, by sequentially analyzing a series of captured images based on the registered targets, it is possible to recognize whether the registered targets are included in the series of images (the invention according to claim 7). It is possible to cope with free-spirited shooting by a video camera or a digital still camera, and it is possible to eliminate a situation where shooting timing is missed.
[0018]
When the reproduction control unit extracts and outputs an image including a registration target as a reproduction target and starts a reproduction operation from the immediately preceding image not including the registration target (claim 8). Invention), instead of playing the registered target immediately after starting the playback, the playback is started from an earlier image (for example, an image several seconds to 10 seconds earlier in the case of moving image playback). Therefore, there is no risk of missing the scene of the registration target.
[0019]
BEST MODE FOR CARRYING OUT THE INVENTION
(1st Embodiment)
Hereinafter, a first embodiment of the present invention will be described with reference to FIGS.
FIG. 1 is a block diagram showing basic components of the video camera device according to this embodiment.
This video camera device is a handy type video camera (personal camera), an installation type surveillance camera used for person surveillance, an in-vehicle camera mounted in an automobile, and the like. It has a function of storing a captured image taken in color through a solid-state imaging device in a recording medium, and a function of reading out the stored image and reproducing and outputting the image.
[0020]
In particular, the video camera device according to the present embodiment, when a target image (for example, a person image) for specifying a storage target is arbitrarily registered in advance, a registered target image from a series of captured images (monitor images). Is extracted and recorded and stored. Furthermore, if a target image for specifying a reproduction target is arbitrarily registered in advance, a series of stored images (recorded An image including the registered target image is extracted from the (captured image: recorded image) and reproduced and output.
[0021]
In this case, the recording mode includes two types of modes, that is, a “normal recording mode” in which captured images are sequentially recorded and stored, and a “target recording mode” in which images including a registered target are recorded and stored. Further, as the playback mode, there are three types of modes, namely, a “normal playback mode” in which the captured image recorded in the “normal recording mode” is directly reproduced, and a registered target recorded in the above “target recording mode”. "Target search and playback mode" for searching for and arbitrarily selecting and specifying a registered target selected from among the included images, and playing the image including the registered target among the images recorded in the "normal recording mode" described above. And a “target playback mode” for output.
Before describing the features of the first embodiment in detail, the hardware configuration of the first embodiment will be described below.
[0022]
The CPU 1 is a central processing unit that controls the overall operation of the video camera device according to the operating system and various application software in the storage unit 2. The storage unit 2 has a program storage area and a data storage area, and is configured by a magnetic, optical, semiconductor memory, or the like, and a drive system thereof. The recording unit 2 may have a configuration in which a removable storage medium such as a CD-ROM or a DVD can be mounted in addition to a fixed memory such as a hard disk.
[0023]
The recording medium 3 for recording and storing photographed images is a detachable medium composed of a CD-ROM, a DVD, or the like. When the above-described “normal recording mode” is designated, a series of photographed images is sequentially recorded. When the “target recording mode” is designated, the image including the registered target extracted from the captured image is recorded and stored. Note that the recording medium 3 is recorded from the top in the order of shooting. When the recording areas are conceptually distinguished from each other, the normal recording area 31 of the image shot in the "normal recording mode" and the normal recording area 31 in the "target recording mode" It is divided into a target recording area 32 of a captured image.
[0024]
On the other hand, a key input unit 4, a display unit 5, and a camera photographing unit 6, which are input / output peripheral devices, are connected to the CPU 1 via a bus line. The CPU 1 controls these operations according to an input / output program.
The key input unit 4 is an operation unit that forms a keyboard and a touch panel, has various buttons such as a shooting button and a play button, and inputs various commands and character information. The display unit 5 is a liquid crystal display unit that performs full-color display, and is used as a finder screen, an image reproduction screen, and a touch screen.
The camera photographing unit 6 has a normal configuration including various electronic components such as an area sensor (solid-state imaging device) that receives a subject image captured through an optical system, an analog / digital conversion unit, and an autofocus unit. Although not shown, the camera body is provided with an external connection terminal that is connected to an image processing device or the like, so that externally supplied image information can be captured.
[0025]
FIG. 2 is a diagram showing the contents of the target registration memory 21 provided in the storage unit 2.
The target registration memory 21 is a memory in which a target image for specifying a storage target or a target image for specifying a reproduction target is registered in advance, and has a configuration capable of storing a plurality of target images. The target registration memory 21 stores, for each registered target, items of “target number”, “target image”, and “recording position on the medium”. Here, the “target number” is identification information for identifying the target image, and is a serial number automatically generated every time the target image is registered.
[0026]
The “target image” is a face image of the person (image photographed around the face) if the storage target / reproduction target is a person, and if the object is a car or an animal other than a person, the entire image is photographed. Image. In this case, the “target image” may be, for example, a plurality of images of the storage target / reproduction target taken from the front, rear, left and right. If the storage target / reproduction target is a person, the face of the person The image may include an entire image in addition to the image, and the imaged portion and the number of images are not limited as long as the image can reliably recognize the storage target / reproduction target.
[0027]
Here, when registering the “target image”, the CPU 1 registers, for example, an image arbitrarily input and supplied from the outside as the “target image”, or selects one of the captured images stored in the recording medium 3. An image arbitrarily selected and designated is registered as a “target image”.
The “recording position on the medium” is, when the above “target recording mode” is designated, every time an image including the registered target extracted from the captured image is recorded and stored, its recording start position and the recording start position are recorded. Each time a registered target is detected, the recording start position and the recording end position are sequentially recorded in association with the registered target.
[0028]
Next, the operation concept of the video camera device according to the first embodiment will be described with reference to the flowcharts shown in FIGS. Here, the functions described in these flowcharts are stored in the form of readable program codes, and sequentially execute operations according to the program codes. Further, the operation according to the above-described program code transmitted via the transmission medium can be sequentially performed. This is the same in other embodiments described later, and an operation specific to this embodiment can be executed using a program / data externally supplied via a transmission medium in addition to a recording medium.
[0029]
3 and 4 are flowcharts showing the overall operation of the video camera device according to the recording mode / playback mode.
First, the CPU 1 monitors the presence / absence of an operation (step A1). If any operation is performed, the CPU 1 checks whether target registration has been instructed (step A2). Now, in order to register a desired target before photographing is started, if the registration is instructed, the input of the target image is accepted and the registration processing is performed (steps A3 to A5).
[0030]
Here, the CPU 1 inputs and supplies an arbitrary image from the outside as a “target image”, or inputs and designates an image arbitrarily selected from the captured images stored in the recording medium 3 as the “target image”. If it has been performed (step A3), the input "target image" is taken in, the "target number" is generated, and the "target image" with the "target number" is written and registered in the target registration memory 21 (step A3). Step A4).
After the registration for one target is completed in this way, it is checked whether or not the registration of another target has been instructed (step A5). If another registration instruction has been received, the process returns to step A3. Is repeated (steps A3 to A5), but when the registration end is instructed, the process returns to step A1 to wait for the operation.
[0031]
Now, if the "target recording mode" is selected and designated after the target registration (step A6), the target recording process is started. That is, the CPU 1 starts monitor shooting at the same time as switching to the target recording mode (step A7). Then, each target image registered in the target registration memory 21 is read out, and an image analysis for searching for any target image in the monitor image while comparing each registered target image with the monitor image is performed. (Step A8), and the presence or absence of the target image is checked (Step A9). In this case, if the registered target is a person, a feature portion is extracted from the person image and feature comparison is performed. At this time, after correcting the face direction, size, and the like, the face outline, eyes, Compare the shape, position, size, etc. of the mouth, nose, forehead, etc. It should be noted that, in addition, the gender, the face, the presence or absence of glasses, the height, the body shape, the hairstyle, and the color may be comprehensively compared to perform the person recognition.
[0032]
If no registered target is included in the monitor image (NO in step A9), it is checked whether a target recording end instruction (target recording mode release instruction) has been received (step A10). The process returns to step A8 until the end instruction is received, and the monitor analysis is performed. When the instruction to end the target recording is received, the monitor shooting is ended (step A11), and the operation returns to the operation waiting state (step A1).
[0033]
On the other hand, when it is recognized that the registered target is included, that is, when it is recognized that any of the registered targets is included in the monitor image (YES in step A9), this time The monitor image is specified as a storage target, the operation of recording the monitor image in the recording medium 3 is started (step A12), and the recording position (storage destination address in the recording medium 3) at that time is obtained as a shooting start position. Then, this shooting start position is written into the target registration memory 21 in association with the “target number” (step A13). At this time, when a plurality of registered targets are included in the monitor image, the process of writing the shooting start position in the target registration memory 21 in association with the “target number” for each registered target is repeated.
[0034]
Further, while analyzing the monitor image, it is monitored whether any of the registered targets are included therein (step A14). If the registered target is included, the operation of recording the monitor image is continued (step A14). Step A15). Thereafter, the monitor image including the registered target is continuously recorded until there is an instruction for ending the target recording (step A16) (steps A14 and A15). ), After ending the monitor shooting (step A17), the operation returns to the operation waiting state (step A1).
[0035]
When the registered target is removed from the monitor (NO in step A14), the recording operation is terminated (step A18), and the recording position at that time (storage destination address in the recording medium 3) is set as the photographing end position. Then, the photographing end position is written in the target registration memory 21 in association with the "target number" (step A19). At this time, when a plurality of registered targets are included in the monitor image, the process of writing the shooting end position in the target registration memory 21 in association with the “target number” is repeated for each registered target. Then, returning to step A18, the above operation is repeated while comparing the registered target image with the monitor image to search for any target image included in the monitor image.
[0036]
On the other hand, when the mode is switched to the above-mentioned “target search / playback mode”, this is detected in step A20 in FIG. That is, the CPU 1 accesses the target registration memory 21, reads out each registered target image, and displays a list on the menu screen (step A21). When a desired target is selected and designated as a reproduction target from the menu screen (step A22), the target registration memory 21 is searched based on the "target number" corresponding to the selected target, and its recording position (start / start) is determined. The end position) is read (step A23), and the target recording area 32 in the recording medium 3 is searched based on the recording position, and the corresponding image is read and reproduced and output (step A24).
[0037]
In this state, when the end of reproduction is instructed (step A25), the reproduction operation is ended (step A29), and then the operation returns to the first operation waiting state (step A1 in FIG. 3). If not, it is checked whether the next reproduction has been instructed (step A26). The next playback instruction is for instructing that a jump to the next recording and playback including the same selected target should be performed. When the instruction is received, the CPU 1 accesses the target registration memory 21 and Under the condition that there is a next recording position associated with the selected target (step A28), this recording position is read (step A23), and an image reproducing operation is performed based on this recording position (step A24).
If there is no next reproduction instruction, while continuing the current recording / reproduction (step A27), it is checked whether or not there is a reproduction end instruction (step A25), and it is also checked whether or not there is a next reproduction instruction (step A26).
[0038]
When the mode is switched to the “target reproduction mode” (step A30), the target reproduction processing is started. That is, the CPU 1 accesses the target registration memory 21, reads out each registered target image, displays it in a list on the menu screen, and when a desired target is selected and designated as a reproduction target from this menu screen, The "target image" corresponding to the selected target is read (step A31). In this case, all registered targets may be selected and designated as reproduction targets. In the “target reproduction mode”, the captured images (recorded images) stored in the normal recording area 31 in the recording medium 3 are sequentially read as reproduction targets, and the images are analyzed (step A32). At this time, the selected target image is compared with the recorded image, and image analysis is performed to search for the selected target image in the recorded image (step A33), and the presence or absence of the selected target image is checked (step A34). .
[0039]
Here, if there is no selected target image, the process returns to the initial operation waiting state (step A1 in FIG. 3), but if the selected target image is included, reproduction of the recorded image is started from the immediately preceding image (step A1). A35). In this case, reproduction is started from an image several seconds to 10 seconds before the image in which the selected target first appears. Then, when the reproduction end is instructed during the image reproduction (step A36), the reproduction operation is terminated (step A40), and the process returns to the initial operation waiting state (step A1).
[0040]
In a state where the end of the reproduction is not instructed, the reproduction image is analyzed while searching for the selection target in the reproduction image (step A37), and on the condition that the selection target is included, The reproduction operation is continued (step A41). Here, when it is detected that the selected target is not included in the reproduced image (step A37), the recorded image is read out and analyzed based on the condition that the next recorded image is present (step A39). (Step A32), and thereafter, the above operation is repeated. If there is no next recorded image (NO in step A38), the reproduction operation is terminated (step A39), and the operation returns to the operation waiting state (step A1).
[0041]
In the other processing (step A42), when the mode is switched to the “normal recording mode”, a normal recording process for sequentially recording and storing the captured images is performed, and when the mode is switched to the “normal playback mode”, the recording is performed. A normal reproduction process for reproducing the image as it is is performed. At this time, processing corresponding to button operations such as fast-forward playback is also performed.
[0042]
As described above, in the video camera device according to the first embodiment, while the target image for specifying the storage target is registered in the storage unit 2, the CPU 1 transmits the monitor image from the camera photographing unit 6. When a monitor image including the registered target is recognized as a result of the sequential analysis based on the registered target, the image is extracted as a storage target and stored in the recording medium 3. Can save and save only the image of the subject such as the desired person from the camera, greatly reducing the amount of image storage and eliminating the need for editing work such as deleting unnecessary images when playing back images. It becomes.
[0043]
Further, when a plurality of types of target images are registered, each time an image including any of the registered targets is recognized, this image is extracted and stored as a storage target, and the stored image is recorded. The recording range is detected and recorded for each target, and if any of the registered targets is selected and designated as a reproduction target, it is stored based on the recording position (start / end position) associated with the selected target. Since images are searched, images within the start position to the end position are extracted and reproduced and output, even when a plurality of types of target images are registered, an image including the registered target is registered for each registered target. You can record and save, and even during playback, simply select the desired registration target and immediately play back the image containing that registration target. It becomes possible.
[0044]
When registering a target image, you can select whether to register an image arbitrarily input and supplied from the outside as a target image or to register it as a target image using images taken in the past. It is possible to do it.
In addition, by sequentially analyzing the photographed images based on the registered targets, it is recognized whether or not the registered targets are included in the images. A situation in which the timing is missed can be eliminated.
[0045]
On the other hand, in a state where the target image for specifying the reproduction target is registered in advance, the CPU 1 analyzes the recorded image based on the registered target, and when the CPU 1 recognizes the image including the registered target, Since the image is extracted and output as a reproduction target, only an image in which a subject such as a desired person is shown can be reproduced from among a large number of recorded images, and unnecessary images are deleted when the image is reproduced. Editing work is also unnecessary.
[0046]
In this case, even when a plurality of target images are registered, an image including the registered target can be immediately reproduced simply by selecting a desired registered target.
In addition, since an image including a target is extracted and output for each of a plurality of recorded images as a reproduction target, reproduction over a plurality of recorded images can be performed.
Furthermore, since the target is not played back immediately after the start of the playback but is started from an image earlier than the target, there is no danger of missing the target.
[0047]
The first embodiment described above is an example in which the present invention is applied to a video camera device. However, the present invention is not limited to a moving image but can be applied to a digital still camera. In this case, the finder image may be analyzed as a monitor image, and when it is detected that a registered target is included, the finder image (monitor image) may be recorded and stored. The playback of a recorded image (still image) is basically the same as that of a video camera.
[0048]
(2nd Embodiment)
Hereinafter, a second embodiment of the present invention will be described with reference to FIGS. Although the above-described first embodiment is applied to a video camera device, the second embodiment is applied to an automatic recording device that records television (TV) broadcasts.
Here, in both embodiments, basically the same components are denoted by the same reference numerals, and the description thereof will be omitted. In addition, the following description focuses on the features of the second embodiment.
[0049]
FIG. 5 is a block diagram showing basic components of the automatic recording apparatus.
In this embodiment, in addition to a CPU 11, a TV tuner 12, a TV monitor screen 13, an operation unit 14, a normal recording memory 15, a reservation memory 16, and the like, which are normally provided, a target registration memory 17, a target registration memory 17, It has a configuration having a recording memory 18.
The reserved memory 16 is a normal memory in which a program start time and an end time arbitrarily input and designated are set for each reserved program. The target registration memory 17 is capable of registering a plurality of target images arbitrarily input in advance as recording targets, and is configured to store a “target image” corresponding to a “target number”. The normal recording memory 15 is a memory for sequentially recording all images of a reserved broadcast program as usual, while the target recording memory 18 is an image containing a registered target from among the reserved broadcast program images. Only the memory that is extracted and automatically recorded. That is, the target recording memory 18 is a memory for extracting and recording only a part of the images for each reserved program.
[0050]
Next, an operation concept of the automatic recording apparatus according to the second embodiment will be described with reference to flowcharts shown in FIGS.
FIG. 6 is a flowchart showing the operation (reserved recording) of the automatic recording device.
First, the CPU 11 accesses the reservation memory 16 and checks whether unrecorded reservation information is registered (step B1). If there is a reservation, it detects whether the start time of the reserved program has been reached (step B1). Step B2). When the start time is detected, the target registration memory 17 is accessed to read out each registered target image (step B3), acquire the broadcast image, and prepare for starting the recording operation (step B4). When the end time of the broadcast is detected (step B5), it is checked whether or not there is another reservation (step B1). If all the reservation recordings have been completed, the recording operation is terminated at this point.
[0051]
When the recording operation is started, the acquired broadcast images are sequentially recorded in the normal recording memory 15 (step B6), and the recorded images in the normal recording memory 15 are compared with each registered target image. While performing image analysis to search for any of the registered targets (step B7), the presence or absence of a target image is checked (step B8).
Here, if any registered target is not included, only normal recording is performed (step B6) on condition that the broadcast has not ended (step B5), but it is recognized that the registered target image is included. If it has been performed (YES in step B8), the immediately preceding image is obtained from the normal recording memory 15 and recorded in the target recording memory 18 (step B9), and the broadcast image including the registered target is stored in the target recording memory 18 (Step B10).
[0052]
Thereafter, when the registered target image is still included (step B11), the recording in the target recording memory 18 is continued along with the recording in the normal recording memory 15 (step B12). If the registered target is not present (NO in step B11), it is checked whether or not the broadcast has ended (step B5). If the broadcast target is being broadcast, recording is performed in the normal recording memory 15 (step B6). Then, the presence or absence of the target image is checked (steps B7 and B8). Hereinafter, the above operation is repeated until the broadcast end time is detected.
[0053]
FIG. 7 is a flowchart showing the recording and reproducing operation of the automatic recording device.
First, when the recording / reproduction is instructed, the CPU 1 displays a reproduction menu screen from which "normal reproduction", "target reproduction", or "target search reproduction" can be selected (step C1). The selected playback menu is determined (step C2), and if "normal playback" is selected, the normal recording memory 15 is accessed to display a recording content menu screen (step C3). The recording contents selected and designated from among them are read out from the normal recording memory 15 and reproduced and output (step C4).
[0054]
On the other hand, when "target reproduction" is selected (step C2), the contents of the target registration memory 17 are read, and a target registration menu screen is displayed (step C5), and an arbitrary target is selected as a reproduction target. If it is selected (step C6), the recording corresponding to the selected target is retrieved from the target recording memory 18 and is reproduced and output (step C7). At this time, all registered targets can be selected as reproduction targets. When all registered targets are selected, all contents in the target recording memory 18 are sequentially read out and reproduced and output. I have to.
[0055]
If "target search and reproduction" is selected (step C2), the target registration memory 17 is accessed, each registered target image is read, and a list is displayed on the menu screen (step C8). When a desired target is selected and designated as a reproduction target from the menu screen (step C9), the selected target image is read out from the target registration memory 17 (step C10), and the recorded image in the normal recording memory 15 is selected. Image analysis is performed to search for a selected target while comparing with the target image (step C11), and the presence or absence of the selected target image is checked (step C12). Here, when the selected target image is detected, the reproduction operation is started from the immediately preceding image (step C13), and thereafter, the operation of reproducing the image while performing the target search is repeated until the end of the recorded image (step C14).
[0056]
As described above, in the automatic recording apparatus according to the second embodiment, when the target image for specifying the recording target is registered in the target registration memory 17, the CPU 1 stores the broadcast image of the reserved program in this registration. As a result of the sequential analysis based on the target, when an image including the registered target is recognized, this image is extracted and recorded as a recording target. For example, a desired specific singer appears in a song program. It is possible to record only the image of the part that is being recorded, even if the reserved broadcast is a long program, it is possible to greatly reduce the amount of recording, and it is also unnecessary to perform fast forward playback work when playing back images Become.
[0057]
In a state where the target image for specifying the reproduction target is registered in the target registration memory 17, the CPU 1 analyzes the recorded image based on the registered target, and recognizes the recorded image including the registered target. In this case, since the recorded image is extracted and output as a reproduction target, for example, only a partial image in which a desired singer appears can be reproduced, and the reserved broadcast is a long program. In addition, the fast forward reproduction work is not required.
In addition, the second embodiment has the same effects as the first embodiment.
[0058]
In the above-described second embodiment, the start time and the end time are stored in the reservation memory 16 for each reserved program, but the start image (title image or the like) of the broadcast program is used as the reservation information. Registered recording may be started when the start image is detected in the broadcast image. Furthermore, if the end image of the broadcast program is also registered, it is possible to realize the timing of the end of recording at the time of the end of the broadcast by the same method as that at the start.
[0059]
In the above-described first and second embodiments, an arbitrary target is input and registered. For example, in a camera device, a person or the like who has photographed many times in the past may be a photographed image. May be automatically registered as targets to be saved / reproduced, or may be automatically registered as targets to be saved / reproduced. A person or the like that appears many times may be detected by analyzing the broadcast image, and a person or the like that frequently appears in the reserved program may be automatically registered as a target to be saved / reproduced.
[0060]
Further, in each of the above-described embodiments, the stand-alone type device has been exemplified. However, the present invention is not limited to this. Each component is physically separated into two or more housings, and communication lines, cables, and the like. A distributed system that transmits and receives data via a wired transmission path or a wireless transmission path such as radio waves, microwaves, and infrared rays may be configured.
[0061]
On the other hand, a recording medium (for example, a CD-ROM, a floppy disk, a RAM card, or the like) in which a program code for causing each of the above-described units to be executed may be provided to the computer.
That is, a storage medium having a program code that can be read by a computer, a function of arbitrarily registering a target image for specifying a storage target in advance, and a series of images are sequentially analyzed based on the registered registration target. When the image including the registered target is recognized as a result of performing the function and the image analysis, a computer that records a program for realizing the function of extracting and recording and storing the image as a storage target is readable by a computer. It is also possible to provide a simple recording medium.
[0062]
Also, a recording medium having a program code readable by a computer, a function of arbitrarily registering a target image for specifying a reproduction target in advance, and analyzing the series of stored images based on the registered target registered. A computer that records a program for realizing the function of performing the image analysis and the function of extracting and outputting the image as a reproduction target when the image including the registered target is recognized as a result of performing the image analysis. It is also possible to provide a simple recording medium.
[0063]
【The invention's effect】
According to the first invention (the invention described in claim 1), a target image (a person image or the like) for specifying a storage target is arbitrarily registered in advance, and a series of images (for example, As a result of sequentially analyzing the captured image and the broadcast program), when an image including the registration target is recognized, the image is extracted as a storage target and is recorded and stored. , It is possible to record and save only the image of the subject, such as a desired person, from a huge number of captured images, which can greatly reduce the amount of image storage and erase unnecessary images when playing back images In addition, in a recording device for automatically recording a reserved broadcast program, for example, in a song program, only an image of a portion where a desired specific singer appears is recorded and saved. Even if the reserved broadcast is a long-time program, the amount of recording can be greatly reduced, and fast forward playback work is not required when playing back images. An apparatus can be provided.
According to the second invention (the invention according to claim 3), a target image for specifying a reproduction target is arbitrarily registered in advance, and a series of stored images (for example, a captured image, As a result of analyzing a broadcast program (recorded image of a broadcast program), if an image including a registration target is recognized, this image is extracted and output as an object to be reproduced. It is possible to play back only the image of the subject such as the desired person from the captured image, eliminating the need for editing work such as deleting unnecessary images when playing back the image, and automatically recording a broadcast program specified in advance. For example, a recording device that can reproduce only a partial image in which a desired singer appears, and even if a reserved broadcast is a long program, does not require fast forward reproduction work. It is possible to provide a high image processing apparatus.
[Brief description of the drawings]
FIG. 1 is a block diagram showing basic components of a video camera device according to a first embodiment.
FIG. 2 is a diagram showing the contents of a target registration memory 21 provided in a storage unit 2;
FIG. 3 is a flowchart showing an overall operation of the video camera device according to a recording mode / playback mode.
FIG. 4 is a flowchart showing the overall operation of the video camera device following FIG. 3;
FIG. 5 is a block diagram showing basic components of an automatic recording apparatus according to a second embodiment.
FIG. 6 is a flowchart showing a recording operation of the automatic recording device.
FIG. 7 is a flowchart showing a recording / reproducing operation of the automatic recording device.
[Explanation of symbols]
1,11 CPU
2 Storage device
4 Key input section
5 Display
6 Camera shooting unit
12 TV tuner
13 TV monitor screen
15 Normal recording memory
16 Reserved memory
17, 21 Target registration memory
18 Target recording memory

Claims (10)

An image capturing apparatus that extracts a desired image from a series of images and records and saves the image,
Registration means for arbitrarily registering a target image for specifying a storage target in advance,
Image analysis means for sequentially analyzing a series of images based on the registration target registered by the registration means,
As a result of performing image analysis by the image analysis unit, when an image including the registration target is recognized, a recording control unit that extracts and records and saves the image as a storage target,
An image processing apparatus comprising: When a plurality of types of target images are registered by the registration unit, the recording control unit extracts and records and saves this image as a storage target every time an image including any of the registered targets is recognized. , Detect and record the recording range where this stored image is recorded for each target,
When any one of the plurality of registered targets is selected and designated as a reproduction target, the stored image is searched based on the recording range associated with the selected target. Extract and play back images
2. The image processing apparatus according to claim 1, wherein: An image processing apparatus that extracts and reproduces and outputs a desired image from a series of stored images that are stored,
Registration means for arbitrarily registering a target image for specifying a reproduction target in advance;
Image analysis means for analyzing the series of stored images based on the registration target registered by the registration means,
As a result of performing image analysis by the image analysis unit, when an image including the registered target is recognized, a reproduction control unit that extracts and outputs the image as a reproduction target and outputs the image.
An image processing apparatus comprising: When any of the registered targets is selected and designated as a reproduction target among the plural types of target images registered by the registration unit, the reproduction control unit extracts an image including the selected target as a reproduction target. 4. The image processing apparatus according to claim 3, wherein the image processing apparatus outputs the image data. When extracting and reproducing and outputting a desired image from a recording medium in which a plurality of types of stored images are recorded as a series of stored images, the image analysis unit registers the plurality of types of stored images. Analyze sequentially based on the target,
The reproduction control means, for each of a plurality of types of stored images, to extract and output an image including a registration target as a reproduction target,
4. The image processing apparatus according to claim 3, wherein: The registering unit registers an image arbitrarily selected and designated from among images or captured images arbitrarily input and supplied from the outside as a target image,
The image processing apparatus according to claim 1, wherein the image processing apparatus is configured to perform the above processing. The image analysis means, by sequentially analyzing a series of captured images based on the registration target, to recognize whether the registration target is included in the series of images,
The image processing apparatus according to claim 1, wherein the image processing apparatus is configured to perform the above processing. The reproduction control means, when extracting and outputting an image including a registration target as a reproduction target, starts a reproduction operation from the immediately preceding image not including the registration target,
4. The image processing apparatus according to claim 3, wherein: Against the computer
A function for arbitrarily registering a target image for specifying a storage target in advance,
A function of sequentially analyzing a series of images based on registered registration targets,
As a result of performing image analysis, when an image including the registered target is recognized, a function of extracting and recording and saving this image as a storage target,
The program to realize. Against the computer
A function of arbitrarily registering a target image for specifying a reproduction target in advance,
A function of analyzing the series of stored images based on a registered registration target,
As a result of performing the image analysis, when an image including the registered target is recognized, a function of extracting and outputting the image as a reproduction target, and
The program to realize.

Images