JP4360399B2 - Imaging device - Google Patents

Abstract

Application is found to, for example, a video camera with recording means united therewith. On the basis of image recognition results, in accordance with the timing of detection of images of specified pattern in specified sequence, high-speed writing of imaging results in memory is completed and the imaging results stored in the memory is saved in a recording medium.

Description

  The present invention relates to an imaging apparatus, an imaging apparatus control method, an imaging apparatus control method program, and a recording medium on which an imaging apparatus control method program is recorded, and can be applied to, for example, a video camera in which recording means is integrated. . The present invention finishes high-speed writing of the imaging result to the memory based on the timing at which the image of the specific pattern is detected in a specific order based on the image recognition result, and the imaging result written to the memory Is read out and recorded on a recording medium, so that a desired scene can be surely shot in slow motion.

  Conventionally, Japanese Patent Application Laid-Open No. 9-83952 has proposed a method of recording an imaged result on a recording medium by delaying an imaging result using a large-capacity memory. According to the technique disclosed in Japanese Patent Laid-Open No. 9-83952, it is possible to record from a video at a time when the user goes back a certain time from the time when the user instructs to start shooting, so that a valuable shooting opportunity is not missed. Can be.

  In recent years, video cameras have been provided that use a memory to reduce the field frequency of an imaging result and record slow motion video. That is, this video camera outputs imaging results from the image sensor at a field frequency of 50 [fps (field / second)] or 60 [fps], for example, a field frequency of 240 [fps], which is higher than that of a normal video signal. Store in memory. The video camera also reads out the imaging result stored in the memory at a field frequency of a normal video signal and records it on a recording medium. Here, the memory is composed of, for example, SDRAM (Synchronous Dynamic Random Access Memory), and the recording medium is composed of a magnetic disk, an optical disk, a hard disk device, or the like. Hereinafter, the process of reducing the field frequency of the imaging result using the memory and recording the slow motion video is referred to as slow motion imaging. In this video camera, the slow motion shooting period is determined based on the operation point of the operator.

  However, in slow motion shooting, for example, golf swings, tennis swings, bat swings in baseball, etc. may be shot. In such a case, the slow motion shooting period is determined based on the operation point of the operator. However, there is a problem that a desired scene cannot always be photographed accurately. That is, in this case, the operation of the operation element may be too fast or too slow, and a wasteful part may be photographed or an important part may not be photographed.

  As one method for solving this problem, for example, a method based on a ball hitting sound or the like can be considered. However, in this method, for example, when shooting a golf swing at a golf driving range, in a place where a lot of similar sounds are detected, it is predicted that shooting will start based on the impact sound of others. Is done. Therefore, even with this method, there is a problem that a desired scene cannot be accurately photographed in slow motion.

Further, as disclosed in, for example, Japanese Patent Laid-Open No. 9-55931, a method based on the detection time of a moving object is also conceivable. In the case of this method, for example, when shooting starts from a stationary scene such as a broken balloon or a milk crown, a desired scene can be reliably shot. However, in the case of this method, for example, when a specific scene is recorded from an originally moving image, such as a specific scene of sports, there is a problem that a desired scene cannot be reliably captured in slow motion.
Japanese Patent Laid-Open No. 9-83952 JP-A-9-55931

  The present invention has been made in consideration of the above points. An imaging apparatus capable of surely capturing a desired scene in slow motion, an imaging apparatus control method, an imaging apparatus control method program, and an imaging apparatus control method The present invention intends to propose a recording medium on which the program is recorded.

In order to solve the above problem, the invention of claim 1 is applied to an imaging apparatus, and an imaging unit that outputs an imaging result, a memory that stores and outputs an imaging result output from the imaging unit, and the imaging A recording medium for recording an imaging result output from the unit or an imaging result output from the memory, an image recognition unit for recognizing the imaging result and outputting an image recognition result, and a control for controlling the operation of each unit and a section, wherein, in the normal operation mode, at a first field frequency or frame frequency, to output the imaging result from the imaging unit, and recorded on the recording medium, in slow-motion photography mode, before The imaging result is output from the imaging unit at a second field frequency or frame frequency that is higher than the first field frequency or frame frequency, and the And sequentially storing in the memory, and based on the image recognition result, with reference to the timing at which the specific pattern is detected in a predetermined order in the imaging result, the storage of the imaging result in the memory is terminated, The imaging result stored in the memory is read out at a third field frequency or frame frequency lower than the second field frequency or frame frequency, and recorded on the recording medium.

The invention according to claim 8 is an imaging unit that outputs an imaging result, a memory that stores and outputs an imaging result output from the imaging unit, an imaging result that is output from the imaging unit, or an output from the memory. In a standard operation mode, the first field is applied to a control method of an imaging apparatus including a recording medium for recording an imaging result and an image recognition unit that recognizes the imaging result and outputs an image recognition result. in frequency or frame frequency, to output the imaging result from the imaging unit, wherein the recording step of a standard operation mode for recording on a recording medium, in slow-motion shooting mode before Symbol frequency than the first field frequency or frame frequency The imaging result is output from the imaging unit at a high second field frequency or frame frequency, and is sequentially and cyclically stored in the memory. The slow motion shooting mode writing step, and in the slow motion shooting mode, based on the image recognition result, based on the timing at which a specific pattern is detected in a predetermined order in the imaging result, the imaging result Slow motion that terminates storage in the memory, reads out the imaging result stored in the memory at a third field frequency or frame frequency lower than the second field frequency or frame frequency, and records the result on the recording medium A recording mode recording step.

The invention according to claim 9 is an imaging unit that outputs an imaging result, a memory that stores and outputs an imaging result output from the imaging unit, an imaging result that is output from the imaging unit, or an output from the memory. Applied to a program for a control method of an imaging apparatus comprising a recording medium for recording an imaging result and an image recognition unit that recognizes the imaging result and outputs an image recognition result. in the field frequency or frame frequency, to output the imaging result from the imaging unit, and the recording step of a standard operation mode for recording on the recording medium, in slow-motion photography mode, from the previous SL first field frequency or frame frequency The imaging result is output from the imaging unit at a second field frequency or frame frequency having a high frequency, and sequentially stored in the memory Based on the timing at which a specific pattern is detected in a predetermined order in the imaging result based on the image recognition result in the slow motion shooting mode writing step that is cyclically stored, The storage of the imaging result in the memory is terminated, and the imaging result stored in the memory is read out at a third field frequency or frame frequency lower than the second field frequency or frame frequency, and stored in the recording medium. And a recording step of the slow motion shooting mode for recording.

According to a tenth aspect of the present invention, an imaging unit that outputs an imaging result, a memory that stores and outputs an imaging result output from the imaging unit, an imaging result output from the imaging unit, or an output from the memory Applied to a recording medium recording a program of a control method of an imaging apparatus, comprising: a recording medium for recording the imaging result, and an image recognition unit for recognizing the imaging result and outputting an image recognition result. A program of a method includes: a recording step in a standard operation mode for outputting the imaging result from the imaging unit at a first field frequency or a frame frequency in a standard operation mode, and recording the result on the recording medium; , before Symbol higher frequency than the first field frequency or frame frequency, the shooting at a second field frequency or frame frequency A specific pattern in the imaging result based on the image recognition result in the writing step of the slow motion imaging mode in which the imaging result is output from the unit and sequentially stored in the memory cyclically. The storage of the imaging result in the memory is terminated with reference to the timing detected in the order of, and the imaging result stored in the memory is lower than the second field frequency or frame frequency, And a recording step of a slow motion shooting mode in which reading is performed at a field frequency or a frame frequency and recording on the recording medium.

  According to the configuration of claim 1, claim 8, claim 9, or claim 10, based on the image recognition result, the slow motion is based on the timing at which the specific pattern is detected in a predetermined order in the imaging result. The shooting period is set. Therefore, when the operator is operated one by one, the desired scene can be surely shot in slow motion as compared with the case where sound is used as a trigger.

  According to the present invention, it is possible to reliably perform slow motion shooting of a desired scene.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(1) Configuration of Embodiment FIG. 2 is a block diagram illustrating an imaging apparatus according to Embodiment 1 of the present invention. The imaging apparatus 1 switches the operation mode between a standard operation mode, which is an operation mode during normal shooting, and a slow motion shooting mode, by a user operation. In this slow motion shooting mode, the imaging device 1 converts the field frequency of the imaging result using the memory 2 and records a slow motion video on the video recording medium 3.

  Here, in the imaging device 1, the image sensor 4 is a solid-state imaging device such as a complementary metal oxide semiconductor (CMOS) type imaging device. The image sensor 4 photoelectrically converts an optical image formed on the imaging surface by an optical system (not shown) and outputs an imaging signal that is an imaging result. In this embodiment, the image sensor 4 has a CDS (Correlated Double Sampling) unit, and the image signal is subjected to correlated double sampling processing in the CDS unit and output.

  The image sensor 4 switches the operation under the control of the control unit 5 and outputs an imaging result at a field frequency of 60 [fps], which is a specification of the NTSC system in the standard operation mode, and from the standard rate in the slow motion shooting mode. Outputs imaging results at a high field frequency. In this embodiment, this high-speed field frequency is a field frequency 240 [fps] that is four times the field frequency in the standard operation mode. The image sensor 4 has a function of adding and outputting the output signals of the same color photosensors arranged adjacent to each other in the horizontal direction when outputting the imaging signals for one line. In the slow motion shooting mode, the image sensor 4 uses this function to thin out pixels and output an imaging signal to prevent an increase in the rate of the imaging signal. If the subsequent processing unit has a sufficient processing speed, this thinning process may be omitted, and the number of pixels to be added is controlled to output an imaging signal at an arbitrary rate. Also good.

  An AFE (Analog Front End) 6 performs AGC (Automatic Gain Control) processing on the imaging signal output from the image sensor 4 to control the gain of the imaging signal, and then performs analog-digital conversion processing to output image data D1.

  The camera signal processing unit 7 performs camera signal processing on the image data output from the AFE 6 and outputs the processed signal. Here, the camera signal processing includes, for example, white balance adjustment processing, color correction processing, AF (Auto Focus) processing, AE (Auto Exposure) processing, and the like.

  The resolution conversion processing unit 8 receives the image data D1 processed by the camera signal processing unit 7 in the standard operation mode, and outputs the image data D1 to the moving image recording processing unit 10 for recording. The resolution conversion processing unit 8 converts the resolution of the image data D1 into a resolution suitable for display on the display unit 12, and outputs the resolution to the display processing unit 9 for monitoring.

  The resolution conversion processing unit 8 thins out the field of the image data D1 having the field frequency of 240 [fps] processed by the camera signal processing unit 7 in the slow motion shooting mode, and displays it at the field frequency of 60 [fps] for monitoring. Output to the processing unit 9. Also, the size of the image data D1 having a field frequency of 240 [fps] processed by the camera signal processing unit 7 is adjusted and output to the image compression / decompression unit 11 for recording in the memory 2. The size adjustment process is a process of changing the format of the image data D1 so as to correspond to the specifications of the image compression / decompression unit 11 and the memory 2, and the image compression / decompression unit 11 and the memory 2 have sufficient processing capability. If it is, it can be omitted.

  Further, the resolution conversion processing unit 8 switches the operation under the control of the control unit 5 in the slow motion shooting mode, and instead of the image data D1 of the field frequency 240 [fps] processed by the camera signal processing unit 7, the image compression / decompression is performed. Image data having a field frequency of 60 [fps] output from the unit 11 is input. The resolution conversion processing unit 8 outputs the image data to the moving image recording processing unit 10 for recording. The resolution conversion processing unit 8 converts the resolution of the image data into a resolution suitable for display on the display unit 12 and outputs the resolution to the display processing unit 9 for monitoring.

  The display unit 12 is configured by, for example, an LCD (Liquid Crystal Display). The display processing unit 9 drives the display unit 12 with the monitor image data output from the resolution conversion processing unit 8 and displays a monitor image of the imaging result on the display unit 12. When the operation is switched under the control of the control unit 5 and the moving image recorded on the video recording medium 3 is monitored, the display unit 12 is driven by the image data output from the moving image recording processing unit 10 to record the video. The moving image recorded on the medium 3 is displayed on the display unit 12. Instead of displaying the image data on the display unit 12, it may be output externally.

  The moving image recording processing unit 10 records the recording image data output from the resolution conversion processing unit 8 at the time of recording on the video recording medium 3 by a moving image encoding method such as MPEG (Moving Picture Experts Group). The data is compressed and recorded on the video recording medium 3. Further, the operation is switched under the control of the control unit 5, the moving image recorded on the video recording medium 3 is reproduced, the data is expanded, and the image data is output to the display processing unit 9. The video recording medium 3 is various recording media such as a hard disk device, an optical disk device, and a memory card.

The image compression / decompression unit 11 converts the image data output from the resolution conversion processing unit 8 for recording in the memory 2 in the slow motion shooting mode by using a still image encoding method such as (Joint Photographic Experts Group). Compress it. The encoded data obtained by data compression is output to the memory control unit 13 . The image compression / decompression unit 11 switches the operation under the control of the control unit 5 in the slow motion shooting mode, decompresses the encoded data output from the memory control unit 13 , decodes the image data, and performs a resolution conversion processing unit. 8 is output.

The memory control unit 13 sequentially and cyclically records the encoded data of the field frequency 240 [fps] output from the image compression / decompression unit 11 in the memory 2 in the slow motion shooting mode. Here, the memory 2 is composed of, for example, SDRAM. Further, the memory control unit 13 switches the operation under the control of the control unit 5 in the slow motion shooting mode, sequentially reads out the encoded data recorded in the memory 2, and outputs it to the image compression / decompression unit 11. When reading the encoded data from the memory 2, the memory control unit 13 reads out and outputs the encoded data at a field frequency of 60 [fps], which is a quarter speed of recording.

  The image recognition processing unit 14 performs image recognition processing on the image data output from the AFE 6 by applying a pattern matching method in the slow motion shooting mode, and detects a specific pattern instructed by the control unit 5 from the imaging result. The image recognition processing unit 14 notifies the control unit 5 of the detection result.

  FIG. 3 is a block diagram showing the detailed configuration of the image recognition processing unit 14. The image recognition processing unit 14 inputs the image data output from the AFE 6 to the preprocessing unit 14A, and executes preprocessing such as noise removal processing, image size normalization processing, and feature extraction processing. Further, image data is temporarily stored and held in the subsequent image buffer 14B, and pattern matching processing is executed by the matching circuit 14C.

  Here, the matching circuit 14C executes the pattern matching process using a dictionary stored in the memory 14D by a boosting technique using a pixel difference between two points. Here, boosting is a statistical image identification method that composes an effective classifier (strong classifier) by combining weak classifiers with slightly better performance than random. The boost method is generally known. The image recognition processing unit 14 detects, in each field, the image pattern instructed by the control unit 5 by the ada boost method in the slow motion shooting mode, and notifies the control unit 5 of the presence / absence of the image pattern and the position of the image pattern. Notice.

  Therefore, the image recognition processing unit 14 registers the image difference table of this specific image pattern in the memory 14D as shown in FIG. Here, the image difference table is also called a dictionary. As shown in FIG. 5, the image difference table uses two pixel values on a specific image pattern to be detected and a determination criterion set based on a difference value between the two pixel values. The threshold value is registered. Here, FIGS. 5A and 5B show cases where the image patterns to be detected have a round shape and a rectangular shape, respectively. The imaging apparatus 1 is configured to select a desired shooting mode from a plurality of types of shooting modes in the slow motion shooting mode, and a specific image pattern is set for each shooting mode. Therefore, an image difference table is provided in the memory 14D for each shooting mode. In addition, when practically sufficient accuracy can be ensured, the image difference table may be shared by a plurality of shooting modes.

  The matching circuit 14C sets a pattern matching area on the image of the image data temporarily stored in the image buffer 14B, and sequentially moves the pattern matching area in, for example, the order of raster scanning. The matching circuit 14C calculates a pixel difference value between coordinates corresponding to recording of the image difference table from the pattern matching area for each scanning position with reference to the feature point detected by the feature point detection. Further, the calculated pixel difference value is determined based on the threshold value of the image difference table, and a weak hypothesis is set as to whether or not the detection target image pattern exists in the pattern matching region. Here, the matching circuit 14 </ b> C sets the weak hypothesis to a value 1 when it is considered that an image pattern to be detected exists, and sets the weak hypothesis to a value −1 when it is considered that it does not exist.

  For each scanning position, the matching circuit 14C repeats the weak hypothesis detection a plurality of times and performs cumulative addition. If the cumulative addition value exceeds a certain threshold value, the matching circuit 14C It is determined that there is an image pattern to be detected.

  In this embodiment, the matching circuit 14C executes a series of processes using only the luminance signal in the image data D1, but detects a specific image pattern in combination with, for example, a color detection process using color information. Alternatively, the process may be executed by combining various other detection processes in various ways. Instead of the boosting technique, genetic algorithms (GA) or the like may be used. When only a moving object is recognized, a motion vector detected by the moving image recording processing unit 10 may be used. If pattern recognition processing is performed in combination with other methods as described above, the processing speed can be increased and the accuracy can be improved.

  The control unit 5 is a control unit that controls the operation of the entire imaging apparatus 1, and executes a program recorded in a memory (not shown) to control the operation of each unit of the imaging apparatus 1. In this embodiment, the program is provided by being preinstalled in the imaging apparatus 1, but instead of the preinstallation, the program is recorded and provided on a recording medium such as an optical disk, a magnetic disk, or a memory card. Alternatively, it may be provided by downloading via a network such as the Internet. The image recognition processing in the image recognition processing unit 14 may be executed by the control unit 5 together.

  That is, in the standard operation mode, the control unit 5 controls the operation of the image sensor 4 so as to acquire an imaging result at a field frequency of 60 [fps], and displays the imaging result at the field frequency of 60 [fps] on the display unit 12. The operations of the AFE 6, the camera signal processing unit 7, the resolution conversion processing unit 8, and the display processing unit 9 are controlled so as to be displayed. Therefore, in this case, in this imaging apparatus 1, the imaging result of the field frequency 60 [fps] is sequentially processed by the AFE 6, the camera signal processing unit 7, the resolution conversion processing unit 8, and the display processing unit 9 and displayed on the display unit 12. The Further, when the user operates the trigger switch for starting recording, the control unit 5 instructs the moving image recording processing unit 10 to start the operation, and outputs the monitor image on the display unit 12 while outputting from the resolution conversion processing unit 8. The image data having a field frequency of 60 [fps] is sequentially compressed by the moving image recording processing unit 10 and recorded on the video recording medium 3. When the user operates the trigger switch again in this state, the moving image recording processing unit 10 is instructed to stop the operation, and the recording of the image data is stopped.

  When the user instructs playback of the video recording medium 3, the control unit 5 instructs the moving image recording processing unit 10 to play back the video recording medium 3, and the encoded data recorded on the video recording medium 3 is transferred to the moving image. The recording processing unit 10 sequentially decompresses the data and outputs it to the display processing unit 9, and the image data is displayed on the display unit 12.

  On the other hand, when the user instructs the slow motion shooting mode, the control unit 5 instructs each unit to switch the operation mode to the slow motion shooting mode at a predetermined timing, and the image sensor 4 has a field frequency of 240 [fps]. Obtain imaging results. Further, as shown in FIG. 6 in comparison with FIG. 2, the imaging result of the field frequency 240 [fps] is converted into image data of the field frequency 60 [fps] by the resolution conversion processing unit 8 and displayed on the display unit 12. However, the imaging result of the field frequency 240 [fps] is sequentially and cyclically recorded in the memory 2.

  The control unit 5 switches the operation of each unit at a predetermined timing, and sequentially compares the imaging results of the field frequency 240 [fps] stored in the memory 2 at that time as shown in FIG. 7 by comparison with FIG. Read at a field frequency of 60 [fps]. The read data is decompressed to the original image data by the image compression / decompression unit 11, and recorded on the video recording medium 3 by the moving image recording processing unit 10 while displaying the image data on the display unit 12.

  In this slow motion shooting mode, the control unit 5 sets the timing for ending the writing of the image data to the memory 2 on the basis of the detection result of the image pattern in the image recognition processing unit 14. More specifically, the control unit 5 detects the timing at which the predetermined specific pattern is detected in a predetermined order based on the detection result of the image pattern in the image recognition processing unit 14, and based on the detected timing, The timing for ending the writing of the image data to the memory 2 is determined.

  Here, in this embodiment, the specific pattern is an image pattern in which the image recognition target in the image recognition processing unit 14 exists in a specific region of the imaging result, and a plurality of specific patterns are provided for each shooting mode in the slow motion shooting mode. A pattern is provided.

  That is, when the shooting mode is the golf swing mode, the image recognition target in the image recognition processing unit 14 is set to a ball, and a plurality of fields formed by dividing a screen of one field in the horizontal direction and the vertical direction as shown in FIG. In the area, the pattern (FIGS. 8A and 8B) in which the ball exists in the horizontal center and the lowermost area A is set as the first and second patterns of these specific patterns. . In addition, a pattern in which a ball exists in the horizontal direction, the rightmost region B or the leftmost region C (FIG. 8C) is set as the third pattern of these specific patterns. Here, the example of FIG. 8 is a case where the number of divisions in the horizontal direction and the vertical direction of one screen is set to 5 and 3, respectively.

  In the example of FIG. 8, when the ball is teeed up and addressed, and then the ball is launched, these first to third patterns are sequentially detected. In this case, from the field where the third pattern, which is the state where the ball is launched, to the field which is reversed by a predetermined number of fields is the field where the golf swing was photographed, and the scene desired by the user To be judged.

  Therefore, in the golf swing mode, the control unit 5 instructs the start of writing of the imaging result to the memory 2 when the user instructs the slow motion shooting mode. Also, the ball is set as a recognition target, the image recognition processing unit 14 is instructed to perform image recognition processing, and the first to third patterns are sequentially detected based on the image recognition processing result. When the third pattern is detected, the writing to the memory 2 is terminated when the predetermined time T has elapsed thereafter, and the imaging result stored in the memory 2 is read at that time to record the video recording medium. 3 is stored. Here, the predetermined period T is a time set by the user when the user sets the shooting mode.

  On the other hand, when the shooting mode is the baseball swing mode, the image recognition target in the image recognition processing unit 14 is set to the ball. Also, as shown in FIG. 9, a pattern in which a ball is present in the rightmost region B in the horizontal direction (FIG. 9A) is set as the first pattern among these specific patterns. In addition, patterns in which the ball is present in the horizontal direction, the central region D and the horizontal direction, and the rightmost region B (FIGS. 9B and 9C) are the second and third patterns of these specific patterns. Is set.

  Here, in the example of FIG. 9, the first pattern is detected when the ball thrown by the pitcher enters the screen, and the second pattern is detected at the moment when the batter hits the ball. The third pattern is detected at the moment when the ball jumps out of the screen. In this case, it is determined that the scene desired by the user is from the field in which the third pattern is detected to the field that is reversed by a predetermined number of fields.

  Therefore, the control unit 5 instructs the start of writing of the imaging result to the memory 2 when the user instructs the slow motion shooting mode even in the baseball swing mode. Also, the ball is set as a recognition target, the image recognition processing unit 14 is instructed to perform image recognition processing, and the first to third patterns are sequentially detected based on the image recognition processing result. When the third pattern is detected, the writing to the memory 2 is terminated when the predetermined time T has elapsed thereafter, and the imaging result stored in the memory 2 is read at that time to record the video recording medium. 3 is stored.

  Similarly, in the other shooting modes, the control unit 5 similarly instructs the start of writing of the imaging result to the memory 2 in response to the instruction of the slow motion shooting mode, and performs image recognition processing corresponding to each shooting mode. 14 is instructed. Further, the first, second, and third patterns are sequentially detected based on the recognition result by the image recognition processing unit 14, and a predetermined time T has elapsed from the time when the third pattern is detected. When the writing is finished, the imaging result stored in the memory 2 at that time is read and stored in the video recording medium 3.

  FIG. 1 is a flowchart showing a processing procedure of the control unit 5 relating to the slow motion shooting mode, and FIG. 10 is a time chart showing the operation of each part of the imaging apparatus 1 in comparison with FIG. In FIG. 10, the operation of the corresponding part is indicated by the reference numerals attached to the respective parts in FIG. 2, and 2W and 2R indicate the write operation and read operation of the memory 2, respectively.

  In the standard operation mode, the control unit 5 controls the operation of the image sensor 4 so as to acquire the imaging result at the field frequency of 60 [fps] (FIG. 10A), and the imaging at the field frequency of 60 [fps]. The results are recorded on the video recording medium 3 while being displayed on the display unit 12 (FIGS. 10F and 10G) (FIG. 10E). In FIG. 10, the period up to time t1 is the operation period in the standard operation mode.

  In this state, when the user instructs the start of the slow motion shooting mode, the processing procedure of FIG. 1 is started, the image recognition processing corresponding to the shooting mode is instructed to the image recognition processing unit 14, and the field frequency to the memory 2 is also determined. Each unit is instructed to start recording the imaging result of 240 [fps]. Therefore, in this case, the imaging device 1 acquires the imaging result of the field frequency 240 [fps] from the image sensor 4 and sequentially stores the imaging result in the memory 2 in a cyclic manner, while thinning the field, and the imaging result of the field frequency 60 [fps]. Is provided from the display unit 12 (FIGS. 10A to 10G).

  When the operation of each unit is set as described above, the control unit 5 proceeds from step SP1 to step SP2, and determines whether or not the first pattern is detected based on the image recognition result of the image recognition processing unit 14. If a negative result is obtained in step SP2, the control unit 5 repeats step SP2 and waits for the first pattern to be detected.

  When the first pattern is detected, the control unit 5 moves from step SP2 to step SP3, and whether or not the second pattern is detected based on the image recognition result of the image recognition processing unit 14 that follows here. to decide. If a negative result is obtained in step SP3, the control unit 5 repeats step SP3 and waits for the second pattern to be detected.

  When the second pattern is detected, the control unit 5 moves from step SP3 to step SP4, and whether or not the third pattern is detected based on the image recognition result of the image recognition processing unit 14 that follows. to decide. If a negative result is obtained in step SP4, the control unit 5 repeats step SP4 and waits for detection of the third pattern.

  When the third pattern is detected in step SP4, the control unit 5 moves from step SP4 to step SP5, waits for the elapse of the period T set by the user, and then finishes writing to the memory 2. In the subsequent step SP6, the imaging result stored in the memory 2 at that time is read and stored in the video recording medium 3. In FIG. 10, the period from time t1 to time t2 is a period for writing to the memory 2 in the slow motion shooting mode, and the subsequent period from time t2 to time t3 is the period for reading from the memory 2. is there.

  When the reading of the imaging result stored in the memory 2 is completed, the control unit 5 moves from step SP6 to step SP7, determines whether or not the user has instructed repetition of slow motion shooting, and here an affirmative result is obtained. Then, after instructing the start of recording of the imaging result of the field frequency 240 [fps] in the memory 2, the process returns to step SP2. On the other hand, if the user has not instructed the repetition of the slow motion shooting, the process proceeds from step SP7 to step SP8 and this processing procedure is terminated.

  The control unit 5 turns on the tally lamp and displays a predetermined mark on the display unit 12 during a period in which the imaging result is written in the memory 2 so that the user can grasp the shooting situation.

(2) Operation of Embodiment In the above configuration, in the imaging apparatus 1 (FIG. 2), when the standard operation mode is set, the image sensor 4 acquires the imaging result of the field frequency 60 [fps]. The imaging result is sequentially processed by the AFE 6, the camera signal processing unit 7, the resolution conversion processing unit 8, and the display processing unit 9 and displayed on the display unit 12. The image data output from the resolution conversion processing unit 8 is subjected to data compression processing by the moving image recording processing unit 10 and then recorded on the video recording medium 3.

  Further, when the operation mode is switched to the slow motion shooting mode, the image sensor 4 acquires the imaging result of the field frequency 240 [fps], and the imaging result of the field frequency 240 [fps] is obtained from the AFE 6, the camera signal processing unit 7, The image data is sequentially and cyclically stored in the memory 2 through the image compression / decompression unit 11 and the memory control unit 13 (FIG. 6).

  In the imaging device 1, the storage of the imaging result of the field frequency 240 [fps] in the memory 2 is completed at a predetermined timing, and the imaging result stored in the memory 2 at that time is lower than the writing speed. Read sequentially. The read imaging results are sequentially processed by the image compression / decompression unit 11, the resolution conversion processing unit 8, and the moving image recording processing unit 10 and recorded on the video recording medium 3 (FIG. 7).

Therefore, in the imaging device 1 can record switching the operation mode to the slow-motion photography mode, images obtained by shadow slow motion down shooting a desired subject on the image recording medium 3.

  However, for example, if the writing of the imaging result to the memory 2 is terminated based on the operation point of the operation element, the operation of the operation element may be too fast or too slow. When shooting is not possible. When voice is used as a trigger, it is predicted that an incorrect timing is used as a trigger, and in this case as well, a desired scene cannot be accurately captured.

  Therefore, in the imaging apparatus 1, when the slow motion shooting mode is set, an image pattern corresponding to the shooting mode is detected by the image recognition processing in the image recognition processing unit 14 (FIGS. 3 to 5). The image recognition processing result is analyzed to determine in which region of the imaging result the image pattern exists. Further, based on the determination result, the timing at which the specific pattern is detected in the order designated in advance for each photographing mode is detected. Further, writing of the imaging result in the memory 2 is terminated based on the detected timing, and reading of the imaging result stored in the memory 2 is started at that time.

  Accordingly, in this imaging apparatus 1, a period for slow motion shooting is set based on the pattern recognition result of the imaging result, and when setting a period for slow motion shooting based on the operation of the operator by the user, the voice is used as a reference. As compared with the case where a period for slow motion shooting is set, a scene desired by the user can be reliably shot.

  Furthermore, the process of setting the period for slow motion shooting based on the pattern recognition result is executed based on the timing at which the specific pattern is detected in a predetermined order for each shooting mode. Timing misjudgment can be effectively avoided, and a desired scene can be taken more accurately.

  That is, for example, in the golf swing mode (FIG. 8), following the first pattern in which the ball exists in the center in the horizontal direction and in the lowermost region, the ball also exists in the center in the horizontal direction and in the lowermost region in the same manner. When the second pattern is detected, and when the third pattern in which the ball is present in the rightmost region in the horizontal direction is detected, the slow motion shooting is performed based on the timing at which the third pattern is detected. A period is set.

  In this case, for example, if the period of slow motion shooting is set based on only the first or second pattern, the first or second pattern is relatively long when the ball is teeed up. Since this is a period pattern, it is not possible to specify the timing to finish writing the imaging result to the memory 2. In addition, since the slow motion shooting period is set based on only the third pattern, for example, when a butterfly other than the ball jumps into the screen, the imaging result is erroneously written to the memory 2. Will end.

  In the baseball swing mode (FIG. 9), the second pattern in which the ball exists in the center area in the horizontal direction is detected in the same manner as the first pattern in which the ball exists in the rightmost area in the horizontal direction. Further, when a third pattern in which a ball is present in the rightmost region in the horizontal direction is detected, a period for slow motion shooting is set with reference to the timing at which the third pattern is detected.

  In this case, for example, if the period for slow motion shooting is set based on only one of the first to third patterns, for example, even when the batter sees the ball, the slow motion shooting is performed. The video is recorded on the video recording medium 3, and slow motion shooting is wasted.

  However, as in this embodiment, if the writing of the imaging result to the memory 2 is completed based on the timing at which these first to third patterns are detected in a predetermined order, such waste and malfunction It is possible to effectively capture the scene desired by the user by effectively avoiding the above.

  In addition, in this embodiment, such a specific pattern is an image in which an image recognition target of the image recognition processing unit is present at a specific portion of the imaging result. Therefore, for example, a plurality of types of ball games are used by using a common pixel difference table. In such a case, the configuration of the image recognition processing unit can be simplified, and the scene desired by the user can be reliably captured with a simple configuration.

(3) Advantages of the embodiment According to the above configuration, the high-speed writing of the imaging result to the memory is terminated based on the timing at which the image of the specific pattern is detected in a specific order, and the result is written to the memory. By recording the imaging result on a recording medium, it is possible to reliably perform slow motion imaging of a desired scene.

  In addition, since the specific pattern is an image in which the image recognition target detected by the image recognition unit is present at a specific location in one screen, the scene desired by the user can be reliably captured with a simple configuration.

  FIG. 11 is a schematic diagram for explaining the timing setting at the time of slow motion shooting in the imaging apparatus according to the second embodiment of the present invention, in comparison with FIGS. 8 and 9. The imaging apparatus of this embodiment is configured in the same manner as the imaging apparatus 1 of the first embodiment, except that this timing setting method is different. Therefore, in the following description, the configuration of FIG.

  Here, similarly to the imaging apparatus 1 of the first embodiment, the imaging apparatus of this embodiment sets a period for slow motion shooting based on the timing at which images of a specific pattern are detected in a specific order. In the imaging apparatus of this embodiment, a pattern for detecting a signal to be imaged is applied to the specific pattern.

  Specifically, in this embodiment, in the golf swing mode, the pattern with both eyes open is set as the first pattern (FIG. 11A), and the pattern with the right eye closed is set as the second pattern. (FIG. 11B). Further, a pattern with both eyes open is set as the third pattern (FIG. 11C). The control unit 5 sequentially detects the first to third patterns and detects a cue by the wink to be photographed. When the third pattern is detected after closing the right eye with the wink, the control unit 5 starts writing the imaging result to the memory 2 from the time when the third pattern is detected.

In addition, the pattern of the side face that has finished hitting and seeing off the ball is set as the fourth pattern (FIG. 11D), and the pattern with the face turned to the front is set as the fifth pattern (FIG. 11). (E)). Further, the pattern with the left eye closed is set as the sixth pattern (FIG. 11F). The control unit 5 sequentially detects the fourth to sixth patterns and detects a cue by the wink to be photographed. That is, in this case, when the person to be photographed closes his left eye by winking, the sixth pattern is detected, and the control unit 5 stops writing to the memory 2 by the slow motion photographing from the time of detection of the sixth pattern, Reading from the memory 2 is started.

  Therefore, in this embodiment, the image recognition processing unit 14 records the open eye pattern and the closed eye pattern in the pixel difference table and holds them. The closed eye pattern is detected and notified to the control unit 5.

  According to this embodiment, the period of slow motion shooting is set based on the timing at which images of a specific pattern are detected in a specific order, and the specific pattern detected in this predetermined order By using the pattern for detecting the cue, it is possible to capture the scene desired by the user more reliably by performing the slow motion shooting so that the intention of the shooting target is reflected.

  FIG. 12 is a schematic diagram for explaining timing setting at the time of slow motion shooting in the imaging apparatus according to the third embodiment of the present invention, in comparison with FIGS. 8 and 9. The imaging apparatus of this embodiment is configured in the same manner as the imaging apparatus of the above-described embodiment except that this timing setting method is different. Therefore, in the following description, the configuration of FIG.

  In this embodiment, similarly to the imaging device 1 of the first embodiment, a period for slow motion shooting is set with reference to the timing at which images of a specific pattern are detected in a specific order. In the image pickup apparatus of this embodiment, the pose pattern of a person detected by a series of operations is applied to this specific pattern. Therefore, the imaging apparatus of this embodiment sets a period for slow motion shooting based on the change in the pose of the shooting target.

  That is, in this embodiment, as shown in FIG. 12, in the golf swing mode, the pose at the time of addressing and holding the golf club is set as the first pattern (FIG. 12A), and the takeback is performed. The paused pose is set to the second pattern (FIG. 12B). Further, a pose in which the ball is chased with the eye after finishing hitting is set to the third pattern (FIG. 12C). Therefore, in this embodiment, the image recognition processing unit 14 creates a dictionary so that these first to third patterns can be detected.

  When the user instructs slow motion shooting, the control unit 5 starts high-speed writing into the memory 2. In addition, the image recognition processing unit 14 is instructed to start the image recognition process, and the first to third patterns are sequentially detected based on the image recognition process result. When a predetermined period T elapses after the third pattern is detected, the writing to the memory 2 is terminated, and reading of the imaging result stored in the memory 2 is started at that time.

  According to this embodiment, the period of slow motion shooting is set based on the timing at which images of a specific pattern are detected in a specific order, and the specific pattern detected in this predetermined order is a series of With the pose detected by the movement, for example, when shooting a golf swing, it is possible to accurately determine the movement of a subject with a specific pose and shoot a scene desired by the user more reliably. it can.

  The imaging apparatus of this embodiment sets a period for slow motion shooting based on the timing at which images of a specific pattern are detected in a specific order, and accepts the setting of the specific pattern by a user operation. The image pickup apparatus of this embodiment is configured in the same manner as the image pickup apparatus of each of the above-described embodiments except that the specific pattern setting is different. Therefore, in the following description, the configuration of the imaging apparatus of the fourth embodiment will be described by appropriately using the configuration of the imaging apparatus of the first embodiment.

  That is, in this imaging apparatus, when the user selects a registration mode for slow motion shooting, the control unit 5 displays a guide message on the display unit 12 and / or outputs a synthesized voice for the guide. A series of operations in the registration mode is instructed to the user by display and / or sound.

  The control unit 5 performs trial shooting of an object to be subjected to slow motion shooting in the standard operation mode and records it on the video recording medium 3 by user operation according to these guides. Further, the moving image taken by trial shooting is reproduced and displayed on the display unit 12. In the reproduction of the moving image, the control unit 5 instructs the user to perform a pause operation, and as shown in FIG. 13, the control unit 5 causes the user to select one scene for slow motion shooting and displays it on the display unit 12.

  In this state, the control unit 5 accepts selection of an image recognition target in the image recognition processing unit 14. That is, the control unit 5 displays a predetermined menu screen, accepts selection of the frame W surrounding the image recognition target, and displays the frame W on the still image displayed on the display unit 12. Further, the display of the frame W is enlarged or reduced in response to the operation of the up and down controls 16 and 17 arranged on the side of the display screen. Further, menus 18U, 18D, 18R, and 18L for instructing movement in the vertical direction and the horizontal direction are displayed on the display screen, and a frame is displayed in response to the operation of these menus 18U, 18D, 18R, and 18L detected through the touch panel. The display position of W is moved up and down, left and right. When the user operates the OK menu, the image surrounded by the frame W is set as a recognition target of the image recognition processing unit 14.

  That is, in this case, the control unit 5 transfers the still image data to the image recognition processing unit 14 and performs preprocessing, and then the part surrounded by the frame W with reference to the feature point detected by the preprocessing. To detect the coordinate values of two points registered in the pixel search table. Further, the threshold value is calculated by calculating the pixel difference value of these two points, and the coordinate value and threshold value of these two points are registered in the memory 14D. In this case, as described above, for example, when a specific image pattern is detected in combination with color detection processing using color information, when processing is executed by combining various other detection processing in various ways, genetic processing is performed. When using an algorithm or the like, information necessary for executing each process is acquired and a dictionary is constructed in the memory 14D.

  Incidentally, it is also possible to simply accept the setting of the frame W and accept registration of the detection object without executing the trial shooting process. In this case, after accepting the setting of the frame W by the user, the control unit 5 instructs the image recognition processing unit 14 to set the image surrounded by the set frame W as a recognition target at the start of slow motion shooting. Instruct processing. In response to an instruction from the control unit 5, the image recognition processing unit 14 registers a search target in the pixel search table from the image surrounded by the frame W at the start of slow motion shooting, and thereafter uses this pixel search table to recognize the search target. Search for.

After registering the dictionary in the memory 14D, the control unit 5 subsequently accepts settings for the first to third patterns. Here, as shown in FIG. 14, the control unit 5 switches the display of the display unit 12, and displays the boundary of the region for determining the presence or absence of the image recognition target for each pattern on the left side of the screen. In addition, in the display for each pattern, the user selects a region. In the first to third patterns shown in FIG. 14, one screen is divided into three areas in the horizontal direction to provide three areas, and the central area is further divided into upper and lower areas to set each area. It is an example. The control unit 5 detects the selection of each area by the user via the touch panel, switches the display color of the area selected by the user, and notifies the user. In FIG. 14, the display of the area selected by the user is shown by hatching. Therefore, in the examples of FIGS. 13 and 14, the case where the ball exists in the center and the lower region in the horizontal direction is assigned to the first and second patterns, and the ball exists in the region in the horizontal direction and the right side. The case will be assigned to the third pattern.

  Instead of displaying the first to third pattern areas and accepting the selection of the area by the user, the user may directly accept the designation of the area on the display screen. In addition, a video shot by trial shooting may be reproduced, and a pause operation may be received in a scene corresponding to each pattern, and registration of each pattern may be received by image processing of the paused image. That is, in this case, a location where the recognition target exists is detected in the temporarily stopped image, and an area where the recognition target exists in each pattern is detected based on the detection result. Alternatively, a predetermined movement pattern set in advance may be displayed, and the pattern registration may be received by allowing the user to select this movement pattern. In addition, general parameters such as golf mode and tennis mode, for example, which are set in advance may be prepared as a simple setting mode, and a change in this parameter may be received to receive registration of each pattern.

  As described above with respect to the third embodiment, when the timing is detected by the pattern based on the pause, the paused operation is received by reproducing the video shot by trial shooting, and the paused image is analyzed for each pause. Pattern registration may be accepted.

  When the area of each pattern is selected by the user, the control unit 5 ends the registration mode and ends accepting the setting of the specific pattern by operating a predetermined operator.

  When the slow motion shooting is subsequently instructed, the control unit 5 uses the memory 2 with reference to the timing at which the first to third patterns registered in the registration mode are sequentially detected, as in the first embodiment. The writing of the imaging result to is terminated.

  In this embodiment, when the control unit 5 further detects the first and second patterns, the control unit 5 only in the horizontal center and lower regions where the recognition target exists in the first and second patterns. The image recognition processing unit 14 is instructed to perform image recognition processing. In addition, after the second pattern is detected, the image recognition processing unit 14 is instructed to perform the image recognition process only in the right side region in the horizontal direction where the recognition target exists in the third pattern. Further, in response to the instruction from the control unit 5, the image recognition processing unit 14 scans the pattern matching region only in the region designated by the control unit 5, as shown in FIG. The image of the ball is detected, and the scaling process of the detected image, which is one of the pre-processes necessary for the image detection process by pattern matching, is omitted. Further, the scanning of the pattern matching area in the entire screen is omitted, and the scanning process is executed only in a part of the area to simplify the process. Here, FIG. 15A is a diagram showing a case where a recognition target is detected only in the horizontal direction, center, and lower regions described in FIG. 13, and scanning of the pattern matching region is indicated by arrows.

  The image recognition processing unit 14 narrows the size of the pattern matching area based on the immediately preceding image recognition result, and executes the image recognition process at a high speed. That is, in the image recognition processing in each region, the image recognition processing unit 14 uses the pattern matching region AR in all the regions where the image recognition processing is instructed as shown in FIG. Are subjected to raster scanning to detect the image recognition target A. In the second and subsequent fields, as shown in FIG. 15B, the pattern matching region AR is raster scanned within a certain range AR1 centered on the position of the image recognition target A detected in the previous field. The recognition target A is detected.

  As described above in the second embodiment, when detecting the opening / closing of the eyes, as shown in FIG. 16A, the face position is first identified using a face dictionary (pixel difference table). Thereafter, a range in which eyes are assumed to exist from the specified face position is set, and as shown in FIG. 16 (B), the set range is searched using an eye dictionary, and the opened and closed eyes are closed. By detecting the eye, the size of the pattern matching area can be narrowed and the image recognition process can be executed at a high speed based on the immediately preceding image recognition result. In this case, the accuracy of the image recognition process can be improved.

  According to this embodiment, by setting the period for slow motion shooting based on the timing at which images of a specific pattern are detected in a specific order, and receiving registration of this specific pattern by a user operation, By applying to shooting various subjects, it is possible to reliably perform slow motion shooting of a scene desired by the user.

  FIG. 17 is a time chart for explaining the operation of the image pickup apparatus according to the fifth embodiment of the present invention in comparison with FIG. In the imaging apparatus of this embodiment, in the slow motion shooting mode, the field-thinned image data is recorded on the recording medium during the period in which the imaging result recorded at high speed in the memory is recorded. The imaging apparatus of this embodiment is configured in the same manner as each of the above-described embodiments except that the configuration relating to recording on this recording medium is different. Therefore, in this embodiment, the configuration of FIG.

  That is, in this embodiment, in the standard operation mode, the resolution conversion processing unit 8 is the same as that described in the first embodiment, and the moving image recording processing unit 10 records the image data D1 processed by the camera signal processing unit 7. And the resolution is converted and output to the display unit 12 for monitoring.

  On the other hand, when recording in the memory 2 in the slow motion shooting mode, the field frequency 240 [fps] is obtained by thinning out the field of the image data D1 having the field frequency 240 [fps] and outputting it to the display unit 12 for monitoring. The image data D1 is output to the image compression / decompression unit 11 for recording in the memory 2, and the image data D1 having a field frequency of 60 [fps] obtained by thinning out the fields is output to the moving image recording processing unit 10 for recording. . On the other hand, at the time of reading from the memory 2, the image data of the field frequency 60 [fps] output from the image compression / decompression unit 11 is recorded in the moving image recording processing unit 10 for recording in the same manner as described in the first embodiment. The resolution is converted and output to the display unit 12 for monitoring.

  Therefore, in this embodiment, it is possible to record the imaging result of the field frequency 60 [fps] without interruption, and to automatically record the imaging result obtained by photographing the intended scene only in the slow motion.

  According to this embodiment, an imaging result at a field frequency of 60 [fps] is recorded without interruption by setting a period for slow motion imaging based on the timing at which images of a specific pattern are detected in a specific order. Thus, only the intended scene can be shot in slow motion.

  FIG. 18 is a schematic diagram illustrating the configuration of the memory 2 applied to the imaging apparatus according to the sixth embodiment of the present invention. The imaging apparatus of this embodiment is configured in the same manner as the imaging apparatus of the above-described embodiment except that the configuration related to the memory 2 is different. Therefore, in this embodiment, the configuration of FIG.

  Here, in this embodiment, in the memory 2, the recordable area is divided into a plurality of areas, and areas 1 to 5 are formed. In this imaging apparatus, these areas 1 to 5 are sequentially and cyclically assigned to continuous slow motion imaging, the imaging results are stored, and the slow motion imaging can be repeated. In FIG. 18, the circular writing of the imaging result in each region is indicated by an arrow.

  Here, FIG. 19 is a flowchart showing a processing procedure of the control unit 5 of the imaging apparatus in comparison with FIG. FIG. 20 is a time chart showing the operation of each part of the imaging apparatus in comparison with FIG. 17 when the user does not select immediate recording in the processing procedure shown in FIG.

  When the user instructs the start of the slow motion shooting mode, the control unit 5 starts the processing procedure of FIG. 19 and instructs the image recognition processing unit 14 to perform image recognition processing according to the shooting mode. Each unit is instructed to start recording an imaging result having a frequency of 240 [fps]. Subsequently, the process proceeds from step SP11 to step SP12, and based on the image recognition result of the image recognition processing unit 14, it is determined whether or not the first pattern has been detected. If a negative result is obtained in step SP12, the control unit 5 repeats step SP12 and waits for the first pattern to be detected.

  When the first pattern is detected, the control unit 5 moves from step SP12 to step SP13 and waits for the detection of the second pattern. When the second pattern is detected, the control unit 5 is detected. Moves from step SP13 to step SP14. In step SP14, the process waits until the third pattern is detected. When the third pattern is detected, the process proceeds from step SP14 to step SP15.

  Here, after waiting for the elapse of the period T set by the user, the control unit 5 ends the writing to the memory 2. In subsequent step SP16, the control unit 5 determines whether or not the user has selected immediate recording. If a positive result is obtained here, the control unit 5 proceeds from step SP16 to step SP17. Here, the control unit 5 reads out the imaging result stored in the memory 2 at that time and stores it in the video recording medium 3. In FIG. 20, the period from the time point t1 to the time point t2 is a writing period in the memory 2 in the slow motion shooting mode, and the subsequent period from the time point t2 to the time point t3 is a reading period from the memory 2. is there.

  When the reading from the memory 2 is completed, the control unit 5 proceeds from step SP17 to step SP18, determines whether or not the user has instructed repetition of slow motion shooting, and when a positive result is obtained, the field frequency 240 is determined. After instructing the start of recording of the imaging result of [fps] into the memory 2, the process returns to step SP12. On the other hand, if the user has not instructed repetition of slow motion shooting, the process proceeds from step SP18 to step SP19, where it is determined whether the user has selected immediate recording, and if a positive result is obtained, In this case, since the process of recording the imaging results stored in the memory 2 so far in the video recording medium 3 has been completed, the process proceeds from step SP19 to step SP20 and the process procedure is terminated.

  Therefore, when the user selects immediate recording, the imaging apparatus of this embodiment executes the slow motion shooting process in the same manner as in the above-described embodiment.

  On the other hand, when the user does not select immediate recording, a negative result is obtained in step SP16, so that the control unit 5 moves from step SP16 to step SP18 without executing reading from the memory 2, It is determined whether or not the user has instructed repetition of slow motion shooting, and if an affirmative result is obtained here, the start of recording of the imaging result of the field frequency 240 [fps] in the memory 2 is instructed, and then the process returns to step SP12. . At this time, the memory control unit 13 is instructed to switch the operation so that the imaging result is recorded in the subsequent area with respect to the area of the memory 2 in which the imaging result is recorded immediately before.

  Therefore, in this case, in the imaging apparatus of this embodiment, the areas 1 to 5 are sequentially selected and the imaging results are stored in the memory 2 at a high speed until the user stops the instruction to repeat the slow motion imaging. At this time, the process of reading the imaging result stored in the memory 2 is omitted, and the imaging result is stored in the subsequent area.

  In addition, when the imaging results are sequentially stored in the memory 2 in this way and the user stops the instruction to repeat the slow motion shooting, or when the user has not instructed the repetition of the slow motion shooting, the process proceeds from step SP18 to step SP19. In this case, it is determined whether or not the user selects immediate recording. In this case, a negative result is obtained. In this case, the control unit 5 moves from step SP19 to step SP21, reads out the imaging results stored in each area of the memory 2 so far from the memory 2, records them in the video recording medium 3, and moves to step SP20. This processing procedure ends.

  Therefore, in this embodiment, the imaging results stored at high speed in the memory 2 are finally read out and stored in the video recording medium 3, and the period from time t4 to time t5 in FIG. 20 corresponds to this processing period. become.

  According to this embodiment, by dividing the memory into a plurality of areas and sequentially setting each area as a recording area for imaging results in slow motion shooting, continuous slow motion shooting can be performed, which is convenient for the user. Can be improved.

  In the above-described embodiment, the case where the write end timing to the memory 2 is set using three patterns has been described. However, the present invention is not limited to this, and the write end timing can be set sufficiently reliably. In this case, the timing for ending writing to the memory 2 may be set using two patterns, and further, the timing for ending writing to the memory 2 may be set using four or more patterns.

In the above-described sixth embodiment, when the user does not select immediate recording, the operation is switched, and the imaging results stored at high speed in the memory 2 are collectively read and stored in the video recording medium 3. However, the present invention is not limited to this, and an operation switching instruction may be detected in the same manner as in the case of setting the timing of the end of writing to the memory 2. In this case, the user can switch the operation of the imaging apparatus at a location away from the imaging apparatus, and the user-friendliness can be further improved. In this case, for example, it is considered necessary to notify the user of the operation change by blinking the tally lamp or the like to prevent an erroneous operation change instruction.

  Further, in the above-described embodiment, when the imaging result stored in the memory is stored in the video recording medium, the imaging result recorded in the video recording medium is displayed on the display unit and monitored. The invention is not limited to this, and the processing of displaying on the display unit is omitted, and the imaging result obtained by the image sensor is displayed on the display unit, while the imaging result stored in the memory is recorded on the video recording medium in the background. You may do it.

  In the above-described embodiment, the case where the imaging result is acquired and recorded on the video recording medium at the field frequency 60 [fps] in the standard operation mode has been described. An imaging result may be acquired at a frequency of 240 [fps], thinned out, and recorded on a video recording medium.

  In the above-described embodiment, the case where the imaging result is acquired at the field frequency of 60 [fps] in the standard operation mode and the imaging result is acquired at the field frequency of 240 [fps] in the slow motion imaging mode has been described. However, the present invention is not limited to this, and these frequencies can be variously set as necessary without departing from the spirit of the present invention. Furthermore, it is widely used when acquiring and recording imaging results by a non-interlace method. Can be applied.

  In the above-described embodiment, the case has been described in which the imaging result stored at high speed in the memory 2 is read from the memory at the field frequency in the standard operation mode and recorded on the video recording medium. However, the present invention is not limited to this. For example, the field frequency may be higher than the field frequency in the standard operation mode and may be read from the memory and recorded on the video recording medium at a field frequency lower than that at the time of writing to the memory. In this way, the imaging result stored in the memory can be stored in the video recording medium in a short time, and for example, the time margin when repeating slow motion imaging can be increased.

  The present invention can be applied to, for example, a video camera.

It is a flowchart which shows the process sequence regarding the slow motion imaging | photography mode of the imaging device of Example 1 of this invention. It is a block diagram which shows the imaging device of Example 1 of this invention. FIG. 3 is a block diagram illustrating a detailed configuration of an image recognition processing unit of the imaging apparatus in FIG. 2. It is a basic diagram which shows the structure of the memory of the image recognition process part of FIG. FIG. 5 is a schematic diagram for explaining contents of a memory in FIG. 4. It is a block diagram which shows the flow of the image data in slow motion imaging | photography mode of the imaging device of FIG. FIG. 7 is a block diagram showing a continuation of FIG. 6. It is a basic diagram with which it uses for description of the golf swing mode in the imaging device of FIG. It is a basic diagram with which it uses for description of the baseball swing mode in the imaging device of FIG. 3 is a time chart showing the operation of each part of the imaging apparatus of FIG. 2. It is a basic diagram with which it uses for description of the timing setting at the time of slow motion imaging | photography in the imaging device of Example 2 of this invention. It is a basic diagram with which it uses for description of the timing setting at the time of slow motion imaging | photography in the imaging device of Example 3 of this invention. It is a top view which shows the display screen at the time of the pattern setting in the imaging device of Example 4 of this invention. FIG. 14 is a plan view showing a continuation of FIG. 13. It is a basic diagram with which it uses for description of the image recognition process in the imaging device of Example 4 of this invention. FIG. 16 is a plan view showing a continuation of FIG. 15. It is a time chart with which it uses for description of operation | movement of the imaging device of Example 5 of this invention. It is a basic diagram which shows the structure of the memory in the imaging device of Example 6 of this invention. It is a flowchart which shows the process sequence of the imaging device of Example 6 of this invention. FIG. 20 is a time chart for explaining the operation of the imaging apparatus according to the processing procedure of FIG. 19. FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Imaging device, 2 ... Memory, 3 ... Video recording medium, 4 ... Image sensor, 5 ... Control part, 12 ... Display part, 14 ... Image recognition process part

Claims (2)

An imaging unit for outputting an imaging result;
A memory for storing and outputting an imaging result output from the imaging unit ;
An image recognition unit that recognizes an image of the imaging result output from the imaging unit or the imaging result output from the memory and outputs an image recognition result;
A control unit for controlling the operation of each unit,
The controller is
In standard operating mode,
The imaging result is output from the imaging unit at a first field frequency or frame frequency, and recorded on a predetermined recording medium ,
In slow motion shooting mode,
The imaging result is output from the imaging unit at a second field frequency or frame frequency that is higher than the first field frequency or frame frequency, and sequentially and cyclically stored in the memory,
Based on the image recognition result, the storage of the imaging result in the memory is terminated based on the timing at which a specific pattern, which is a pattern for detecting a signal to be captured, is detected in a predetermined order in the imaging result. An imaging apparatus, wherein the imaging result stored in the memory is read at a third field frequency or frame frequency lower than the second field frequency or frame frequency and recorded on a predetermined recording medium .   An imaging unit for outputting an imaging result;
  A memory for storing and outputting an imaging result output from the imaging unit;
  An image recognition unit that recognizes an image of the imaging result output from the imaging unit or the imaging result output from the memory and outputs an image recognition result;
  A control unit for controlling the operation of each unit,
  The controller is
  In standard operating mode,
  The imaging result is output from the imaging unit at a first field frequency or frame frequency, and recorded on a predetermined recording medium,
  In slow motion shooting mode,
  The imaging result is output from the imaging unit at a second field frequency or frame frequency that is higher than the first field frequency or frame frequency, and sequentially and cyclically stored in the memory,
  Based on the image recognition result, the specific pattern, which is a specific pose pattern detected in a series of actions to be taken, is detected in a predetermined order in the imaging result. The storage in the memory is terminated, and the imaging result stored in the memory is read out at a third field frequency or frame frequency lower than the second field frequency or frame frequency and recorded on a predetermined recording medium.
  An imaging apparatus characterized by that.

Images