JP2022041589A - Imaging apparatus, control method of imaging apparatus, and program - Google Patents

Abstract

To provide an imaging apparatus, a control method of the imaging apparatus and a program, capable of reducing a possibility of failing to provide an appropriate photographic experience.SOLUTION: A digital camera 100 includes: an imaging element 102 that continuously photographs a subject; a DRAM 107, which is temporary storage means for temporarily storing a plurality of image data photographed by the imaging element; an image processing unit 104 that sequentially executes image processing on the image data stored in the temporary storage means; a CPU 112, which is calculation means for calculating a remaining time available for continuous photographing; and a voice notification unit 117 that provides voice notification of the remaining time available for continuous photographing calculated by the calculation means. The calculation means calculates the remaining time available for continuous photographing on the basis of a remaining amount of the temporary storage means and writing and reading speeds of image data to and from the temporary storage means.SELECTED DRAWING: Figure 1

Description

This case relates to an image pickup device that gives a voice notification.

In recent years, the number of pixels of image pickup elements used in image pickup devices such as digital cameras has increased, and the reading speed has been increased. This enables high-speed continuous shooting with high resolution, but since the processing load of imaging data increases, high processing performance is required, and the scale and power of the image processing circuit increase.

For this reason, a technique is used in which the captured data is processed at high speed, temporarily stored in a memory, and then sequentially processed by an image processing circuit having suppressed processing performance. For example, Patent Document 1 discloses a technique of compressing RAW data generated from imaging data, temporarily holding the RAW data in a memory, and decompressing the compressed data read from the memory for development processing.

Japanese Unexamined Patent Publication No. 2010-147531

However, when high-resolution high-speed continuous shooting is possible by a system that improves the performance of the processing from imaging to holding data in the temporary memory and suppresses the processing from reading the data in the memory to the recording medium. , The period during which continuous shooting is possible is limited. As a result, if the user does not properly grasp the remaining continuous shooting period, the continuous shooting speed may slow down or the shooting may be interrupted at an unintended timing. In this way, it may not be possible to provide an appropriate shooting experience.

The present invention has been made in view of such a situation, and an object of the present invention is to reduce the possibility that an appropriate shooting experience cannot be provided.

In order to solve the above problems, the image pickup apparatus of the present invention includes an image pickup means for continuously photographing a subject, a temporary storage means for temporarily storing a plurality of image data captured by the image pickup means, and the temporary storage means. An image processing means for sequentially performing image processing on the image data stored in the image data, a calculation means for calculating the remaining time for continuous shooting, and a voice notification of the remaining time for continuous shooting calculated by the calculation means. The calculation means includes a voice notification means, and is characterized in that the calculation means calculates the remaining time during continuous shooting based on the remaining amount of the temporary storage means and the writing speed and reading speed of the image data to the temporary storage means. do.

According to the present invention, it is possible to reduce the possibility that an appropriate shooting experience cannot be provided.

The block diagram which shows the structure of the digital camera 100 which is an image pickup apparatus. A flowchart showing the continuous shooting possible time notification process. Schematic diagram of processing during continuous shooting. Voice notification timing diagram in continuous shooting possible time notification processing. The flowchart which shows the continuous shooting possible time notification processing of 2nd Embodiment. The figure which shows the scene example at the time of the continuous shooting of the 2nd Embodiment The voice notification timing diagram in the continuous shooting possible time notification processing of the second embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[First Embodiment]
FIG. 1 is a block diagram of a digital camera 100, which is an image pickup apparatus according to the present invention. In FIG. 1, the imaging optical unit 101 has a plurality of lens groups and an aperture including a focus lens and an anti-vibration lens, and the imaging optical unit 101 performs focus adjustment, exposure adjustment, blur correction, etc. at the time of shooting. Then, an optical image is formed on the image pickup element 102 which is an image pickup means. The image pickup device 102 has a photoelectric conversion function for converting an optical image into an electric signal (analog image signal), and is composed of a CCD, a CMOS sensor, or the like. The A / D conversion unit 103 converts the analog image signal from the image sensor unit 102 into a digital image signal.

The PU 112 is composed of a microcomputer or the like that controls the entire image pickup apparatus, gives an operation instruction to each functional block, and executes various control processes. It also performs operations required for various control processes. The bus 118 is a system bus, and the bus 119 is an image data bus.

The DRAM (memory) 107 is a memory for storing data, and has a storage capacity sufficient for storing a predetermined number of still images, moving images for a predetermined time, data such as voice, constants for operation of the CPU 112, programs, and the like. Be prepared. The memory control unit 106 writes data to and reads data from the DRAM 107 in response to an instruction from the CPU 112 or the data transfer unit 105.

The non-volatile memory control unit 108 writes and reads data to and from the ROM (nonvolatile memory) 109 in response to an instruction from the CPU 112. The ROM 109 is a memory that can be electrically erased and recorded, and an EEPROM or the like is used. The ROM 109 stores constants, programs, etc. for the operation of the CPU 112.

The CPU 112 includes an image processing unit 104, a data transfer unit 105, a memory control unit 106, a non-volatile memory control unit 108, a recording media control unit 110, an operation unit 113, a display control unit 114, and a voice control unit 116 via a bus 118. The image pickup element 102 is controlled. Execution of the microcomputer realizes each process of this embodiment by executing the program recorded in ROM 109.

The recording medium 111 is a recording medium such as an SD card, and is controlled by the recording media control unit 110 to record image data and read recorded data.

The operation unit 113, which is an operation means, includes switches, buttons, a touch panel, and the like operated by the user, and is used for operations such as power ON / OFF and shutter ON / OFF.

The display unit 115 is composed of a liquid crystal monitor or the like, and is mounted on the back surface of the digital camera 100 main body or in a finder. It is controlled by the display control unit 114 and displays various image data, setting information, and the like.

The voice notification unit 117, which is a voice notification means, is composed of a speaker, a wireless earphone, or the like, and is controlled by the voice control unit 116 to output an operation sound, various notification sounds, and the like.

The image processing unit 104 is composed of various image processing units, a buffer memory, and the like, and appropriately performs processing such as magnification chromatic aberration correction, development processing, noise reduction processing, geometric deformation, scaling, and the like on the image data. .. Further, the image processing unit 104 also includes an image pickup correction unit that appropriately performs pixel correction, black level correction, shading correction, scratch correction, and the like on the image data converted by the A / D converter 102.

The data transfer unit 105 is composed of a plurality of DMACs (Direct Memory Access Controllers) that transfer data.

The above is the configuration of the digital camera 100, which is the image pickup apparatus according to the present embodiment. Next, the continuous shooting possible time notification process in the present embodiment will be described in detail.

FIG. 2 is a diagram showing a processing flow in continuous shooting possible time notification processing of the digital camera 100, which is an imaging device according to the present embodiment. Hereinafter, the processing contents will be described based on the processing flow of FIG.

In step S201, the CPU 112 determines whether or not the shooting mode is set to the continuous shooting mode. When the continuous shooting mode is set, the process proceeds to step S202, and when the continuous shooting mode is not set, the continuous shooting possible time notification process is not performed, so the process ends.

In step S202, the CPU 112 determines whether or not the shutter button, which is a part of the operation unit 113, has been pressed by the user. The shutter button is, for example, a button that operates the autofocus process when pressed halfway (SW1) and operates the image pickup process when pressed fully (SW2). If the shutter button (SW2) is pressed and continuous shooting is performed, the process proceeds to step S203, and if the shutter button (SW2) is not pressed and continuous shooting is not performed, the process waits until shooting is performed. ..

In step S203, the CPU 112 calculates the remaining time during continuous shooting as a calculation means. The user can intuitively grasp how long the continuous shooting can be continued by expressing it as the shootable time instead of the shootable number of shots. When expressing by the number of remaining continuous shootings, the speed at which the information changes differs depending on the continuous shooting setting, and the user cannot accurately grasp the remaining continuous shooting period. Here, a method of calculating the remaining time during continuous shooting will be described with reference to FIG. FIG. 3 is a schematic diagram of processing during continuous shooting.

During continuous shooting, the analog image signal acquired by the image sensor is temporarily held in the DRAM as RAW image data 303 after being subjected to necessary processing by the A / D conversion unit and the image pickup correction unit. The retained RAW image data 303 are sequentially read out, converted into image data for recording, for example, JPEG image data, etc. by the image processing unit, and then transferred to and recorded on a recording medium. The calculation of the remaining time that allows continuous shooting is based on the processing performance of the pre-stage processing 301 and the post-stage processing 302 of the DRAM that temporarily holds the RAW image data 303, and the remaining capacity of the capacity reserved for holding the RAW image data 303 of the DRAM. It is done based on. The processing performance of the pre-stage processing 301 is, for example, the writing rate of the RAW image data 303 to the DRAM, which is determined by the number of pixels to be photographed by the image sensor based on the setting and the number of images to be photographed per unit time. On the other hand, the processing performance of the post-stage processing 302 is determined by the number of pixels processed by the image processing unit based on the setting, the number of pixels that can be processed per unit time, and the amount of recordable data per unit time of the recording medium, with respect to the DRAM. This is the read rate of the RAW image data 303. The CPU 112 can shoot continuously from the remaining amount of the DRAM capacity, the write rate of the RAW image data 303 of the pre-stage processing 301, and the read rate of the RAW image data 303 of the post-stage processing 302 until the remaining amount of the DRAM capacity is exhausted. Calculate the remaining time. As described above, the remaining time during continuous shooting is not calculated based only on the remaining capacity of the DRAM, which is a temporary storage means, but is calculated based on the processing performance of each of the input side and the output side of the DRAM, so that the accuracy is higher. It is possible to provide the user with good remaining time information. When the remaining time for continuous shooting is calculated in step S203, the process proceeds to step S204.

In step S204, the CPU 112 determines whether or not the remaining time for continuous shooting calculated in step S203 is less than a predetermined threshold value set in advance. If the remaining time for continuous shooting is less than a predetermined threshold value, the process proceeds to step S205, and if the remaining time for continuous shooting is greater than or equal to the predetermined threshold value, the process proceeds to step S206.

In step S205, the CPU 112 instructs the voice control unit 116 to count down and notify the remaining time during which continuous shooting is possible every second. The voice control unit 116 controls the voice notification unit 117 in response to an instruction from the CPU 112, and notifies the user of the remaining time during continuous shooting by voice. By notifying the user of the remaining time during continuous shooting by voice, the user can grasp the remaining time while concentrating on the subject. In the case of display-only notification, the user needs to shift his / her line of sight from the subject to the display of the remaining time at any time to check it, which may affect the framing of shooting. When the remaining time during continuous shooting is notified by voice in step S205, the process proceeds to step S207.

In step S206, the CPU 112 instructs the voice control unit 116 to notify the voice control unit 116 of the remaining time during continuous shooting at 5-second intervals. The voice control unit 116 controls the voice notification unit 117 in response to an instruction from the CPU 112, and notifies the user of the remaining time during continuous shooting by voice. In a state where there is a margin in the remaining time for continuous shooting, the notification of the remaining time in units of 1 second to the user is excessive and causes annoyance. Therefore, when the remaining time for continuous shooting is equal to or more than a predetermined threshold value, Appropriate information notification is possible by lengthening the notification interval. When the remaining time during continuous shooting is notified by voice in step S206, the process proceeds to step S207.

In step S207, the CPU 112 determines whether or not the shutter button (SW2) has been released. When the shutter button (SW2) is released and continuous shooting is paused, the process proceeds to step S208, and when continuous shooting is continued without releasing the shutter button (SW2), the process returns to step S203 and steps S203 to The process of S207 is repeated.

In step S208, the CPU 112 calculates the remaining time during continuous shooting as in step S203. However, in this step, since continuous shooting has already been suspended, the remaining time is calculated from the remaining amount of the DRAM capacity and the read rate of the RAW image data 303 in the subsequent processing 302. When the remaining time during continuous shooting is calculated in step S208, the process proceeds to step S209.

In step S209, the CPU 112 determines whether or not the calculated remaining time for continuous shooting has returned to a predetermined time set in advance or more. If the remaining time for continuous shooting returns to the predetermined time or more, the process proceeds to step S210, and if the remaining time for continuous shooting is less than the predetermined time, the process waits until the remaining time for continuous shooting exceeds the predetermined time.

In step S210, the CPU 112 instructs the voice control unit 116 to notify the voice control unit 116 that the remaining time during continuous shooting has reached a predetermined time or longer. The voice control unit 116 controls the voice notification unit 117 in response to an instruction from the CPU 112, and notifies the user by voice that the remaining time during continuous shooting has reached a predetermined time or longer. By notifying by voice that the remaining time for continuous shooting has exceeded the specified time, the user can concentrate on the subject even during the period when continuous shooting is paused, and the next continuous shooting opportunity while continuing framing. It will be possible to prepare. When the voice notification that the remaining time for continuous shooting has reached the predetermined time or more in step S210 is notified, the process returns to step S201, and the processes of steps S201 to S210 are repeated.

Next, the voice notification timing of the continuous shooting possible time notification process described above will be described with reference to FIG. FIG. 4 is a timing diagram of voice notification in the continuous shooting possible time notification process. During the continuous shooting period in which the shutter button (SW2) is pressed by the user, voice notifications 401 and 402 of the remaining time during continuous shooting are performed. Here, if the remaining time for continuous shooting is 5 seconds or more, the voice notification 401 is given every 5 seconds, and if the remaining time for continuous shooting is less than 5 seconds, the voice notification 402 is given every 1 second. An example is shown. Further, after the shutter button (SW2) is released by the user and the continuous shooting pause period is set, when the remaining time during continuous shooting exceeds a preset predetermined time, the user is notified by voice 403. ..

As described above, by calculating the remaining time for continuous shooting based on various settings for continuous shooting and notifying the user by voice, the remaining time for intuitive continuous shooting even when the user is concentrated on the subject. It becomes possible to grasp the period. As a result, the user can take a voice notification and a response according to the shooting situation, which can lead to a reduction in the loss of shooting opportunities.

Further, although the present invention has been specifically described based on the first embodiment, it is needless to say that the present invention is not limited to the above-described embodiment and various changes can be made without departing from the gist thereof. stomach. For example, in the present embodiment, an example of switching the voice notification every 1 second and every 5 seconds with the calculated remaining period during continuous shooting being 5 seconds or more as a boundary has been described, but the present invention is not limited to this, and each value is not limited to this. Can be any setting value. Further, in the present embodiment, an example in which the CPU 112 calculates the remaining period time during which continuous shooting is possible has been described, but it may be realized by dedicated hardware.

[Second Embodiment]
Next, the image pickup apparatus according to the second embodiment will be described with reference to FIGS. 5 to 7. In the second embodiment, an example of changing the setting for extending the continuous shooting period according to the voice notification of the remaining time during continuous shooting will be described. This avoids the loss of shooting opportunities.

The configuration of the digital camera 100, which is the image pickup apparatus according to the present embodiment, and the method of calculating the remaining time during continuous shooting are the same as those of the first embodiment, only different parts will be described, and the same parts will be described. Is omitted. The difference from the first embodiment in the second embodiment is the processing flow of the continuous shooting possible time notification process and the voice notification timing.

FIG. 5 is a diagram showing a processing flow of the shooting possible time notification processing in the present embodiment. Hereinafter, the processing contents will be described based on the processing flow of FIG. The same processing steps as those in the first embodiment are designated by the same symbols, and detailed description thereof will be omitted here.

In step S501, the user determines in advance, via the operation unit 113, the setting content for changing the setting for extending the continuous shooting period during continuous shooting. The setting contents for extending the continuous shooting period are, for example, the number of continuous shots per unit time by the image sensor 102, the recording format and image quality of the recording image data generated by the image processing unit 104, and the like. Further, it also includes a setting such as deletion of the RAW image data 303 which is the stored data held in the DRAM 107. These settings are related to lowering the write rate or increasing the read rate of the DRAM, which is a temporary storage means, and increasing the remaining capacity of the DRAM, and can extend the remaining time during continuous shooting. .. When the user determines in advance the setting content for changing the setting for extending the continuous shooting period during continuous shooting in step S501, the process proceeds to step S502.

In step S502, the user selects from the operation unit 113 an operation button for reflecting the setting for changing the setting for extending the continuous shooting period during the continuous shooting determined in step S501, and determines the allocation. By providing the operation button (SW3) of the setting change reflection function, the user can easily change the setting without looking away from the subject even during continuous shooting. Further, by assigning the operation button (SW3) of the setting change reflection function to an arbitrary operation button, it is possible to assign the button to another function in a scene where this function is unnecessary. This makes it possible to simplify the digital camera 100 without increasing the number of operation buttons more than necessary. When the user determines the assignment of the operation button (SW3) of the setting change reflection function in step S502, the process proceeds to step S201. The processing of steps S201 to S203 is the same as that of the first embodiment.

In step S503, the CPU 112 determines whether or not the operation button (SW3) to which the setting change reflection function is assigned is pressed. If the operation button (SW3) to which the setting change reflection function is assigned is pressed, the process proceeds to step S504, and if the operation button (SW3) is not pressed, the process proceeds to step S204. The processing of steps S204 to S206 is the same as that of the first embodiment.

In step S504, the CPU 112 gives a control instruction to the image sensor 102, the image processing unit 104, and the memory control unit 106 based on the preset setting change contents, and changes the setting. When the setting of each part is changed in step S504, the process proceeds to step S505.

In step S505, the CPU 112 again calculates the remaining time during continuous shooting based on the changed setting. When the remaining time for continuous shooting after the setting change is calculated in step S504, the process proceeds to step S505.

In step S506, the CPU 112 instructs the voice control unit 116 to notify the voice control unit 116 of the remaining time during continuous shooting after the setting change. The voice control unit 116 controls the voice notification unit 117 in response to an instruction from the CPU 112, and notifies the user of the remaining time during continuous shooting after the setting change. When the remaining time during continuous shooting after the setting change is notified by voice in step S506, the process proceeds to step S207.

The processing of steps S207 to S210 is the same as that of the first embodiment, and after step S210, the process returns to step S201 and the processing of steps S201 to S210 is repeated.

Since it is assumed that the setting change performed in step S504 is a setting change temporarily performed by the user in order to avoid loss of shooting opportunity, the setting is initially set when continuous shooting is temporarily interrupted. Return to settings. That is, the valid period of the setting change performed during continuous shooting is only during the continuous shooting period in which the setting is changed. As a result, when the user performs continuous shooting again, the shooting is performed with the initial settings, and the operation more in line with the user's shooting intention becomes possible.

Next, an example of a setting change scene in the continuous shooting possible time notification process of the second embodiment described above with reference to FIGS. 6 and 7 and a voice notification timing will be described. FIG. 6 is a schematic diagram showing an example of a shooting scene in which settings are changed during continuous shooting. FIG. 7 is a timing diagram of voice notification in the continuous shooting possible time notification processing corresponding to the shooting scene example of FIG.

FIG. 6A shows a scene in which the user presses the shutter button (SW2) and starts continuous shooting of the subject 601. The remaining time during which continuous shooting is possible calculated at this time is displayed as the information display 602 in the viewfinder at the same time as the voice notification 702 (FIG. 7). FIG. 6B shows a scene in which the user continues continuous shooting and the subject 601 approaches. At this time, since the remaining time during continuous shooting is equal to or less than a predetermined value, voice notification 703 (FIG. 7) is performed as a countdown every second, and the user can continuously shoot from the information of the voice notification and the situation of the subject 601 to a desired scene. Determine if. Here, when the user determines that continuous shooting up to a desired scene is impossible, the user presses the operation button (SW3) to reflect the preset setting change 701. FIG. 6C shows a scene immediately after the user presses the operation button (SW3) for reflecting the setting change. For example, when the setting for reducing the number of shots per unit time by the image sensor 102 is determined in advance as the setting change content, the voice notification 704 indicates that the remaining time during continuous shooting is extended according to the setting content (Fig. 7) It is done. As a result, the user can immediately grasp how much the remaining time for continuous shooting has been extended by changing the setting. FIG. 6D shows a scene immediately before the end of the continuous shooting possible period. At this time, since the remaining time during continuous shooting is equal to or less than a predetermined value, a voice notification 705 (FIG. 7) is given as a countdown every second. By changing the settings and extending the continuous shooting period, the user can shoot the desired scene closest to the subject 601.

As described above, by notifying the user of the remaining time during which continuous shooting is possible by voice, the user can promptly make a judgment according to the shooting situation and change the setting for extending the continuous shooting period. It can be easily done. As a result, the user can reduce the loss of shooting opportunities.

Further, although the present invention has been specifically described based on the second embodiment, it is needless to say that the present invention is not limited to the above-described embodiment and various changes can be made without departing from the gist thereof. stomach.

For example, the setting change reflection operation button may be a dedicated operation button.

(Other examples)
The present invention supplies a program that realizes one or more functions of the above-described embodiment to a system or device via a network or storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by the processing to be performed. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

Claims (11)

An imaging means that continuously shoots the subject,
A temporary storage means for temporarily storing a plurality of image data captured by the image pickup means, and a temporary storage means.
An image processing means that sequentially performs image processing on the image data stored in the temporary storage means, and an image processing means.
A calculation method for calculating the remaining time for continuous shooting,
A voice notification means for notifying the remaining time of continuous shooting calculated by the calculation means by voice, and a voice notification means.
Equipped with
The calculation means is an image pickup apparatus characterized in that the remaining time during continuous shooting is calculated based on the remaining amount of the temporary storage means and the write rate and read rate of the image data to the temporary storage means. The image pickup apparatus according to claim 1, wherein the write rate of the image data to the temporary storage means is determined based on the number of pixels of the image pickup means and the number of images taken per unit time. Further having a recording means for recording image data for recording generated by the image processing means.
The reading rate of the image data for the temporary storage means is based on the number of pixels processed by the image processing means, the number of pixels that can be processed per unit time, and the amount of recordable data per unit time of the recording means. The image pickup apparatus according to claim 1 or 2, wherein the image pickup apparatus is determined. The voice notification means is characterized in that the unit of time for notification is changed when the remaining time during continuous shooting calculated by the calculation means is equal to or greater than a predetermined threshold value and when the remaining time is less than a predetermined threshold value. The image pickup apparatus according to any one of 1 to 3. The voice notification means is characterized in that after the continuous shooting by the imaging means is interrupted, the voice notification means notifies that the remaining time during which continuous shooting is possible calculated by the calculation means has reached a predetermined time or longer. The image pickup apparatus according to any one of 4 to 4. Further having an operating means for the user to change the setting based on the information notified by the voice notification means.
The imaging device according to any one of claims 1 to 5, wherein the setting content changed by the operating means is a content preset by the user. The imaging device according to claim 6, wherein the operating means for reflecting the set contents is an operating means preset by the user. The setting contents include the number of continuous images taken per unit time of the image pickup means, the recording format of the image data for recording generated by the image processing means, the image quality of the image data for recording generated by the image processing means, or. The image pickup apparatus according to any one of claims 6 to 7, wherein the setting is for deleting the stored data of the temporary storage means. The image pickup apparatus according to any one of claims 6 to 8, wherein the reflection of the setting contents by the operation means is effective only during a period in which continuous shooting by the image pickup means is performed. An image pickup unit that continuously captures a subject, a temporary storage means that temporarily stores a plurality of image data captured by the image pickup means, and an image that sequentially performs image processing on the image data stored in the temporary storage means. It is a control method of an image pickup apparatus including a processing means, a calculation means for calculating the remaining time for continuous shooting, and a voice notification means for notifying the remaining time for continuous shooting calculated by the calculation means by voice. hand,
Control of an image pickup apparatus, characterized in that the calculation means controls to calculate the remaining time during continuous shooting based on the remaining amount of the temporary storage means and the write rate and read rate of the image data to the temporary storage means. Method. A computer-readable program for operating a computer as each means of the image pickup apparatus according to any one of claims 1 to 9.

Images