US10148861B2 - Image pickup apparatus generating focus changeable image, control method for image pickup apparatus, and storage medium - Google Patents

Image pickup apparatus generating focus changeable image, control method for image pickup apparatus, and storage medium Download PDF

Info

Publication number
US10148861B2
US10148861B2 US14/669,289 US201514669289A US10148861B2 US 10148861 B2 US10148861 B2 US 10148861B2 US 201514669289 A US201514669289 A US 201514669289A US 10148861 B2 US10148861 B2 US 10148861B2
Authority
US
United States
Prior art keywords
data
focal length
image
control unit
development process
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US14/669,289
Other languages
English (en)
Other versions
US20150288872A1 (en
Inventor
Takuma Mikawa
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Assigned to CANON KABUSHIKI KAISHA reassignment CANON KABUSHIKI KAISHA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MIKAWA, TAKUMA
Publication of US20150288872A1 publication Critical patent/US20150288872A1/en
Application granted granted Critical
Publication of US10148861B2 publication Critical patent/US10148861B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • H04N5/23212—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/62—Control of parameters via user interfaces
    • H04N5/23216—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording

Definitions

  • the present invention relates to an image pickup apparatus, a control method for the image pickup apparatus, and a storage medium.
  • image processing apparatuses there are image pickup apparatuses such as digital cameras.
  • RAW data including minimally processed data from an image sensor is typically recorded in memory (see Japanese Laid-Open Patent Publication (Kokai) No. 2007-4471).
  • the present invention provides an image pickup apparatus which is capable of easily generating a developed image file from image data capable of refocusing after being taken, a control method for the image pickup apparatus, and a storage medium.
  • the present invention provides an image pickup apparatus comprising: a selection unit configured to select one of a first recording mode in which data obtained based on a plurality of signals having different focuses is recorded as first data in a refocusable format, and a second recording mode in which data in a non-refocusable format, which is obtained by carrying out a development process on the data obtained based on the plurality of signals, is recorded as second data, a first setting unit configured to set a focal length before recording the data obtained based on the plurality of signals into a recording medium as the first data and the second data, and a storage control unit configured to, when the first recording mode is selected by the selection unit, provide control to store the first data in association with information indicative of the set focal length into the recording medium, and when the second recording mode is selected by the selection unit, provide control to store the second data obtained by carrying out the development process on the data obtained based on the plurality of signals using the set focal length into the recording medium.
  • whether to generate a RAW image file or generate a developed image file is determined based on a recording mode and focus information.
  • the RAW image file is recorded with focus information in the recording unit.
  • a developed image file with a desired focus is easily generated from the RAW image file.
  • FIG. 1 illustrates an image pickup apparatus according to the present invention.
  • FIG. 2 is a block diagram showing an exemplary hardware arrangement of the image pickup apparatus according to the present invention.
  • FIGS. 3A and 3B illustrate an exemplary arrangement of an image pickup unit according to the present invention.
  • FIG. 4 is a flowchart illustrating a shooting process which is carried out by the image pickup apparatus according to the present invention.
  • FIGS. 5A and 5B are flowcharts illustrating a process of setting and storing focus parameters in step S 450 in FIG. 4 .
  • FIG. 6 is a diagram showing an exemplary structure of a RAW image file which is generated in the process in FIGS. 5A and 5B .
  • FIG. 7 is a flowchart illustrating a shooting process which is carried out by the image pickup apparatus according to the present invention.
  • FIGS. 8A and 8B are flowcharts illustrating a process of setting and storing focus parameters in step S 750 in FIG. 7 .
  • FIGS. 9A to 9C are views of a display unit of the image pickup apparatus according to the present invention.
  • FIG. 1 is a view showing an image pickup apparatus taken from behind according to a first embodiment of the present invention.
  • the image pickup apparatus in FIG. 1 is, for example, a digital camera (hereafter referred to merely as the camera) 100 .
  • the camera 100 is capable of recording image data in RAW format (RAW data) which has not yet been developed, and image data which has already been developed and converted into a format such as JPEG format or TIFF format.
  • RAW format RAW data
  • JPEG format JPEG format
  • TIFF format TIFF format
  • the camera 100 directly outputs image data of which the light quantity has been measured by an image pickup device, and records a plurality of pieces of RAW data having different focuses obtained using the so called light-field technique.
  • the camera 100 is also capable of setting focus parameters as focus information during the captured image review immediately after the image is taken, as described below.
  • the camera 100 has at least a shooting mode and an image playback mode.
  • the shooting mode a user is allowed to choose and determine whether to record RAW data obtained by shooting, or to record data in JPEG format (developed data) as data which has been subjected to the development process.
  • RAW data is data in a refocusable format from which desired data can be generated by adjusting not only the general items of the development process (such as exposure, white balance, contrast and sharpness), but a focus position and a depth of field.
  • developed data is data in an unrefocusable format of which the focus position and the depth of field as well as the general items of the development process described above cannot be adjusted.
  • the camera 100 has a user interface 101 on a rear side thereof, and the user interface 101 has a monitor 102 on which an image obtained by shooting, shooting information, or the like is displayed.
  • the user interface 101 has a shutter button 103 , a mode selection switch 104 , an operating button 105 , a set button 106 , and a menu button 107 .
  • the shutter button 103 is disposed on an upper surface of a casing for the camera 100 , and in response to the user pressing the shutter button 103 , the camera 100 performs a shooting process.
  • the mode selection switch 104 , the operating button 105 , the set button 106 , and the menu button 107 are disposed on a right side of the monitor 102 . By operating the mode selection switch 104 , the user switches between the image playback mode and the shooting mode and selectively turns on and off the power.
  • the operating button 105 , the set button 106 , and the menu button 107 are used when the camera 100 performs various operations.
  • the monitor 102 has a touch panel and receives instructions corresponding to user's touch operations.
  • the operating button 105 has four buttons, i.e., up, down, right, and left buttons.
  • the user provides the camera 100 with a shooting instruction or an image playback instruction and sets focus parameters, using the operating button 105 , the set button 106 , and the menu button 107 .
  • the camera 100 goes into the image playback mode (play), and when the mode selection switch 104 is set on a right side in the figure, the camera 100 goes into the shooting mode (camera).
  • the mode selection switch 104 is set in the middle, the camera 100 is powered off.
  • FIG. 2 is a block diagram showing an example of the hardware arrangement of the camera in FIG. 1 .
  • the camera 100 has a control unit 201 , which controls the overall camera 100 .
  • the control unit 201 is, for example, a central processing unit (CPU).
  • Programs, parameters, and so on are stored in a read-only memory (ROM) 202 .
  • control programs required for processing in the camera 100 are recorded in the ROM 202 .
  • a shooting processing program as described below, is recorded as a program code readable by the control unit 201 in the ROM 202 , and the control unit 201 executes this program code to carry out a shooting process.
  • the ROM 202 in the figure is, for example, a flash ROM on which the control programs are rewritable.
  • Programs and data supplied from external devices are temporarily stored in a random-access memory (RAM) 203 .
  • the control programs recorded in the ROM 202 are expanded on the RAM 203 and executed.
  • the RAM 203 is also used as a work area for the control unit 201 .
  • a recording medium (recording unit) 204 is, for example, a memory card removable from the camera 100 , and digital data such as image data is recorded as a file in the recording medium 204 . It should be noted that the recording medium 204 may be in another form such as a magnetic or optical card, or an IC card.
  • the image pickup unit 205 has a taking lens unit (hereafter referred to merely as lenses), a shutter, a diaphragm, an image pickup device, and so on. As described below, the image pickup unit 205 outputs an image signal corresponding to an input optical image.
  • the image pickup device has micro lens arrays for pixels, and thus obtains image signals using the light field technique as described below.
  • An operation input unit 206 is comprised, for example, the shutter button 103 , the mode selection switch 104 , the operating button 105 , the set button 106 , and the menu button 107 in FIG. 1 .
  • a display unit 207 which is the monitor 102 in FIG. 1 , has the touch panel as described earlier, and the user sets focus parameters using the touch panel at the time of captured image review.
  • control unit 201 the ROM 202 , the RAM 203 , the recording medium 204 , the image pickup unit 205 , the operation input unit 206 , and the display unit 207 are connected to one another via a system bus 210 .
  • FIGS. 3A and 3B are views useful in explaining an exemplary arrangement of the image pickup unit 205 in FIG. 2 .
  • FIG. 3A is a view schematically showing the image pickup unit 205 as seen from a lateral side
  • FIG. 3B is a view schematically showing the image pickup unit 205 as seen from a front side. It should be noted that the shutter, the diaphragm, and so on are omitted in the example shown in the figures.
  • the image pickup device 301 includes an image sensor (for example, a CMOS image sensor) 302 and a plurality of microlens (ML) arrays 304 .
  • the ML arrays 304 are disposed on a front side (that is, a lens 303 side) of the image sensor 302 (see FIG. 3A ).
  • the image sensor 302 has a plurality of pixels 302 a arrayed in a two-dimensional matrix, and one ML array 304 has a plurality of MLs 304 a .
  • one ML 304 a is associated with 5 ⁇ 5 pixels 302 a . It should be noted that at least one ML array 304 differs from the other ML arrays 304 in terms of focal length.
  • At least one ML array 304 differs from the other ML arrays 304 in terms of focal length, and hence a plurality of image signals differing in focal length (that is, image signals having a plurality of focuses) are obtained from the image sensor 302 .
  • the image signals are recorded in the recording medium 204 after an image pickup process.
  • the camera 100 shown in the figures obtains a plurality of pieces of RAW data using the light field technique (light field images).
  • light field images may be obtained with an arrangement different from the arrangement shown in FIGS. 3A and 3B .
  • Light field images are recorded as RAW data in the recording medium 204 .
  • a refocusing process, as described below, is carried out on the light field images to generate a developed image file such as JPEG data.
  • FIG. 4 is a flowchart useful in explaining a shooting process which is carried out by the camera in FIG. 2 .
  • the shooting process in the flowchart of FIG. 4 is carried out under the control of the control unit 201 .
  • the control unit 201 carries out the shooting process by loading a control program (a shooting process program) stored in the ROM 202 .
  • control program may be recorded in the recording medium 204 , and further, the control program may be loaded from a network.
  • the camera 100 has a shooting mode and an image playback mode, and when the shooting mode is selected, a process of capturing image data and recording the image data in the recording medium 204 is carried out. On the other hand, when the image playback mode is selected, a process of reading the image data from the recording medium 204 and playing back the image data is carried out.
  • the mode selection switch 104 is placed on the right side (camera side) as viewed in FIG. 1 to set the shooting mode.
  • the control unit 201 obtains RAW data corresponding to image signals which are output from the image sensor 302 provided in the image pickup unit 205 (step S 400 ).
  • the control unit 201 then carries out a development process including a simple refocusing process on the RAW data to generate preview image data (step S 405 ).
  • This simple refocusing process is a process for generating preview image data and is intended to shorten processing time and display an image on the display unit 207 .
  • the preview image data is generated with a deep depth of field, that is, a short focal length so that an image on the display unit 207 can be easily seen.
  • the control unit 201 then displays an image corresponding to the preview image data on the display unit 207 (step S 410 ).
  • the control unit 201 determines whether or not the recording mode (that is, the setting recording mode) has been changed by user operation (step S 420 ).
  • RAW recording mode first recording mode
  • JPEG recording mode second recording mode
  • One of the first recording mode and the second recording mode is set as a setting recording mode.
  • the control unit 201 changes recording mode-related information to the recording mode set by the user (step S 430 ).
  • the control unit 201 determines whether or not a shooting instruction (that is, pressing of the shutter button 103 ) has been provided by the user (step S 440 ).
  • step S 420 when the control unit 201 determines that the recording mode has not been changed by user operation (NO in step S 420 ), the process proceeds to step S 440 .
  • the control unit 201 sets and stores focus parameters, as described below, (hereafter referred to as the process of setting and storing focus parameters) (step S 450 ). After that, the control unit 201 determines whether or not an operation to exit the shooting mode has been performed by the user (step S 460 ).
  • step S 440 when the control unit 201 determines that the shooting instruction has not been provided by the user (NO in step S 440 ), the process proceeds to step S 460 .
  • step S 460 When an operation to exit the shooting mode has been performed (YES in step S 460 ), the control unit 201 ends the shooting process. On the other hand, when the control unit 201 determines that an operation to exit the shooting mode has not been performed by the user (NO in step S 460 ), the process returns to step S 400 . It should be noted that when the power is turned off or the mode is switched to the image playback mode, the control unit 201 determines that an operation to exit the shooting mode has been performed.
  • step S 400 to step S 460 are repeatedly carried out, and live view images are displayed on the display unit 208 in real time.
  • the control unit 201 then accepts a shooting instruction and a recording mode changing operation.
  • FIGS. 5A and 5B are flowcharts useful in explaining the process of setting and storing focus parameters in step S 450 in FIG. 4 .
  • the control unit 201 when the user provides the shooting instruction, the control unit 201 starts the process of setting and storing focus parameters. First, immediately after the image is captured, the control unit 201 controls the display unit 207 to display a preview image based on image data obtained by the shooting process (step S 500 ).
  • step S 500 focus information has not yet been set, and hence the control unit 201 carries out the development process under a predetermined condition on image data obtained from an image sensor when receiving the shooting instruction in step S 440 as is the case with step 414 , to generate preview image data and display the preview image as a captured image review on the display unit 207 .
  • control unit 201 determines whether or not focus information has been set by user operation (step S 505 ). To set focus information, the user taps on a desired subject on the preview image displayed on the display unit 207 .
  • the control unit 201 In response to this tapping (that is, touching), the control unit 201 obtains a focal length from the camera 100 to the subject using a well-known method. The control unit 201 then sets the obtained focal length as focus information.
  • the control unit 201 detects a point at which a finger of the user releases a display screen of the display unit 207 .
  • a desired position that is, a position of the subject.
  • focus information may be set in another way. For example, by inputting a value to designate a focal length using an operating button, the control unit 201 may set the designated focal length as focus information.
  • control unit 201 determines whether or not the captured image review has continued for a predetermined time period (for example, four seconds) or longer. Namely, the control unit 201 determines whether or not to terminate (that is, stop) the captured image review (step S 507 ).
  • step S 507 determines that the captured image review has not continued for the predetermined time period or longer (NO in step S 507 ).
  • the process returns to step S 505 .
  • the control unit 201 determines that the captured image review has continued for the predetermined time period or longer (YES in step S 507 )
  • the process proceeds to step S 525 , as described below.
  • step S 505 focus information has been set by user operation (YES in step S 505 )
  • the control unit 201 obtains the focus information (step S 510 ).
  • the control unit 201 then generates developed image data by carrying out the development process such as a refocusing process, RGB process, and color adjustment on RAW data based on the obtained focus information. After that, the control unit 201 saves the developed image data and the focus information in association with each other in the RAM 203 (step S 515 ).
  • control unit 201 generates developed image data by carrying out a refocusing process so as to put a focus at a focal length according to the focus information.
  • the control unit 201 then carries out a process in which it displays the developed image data on the display unit 207 . Specifically, the control unit 201 generates preview image data based on the developed image data and displays an image corresponding to the preview image data on the display unit 207 (step S 520 ). The control unit 201 then resets the captured image review time (that is, elapsed time of performing the captured image review). After that, the process returns to step S 505 .
  • step S 505 By repeatedly carrying out the processes in step S 505 to step S 520 in this manner, the user is allowed to set focus information during the captured image review any number of times. Further, when the captured image review has continued for the predetermined time period or longer without the user performing an operation to set focus information, an image recording process is started as described below.
  • step S 507 when in step S 507 , the captured image review has continued for the predetermined time period or longer (YES in step S 505 ), the control unit 201 determines whether or not the JPEG recording mode is set as the recording mode (step S 525 ). When the JPEG recording mode is set as the recording mode (YES in step S 525 ), the control unit 201 determines whether or not there is one or more pieces of focus information (step S 530 ).
  • step S 535 the control unit 201 carries out a refocusing process in which it generates developed image data with all pixels in focus (all-focused image, pan-focus) (step S 535 ). It should be noted that here, the control unit 201 may use the image data generated in step S 405 in FIG. 4 .
  • control unit 201 carries out a process in which it encodes the image data generated in step S 535 into JPEG format (step S 540 ). After that, the process proceeds to step S 570 , as described below.
  • control unit 201 When focus information is set in the JPEG recording mode (YES in step S 530 ), the control unit 201 carries out a process in step S 545 in which it encodes the image data saved in the RAM 203 in step S 515 into JPEG format and generates a JPEG image file (step S 545 ). The control unit 201 then determines whether or not all the RAW data for which the focus information has been set has been encoded into JPEG format (step S 550 ).
  • step S 550 When the control unit 201 determines that all the RAW data for which the focus information has been set has not been encoded into JPEG format (NO in step S 550 ), the process returns to step S 545 . On the other hand, when the control unit 201 determines that all the RAW data for which the focus information has been set has been encoded into JPEG format (YES in step S 550 ), the process proceeds to step S 570 , as described below.
  • one RAW data is subjected to JPEG encodings corresponding in number to the number of pieces of focus information set by the user to generate a JPEG image file.
  • JPEG image file a plurality of JPEG image files corresponding to the number of pieces of focus information are generated.
  • step S 555 the control unit 201 determines whether or not there is one or more pieces of focus information in the RAW recording mode.
  • the control unit 201 determines that there is one or more pieces of focus information (YES in step S 555 ), that is, focus information is set in the RAW recording mode
  • the process proceeds to step S 560 , in which the control unit 201 carries out a process in which it generates a RAW image file and associates a plurality of pieces of the focus information with the RAW image file (step S 560 ).
  • step S 570 the control unit 201 carries out a process in which it generates a RAW image file and associates a plurality of pieces of the focus information with the RAW image file
  • step S 560 even when there is a plurality of pieces of focus information, the plurality of pieces of focus information is associated with one RAW image file.
  • FIG. 6 is a diagram showing an exemplary structure of a RAW image file which is generated in the process in FIGS. 5A and 5B .
  • the RAW image file has a header section 601 and an image data section 602 , and attribute information is recorded in the header section 601 .
  • RAW data obtained by all the ML arrays is recorded in the image data section 602 .
  • shooting date and time information As shown in the figure, for example, shooting date and time information, camera model name, image size, shutter speed, aperture value, ISO sensitivity, shooting mode, focus information arrangement, and other additional information are recorded as the attribute information. Since the focus information arrangement is recorded here, a plurality of pieces of focus information is allowed to be associated with one RAW image file.
  • a focus position as well as a focal length described above are recorded as focus information. Further, information other than a focal length and a focus position may be recorded as the focus information.
  • a focus position means a point designated by the user tapping on it, that is, a position on an image in which there is a desired subject.
  • control unit 201 carries out a process in which it generates a RAW image file (step S 565 ). On this occasion, the control unit 201 sets the focus information arrangement in FIG. 6 to a null.
  • the control unit 201 After the process in step S 540 , S 550 , S 560 , or S 565 , the control unit 201 carries out a process in which it stores the JPEG image file or the RAW image file in the non-volatile recording medium 204 (step S 570 ) such as a memory card. After that, the control unit 201 releases the focus information, the image data, and so on saved in the RAM 203 (step S 575 ). Then, the control unit 201 ends the process of storing focus parameters.
  • the user is allowed to set focus information during the captured image review.
  • the user is thus allowed to perform an operation to set a plurality of pieces of focus information in a sequential shooting process.
  • the image storing process varies with the recording mode (the RAW recording mode or the JPEG recording mode) and focus information.
  • focus information is set through the same operation irrespective of recording mode, and an image file suitable for the recording mode can be easily generated.
  • a developed image file for which focus information is set can be generated with little time and effort.
  • JPEG recording mode is set as the recording mode
  • JPEG image data corresponding in number to the number of pieces of focus information is allowed to be stored.
  • the JPEG recording mode and the RAW recording mode are taken as examples of recording modes, there may be a “RAW+JPEG recording mode” in which a JPEG image file and a RAW image file are recorded at the same shooting process. In this case, that is, when the “RAW+JPEG recording mode” is set, a recording process for both JPEG data and RAW data is carried out.
  • FIG. 1 A description will now be given of a camera according to a second embodiment of the present invention. It should be noted that an arrangement of the camera according to the second embodiment is the same as that of the camera shown in FIGS. 1 and 2 , and an arrangement of the image pickup unit 205 according to the second embodiment is also the same as that of the image pickup unit shown in FIG. 3 .
  • the camera according to the second embodiment has a function of setting focus parameters during live view shooting (that is, before accepting a shooting instruction) in addition to the functions of the camera according to the first embodiment described above.
  • the camera according to the second embodiment also has a function of adding and changing focus information during the captured image review. It should be noted that focus parameters are adjusted using the touch panel.
  • FIG. 7 is a flowchart useful in explaining a shooting process which is carried out by the camera according to the second embodiment of the present invention.
  • the shooting mode is set by placing the mode selection switch 104 on the right side (camera side) as viewed in FIG. 1 as described above.
  • the control unit 201 carries out the processes in steps S 400 to S 430 described above with reference to FIG. 4 .
  • the control unit 201 determines whether or not focus information has been set by user operation (step S 732 ). When the control unit 201 determines that no operation to set focus information has been performed (NO in step S 732 ), the process proceeds to step S 440 described above with reference to FIG. 4 .
  • step S 732 when an operation to set focus information has been performed (YES in step S 732 ), the control unit 201 obtains the focus information set in step S 732 (step S 734 ). After that, the control unit 201 carries out a refocusing process on RAW data based on the focus information to generate a developed image file. The control unit 201 then associates the developed image file and the focus information with each other and saves them in the RAM 203 (step S 736 ).
  • control unit 201 saves the focus information as in-shooting focus information in the RAM 203 .
  • the control unit 201 then carries out a process in which it displays the developed image file generated in step S 736 on the display unit 207 (step S 738 ). On this occasion, the control unit 201 indicates a point tapped on by the user with a box so that a focus point set by the user can be clear. When a plurality of focus points are set, the control unit 201 displays a plurality of boxes on the display unit 207 . After the process in step S 738 , the process proceeds to step S 440 .
  • step S 440 a shooting instruction has been provided, the control unit 201 carries out a process of setting and storing focus parameters, as described below (step S 750 ), and the process proceeds to step S 460 .
  • FIGS. 8A and 8B are flowcharts explaining the process of setting and storing focus parameters in step S 750 in FIG. 7 .
  • FIGS. 8A and 8B the same steps as those in the process of setting and storing focus parameters shown in FIGS. 5A and 5B are designated by the same reference symbols, and description thereof is omitted.
  • the control unit 201 when the user provides a shooting instruction, the control unit 201 starts the process of setting and storing focus parameters. First, the control unit 201 displays image data obtained by shooting on the display unit 207 (step S 800 ). Specifically, immediately after the image is taken, the control unit 201 displays image data obtained by the shooting process on the display unit 207 .
  • control unit 201 displays a focus point set by the user on the display unit 207 with a box.
  • step S 505 focus information has been set by user operation (YES in step S 505 )
  • the control unit 201 obtains the set focus information in step S 510 as described above.
  • the control unit 201 then carries out a refocusing process on RAW data based on the focus information to generate a developed image file.
  • control unit 201 assumes the focus information as post-shooting focus information, associates the developed image file and the post-shooting focus information with each other, and saves them in the RAM 203 (step S 815 ).
  • the control unit 201 then carries out a process in which it displays the developed image file on the display unit 207 . Specifically, the control unit 201 generates preview image data based on the developed image file and displays an image corresponding to the preview image data on the display unit (monitor) 207 (step S 820 ). On this occasion, the control unit 201 resets the captured image review time (that is, elapsed time of performing the captured image review).
  • step S 820 the control unit 201 indicates a focus point set by the user with a box on the display unit 207 so that the set focus point can be clear.
  • the control unit 201 indicates a focus point set at the time of live view shooting (that is, before shooting instruction) with a solid line and indicates a focus point set at the time of the captured image review with a dotted line so that setting timings of focus parameters can be distinguished from each other. After that, the process returns to step S 505 .
  • FIGS. 9A to 9C are views useful in explaining how boxes are displayed by the camera according to the second embodiment of the present invention.
  • FIG. 9A illustrates an exemplary preview image before a shooting instruction in a state where no focus information has been set.
  • FIG. 9B illustrates an exemplary preview image in a case where a focus parameter is set during the live view shooting before a shooting instruction.
  • FIG. 9C illustrates an exemplary preview image in a case where a focus parameter is set during the captured image review after shooting instruction.
  • control unit 201 determines that a focus parameter was set before the shooting instruction and displays a box 903 surrounding the face 902 on the live view image in step S 738 in FIG. 7 (see FIG. 9B ).
  • the control unit 201 determines that a focus parameter was set during the captured image review and displays a box 905 about the mountain 904 on the preview image in step S 820 in FIG. 8A (see FIG. 9C ).
  • control unit 201 displays the box 905 with a dotted line in association with the mountain 904 and displays the box 903 with a solid line so that setting timings of focus information can be distinguished from each other.
  • step S 530 focus information is set in the JPEG recording mode
  • the control unit 201 carries out a process in which it encodes the image data generated in steps S 736 and S 815 into JPEG format to generate a JPEG image file (step S 845 ).
  • the control unit 201 determines whether or not all the image data for which the focus information has been set has been encoded into JPEG format (step S 850 ).
  • step S 850 When the control unit 201 determines that all the image data for which the focus information has been set has not been encoded into JPEG format (NO in step S 850 ), the process returns to step S 845 . On the other hand, when all the image data for which the focus information has been set has been encoded into JPEG format (YES in step S 850 ), the process proceeds to step S 570 described above with reference to FIG. 5B .
  • JPEG encodings corresponding in number to the number of pieces of focus information set by the user is performed to generate a JPEG image file.
  • JPEG image file includes both focus information during the period of live view shooting (that is, before shooting instruction) and focus information during the period of the captured image review.
  • the user is allowed to set focus information at the time of the live view shooting as well (that is, before a shooting instruction is provided).
  • the user is allowed to perform an operation to set a plurality of pieces of focus information.
  • points for which the focus information have been set are indicated with boxes, and moreover, display is controlled such that the boxes are displayed in a different manner according to the setting timings of the focus information.
  • the user can easily determine whether a focus point was set before or after a shooting instruction.
  • focus information is added during the captured image review.
  • the present invention is not limited to this, but during the captured image review, focus information that has already been set is selected, and an operation to change the selected focus information such as an operation to delete the selected focus information or an operation to shift a focus point may be performed.
  • control unit 201 may set focus information by identifying a person or the like.
  • Embodiment(s) of the present invention can also be realized by a computer of a system or apparatus that reads out and executes computer executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be referred to more fully as a ‘non-transitory computer-readable storage medium’) to perform the functions of one or more of the above-described embodiment(s), and/or that includes one or more circuits (e.g., application specific integrated circuit (ASIC)) for performing the functions of one or more of the above-described embodiment(s), and by a method performed by the computer of the system or apparatus by, for example, reading out and executing the computer executable instructions from the storage medium to perform the functions of one or more of the above-described embodiment(s), and/or controlling the one or more circuits to perform the functions of one or more of the above-described embodiment(s).
  • computer executable instructions e.g., one or more programs
  • a storage medium which may also be referred to more fully as a
  • the computer may comprise one or more processors (e.g., central processing unit (CPU), micro processing unit (MPU)) and may include a network of separate computers or separate processors to read out and execute the computer executable instructions.
  • the computer executable instructions may be provided to the computer, for example, from a network or the storage medium.
  • the storage medium may include, for example, one or more of a hard disk, a random-access memory (RAM), a read only memory (ROM), a storage of distributed computing systems, an optical disk (such as a compact disc (CD), digital versatile disc (DVD), or Blu-ray Disc (BD)TM), a flash memory device, a memory card, and the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)
  • Television Signal Processing For Recording (AREA)
US14/669,289 2014-04-02 2015-03-26 Image pickup apparatus generating focus changeable image, control method for image pickup apparatus, and storage medium Active 2035-12-07 US10148861B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2014-076175 2014-04-02
JP2014076175A JP2015198391A (ja) 2014-04-02 2014-04-02 撮像装置、撮像装置の制御方法、およびプログラム

Publications (2)

Publication Number Publication Date
US20150288872A1 US20150288872A1 (en) 2015-10-08
US10148861B2 true US10148861B2 (en) 2018-12-04

Family

ID=53178400

Family Applications (1)

Application Number Title Priority Date Filing Date
US14/669,289 Active 2035-12-07 US10148861B2 (en) 2014-04-02 2015-03-26 Image pickup apparatus generating focus changeable image, control method for image pickup apparatus, and storage medium

Country Status (6)

Country Link
US (1) US10148861B2 (enrdf_load_stackoverflow)
JP (1) JP2015198391A (enrdf_load_stackoverflow)
KR (1) KR101737301B1 (enrdf_load_stackoverflow)
CN (1) CN104980631B (enrdf_load_stackoverflow)
DE (1) DE102015105072B4 (enrdf_load_stackoverflow)
GB (1) GB2524902B (enrdf_load_stackoverflow)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6363889B2 (ja) * 2014-07-01 2018-07-25 キヤノン株式会社 撮像素子、撮像装置およびその制御方法
WO2016125352A1 (ja) 2015-02-02 2016-08-11 富士フイルム株式会社 カメラ装置、撮像システム、制御方法及びプログラム
JP6572107B2 (ja) * 2015-11-19 2019-09-04 キヤノン株式会社 画像処理装置及び画像処理方法
JP6808420B2 (ja) * 2016-09-27 2021-01-06 キヤノン株式会社 撮像素子および撮像装置
JP6627117B1 (ja) * 2018-10-29 2020-01-08 エスゼット ディージェイアイ テクノロジー カンパニー リミテッドＳｚ Ｄｊｉ Ｔｅｃｈｎｏｌｏｇｙ Ｃｏ．，Ｌｔｄ 画像処理装置、撮像装置、移動体、画像処理方法、及びプログラム
CN113114947B (zh) * 2021-04-20 2022-11-01 重庆紫光华山智安科技有限公司 对焦调节方法和装置、电子设备及存储介质
EP4561092A1 (en) * 2023-11-24 2025-05-28 Beijing Xiaomi Mobile Software Co., Ltd. Focus parameter storing and signaling

Citations (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5625415A (en) * 1993-05-20 1997-04-29 Fuji Photo Film Co., Ltd. Apparatus and method for automatic focusing in a camera system
US20020171750A1 (en) * 2001-04-24 2002-11-21 Masatake Kato Camera system, lens apparatus and camera
JP2006189571A (ja) 2005-01-05 2006-07-20 Canon Inc 撮像装置
JP2007004471A (ja) 2005-06-23 2007-01-11 Nikon Corp 画像合成方法及び撮像装置
US20070070238A1 (en) * 2000-01-24 2007-03-29 Masahiko Sugimoto Imaging device, automatic focusing method and recording medium on which a program is recorded
US20080170152A1 (en) * 2007-01-16 2008-07-17 Sony Corporation Image pickup system, image pickup apparatus, and interchangeable lens
US7505674B2 (en) 2002-12-04 2009-03-17 Canon Kabushiki Kaisha Image processing apparatus and method for generating and displaying playlist for image data
US7565056B2 (en) 2002-02-01 2009-07-21 Canon Kabushiki Kaisha Information data processing apparatus
CN101753775A (zh) 2008-12-12 2010-06-23 株式会社其恩斯 成像装置
JP2010212965A (ja) 2009-03-10 2010-09-24 Nikon Corp カメラ
JP2011155696A (ja) 2011-04-27 2011-08-11 Mega Chips Corp 一眼レフデジタルカメラにおける連続撮像方法
CN103327223A (zh) 2012-03-21 2013-09-25 卡西欧计算机株式会社 摄像装置
JP2013247478A (ja) 2012-05-24 2013-12-09 Canon Inc 撮像装置及びその制御方法、プログラム、並びに記憶媒体
US20130329068A1 (en) 2012-06-08 2013-12-12 Canon Kabushiki Kaisha Image processing apparatus and image processing method
JP2013254151A (ja) 2012-06-08 2013-12-19 Canon Inc 画像処理装置および画像処理方法
US20130335618A1 (en) 2012-06-15 2013-12-19 Canon Kabushiki Kaisha Image recording apparatus and image reproducing apparatus
JP2013254432A (ja) 2012-06-08 2013-12-19 Canon Inc 画像処理装置及び画像処理方法
US20140072271A1 (en) 2011-05-30 2014-03-13 Sony Corporation Recording apparatus, recording method, reproduction apparatus, reproduction method, program, and recording reproduction apparatus
JP2014057141A (ja) 2012-09-11 2014-03-27 Canon Inc 画像処理装置、方法およびプログラム、並びに画像処理装置を有する撮像装置

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5898501B2 (ja) 2012-01-13 2016-04-06 キヤノン株式会社 画像処理装置、撮像装置、制御方法、プログラム及び記録媒体
JP6029380B2 (ja) 2012-08-14 2016-11-24 キヤノン株式会社 画像処理装置、画像処理装置を具備する撮像装置、画像処理方法、及びプログラム
JP6355883B2 (ja) 2012-10-10 2018-07-11 株式会社オカムラ 椅子

Patent Citations (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5625415A (en) * 1993-05-20 1997-04-29 Fuji Photo Film Co., Ltd. Apparatus and method for automatic focusing in a camera system
US20070070238A1 (en) * 2000-01-24 2007-03-29 Masahiko Sugimoto Imaging device, automatic focusing method and recording medium on which a program is recorded
US20020171750A1 (en) * 2001-04-24 2002-11-21 Masatake Kato Camera system, lens apparatus and camera
US7565056B2 (en) 2002-02-01 2009-07-21 Canon Kabushiki Kaisha Information data processing apparatus
US9013601B2 (en) 2002-02-01 2015-04-21 Canon Kabushiki Kaisha Information data processing apparatus
US7505674B2 (en) 2002-12-04 2009-03-17 Canon Kabushiki Kaisha Image processing apparatus and method for generating and displaying playlist for image data
US20090142037A1 (en) 2002-12-04 2009-06-04 Canon Kabushiki Kaisha Image processing apparatus and method for generating and displaying playlist for image data
JP2006189571A (ja) 2005-01-05 2006-07-20 Canon Inc 撮像装置
JP2007004471A (ja) 2005-06-23 2007-01-11 Nikon Corp 画像合成方法及び撮像装置
US20080170152A1 (en) * 2007-01-16 2008-07-17 Sony Corporation Image pickup system, image pickup apparatus, and interchangeable lens
CN101753775A (zh) 2008-12-12 2010-06-23 株式会社其恩斯 成像装置
US8581996B2 (en) 2008-12-12 2013-11-12 Keyence Corporation Imaging device
JP2010212965A (ja) 2009-03-10 2010-09-24 Nikon Corp カメラ
JP2011155696A (ja) 2011-04-27 2011-08-11 Mega Chips Corp 一眼レフデジタルカメラにおける連続撮像方法
US20140072271A1 (en) 2011-05-30 2014-03-13 Sony Corporation Recording apparatus, recording method, reproduction apparatus, reproduction method, program, and recording reproduction apparatus
JP2013198016A (ja) 2012-03-21 2013-09-30 Casio Comput Co Ltd 撮像装置
US20130250159A1 (en) 2012-03-21 2013-09-26 Casio Computer Co., Ltd. Image capturing apparatus
CN103327223A (zh) 2012-03-21 2013-09-25 卡西欧计算机株式会社 摄像装置
JP2013247478A (ja) 2012-05-24 2013-12-09 Canon Inc 撮像装置及びその制御方法、プログラム、並びに記憶媒体
US9036072B2 (en) 2012-06-08 2015-05-19 Canon Kabushiki Kaisha Image processing apparatus and image processing method
JP2013254432A (ja) 2012-06-08 2013-12-19 Canon Inc 画像処理装置及び画像処理方法
JP2013254151A (ja) 2012-06-08 2013-12-19 Canon Inc 画像処理装置および画像処理方法
US20130329068A1 (en) 2012-06-08 2013-12-12 Canon Kabushiki Kaisha Image processing apparatus and image processing method
US20150222810A1 (en) 2012-06-08 2015-08-06 Canon Kabushiki Kaisha Image processing apparatus and image processing method
JP2014003404A (ja) 2012-06-15 2014-01-09 Canon Inc 画像記録装置および画像再生装置
US20130335618A1 (en) 2012-06-15 2013-12-19 Canon Kabushiki Kaisha Image recording apparatus and image reproducing apparatus
US9451148B2 (en) 2012-06-15 2016-09-20 Canon Kabushiki Kaisha Image recording apparatus and image reproducing apparatus
JP2014057141A (ja) 2012-09-11 2014-03-27 Canon Inc 画像処理装置、方法およびプログラム、並びに画像処理装置を有する撮像装置
US9571718B2 (en) 2012-09-11 2017-02-14 Canon Kabushiki Kaisha Image processing apparatus, image processing method, non-transitory computer-readable storage medium and image pickup apparatus for processing a picked-up image
US20170126967A1 (en) 2012-09-11 2017-05-04 Canon Kabushiki Kaisha Image processing apparatus, image processing method, non-transitory computer-readable storage medium, and image pickup apparatus for processing a picked-up image

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Office Action in Chinese Patent Application No. 201510155073.2, dated Jul. 17, 2017 (with English translation).

Also Published As

Publication number Publication date
CN104980631A (zh) 2015-10-14
DE102015105072A1 (de) 2015-10-08
CN104980631B (zh) 2018-06-15
KR20150114897A (ko) 2015-10-13
JP2015198391A (ja) 2015-11-09
KR101737301B1 (ko) 2017-05-18
GB201505493D0 (en) 2015-05-13
US20150288872A1 (en) 2015-10-08
GB2524902B (en) 2016-06-08
GB2524902A (en) 2015-10-07
DE102015105072B4 (de) 2022-02-17

Similar Documents

Publication Publication Date Title
US10148861B2 (en) Image pickup apparatus generating focus changeable image, control method for image pickup apparatus, and storage medium
JP5921080B2 (ja) 撮像装置及びその制御方法
US20170302848A1 (en) Photographing method, device and computer storage medium
US8823836B2 (en) Digital photographing apparatus and method of controlling the same
CN103533232A (zh) 图像处理装置以及图像处理方法
US10440252B2 (en) Apparatus and imaging method for setting a target of an image
JP5906023B2 (ja) 撮像装置及びその制御方法
KR20120083085A (ko) 디지털 촬영 장치 및 이의 제어 방법
US9601158B2 (en) Moving image selection apparatus for selecting moving image to be combined, moving image selection method, and storage medium
JP5725965B2 (ja) 撮像装置及びその制御方法
JP5409483B2 (ja) 撮像装置
JP2012235228A (ja) 撮像装置及びその制御方法
JP5381498B2 (ja) 画像処理装置、画像処理プログラムおよび画像処理方法
US10382676B2 (en) Image display apparatus, image capturing apparatus, image display method, and storage medium
US9736380B2 (en) Display control apparatus, control method, and storage medium
JP5742282B2 (ja) カメラ
US10382740B2 (en) Image processing apparatus, method for controlling the same, and image capture apparatus
KR101643614B1 (ko) 복수의 표시부들 각각에 다른 영상을 디스플레이할 수 있는 디지털 영상 신호 처리 장치 및 이의 제어 방법
JP6757245B2 (ja) 動画再生装置、撮像装置、動画再生方法及びプログラム
JP2013183220A (ja) カメラ、画像処理装置
US20160189747A1 (en) Imaging apparatus and control method thereof
JP6424620B2 (ja) 画像生成装置、画像生成方法及びプログラム
JP2009198956A (ja) 撮像装置及びプログラム
JP6511780B2 (ja) 画像取得装置、及びプログラム
KR20110088226A (ko) 영상 처리 방법 및 장치

Legal Events

Date Code Title Description
AS Assignment

Owner name: CANON KABUSHIKI KAISHA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MIKAWA, TAKUMA;REEL/FRAME:036158/0187

Effective date: 20150324

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 4