WO2019039404A1 - IMAGING DEVICE AND IMAGING METHOD - Google Patents

IMAGING DEVICE AND IMAGING METHOD Download PDF

Info

Publication number
WO2019039404A1
WO2019039404A1 PCT/JP2018/030550 JP2018030550W WO2019039404A1 WO 2019039404 A1 WO2019039404 A1 WO 2019039404A1 JP 2018030550 W JP2018030550 W JP 2018030550W WO 2019039404 A1 WO2019039404 A1 WO 2019039404A1
Authority
WO
WIPO (PCT)
Prior art keywords
buffer memory
image data
memory area
signal processing
imaging
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2018/030550
Other languages
English (en)
French (fr)
Inventor
Yuki Kawaguchi
Koji Ozaki
Masaya Kinoshita
Akira Iwase
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Priority to EP18765206.0A priority Critical patent/EP3673645B1/en
Priority to US16/639,334 priority patent/US11503177B2/en
Publication of WO2019039404A1 publication Critical patent/WO2019039404A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/21—Intermediate information storage
    • H04N1/2104—Intermediate information storage for one or a few pictures
    • H04N1/2112—Intermediate information storage for one or a few pictures using still video cameras
    • H04N1/2129—Recording in, or reproducing from, a specific memory area or areas, or recording or reproducing at a specific moment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00912—Arrangements for controlling a still picture apparatus or components thereof not otherwise provided for
    • H04N1/00915—Assigning priority to, or interrupting, a particular operation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/21—Intermediate information storage
    • H04N1/2104—Intermediate information storage for one or a few pictures
    • H04N1/2112—Intermediate information storage for one or a few pictures using still video cameras
    • H04N1/2125—Display of information relating to the still picture recording
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/21—Intermediate information storage
    • H04N1/2104—Intermediate information storage for one or a few pictures
    • H04N1/2112—Intermediate information storage for one or a few pictures using still video cameras
    • H04N1/2137—Intermediate information storage for one or a few pictures using still video cameras with temporary storage before final recording, e.g. in a frame buffer
    • H04N1/2141—Intermediate information storage for one or a few pictures using still video cameras with temporary storage before final recording, e.g. in a frame buffer in a multi-frame buffer
    • H04N1/2145—Intermediate information storage for one or a few pictures using still video cameras with temporary storage before final recording, e.g. in a frame buffer in a multi-frame buffer of a sequence of images for selection of a single frame before final recording, e.g. from a continuous sequence captured before and after shutter-release
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/21—Intermediate information storage
    • H04N1/2104—Intermediate information storage for one or a few pictures
    • H04N1/2112—Intermediate information storage for one or a few pictures using still video cameras
    • H04N1/215—Recording a sequence of still pictures, e.g. burst mode
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N1/32101—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32144—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/61—Control of cameras or camera modules based on recognised objects
    • H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/633—Control of cameras or camera modules by using electronic viewfinders for displaying additional information relating to control or operation of the camera
    • H04N23/634—Warning indications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2101/00—Still video cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/21—Intermediate information storage
    • H04N2201/218—Deletion of stored data; Preventing such deletion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00—Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/32—Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device, e.g. between a still-image camera and its memory or between a still-image camera and a printer device
    • H04N2201/3201—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N2201/3212—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to a job, e.g. communication, capture or filing of an image
    • H04N2201/3219—Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of data relating to a job, e.g. communication, capture or filing of an image of a job status, e.g. successful execution

Definitions

  • the present technique relates to an imaging device and an imaging method, and more particularly, to a technique for processing a series of picture data that is continuously acquired, such as continuous shooting of still pictures and moving picture imaging.
  • An imaging device having a function of continuously performing still picture imaging as so-called continuous shooting imaging is widely known. Particularly, in the case of an imaging device capable of high-precision picture imaging, it takes a relatively long time to complete writing of a large number of picture data obtained by continuous shooting on a recording medium. Because of this, in a signal processing unit in the imaging device, processing is progressed while a series of picture data is temporarily saved in a buffer memory.
  • PTL 1 and PTL 2 Techniques related to an imaging device having a continuous shooting function is disclosed in PTL 1 and PTL 2.
  • a technique in which imaged pictures obtained by continuous shooting is temporarily stored in a buffer memory for display such that pictures selected by a user are continuously saved in a recording medium and the remaining pictures are deleted is disclosed in PTL 1.
  • a technique in which a preliminary area is provided as a buffer memory used for continuous shooting and, according to circumstances, the preliminary area is used to deal with high-speed continuous shooting is disclosed in PTL 2.
  • an imaging device including: a signal processing unit configured to cause a series of picture data being continuously acquired to be temporarily stored in a buffer memory area in a signal processing process, read out the series of picture data from the buffer memory area, and perform a subsequent signal processing; and a control unit configured to perform control for deleting at least a part of the picture data stored in the buffer memory area, on a basis of detecting a predetermined operation while the signal processing is being performed on the series of picture data by the signal processing unit.
  • the signal processing unit a process of reading out picture data from an image sensor, a process of developing picture data, a process of writing picture data on a recording medium, or the like is performed.
  • the control unit may cause the deletion of the picture data stored in the buffer memory area to be executed in a case where a storable capacity of the buffer memory area is less than a predetermined amount. Even in a case in which it is requested to delete picture data buffered in the buffer memory area by predetermined operation by the user, it is unnecessary to delete the picture data when the remaining capacity is sufficient to store the picture data. Therefore, actual picture data deletion is performed in a case in which the remaining capacity is less than a predetermined amount.
  • the control unit may cause the deletion of the picture data stored in the buffer memory area to be executed in accordance with detecting an imaging starting operation for the series of picture data in addition to detecting the predetermined operation.
  • the deletion control is not performed immediately by only detecting operation of a predetermined operating element, which is an instruction to delete picture data, and the deletion is executed in a case in which there is an imaging start operation of a series of picture data immediately afterwards.
  • control unit may cause the deletion of the picture data stored in the buffer memory area to be executed in accordance with only a condition of detecting the predetermined operation. That is, deletion of picture data from the buffer memory area is executed impromptu in response to detection of a predetermined operation.
  • a plurality of buffer memory areas in which the signal processing unit buffers picture data of different signal processing steps may be prepared, and in accordance with the predetermined operation, the control unit may cause the signal processing unit to execute complete or partial deletion of the picture data stored in the plurality of buffer memory areas.
  • picture data is buffered for each of a plurality of steps in a signal processing process in some cases.
  • the steps of the signal processing process are, for example, a step of performing a process of reading out picture data from an imaging element unit (imager), a step of performing a process of developing picture data, a step of performing a process of outputting picture data to a recording medium, and the like.
  • a restart such as continuous shooting immediately afterwards, in some cases. Therefore, buffer data deletion is performed for a plurality of buffer memory areas.
  • a plurality of buffer memory areas in which the signal processing unit buffers picture data of different signal processing steps may be prepared, and in accordance with the predetermined operation, the control unit may cause the signal processing unit to execute complete or partial deletion of the picture data stored in a part of the buffer memory areas. That is, in the case in which picture data is buffered for each of the plurality of steps in the signal processing process, buffer data deletion is performed for only some of the plurality of buffer memory areas.
  • the part of the buffer memory areas may be a first buffer memory area that is used in a signal processing process in the signal processing unit.
  • buffer data deletion is performed in a buffer memory area in which buffer is performed initially.
  • the control unit may cause picture data whose imaging time is the oldest to be deleted first from among the picture data stored in the buffer memory area. For example, a necessary amount of data is selected and deleted from picture data stored in a buffer memory area in order from the oldest imaging time.
  • the control unit may cause picture data whose imaging time is the newest to be deleted first from among the picture data stored in the buffer memory area. For example, a necessary amount of data is selected and deleted from picture data stored in a buffer memory area in order from the newest imaging time.
  • the control unit may cause thinning deletion to be performed for a series of picture data in order of imaging time stored in the buffer memory area.
  • the control unit may cause a picture to be deleted to be selected from among the picture data stored in the buffer memory area using a predetermined condition and be deleted. From among pieces of picture data stored in a buffer memory area, picture data to be deleted is selected by setting conditions.
  • control unit in a case where the control unit causes deletion of the picture data stored in the buffer memory area to be executed, the control unit may cause the deletion of the picture data to be executed except for picture data being read out from the buffer memory area. For picture data being read out for signal processing, signal processing is executed without change.
  • the control unit may cause the deletion of the picture data stored in the buffer memory area to be executed by selecting one of a plurality of deletion processing methods.
  • a deletion processing method it is possible to select one of a plurality of deletion processing methods such as complete deletion, deletion in order from the oldest picture data, deletion in order from the newest picture data, thinning deletion, and deletion by selection under predetermined conditions.
  • control unit may perform control for a display indicating a progress of signal processing to be executed by a display unit during a period until signal processing for the series of picture data is completed by the signal processing unit. For example, in a situation where signal processing is not completed yet for a while after the user has finished the imaging operation, a display indicating the progress of the signal processing is executed for the user.
  • a picture on which processing for recording on a recording medium has been completed may be presented from among the series of picture data. From among a series of picture data by continuous shooting imaging or super slow moving picture imaging, a picture on which processing for recording on a recording medium has been completed is presented.
  • the series of picture data may be a plurality of pieces of still picture data input by a continuous shooting imaging operation.
  • continuous shooting imaging a situation in which the capacity of a buffer memory area is pressed such that it is not possible to immediately shift to the next continuous shooting imaging or super slow moving picture imaging occurs. That is, in the case of performing continuous shooting imaging, data deletion in the buffer memory area is effective.
  • the series of picture data may be picture data of a plurality of frames input by a moving picture imaging operation of a high frame rate switched from a normal imaging frame rate.
  • a high frame rate moving picture refers to, for example, a super slow moving picture.
  • an operating element for the predetermined operation may be provided in a state in which the operating element is unable to be operated simultaneously with an operating element for an imaging starting operation with one hand.
  • An operating element for instructing data deletion in a buffer memory area is arranged, for example, at a location spaced apart from an operating element for imaging starting operation so that the operating elements is unable to be operated simultaneously with one hand.
  • an operating element for the predetermined operation may be a button-type operating element. That is, it is assumed to be an operating element with simple operability.
  • an imaging method of an imaging device including a signal processing unit configured to cause a series of picture data being continuously acquired to be temporarily stored in a buffer memory area in a signal processing process, read out the series of picture data from the buffer memory area, and perform a subsequent signal processing, the imaging method including: a procedure of detecting a predetermined operation while signal processing is being performed by the signal processing unit on a series of picture data obtained by an imaging operation; and a procedure of causing deletion of at least a part of the picture data stored in the buffer memory area to be executed on a basis of the detecting of the predetermined operation.
  • the storable capacity of a buffer memory area may be secured even immediately after continuous shooting.
  • the capacity of a buffer memory can be secured in accordance with a user's intention even in a situation in which a large amount of buffer memory capacity is used due to continuous shooting or the like and thus it is not possible to start the next continuous shooting or the like, a state in which continuous shooting or the like is possible impromptu can be reached. In this way, a user can execute continuous shooting imaging or the like without missing out an imaging opportunity.
  • the advantageous effects described herein are not necessarily limited, and may be any of the effects described in the present disclosure.
  • FIG. 1 is an explanatory diagram of an exterior of an imaging device according to an embodiment of the present technique.
  • FIG. 2 is a block diagram of an imaging device according to an embodiment.
  • FIG. 3 is an explanatory diagram of an example of signal processing through a single buffer memory according to an embodiment.
  • FIG. 4 is an explanatory diagram of an example of signal processing through two buffer memories according to an embodiment.
  • FIG. 5 is an explanatory diagram of an example of signal processing through three buffer memories according to an embodiment.
  • FIG. 6 is an explanatory diagram of an example of picture data to be deleted according to an embodiment.
  • FIG. 7 is an explanatory diagram of an example of picture data to be deleted according to an embodiment.
  • FIG. 8 is an explanatory diagram of an elapsed picture according to an embodiment.
  • FIG. 9 is a flowchart of continuous shooting control according to a first embodiment.
  • FIG. 10 is a flowchart of continuous shooting control according to a second embodiment.
  • FIG. 11 is a flowchart of continuous shooting control according to a third embodiment.
  • FIG. 12 is a flowchart of an imaging sequence according to a third embodiment.
  • FIG. 13 is a flowchart of buffer deletion according to an embodiment.
  • FIG. 14 is a flowchart of buffer deletion according to an embodiment.
  • FIG. 15 is a flowchart of buffer deletion according to an embodiment.
  • Imaging device Configuration of imaging device> ⁇ 2. Examples of processing various signals by signal processing unit> ⁇ 3. Outline of buffer data deletion by forced return> ⁇ 4. Display of process progress> ⁇ 5. Structure for operation> ⁇ 6. Processing example> 6-1: First embodiment 6-2: Second embodiment 6-3: Third embodiment ⁇ 7. Application to super slow moving picture imaging> ⁇ 8. Summary and modifications> Note that in description, "imaging” indicates an operation in which light from a subject is photoelectrically converted by an imaging element (an image sensor 12 which will be described below) and acquired as picture data constituting a still picture or a moving picture, in accordance with a release operation by a user or an automatic release operation.
  • imaging element an image sensor 12 which will be described below
  • imaging permanently recording imaged picture data in a recording medium such as a memory card through necessary signal processing
  • imaging recording a series of operations of acquiring (imaging) picture data of a subject and recording the picture data in a recording medium through signal processing
  • a of FIG. 1 and B of FIG. 1 illustrate an example of an exterior of an imaging device 1 according to an embodiment.
  • a of FIG. 1 is a perspective view as seen from the front side
  • B of FIG. 1 is a rear view. Note that description will be given by assuming that a subject side is the front side (front side), and a side opposite a cameraman is the rear side (rear side).
  • the imaging device 1 is a so-called digital camera and is capable of imaging recording a still picture or a moving picture.
  • the imaging device 1 of the present embodiment is capable of continuous still picture imaging recording in which continuous shooting, i.e., continuous imaging of a plurality of still pictures, is performed and the imaged still pictures are recorded in a recording medium. Continuously reading out picture data from the image sensor 12 during continuous shooting is referred to as "continuous shooting imaging" in some cases.
  • the imaging device 1 of the present embodiment has a function of super slow moving picture imaging recording for performing high frame rate imaging in some cases.
  • the super slow moving picture imaging recording refers to an operation in which picture data read out from an image sensor at a very high speed is temporarily stored in a buffer memory, and the picture data is developed at normal speed to create a slow motion moving picture and record the created slow motion moving picture in a recording medium
  • the operation of reading out picture data from the image sensor 12 as a process of the super slow moving picture imaging recording is referred to as "super slow moving picture imaging" in some cases.
  • a lens barrel 8 incorporating a lens optical system is provided at a front side of the imaging device 1, and a grip portion 9 is formed for a user to easily hold the lens barrel 8 with right hand with the lens barrel 8 facing a subject.
  • a release button 2 is arranged at an upper side of the grip portion 9. The arrangement of the release button 2 is set at a position where the user can easily operate the release button 2 with the index finger or the like with the right hand gripping the grip portion 9.
  • a forced return button 3 is provided at a position on a main body behind the lens barrel 8.
  • the forced return button 3 is an operating element operated by the user to forcibly return to a state in which continuous shooting or super slow moving picture imaging is possible. A processing operation according to the operation of the forced return button 3 will be described below.
  • various operating elements as an operation button 4 or an operation dial 5 are provided at a rear side or an upper surface of the imaging device 1.
  • various operations such as a zoom operation, a mode setting operation, a function selection operation, a menu operation, an item selection operation, and a reproduction related operation are made possible.
  • a display unit 17 and an electronic viewfinder 19 are provided for the user to check a through picture (a monitoring picture during recording standby), an imaged recorded picture, a reproduced picture, or the like.
  • a touch panel may be arranged on the display unit 17 so that a touch operation is possible.
  • FIG. 2 illustrates an internal configuration example of the imaging device 1.
  • the imaging device 1 includes an optical system 11, an image sensor 12, an optical system drive unit 13, a sensor unit 14, a recording unit 15, a communication unit 16, a display unit 17, an operation unit 18, an electronic viewfinder 19, a signal processing unit 20, and a control unit 30.
  • the optical system 11 includes a cover lens, a focus lens, a zoom lens, a condenser lens, a diaphragm mechanism, and the like. By the optical system 11, light from a subject is condensed on the image sensor 12.
  • the image sensor 12 has, for example, an imaging element such as a charge-coupled device (DDC) type imaging element and a complementary metal oxide semiconductor (CMOS) type imaging element, and a peripheral circuit system configured to read out a charge from the imaging element.
  • a signal read out from the image sensor 12 is supplied to the signal processing unit 20 as an imaged picture signal of a subject.
  • a signal transmission operation and an electronic shutter speed in the image sensor 12 are controlled by the control unit 30.
  • the optical system drive unit 13 drives the focus lens in the optical system 11 on the basis of control of the control unit 30 and executes a focusing operation. Also, the optical system drive unit 13 drives the diaphragm mechanism in the optical system 11 on the basis of control of the control unit 30 to execute exposure adjustment or drives the zoom lens to execute the zoom operation.
  • the signal processing unit 20 is configured as a picture processing processor by, for example, a digital signal processor (DSP) or the like.
  • the signal processing unit 20 performs various signal processing on a digital signal (imaged picture signal) from the image sensor 12.
  • the signal processing unit 20 performs a correlated double sampling (CDS) process, an automatic gain control (AGC) process, or the like on an electrical signal obtained by photoelectric conversion in the image sensor 12 and further performs an analog/digital (A/D) conversion process.
  • CDS correlated double sampling
  • A/D automatic gain control
  • the signal processing unit 20 performs various processes while successively buffering imaged signals (picture data) converted into digital data.
  • the signal processing unit 20 performs a noise removal process, a Y/C process, a color correction process, an edge enhancement process, a resolution conversion process, a codec process as recording formatting, data pressing, and the like on the picture data.
  • the image sensor 12 performs a process up to an A/D converter, and the signal processing unit 20 receives an imaged signal (picture data) converted into digital data.
  • the recording unit 15 stores picture data as a still picture or a moving picture generated by the signal processing unit 20 in a recording medium 15a, on the basis of control of the control unit 30.
  • the recording medium 15a indicates a recording medium that records picture data permanently (instead of temporarily).
  • the recording medium 15a may be detachable like a memory card, an optical disc, a magnetic tape or the like, or may be fixed like a hard disk drive (HDD), a semiconductor memory module, or the like.
  • the communication unit 16 performs wired or wireless communication with an external device (not illustrated), on the basis of control of the control unit 30. That is, the communication unit 16 performs transmission of imaged picture data, picture data read out from the recording medium 15a, additional information of such pieces of picture data, and other control data to an external device or receives various data from the external device. In this way, the imaging device 1 outputs picture data or the like to the external device (not illustrated) for the imaged picture data to be reproduced or edited in the external device.
  • a communication system such as a wireless communication standard such as Wi-Fi (registered trademark) or Bluetooth (registered trademark).
  • the communication unit 16 may perform wired communication using a connector cable such as a Universal Serial Bus (USB) cable or the like.
  • the communication unit 16 may also perform communication by various networks such as the Internet, a home network, a local area network (LAN) or the like and perform transmission and reception of various pieces of data to and from a server, a terminal, or the like on the network.
  • a connector cable such as a Universal Serial Bus (USB) cable or the like.
  • USB Universal Serial Bus
  • the communication unit 16 may also perform communication by various networks such as the Internet, a home network, a local area network (LAN) or the like and perform transmission and reception of various pieces of data to and from a server, a terminal, or the like on the network.
  • LAN local area network
  • the operation unit 18 comprehensively shows an input function for inputting a user's operation. That is, operating elements such as the above-described release button 2, forced return button 3, operation button 4, operational dial 5, and the like are collectively shown as the operation unit 18. Further, even in a case in which other operation input units such as a touch panel or a reception unit of a remote controller are provided, these are also one mode of the operation unit 18. Operation information obtained by the operation unit 18 is supplied to the control unit 30. The control unit 30 performs necessary control in accordance with the operation information.
  • the display unit 17 is a display unit configured to perform various displays to the user, and for example, as illustrated in B of FIG. 1, the display unit 17 is formed with a display device such as a liquid crystal display (LCD) or an organic electro-luminescence (EL) display formed on a housing of the imaging device 1.
  • the electronic viewfinder 19 is also formed using an LCD, an organic EL display, or the like, and performs complementary presentation of pictures or information to the user with the display unit 17.
  • Picture data of an imaged picture whose resolution has been converted for display is supplied from the signal processing unit 20 to the display unit 17 or the electronic viewfinder 19.
  • the display unit 17 or the electronic viewfinder 19 displays the picture data of the imaged picture. In this way, the user can check a so-called through picture (a monitoring picture of a subject).
  • picture data reproduced in the recording unit 15 may be supplied to the display unit 17 or the electronic viewfinder 19 via the signal processing unit 20, and by the picture data being displayed, the user can check a reproduced picture of an imaged recorded picture.
  • the display unit 17 or the electronic viewfinder 19 also causes display of various operation menus, icons, messages, etc. i.e., graphical user interface (GUI), on a screen on the basis of an instruction of the control unit 30.
  • GUI graphical user interface
  • an optical finder is provided instead of the electronic viewfinder 19 in the imaging device 1 in some cases.
  • the imaging device 1 is a so-called single lens reflex camera in some cases.
  • the sensor unit 14 comprehensively shows various sensors. Specifically, a gyro sensor for detecting the attitude of the imaging device 1 or, for example, a camera shake, an acceleration sensor for detecting movement acceleration and gravidity direction of the imaging device 1, and the like are provided in some cases. As the sensor unit 14, an illuminance sensor for detecting external illuminance for exposure adjustment or the like, a distance measuring sensor for measuring a subject distance, and the like may be provided. The various sensors of the sensor unit 14 transmit detection signals to the control unit 30. The control unit 30 can perform various controls using information detected by the sensor unit 14.
  • the control unit 30 is configured, for example, by a microcomputer (arithmetic processing device) including a central processing unit (CPU), a read-only memory (ROM), a random access memory (RAM), a flash memory, and the like.
  • the CPU executes a program stored in the ROM, the flash memory, or the like thereby totally controlling the entire imaging device 1.
  • the RAM is used as a work area during various data processing of the CPU and is used for temporarily storing data, programs, and the like.
  • the ROM or the flash memory nonvolatile memory
  • OS operating system
  • the control unit 30 controls operation of each unit, such as instructions of various signal processing in the signal processing unit 20, an imaging operation according to user operation, a storage reproduction operation in the recording unit 15, a camera operation such as focusing/exposure adjustment, an exposure/reading-out operation of the image sensor 12, a communication operation with an external device by the communication unit 16, and a display operation in the display unit 17 or the electronic viewfinder 19.
  • the signal processing unit 20 and the control unit 30 may be integrated as a one-chip microcomputer or the like.
  • the control unit 30 corresponds to the "control unit” mentioned in the claims, for example, the DSP functioning as the signal processing unit 20 or the CPU in the microcomputer may also be assumed as corresponding to the "control unit” mentioned in the claims.
  • FIGS. 3, 4, and 5 mainly show processing processes in the signal processing unit 20 in the configuration of FIG. 2.
  • a first processing unit 41 and a second processing unit 42 show arithmetic processing at each step executed in the signal processing unit 20 formed by a DSP, a microcomputer, or the like.
  • the first processing unit 41 and the second processing unit 42 do not refer to separate units as hardware, and show a signal processing process.
  • the first processing unit 41 and the second processing unit 42 may also be configured as separate units as hardware.
  • the signal processing unit 20 performs signal processing by the first processing unit 41 on a signal supplied from the image sensor 12, and buffers (temporarily stores) the signal in a buffer memory area 51.
  • the buffer memory area 51 is a buffer for buffering a difference in processing speeds of the first processing unit 41 and the second processing unit 42, which process each step in the signal processing unit 20.
  • buffer data BDT picture data buffered in the buffer memory area
  • buffer data BDT1 picture data of the first buffer 51
  • buffer memory areas for example, a storage area inside a chip as a DSP or a microcomputer functioning as the signal processing unit 20 may be used, or a storage area of a memory element outside the chip may be used.
  • buffer memory areas such as the first buffer 51 may be fixedly determined as the address range of the RAM, or may be one to which the address range is variably assigned.
  • the picture data (buffer data BDT1) temporarily stored in the first buffer 51 is sequentially read out in accordance with the processing timing of the second processing unit 42, and signal processing is performed thereon by the second processing unit 42.
  • the picture data processed in the second processing unit 42 is transmitted to the recording unit 15 and recorded in the recording medium 15a as still picture data CS or moving picture data MV.
  • the still picture data CS is, for example, a normal one-shot imaged still picture or a plurality of a series of still picture data obtained by continuous shooting.
  • the moving picture data MV is moving picture data obtained by normal moving picture imaging recording or moving picture data as a super slow motion moving picture.
  • the control unit 30 performs an instruction related to signal processing of the first processing unit 41 and the second processing unit 42 or control related to erasing of the buffer data BDT of the first buffer 51 in accordance with operation information from the operation unit 18 or operation programs.
  • a first buffer 51 and a second buffer 52 are used to buffer the processing speed difference in the signal processing unit 20.
  • signal processing is performed on a signal supplied from the image sensor 12 by the first processing unit 41, and the processed signal is temporarily stored in the first buffer 51.
  • the buffer data BDT1 temporarily stored in the first buffer 51 is sequentially read out in accordance with the processing timing of the second processing unit 42, subjected to signal processing by the second processing unit 42, and then temporarily stored in the second buffer 52.
  • Buffer data BDT2 temporarily stored in the second buffer 52 is sequentially read out in accordance with the processing timing of the third processing unit 43. Then, picture data processed by the third processing unit 43 is transmitted to the recording unit 15 and recorded on the recording medium 15a as the still picture data CS or the moving picture data MV.
  • the control unit 30 performs an instruction related to signal processing of the first processing unit 41, the second processing unit 42, and the third processing unit 43, or control related to erasing of the buffer data BDT of the first buffer 51 and the second buffer 52.
  • a RAM or the like inside and outside a chip constituting the signal processing unit 20 is used as the first buffer 51 and the second buffer 52
  • a common RAM may be used or separate RAMs may be used for the first buffer 51 and the second buffer 52.
  • a first buffer 51, a second buffer 52, and a third buffer 53 are used to buffer the processing speed difference in the signal processing unit 20.
  • the signal processing unit 20 performs signal processing on a signal supplied from the image sensor 12 by the first processing unit 41 and temporarily stores the processed signal in the first buffer 51.
  • the buffer data BDT1 temporarily stored in the first buffer 51 is sequentially read out in accordance with the processing timing of the second processing unit 42, subjected to signal processing by the second processing unit 42, and then temporarily stored in the second buffer 52.
  • the buffer data BDT2 temporarily stored in the second buffer 52 is sequentially read out in accordance with the processing timing of the third processing unit 43, subjected to signal processing by the third processing unit 43, and then temporarily stored in the third buffer 53.
  • Buffer data BDT3 temporarily stored in the third buffer 53 is sequentially read out in accordance with the processing timing of a fourth processing unit 44. Then, picture data processed by the fourth processing unit 44 is transmitted to the recording unit 15 and recorded on the recording medium 15a as the still picture data CS or the moving picture data MV.
  • the control unit 30 performs an instruction related to signal processing of the first processing unit 41, the second processing unit 42, the third processing unit 43, and the fourth processing unit 44 or control related to erasing of the buffer data BDT of the first buffer 51, the second buffer 52, and the third buffer 53.
  • a RAM or the like inside and outside a chip constituting the signal processing unit 20 is used as the first buffer 51, the second buffer 52, and the third buffer 53
  • a common RAM may be used or separate RAMs may be used for the first buffer 51, the second buffer 52, and the third buffer 53.
  • FIG. 4 Specific examples of the first processing unit 41, the second processing unit 42, the third processing unit 43, and the fourth processing unit 44 that perform an exchange of picture data through buffering as shown in FIGS. 3, 4, and 5 are not limited, and although those are determined according to various processing contents or processing speeds, in the case of FIG. 4, the following processing classification may be considered as an example.
  • the processing of the first processing unit 41 is referred to as "read-out processing.” That is, the processing includes reading out a photoelectrically-converted signal from the image sensor 12, converting the read-out signal into digital data, and generating picture data as a raw picture. As the buffer data BDT1 of the first buffer 51, raw picture data is assumed.
  • the processing of the second processing unit 42 is referred to as "development processing.” That is, processing in which necessary signal processing such as a noise removal process, a Y/C process, a color correction process, an edge enhancement process, a resolution conversion process, and the like are performed on raw picture data to generate developed picture data is assumed.
  • As the buffer data BDT2 of the second buffer 52 picture data after development is assumed. Note that processes of recording formatting and pressing (for example, JPEG codec and the like) of picture data are included in the processing of the second processing unit 42 in some cases. In that case, the buffer data BDT2 of the second buffer 52 is, for example, JPEG picture data or the like.
  • the processing of the third processing unit 43 is referred to as "media output processing.” That is, the processing is a process of transmitting and outputting picture data for recording on the recording unit 15.
  • the processing also includes a process of writing on the recording medium 15a in some cases.
  • the processing also includes a process of recording formatting and pressing (for example, JPEG codec and the like) of picture data in some cases.
  • a read-out processing speed is generally faster than a development processing speed, even when the development processing is executed in parallel with the read-out processing, the first buffer 51 becomes full at some point, and the first processing unit 41 is unable to perform further read-out processing. In that case, the next reading-out is unable to be performed until the development of the buffer data BDT1 is completed in the second processing unit 42, and since it is only necessary to read out at a slow speed at the expense of the original reading-out speed, the imaging interval is extended, and continuous shooting at the maximum speed is unable to be performed.
  • the buffer data BDT1 of the first buffer 51 is subjected to development processing by the second processing unit 42, temporarily stored in the second buffer 52, read out by the third processing unit 43, and written on the recording medium 15a.
  • the time until the first buffer 51 becomes full can be extended.
  • the second buffer 52 becomes full at some point, and it is forced to wait for the development processing.
  • the buffer data BDT1 is unable to be developed on the first buffer 51-side and is accumulated, and finally, since the first processing unit 41 is unable to read out data from the image sensor 12, continuous shooting at the maximum speed is unable to be performed.
  • the user immediately after continuous shooting, the user has to wait until continuous shooting at the maximum speed (or continuous shooting itself) becomes possible.
  • the user may encounter a scene that he or she wants to image even during this standby time in some cases. However, in that case, if the user has only to wait until imaging becomes possible, the user loses an imaging opportunity.
  • a structure for forcibly deleting buffer data BDT is prepared, the picture data before the completion of the recording is deleted by the user's intention, and the buffer memory area is freed to return to continuous shooting. That is, returning to continuous shooting is possible in response to a case in which the user wants to take a picture of the current scene even if the user has to discard a picture taken immediately before.
  • the forced return button 3 is provided as illustrated in FIG. 1.
  • the mode and the structure of the operating element are not limited to the button type, here, it is assumed that the operating element is an operation button.
  • the control unit 30 instructs buffer memory areas of the first buffer 51 and the second buffer 52 to be forcibly open upon receiving the operation information.
  • the upper part of A of FIG. 6 shows a state in which pieces of picture data SG1 to SG8 are temporarily stored as the buffer data BDT.
  • the buffer memory area is full due to the pieces of picture data SG1 to SG8.
  • the number of pieces of picture data being 8 is merely a simplified example for the sake of description. All of the pieces of picture data are deleted as shown in the lower part of the same drawing (broken lines indicate that the pieces of data are deleted). As a result, the buffer memory area is open, and new buffering is possible.
  • buffers can be considered as buffers to be subjected to deletion of buffer data BDT.
  • complete deletion of the pieces of buffer data BDT1 and BDT2 may be performed for both the first buffer 51 and the second buffer 52 in the case of FIG. 4.
  • complete deletion of the buffer data BDT1 may be performed for only the first buffer 51, or complete deletion of the buffer data BDT2 may be performed for only the second buffer 52.
  • the user may set buffers to be subjected to deletion or whether all buffers or some of the buffers will be subjected to deletion. Note that in the case of FIG. 5 as well, whether all buffers or some of the buffers will be subjected to deletion may be considered. Even in a case in which partial deletion, instead of complete deletion, are subjected to deletion, which will be described below, buffers to be subjected to deletion may be considered in various ways.
  • the buffer is emptied instead of giving up picture data that is imaged and unrecorded, so that it is possible to give the user an opportunity for continuous shooting imaging.
  • the deletion of the buffer data BDT it may be partial deletion rather than complete deletion as described above.
  • the complete deletion allows the user to easily understand a situation of the imaging device 1 and is suitable for starting continuous shooting with the highest performance, but by the partial deletion, an appropriate deletion method that is likely to leave valuable pictures may be provided to the user. In that sense, it is also desirable to allow the user to select whether to perform the complete deletion or partial deletion which will be described below, and further, a deletion method with which deletion is to be performed.
  • B of FIG. 6 shows an example in which deletion is performed in order from the oldest data.
  • the upper part of B of FIG. 6 shows a state in which pieces of picture data SG1 to SG8 are temporarily stored in that order as the buffer data BDT.
  • the pieces of picture data are deleted in order from the oldest picture data, for example, the pieces of picture data SG1, SG2, and SG3 are deleted in that order (shown with broken lines).
  • picture data that has been already provided to signal processing of a subsequent stage may remain in a buffer memory area in some cases.
  • the pieces of picture data SG4 to SG8 still remain in the buffer memory area, buffering corresponding to new continuous shooting is possible by securing a storable capacity of a predetermined amount of more. Accordingly, it is conceivable that the number of pieces of picture data to be deleted in order from the oldest one is determined in accordance with, for example, the time until a storable capacity of a predetermined amount or more can be secured in the buffer memory area.
  • a of FIG. 7 illustrates an example of deleting in order from the newest data.
  • the upper part of A of FIG. 7 shows a state in which pieces of picture data SG1 to SG8 are temporarily stored in that order as the buffer data BDT.
  • the pieces of picture data are deleted in order from the newest picture data, for example, the pieces of picture data SG8, SG7, and SG6 are deleted in that order (shown with broken lines).
  • the pieces of picture data SG1 to SG5 still remain in the buffer memory area, new buffering is possible by securing a storable capacity.
  • the number of pieces of picture data to be deleted in order from the newest one is determined in accordance with, for example, the time until a storable capacity of a predetermined amount or more can be secured in the buffer memory area.
  • the new data is a picture just before the end of continuous shooting, and for the user, there is a possibility that the new data is a picture after finishing taking the best scene (a situation in which the user attempts to end continuous shooting). Therefore, it is conceivable that the user often has a small feeling of resistance for deletion of a new picture.
  • FIG. 7 illustrates an example in which, among a series of picture data taken by continuous shooting, thinning deletion is performed by, for example, for every other piece of picture data.
  • the upper part of A of FIG. 7 illustrates a state in which a series of picture data SG1 to SG5 taken by a first continuous shooting and a pieces of picture data SG6 to SG8 (hatched) taken by a second continuous shooting are temporarily stored as the buffer data BDT.
  • thinning deletion is performed from each series of picture data (shown with broken lines). That is, from among the series of picture data SG1 to SG5 taken by the first continuous shooting, the pieces of picture data SG2 and SG4 are deleted. Also, from among the pieces of picture data SG6 to SG8 taken by the second continuous shooting, the picture data SG7 is deleted.
  • a series of picture data to be thinned or an interval thereof may be considered in various ways. For example, it is sufficient to select an appropriate deletion picture so that a storable capacity of a predetermined amount or more is secured in a buffer memory area. Even when a series of picture data taken by one-time continuous shooting are, for example, thinned and deleted, sufficient quality may be maintained with the remaining series of picture data in some cases, such as a case in which the continuous shooting speed is fast. In such a case, thinning deletion is preferable in terms of maintaining taken pictures as much as possible.
  • C of FIG. 7 is an example in which, from among pieces of buffer data BDT, a picture to be left and a picture to be deleted are selected under predetermined conditions, and the pieces of buffer data BDT selected as pictures to be deleted are deleted.
  • the upper part of C of FIG. 7 illustrates a state in which pieces of picture data SG1 to SG8 are temporarily stored as the buffer data BDT.
  • the other pieces of picture data SG1, SG2, and SG4 to SG8 are deleted.
  • a storable capacity of a predetermined amount or more is secured in the buffer memory area.
  • Predetermined conditions in the case of selecting pictures to be deleted as above may be considered in various ways.
  • the predetermined conditions may be conditions based on a result of picture recognition/detection processing, conditions of an imaging operation state, and the like. For example, it is preferable to select and delete data with high probability of failure using the following conditions.
  • a contrast value of picture data is detected as a detection value for AF control.
  • a detection value for AF control According to the detection value, a focusing state of the picture can be determined. Therefore, it is possible to determine a contrast value of each picture data as the buffer data BDT and perform selection so that picture data in a good focusing state is left, and picture data in a worse focusing state (for example, a picture imaged in the AF control process) is deleted.
  • Subject picture detection is performed for each picture data as buffer data BDT, and whether a facial picture is detected is determined. Leaving pictures from which a face is detected and setting pictures from which a face is not detected as pictures to be deleted may be considered. As a result, it is possible to leave pictures in which a subject person is clearly shown. Note that in a case in which a face is able to be detected from a plurality of pictures, picture data to be left may be further narrowed down with conditions such as the size of the face, the position of the face, the relationship between the position of the face and the focus position, and the like to increase the number of pictures to be deleted so that a predetermined storable capacity is secured.
  • Composition determination is performed by performing picture analysis on each picture data as buffer data BDT. For example, quantifying the quality of a composition and setting picture data to be deleted in order from picture data with the lowest point may be considered. As a result, a picture with a good composition may be left. Particularly, in the case of continuous shooting, since composition often changes slightly in a series of pictures due to movement of the user, camera shake, or the like during the continuous shooting, it is useful to select and keep pictures with optimum composition.
  • - Shake amount information of camera shake For example, in a case in which the amount of camera shake is measured by a gyro sensor or the like in the sensor unit 14, the amount of camera shake during imaging of each picture data as buffer data BDT is stored and used for determination. Picture data with a large amount of camera shake is set as picture data to be deleted.
  • a digital camera is usually equipped with a microphone so that voice input/recording is possible. Therefore, audio data at the time of imaging is saved, picture data at a timing at which distinguished audio data is obtained is set as picture data to be saved, and the other pieces of picture data are set as picture data to be deleted. For example, several pieces of picture data based on a timing imaged at the timing of golf or baseball hitting sound are saved, and picture data imaged at a time point away from the timing is set as picture data to be deleted. As a result, a particularly important scene may be left during continuous shooting.
  • the illuminance state of each picture data can be determined by picture analysis
  • selecting is performed according to the illumination condition. For example, picture data which is a frame with less influence of flicker is saved, and other pieces of picture data are set as picture data to be deleted.
  • the picture data to be left is selected according to the screen brightness, and the other pieces of picture data (for example, dark pictures) are set as picture data to be deleted.
  • - Lens condition Selection is performed in accordance with an operation state of a lens by the optical system 11 at the time of imaging each picture data as the buffer data BDT. For example, selection is performed under wide/tele conditions. Since picture data in the wide angle (wide) state allows a subject to be extracted by trimming, a wide picture is left, and pictures on the tele side are set as pictures to be deleted. Also, selection is performed according to the zoom lens operating speed in the case of power zooming. Also, selection is performed according to an operation speed of a focus lens. In any of these cases, picture data imaged during operation (a period in which the operation speed is fast) is set as picture data to be deleted by priority.
  • the above-described deletion of the buffer data BDT is executed by operating the forced return button 3 when the user wants to perform continuous shooting immediately after finishing waiting while waiting immediately after continuous shooting until the next continuous shooting is possible.
  • the waiting immediately after continuous shooting is a period during which signal processing up to recording the buffer data BDT on the recording medium 15a has not been completed.
  • the user can start the next continuous shooting without operating the forced return button 3. Therefore, while waiting until returning to a state in which continuous shooting is possible, the user operates the forced return button 3 as necessary (in response to occurrence of a scene that he or she want to take picture of).
  • manipulating the forced return button 3 has a possibility of causing a scene taken immediately before to be sacrificed, the user may be confused as to whether he or she should operate the forced return button 3. Considering this, it is preferable for the user to clearly know up to which picture, during immediately-preceding continuous shooting, the processing has been completed in a standby period.
  • FIG. 8 illustrates pieces of picture data SG1 to SGm obtained by continuous shooting imaging. It is assumed that processing up to a recording process has not been completed yet for the series of picture data SG1 to SGm obtained by the continuous shooting.
  • a developed picture 70, a recorded picture 71, and a mark 72 indicating that recording of a picture indicated by the recorded picture 71 on the recording medium 15a has been completed is displayed on the display unit 17.
  • the developed picture 70 shows a picture after the processing in the second processing unit 42 is completed.
  • the recorded picture 71 shows a picture whose processing up to the media output by the third processing unit 43 has been completed.
  • the user can recognize up to which picture the pictures will be saved even if the forced return button 3 is pressed during standby. For example, in the example shown in B of FIG. 8, the user can recognize that pieces of picture data up to the picture data SG3 can be surely saved. Also, the user can recognize that processing up to a development process has been completed for pieces of picture data up to picture data SGm-1.
  • the user may operate the forced return button 3 before all of the processes are completed while measuring a timing by a progress display. As a result, it is also possible to not miss the current scene and to leave important pictures for the immediately-preceding imaged scene.
  • the picture data in the second buffer 52 is not deleted and signal processing up to recording is performed thereon. Therefore, even in such a case, displaying the developed picture in the second processing unit 42 also allows the user to be presented with up to which picture the pictures will be left in the immediately-preceding continuous shooting imaging.
  • Performing such a display of a process progress in the electronic viewfinder 19 may also be considered.
  • the display unit 17 and the electronic viewfinder 19 are used complementarily. For example, when the user looks into the electronic viewfinder 19, the display of the electronic viewfinder 19 is turned on and the display of the display unit 17 is turned off, and when the user is not looking into the electronic viewfinder 19, the display of the electronic viewfinder 19 is turned off, and the display of the display unit 17 is turned on. Therefore, at the time of standby, display of the process progress as described above may be performed on the side that is turned on.
  • the forced return button 3 is provided at a position on the main body behind the lens barrel 8. Since this forced return button 3 is an operation involving deletion of imaged picture data, it is important to prevent erroneous operation as much as possible. As one of the configurations for so-called fail-safe, it is preferable that the forced return button 3 is arranged such that the forced return button 3 is unable to be operated with at least the user's right hand gripping the grip portion 9. Particularly, it is desirable that the forced return button 3 is provided to be unable to be operated simultaneously with an operating element for an imaging starting operation, i.e., the release button 2 with one hand (in this case, the right hand).
  • the arrangement position of the forced return button 3 shown in A of FIG. 1 is a position which is not normally reached by the right hand gripping the grip portion 9. In this way, the forced return button 3 is prevented from being mistakenly pressed as the release button 2. Also, since the forced return button 3 is spaced apart from the release button 2 as described above, the forced return button 3 is not operated unless the user intentionally presses the forced return button 3, and thus it is suitable for avoiding erroneous operation.
  • the forced return button 3 it is requested that the forced return button 3 be able to be operated immediately in accordance with a scene in front of the user during standby. The user is in a panic situation for a moment. Because of this, it is not suitable to arrange a cover on the button to prevent erroneous operation, or to set an operation mode such as operation related to the menu display of the display unit 17. That is, it is desirable that an operating element for forced return be able to be operated impromptu in the housing, like the forced return button 3. Therefore, in the present embodiment, the forced return button 3 is arranged at an upper left portion of the housing for the forced return button 3 to be operated with left hand while the grip portion 9 is gripped by the right hand. By requesting the user to operate with the left hand, it is assumed that it is an intentional operation by the user and can be operated instantly even with the right hand holding the camera.
  • the grip portion 9 is gripped with the right hand and the left hand is attached to a lower portion of the housing. That is, the left hand of the user is below the housing. Therefore, arranging the forced return button 3 at an upper portion of the housing is suitable since the forced return button 3 is prevented from being unintentionally pushed by the user. Particularly, for the operating element to eliminate unintentional operation (erroneous operation) of the user, it is suitable to arrange the forced return button 3 on the upper left of the main body.
  • a position at which the forced return button 3 is spaced apart from the release button 2 a position at which it is difficult to operate the forced return button 3 and the release button 2 simultaneously with one hand, a position at which the forced return button 3 may be intentionally operated with the other hand, and the like are preferable.
  • the operating element is not necessarily demanded to be in the form of a button. This will be described below as a modification.
  • deletion of buffer data BDT may be performed impromptu in accordance with the operation of the forced return button 3
  • erasing of the buffer data BDT may also be performed when the release button 2 is operated immediately after the operation of the forced return button 3 or while the forced return button 3 is pressed.
  • FIG. 9 illustrates a processing example in a case in which the user performs continuous shooting operation, as a processing example according to the first embodiment. Note that although the control unit 30 of the imaging device 1 performs various control processes for normal still picture imaging, moving picture imaging, picture reproduction, mode setting, and the like, description thereof will be omitted, and only a process related to continuous shooting will be described below.
  • a flowchart of FIG. 9 illustrates a process in a case in which imaging operation is performed as a continuous shooting mode.
  • the control unit 30 monitors the end of operation. For example, an end of a continuous shooting mode, an end of imaging (shift to a reproduction operation), a power off, or the like is the end of operation in this case. Processing examples of such cases will be omitted.
  • Step S102 the control unit 30 waits for the continuous shooting operation (the operation of the release button 2) in Step S102 in a period until the end of the operation. Until the operation of the release button 2 is detected, normally, Steps S102, S106, and S108 are performed in that order to control a through picture display. Then, the process returns to Steps S101 and S102.
  • Step S106 branches the process based on whether waiting immediately after continuous shooting is in progress (whether it is before completion of processing continuously-shot picture data), and normally, the through picture display is controlled in Step S108.
  • the control unit 30 controls the signal processing unit 20 to generate through picture display data for each frame data read out from the image sensor 12 and instructs the display unit 17 or the electronic viewfinder 19 to display the generated through picture display data.
  • Step S102 the control unit 30 proceeds from Step S102 to Step S103 and starts the continuous shooting operation. That is, exposure/signal transmission as a still picture by continuous shooting from the image sensor 12 or signal processing in the signal processing unit 20 is started.
  • the signal processing unit 20 acquires picture data obtained by continuous shooting from the image sensor 12, performs processes of the first processing unit 41, the second processing unit 42, and the third processing unit 43, and starts an operation for recording the continuously-shot pictures on the recording medium 15a.
  • Step S104 the control unit 30 monitors the end of the continuous shooting. For example, when the user ends the operation of the release button 2 (ends pressing the release button 2), it is determined that the end of the continuous shooting is reached. Alternatively, when the maximum time capable of continuous shooting is reached (when the first buffer 51 becomes full capacity), it is determined that the end of the continuous shooting is reached. When end of the continuous shooting is reached, the control unit 30 ends the reading out of the continuously-shot pictures in the image sensor 12 in Step S105.
  • Step S106 the control unit 30 proceeds from Step S106 to Step S107 and controls the display of the process progress.
  • the recorded picture 71 or the like is displayed on the display unit 17 or the electronic viewfinder 19, and the user is presented with progress of the current process.
  • Step S109 the control unit 30 monitors whether the operation of the forced return button 3 is performed. Particularly, in a period in which the operation of the forced return button 3 is not detected, the completion of the signal processing for continuous shooting is confirmed in Step S106, and the process progress in Step S107 is continuously displayed until completion. Therefore, the user can grasp the recording completion of each picture of the continuous shooting with time.
  • the process of the control unit 30 proceeds from Step S106 to Step S108, the through picture display control is resumed, and the process returns to the monitoring process of Steps S101 and S102. Therefore, when the user operates the release button 2 again, the control unit 30 proceeds to Step S103 again and starts the continuous shooting.
  • the control unit 30 performs monitoring within the loop of Steps S106, S107, and S109, and normally, continuous shooting is not started even when the user operates the release button 2 during this time. If the user wants to perform continuous shooting during the standby, it is necessary to operate the forced return button 3. In a case in which the forced return button 3 is operated, the control unit 30 detects the operation of the forced return button 3 in Step S109 and proceeds to Step S110. Here, the control unit 30 checks whether unprocessed buffer data BDT is left in a buffer memory area (that is, in the configuration of FIG.
  • Step S111 the first buffer 51 and the second buffer 52 used by the signal processing unit 20, and when unprocessed buffer data BDT is left, proceeds to Step S111 and instructs all buffer data BDT to be deleted in the first buffer 51 and the second buffer 52.
  • the signal processing unit 20 deletes all of the buffer data BDT.
  • the control unit 30 returns to Steps S101 and S102. In a case in which the user operates the release button 2 immediately afterwards, the control unit 30 proceeds the process from Step S102 to Step S103 and starts continuous shooting.
  • Step S110 determines that there is no unprocessed buffer data BDT.
  • the process returns to Steps S101 and S102, and a state in which continuous shooting is possible is reached.
  • the remaining picture data may be treated as overwritable data.
  • FIG. 10 A processing example according to a second embodiment is illustrated in FIG. 10. Note that the same processes as in FIG. 9 are denoted by the same step numbers, and repetitive description is avoided.
  • Steps S101 to S109 are the same as those shown in FIG. 9.
  • the control unit 30 proceeds from Step S109 to Step S120, checks whether unprocessed buffer data BDT1 remains in the first buffer 51, and when the unprocessed buffer data BDT1 is left, the control unit 30 proceeds to Step S121 and instructs the signal processing unit 20 to delete all of the buffer data BDT1 in the first buffer 51.
  • the signal processing unit 20 deletes all of the buffer data BDT of the first buffer 51.
  • the control unit 30 returns to Steps S101 and S102.
  • the control unit 30 proceeds the process from Step S102 to Step S103 and starts continuous shooting.
  • Step S120 in a case in which it is determined in Step S120 that there is no unprocessed buffer data BDT1 in the first buffer 51, the process returns to Steps S101 and S102, and the state in which continuous shooting is possible is reached. Even when the buffer data BDT1 processed after the second processing unit 42 remains in the first buffer 51, the remaining buffer data BDT1 may be treated as overwritable data.
  • the user can forcibly delete the buffer data BDT by the operation of the forced return button 3 and resume the continuous shooting.
  • the buffer data BDT of the second buffer 52 (picture data on which development processing is completed) is not discarded, the number of pictures saved in the recording medium 15a can be increased in comparison to the first embodiment even when the forced return button 3 is operated.
  • the example in which the first buffer 51 is subjected to deletion has been given as an example in which a part of the buffer memory area is subjected to deletion, a case in which only the second buffer 52 is subjected to deletion may also be considered. Further, in a case of having the first buffer 51, the second buffer 52, and the third buffer 53 as shown in FIG. 5, an example in which the first buffer 51 and the second buffer 52 are subjected to deletion may also be considered.
  • Step S200 of FIG. 11 the control unit 30 monitors the end of the operation of the continuous shooting mode, which is the same as Step S101 in FIG. 9 above.
  • the control unit 30 waits for the continuous shooting operation (operation of the release button 2) in Step S201 in a period until the end of the operation is reached.
  • Steps S201, S203, and S204 are performed in that order to control a through picture display.
  • the process returns to Steps S200 and S201.
  • Step S203 branches the process based on whether waiting immediately after continuous shooting is in progress (whether it is before completion of processing continuously-shot picture data), and normally, the through picture display is controlled in Step S204.
  • Step S201 When the operation of the release button 2 is detected, the control unit 30 proceeds from Step S201 to Step S202 and starts the continuous shooting operation by processing an imaging sequence.
  • the processing content of the imaging sequence is illustrated in FIG. 12.
  • Step S210 of FIG. 12 the control unit 30 checks whether a storable capacity C1 of the first buffer 51 is equal to or greater than a predetermined threshold value th1, for example.
  • the threshold value th1 is preset as a value indicating the storage capacity that does not affect execution of continuous shooting. Particularly, when waiting for completion of signal processing of continuously-shot picture data is not in progress, the first buffer 51 has sufficient free capacity (storable capacity C1).
  • Step S214 the control unit 30 proceeds to Step S214 and starts exposure/signal transmission as a still picture by continuous shooting from the image sensor 12 or signal processing in the signal processing unit 20.
  • the signal processing unit 20 acquires picture data obtained by continuous shooting from the image sensor 12, performs processes of the first processing unit 41, the second processing unit 42, and the third processing unit 43, and starts an operation for recording the continuously-shot pictures on the recording medium 15a.
  • Step S215 the control unit 30 monitors the end of the continuous shooting. For example, when the user ends the operation of the release button 2 (ends pressing the release button 2), it is determined that the end of the continuous shooting is reached. Alternatively, when the maximum time capable of continuous shooting is reached (when the first buffer 51 becomes full capacity), it is determined that the end of the continuous shooting is reached. When end of the continuous shooting is reached, the control unit 30 ends the reading out of the continuously-shot pictures in the image sensor 12 in Step S216. As a normal operation, the processing S202 as the imaging sequence is completed as described above, and the process proceeds to Step S203 of FIG. 11.
  • Step S203 the control unit 30 branches the process based on whether signal processing for the continuous shooting has been completed.
  • Step S203 Until signal processing for all of the series of continuously-shot pictures is completed, the control unit 30 proceeds from Step S203 to Step S205 and performs control of a process progress display. That is, as shown in B of FIG. 8 and C of FIG. 8, the control unit 30 causes the recorded picture 71 or the like to be displayed on the display unit 17 or the electronic viewfinder 19, and the user is presented with progress of the current process.
  • Step S206 the control unit 30 monitors whether the forced return button 3 has been operated. Particularly, when the operation of the forced return button 3 is not detected, the control unit 30 sets a forced return flag FC to 0 in Step S203. Then, the process returns to Steps S200 and 201. That is, when the user simply waits, the process transitions to the loop of Steps S203, S205, S206, S208, S200, S201, and S203. However, even while waiting for completion of signal processing for the immediately-preceding continuous shooting, the user may operate the release button 2 so that the process proceeds to the imaging sequence from Step S201 to S202.
  • Step S210 the processing of the second processing unit 42 may have been already performed at a time point at which the release button 2 is operated this time, and the storable capacity of the first buffer 51 may be sufficiently open in some cases. Therefore, when the storable capacity C1 is equal to or greater than the threshold value th1, the control unit 30 proceeds to Step S214 and starts a new continuous shooting operation in the image sensor 12 and the signal processing unit 20.
  • the control unit 30 proceeds from Step S210 to Step S211 and checks whether the forced return flag FC is equal to 1. In a case in which the user does not operate the forced return button 3 and, instead, operates the release button 2, the forced return flag FC is equal to 0 (S206 to S208 in FIG. 11).
  • Step S213 causes the buffer-full state to be displayed on the display unit 17 or the electronic viewfinder 19, and ends the process of the imaging sequence. That is, the user is notified of the reason why continuous shooting is unable to be started, the continuous shooting operation (operation of release button 2) is disabled, and continuous shooting is not started.
  • the user When the user wants to perform continuous shooting while waiting for the completion of signal processing, the user has to operate the forced return button 3. Particularly, in this example, operation of simultaneously pressing the forced return button 3 and the release button 2 (or pressing the release button 2 while the forced return button 3 is pressed) is necessary.
  • Step S209 the control unit 30 checks whether the release button 2 is operated simultaneously with the forced return button 3 in Step S209. That is, in Step S209, the control unit 30 checks whether the operation of the release button 2 is being performed while the operation of the forced return button 3 is continued.
  • Step S210 of FIG. 12 the control unit 30 first checks the storable capacity of the first buffer 51. When the storable capacity C1 is equal to or greater than the threshold value th1, since there is no particular problem, the process proceeds to Step S214, and the control unit 30 starts the continuous shooting operation.
  • Step S211 the control unit 30 checks the forced return flag FC.
  • the control unit 30 proceeds to Step S212, and for example, deletes all or a part of the buffer data BDT1 stored in the first buffer 51.
  • Step S214 the control unit 30 proceeds to Step S214 and starts the continuous shooting operation.
  • the storable capacity C1 of the first buffer 51 is checked in Step S210 above, the storable capacity of the second buffer 52 may also be determined. For example, when the storable capacity of one or both of the first buffer 51 and the second buffer 52 is not sufficient, proceeding to Step S211 may be considered.
  • Step S212 a specific example of the buffer deletion process in Step S212 will be described below, in addition to being applied to only the first buffer 51, the specific example may also be applied to both the first buffer 51 and the second buffer 52, or applied to only the second buffer 52.
  • the buffer data BDT is deleted as necessary.
  • a forced return may be performed even in a case in which the release button 2 and the forced return button 3 are not operated simultaneously, for example, in a case in which the release button 2 is operated within a predetermined time after the forced return button 3 is operated. In either case, by operation of the two operating elements being necessary, deletion of the buffer data BDT due to erroneous operation can be effectively prevented.
  • a specific example of the deletion of the buffer in Step S212 of FIG. 12 will be described with reference to FIGS. 13, 14 and 15.
  • An example in which the first buffer 51 is subjected to deletion will be described.
  • a of FIG. 13 is the most typical method shown in A of FIG. 6.
  • the control unit 30 instructs deletion of all of the buffer data BDT1 in the first buffer 51 in Step S220.
  • the signal processing unit 20 deletes all of the buffer data BDT1 of the first buffer 51 and allows continuous shooting to be resumed.
  • Step S230 the control unit 30 checks a status of the picture being read out from the first buffer 51.
  • the control unit 30 instructs a single piece of picture data to be deleted every time in order from the oldest picture data in Step S232 until it is checked in Step S231 from the status that the reading-out has been completed.
  • the control unit 30 causes all the remaining buffer data BDT1 to be deleted in Step S233. In this way, signal processing up to recording is performed on the picture data being read out.
  • a of FIG. 14 illustrates an example of deleting the necessary amount in order from the oldest data as shown in B of FIG. 6.
  • the control unit 30 causes the oldest picture data from among the pieces of buffer data BDT1 of the first buffer 51 to be deleted.
  • the control unit 30 updates the storable capacity C1 of the first buffer 51 in accordance with the deletion.
  • the control unit 30 checks whether the storable capacity C1 is equal to or larger than the threshold value th1. When the storable capacity C1 is not equal to or greater than the threshold value th1 yet, the control unit 30 returns to step S240, causes the oldest picture data at that time to be deleted, and performs Steps S241 and S242.
  • the deletion process is ended.
  • Step S250 the control unit 30 causes the newest picture data from among the pieces of buffer data BDT1 of the first buffer 51 to be deleted.
  • Step S251 the control unit 30 updates the storable capacity C1 of the first buffer 51 in accordance with the deletion.
  • Step S252 the control unit 30 checks whether the storable capacity C1 is equal to or larger than the threshold value th1. When the storable capacity C1 is not equal to or greater than the threshold value th1 yet, the control unit 30 returns to step S250, causes the newest picture data at that time to be deleted, and performs Steps S251 and S252.
  • Step S252 since a sufficient capacity can be secured upon the time point at which the storable capacity C1 of the first buffer 51 is equal to or greater than the threshold value th1, the deletion process is ended.
  • a of FIG. 15 illustrates an example of performing thinning deletion as illustrated in B of FIG. 7.
  • the control unit 30 specifies a range of a series of picture data obtained by continuous shooting from among the pieces of buffer data BDT1 of the first buffer 51.
  • the control unit 30 causes every even-numbered picture data from among the series of picture data to be deleted.
  • the control unit 30 may also cause every odd-numbered picture data to be deleted.
  • pieces of picture data may be deleted by skipping two pieces of picture data, skipping three pieces of picture data, etc.
  • Step S262 the control unit 30 checks whether a series of data obtained by another continuous shooting is left, and in a case in which the series of data obtained by the other continuous shooting is left, the control unit 30 also causes thinning deletion to be executed in Steps S260 and S261 for the series of picture data. The process is ended at a time point at which the thinning deletion is performed for each continuous shooting. Note that even during the thinning deletion, the deletion process may be ended at a time point at which the storable capacity C1 of the first buffer 51 becomes equal to or larger than the threshold value th1.
  • control unit 30 may further perform thinning deletion on the first buffer 51.
  • deletion may be performed continuously with different deletion methods as shown in A of FIG. 14 and B of FIG. 14.
  • Step S270 the control unit 30 acquires conditions for selection of deletion/non-deletion.
  • the selection conditions may be fixedly determined, or may have been previously selected by the user's operation. As described above, various conditions can be considered.
  • Step S271 the control unit 30 selects picture data to be deleted according to the conditions.
  • Step S272 the control unit 30 causes the picture data selected as picture data to be deleted to be deleted, and ends the process.
  • the control unit 30 may select picture data to be deleted from among the pieces of buffer data BDT1 remaining in the first buffer 51 with different conditions and cause the selected picture data to be deleted to be deleted. Alternatively, in that case, deletion may be performed continuously with different deletion methods as shown in A of FIG. 14 and B of FIG. 14.
  • Step S280 the control unit 30 sets a deletion process method that has been previously selected by the user's operation as a process to be executed. For example, a deletion process method selected by the user from among, for example, the complete deletion shown in A of FIG. 13, complete deletion except for data being read out shown in B of FIG. 13, deletion in order from the oldest picture data shown in A of FIG. 14, and the like is selected.
  • Step S281 deletion control is executed by the selected deletion process method. That is, in Step S281, any process from among those shown in A of FIG. 13, B of FIG. 13, A of FIG. 14, B of FIG. 14, A of FIG. 15, and B of FIG. 15 is performed. In this way, the user can select a preferable deletion process method corresponding to his or her use case.
  • the imaging recording of a super slow moving picture is a function of storing data read out from the image sensor 12 at a very high speed in the buffer memory area and creating a slow motion moving picture while developing the stored data at normal speed. Since the picture data read out from the image sensor 12 is stored and developed at once until the buffer memory area becomes full, the imaging available time is limited by the number of pieces of picture data that can be written in the buffer memory area, and the next super slow moving picture imaging is unable to be started until the buffer memory area is empty.
  • the processes of the above-described first to third embodiments are also applied to the case of the super slow moving picture mode. That is, when the storable capacity C1 is not sufficient in the buffer memory area and thus the super slow moving picture imaging is unable to be resumed, the buffer memory area is opened by operation of the forced return button 3 (or combined operation of the forced return button 3 and the release button 2) to start the super slow moving picture imaging. As a result, it is possible to prevent scenes preferable for the super slow moving picture imaging from being missed.
  • the processing of the embodiment can be applied to super-slow moving picture imaging in exactly the same way. Because of this, the processing is also suitable for a case where super-slow moving picture imaging and continuous shooting are performed alternately. For example, even in the case where the user wants to perform super-slow moving picture imaging while waiting for completion of processing immediately after continuous shooting, or in a case where the user wants to perform continuous shooting while waiting for completion of processing immediately after super-slow moving picture imaging, applying the above-described processing and securing a storable capacity of the buffer memory area to start super-slow moving picture imaging or continuous shooting imaging may be considered.
  • the imaging device 1 includes the signal processing unit 20 configured to cause a series of picture data being continuously acquired (whose imaging times are consecutive) by continuous shooting, super-slow moving picture imaging, or the like to be temporarily stored in a buffer memory area sequentially, read out the series of picture data from the buffer memory area, and perform predetermined signal processing, and the control unit 30 configured to cause the signal processing unit 20 to execute complete or partial deletion of the picture data stored in the buffer memory area, on the basis of detection of predetermined operation (operation of the forced return button 3) while signal processing is being performed on the series of picture data in the signal processing unit 20.
  • the signal processing unit 20 configured to cause a series of picture data being continuously acquired (whose imaging times are consecutive) by continuous shooting, super-slow moving picture imaging, or the like to be temporarily stored in a buffer memory area sequentially, read out the series of picture data from the buffer memory area, and perform predetermined signal processing
  • the control unit 30 configured to cause the signal processing unit 20 to execute complete or partial deletion of the picture data stored in the buffer memory area, on the basis of detection of
  • the buffer memory area is opened partially or entirely.
  • the control unit 30 causing complete or partial deletion of the picture data stored in the buffer memory area to be executed on the basis of the user's operation, a state in which the next imaging (continuous shooting imaging or super-slow moving picture imaging) can be started instantly may be reached. Because of this, a situation of losing an imaging opportunity due to waiting for processing can be eliminated. Particularly, since a situation in which the cameraman wants to take a picture of the current moment even if the he or she has to discard a picture taken immediately before may occur often, a function for not missing an imaging opportunity can be realized in such cases. Also, since the erasing is performed on the basis of the user's intention, automatic erasing not desired by the user is not performed. Discarding an imaged picture is based on the user's choice to the end, and is not deletion that is unintended by the user.
  • the control unit 30 causes the picture data stored in the buffer memory area to be deleted in a case where the storable capacity C1 of the buffer memory area is less than the predetermined amount (threshold value th1) (S210 of FIG. 12). Even in a case where deletion of picture data being buffered in the buffer memory area is requested by a predetermined operation (operation of the forced return button 3) by the user, there may be no necessity to delete the picture data when there is sufficient remaining storable capacity. Therefore, deletion of picture data is actually performed in a case where the remaining capacity is less than the predetermined amount.
  • deletion of buffer data is not performed. Therefore, unprocessed picture data remaining in the buffer memory area may be kept without change for signal processing and may be recorded on the recording medium 15a. As a result, the amount of picture data to be deleted can be minimized.
  • the control unit 30 causes deletion of picture data stored in the buffer memory area to be executed in accordance with detection of the predetermined operation (operation of the forced return button 3) and the detection of operation to start imaging of the next series of picture data (operation of the release button 2) (Steps S206 and S209 in FIG. 11).
  • the deletion control is not performed immediately by merely detecting the operation of the forced return button 3, which is an instruction to delete the picture data, and the deletion is executed in a case where the release button 2 is operated simultaneously with or immediately after the operation of the forced return button 3.
  • meaning of detecting operation of the release button 2 along with detecting operation of the forced return button 3 is not limited to the case where operations of the forced return button 3 and the release button 2 are performed simultaneously, and also includes a case where the release button 2 is operated within a predetermined amount of time (for example, within one second) from operation of the forced return button 3. This, is because, even in this case, it is possible to check the necessity of deleting the buffer data BDT by operating the release button 2, and deletion may be performed when the necessity is confirmed.
  • buffer data deletion may be performed only in a case of starting imaging operation that a certain amount of capacity of a buffer memory is necessary to be secured due to a difference between a read-out speed from the image sensor 12 and a signal processing speed, such as in continuous shooting imaging or super-slow moving picture imaging.
  • the deletion may not be executed.
  • the control unit 30 causes deletion of the picture data stored in the buffer memory area to be executed in accordance with only the condition of detecting the predetermined operation (operation of the forced return button 3) (FIG. 9, FIG. 10).
  • operation of the forced return button 3 operation of the forced return button 3
  • a user is a person who can determine that a series of pictures is unnecessary immediately after the series of pictures are imaged, allowing to return to the state in which continuous shooting is possible (super-slow moving picture imaging is possible) instantly may facilitate use in some cases.
  • a forced return in response to such a request can be realized.
  • the case where the plurality of buffer memory areas (the first buffer 51, the second buffer 52, and the third buffer 53) for buffering picture data in another signal processing step is prepared by the signal processing unit 20 is shown.
  • the control unit 30 causes the signal processing unit 20 to perform complete or partial deletion of picture data stored in the plurality of buffer memory areas in accordance with a predetermined operation has been described.
  • standby is necessary until continuous shooting or the like immediately afterwards is possible in accordance with the remaining capacity in the buffer memory area of each part in some cases. Therefore, buffer data deletion is performed for the plurality of buffer memory areas.
  • control unit 30 causes the signal processing unit to execute complete or partial deletion of picture data stored in some of the buffer memory areas in accordance with a predetermined operation.
  • the control unit 30 causes the signal processing unit to execute complete or partial deletion of picture data stored in some of the buffer memory areas in accordance with a predetermined operation.
  • it is possible to return to the state in which continuous shooting imaging or super-slow moving picture imaging is possible while deletion of picture data (deletion of unrecorded pictures) is reduced as much as possible.
  • any buffer memory area that is a location that can be a bottleneck in the data processing process can be set as a buffer memory area subjected to deletion.
  • the first buffer 51 which is the first buffer memory area used in the signal processing process of the signal processing unit 20
  • the first buffer 51 which is the first buffer memory area used in the signal processing process of the signal processing unit 20
  • deletion of picture data is performed in order from the oldest imaging time from among pieces of picture data stored in the buffer memory area in a case where partial deletion is executed on the pieces of picture data stored in the buffer memory area has been described (see B of FIG. 6 and A of FIG. 14).
  • deletion of picture data whose imaging time is relatively new may be reduced as much as possible.
  • deletion of picture data is performed in order from the newest imaging time from among pieces of picture data stored in the buffer memory area in a case where partial deletion is executed on the pieces of picture data stored in the buffer memory area has been described (see A of FIG. 7 and B of FIG. 14).
  • deletion of picture data whose imaging time is relatively old may be reduced as much as possible. Therefore, the newest imaged picture is discarded.
  • a cameraman operates the forced return button 3 when he/she thinks that a picture taken immediately before is a failure and wants to promptly shift to imaging of the next scene.
  • the picture data whose imaging time is the newest is one that the user considers as a failure.
  • the new data is a picture immediately before the end of continuous shooting, and for the user, there is a possibility that the new data is a picture after finishing taking the best scene (a situation of trying to end continuous shooting). Therefore, it may be considered that the user often has a small feeling of resistance for deletion of a new picture. In a case of dealing with such a use case, it is suitable to delete in order from the newest picture data.
  • the user may be allowed to select which one of the buffer memory areas in the plurality of signal processing steps, such as the first buffer 51 and the second buffer 52, is to be subjected to deletion or whether to set all of the buffer memory areas to be subjected to erasure. Even in this case, it is clear that all of the buffer memory areas are subjected to deletion, and the maximum capability can be demonstrated in continuous shooting imaging or super-slow moving picture imaging to be resumed. On the other hand, when some of the buffer memory areas are set to be subjected to deletion, picture data to be left without deleting can be generated.
  • a progress indicating a progress of signal processing is displayed on a display unit (the display unit 17 or the electronic viewfinder 19) during a period until signal processing on a series of picture data is completed in the signal processing unit 20 .
  • a display as shown in B of FIG. 8 or C of FIG. 8 is performed.
  • the display is very useful information for determining whether the remaining pictures (unprocessed pictures) should be deleted by the operation of the forced return button 3 or whether it is better to wait more and then perform the next imaging.
  • the user can perform an appropriate operation according to the display. Particularly, in a case where the buffer data BDT is being completely deleted, since it is possible for the user to check whether an important scene has been recorded, the display becomes a material for determining whether to use the forced return function.
  • the recorded picture 71 is presented. That is, from among a series of picture data obtained by continuous shooting imaging or super-slow moving picture imaging, a picture for which processing for recording on a recording medium has been completed is presented.
  • the user can clearly recognize whether processing up to a necessary picture from among pictures obtained by continuous shooting has been completed, and thus the user can accurately determine whether operation of the forced return button 3 should be performed or the operation timing.
  • the display is simplified, and it is easy for the user to recognize the display. This is suitable as a display in a case where the user wants to quickly determine whether to perform operation of the forced return button 3 in a situation in which a scene that the user wants to take picture of is in front of the user.
  • the super-slow moving picture imaging is an imaging method of recording a slow motion moving picture by performing development processing at a normal frame rate while storing a moving picture read out at a high frame rate switched from a normal imaging frame rate (for example, 60 fps) in a buffer memory.
  • a normal imaging frame rate for example, 60 fps
  • the present technique may be adaptable, by keeping a balance with a signal processing speed, to a case of imaging recording a moving picture with a very large amount of data or a picture with a high frame rate.
  • the forced return button 3 is provided in a state in which the forced return button 3 is unable to be operated simultaneously with an operating element (the release button 2) for imaging starting operation with one hand. That is, the forced return button 3 for instructing the deletion of the data in the buffer memory area is arranged at a position spaced apart from the release button 2 so that the forced return button 3 is unable to be operated simultaneously with the release button 2 with one hand.
  • the user is prevented from performing an operation of deleting data in the buffer memory area by mistake as an imaging start operation, and thus deletion of picture data unintended by the user does not occur.
  • An operating element for predetermined operation for instructing a forced return is implemented with a button type forced return button 3.
  • the forced return button 3 may be easily operated, and thus it is the most suitable to perform a quick operation when the user has found a scene to be imaged.
  • the operating element for instruction deletion of data in the buffer memory area may not be a button-type operating element.
  • the operating element may also be a lever operating element, a touch operating element, or the like.
  • predetermined operation may be determined in accordance with a type of touch, for example, a tap, a flick, a flicking direction, etc., and the forced return function may be performed by the operation.
  • a functional key to which the user can arbitrarily assign a function may be used as the operating element for instructing deletion of data in the buffer memory area. Sharing the release button 2 may also be considered. For example, pressing the release button 2 for a long time or pressing the release button 2 twice may be set as predetermined operation for forced return. Further, a gesture operation capable of being monitored by the control unit 30 by picture recognition may be used. For example, the user may perform imaging with the left hand in a predetermined shape in front of the lens barrel 8 for the control unit 30 to recognize the user's gesture as a predetermined operation.
  • Recording media capable of ultra high-speed writing may be developed in the future, and the media output speed may greatly exceed the development processing speed in some cases. In that case, the following may be considered.
  • the recording is performed in parallel with the development processing so that the raw picture data is written in the recording medium 15a first. In that case, in a case where a forced return to continuous shooting is instructed, the recorded data of the raw picture data in the buffer memory area is deleted. In this state, the raw picture data has already been stored in the recording medium 15a so that there is no loss as a picture.
  • the recording medium 15a may be treated like a buffer, and the raw picture data may be recorded in parallel so that the raw picture data can be saved even at the time of forced return as in the case in which the raw picture data and the JPEG data are being recorded simultaneously.
  • the saved raw picture data it is only necessary to perform the development processing later at a timing at which continuous shooting is not performed (for example, by an instruction from the user).
  • a method in which the JPEG data is resized and the data size is reduced upon receiving an instruction for forced return, and data is deleted in the process of processing a buffer memory area while writing the data on the recording medium 15a at a high speed may also be considered.
  • the signal processing unit 20 may delete picture data in the processing process. For example, a case where picture data generated by arithmetic processing by the signal processing unit 20 is prevented from being written in the next buffer memory area (or from being output to the recording medium 15a) in accordance with operation of the forced return button 3 so that picture data being processed in the above-described first processing unit 41, second processing unit 42, third processing unit 43, etc. are discarded, may be considered. Furthermore, in addition to being applied to deletion of picture data in the buffer memory area, the technique of the embodiment can also be applied to deletion of pictures on the recording medium 15a.
  • Such a program can be pre-stored in a recording medium incorporated in a device such as a computer device or in a ROM or the like in a microcomputer having a CPU.
  • a program can be temporarily or permanently stored (stored) in a removable recording medium such as a semiconductor memory, a memory card, an optical disk, a magneto-optical disk, or a magnetic disk.
  • a removable recording medium can be provided as so-called packaged software.
  • the program can also be downloaded from a download site via a network such as a local area network (LAN) or the Internet.
  • LAN local area network
  • An imaging device comprising: a signal processor configured to perform a first signal processing to temporarily store a series of continuously acquired image data in a buffer memory area, to read out the series of image data from the buffer memory area, and to perform a second signal processing that is subsequent to the first signal processing; and a controller configured to obviate at least a part of the image data stored in the buffer memory area following detection of a predetermined operation during execution of the first signal processing on the series of image data.
  • obviating at least a part of the image data stored in the buffer memory area includes deletion of the image data stored in the buffer memory area when a remaining storage capacity of the buffer memory area is less than a predetermined amount.
  • the imaging device wherein the signal processor prepares a plurality of buffer memory areas to store the image data of at least the first signal processing and the second signal processing, and in accordance with the predetermined operation, the controller commands the signal processor to obviate the image data by completely or partially deleting the image data stored in the plurality of buffer memory areas.
  • the signal processor prepares a plurality of buffer memory areas to store the image data of at least the first signal processing and the second signal processing, and in accordance with the predetermined operation, the controller commands the signal processor to obviate the image data by completely or partially deleting the image data stored in at least one of the buffer memory areas.
  • the at least one of the buffer memory areas is a first buffer memory area that is used to store image data during a signal processing executed by the signal processor.
  • the controller commands the signal processor to obviate the image data by partially deleting the image data stored in the buffer memory area, the controller first deletes the image data in the buffer memory area with imaging time for the longest period of time.
  • the controller commands the signal processor to obviate the image data by partially deleting the image data stored in the buffer memory area, the controller first deletes the image data in the buffer memory area with imaging time for the shortest period of time.
  • the imaging device wherein when the controller commands the signal processor to obviate the image data by deleting the image data stored in the buffer memory area, the controller deletes all image data stored in the buffer memory area except for the image data currently being read out from the buffer memory area. (14) The imaging device according to (1), wherein when the controller commands the signal processor to obviate the image data by deleting the image data stored in the buffer memory area, the controller deletes image data stored in the buffer memory area by selecting one of a plurality of deletion processing methods. (15) The imaging device according to (1), wherein the controller controls a display indicating a progress of signal processing until the signal processor completes signal processing for the series of image data.
  • the series of image data is a plurality of pieces of still image data input by a continuous shooting imaging operation.
  • the series of image data is image data of a plurality of frames input by a moving picture imaging operation that switched from a normal imaging frame rate to a high imaging frame rate.
  • the imaging device according to (1) further comprising a housing including a first operating element for the predetermined operation and a second operating element for an imaging starting operation, wherein the first operating element is unable to be operated simultaneously with the second operating element with one hand.
  • the imaging device according to (1) further comprising an operating element for the predetermined operation, wherein the operating element is a button-type operating element.
  • An imaging method of an imaging device including a signal processor configured to perform a first signal processing to temporarily store a series of continuously acquired image data in a buffer memory area, to read out the series of image data from the buffer memory area, and to perform a second signal processing that is subsequent to the first signal processing, the imaging method comprising: detecting a predetermined operation during execution of the first signal processing on the series of image data obtained by an imaging operation; and obviating at least a part of the image data stored in the buffer memory area following detection of the predetermined operation.
  • An imaging device including: a signal processing unit configured to cause a series of picture data being continuously acquired to be temporarily stored in a buffer memory area in a signal processing process, read out the series of picture data from the buffer memory area, and perform a subsequent signal processing; and a control unit configured to perform control for deleting at least a part of the picture data stored in the buffer memory area, on a basis of detecting a predetermined operation while the signal processing is being performed on the series of picture data by the signal processing unit.
  • the imaging device in which the control unit causes the deletion of the picture data stored in the buffer memory area to be executed in accordance with detecting an imaging starting operation for the series of picture data in addition to detecting the predetermined operation.
  • the imaging device in which the control unit causes the deletion of the picture data stored in the buffer memory area to be executed in accordance with only a condition of detecting the predetermined operation.
  • the imaging device in which a plurality of buffer memory areas in which the signal processing unit buffers picture data of different signal processing steps are prepared, and in accordance with the predetermined operation, the control unit causes the signal processing unit to execute complete or partial deletion of the picture data stored in the plurality of buffer memory areas.
  • the imaging device according to any one of (21) to (24), in which a plurality of buffer memory areas in which the signal processing unit buffers picture data of different signal processing steps are prepared, and in accordance with the predetermined operation, the control unit causes the signal processing unit to execute complete or partial deletion of the picture data stored in a part of the buffer memory areas.
  • the part of the buffer memory areas is a first buffer memory area that is used in a signal processing process in the signal processing unit.
  • the imaging device in which, in a case where the control unit causes partial deletion of the picture data stored in the buffer memory area to be executed, the control unit causes thinning deletion to be performed for a series of picture data in order of imaging time stored in the buffer memory area.
  • the control unit causes a picture to be deleted to be selected from among the picture data stored in the buffer memory area using a predetermined condition and be deleted.
  • the imaging device according to any one of (21) to (27), in which, in a case where the control unit causes deletion of the picture data stored in the buffer memory area to be executed, the control unit causes the deletion of the picture data to be executed except for picture data being read out from the buffer memory area.
  • the control unit causes the deletion of the picture data stored in the buffer memory area to be executed by selecting one of a plurality of deletion processing methods.
  • the imaging device according to any one of (21) to (33), in which the control unit performs control for a display indicating a progress of signal processing to be executed by a display unit during a period until signal processing for the series of picture data is completed by the signal processing unit. (35) The imaging device according to (34), in which, in the display indicating the progress, a picture on which processing for recording on a recording medium has been completed is presented from among the series of picture data. (36) The imaging device according to any one of (21) to (35), in which the series of picture data is a plurality of pieces of still picture data input by a continuous shooting imaging operation.
  • the imaging device according to any one of (21) to (35), in which the series of picture data is picture data of a plurality of frames input by a moving picture imaging operation of a high frame rate switched from a normal imaging frame rate. (38) The imaging device according to any one of (21) to (37), in which, on a housing, an operating element for the predetermined operation is provided in a state in which the operating element is unable to be operated simultaneously with an operating element for an imaging starting operation with one hand. (39) The imaging device according to any one of (21) to (38), in which an operating element for the predetermined operation is a button-type operating element.
  • An imaging method of an imaging device including a signal processing unit configured to cause a series of picture data being continuously acquired to be temporarily stored in a buffer memory area in a signal processing process, read out the series of picture data from the buffer memory area, and perform a subsequent signal processing, the imaging method including: a procedure of detecting a predetermined operation while signal processing is being performed by the signal processing unit on a series of picture data obtained by an imaging operation; and a procedure of causing deletion of at least a part of the picture data stored in the buffer memory area to be executed on a basis of the detecting of the predetermined operation.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Information Transfer Systems (AREA)
  • Television Signal Processing For Recording (AREA)
PCT/JP2018/030550 2017-08-21 2018-08-17 IMAGING DEVICE AND IMAGING METHOD Ceased WO2019039404A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP18765206.0A EP3673645B1 (en) 2017-08-21 2018-08-17 Imaging device, imaging method
US16/639,334 US11503177B2 (en) 2017-08-21 2018-08-17 Imaging device, imaging method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017-158510 2017-08-21
JP2017158510A JP6939242B2 (ja) 2017-08-21 2017-08-21 撮像装置、撮像方法

Publications (1)

Publication Number Publication Date
WO2019039404A1 true WO2019039404A1 (en) 2019-02-28

Family

ID=63490649

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/030550 Ceased WO2019039404A1 (en) 2017-08-21 2018-08-17 IMAGING DEVICE AND IMAGING METHOD

Country Status (4)

Country Link
US (1) US11503177B2 (enExample)
EP (1) EP3673645B1 (enExample)
JP (1) JP6939242B2 (enExample)
WO (1) WO2019039404A1 (enExample)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110766451A (zh) * 2019-09-29 2020-02-07 浙江新再灵科技股份有限公司 一种基于人体静态标签的电梯广告投放方法及投放系统
US11895407B2 (en) 2019-07-24 2024-02-06 Sony Group Corporation Imaging device and imaging method

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12363238B1 (en) * 2022-09-15 2025-07-15 Gopro, Inc. Image capture device with a datastore for process component integration

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005136855A (ja) 2003-10-31 2005-05-26 Kyocera Corp 撮像機能付き携帯端末装置
US20080079817A1 (en) * 2006-09-28 2008-04-03 Casio Computer Co., Ltd. Imaging apparatus, recording medium for recording a computer program, and imaging control method
US20100026845A1 (en) * 2008-08-04 2010-02-04 Samsung Digital Imaging Co., Ltd. Photographing apparatus for supporting overriding mode and method of controlling same
JP2010028451A (ja) 2008-07-18 2010-02-04 Nikon Corp デジタルカメラおよびデジタルカメラを制御するプログラム
JP2010226481A (ja) * 2009-03-24 2010-10-07 Olympus Imaging Corp 撮影装置

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003274323A (ja) * 2002-03-14 2003-09-26 Canon Inc 静止画撮影装置、格納制御方法、プログラム、及び記憶媒体
US7719579B2 (en) 2005-05-24 2010-05-18 Zoran Corporation Digital camera architecture with improved performance
KR101805626B1 (ko) * 2011-11-18 2017-12-08 삼성전자주식회사 디지털 촬영 장치 및 이의 연속 촬영 제어 방법

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005136855A (ja) 2003-10-31 2005-05-26 Kyocera Corp 撮像機能付き携帯端末装置
US20080079817A1 (en) * 2006-09-28 2008-04-03 Casio Computer Co., Ltd. Imaging apparatus, recording medium for recording a computer program, and imaging control method
JP2010028451A (ja) 2008-07-18 2010-02-04 Nikon Corp デジタルカメラおよびデジタルカメラを制御するプログラム
US20100026845A1 (en) * 2008-08-04 2010-02-04 Samsung Digital Imaging Co., Ltd. Photographing apparatus for supporting overriding mode and method of controlling same
JP2010226481A (ja) * 2009-03-24 2010-10-07 Olympus Imaging Corp 撮影装置

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11895407B2 (en) 2019-07-24 2024-02-06 Sony Group Corporation Imaging device and imaging method
CN110766451A (zh) * 2019-09-29 2020-02-07 浙江新再灵科技股份有限公司 一种基于人体静态标签的电梯广告投放方法及投放系统
CN110766451B (zh) * 2019-09-29 2022-07-19 浙江新再灵科技股份有限公司 一种基于人体静态标签的电梯广告投放方法及投放系统

Also Published As

Publication number Publication date
JP2019036904A (ja) 2019-03-07
US20210037162A1 (en) 2021-02-04
JP6939242B2 (ja) 2021-09-22
EP3673645A1 (en) 2020-07-01
EP3673645B1 (en) 2024-05-22
US11503177B2 (en) 2022-11-15

Similar Documents

Publication Publication Date Title
EP2541902A1 (en) Imaging processing device and image processing method
KR101690261B1 (ko) 디지털 영상 처리장치 및 그 제어방법
EP3673645B1 (en) Imaging device, imaging method
RU2507610C2 (ru) Устройство записи информации и способ управления им
JP2009199586A (ja) 情報処理装置及びその制御方法
JP2014168209A (ja) 撮像装置、撮像方法ならびにプログラム
JP2008147966A (ja) 撮像装置及びそのプログラム
JP6854633B2 (ja) 電子機器、制御方法、プログラム、及び記憶媒体
JP2020187239A (ja) 撮像装置、撮像装置の制御方法、プログラム、および記憶媒体
JP5151947B2 (ja) 撮影装置及びそのプログラム
JP5612934B2 (ja) 携帯機器および再生表示方法
JP4375540B2 (ja) 撮影装置及びそのプログラム
JP2007325152A (ja) 撮像装置及びそのプログラム
JP2022187301A (ja) 撮像装置、制御方法、プログラム
JP4408087B2 (ja) 画像再生装置及びその制御方法
JP6257310B2 (ja) 撮影装置、撮影制御方法及びプログラム
KR101314827B1 (ko) 디지털 촬영장치의 제어방법 및 이 방법을 채용한 디지털촬영장치
JP2008228073A (ja) 撮像装置、画像転送方法及びコンピュータプログラム
JP4776967B2 (ja) 記録再生装置及びその制御方法及びプログラム及び記憶媒体
JP2007048173A (ja) 記録装置及びそのプログラム
JP2008054128A (ja) 撮像装置、画像表示装置及びそのプログラム
KR101362774B1 (ko) 디지털 촬영장치의 제어방법 및 이 방법을 채용한 디지털 촬영장치
WO2022209342A1 (ja) 撮像装置、フォーカス制御方法、プログラム
JP2023004355A (ja) 撮像装置、画像処理装置、制御方法、プログラム
JP4795418B2 (ja) デジタルカメラ

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18765206

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2018765206

Country of ref document: EP

Effective date: 20200323