US12316958B2 - Imaging device, imaging method, and program - Google Patents

Imaging device, imaging method, and program Download PDF

Info

Publication number
US12316958B2
US12316958B2 US18/064,572 US202218064572A US12316958B2 US 12316958 B2 US12316958 B2 US 12316958B2 US 202218064572 A US202218064572 A US 202218064572A US 12316958 B2 US12316958 B2 US 12316958B2
Authority
US
United States
Prior art keywords
video image
image data
imaging device
processor
setting condition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US18/064,572
Other languages
English (en)
Other versions
US20230114332A1 (en
Inventor
Shinya Fujiwara
Taro Saito
Tomoharu Shimada
Takehiro Koguchi
Yukinori Nishiyama
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujifilm Corp
Original Assignee
Fujifilm Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujifilm Corp filed Critical Fujifilm Corp
Assigned to FUJIFILM CORPORATION reassignment FUJIFILM CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: FUJIWARA, SHINYA, KOGUCHI, TAKEHIRO, NISHIYAMA, YUKINORI, SAITO, TARO, SHIMADA, TOMOHARU
Publication of US20230114332A1 publication Critical patent/US20230114332A1/en
Priority to US19/197,147 priority Critical patent/US20250267358A1/en
Application granted granted Critical
Publication of US12316958B2 publication Critical patent/US12316958B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/761—Proximity, similarity or dissimilarity measures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Definitions

  • the present invention relates to an imaging device, an imaging method, and a program.
  • the imaging device and an external recorder may be connected to each other, and video image data may be recorded in a storage area of the external recorder.
  • video image data may be recorded in a storage area of the external recorder.
  • a live view image captured by the imaging device is displayed on a display unit (monitor) of the external recorder.
  • JP2019-205062A discloses a technique of showing a relationship before and after conversion of image signals by displaying a relationship diagram.
  • a relationship between scales of signals before and after the conversion of the image signals and a relationship between signal values before and after the conversion of the image signals are shown by a bar graph displayed on the left and right. A user can know the relationship before and after the conversion of the image signals from this relationship diagram.
  • One embodiment according to the technology of the present disclosure provides an imaging device, an imaging method, and a program that allow a user to easily visually discriminate a difference between setting conditions by displaying video image data indicating the difference.
  • an imaging device comprising: a connection unit that is connectable to an external device; and a processor, in which the processor performs processing of generating first video image data from captured video image data on the basis of a first setting condition, processing of generating second video image data from the captured video image data on the basis of a second setting condition, processing of generating third video image data indicating a difference between the first setting condition and the second setting condition on the basis of the first video image data and the second video image data, and processing of outputting the third video image data to the external device via the connection unit.
  • the first setting condition is a condition set in the imaging device
  • the second setting condition is a condition set in the external device.
  • the processor generates the third video image data by alternately arranging a frame constituting the first video image data and a frame constituting the second video image data.
  • the processor generates the third video image data by alternately arranging a plurality of frames constituting the first video image data and a plurality of frames constituting the second video image data.
  • the processor generates the third video image data by combining a frame constituting the first video image data and a frame constituting the second video image data.
  • the processor generates the third video image data by combining the frame constituting the first video image data and the frame constituting the second video image data side by side.
  • the processor generates the third video image data by superimposing and combining the frame constituting the first video image data and the frame constituting the second video image data.
  • a display unit that displays display data under control of the processor is further provided, and the processor compares the first setting condition with the second setting condition and displays a comparison result on the display unit.
  • the processor compares the first setting condition with the second setting condition and displays the difference between the first setting condition and the second setting condition on the display unit as the comparison result.
  • the processor outputs the first video image data instead of the third video image data in a case where a signal of a recording start instruction for the external device is received via the connection unit.
  • the processor generates the third video image data after generating the first video image data and the second video image data.
  • the processor alternately generates the first video image data and the second video image data in conformity with the third video image data.
  • connection unit is wirelessly connected to the external device.
  • an imaging method using an imaging device that includes a connection unit, which is connectable to an external device, and a processor, the imaging method comprising: causing the processor to execute: a step of generating first video image data from captured video image data on the basis of a first setting condition; a step of generating second video image data from the captured video image data on the basis of a second setting condition; a step of generating third video image data indicating a difference between the first setting condition and the second setting condition on the basis of the first video image data and the second video image data; and a step of outputting the third video image data to the external device via the connection unit.
  • a program for performing an imaging method using an imaging device that includes a connection unit, which is connectable to an external device, and a processor, the program causing the processor to execute: a step of generating first video image data from captured video image data on the basis of a first setting condition; a step of generating second video image data from the captured video image data on the basis of a second setting condition; a step of generating third video image data indicating a difference between the first setting condition and the second setting condition on the basis of the first video image data and the second video image data; and a step of outputting the third video image data to the external device via the connection unit.
  • FIG. 1 is a diagram conceptually showing an imaging device and an external recorder connected to the imaging device.
  • FIG. 2 is a block diagram showing main functions of the imaging device and of the external recorder.
  • FIG. 3 is a block diagram showing a processing function of video image data realized by a CPU.
  • FIG. 4 is a schematic diagram showing an example of third video image data.
  • FIG. 5 is a flowchart illustrating an imaging method.
  • FIG. 6 is a flowchart illustrating an imaging method.
  • FIG. 7 is a schematic diagram showing an example of the third video image data.
  • FIG. 8 is a schematic diagram showing an example of the third video image data.
  • FIG. 9 is a schematic diagram showing an example of the third video image data.
  • FIG. 10 is a flowchart illustrating an imaging method.
  • FIG. 11 is a diagram showing a comparison result displayed on a rear monitor of the imaging device.
  • FIG. 12 is a block diagram showing functions of the imaging device and of the external recorder.
  • FIG. 13 is a flowchart illustrating an imaging method.
  • FIG. 1 is a diagram conceptually showing the imaging device and an external recorder connected to the imaging device.
  • An imaging device (digital camera) 1 is connected to an external recorder 3 through a High-Definition Multimedia Interface (HDMI (registered trademark)) cable 5 .
  • the imaging device 1 captures a video (video image data) and a still image in response to a command from an operation unit, such as a shutter button. Further, in an imaging preparation state, a live view image, which is display data, is displayed on a rear monitor (not shown) provided on a rear surface of the imaging device 1 and/or on a viewfinder (not shown) of the imaging device 1 .
  • the imaging device 1 has an HDMI output terminal, which is an example of a connection unit 109 ( FIG. 2 ), and is connected to the external recorder 3 via the HDMI cable 5 .
  • the imaging device 1 outputs the captured video image data to the external recorder 3 via the HDMI cable 5 .
  • the external recorder 3 is an example of an external device that is connectable to the imaging device 1 .
  • Another example of the external device includes an external monitor.
  • the external recorder 3 has an HDMI input terminal, which is an example of a connection unit 203 ( FIG. 2 ), and is connected to the imaging device 1 through the HDMI cable 5 .
  • the external recorder 3 acquires the video image data captured by the imaging device 1 via the HDMI cable 5 and records the acquired video image data in a recording unit 209 . Further, the external recorder 3 acquires the video image data captured by the imaging device 1 via the HDMI cable 5 and displays the acquired video image data on a display unit 207 .
  • the imaging device 1 and the external recorder 3 are connected to each other through the HDMI cable 5 , but the present invention is not limited to this example.
  • the imaging device 1 and the external recorder 3 may be connected through a Universal Serial Bus (USB) cable, or may be wirelessly connected using, for example, Wi-Fi as described later.
  • USB Universal Serial Bus
  • a type (standard) and a setting for processing video image data will be described.
  • ITU-R International Telecommunication Union-Radiocommunication Sector
  • Log video or video RAW Log video or video RAW that is independently defined by each camera manufacturer, or the like. Therefore, in order to display the video image data captured by the imaging device 1 on the display unit (monitor) 207 of the external recorder 3 with the correct color and brightness, it is necessary to change the monitor image quality setting of the external recorder 3 according to the video image quality setting of the imaging device 1 .
  • the “video image quality setting” and the “monitor image quality setting” are at least one of a color gamut, a gamma, a video range, a lookup table, or a brightness setting.
  • the video image quality setting of the imaging device 1 and the monitor image quality setting of the external recorder 3 may not match with each other.
  • the monitor image quality setting of the external recorder 3 may be BT.709.
  • the live view image displayed on the external recorder 3 that performs processing using BT.709 may become a picture having a darker exposure and a lower chroma saturation than the video image data of the imaging device 1 that performs processing using BT.2100.
  • the user may perform imaging by changing the video image quality setting of the imaging device 1 while viewing the live view image displayed on the display unit 207 of the external recorder 3 .
  • the user may perform imaging with a video image quality setting in which the chroma saturation is increased or the exposure is increased.
  • the video image data may have a too high chroma saturation or a too high exposure.
  • the user needs to confirm whether or not the image quality setting of the display unit 207 of the external recorder 3 is correctly set with respect to the video image quality setting of the imaging device 1 .
  • FIG. 2 is a block diagram showing the main functions of the imaging device 1 and of the external recorder 3 .
  • the imaging device 1 mainly comprises a lens 103 , an imaging element 105 , a central processing unit (CPU) (processor) 107 , a display unit 113 , a memory 111 , and the connection unit 109 .
  • the external recorder 3 mainly comprises the connection unit 203 , a CPU 205 , the display unit 207 , and the recording unit 209 .
  • the lens 103 forms a subject image (optical image) on the imaging element 105 .
  • the lens 103 has a control mechanism, such as a stop, and the imaging device 1 has, for example, a shutter for controlling the formation of the subject image on the imaging element 105 .
  • the imaging element 105 comprises a light-receiving surface in which a large number of light-receiving elements are arranged in a matrix form. Light corresponding to the subject image formed on the light-receiving surface of the imaging element 105 is received by each light-receiving element and is converted into an electrical signal. A color filter of red (R), green (G), or blue (B) is provided on the light-receiving surface of the imaging element 105 , and a color image of the subject can be acquired on the basis of a signal of each color.
  • CMOS complementary metal-oxide semiconductor
  • CCD charge-coupled device
  • the imaging element 105 performs noise removal, amplification, and the like of an analog image signal via an internal analog front-end (AFE) (not shown), and converts the analog image signal into a digital image signal with a gradation width via an internal analog/digital converter (A/D converter) (not shown) provided in the same manner.
  • AFE analog front-end
  • A/D converter internal analog/digital converter
  • the AFE and the A/D converter may be externally connected.
  • the video image data captured by the imaging device 1 is composed of data consisting of a plurality of frames, and each frame is generated as the digital image signal as described above.
  • the CPU 107 performs image processing on the digital image signal (a signal composed of the frame constituting the video image data).
  • the CPU 107 performs image processing, such as color signal separation, white balance adjustment, and gamma correction, on the digital image signal.
  • the CPU 107 performs each image processing on the digital image signal according to the type and the setting of the video described above. The image processing performed by the CPU 107 will be described later.
  • the CPU 107 performs other general control for the imaging device 1 .
  • the CPU 107 reads out necessary programs and information used to perform various types of control, from the memory 111 , to perform various types of processing and various types of control.
  • the memory 111 is an internal memory of the imaging device 1 , and stores programs necessary for various types of imaging of the imaging device 1 .
  • the CPU 107 controls the display of the display unit 113 . Specific examples of the display unit 113 include a rear monitor and an electronic viewfinder of the imaging device 1 .
  • connection unit 109 of the imaging device 1 and the connection unit 203 of the external recorder 3 are connected to each other by the HDMI cable 5 .
  • the video image data is input from the imaging device 1 to the connection unit 203 of the external recorder 3 .
  • the external recorder 3 records the input video image data in the recording unit 209 .
  • the CPU 205 displays the input video image data on the display unit 207 .
  • the connection unit is connected to the display unit 207 by way of the CPU 205 , but the display unit 207 may be connected to the connection unit 203 , and, for example, the CPU 205 may control the display unit.
  • the CPU 205 performs general control including recording control of the external recorder 3 to the recording unit 209 described above.
  • the CPU 205 reads out necessary programs and information used to perform various types of control, from a memory (not shown) of the external recorder 3 , to perform various types of processing and various types of control performed by the CPU 205 .
  • the hardware structures of the CPU 107 and the CPU 205 are various processors as described below.
  • the various processors include, for example, a CPU which is a general-purpose processor that executes software (programs) to act as various functional units, a programmable logic device (PLD) which is a processor having a changeable circuit configuration after manufacture, such as a field programmable gate array (FPGA), and a dedicated electric circuit which is a processor having a dedicated circuit configuration designed to execute specific processing, such as an application specific integrated circuit (ASIC).
  • a CPU which is a general-purpose processor that executes software (programs) to act as various functional units
  • PLD programmable logic device
  • FPGA field programmable gate array
  • ASIC application specific integrated circuit
  • One functional unit may be composed of one of these various processors or may be composed of a combination of two or more processors of the same type or different types (for example, a plurality of FPGAs or a combination of the CPU and the FPGA).
  • the plurality of functional units may be composed of one processor.
  • a first example in which the plurality of functional units are composed of one processor is an aspect in which one or more CPUs and software are combined to constitute one processor and the processor acts as the plurality of functional units, as typified by a computer used for a client, a server, or the like.
  • a second example is an aspect in which a processor that realizes the functions of the entire system including a plurality of functional units with one integrated circuit (IC) chip is used, as typified by system on chip (SoC) and the like.
  • IC integrated circuit
  • SoC system on chip
  • various functional units are composed of one or more of the various processors described above as the hardware structure.
  • FIG. 3 is a block diagram showing a processing function of the video image data realized by the CPU 107 .
  • the CPU 107 comprises a first video image data processing unit 121 , a second video image data processing unit 123 , and a third video image data processing unit 125 .
  • the first video image data processing unit 121 processes video image data (RAW) on the basis of the video image quality setting (first setting condition).
  • the video image data (RAW) is video image data that has not yet been subjected to image processing, and is data that has the information of the subject image captured by the imaging element 105 as it is.
  • the video image quality setting is a condition set in the imaging device 1 , and the first video image data processed with the video image quality setting is used for the video image data to be recorded or for the live view image.
  • the video image quality setting is hybrid log-gamma (HLG) or perceptual quantization (PQ) of BT.2100.
  • the second video image data processing unit 123 processes the video image data (RAW) on the basis of the monitor image quality setting (second setting condition).
  • the monitor image quality setting is a condition set in the external recorder 3 , and the second video image data processed with the monitor image quality setting is displayed on the display unit 207 of the external recorder 3 .
  • the second video image data processing unit 123 processes the video image data (RAW) on the basis of BT.709.
  • the third video image data processing unit 125 generates third video image data indicating a difference between the video image quality setting and the monitor image quality setting, on the basis of the first video image data and the second video image data. The user can visually easily discriminate the difference between the video image quality setting and the monitor image quality setting by viewing the third video image data.
  • the first video image data and the second video image data have a different image quality therebetween. Therefore, the user can easily visually discriminate the different image quality by viewing the third video image data displayed on the display unit 207 .
  • the first video image data and the second video image data have the same image quality. Therefore, the user can easily visually discriminate the same image quality by viewing the third video image data displayed on the display unit 207 .
  • FIG. 4 is a schematic diagram showing an example of the third video image data.
  • Third video image data V 3 ( 1 ) is generated by alternately arranging a plurality of first frames VF 1 constituting first video image data V 1 and a plurality of second frames VF 2 constituting second video image data V 2 in chronological order.
  • the first frame VF 1 and the second frame VF 2 are arranged every 5 frames in chronological order.
  • the first frame VF 1 is processed by the video image quality setting
  • the second frame VF 2 is processed by the monitor image quality setting.
  • the first frame VF 1 and the second frame VF 2 have a different image quality therebetween.
  • the third video image data V 3 ( 1 ) is displayed on the display unit 207 , the first frame VF 1 and the second frame VF 2 having a different image quality are repeatedly displayed at a predetermined interval. Therefore, since the image quality of the displayed third video image data V 3 ( 1 ) is repeatedly changed, the user can easily visually discriminate that the video image quality setting and the monitor image quality setting are different from each other.
  • the first frame VF 1 and the second frame VF 2 have the same image quality. Therefore, since the image quality of the third video image data V 3 ( 1 ) is stably displayed without being changed, the user can easily visually discriminate that the video image quality setting and the monitor image quality setting are the same.
  • the plurality of first frames VF 1 and the plurality of second frames VF 2 are alternately arranged in chronological order as shown in FIG. 4 .
  • the first video image data (the plurality of first frames VF 1 ) and the second video image data (the plurality of second frames VF 2 ) may be alternately arranged every second.
  • the third video image data V 3 ( 1 ) may be formed by alternately arranging the first frame VF 1 and the second frame VF 2 every single frame.
  • FIG. 5 is a flowchart illustrating an imaging method (and a program for executing the imaging method) using the imaging device 1 to which the external recorder 3 is connected.
  • the first video image data processing unit 121 of the imaging device 1 acquires a video image quality setting “MV_SET” of the imaging device 1 (step S 101 ).
  • a monitor image quality setting “MON_SET” of the external recorder 3 is transmitted from the external recorder 3 (CPU 205 ) to the imaging device 1 via the HDMI cable 5 , and the second video image data processing unit 123 of the imaging device 1 acquires the monitor image quality setting “MON_SET” (step S 102 ).
  • the CPU 107 acquires the video image data (RAW) from the imaging element 105 (step S 103 ). Specifically, the frames constituting the video image data (RAW) are acquired in the order of frame numbers in chronological order. After that, the CPU 107 receives the signal of the recording start instruction and determines whether or not video recording is being performed (step S 104 ). In a case where the CPU 107 determines that the video recording is being performed, the first video image data processing unit 121 of the imaging device 1 generates the first video image data corresponding to the “MV_SET” and transmits the first video image data to the external recorder 3 (step S 105 ).
  • the third video image data processing unit 125 determines whether or not the number calculated by the following expression is an even number (step S 111 ). Int(Frame/n) Expression:
  • Int ( ⁇ ) in the expression means truncating a decimal fraction of the number ⁇ in parentheses
  • Frame means a frame number of the video image data (RAW)
  • n means a frame period of processing switching. The user can arbitrarily decide the frame period n of the processing switching.
  • the first video image data processing unit 121 In a case where the CPU 107 determines that the number calculated by the expression is an even number, the first video image data processing unit 121 generates the first video image data corresponding to the “MV_SET” and transmits the first video image data to the third video image data processing unit 125 (step S 112 ). On the other hand, in a case where the CPU 107 determines that the number calculated by the expression is not an even number, the second video image data processing unit 123 generates the second video image data corresponding to the “MON_SET”, and transmits the second video image data to the third video image data processing unit 125 (step S 113 ).
  • the third video image data processing unit 125 generates the third video image data by using the generated first and second video image data, and transmits the third video image data to the external recorder 3 (step S 114 ).
  • the first video image data and the second video image data are generated by being switched therebetween according to the number of Frame (frame number)/n (frame period of processing switching), and then the third video image data is generated.
  • the third video image data is generated.
  • the CPU 107 determines whether or not the video image quality setting of the imaging device 1 has been updated (step S 106 ). In a case where the video image quality setting of the imaging device 1 has been updated, the CPU 107 updates the “MV_SET” of the imaging device 1 (step S 107 ).
  • the CPU 107 determines whether or not the monitor image quality setting of the external recorder 3 has been updated (step S 108 ). After that, the updated “MON_SET” is transmitted from the external recorder 3 to the imaging device 1 (step S 109 ). After that, the CPU 107 determines whether or not the video mode has ended (step S 110 ), and in a case where the video mode has not ended, the process returns to step S 103 , and the next frame of the video image data (RAW) is processed.
  • the third video image data processing unit 125 generates the third video image data in which the plurality of first frames VF 1 and the plurality of second frames VF 2 are alternately arranged. Then, the user can easily visually discriminate whether or not the video image quality setting and the monitor image quality setting are correctly set by viewing the third video image data displayed on the display unit 207 of the external recorder 3 .
  • each of the above-mentioned configurations and functions can be appropriately realized by using any hardware, software, or a combination of both.
  • the CPU 107 may perform the video image data processing instead of each video image data processing unit.
  • the present invention can also be applied to a program causing a computer to execute the above-mentioned processing steps (processing procedures), a computer-readable recording medium (non-transitory recording medium) on which such a program is recorded, or a computer on which such a program can be installed.
  • the first video image data or the second video image data is generated in conformity with the frame numbers of the frames constituting the video image data (RAW) (see steps S 111 to S 113 of FIG. 5 ).
  • the first video image data and the second video image data are generated together for the frames constituting the video image data (RAW).
  • FIG. 6 is a flowchart illustrating an imaging method (and a program for executing the imaging method) using the imaging device 1 to which the external recorder 3 is connected.
  • the first video image data processing unit 121 of the imaging device 1 acquires the video image quality setting “MV_SET” of the imaging device 1 (step S 201 ).
  • the monitor image quality setting “MON_SET” of the external recorder 3 is transmitted from the external recorder 3 (CPU 205 ) to the imaging device 1 via the HDMI cable 5 , and the second video image data processing unit 123 of the imaging device 1 acquires the monitor image quality setting “MON_SET” (step S 202 ).
  • the CPU 107 acquires the video image data (RAW) from the imaging element 105 (step S 203 ).
  • the first video image data processing unit 121 generates the first video image data of the “MV_SET” (step S 204 ).
  • the second video image data processing unit 123 generates the second video image data of the “MON_SET” (step S 205 ).
  • the CPU 107 receives the signal of the recording start instruction and determines whether or not video recording is being performed (step S 206 ).
  • the first video image data processing unit 121 generates the first video image data corresponding to the “MV_SET” and transmits the first video image data to the external recorder 3 (step S 207 ).
  • the third video image data processing unit 125 determines whether or not the number calculated by the above-mentioned expression (see step S 111 of FIG. 5 ) is an even number (step S 213 ).
  • the first video image data processing unit 121 of the imaging device 1 transmits the first video image data corresponding to the “MV_SET” to the third video image data processing unit 125 (step S 214 ).
  • the second video image data processing unit 123 of the imaging device 1 transmits the second video image data corresponding to the “MON_SET” to the third video image data processing unit 125 (step S 215 ).
  • the third video image data processing unit 125 generates the third video image data by using the generated first and second video image data, and transmits the third video image data to the external recorder 3 (step S 216 ).
  • the first video image data and the second video image data are generated together for the frames constituting the video image data (RAW).
  • the first video image data and the second video image data are provided for all the frames constituting the video image data (RAW).
  • the third video image data processing unit 125 also generates the third video image data in which the plurality of first frames VF 1 constituting the first video image data V 1 and the plurality of second frames VF 2 constituting the second video image data V 2 are alternately arranged. Since the third video image data is displayed on the display unit 207 of the external recorder 3 , the user can easily visually discriminate whether or not the video image quality setting of the imaging device 1 and the monitor image quality setting of the display unit 207 of the external recorder 3 are correctly set.
  • the third video image data (third frame VF 3 ) is generated by combining the first frame VF 1 and the second frame VF 2 . That is, in the present embodiment, the third video image data indicating the difference between the video image quality setting and the monitor image quality setting is generated by combining the first frame and the second frame.
  • FIG. 7 is a schematic diagram showing an example of the third video image data of the present embodiment.
  • a third frame VF 3 ( 2 ) constituting the third video image data shown in FIG. 7 is obtained by combining the first frame VF 1 constituting the first video image data and the second frame VF 2 constituting the second video image data side by side.
  • the third frame VF 3 ( 2 ) is formed by disposing the first frame VF 1 on a left side and the second frame VF 2 on a right side side by side when facing the third frame VF 3 ( 2 ) to combine the first frame VF 1 and the second frame VF 2 .
  • the first frame VF 1 and the second frame VF 2 are arranged, so that the user can easily visually discriminate the difference between the video image quality setting and the monitor image quality setting.
  • FIG. 8 is a schematic diagram showing an example of the third video image data of the present embodiment.
  • a third frame VF 3 ( 3 ) constituting the third video image data shown in FIG. 8 is obtained by superimposing and combining the first frame VF 1 constituting the first video image data and the second frame VF 2 constituting the second video image data.
  • the third frame VF 3 ( 3 ) is formed by superimposing and displaying the second frame VF 2 on a part of a region of the first frame VF 1 .
  • the second frame VF 2 is superimposed and displayed on a part of the region of the first frame VF 1 , so that the user can easily visually discriminate the difference between the video image quality setting and the monitor image quality setting.
  • FIG. 9 is a schematic diagram showing an example of the third video image data of the present embodiment.
  • a third frame VF 3 ( 4 ) constituting the third video image data shown in FIG. 9 is obtained by combining a part of the first frame VF 1 constituting the first video image data and a part of the second frame VF 2 constituting the second video image data.
  • the third frame VF 3 ( 4 ) is formed by combining an image of a left half of the first frame VF 1 and an image of a right half of the second frame VF 2 side by side when facing the third frame VF 3 ( 4 ). In this way, the image of the left half of the first frame VF 1 and the image of the right half of the second frame VF 2 are combined, so that the user can easily visually discriminate the difference between the video image quality setting and the monitor image quality setting.
  • FIG. 10 is a flowchart illustrating an imaging method (and a program for executing the imaging method) according to the present embodiment.
  • the first video image data processing unit 121 of the imaging device 1 acquires the video image quality setting “MV_SET” of the imaging device 1 (step S 301 ).
  • the monitor image quality setting “MON_SET” of the external recorder 3 is transmitted from the external recorder 3 (CPU 205 ) to the imaging device 1 via the HDMI cable 5 , and the second video image data processing unit 123 of the imaging device 1 acquires the monitor image quality setting “MON_SET” (step S 302 ).
  • the CPU 107 acquires the video image data (RAW) from the imaging element 105 (step S 303 ). Then, the first video image data processing unit 121 generates the first video image data corresponding to the “MV_SET” (step S 304 ). In addition, the second video image data processing unit 123 generates the second video image data corresponding to the “MON_SET” (step S 305 ).
  • the CPU 107 receives the signal of the recording start instruction and determines whether or not video recording is being performed (step S 306 ).
  • the first video image data processing unit 121 transmits the first video image data to the external recorder 3 (step S 307 ).
  • the third video image data processing unit 125 generates the third video image data in which the first video image data and the second video image data are combined (step S 313 ). After that, the third video image data is transmitted from the imaging device 1 to the external recorder 3 (step S 314 ).
  • the third video image data processing unit 125 generates the third video image data in which the first frame VF 1 and the second frame VF 2 are combined. Then, the user checks the third video image data displayed on the display unit 207 of the external recorder 3 , so that the user can easily visually discriminate whether or not the video image quality setting of the imaging device 1 and the monitor image quality setting of the display unit 207 of the external recorder 3 are correctly set.
  • the CPU 107 displays a comparison result between the video image quality setting and the monitor image quality setting on the display unit (the rear monitor or the electronic viewfinder) 113 of the imaging device 1 .
  • FIG. 11 is a diagram showing the comparison result displayed on the rear monitor of the imaging device 1 .
  • the CPU 107 displays a comparison result 7 between the video image quality setting and the monitor image quality setting on the rear monitor.
  • the video mode is “BT.2100”, and the video range is “Limited”, in the video image quality setting of the imaging device 1 .
  • the video mode is “BT.709”, and the video range is “Limited”, in the monitor image quality setting of the external recorder 3 .
  • “match” (or “OK”) is displayed in a case where the video image quality setting of the imaging device 1 and the monitor image quality setting of the external recorder 3 match with each other
  • “no match” (or “NG”) is displayed in a case where the video image quality setting of the imaging device 1 and the monitor image quality setting of the external recorder 3 do not match with each other.
  • the imaging device 1 and the external recorder 3 are wirelessly connected to each other.
  • FIG. 12 is a block diagram showing the functions of the imaging device 1 and of the external recorder 3 of this example.
  • the parts already illustrated in FIG. 2 are designated by the same reference numerals, and the description thereof will be omitted.
  • the imaging device 1 and the external recorder 3 are wirelessly connected to each other.
  • the connection unit 109 has a communication unit (antenna) 110 A and is wirelessly connected to a communication unit (antenna) 110 B to transmit the captured video image data to the external recorder 3 .
  • Specific examples of the wireless connection include connection through Wi-Fi, ultra-wideband (UWB), wireless HDMI, and a wireless serial digital interface (SDI).
  • control is performed on the imaging device 1 side such that a live view image that enables checking of the exposure and the color is obtained even in a case where the monitor image quality setting of the external recorder 3 and the video image quality setting of the imaging device 1 are different from each other.
  • this example is effective in a case where the monitor image quality setting of the external recorder 3 that matches with the video image quality setting of the imaging device 1 does not exist.
  • FIG. 13 is a flowchart illustrating the imaging method of this example (and a program for executing the imaging method).
  • the first video image data processing unit 121 of the imaging device 1 acquires the video image quality setting “MV_SET” of the imaging device 1 (step S 401 ).
  • the monitor image quality setting “MON_SET” of the external recorder 3 is transmitted from the external recorder 3 to the imaging device 1 , and the second video image data processing unit 123 of the imaging device 1 acquires the monitor image quality setting “MON_SET” (step S 402 ).
  • the imaging device 1 acquires the video image data (RAW) from the imaging element 105 (step S 403 ).
  • the first video image data processing unit 121 generates the first video image data through first image processing corresponding to the “MV_SET” (step S 404 ).
  • the second video image data processing unit 123 generates the second video image data through second image processing corresponding to the “MON_SET” (step S 405 ).
  • the first video image data is transmitted from the imaging device 1 to the external recorder 3 (step S 406 ).
  • the second video image data is transmitted from the imaging device 1 to the external recorder 3 (step S 407 ).
  • the CPU 107 determines whether or not video recording is being performed (step S 408 ). In a case where the CPU 107 determines that the video recording is being performed, the external recorder 3 records the first video image data (step S 409 ). On the other hand, in a case where the CPU 107 determines that the video recording is not being performed, the external recorder 3 displays the second video image data on the display unit (monitor) 207 (step S 410 ).
  • the imaging device 1 generates the first video image data of the video image quality setting and the second video image data of the monitor image quality setting and transmits the first and second video image data to the external recorder 3 .
  • the external recorder 3 records the first video image data in a case of performing video recording, and displays the second video image data on the display unit (monitor) 207 .
  • the live view image that enables checking of the exposure and the color can be displayed on the display unit 207 even in a case where the monitor image quality setting of the external recorder 3 that matches with the video image quality setting of the imaging device 1 does not exist.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Evolutionary Computation (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Studio Devices (AREA)
  • Television Signal Processing For Recording (AREA)
US18/064,572 2020-06-30 2022-12-12 Imaging device, imaging method, and program Active 2042-01-26 US12316958B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US19/197,147 US20250267358A1 (en) 2020-06-30 2025-05-02 Imaging device, imaging method, and program

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2020-112549 2020-06-30
JP2020112549 2020-06-30
PCT/JP2021/024053 WO2022004570A1 (ja) 2020-06-30 2021-06-25 撮像装置、撮像方法、及びプログラム

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/024053 Continuation WO2022004570A1 (ja) 2020-06-30 2021-06-25 撮像装置、撮像方法、及びプログラム

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US19/197,147 Continuation US20250267358A1 (en) 2020-06-30 2025-05-02 Imaging device, imaging method, and program

Publications (2)

Publication Number Publication Date
US20230114332A1 US20230114332A1 (en) 2023-04-13
US12316958B2 true US12316958B2 (en) 2025-05-27

Family

ID=79316031

Family Applications (2)

Application Number Title Priority Date Filing Date
US18/064,572 Active 2042-01-26 US12316958B2 (en) 2020-06-30 2022-12-12 Imaging device, imaging method, and program
US19/197,147 Pending US20250267358A1 (en) 2020-06-30 2025-05-02 Imaging device, imaging method, and program

Family Applications After (1)

Application Number Title Priority Date Filing Date
US19/197,147 Pending US20250267358A1 (en) 2020-06-30 2025-05-02 Imaging device, imaging method, and program

Country Status (5)

Country Link
US (2) US12316958B2 (cg-RX-API-DMAC7.html)
JP (1) JP7352028B2 (cg-RX-API-DMAC7.html)
CN (1) CN115769591B (cg-RX-API-DMAC7.html)
DE (1) DE112021003484T5 (cg-RX-API-DMAC7.html)
WO (1) WO2022004570A1 (cg-RX-API-DMAC7.html)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070030374A1 (en) * 2005-08-02 2007-02-08 Olympus Corporation Electronic image capturing apparatus, control method of electronic image capturing apparatus, and image processing apparatus
US20100194917A1 (en) * 2009-02-03 2010-08-05 Kenji Funamoto Imaging apparatus and live-view image display method thereof
JP2010172462A (ja) 2009-01-29 2010-08-12 Toshiba Corp 医用画像表示装置
US8379130B2 (en) * 2009-08-07 2013-02-19 Qualcomm Incorporated Apparatus and method of processing images based on an adjusted value of an image processing parameter
US20130286207A1 (en) * 2012-04-25 2013-10-31 Sony Corporation Imaging apparatus, imaging processing method, image processing device and imaging processing system
US20160337600A1 (en) 2015-05-13 2016-11-17 Olympus Corporation Imaging device and imaging method
US20180077332A1 (en) 2016-09-09 2018-03-15 Olympus Corporation Imaging apparatus and imaging method
US20190287450A1 (en) * 2018-03-15 2019-09-19 Canon Kabushiki Kaisha Display apparatus and control method thereof
JP2019205062A (ja) 2018-05-23 2019-11-28 キヤノン株式会社 画像処理装置およびその制御方法ならびにプログラム

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5476150B2 (ja) * 2010-02-10 2014-04-23 富士フイルム株式会社 画像処理装置、画像処理方法、画像処理プログラムおよび記録媒体

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070030374A1 (en) * 2005-08-02 2007-02-08 Olympus Corporation Electronic image capturing apparatus, control method of electronic image capturing apparatus, and image processing apparatus
JP2010172462A (ja) 2009-01-29 2010-08-12 Toshiba Corp 医用画像表示装置
US20100194917A1 (en) * 2009-02-03 2010-08-05 Kenji Funamoto Imaging apparatus and live-view image display method thereof
JP2010183173A (ja) 2009-02-03 2010-08-19 Fujifilm Corp 撮像装置及びそのスルー画像表示方法
US8379130B2 (en) * 2009-08-07 2013-02-19 Qualcomm Incorporated Apparatus and method of processing images based on an adjusted value of an image processing parameter
JP2013229699A (ja) 2012-04-25 2013-11-07 Sony Corp 撮像装置、撮像処理方法、画像処理装置および撮像処理システム
US20130286207A1 (en) * 2012-04-25 2013-10-31 Sony Corporation Imaging apparatus, imaging processing method, image processing device and imaging processing system
US20160337600A1 (en) 2015-05-13 2016-11-17 Olympus Corporation Imaging device and imaging method
CN106161975A (zh) 2015-05-13 2016-11-23 奥林巴斯株式会社 摄像装置和摄像方法
US20180077332A1 (en) 2016-09-09 2018-03-15 Olympus Corporation Imaging apparatus and imaging method
CN107809579A (zh) 2016-09-09 2018-03-16 奥林巴斯株式会社 摄像装置和摄像方法
US20190287450A1 (en) * 2018-03-15 2019-09-19 Canon Kabushiki Kaisha Display apparatus and control method thereof
JP2019205062A (ja) 2018-05-23 2019-11-28 キヤノン株式会社 画像処理装置およびその制御方法ならびにプログラム
US20190364222A1 (en) 2018-05-23 2019-11-28 Canon Kabushiki Kaisha Image processing apparatus, control method thereof, and storage medium

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Chinese Office Action and Search Report for Chinese Application No. 202180045791.8, dated Nov. 29, 2024, with an English translation.
International Preliminary Report on Patentability and Written Opinion of the International Searching Authority for International Application No. PCT/JP2021/024053, dated Jan. 12, 2023, with an English translation.
International Search Report for International Application No. PCT/JP2021/024053, dated Sep. 14, 2021, with an English translation.

Also Published As

Publication number Publication date
CN115769591A (zh) 2023-03-07
JPWO2022004570A1 (cg-RX-API-DMAC7.html) 2022-01-06
JP7352028B2 (ja) 2023-09-27
CN115769591B (zh) 2025-08-12
WO2022004570A1 (ja) 2022-01-06
US20250267358A1 (en) 2025-08-21
DE112021003484T5 (de) 2023-04-27
US20230114332A1 (en) 2023-04-13

Similar Documents

Publication Publication Date Title
US10237514B2 (en) Camera system, video processing apparatus, and camera apparatus
US10896634B2 (en) Image signal processing apparatus and control method therefor
JP2010093472A (ja) 撮像装置および撮像装置用信号処理回路
US20260030715A1 (en) Video imaging apparatus, video imaging method, and video imaging program
US8063950B2 (en) Imaging apparatus, waveform signal display method, storage medium, and integrated circuit
US10880491B2 (en) Imaging apparatus including controller for converting dynamic range image data
US20230114332A1 (en) Imaging device, imaging method, and program
US11165956B2 (en) Imaging apparatus
JP7803906B2 (ja) 画像処理装置、撮像装置、画像処理方法、画像処理プログラム及び記録媒体
US20040021789A1 (en) Photographing system
JP2024109720A (ja) 動画制御装置、動画記録装置、動画制御方法、動画記録方法、及び動画制御プログラム
JP5340456B2 (ja) 撮像装置及びその制御方法、プログラム並びに記憶媒体
JP2008219738A (ja) 撮像装置
CN101127920B (zh) 数字成像装置的彩色处理参数设置
JP2001160915A (ja) デジタルカメラ
JP6796723B2 (ja) 撮像装置及びその駆動方法
WO2019053764A1 (ja) 撮像装置
JP3994534B2 (ja) 信号処理装置及び信号処理方法
EP1033887A2 (en) Video signal, processing circuit, viewfinder apparatus, television camera, and image monitor apparatus
JP4124875B2 (ja) デジタル出力可能な電子内視鏡装置
JP2000278677A (ja) 電子内視鏡装置
JPH10145650A (ja) 撮像装置
JP2000079094A (ja) デジタル出力可能な電子内視鏡装置
JP2020120311A (ja) 画像処理装置、画像処理方法およびプログラム
JPH08339173A (ja) コンピュータ入力画像調整装置

Legal Events

Date Code Title Description
FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: FUJIFILM CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FUJIWARA, SHINYA;SAITO, TARO;SHIMADA, TOMOHARU;AND OTHERS;REEL/FRAME:062064/0329

Effective date: 20221013

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STCF Information on status: patent grant

Free format text: PATENTED CASE