US12316958B2 - Imaging device, imaging method, and program - Google Patents
Imaging device, imaging method, and program Download PDFInfo
- Publication number
- US12316958B2 US12316958B2 US18/064,572 US202218064572A US12316958B2 US 12316958 B2 US12316958 B2 US 12316958B2 US 202218064572 A US202218064572 A US 202218064572A US 12316958 B2 US12316958 B2 US 12316958B2
- Authority
- US
- United States
- Prior art keywords
- video image
- image data
- imaging device
- processor
- setting condition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/761—Proximity, similarity or dissimilarity measures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Definitions
- the present invention relates to an imaging device, an imaging method, and a program.
- the imaging device and an external recorder may be connected to each other, and video image data may be recorded in a storage area of the external recorder.
- video image data may be recorded in a storage area of the external recorder.
- a live view image captured by the imaging device is displayed on a display unit (monitor) of the external recorder.
- JP2019-205062A discloses a technique of showing a relationship before and after conversion of image signals by displaying a relationship diagram.
- a relationship between scales of signals before and after the conversion of the image signals and a relationship between signal values before and after the conversion of the image signals are shown by a bar graph displayed on the left and right. A user can know the relationship before and after the conversion of the image signals from this relationship diagram.
- One embodiment according to the technology of the present disclosure provides an imaging device, an imaging method, and a program that allow a user to easily visually discriminate a difference between setting conditions by displaying video image data indicating the difference.
- an imaging device comprising: a connection unit that is connectable to an external device; and a processor, in which the processor performs processing of generating first video image data from captured video image data on the basis of a first setting condition, processing of generating second video image data from the captured video image data on the basis of a second setting condition, processing of generating third video image data indicating a difference between the first setting condition and the second setting condition on the basis of the first video image data and the second video image data, and processing of outputting the third video image data to the external device via the connection unit.
- the first setting condition is a condition set in the imaging device
- the second setting condition is a condition set in the external device.
- the processor generates the third video image data by alternately arranging a frame constituting the first video image data and a frame constituting the second video image data.
- the processor generates the third video image data by alternately arranging a plurality of frames constituting the first video image data and a plurality of frames constituting the second video image data.
- the processor generates the third video image data by combining a frame constituting the first video image data and a frame constituting the second video image data.
- the processor generates the third video image data by combining the frame constituting the first video image data and the frame constituting the second video image data side by side.
- the processor generates the third video image data by superimposing and combining the frame constituting the first video image data and the frame constituting the second video image data.
- a display unit that displays display data under control of the processor is further provided, and the processor compares the first setting condition with the second setting condition and displays a comparison result on the display unit.
- the processor compares the first setting condition with the second setting condition and displays the difference between the first setting condition and the second setting condition on the display unit as the comparison result.
- the processor outputs the first video image data instead of the third video image data in a case where a signal of a recording start instruction for the external device is received via the connection unit.
- the processor generates the third video image data after generating the first video image data and the second video image data.
- the processor alternately generates the first video image data and the second video image data in conformity with the third video image data.
- connection unit is wirelessly connected to the external device.
- an imaging method using an imaging device that includes a connection unit, which is connectable to an external device, and a processor, the imaging method comprising: causing the processor to execute: a step of generating first video image data from captured video image data on the basis of a first setting condition; a step of generating second video image data from the captured video image data on the basis of a second setting condition; a step of generating third video image data indicating a difference between the first setting condition and the second setting condition on the basis of the first video image data and the second video image data; and a step of outputting the third video image data to the external device via the connection unit.
- a program for performing an imaging method using an imaging device that includes a connection unit, which is connectable to an external device, and a processor, the program causing the processor to execute: a step of generating first video image data from captured video image data on the basis of a first setting condition; a step of generating second video image data from the captured video image data on the basis of a second setting condition; a step of generating third video image data indicating a difference between the first setting condition and the second setting condition on the basis of the first video image data and the second video image data; and a step of outputting the third video image data to the external device via the connection unit.
- FIG. 1 is a diagram conceptually showing an imaging device and an external recorder connected to the imaging device.
- FIG. 2 is a block diagram showing main functions of the imaging device and of the external recorder.
- FIG. 3 is a block diagram showing a processing function of video image data realized by a CPU.
- FIG. 4 is a schematic diagram showing an example of third video image data.
- FIG. 5 is a flowchart illustrating an imaging method.
- FIG. 6 is a flowchart illustrating an imaging method.
- FIG. 7 is a schematic diagram showing an example of the third video image data.
- FIG. 8 is a schematic diagram showing an example of the third video image data.
- FIG. 9 is a schematic diagram showing an example of the third video image data.
- FIG. 10 is a flowchart illustrating an imaging method.
- FIG. 11 is a diagram showing a comparison result displayed on a rear monitor of the imaging device.
- FIG. 12 is a block diagram showing functions of the imaging device and of the external recorder.
- FIG. 13 is a flowchart illustrating an imaging method.
- FIG. 1 is a diagram conceptually showing the imaging device and an external recorder connected to the imaging device.
- An imaging device (digital camera) 1 is connected to an external recorder 3 through a High-Definition Multimedia Interface (HDMI (registered trademark)) cable 5 .
- the imaging device 1 captures a video (video image data) and a still image in response to a command from an operation unit, such as a shutter button. Further, in an imaging preparation state, a live view image, which is display data, is displayed on a rear monitor (not shown) provided on a rear surface of the imaging device 1 and/or on a viewfinder (not shown) of the imaging device 1 .
- the imaging device 1 has an HDMI output terminal, which is an example of a connection unit 109 ( FIG. 2 ), and is connected to the external recorder 3 via the HDMI cable 5 .
- the imaging device 1 outputs the captured video image data to the external recorder 3 via the HDMI cable 5 .
- the external recorder 3 is an example of an external device that is connectable to the imaging device 1 .
- Another example of the external device includes an external monitor.
- the external recorder 3 has an HDMI input terminal, which is an example of a connection unit 203 ( FIG. 2 ), and is connected to the imaging device 1 through the HDMI cable 5 .
- the external recorder 3 acquires the video image data captured by the imaging device 1 via the HDMI cable 5 and records the acquired video image data in a recording unit 209 . Further, the external recorder 3 acquires the video image data captured by the imaging device 1 via the HDMI cable 5 and displays the acquired video image data on a display unit 207 .
- the imaging device 1 and the external recorder 3 are connected to each other through the HDMI cable 5 , but the present invention is not limited to this example.
- the imaging device 1 and the external recorder 3 may be connected through a Universal Serial Bus (USB) cable, or may be wirelessly connected using, for example, Wi-Fi as described later.
- USB Universal Serial Bus
- a type (standard) and a setting for processing video image data will be described.
- ITU-R International Telecommunication Union-Radiocommunication Sector
- Log video or video RAW Log video or video RAW that is independently defined by each camera manufacturer, or the like. Therefore, in order to display the video image data captured by the imaging device 1 on the display unit (monitor) 207 of the external recorder 3 with the correct color and brightness, it is necessary to change the monitor image quality setting of the external recorder 3 according to the video image quality setting of the imaging device 1 .
- the “video image quality setting” and the “monitor image quality setting” are at least one of a color gamut, a gamma, a video range, a lookup table, or a brightness setting.
- the video image quality setting of the imaging device 1 and the monitor image quality setting of the external recorder 3 may not match with each other.
- the monitor image quality setting of the external recorder 3 may be BT.709.
- the live view image displayed on the external recorder 3 that performs processing using BT.709 may become a picture having a darker exposure and a lower chroma saturation than the video image data of the imaging device 1 that performs processing using BT.2100.
- the user may perform imaging by changing the video image quality setting of the imaging device 1 while viewing the live view image displayed on the display unit 207 of the external recorder 3 .
- the user may perform imaging with a video image quality setting in which the chroma saturation is increased or the exposure is increased.
- the video image data may have a too high chroma saturation or a too high exposure.
- the user needs to confirm whether or not the image quality setting of the display unit 207 of the external recorder 3 is correctly set with respect to the video image quality setting of the imaging device 1 .
- FIG. 2 is a block diagram showing the main functions of the imaging device 1 and of the external recorder 3 .
- the imaging device 1 mainly comprises a lens 103 , an imaging element 105 , a central processing unit (CPU) (processor) 107 , a display unit 113 , a memory 111 , and the connection unit 109 .
- the external recorder 3 mainly comprises the connection unit 203 , a CPU 205 , the display unit 207 , and the recording unit 209 .
- the lens 103 forms a subject image (optical image) on the imaging element 105 .
- the lens 103 has a control mechanism, such as a stop, and the imaging device 1 has, for example, a shutter for controlling the formation of the subject image on the imaging element 105 .
- the imaging element 105 comprises a light-receiving surface in which a large number of light-receiving elements are arranged in a matrix form. Light corresponding to the subject image formed on the light-receiving surface of the imaging element 105 is received by each light-receiving element and is converted into an electrical signal. A color filter of red (R), green (G), or blue (B) is provided on the light-receiving surface of the imaging element 105 , and a color image of the subject can be acquired on the basis of a signal of each color.
- CMOS complementary metal-oxide semiconductor
- CCD charge-coupled device
- the imaging element 105 performs noise removal, amplification, and the like of an analog image signal via an internal analog front-end (AFE) (not shown), and converts the analog image signal into a digital image signal with a gradation width via an internal analog/digital converter (A/D converter) (not shown) provided in the same manner.
- AFE analog front-end
- A/D converter internal analog/digital converter
- the AFE and the A/D converter may be externally connected.
- the video image data captured by the imaging device 1 is composed of data consisting of a plurality of frames, and each frame is generated as the digital image signal as described above.
- the CPU 107 performs image processing on the digital image signal (a signal composed of the frame constituting the video image data).
- the CPU 107 performs image processing, such as color signal separation, white balance adjustment, and gamma correction, on the digital image signal.
- the CPU 107 performs each image processing on the digital image signal according to the type and the setting of the video described above. The image processing performed by the CPU 107 will be described later.
- the CPU 107 performs other general control for the imaging device 1 .
- the CPU 107 reads out necessary programs and information used to perform various types of control, from the memory 111 , to perform various types of processing and various types of control.
- the memory 111 is an internal memory of the imaging device 1 , and stores programs necessary for various types of imaging of the imaging device 1 .
- the CPU 107 controls the display of the display unit 113 . Specific examples of the display unit 113 include a rear monitor and an electronic viewfinder of the imaging device 1 .
- connection unit 109 of the imaging device 1 and the connection unit 203 of the external recorder 3 are connected to each other by the HDMI cable 5 .
- the video image data is input from the imaging device 1 to the connection unit 203 of the external recorder 3 .
- the external recorder 3 records the input video image data in the recording unit 209 .
- the CPU 205 displays the input video image data on the display unit 207 .
- the connection unit is connected to the display unit 207 by way of the CPU 205 , but the display unit 207 may be connected to the connection unit 203 , and, for example, the CPU 205 may control the display unit.
- the CPU 205 performs general control including recording control of the external recorder 3 to the recording unit 209 described above.
- the CPU 205 reads out necessary programs and information used to perform various types of control, from a memory (not shown) of the external recorder 3 , to perform various types of processing and various types of control performed by the CPU 205 .
- the hardware structures of the CPU 107 and the CPU 205 are various processors as described below.
- the various processors include, for example, a CPU which is a general-purpose processor that executes software (programs) to act as various functional units, a programmable logic device (PLD) which is a processor having a changeable circuit configuration after manufacture, such as a field programmable gate array (FPGA), and a dedicated electric circuit which is a processor having a dedicated circuit configuration designed to execute specific processing, such as an application specific integrated circuit (ASIC).
- a CPU which is a general-purpose processor that executes software (programs) to act as various functional units
- PLD programmable logic device
- FPGA field programmable gate array
- ASIC application specific integrated circuit
- One functional unit may be composed of one of these various processors or may be composed of a combination of two or more processors of the same type or different types (for example, a plurality of FPGAs or a combination of the CPU and the FPGA).
- the plurality of functional units may be composed of one processor.
- a first example in which the plurality of functional units are composed of one processor is an aspect in which one or more CPUs and software are combined to constitute one processor and the processor acts as the plurality of functional units, as typified by a computer used for a client, a server, or the like.
- a second example is an aspect in which a processor that realizes the functions of the entire system including a plurality of functional units with one integrated circuit (IC) chip is used, as typified by system on chip (SoC) and the like.
- IC integrated circuit
- SoC system on chip
- various functional units are composed of one or more of the various processors described above as the hardware structure.
- FIG. 3 is a block diagram showing a processing function of the video image data realized by the CPU 107 .
- the CPU 107 comprises a first video image data processing unit 121 , a second video image data processing unit 123 , and a third video image data processing unit 125 .
- the first video image data processing unit 121 processes video image data (RAW) on the basis of the video image quality setting (first setting condition).
- the video image data (RAW) is video image data that has not yet been subjected to image processing, and is data that has the information of the subject image captured by the imaging element 105 as it is.
- the video image quality setting is a condition set in the imaging device 1 , and the first video image data processed with the video image quality setting is used for the video image data to be recorded or for the live view image.
- the video image quality setting is hybrid log-gamma (HLG) or perceptual quantization (PQ) of BT.2100.
- the second video image data processing unit 123 processes the video image data (RAW) on the basis of the monitor image quality setting (second setting condition).
- the monitor image quality setting is a condition set in the external recorder 3 , and the second video image data processed with the monitor image quality setting is displayed on the display unit 207 of the external recorder 3 .
- the second video image data processing unit 123 processes the video image data (RAW) on the basis of BT.709.
- the third video image data processing unit 125 generates third video image data indicating a difference between the video image quality setting and the monitor image quality setting, on the basis of the first video image data and the second video image data. The user can visually easily discriminate the difference between the video image quality setting and the monitor image quality setting by viewing the third video image data.
- the first video image data and the second video image data have a different image quality therebetween. Therefore, the user can easily visually discriminate the different image quality by viewing the third video image data displayed on the display unit 207 .
- the first video image data and the second video image data have the same image quality. Therefore, the user can easily visually discriminate the same image quality by viewing the third video image data displayed on the display unit 207 .
- FIG. 4 is a schematic diagram showing an example of the third video image data.
- Third video image data V 3 ( 1 ) is generated by alternately arranging a plurality of first frames VF 1 constituting first video image data V 1 and a plurality of second frames VF 2 constituting second video image data V 2 in chronological order.
- the first frame VF 1 and the second frame VF 2 are arranged every 5 frames in chronological order.
- the first frame VF 1 is processed by the video image quality setting
- the second frame VF 2 is processed by the monitor image quality setting.
- the first frame VF 1 and the second frame VF 2 have a different image quality therebetween.
- the third video image data V 3 ( 1 ) is displayed on the display unit 207 , the first frame VF 1 and the second frame VF 2 having a different image quality are repeatedly displayed at a predetermined interval. Therefore, since the image quality of the displayed third video image data V 3 ( 1 ) is repeatedly changed, the user can easily visually discriminate that the video image quality setting and the monitor image quality setting are different from each other.
- the first frame VF 1 and the second frame VF 2 have the same image quality. Therefore, since the image quality of the third video image data V 3 ( 1 ) is stably displayed without being changed, the user can easily visually discriminate that the video image quality setting and the monitor image quality setting are the same.
- the plurality of first frames VF 1 and the plurality of second frames VF 2 are alternately arranged in chronological order as shown in FIG. 4 .
- the first video image data (the plurality of first frames VF 1 ) and the second video image data (the plurality of second frames VF 2 ) may be alternately arranged every second.
- the third video image data V 3 ( 1 ) may be formed by alternately arranging the first frame VF 1 and the second frame VF 2 every single frame.
- FIG. 5 is a flowchart illustrating an imaging method (and a program for executing the imaging method) using the imaging device 1 to which the external recorder 3 is connected.
- the first video image data processing unit 121 of the imaging device 1 acquires a video image quality setting “MV_SET” of the imaging device 1 (step S 101 ).
- a monitor image quality setting “MON_SET” of the external recorder 3 is transmitted from the external recorder 3 (CPU 205 ) to the imaging device 1 via the HDMI cable 5 , and the second video image data processing unit 123 of the imaging device 1 acquires the monitor image quality setting “MON_SET” (step S 102 ).
- the CPU 107 acquires the video image data (RAW) from the imaging element 105 (step S 103 ). Specifically, the frames constituting the video image data (RAW) are acquired in the order of frame numbers in chronological order. After that, the CPU 107 receives the signal of the recording start instruction and determines whether or not video recording is being performed (step S 104 ). In a case where the CPU 107 determines that the video recording is being performed, the first video image data processing unit 121 of the imaging device 1 generates the first video image data corresponding to the “MV_SET” and transmits the first video image data to the external recorder 3 (step S 105 ).
- the third video image data processing unit 125 determines whether or not the number calculated by the following expression is an even number (step S 111 ). Int(Frame/n) Expression:
- Int ( ⁇ ) in the expression means truncating a decimal fraction of the number ⁇ in parentheses
- Frame means a frame number of the video image data (RAW)
- n means a frame period of processing switching. The user can arbitrarily decide the frame period n of the processing switching.
- the first video image data processing unit 121 In a case where the CPU 107 determines that the number calculated by the expression is an even number, the first video image data processing unit 121 generates the first video image data corresponding to the “MV_SET” and transmits the first video image data to the third video image data processing unit 125 (step S 112 ). On the other hand, in a case where the CPU 107 determines that the number calculated by the expression is not an even number, the second video image data processing unit 123 generates the second video image data corresponding to the “MON_SET”, and transmits the second video image data to the third video image data processing unit 125 (step S 113 ).
- the third video image data processing unit 125 generates the third video image data by using the generated first and second video image data, and transmits the third video image data to the external recorder 3 (step S 114 ).
- the first video image data and the second video image data are generated by being switched therebetween according to the number of Frame (frame number)/n (frame period of processing switching), and then the third video image data is generated.
- the third video image data is generated.
- the CPU 107 determines whether or not the video image quality setting of the imaging device 1 has been updated (step S 106 ). In a case where the video image quality setting of the imaging device 1 has been updated, the CPU 107 updates the “MV_SET” of the imaging device 1 (step S 107 ).
- the CPU 107 determines whether or not the monitor image quality setting of the external recorder 3 has been updated (step S 108 ). After that, the updated “MON_SET” is transmitted from the external recorder 3 to the imaging device 1 (step S 109 ). After that, the CPU 107 determines whether or not the video mode has ended (step S 110 ), and in a case where the video mode has not ended, the process returns to step S 103 , and the next frame of the video image data (RAW) is processed.
- the third video image data processing unit 125 generates the third video image data in which the plurality of first frames VF 1 and the plurality of second frames VF 2 are alternately arranged. Then, the user can easily visually discriminate whether or not the video image quality setting and the monitor image quality setting are correctly set by viewing the third video image data displayed on the display unit 207 of the external recorder 3 .
- each of the above-mentioned configurations and functions can be appropriately realized by using any hardware, software, or a combination of both.
- the CPU 107 may perform the video image data processing instead of each video image data processing unit.
- the present invention can also be applied to a program causing a computer to execute the above-mentioned processing steps (processing procedures), a computer-readable recording medium (non-transitory recording medium) on which such a program is recorded, or a computer on which such a program can be installed.
- the first video image data or the second video image data is generated in conformity with the frame numbers of the frames constituting the video image data (RAW) (see steps S 111 to S 113 of FIG. 5 ).
- the first video image data and the second video image data are generated together for the frames constituting the video image data (RAW).
- FIG. 6 is a flowchart illustrating an imaging method (and a program for executing the imaging method) using the imaging device 1 to which the external recorder 3 is connected.
- the first video image data processing unit 121 of the imaging device 1 acquires the video image quality setting “MV_SET” of the imaging device 1 (step S 201 ).
- the monitor image quality setting “MON_SET” of the external recorder 3 is transmitted from the external recorder 3 (CPU 205 ) to the imaging device 1 via the HDMI cable 5 , and the second video image data processing unit 123 of the imaging device 1 acquires the monitor image quality setting “MON_SET” (step S 202 ).
- the CPU 107 acquires the video image data (RAW) from the imaging element 105 (step S 203 ).
- the first video image data processing unit 121 generates the first video image data of the “MV_SET” (step S 204 ).
- the second video image data processing unit 123 generates the second video image data of the “MON_SET” (step S 205 ).
- the CPU 107 receives the signal of the recording start instruction and determines whether or not video recording is being performed (step S 206 ).
- the first video image data processing unit 121 generates the first video image data corresponding to the “MV_SET” and transmits the first video image data to the external recorder 3 (step S 207 ).
- the third video image data processing unit 125 determines whether or not the number calculated by the above-mentioned expression (see step S 111 of FIG. 5 ) is an even number (step S 213 ).
- the first video image data processing unit 121 of the imaging device 1 transmits the first video image data corresponding to the “MV_SET” to the third video image data processing unit 125 (step S 214 ).
- the second video image data processing unit 123 of the imaging device 1 transmits the second video image data corresponding to the “MON_SET” to the third video image data processing unit 125 (step S 215 ).
- the third video image data processing unit 125 generates the third video image data by using the generated first and second video image data, and transmits the third video image data to the external recorder 3 (step S 216 ).
- the first video image data and the second video image data are generated together for the frames constituting the video image data (RAW).
- the first video image data and the second video image data are provided for all the frames constituting the video image data (RAW).
- the third video image data processing unit 125 also generates the third video image data in which the plurality of first frames VF 1 constituting the first video image data V 1 and the plurality of second frames VF 2 constituting the second video image data V 2 are alternately arranged. Since the third video image data is displayed on the display unit 207 of the external recorder 3 , the user can easily visually discriminate whether or not the video image quality setting of the imaging device 1 and the monitor image quality setting of the display unit 207 of the external recorder 3 are correctly set.
- the third video image data (third frame VF 3 ) is generated by combining the first frame VF 1 and the second frame VF 2 . That is, in the present embodiment, the third video image data indicating the difference between the video image quality setting and the monitor image quality setting is generated by combining the first frame and the second frame.
- FIG. 7 is a schematic diagram showing an example of the third video image data of the present embodiment.
- a third frame VF 3 ( 2 ) constituting the third video image data shown in FIG. 7 is obtained by combining the first frame VF 1 constituting the first video image data and the second frame VF 2 constituting the second video image data side by side.
- the third frame VF 3 ( 2 ) is formed by disposing the first frame VF 1 on a left side and the second frame VF 2 on a right side side by side when facing the third frame VF 3 ( 2 ) to combine the first frame VF 1 and the second frame VF 2 .
- the first frame VF 1 and the second frame VF 2 are arranged, so that the user can easily visually discriminate the difference between the video image quality setting and the monitor image quality setting.
- FIG. 8 is a schematic diagram showing an example of the third video image data of the present embodiment.
- a third frame VF 3 ( 3 ) constituting the third video image data shown in FIG. 8 is obtained by superimposing and combining the first frame VF 1 constituting the first video image data and the second frame VF 2 constituting the second video image data.
- the third frame VF 3 ( 3 ) is formed by superimposing and displaying the second frame VF 2 on a part of a region of the first frame VF 1 .
- the second frame VF 2 is superimposed and displayed on a part of the region of the first frame VF 1 , so that the user can easily visually discriminate the difference between the video image quality setting and the monitor image quality setting.
- FIG. 9 is a schematic diagram showing an example of the third video image data of the present embodiment.
- a third frame VF 3 ( 4 ) constituting the third video image data shown in FIG. 9 is obtained by combining a part of the first frame VF 1 constituting the first video image data and a part of the second frame VF 2 constituting the second video image data.
- the third frame VF 3 ( 4 ) is formed by combining an image of a left half of the first frame VF 1 and an image of a right half of the second frame VF 2 side by side when facing the third frame VF 3 ( 4 ). In this way, the image of the left half of the first frame VF 1 and the image of the right half of the second frame VF 2 are combined, so that the user can easily visually discriminate the difference between the video image quality setting and the monitor image quality setting.
- FIG. 10 is a flowchart illustrating an imaging method (and a program for executing the imaging method) according to the present embodiment.
- the first video image data processing unit 121 of the imaging device 1 acquires the video image quality setting “MV_SET” of the imaging device 1 (step S 301 ).
- the monitor image quality setting “MON_SET” of the external recorder 3 is transmitted from the external recorder 3 (CPU 205 ) to the imaging device 1 via the HDMI cable 5 , and the second video image data processing unit 123 of the imaging device 1 acquires the monitor image quality setting “MON_SET” (step S 302 ).
- the CPU 107 acquires the video image data (RAW) from the imaging element 105 (step S 303 ). Then, the first video image data processing unit 121 generates the first video image data corresponding to the “MV_SET” (step S 304 ). In addition, the second video image data processing unit 123 generates the second video image data corresponding to the “MON_SET” (step S 305 ).
- the CPU 107 receives the signal of the recording start instruction and determines whether or not video recording is being performed (step S 306 ).
- the first video image data processing unit 121 transmits the first video image data to the external recorder 3 (step S 307 ).
- the third video image data processing unit 125 generates the third video image data in which the first video image data and the second video image data are combined (step S 313 ). After that, the third video image data is transmitted from the imaging device 1 to the external recorder 3 (step S 314 ).
- the third video image data processing unit 125 generates the third video image data in which the first frame VF 1 and the second frame VF 2 are combined. Then, the user checks the third video image data displayed on the display unit 207 of the external recorder 3 , so that the user can easily visually discriminate whether or not the video image quality setting of the imaging device 1 and the monitor image quality setting of the display unit 207 of the external recorder 3 are correctly set.
- the CPU 107 displays a comparison result between the video image quality setting and the monitor image quality setting on the display unit (the rear monitor or the electronic viewfinder) 113 of the imaging device 1 .
- FIG. 11 is a diagram showing the comparison result displayed on the rear monitor of the imaging device 1 .
- the CPU 107 displays a comparison result 7 between the video image quality setting and the monitor image quality setting on the rear monitor.
- the video mode is “BT.2100”, and the video range is “Limited”, in the video image quality setting of the imaging device 1 .
- the video mode is “BT.709”, and the video range is “Limited”, in the monitor image quality setting of the external recorder 3 .
- “match” (or “OK”) is displayed in a case where the video image quality setting of the imaging device 1 and the monitor image quality setting of the external recorder 3 match with each other
- “no match” (or “NG”) is displayed in a case where the video image quality setting of the imaging device 1 and the monitor image quality setting of the external recorder 3 do not match with each other.
- the imaging device 1 and the external recorder 3 are wirelessly connected to each other.
- FIG. 12 is a block diagram showing the functions of the imaging device 1 and of the external recorder 3 of this example.
- the parts already illustrated in FIG. 2 are designated by the same reference numerals, and the description thereof will be omitted.
- the imaging device 1 and the external recorder 3 are wirelessly connected to each other.
- the connection unit 109 has a communication unit (antenna) 110 A and is wirelessly connected to a communication unit (antenna) 110 B to transmit the captured video image data to the external recorder 3 .
- Specific examples of the wireless connection include connection through Wi-Fi, ultra-wideband (UWB), wireless HDMI, and a wireless serial digital interface (SDI).
- control is performed on the imaging device 1 side such that a live view image that enables checking of the exposure and the color is obtained even in a case where the monitor image quality setting of the external recorder 3 and the video image quality setting of the imaging device 1 are different from each other.
- this example is effective in a case where the monitor image quality setting of the external recorder 3 that matches with the video image quality setting of the imaging device 1 does not exist.
- FIG. 13 is a flowchart illustrating the imaging method of this example (and a program for executing the imaging method).
- the first video image data processing unit 121 of the imaging device 1 acquires the video image quality setting “MV_SET” of the imaging device 1 (step S 401 ).
- the monitor image quality setting “MON_SET” of the external recorder 3 is transmitted from the external recorder 3 to the imaging device 1 , and the second video image data processing unit 123 of the imaging device 1 acquires the monitor image quality setting “MON_SET” (step S 402 ).
- the imaging device 1 acquires the video image data (RAW) from the imaging element 105 (step S 403 ).
- the first video image data processing unit 121 generates the first video image data through first image processing corresponding to the “MV_SET” (step S 404 ).
- the second video image data processing unit 123 generates the second video image data through second image processing corresponding to the “MON_SET” (step S 405 ).
- the first video image data is transmitted from the imaging device 1 to the external recorder 3 (step S 406 ).
- the second video image data is transmitted from the imaging device 1 to the external recorder 3 (step S 407 ).
- the CPU 107 determines whether or not video recording is being performed (step S 408 ). In a case where the CPU 107 determines that the video recording is being performed, the external recorder 3 records the first video image data (step S 409 ). On the other hand, in a case where the CPU 107 determines that the video recording is not being performed, the external recorder 3 displays the second video image data on the display unit (monitor) 207 (step S 410 ).
- the imaging device 1 generates the first video image data of the video image quality setting and the second video image data of the monitor image quality setting and transmits the first and second video image data to the external recorder 3 .
- the external recorder 3 records the first video image data in a case of performing video recording, and displays the second video image data on the display unit (monitor) 207 .
- the live view image that enables checking of the exposure and the color can be displayed on the display unit 207 even in a case where the monitor image quality setting of the external recorder 3 that matches with the video image quality setting of the imaging device 1 does not exist.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Evolutionary Computation (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Software Systems (AREA)
- Databases & Information Systems (AREA)
- Computing Systems (AREA)
- Artificial Intelligence (AREA)
- Studio Devices (AREA)
- Television Signal Processing For Recording (AREA)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US19/197,147 US20250267358A1 (en) | 2020-06-30 | 2025-05-02 | Imaging device, imaging method, and program |
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2020-112549 | 2020-06-30 | ||
| JP2020112549 | 2020-06-30 | ||
| PCT/JP2021/024053 WO2022004570A1 (ja) | 2020-06-30 | 2021-06-25 | 撮像装置、撮像方法、及びプログラム |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2021/024053 Continuation WO2022004570A1 (ja) | 2020-06-30 | 2021-06-25 | 撮像装置、撮像方法、及びプログラム |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US19/197,147 Continuation US20250267358A1 (en) | 2020-06-30 | 2025-05-02 | Imaging device, imaging method, and program |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US20230114332A1 US20230114332A1 (en) | 2023-04-13 |
| US12316958B2 true US12316958B2 (en) | 2025-05-27 |
Family
ID=79316031
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US18/064,572 Active 2042-01-26 US12316958B2 (en) | 2020-06-30 | 2022-12-12 | Imaging device, imaging method, and program |
| US19/197,147 Pending US20250267358A1 (en) | 2020-06-30 | 2025-05-02 | Imaging device, imaging method, and program |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US19/197,147 Pending US20250267358A1 (en) | 2020-06-30 | 2025-05-02 | Imaging device, imaging method, and program |
Country Status (5)
| Country | Link |
|---|---|
| US (2) | US12316958B2 (cg-RX-API-DMAC7.html) |
| JP (1) | JP7352028B2 (cg-RX-API-DMAC7.html) |
| CN (1) | CN115769591B (cg-RX-API-DMAC7.html) |
| DE (1) | DE112021003484T5 (cg-RX-API-DMAC7.html) |
| WO (1) | WO2022004570A1 (cg-RX-API-DMAC7.html) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070030374A1 (en) * | 2005-08-02 | 2007-02-08 | Olympus Corporation | Electronic image capturing apparatus, control method of electronic image capturing apparatus, and image processing apparatus |
| US20100194917A1 (en) * | 2009-02-03 | 2010-08-05 | Kenji Funamoto | Imaging apparatus and live-view image display method thereof |
| JP2010172462A (ja) | 2009-01-29 | 2010-08-12 | Toshiba Corp | 医用画像表示装置 |
| US8379130B2 (en) * | 2009-08-07 | 2013-02-19 | Qualcomm Incorporated | Apparatus and method of processing images based on an adjusted value of an image processing parameter |
| US20130286207A1 (en) * | 2012-04-25 | 2013-10-31 | Sony Corporation | Imaging apparatus, imaging processing method, image processing device and imaging processing system |
| US20160337600A1 (en) | 2015-05-13 | 2016-11-17 | Olympus Corporation | Imaging device and imaging method |
| US20180077332A1 (en) | 2016-09-09 | 2018-03-15 | Olympus Corporation | Imaging apparatus and imaging method |
| US20190287450A1 (en) * | 2018-03-15 | 2019-09-19 | Canon Kabushiki Kaisha | Display apparatus and control method thereof |
| JP2019205062A (ja) | 2018-05-23 | 2019-11-28 | キヤノン株式会社 | 画像処理装置およびその制御方法ならびにプログラム |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5476150B2 (ja) * | 2010-02-10 | 2014-04-23 | 富士フイルム株式会社 | 画像処理装置、画像処理方法、画像処理プログラムおよび記録媒体 |
-
2021
- 2021-06-25 CN CN202180045791.8A patent/CN115769591B/zh active Active
- 2021-06-25 DE DE112021003484.7T patent/DE112021003484T5/de active Pending
- 2021-06-25 WO PCT/JP2021/024053 patent/WO2022004570A1/ja not_active Ceased
- 2021-06-25 JP JP2022533944A patent/JP7352028B2/ja active Active
-
2022
- 2022-12-12 US US18/064,572 patent/US12316958B2/en active Active
-
2025
- 2025-05-02 US US19/197,147 patent/US20250267358A1/en active Pending
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070030374A1 (en) * | 2005-08-02 | 2007-02-08 | Olympus Corporation | Electronic image capturing apparatus, control method of electronic image capturing apparatus, and image processing apparatus |
| JP2010172462A (ja) | 2009-01-29 | 2010-08-12 | Toshiba Corp | 医用画像表示装置 |
| US20100194917A1 (en) * | 2009-02-03 | 2010-08-05 | Kenji Funamoto | Imaging apparatus and live-view image display method thereof |
| JP2010183173A (ja) | 2009-02-03 | 2010-08-19 | Fujifilm Corp | 撮像装置及びそのスルー画像表示方法 |
| US8379130B2 (en) * | 2009-08-07 | 2013-02-19 | Qualcomm Incorporated | Apparatus and method of processing images based on an adjusted value of an image processing parameter |
| JP2013229699A (ja) | 2012-04-25 | 2013-11-07 | Sony Corp | 撮像装置、撮像処理方法、画像処理装置および撮像処理システム |
| US20130286207A1 (en) * | 2012-04-25 | 2013-10-31 | Sony Corporation | Imaging apparatus, imaging processing method, image processing device and imaging processing system |
| US20160337600A1 (en) | 2015-05-13 | 2016-11-17 | Olympus Corporation | Imaging device and imaging method |
| CN106161975A (zh) | 2015-05-13 | 2016-11-23 | 奥林巴斯株式会社 | 摄像装置和摄像方法 |
| US20180077332A1 (en) | 2016-09-09 | 2018-03-15 | Olympus Corporation | Imaging apparatus and imaging method |
| CN107809579A (zh) | 2016-09-09 | 2018-03-16 | 奥林巴斯株式会社 | 摄像装置和摄像方法 |
| US20190287450A1 (en) * | 2018-03-15 | 2019-09-19 | Canon Kabushiki Kaisha | Display apparatus and control method thereof |
| JP2019205062A (ja) | 2018-05-23 | 2019-11-28 | キヤノン株式会社 | 画像処理装置およびその制御方法ならびにプログラム |
| US20190364222A1 (en) | 2018-05-23 | 2019-11-28 | Canon Kabushiki Kaisha | Image processing apparatus, control method thereof, and storage medium |
Non-Patent Citations (3)
| Title |
|---|
| Chinese Office Action and Search Report for Chinese Application No. 202180045791.8, dated Nov. 29, 2024, with an English translation. |
| International Preliminary Report on Patentability and Written Opinion of the International Searching Authority for International Application No. PCT/JP2021/024053, dated Jan. 12, 2023, with an English translation. |
| International Search Report for International Application No. PCT/JP2021/024053, dated Sep. 14, 2021, with an English translation. |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115769591A (zh) | 2023-03-07 |
| JPWO2022004570A1 (cg-RX-API-DMAC7.html) | 2022-01-06 |
| JP7352028B2 (ja) | 2023-09-27 |
| CN115769591B (zh) | 2025-08-12 |
| WO2022004570A1 (ja) | 2022-01-06 |
| US20250267358A1 (en) | 2025-08-21 |
| DE112021003484T5 (de) | 2023-04-27 |
| US20230114332A1 (en) | 2023-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10237514B2 (en) | Camera system, video processing apparatus, and camera apparatus | |
| US10896634B2 (en) | Image signal processing apparatus and control method therefor | |
| JP2010093472A (ja) | 撮像装置および撮像装置用信号処理回路 | |
| US20260030715A1 (en) | Video imaging apparatus, video imaging method, and video imaging program | |
| US8063950B2 (en) | Imaging apparatus, waveform signal display method, storage medium, and integrated circuit | |
| US10880491B2 (en) | Imaging apparatus including controller for converting dynamic range image data | |
| US20230114332A1 (en) | Imaging device, imaging method, and program | |
| US11165956B2 (en) | Imaging apparatus | |
| JP7803906B2 (ja) | 画像処理装置、撮像装置、画像処理方法、画像処理プログラム及び記録媒体 | |
| US20040021789A1 (en) | Photographing system | |
| JP2024109720A (ja) | 動画制御装置、動画記録装置、動画制御方法、動画記録方法、及び動画制御プログラム | |
| JP5340456B2 (ja) | 撮像装置及びその制御方法、プログラム並びに記憶媒体 | |
| JP2008219738A (ja) | 撮像装置 | |
| CN101127920B (zh) | 数字成像装置的彩色处理参数设置 | |
| JP2001160915A (ja) | デジタルカメラ | |
| JP6796723B2 (ja) | 撮像装置及びその駆動方法 | |
| WO2019053764A1 (ja) | 撮像装置 | |
| JP3994534B2 (ja) | 信号処理装置及び信号処理方法 | |
| EP1033887A2 (en) | Video signal, processing circuit, viewfinder apparatus, television camera, and image monitor apparatus | |
| JP4124875B2 (ja) | デジタル出力可能な電子内視鏡装置 | |
| JP2000278677A (ja) | 電子内視鏡装置 | |
| JPH10145650A (ja) | 撮像装置 | |
| JP2000079094A (ja) | デジタル出力可能な電子内視鏡装置 | |
| JP2020120311A (ja) | 画像処理装置、画像処理方法およびプログラム | |
| JPH08339173A (ja) | コンピュータ入力画像調整装置 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
| AS | Assignment |
Owner name: FUJIFILM CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FUJIWARA, SHINYA;SAITO, TARO;SHIMADA, TOMOHARU;AND OTHERS;REEL/FRAME:062064/0329 Effective date: 20221013 |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
| STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
| STCF | Information on status: patent grant |
Free format text: PATENTED CASE |