WO2019003850A1 - 画像処理装置及び方法 - Google Patents

画像処理装置及び方法 Download PDF

Info

Publication number
WO2019003850A1
WO2019003850A1 PCT/JP2018/021859 JP2018021859W WO2019003850A1 WO 2019003850 A1 WO2019003850 A1 WO 2019003850A1 JP 2018021859 W JP2018021859 W JP 2018021859W WO 2019003850 A1 WO2019003850 A1 WO 2019003850A1
Authority
WO
WIPO (PCT)
Prior art keywords
luminance
information
image data
output
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2018/021859
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
良輔 ▲高▼橋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Priority to CN201880043095.1A priority Critical patent/CN110800285B/zh
Publication of WO2019003850A1 publication Critical patent/WO2019003850A1/ja
Priority to US16/708,164 priority patent/US11252335B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318—Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/71—Circuitry for evaluating the brightness variation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/76—Circuitry for compensating brightness variation in the scene by influencing the image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/57—Control of contrast or brightness
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/025—Systems for the transmission of digital non-picture data, e.g. of text during the active part of a television frame
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal

Definitions

  • the present invention relates to an image processing apparatus and method.
  • the display device can perform image processing suitable for the performance of the display device and the characteristics of the video content. Also, the side that transmits the video signal can transmit an intention, such as how to display the video signal on the display device, by the added metadata.
  • HDMI High Definition Multimedia Interface
  • the maximum luminance information when the maximum luminance information is equal to or less than the displayable luminance of the display device, the luminance is displayed as the video signal.
  • the maximum luminance information exceeds the displayable luminance of the display device, uniform gain is applied to the input signal so that the luminance of the maximum luminance information becomes the displayable luminance of the display device.
  • the display is displayed with the brightness lowered.
  • image processing for example, when a plurality of images of the same main subject is displayed continuously, even if the luminance of the main subject is the same, the maximum luminance in the image is higher and lower than the displayable luminance of the display device.
  • the present invention has been made in view of the above problems, and when a plurality of images are displayed, it is possible to suppress a change in the luminance when expressing a subject with the same luminance included in the plurality of images on a display device.
  • the purpose is to
  • FIG. 1 is a conceptual diagram showing a system in an embodiment of the present invention.
  • FIG. 2 is a block diagram showing a configuration of a processing module of the digital camera in the first embodiment.
  • FIG. 10 is a block diagram showing the arrangement of processing modules of the digital camera according to the second and fourth embodiments.
  • FIG. 7 is a view showing information included in image information in the second embodiment.
  • FIG. 10 is a block diagram showing the configuration of a processing module of a digital camera according to a third embodiment.
  • the present invention is not limited to a digital camera, but a mobile phone, a personal computer (laptop type, desktop type, tablet type, etc.), a game machine, etc. It is applicable to the apparatus which processes information.
  • FIG. 1 is a conceptual view showing a system in which the digital camera of the present embodiment is used.
  • the digital camera 1 is connected to the display 2 by a cable 3 (or wireless).
  • the captured image is stored as an image file in the digital camera 1.
  • the image file according to the present embodiment is a RAW file including information recorded at the time of shooting of the light signal acquired by the sensor of the digital camera and information at the time of shooting, and JPEG including the image information converted to the JPEG method and the information at the time of shooting Points to a file.
  • the digital camera 1 receives an instruction 40 (hereinafter referred to as reproduction instruction) for reproducing and displaying an image file stored in the digital camera 1 from the user 4 on the display 2.
  • reproduction instruction an instruction 40 for reproducing and displaying an image file stored in the digital camera 1 from the user 4 on the display 2.
  • the digital camera 1 transmits the transmission signal 10 including the image information and the metadata generated from the information of the image file to the display 2, thereby displaying the image in the digital camera 1 using the display 2. I do.
  • FIG. 2 is a block diagram showing the configuration of a processing module in the digital camera 1 of the first embodiment.
  • a processing module for example, using a CPU and a memory (not shown) in which part or all of the processing is included in the digital camera 1 Is configured.
  • a processing module a user instruction acquisition unit 101, a reproduction display control unit 102, a luminance information acquisition unit 103, a dynamic range information storage unit 104, a metadata generation unit 105, a transmission signal generation unit 106, an image file A holding unit 107 and a transmission unit 108 are included.
  • processing modules unnecessary for the description of the present embodiment are omitted.
  • the user instruction acquisition unit 101 includes, for example, a user interface such as a button or a touch panel disposed on the digital camera 1 and its processing unit for receiving an instruction from the user, and receives a reproduction instruction 40 from the user 4.
  • the reproduction instruction 40 includes an instruction as to how to display which image file among a plurality of image files.
  • the reproduction display control unit 102 When receiving the reproduction control start instruction 1010, the reproduction display control unit 102 transmits a luminance information acquisition instruction 1020 to the luminance information acquisition unit 103, and transmits a metadata generation instruction 1021 to the metadata generation unit 105. Further, it transmits a transmission signal generation instruction 1022 to the transmission signal generation unit 106.
  • the information transmitted from the reproduction display control unit 102 to each processing module includes information such as an image to be displayed and a display method.
  • the luminance information acquisition unit 103 When the luminance information acquisition unit 103 receives the luminance information acquisition instruction 1020, the luminance information acquisition unit 103 acquires dynamic range information 1040 indicating the range of luminance handled by the digital camera 1 from the dynamic range information holding unit 104 as luminance information.
  • the dynamic range of the digital camera 1 generally changes due to factors such as shooting settings, but the dynamic range information 1040 in the first embodiment is the maximum dynamic range that can be handled by the digital camera 1 of that model. I assume. As an example, it is assumed here that the dynamic range information holding unit 104 holds information of 1000% as the maximum dynamic range that can be handled by the digital camera 1. In addition, the maximum value of the dynamic range set when shooting a plurality of images to be displayed may be used.
  • the luminance information acquisition unit 103 converts the acquired dynamic range information 1040 into luminance information 1030.
  • the value of the dynamic range described in the dynamic range information 1040 is replaced with luminance to be luminance information. For example, replace 1000% with 1000 nits.
  • the metadata generation unit 105 receives the metadata generation instruction 1021 and the luminance information 1030, and generates metadata.
  • data is described as data including information of maximum luminance as metadata, but the type of metadata is not limited to this.
  • information such as color gamut, color temperature, and minimum luminance may be added to the metadata.
  • information of MaxCLL (Maximum Content Light Level) and MaxFALL (Maximum Frame Average Light Level) supported by HDMI may be added.
  • the metadata generation unit 105 converts the acquired luminance information 1030 into a format of metadata (a format defined as a metadata format), and outputs the result as metadata 1050.
  • the transmission signal generation unit 106 receives the transmission signal generation instruction 1022 and the metadata 1050 and generates a signal to be transmitted to the display 2 connected to the digital camera 1. Specifically, when the transmission signal generation instruction 1022 is received, the transmission signal generation unit 106 acquires, from the image file holding unit 107, image information 1070 necessary for generation of a signal to be transmitted.
  • the image file holding unit 107 holds, as an image file, image data having various dynamic ranges captured by the digital camera 1. Then, the transmission signal generation unit 106 converts the acquired image information 1070 into a format suitable for signal transmission.
  • the format is converted to a format corresponding to EOTF (Electro Optical Transfer Function) defined in SMPTE ST 2084.
  • the signal defined in SMPTE ST 2084 is a signal representing absolute luminance.
  • information of an image file captured by a digital camera is not stored in a data format representing absolute brightness, but is often stored in relative brightness. Therefore, in this embodiment, it is decided to assign a specific relative value (for example, 18%) in each image file to a specific absolute luminance (for example, 18 nits), and an image file having any dynamic range, Convert the format to be that assignment.
  • Image file A (maximum dynamic range: 100%)
  • -Pixel value 0 Dynamic range 0%
  • Pixel value 184 dynamic range 18%
  • Pixel value 1023 Dynamic range 100%
  • the pixel value 0 is converted to 0 nits, the pixel value 184 to 18 nits, and the pixel value 1023 (maximum value) to a signal representing 100 nits.
  • the digital camera 1 may change the dynamic range of the image file to be recorded by changing the setting.
  • the pixel value of the image file and the value of the dynamic range corresponding to the image file may be different for each image file.
  • Image file B (maximum dynamic range: 1000%) -Pixel value 0: Dynamic range 0% Pixel value 18: dynamic range 18% ⁇ Pixel value 1023: Dynamic range 1000% In this case, the pixel value 0 is converted to 0 nits, the pixel value 18 is converted to 18 nits, and the pixel value 1023 (maximum value) is converted to a signal representing 1000 nits.
  • digital cameras capable of generating image files having different dynamic ranges generally hold internally the information on the dynamic range corresponding to the pixel values of the image file for each format of the image file.
  • a conversion as described above can be performed.
  • luminance conversion For example, in an image file having a dynamic range of 100% or an image file having a dynamic range of 1000%, a relative value is a signal representing the same luminance.
  • the transmission signal generation unit 106 associates the received metadata 1050 with the image information converted into a format suitable for transmission, and transmits it to the transmission unit 108 as a transmission signal 1060.
  • the transmission unit 108 includes a terminal of a standard such as HDMI and its control unit, and transmits the transmission signal 1060 sent from the transmission signal generation unit 106 to the outside of the digital camera 1.
  • the luminance value of the image information is converted and displayed so that the common maximum luminance included in the metadata becomes the luminance that can be displayed on the display 2, thereby displaying the image data to be displayed at the same luminance. It becomes possible to treat the area as the same luminance signal.
  • a second embodiment of the present invention will be described.
  • processing in the case where another external digital camera can be connected to the digital camera 1 and an image file can be received and held from the connected external digital camera will be described.
  • the image file may be acquired from another digital camera 1 via a portable recording medium.
  • determining metadata based on information of a digital camera which has generated an image file will be described.
  • FIG. 3 is a block diagram showing the configuration of a processing module in the digital camera 1 of the second embodiment.
  • a processing module in the digital camera 1 of the second embodiment.
  • the processing of the digital camera 1 in the second embodiment is different from the processing described with reference to FIG. 2 in the processing in the luminance information acquisition unit 201.
  • the same reference numerals are given and the explanation is omitted appropriately.
  • the luminance information acquisition unit 201 When the luminance information acquisition unit 201 receives the luminance information acquisition instruction 1020, the luminance information acquisition unit 201 acquires the image information 1070 of the image to be displayed from the image file storage unit 107.
  • FIG. 4 is a diagram showing an example of information included in certain image information.
  • the image information is composed of an image data portion which is data of an image and a shooting time information portion consisting of shooting time information.
  • the shooting time information includes, for example, a dynamic range determined from settings of the camera, shooting date and time, identification information of the camera used for shooting, a shooting mode (for example, a night scene mode suitable for shooting a night scene) It is information such as operation mode).
  • the luminance information acquisition unit 201 acquires identification information of a camera used for photographing from the image information 1070, and acquires dynamic range information 1040 corresponding to the identification information from the dynamic range information storage unit 104.
  • the dynamic range information holding unit 104 holds dynamic range information for each camera identification information. When there is no dynamic range information corresponding to identification information of a camera, the dynamic range information holding unit 104 provides dynamic range information of other cameras instead.
  • the luminance information acquisition unit 201 converts the acquired dynamic range information 1040 into luminance information 1030 by the same method as that of the first embodiment, and outputs the luminance information 1030 to the metadata generation unit 105.
  • the metadata generation unit 105 converts the acquired luminance information 1030 into a format of metadata, and outputs it as metadata 1050.
  • the transmission signal generation unit 106 associates the received metadata 1050 with the image information converted into a format suitable for transmission, and transmits it as a transmission signal 1060 to the transmission unit 108. .
  • metadata including common maximum luminance information is added to the image information converted into luminance values in the common dynamic range for the same image of the photographed digital camera. Do. As a result, it becomes possible to treat an area of image data to be displayed with the same luminance on the display 2 as the same luminance signal with respect to an image captured by the same digital camera.
  • FIG. 5 is a block diagram showing a configuration of a processing module in the digital camera 1 of the third embodiment, and for example, using a CPU and a memory (not shown) in which part or all of the processing is included in the digital camera 1 Is configured.
  • the processing module of the digital camera 1 according to the third embodiment includes a grouping processing unit 302 as compared with the processing module described with reference to FIG. 2, and accordingly, the reproduction display control unit 301 and luminance information acquisition Processing in the unit 303 and the transmission signal generation unit 304 is different. Other than that, it is the same as that of the first embodiment, so the same reference numerals are given and the explanation is omitted appropriately.
  • the reproduction display control unit 301 When receiving the reproduction control start instruction 1010, the reproduction display control unit 301 transmits a grouping instruction 3010 to the grouping processing unit 302, transmits a luminance information acquisition instruction 3011 to the luminance information acquisition unit 303, and the metadata generation unit 105.
  • the metadata generation instruction 1021 is sent. Further, it transmits a transmission signal generation instruction 1022 to the transmission signal generation unit 304.
  • the information transmitted from the reproduction display control unit 301 to each processing module includes information such as an image to be displayed and a display method.
  • the grouping processing unit 302 receives the grouping instruction 3010 and performs grouping of image files.
  • the grouping referred to here is to classify image files to which the same metadata is to be added into groups according to a predetermined grouping condition.
  • the grouping conditions are, for example, that one or more pieces of information such as the shooting date and time of the image, the shooting mode, the setting of the image processing after shooting, and the shutter speed are identical or close.
  • the grouping conditions may be preset in the digital camera 1 or may be selectable by the user. When grouping is performed, grouping may be performed in consideration of the order of display.
  • FIG. 6A shows an example of an image file held by the image file holding unit 107. Note that display is performed in ascending order from the image of the image file picture 001, and it is assumed that both the shooting date and time and the shooting mode are the same as grouping conditions.
  • FIG. 6B is an example of grouping based on grouping conditions only.
  • the image files picture001, picture002, picture004, and picture005 are group 1, and only the image file picture003 is group 2.
  • FIG. 6C is an example in which grouping is performed in consideration of the order of display (display order). From the image file picture001 to be displayed first, image files having the same grouping condition are grouped in ascending order. Since the image files picture001 to picture002 satisfy the grouping condition, they are the same group (group 1). The image file picture 003 is grouped as another group, but the next image file picture 004 does not satisfy the grouping condition with the image file picture 003. Therefore, the image file picture003 is a group (group 2) of a single image file. Similarly, since the remaining image files picture 004 and picture 005 satisfy the grouping condition, they are the same group (group 3).
  • grouping in consideration of the order in which display is performed is different if images included in a certain group are not displayed continuously, because human beings are less likely to feel the harmful effects due to changes in image processing. It is because there is little bad effect by giving metadata.
  • the smaller the number of image files included in the group is, it is possible to set the maximum brightness more suitable for the image, and the possibility of being able to display in the dynamic range suitable for the image is increased.
  • the grouping processing unit 302 outputs, as grouping information 3020, information in which the image file is grouped by the method as described above to the luminance information acquisition unit 303 and the transmission signal generation unit 304.
  • FIG. 7 shows an example of the grouping information 3020. As shown in FIG.
  • the luminance information acquisition unit 303 acquires luminance information for each group described in the grouping information 3020.
  • the largest dynamic range is acquired among the dynamic ranges possessed by the image files belonging to each group, and this is replaced with the luminance to be the maximum luminance information of the group. For example, if the maximum dynamic range in a group is 1000%, the maximum luminance information of the group is 1000 nits.
  • the maximum luminance information of group 1 is 200 nits
  • the maximum luminance information of group 2 is 300 nits
  • the luminance information of group 3 is 400 nits.
  • the maximum luminance information of the group is acquired from the largest dynamic range of the dynamic range possessed by the image file belonging to each group, but the method of acquiring the luminance information is not limited thereto.
  • a table in which luminance information corresponding to each information (for example, imaging mode) included in the imaging information of the image is stored, and using it, maximum luminance information is acquired from the imaging information of the image file of each group May be
  • the transmission signal generation unit 304 receives the transmission signal generation instruction 1022 and the metadata 1050 and generates a signal to be transmitted to the display 2 connected to the digital camera 1. Specifically, when the transmission signal generation unit 304 receives the transmission signal generation instruction 1022, the transmission signal generation unit 304 acquires, from the image file holding unit 107, the image information 1070 necessary for generation of the signal to be transmitted, and performs grouping processing of the grouping information 3020 Acquired from the unit 302. Then, the transmission signal generation unit 106 performs luminance conversion of the acquired image information 1070 according to the method described in the first embodiment, and further converts the image information 1070 into a format suitable for signal transmission.
  • the format suitable for transmission is converted into a format corresponding to the EOTF defined in SMPTE ST 2084.
  • the transmission signal generation unit 304 associates the received metadata 1050 with the image information converted into a format suitable for transmission, and transmits it to the transmission unit 108 as a transmission signal 3040.
  • images are divided into groups, and metadata including information on common maximum luminance is added to image information converted to luminance values in a common dynamic range for each group.
  • the display 2 it is possible to treat an area of image data that is desired to be displayed with the same luminance for each group as the same luminance signal.
  • each processing module of the digital camera 1 in the fourth embodiment is the same as that shown in FIG. 3, but the detailed content of the processing is different. Therefore, the configuration will be described below with reference to FIG.
  • the user instruction acquisition unit 101 includes, for example, a user interface such as a button or a touch panel disposed on the digital camera 1 and its processing unit, and receives the user instruction 41 from the user.
  • the user instruction 41 includes a slide show display instruction.
  • the display 2 connected to the digital camera 1 performs slide show display in which the image file held in the digital camera 1 is switched at a time interval designated by the user and sequentially displayed. It is an instruction.
  • This slide show display instruction includes designation of an image to start display and designation of a time interval for switching display (hereinafter, switching time).
  • user instruction acquisition unit 101 When user instruction acquisition unit 101 receives a slide show display instruction from the user, user instruction acquisition unit 101 transmits reproduction control start instruction 1010 to reproduction display control unit 102.
  • the reproduction display control unit 102 When receiving the reproduction control start instruction 1010, the reproduction display control unit 102 transmits a luminance information acquisition instruction 1020 to the luminance information acquisition unit 201, and transmits a metadata generation instruction 1021 to the metadata generation unit 105. Further, it transmits a transmission signal generation instruction 1022 to the transmission signal generation unit 106.
  • the information transmitted to each processing module includes an image for starting display, information such as a switching time of display designated by the slide show instruction.
  • the luminance information acquisition unit 201 receives the luminance information acquisition instruction 1020 and acquires maximum luminance information.
  • the maximum luminance information in the fourth embodiment is configured from common luminance information common to the entire image held in the image file holding unit 107 and individual luminance information for each image.
  • common luminance information common to the entire image stored in the image file storage unit 107 is acquired, but the present invention is not limited to this.
  • common brightness information common to each digital camera may be acquired.
  • common luminance information common to the plurality of designated images may be acquired.
  • the luminance information in the fourth embodiment is generated from the information of the dynamic range. Therefore, when receiving the luminance information acquisition instruction 1020, the luminance information acquisition unit 201 first acquires the dynamic range information 1040 from the dynamic range information storage unit 104 as common dynamic range information.
  • the common dynamic range is a range of luminance that can be handled by the digital camera 1 as in the first embodiment. As an example, it is assumed here that the dynamic range information holding unit 104 holds information of 1000% as the maximum dynamic range that the digital camera 1 can handle.
  • the luminance information acquisition unit 201 acquires image information 1070 from the image file storage unit 107 in order to acquire dynamic range information for each image.
  • the image information includes an image data portion which is data of an image, and a shooting time information portion consisting of shooting time information.
  • the luminance information acquisition unit 201 sets dynamic range information included in the shooting time information part in the acquired image information 1070 as dynamic range information for each image.
  • the luminance information acquisition unit 201 converts the acquired common dynamic range information and dynamic range information for each image into common luminance information and individual luminance information.
  • the value of the dynamic range described in each piece of dynamic range information is replaced with luminance to be luminance information. For example, replace 1000% with 1000 nits.
  • the created common luminance information and the individual luminance information are combined to form luminance information 1030.
  • the metadata generation unit 105 receives the metadata generation instruction 1021 and the luminance information 1030, and generates metadata.
  • data is described as data including information of maximum luminance as metadata, but the type of metadata is not limited to this.
  • information such as color gamut, color temperature, and minimum luminance may be added to the metadata.
  • information of MaxCLL and MaxFALL supported by HDMI may be added.
  • the metadata generation unit 105 converts the acquired luminance information 1030 into a metadata format (a format defined as a metadata format), and outputs it as metadata 1050.
  • metadata 1050 includes common metadata and individual metadata.
  • the transmission signal generation unit 106 receives the transmission signal generation instruction 1022 and the metadata 1050 and generates a signal to be transmitted to the display 2 connected to the digital camera 1. Specifically, when the transmission signal generation instruction 1022 is received, the transmission signal generation unit 106 acquires, from the image file holding unit 107, image information 1070 necessary for generation of a signal to be transmitted. Then, the transmission signal generation unit 106 performs luminance conversion of the acquired image information 1070 according to the method described in the first embodiment, and further converts the image information 1070 into a format suitable for signal transmission. In the fourth embodiment, the format suitable for transmission is converted to a format corresponding to the EOTF defined in SMPTE ST 2084.
  • the transmission signal generation unit 106 combines the common metadata and the individual metadata based on the display display switching time included in the transmission signal generation instruction 1022 to generate transmission metadata.
  • the combination ratio makes the ratio of common metadata higher as the switching time is shorter, and conversely, makes the ratio of individual metadata higher as the switching time is longer.
  • the reason is that, as the time interval is shorter, the change in the image processing on the television side frequently occurs due to the change in the metadata, so the difference in the metadata between the images is reduced.
  • image processing on the television side tends to be more desirable when viewed as a single image, so when the time interval is long (if there is not much change in the image processing), each image Emphasize metadata.
  • the transmission signal generation unit 106 holds in advance a table for determining the combination ratio of the common metadata and the individual metadata according to the switching time. Then, according to the information in this table, the common metadata and the individual metadata are combined to generate transmission metadata. Then, the transmission signal generation unit 106 associates the combined metadata with the image information converted into a format suitable for transmission, and transmits the information as a transmission signal 1060 to the transmission unit 108.
  • whether or not the processing described in the first to fourth embodiments described above is performed may be set by, for example, user operation. That is, even if there is a mode in which the maximum luminance based on the dynamic range of the image is transmitted to the external device for each image, and a mode in which the maximum luminance is transmitted to the external device as in the first to fourth embodiments. Good.
  • the processing module shown in FIG. 2, FIG. 3 or FIG. 5 may be configured in an external image processing apparatus, and an image file may be obtained from the imaging apparatus.
  • an imaging system can be configured by the imaging device and the image processing device.
  • the present invention may be implemented by appropriately combining the first to fourth embodiments described above.
  • the present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. Can also be realized. It can also be implemented by a circuit (eg, an ASIC) that implements one or more functions.
  • a circuit eg, an ASIC

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Image Processing (AREA)
  • Television Signal Processing For Recording (AREA)
PCT/JP2018/021859 2017-06-28 2018-06-07 画像処理装置及び方法 Ceased WO2019003850A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201880043095.1A CN110800285B (zh) 2017-06-28 2018-06-07 图像处理设备、图像处理方法和存储介质
US16/708,164 US11252335B2 (en) 2017-06-28 2019-12-09 Image processing apparatus and method, and non-transitory computer-readable storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017-126515 2017-06-28
JP2017126515A JP6948173B2 (ja) 2017-06-28 2017-06-28 画像処理装置及び方法、撮像装置、及び、撮像システム

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/708,164 Continuation US11252335B2 (en) 2017-06-28 2019-12-09 Image processing apparatus and method, and non-transitory computer-readable storage medium

Publications (1)

Publication Number Publication Date
WO2019003850A1 true WO2019003850A1 (ja) 2019-01-03

Family

ID=64740614

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/021859 Ceased WO2019003850A1 (ja) 2017-06-28 2018-06-07 画像処理装置及び方法

Country Status (4)

Country Link
US (1) US11252335B2 (enExample)
JP (1) JP6948173B2 (enExample)
CN (1) CN110800285B (enExample)
WO (1) WO2019003850A1 (enExample)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7256663B2 (ja) * 2019-03-26 2023-04-12 キヤノン株式会社 画像出力装置およびその制御方法
JP2022141397A (ja) * 2021-03-15 2022-09-29 パナソニックＩｐマネジメント株式会社 映像視聴システム、および視聴端末の遠隔操作方法
JP2023079119A (ja) * 2021-11-26 2023-06-07 キヤノン株式会社 画像処理装置、撮像装置および画像処理方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015169722A (ja) * 2014-03-05 2015-09-28 ソニー株式会社 撮像装置
JP2016058848A (ja) * 2014-09-08 2016-04-21 ソニー株式会社 画像処理装置及び画像処理方法
WO2016072347A1 (ja) * 2014-11-07 2016-05-12 ソニー株式会社 送信装置、送信方法、受信装置および受信方法
JP2017060113A (ja) * 2015-09-18 2017-03-23 日本放送協会 Ｈｄｒ−ｓｄｒ一体化制作用ビデオカメラ及びアパーチャ操作装置

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014052494A (ja) * 2012-09-06 2014-03-20 Sharp Corp 画像表示装置、画像表示装置の制御方法、画像表示装置の制御プログラムおよびその制御プログラムを記録した記録媒体
CN106105177B (zh) * 2014-06-10 2019-09-27 松下知识产权经营株式会社 变换方法及变换装置
JP6421504B2 (ja) 2014-07-28 2018-11-14 ソニー株式会社 画像処理装置及び画像処理方法
KR102322709B1 (ko) * 2015-04-29 2021-11-08 엘지디스플레이 주식회사 영상 처리 방법 및 영상 처리 회로와 그를 이용한 표시 장치
EP3136375B1 (en) * 2015-08-31 2020-07-08 Lg Electronics Inc. Image display apparatus
JP6729055B2 (ja) * 2016-06-23 2020-07-22 セイコーエプソン株式会社 映像処理装置、表示装置および映像処理方法
CN106101679B (zh) * 2016-08-23 2018-01-12 青岛海信电器股份有限公司 高动态范围信号的处理方法及处理系统

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015169722A (ja) * 2014-03-05 2015-09-28 ソニー株式会社 撮像装置
JP2016058848A (ja) * 2014-09-08 2016-04-21 ソニー株式会社 画像処理装置及び画像処理方法
WO2016072347A1 (ja) * 2014-11-07 2016-05-12 ソニー株式会社 送信装置、送信方法、受信装置および受信方法
JP2017060113A (ja) * 2015-09-18 2017-03-23 日本放送協会 Ｈｄｒ−ｓｄｒ一体化制作用ビデオカメラ及びアパーチャ操作装置

Also Published As

Publication number Publication date
US11252335B2 (en) 2022-02-15
US20200120254A1 (en) 2020-04-16
CN110800285B (zh) 2021-07-27
JP6948173B2 (ja) 2021-10-13
CN110800285A (zh) 2020-02-14
JP2019009731A (ja) 2019-01-17

Similar Documents

Publication Publication Date Title
US10082723B2 (en) Image capturing apparatus for generating a high dynamic range video frame from multiple image frames with different characteristics
US10567727B2 (en) Reproduction method, creation method, reproduction device, creation device, and recording medium
US10600170B2 (en) Method and device for producing a digital image
JP2017068207A (ja) 画像処理装置、画像処理方法及びプログラム
US11438546B2 (en) Image capturing apparatus and playback apparatus and control methods thereof and non-transitory computer-readable storage medium
US11252335B2 (en) Image processing apparatus and method, and non-transitory computer-readable storage medium
US10009588B2 (en) Image processing apparatus and imaging apparatus
US10091415B2 (en) Image processing apparatus, method for controlling image processing apparatus, image pickup apparatus, method for controlling image pickup apparatus, and recording medium
JP2017139618A (ja) 画像データ生成装置、画像データ生成方法、及びプログラム
US11122234B2 (en) Image output apparatus, control method thereof and computer-readable storage medium
US20240298094A1 (en) Image processing apparatus, method and storage medium
US11871124B2 (en) Image capturing apparatus, method of controlling the same, and non-transitory computer-readable storage medium
US10542207B2 (en) Image processing apparatus and image processing method
JP2021078051A (ja) 画像処理装置および画像制御方法、プログラム、並びに記憶媒体
US20240171696A1 (en) Image processing apparatus, control method and storage medium
EP4654123A1 (en) Image processing apparatus, control method, storage medium and program
US11283938B2 (en) Communication apparatus communicating with another communication apparatus based on performance, control method, and storage medium
US12401910B2 (en) Image processing apparatus, image processing method, and image capture apparatus
JP2007097032A (ja) 画像表示装置、画像表示方法およびディジタルカメラ
US12493929B2 (en) Image processing apparatus, image processing method, and program
JP6161385B2 (ja) 撮像装置及びその制御方法
JP2020064102A (ja) 表示装置および表示方法
CN113747046B (zh) 图像处理方法、装置、存储介质及电子设备
JP2020022004A (ja) 撮像装置
JP2018019122A (ja) 画像データ処理装置および撮像装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18822828

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18822828

Country of ref document: EP

Kind code of ref document: A1