WO2021237692A1 - Image processing method and system - Google Patents

Image processing method and system Download PDF

Info

Publication number
WO2021237692A1
WO2021237692A1 PCT/CN2020/093344 CN2020093344W WO2021237692A1 WO 2021237692 A1 WO2021237692 A1 WO 2021237692A1 CN 2020093344 W CN2020093344 W CN 2020093344W WO 2021237692 A1 WO2021237692 A1 WO 2021237692A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
water surface
area
image area
processed
Prior art date
Application number
PCT/CN2020/093344
Other languages
French (fr)
Chinese (zh)
Inventor
翁松伟
王泽森
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2020/093344 priority Critical patent/WO2021237692A1/en
Priority to CN202080005185.9A priority patent/CN112740664A/en
Publication of WO2021237692A1 publication Critical patent/WO2021237692A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals
    • H04N9/73Colour balance circuits, e.g. white balance circuits or colour temperature control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/64Circuits for processing colour signals
    • H04N9/646Circuits for processing colour signals for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters

Definitions

  • the present invention relates to the field of image processing technology, and more specifically to an image processing method, device, computer-readable storage medium, imaging device, and image processing system.
  • an image processing method includes a judging processing step, the judging processing step includes: a first judging step: judging whether the image to be processed also has a water surface area And an underwater image area; and the image processing method further includes: a to-be-processed image processing step: in the case where the judgment result of the judgment processing step is yes, adjusting the water surface image area and/or the underwater image area For saturation, the case where the judgment result of the judgment processing step is yes includes the judgment result of the first judgment substep being yes.
  • a computer-readable storage medium wherein the computer-readable storage medium stores instructions, and the instructions are used to implement the above-mentioned image processing method.
  • an imaging device comprising: an imaging unit: the imaging unit generates an image to be processed; a judgment module: judging whether the image to be processed simultaneously exists in a water surface area; Underwater image area; processing module: in the case that the image to be processed meets a preset condition, adjust the saturation of the water surface image area and/or the water image area, and the preset condition includes the image to be processed The water surface picture area and the water picture area exist at the same time.
  • an image processing system comprising: a receiver for receiving an image to be processed; a system processor configured to determine whether the image to be processed simultaneously exists on the water surface A picture area and an underwater picture area; when the image to be processed satisfies a preset condition, the saturation of the water surface picture area and/or the water picture area is adjusted, and the preset condition includes the image to be processed The water surface picture area and the water picture area exist at the same time.
  • Fig. 1 is a schematic diagram of an image processing method according to an embodiment of the present invention
  • Fig. 2 is a flowchart of an image processing method according to a first embodiment of the present invention
  • Fig. 3 is a flowchart of an image processing method according to a second embodiment of the present invention.
  • Figure 4 is a structural block diagram of a device according to an embodiment of the present invention.
  • Fig. 5 is a structural block diagram of a computer-readable storage medium according to an embodiment of the present invention.
  • Fig. 7 is a structural block diagram of an image processing system according to an embodiment of the present invention.
  • 10 is a device
  • 100 is a device processor
  • 20 is a computer-readable storage medium
  • 200 is an instruction
  • 30 is an imaging device
  • 300 is an imaging unit
  • 400 is a judgment module
  • 500 is a processing module
  • 600 is a pressure detection device
  • 700 waterproof unit 40 is the image processing system
  • 800 is the receiver
  • 900 is the system processor.
  • first and second are only used for description purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with “first” and “second” may explicitly or implicitly include, but are not limited to, one or more of the features.
  • FIG. 1 is a schematic diagram of an image processing method according to an embodiment of the present invention.
  • the image to be processed can be either a photo or a video.
  • the image processing method processes the frame of the photo.
  • the image processing method processes any frame in the video. Number of photos to be processed.
  • the image processing method includes, but is not limited to, a judgment processing step and a to-be-processed image processing step. Among them, the judgment processing steps include but are not limited to the first judgment sub-step.
  • image processing methods include but are not limited to:
  • the image processing step to be processed when the judgment result of the judgment processing step is yes, adjust the saturation of the water surface image area and/or the water image area, and the case where the judgment result of the judgment processing step is yes includes but is not limited to the first The judgment result of one judgment step is yes.
  • the value of the preset number of frames can be any value from 15 to 25 frames, for example, it can be 1 frame, 2 frames, 3 frames, 4 frames, 5 frames, 6 frames, 7 frames, 8 frames, 9 frames, 10 frames. Frames, 11 frames, 12 frames, 13 frames, 14 frames, 15 frames, 16 frames, 17 frames, 18 frames, 19 frames, 20 frames, 21 frames, 22 frames, 23 frames, 24 frames, 25 frames, etc., among others In the embodiment, the value of the preset number of frames may also be other values.
  • the first judging sub-step when a feature area containing a preset feature appears in the preset number of detected images, and the red channel gain of the feature area is higher than the channel gain threshold, it is judged that the image to be processed has a water surface area.
  • the preset feature can be water ripples or a certain value of strong light intensity, etc.
  • the specific value of the strong light intensity can be determined according to experimental conditions.
  • the identification of the preset feature can use methods such as intelligent scene judgment to determine whether the red channel gain of the feature region is higher than the channel gain threshold, and white balance can be combined to determine whether the red channel gain of the feature region is higher than the channel gain threshold.
  • the value of the channel gain threshold can be determined experimentally. More appropriately, the RGB value falls within the range of [236 232 187] to [255 69 0].
  • the RGB value is [255 130 71], [255 165 0], [250 128 114], or [238 118 33], It can be judged to be reddish or orangeish.
  • the gain of the red channel can be adjusted according to user preference or pre-calibration to achieve an image effect closer to human vision. In particular, it is ideal to adjust the RGB value to [255 255 255] without affecting other colors or the beauty of the picture.
  • the image to be processed After judging that the image to be processed exists in the water surface area, it can be further determined whether the image to be processed still has an underwater image area, and it can be determined that the image to be processed still exists in the water image area when a blue image is detected in the area outside the water surface area. Wait.
  • the second preset color may be blue, such as light blue, dark blue, etc.
  • the preset ratio range can be 70% to 95%, for example, the preset ratio range can be 70%, 71%, 72%, 73%, 74%, 75%, 76%, 77%, 78%, 79%, 80%, 81%, 82%, 83%, 84%, 85%, 86%, 87%, 88%, 89%, 90%, 91%, 92%, 93%, 94%, 95%, etc., in In other embodiments, the preset ratio range may be other numerical ranges.
  • the image to be processed by this way of determining that there is a second preset color in the image to be processed and the proportion of the frame with the second preset color to the image to be processed is within the range of the preset ratio when the light intensity is low. Whether there is a water surface image area and a water image area at the same time, the dark light illumination intensity can be lower than the strong light illumination intensity, and the numerical value of the dark light illumination intensity can be determined by an experimental method.
  • the color temperature adjustment sub-step is after the first judgment sub-step, if the judgment result of the first judgment sub-step is yes, the color temperature adjustment process is performed on the image to be processed.
  • the judgment processing step includes the first judgment step and does not include the second judgment step, the case where the judgment result of the judgment processing step is yes includes the judgment result of the first judgment substep being yes; In the case where the judgment processing step includes the first judgment step and the second judgment step, the case where the judgment result of the judgment processing step is yes includes the judgment result of the first judgment substep is yes and the judgment result of the second judgment substep is Yes.
  • the color temperature adjustment process is directly performed on the image to be processed.
  • the color temperature of the image to be processed can be adjusted by means of automatic white balance, and the color temperature can be increased according to the red channel gain of the water surface area and the weight of the strong light intensity area, for example, when the water surface area is The higher the red channel gain of the area, the higher the color temperature adjustment.
  • the weight of the strong light intensity area is, the higher the color temperature adjustment, etc., and the range of color temperature adjustment can be based on ensuring that the overall color temperature of the image to be processed is normal And set in accordance with the visual habits of the human eye.
  • the judgment processing step may also include, but is not limited to, a second judgment sub-step.
  • the second judgment sub-step is after the color temperature adjustment sub-step and the first judgment sub-step.
  • the second judgment step includes, but is not limited to, judging whether the saturation of the first preset color in the water surface image area is greater than the saturation threshold.
  • the first preset color may be red and/or orange.
  • the value of the saturation threshold can be determined by experimental methods.
  • the second white balance adjustment can be performed on the image to be processed and/or the image to be processed can be output.
  • the judgment processing step includes the first judgment step and does not include the second judgment step
  • the case where the judgment result of the judgment processing step is no includes the judgment result of the first judgment substep being no
  • the judgment processing step includes the first judgment step and the second judgment step
  • the case where the judgment result of the judgment processing step is no includes whether the judgment result of the first judgment step is no or the judgment result of the second judgment step is no.
  • the second white balance processing can use white patch (white spot) algorithm or gray world (gray world) algorithm, etc., since these algorithms themselves are well known by those skilled in the art, they will not be described in detail here.
  • adjusting the saturation of the water surface image area and/or the water image area may include, but is not limited to, reducing the red and/or orange saturation of the water surface image area, that is, it may only reduce the red saturation of the water surface image area. Degree, or only reduce the orange saturation of the water surface area, or reduce the red and orange saturation of the water surface area at the same time.
  • adjusting the saturation of the water surface image area and/or the water image area may include, but is not limited to, increasing the blue saturation of the water image area.
  • Adjusting the saturation of the water surface image area and/or the underwater image area may also include, but is not limited to, adjusting the saturation of the water surface image area and/or the underwater image area in a manner set by the user.
  • the user can set the method to reduce the red saturation of the water surface area
  • the user can also set the method to reduce the orange saturation of the water surface area
  • the user can also set the method to reduce the red and orange saturation of the water surface area at the same time.
  • the user can also set the way to increase the blue saturation of the water screen area, and the user can also set the way to reduce the red saturation of the water screen area and increase the blue saturation of the water screen area.
  • the user can also set The method of reducing the orange saturation of the water surface image area and increasing the blue saturation of the underwater image area, the user can also set the method of reducing the red and orange saturation of the water surface image area and increasing the blue saturation of the underwater image area, etc.
  • the user can also set the degree of saturation adjustment, for example, the degree of reducing the red saturation of the water surface image area, the degree of reducing the orange saturation of the water image area, the degree of increasing the blue saturation of the underwater image area, and so on.
  • the processing step of the image to be processed may also include but is not limited to a recording step.
  • the recording step includes but is not limited to recording the completed operation of adjusting the saturation of the water surface area and/or the water image area.
  • the operation of adjusting the saturation of the water surface image area and/or the water image area is performed according to the recording result of the recording step.
  • the recording result of the recording step indicates that the operation of adjusting the saturation of the water surface image area and/or the water image area has been completed
  • the way to reduce the red saturation of the water surface image area is the most, then in the image processing step to be processed,
  • the operation of adjusting the saturation of the water surface image area and/or the water image area is to reduce the red saturation of the water surface image area.
  • the recording result of the recording step indicates that the operation of adjusting the saturation of the water surface image area and/or the water image area has been completed, the way to reduce the orange saturation of the water surface image area is the most, then the image processing step to be processed , The operation of adjusting the saturation of the water surface image area and/or the water image area is to reduce the orange saturation of the water surface image area.
  • the recording result of the recording step indicates that in the completed operation of adjusting the saturation of the water surface image area and/or the water image area, the way to increase the blue saturation of the water image area is the most, then the image processing step to be processed ,
  • the operation of adjusting the saturation of the water surface image area and/or the underwater image area is to increase the blue saturation of the underwater image area or the like.
  • This method makes the image processed by the image processing method more suitable for the user's preferences, and does not require manual operation by the user to select the preferred method, which greatly improves the user experience.
  • the image processing method may further include but is not limited to a reprocessing step.
  • the reprocessing step includes, but is not limited to, adjusting the hue and/or feathering of the water surface image area.
  • Adjusting the hue can prevent the color from being adjusted to distortion, and the feathering process makes the connection of the various areas of the image to be processed more natural, and improves the overall visual effect of the image to be processed.
  • the reprocessing step may be performed after the image processing step to be processed, and the feathering process may be performed on the edge of the water surface image area and/or the water image area, so that the connection between the water surface image area and the water image area is more natural.
  • the image processing method may further include, but is not limited to, a white balance processing step.
  • the white balance processing step includes, but is not limited to, performing a first white balance adjustment on the water surface image area.
  • the white balance processing step can be executed after the reprocessing step.
  • the first white balance adjustment can be performed on the water surface image area with the underwater image area as a reference to further reduce the reddish phenomenon of the water surface image area.
  • the first white balance processing may be the same as the second white balance processing, or may be different from the second white balance processing.
  • the first white balance processing can use a white patch (white spot) algorithm or a gray world (gray world) algorithm, etc.
  • the white patch algorithm When using the white patch algorithm, it can not only retain the bluish color in the water image area, but also reduce the red in the water surface image area, so that the overall color temperature and image color are closer to reality.
  • the image to be processed can be partitioned, and the standard deviation of each area can be calculated.
  • a large standard deviation indicates that the corresponding area has richer colors.
  • the statistical weight of the area with a large standard deviation can be increased to ensure The blue of the picture area in the water.
  • This image processing method adjusts the saturation of the water surface image area and/or the water image area of the to-be-processed image that simultaneously exists in the water surface image area and the water image area, which can effectively solve the problem that the above-mentioned image simultaneously exists in the water image area and the water surface image area.
  • the red saturation of the water surface image area is too high, which leads to the problem that the image effect of the water image area and the water surface image area is not good at the same time.
  • This image processing method can also obtain a better image when there are both a water surface area and an underwater image area in the image to be processed, which improves the image quality and user experience of the image to be processed.
  • Step S202 Acquire a detection image corresponding to a preset number of frames and the image to be processed.
  • Step S204 is executed after step S202.
  • the first judgment is divided into steps: judging whether the image to be processed simultaneously exists in the water surface image area and the underwater image area.
  • the image to be processed has a water surface area.
  • a blue screen is detected in an area outside the water surface image area, it is determined that the image to be processed still has an underwater image area.
  • step S204 if the judgment result is yes, step S206 is executed, and if the judgment result is no, step S218 is executed.
  • Step S206 the color temperature adjustment is divided into steps: adjusting the color temperature of the image to be processed.
  • Step S208 is executed after step S206.
  • the second judgment is divided into steps: judging whether the saturation of the first preset color in the water surface image area is greater than the saturation threshold.
  • the first preset color may be red and/or orange.
  • step S208 if the judgment result is yes, step S210 is executed, and if the judgment result is no, step S216 is executed.
  • Step S210 the image processing step to be processed: adjusting the saturation of the water surface image area and/or the water image area.
  • Step S212 is executed after step S210.
  • Adjusting the saturation of the water surface image area and/or the underwater image area may also include, but is not limited to, adjusting the saturation of the water surface image area and/or the underwater image area in a manner set by the user. This method makes the image processing method more intelligent, and can adjust the saturation of the water surface image area and/or the water image area according to the user's preference, which improves the user experience.
  • Step S212 a further processing step: adjusting the hue and/or feathering of the water surface image area.
  • Step S214 is executed after step S212.
  • Adjusting the hue can prevent the color from being distorted.
  • the feathering process makes the connection between the water surface area and the water image area more natural, and improves the overall visual effect of the image to be processed.
  • Step S214 white balance processing step: performing a first white balance adjustment on the water surface image area.
  • Step S216 is executed after step S214.
  • the first white balance adjustment can be performed on the water surface image area with the underwater image area as a reference to further reduce the reddish phenomenon of the water surface image area.
  • Step S218 Perform a second white balance adjustment on the image to be processed. Therefore, even in the case that the image to be processed does not have a water surface area and a water image area at the same time, an image with a better effect can be obtained.
  • Step S216 is executed after step S218.
  • the image processing method provided in the first embodiment adjusts the saturation of the water surface image area and/or the water image area of the image to be processed that simultaneously exists in the water surface image area and the underwater image area, which can effectively solve the problem that the image also exists in the water image.
  • the red saturation of the water surface area is too high in the area and the water surface image area, which leads to the problem of poor image effects of the water image area and the water surface image area at the same time.
  • This image processing method can also obtain a better image when there are both a water surface area and an underwater image area in the image to be processed, which improves the image quality and user experience of the image to be processed.
  • Fig. 3 is a flowchart of an image processing method according to a second embodiment of the present invention. As shown in Fig. 3, the image processing method of the second embodiment includes but is not limited to:
  • Step S302 the color temperature adjustment is divided into steps: adjusting the color temperature of the image to be processed.
  • Step S304 is executed after step S302.
  • the color temperature adjustment step by step can reduce the reddishness of the water surface area of the image to be processed to a certain extent, so that when there are both water surface area and water image area in the image to be processed, the overall visual effect of the image to be processed is better. good.
  • the first judgment is divided into steps: judging whether the image to be processed has a water surface image area and an underwater image area at the same time.
  • the proportion of the frame with the second preset color to the image to be processed is within the preset ratio range, it is determined that the image to be processed simultaneously exists in the water surface area and the underwater area .
  • the second preset color may be blue.
  • step S304 if the judgment result is yes, step S306 is executed, and if the judgment result is no, step S316 is executed.
  • Adjusting the hue can prevent the color from being adjusted to distortion, and the feathering process makes the connection of the various areas of the image to be processed more natural, and improves the overall visual effect of the image to be processed.
  • FIG. 5 is a structural block diagram of the computer-readable storage medium 20 according to an embodiment of the present invention.
  • the computer-readable storage medium 20 may include, but is not limited to, non-volatile or volatile storage media, such as random access memory (RAM), static RAM, dynamic RAM, read-only memory (ROM), programmable ROM, erasable In addition to programmable ROM, electrically erasable programmable ROM, flash memory, secure digital (SD) card, etc.
  • the computer-readable storage medium 20 may be used to store instructions 200, which are used to implement any of the above-mentioned image processing methods.
  • the receiver 800 is used to receive the image to be processed.
  • the system processor 900 may also be configured to obtain a detection image corresponding to a predetermined number of frames and the image to be processed.
  • the detection image corresponding to the preset number of frames can be obtained.
  • the receiver 800 can repeatedly receive the photo with the same shooting position and angle as the photo, and the photo can also be copied to obtain the preset frame Number of detected images, etc.; when the image to be processed is a video, you can directly obtain a preset number of detected images from the video, or you can copy each frame of photos in the video to get a preset frame for each frame of photos Number of detected images, etc.
  • the preset feature can be water ripples or a certain value of strong light intensity, etc.
  • the specific value of the strong light intensity can be determined according to experimental conditions.
  • the identification of the preset feature can use methods such as intelligent scene judgment to determine whether the red channel gain of the feature region is higher than the channel gain threshold, and white balance can be combined to determine whether the red channel gain of the feature region is higher than the channel gain threshold.
  • system processor 900 may also be configured to: in the case where there is a second preset color in the image to be processed and the ratio of the frame with the second preset color to the image to be processed is within the preset ratio range , It is determined that the image to be processed simultaneously exists in the water surface area and the underwater area.
  • the second preset color may be blue, such as light blue, dark blue, etc.
  • the preset ratio can range from 70% to 95%.
  • the system processor 900 may also be configured to adjust the color temperature of the image to be processed when the image to be processed has both a water surface image area and an underwater image area, and adjust the water surface image area and/or of the image to be processed after adjusting the color temperature. Or the saturation of the image area in the water; or determine whether the image to be processed simultaneously exists in the water surface area and the water image area before adjusting the color temperature of the image to be processed.
  • the process of adjusting the color temperature of the image to be processed may include, but is not limited to, the process of increasing the color temperature of the image to be processed.
  • the color temperature adjustment step by step can reduce the reddishness of the water surface area of the image to be processed to a certain extent, so that when there are both water surface area and water image area in the image to be processed, the overall visual effect of the image to be processed is better. good.
  • the color temperature of the image to be processed can be adjusted by means of automatic white balance, and the color temperature can be increased according to the red channel gain of the water surface area and the weight of the strong light intensity area, for example, when the water surface area is The higher the red channel gain of the area, the higher the color temperature adjustment.
  • the weight of the strong light intensity area is, the higher the color temperature adjustment, etc., and the range of color temperature adjustment can be based on ensuring that the overall color temperature of the image to be processed is normal And set in accordance with the visual habits of the human eye.
  • the system processor 900 may also be configured to, after adjusting the color temperature of the image to be processed and determining whether the image to be processed has both a water surface image area and an underwater image area, it also determines whether the saturation of the first preset color of the water surface image area is greater than saturation. Degree threshold. And the preset condition includes, but is not limited to, that the image to be processed has both a water surface image area and a water image area, and the saturation of the first preset color of the water surface image area is greater than the saturation threshold. Wherein, the first preset color may be red and/or orange.
  • adjusting the saturation of the water surface image area and/or the water image area includes, but is not limited to, reducing the red and/or orange saturation of the water surface image area. In other embodiments, adjusting the saturation of the water surface image area and/or the underwater image area includes, but is not limited to, increasing the blue saturation of the water image area.
  • Adjusting the saturation of the water surface image area and/or the underwater image area includes, but is not limited to, adjusting the saturation of the water surface image area and/or the underwater image area in a manner set by the user.
  • the system processor 900 may also be configured to record the completed operation of adjusting the saturation of the water surface image area and/or the water image area before adjusting the saturation of the water surface image area and/or the water image area, and adjust the water surface image area and the saturation of the water image area. / Or the operation of the saturation of the underwater picture area is performed according to the record.
  • This method makes the image processed by the image processing system 40 more suitable for the user's preferences, and does not require the user to manually operate to select the preferred method, which greatly improves the user experience.
  • Adjusting the hue can prevent the color from being adjusted to distortion, and the feathering process makes the connection of the various areas of the image to be processed more natural, and improves the overall visual effect of the image to be processed.
  • the system processor 900 may also be configured to adjust the hue and/or feathering of the water surface image area after adjusting the saturation of the water surface image area and/or the water image area. Then, the feathering process can be performed on the edge of the water surface image area and/or the water image area, so that the connection between the water surface image area and the underwater image area is more natural.
  • the system processor 900 may also be configured to perform the first white balance adjustment on the water surface image area.
  • the first white balance processing may be the same as the second white balance processing, or may be different from the second white balance processing.
  • the first white balance processing can use a white patch (white spot) algorithm or a gray world (gray world) algorithm, etc.
  • the system processor 900 may also be configured to perform the first white balance adjustment on the water surface image area after adjusting the hue and/or feathering of the water surface image area.
  • the system processor 900 may also be configured to perform the first white balance adjustment on the water surface image area with the underwater image area as a reference. In order to further reduce the phenomenon of reddish water surface area.
  • the image processing system 40 adjusts the saturation of the water surface image area and/or the water image area of the image to be processed that simultaneously exists in the water surface image area and the underwater image area, which can effectively solve the problem that the above-mentioned image simultaneously exists in the water image area and the water surface image area.
  • This kind of image processing system 40 can also obtain a better image when there are both a water surface image area and an underwater image area in the image to be processed, which improves the image quality and user experience of the image to be processed.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Color Television Image Signal Generators (AREA)

Abstract

An image processing method, a device, a computer-readable storage medium, an imaging device and an image processing system. It can be determined whether an image to be processed has a water surface picture region and an in-water picture region at the same time, and in cases where said image has a water surface picture region and an in-water picture region at the same time, the saturation of the water surface picture region and/or the in-water picture region is adjusted. Thus, an image with a better effect can still be obtained when the image to be processed has a water surface picture region and an in-water picture region at the same time, improving the picture quality of the image to be processed and the user experience.

Description

影像处理的方法和系统Image processing method and system
版权申明Copyright statement
本专利文件披露的内容包含受版权保护的材料。该版权为版权所有人所有。版权所有人不反对任何人复制专利与商标局的官方记录和档案中所存在的该专利文件或者该专利披露。The content disclosed in this patent document contains copyrighted material. The copyright belongs to the copyright holder. The copyright owner does not object to anyone copying the patent document or the patent disclosure in the official records and archives of the Patent and Trademark Office.
技术领域Technical field
本发明涉及影像处理技术领域,更具体地涉及一种影像处理方法、设备、计算机可读存储介质、成像设备以及影像处理系统。The present invention relates to the field of image processing technology, and more specifically to an image processing method, device, computer-readable storage medium, imaging device, and image processing system.
背景技术Background technique
浮潜拍摄是当下比较受欢迎的一种摄影方式,用户可以通过浮潜拍摄的方式来拍摄包括各种水中地貌、景色等的影像。然而,目前对浮潜拍摄方式拍摄出的同时存在水面画面区域以及水中画面区域的影像进行处理获得的影像的效果并不好。Snorkeling shooting is a more popular way of photography nowadays. Users can use snorkeling shooting to shoot images including various underwater landforms and scenery. However, at present, the effects of images obtained by processing images that simultaneously exist in the water surface area and the underwater area taken by the snorkeling shooting method are not good.
鉴于前述内容,需要克服当前同时存在水面画面区域以及水中画面区域的影像的处理效果不好的问题。此外,当画面中存在大片颜色相同或相近的画面区域时,同样会导致画面成像效果较差。In view of the foregoing, it is necessary to overcome the current problem of poor processing effects of images in the water surface area and the underwater image area at the same time. In addition, when there are large areas of the same or similar color in the image, it will also cause poor image imaging.
发明内容Summary of the invention
鉴于上述问题,提出了一种克服上述问题或者至少部分地解决上述问题的影像处理方法、设备、计算机可读存储介质、成像设备以及影像处理系统。In view of the above problems, an image processing method, device, computer readable storage medium, imaging device, and image processing system that overcome or at least partially solve the above problems are proposed.
根据本发明的第一个方面,提供了一种影像处理方法,所述影像处理方法包括判断处理步骤,所述判断处理步骤包括:第一判断分步骤:判断待处理影像是否同时存在水面画面区域以及水中画面区域;且所述影像处理方法还包括:待处理影像处理步骤:在所述判断处理步骤的判断结果为是的情况下,调节所述水面画面区域和/或所述水 中画面区域的饱和度,所述判断处理步骤的判断结果为是的情况包括所述第一判断分步骤的判断结果为是。According to a first aspect of the present invention, there is provided an image processing method, the image processing method includes a judging processing step, the judging processing step includes: a first judging step: judging whether the image to be processed also has a water surface area And an underwater image area; and the image processing method further includes: a to-be-processed image processing step: in the case where the judgment result of the judgment processing step is yes, adjusting the water surface image area and/or the underwater image area For saturation, the case where the judgment result of the judgment processing step is yes includes the judgment result of the first judgment substep being yes.
根据本发明的第二个方面,提供了一种设备,包括设备处理器,所述设备处理器配置成:判断待处理影像是否同时存在水面画面区域以及水中画面区域;在所述待处理影像满足预设条件的情况下,调节所述水面画面区域和/或所述水中画面区域的饱和度,所述预设条件包括所述待处理影像同时存在所述水面画面区域以及所述水中画面区域。According to a second aspect of the present invention, there is provided a device including a device processor configured to: determine whether an image to be processed simultaneously has a water surface area and an underwater image area; In the case of a preset condition, the saturation of the water surface image area and/or the underwater image area is adjusted, and the preset condition includes that the image to be processed simultaneously exists in the water surface image area and the underwater image area.
根据本发明的第三个方面,提供了一种计算机可读存储介质,其中,所述计算机可读存储介质存储有指令,所述指令用于实现上述影像处理方法。According to a third aspect of the present invention, there is provided a computer-readable storage medium, wherein the computer-readable storage medium stores instructions, and the instructions are used to implement the above-mentioned image processing method.
根据本发明的第四个方面,提供了一种成像设备,所述成像设备包括:成像单元:所述成像单元生成待处理影像;判断模块:判断所述待处理影像是否同时存在水面画面区域以及水中画面区域;处理模块:在所述待处理影像满足预设条件的情况下,调节所述水面画面区域和/或所述水中画面区域的饱和度,所述预设条件包括所述待处理影像同时存在所述水面画面区域以及所述水中画面区域。According to a fourth aspect of the present invention, there is provided an imaging device, the imaging device comprising: an imaging unit: the imaging unit generates an image to be processed; a judgment module: judging whether the image to be processed simultaneously exists in a water surface area; Underwater image area; processing module: in the case that the image to be processed meets a preset condition, adjust the saturation of the water surface image area and/or the water image area, and the preset condition includes the image to be processed The water surface picture area and the water picture area exist at the same time.
根据本发明的第五个方面,提供了一种影像处理系统,所述影像处理系统包括:接收器,用于接收待处理影像;系统处理器,配置成判断所述待处理影像是否同时存在水面画面区域以及水中画面区域;在所述待处理影像满足预设条件的情况下,调节所述水面画面区域和/或所述水中画面区域的饱和度,所述预设条件包括所述待处理影像同时存在所述水面画面区域以及所述水中画面区域。According to a fifth aspect of the present invention, there is provided an image processing system, the image processing system comprising: a receiver for receiving an image to be processed; a system processor configured to determine whether the image to be processed simultaneously exists on the water surface A picture area and an underwater picture area; when the image to be processed satisfies a preset condition, the saturation of the water surface picture area and/or the water picture area is adjusted, and the preset condition includes the image to be processed The water surface picture area and the water picture area exist at the same time.
本发明的发明人发现现有的对同时存在水中画面区域以及水面画面区域的影像进行处理获得的影像的效果并不好的原因在于水上色温和水下色温存在较大的差别,在拍摄出的影像同时存在水中画面区域以及水面画面区域时会存在水面画面区域的红色饱和度过高的问题,从而导致同时存在水中画面区域以及水面画面区域的影像的效果不好。而本发明通过对同时存在水面画面区域以及水中画面区域的 待处理影像进行调节水面画面区域和/或水中画面区域的饱和度,可以有效地解决上述问题,这种方式在待处理影像中同时存在水面画面区域以及水中画面区域时也能得到效果较好的影像,提升了待处理影像的画面质量和用户体验。The inventor of the present invention found that the effect of the existing image obtained by processing images that simultaneously exist in the water screen area and the water surface screen area is not good. The reason is that there is a large difference between the water color temperature and the underwater color temperature. When the image exists in both the underwater screen area and the water surface screen area, there will be a problem that the red saturation of the water surface screen area is too high, which results in the poor effect of the image that exists in the water screen area and the water surface screen area at the same time. The present invention can effectively solve the above problems by adjusting the saturation of the water surface area and/or the water surface area of the image to be processed, which simultaneously exists in the water surface image area and the water image area. This method exists in the image to be processed. Better images can also be obtained in the water surface area and the underwater area, which improves the image quality and user experience of the image to be processed.
本发明的附加方面和优点将在下面的描述部分中变得明显,或通过本发明的实践了解到。本发明内容中提供的仅仅是一个实施例,而不是发明本身,本发明内容的效果仅仅是实施例的效果,而不是发明所有的、全部的技术效果。The additional aspects and advantages of the present invention will become apparent in the following description, or be understood through the practice of the present invention. The content of the present invention provides only one embodiment, not the invention itself, and the effects of the content of the present invention are only the effects of the embodiments, rather than all the technical effects of the invention.
附图说明Description of the drawings
通过下文中参照附图对本发明所作的描述,本发明的其它目的和优点将显而易见,并可帮助对本发明有全面的理解。其中:Through the following description of the present invention with reference to the accompanying drawings, other objects and advantages of the present invention will be apparent and can help a comprehensive understanding of the present invention. in:
图1是根据本发明的一个实施例的影像处理方法的示意图;Fig. 1 is a schematic diagram of an image processing method according to an embodiment of the present invention;
图2是根据本发明的第一个实施例的影像处理方法的流程图;Fig. 2 is a flowchart of an image processing method according to a first embodiment of the present invention;
图3是根据本发明的第二个实施例的影像处理方法的流程图;Fig. 3 is a flowchart of an image processing method according to a second embodiment of the present invention;
图4是根据本发明的一个实施例的设备的结构框图;Figure 4 is a structural block diagram of a device according to an embodiment of the present invention;
图5是根据本发明的一个实施例的计算机可读存储介质的结构框图;Fig. 5 is a structural block diagram of a computer-readable storage medium according to an embodiment of the present invention;
图6是根据本发明的一个实施例的成像设备的结构框图;Fig. 6 is a structural block diagram of an imaging device according to an embodiment of the present invention;
图7是根据本发明的一个实施例的影像处理系统的结构框图。Fig. 7 is a structural block diagram of an image processing system according to an embodiment of the present invention.
应该注意的是,附图并未按比例绘制,并且出于说明目的,在整个附图中类似结构或功能的元素通常用类似的附图标记来表示。还应该注意的是,附图只是为了便于描述优选实施例,而不是发明本身。附图没有示出所描述的实施例的每个方面,并且不限制本发明的范围。It should be noted that the drawings are not drawn to scale, and for illustrative purposes, elements with similar structures or functions throughout the drawings are generally denoted by similar reference numerals. It should also be noted that the drawings are only for the convenience of describing the preferred embodiments, rather than the invention itself. The drawings do not show every aspect of the described embodiments and do not limit the scope of the invention.
图中,10为设备,100为设备处理器,20为计算机可读存储介质,200为指令,30为成像设备,300为成像单元,400为判断模块,500为处理模块,600为压力探测装置,700防水单元,40为影像处理系统,800为接收器,900为系统处理器。In the figure, 10 is a device, 100 is a device processor, 20 is a computer-readable storage medium, 200 is an instruction, 30 is an imaging device, 300 is an imaging unit, 400 is a judgment module, 500 is a processing module, and 600 is a pressure detection device , 700 waterproof unit, 40 is the image processing system, 800 is the receiver, and 900 is the system processor.
具体实施方式Detailed ways
下面详细描述本发明的实施方式,所述实施方式的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施方式是示例性的,仅用于解释本发明,而不能理解为对本发明的限制。The following describes the embodiments of the present invention in detail. Examples of the embodiments are shown in the accompanying drawings, in which the same or similar reference numerals indicate the same or similar elements or elements with the same or similar functions. The following embodiments described with reference to the accompanying drawings are exemplary, and are only used to explain the present invention, but should not be understood as a limitation to the present invention.
在本发明的描述中,需要理解的是,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括但不限于一个或者更多个所述特征。In the description of the present invention, it should be understood that the terms “first” and “second” are only used for description purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first" and "second" may explicitly or implicitly include, but are not limited to, one or more of the features.
下文的公开提供了许多不同的实施方式或例子用来实现本发明。为了简化本发明的公开,下文中对特定例子的部件和方法进行描述。当然,它们仅仅为示例,并且目的不在于限制本发明。此外,本发明可以在不同例子中重复参考数字和/或参考字母,这种重复是为了简化和清楚的目的,其本身不指示所讨论各种实施方式和/或设置之间的关系。The following disclosure provides many different embodiments or examples for implementing the present invention. In order to simplify the disclosure of the present invention, components and methods of specific examples are described below. Of course, they are only examples, and are not intended to limit the invention. In addition, the present invention may repeat reference numerals and/or reference letters in different examples, and this repetition is for the purpose of simplification and clarity, and does not indicate the relationship between the various embodiments and/or settings discussed.
下面详细描述本发明的实施方式,所述实施方式的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施方式是示例性的,仅用于解释本发明,而不能理解为对本发明的限制。The following describes the embodiments of the present invention in detail. Examples of the embodiments are shown in the accompanying drawings, in which the same or similar reference numerals indicate the same or similar elements or elements with the same or similar functions. The following embodiments described with reference to the accompanying drawings are exemplary, and are only used to explain the present invention, but should not be understood as a limitation to the present invention.
本实施例首先提供了一种影像处理方法,图1是根据本发明的一个实施例的影像处理方法的示意图。其中,待处理影像既可以为照片,也可以为视频,当待处理影像为照片时,影像处理方法对该帧照片进行处理,当待处理影像为视频时,影像处理方法对该视频中任意帧数的照片进行处理。影像处理方法包括但不限于判断处理步骤和待处理影像处理步骤。其中,判断处理步骤包括但不限于第一判断分步骤。This embodiment first provides an image processing method. FIG. 1 is a schematic diagram of an image processing method according to an embodiment of the present invention. Among them, the image to be processed can be either a photo or a video. When the image to be processed is a photo, the image processing method processes the frame of the photo. When the image to be processed is a video, the image processing method processes any frame in the video. Number of photos to be processed. The image processing method includes, but is not limited to, a judgment processing step and a to-be-processed image processing step. Among them, the judgment processing steps include but are not limited to the first judgment sub-step.
如图1所示,影像处理方法包括但不限于:As shown in Figure 1, image processing methods include but are not limited to:
S102,第一判断分步骤:判断待处理影像是否同时存在水面画面区域以及水中画面区域。S102, the first judgment is divided into steps: judging whether the image to be processed simultaneously exists in the water surface image area and the underwater image area.
S104,待处理影像处理步骤:在判断处理步骤的判断结果为是的 情况下,调节水面画面区域和/或水中画面区域的饱和度,判断处理步骤的判断结果为是的情况包括但不限于第一判断分步骤的判断结果为是。S104, the image processing step to be processed: when the judgment result of the judgment processing step is yes, adjust the saturation of the water surface image area and/or the water image area, and the case where the judgment result of the judgment processing step is yes includes but is not limited to the first The judgment result of one judgment step is yes.
在一些实施例中,第一判断分步骤前还包括但不限于获取预设帧数与待处理影像对应的检测图像。当待处理影像为照片时,可以获取预设帧数与该照片对应的检测图像,例如通过成像单元重复获取与该照片获得位置以及角度大致相同的照片,还可以复制该照片以获得预设帧数的检测图像等;当待处理影像为视频时,可以直接从该段视频中获取预设帧数的检测图像,也可以复制该视频中的每帧照片以得到针对每帧照片的预设帧数的检测图像等。In some embodiments, before the first determination step, it further includes but is not limited to acquiring a detection image corresponding to a predetermined number of frames and the image to be processed. When the image to be processed is a photo, the detection image corresponding to the preset number of frames can be obtained. For example, the imaging unit can repeatedly obtain a photo with the same position and angle as the obtained photo, and the photo can also be copied to obtain the preset frame Number of detected images, etc.; when the image to be processed is a video, you can directly obtain a preset number of detected images from the video, or you can copy each frame of photos in the video to get a preset frame for each frame of photos Number of detected images, etc.
其中,预设帧数的数值可以为15到25帧中任意数值,例如,可以为1帧、2帧、3帧、4帧、5帧、6帧、7帧、8帧、9帧、10帧、11帧、12帧、13帧、14帧、15帧、16帧、17帧、18帧、19帧、20帧、21帧、22帧、23帧、24帧、25帧等,在其他实施例中,预设帧数的数值也可以为其他数值。Among them, the value of the preset number of frames can be any value from 15 to 25 frames, for example, it can be 1 frame, 2 frames, 3 frames, 4 frames, 5 frames, 6 frames, 7 frames, 8 frames, 9 frames, 10 frames. Frames, 11 frames, 12 frames, 13 frames, 14 frames, 15 frames, 16 frames, 17 frames, 18 frames, 19 frames, 20 frames, 21 frames, 22 frames, 23 frames, 24 frames, 25 frames, etc., among others In the embodiment, the value of the preset number of frames may also be other values.
第一判断分步骤中,在预设帧数检测图像均出现包含预设特征的特征区域,且特征区域的红色通道增益高于通道增益阈值的情况下,则判断待处理影像存在水面画面区域。In the first judging sub-step, when a feature area containing a preset feature appears in the preset number of detected images, and the red channel gain of the feature area is higher than the channel gain threshold, it is judged that the image to be processed has a water surface area.
其中预设特征可以为水波纹或一定数值的强光光照强度等,该强光光照强度的具体数值大小可以根据实验情况测定。其中,预设特征的识别可以通过智能场景判断等方法,判断特征区域的红色通道增益是否高于通道增益阈值可以结合白平衡判定特征区域的红色通道增益是否高于通道增益阈值。其中,通道增益阈值的数值可以通过实验方法确定。较为合适地,RGB值落入[236 232 187]至[255 69 0]范围,例如RGB值为[255 130 71]、[255 165 0]、[250 128 114]或[238 118 33]时,可以判定为偏红或偏橙,此时可以针对用户偏好或事先标定调整红色通道增益,以实现更贴近人眼视觉的图像效果。特别地,在不影响其他色彩或者是画面美感的同时,将RGB值调整为[255 255 255]是较为理想的。The preset feature can be water ripples or a certain value of strong light intensity, etc. The specific value of the strong light intensity can be determined according to experimental conditions. Among them, the identification of the preset feature can use methods such as intelligent scene judgment to determine whether the red channel gain of the feature region is higher than the channel gain threshold, and white balance can be combined to determine whether the red channel gain of the feature region is higher than the channel gain threshold. Among them, the value of the channel gain threshold can be determined experimentally. More appropriately, the RGB value falls within the range of [236 232 187] to [255 69 0]. For example, when the RGB value is [255 130 71], [255 165 0], [250 128 114], or [238 118 33], It can be judged to be reddish or orangeish. At this time, the gain of the red channel can be adjusted according to user preference or pre-calibration to achieve an image effect closer to human vision. In particular, it is ideal to adjust the RGB value to [255 255 255] without affecting other colors or the beauty of the picture.
在判断待处理影像存在水面画面区域后,还可以进一步判断待处 理影像是否还存在水中画面区域,可以在水面画面区域外的区域检测到蓝色画面的情况下判断待处理影像还存在水中画面区域等。After judging that the image to be processed exists in the water surface area, it can be further determined whether the image to be processed still has an underwater image area, and it can be determined that the image to be processed still exists in the water image area when a blue image is detected in the area outside the water surface area. Wait.
在另一些实施例中,在待处理影像中存在第二预设颜色且具有第二预设颜色的画面占待处理影像的比例位于预设比例范围内的情况下,则判断待处理影像同时存在水面画面区域以及水中画面区域。In other embodiments, when the second preset color exists in the image to be processed and the ratio of the frame with the second preset color to the image to be processed is within the preset ratio range, it is determined that the image to be processed exists at the same time Water surface area and underwater area.
其中,第二预设颜色可以为蓝色,例如浅蓝色、深蓝色等。预设比例范围可以为70%至95%,例如,预设比例范围可以为70%、71%、72%、73%、74%、75%、76%、77%、78%、79%、80%、81%、82%、83%、84%、85%、86%、87%、88%、89%、90%、91%、92%、93%、94%、95%等,在其他实施例中,该预设比例范围可以为其他数值范围。Wherein, the second preset color may be blue, such as light blue, dark blue, etc. The preset ratio range can be 70% to 95%, for example, the preset ratio range can be 70%, 71%, 72%, 73%, 74%, 75%, 76%, 77%, 78%, 79%, 80%, 81%, 82%, 83%, 84%, 85%, 86%, 87%, 88%, 89%, 90%, 91%, 92%, 93%, 94%, 95%, etc., in In other embodiments, the preset ratio range may be other numerical ranges.
可以在暗光光照强度时,通过这种判断待处理影像中存在第二预设颜色且具有第二预设颜色的画面占待处理影像的比例位于预设比例范围内的方式来判断待处理影像是否同时存在水面画面区域以及水中画面区域,该暗光光照强度可以低于强光光照强度,暗光光照强度的数值大小可以通过实验方法测定。It is possible to determine the image to be processed by this way of determining that there is a second preset color in the image to be processed and the proportion of the frame with the second preset color to the image to be processed is within the range of the preset ratio when the light intensity is low. Whether there is a water surface image area and a water image area at the same time, the dark light illumination intensity can be lower than the strong light illumination intensity, and the numerical value of the dark light illumination intensity can be determined by an experimental method.
判断处理步骤还可以包括但不限于色温调整分步骤,在一些实施例中,色温调整分步骤可以位于第一判断分步骤之前,在另一些实施例中,色温调整分步骤还可以位于第一判断分步骤之后。The judgment processing step may also include, but is not limited to, the color temperature adjustment sub-step. In some embodiments, the color temperature adjustment sub-step may be located before the first judgment sub-step. In other embodiments, the color temperature adjustment sub-step may also be located in the first judgment. After sub-steps.
色温调整分步骤位于第一判断分步骤之后时,在第一判断分步骤的判断结果为是的情况下,对待处理影像进行调整色温处理。本领域技术人员可以理解地,在判断处理步骤包括第一判断步骤且不包括第二判断步骤的情况下,判断处理步骤的判断结果为是的情况包括第一判断分步骤的判断结果为是;在判断处理步骤包括第一判断步骤且包括第二判断步骤的情况下,判断处理步骤的判断结果为是的情况包括第一判断分步骤的判断结果为是且第二判断分步骤的判断结果为是。本领域技术人员还可以理解地,在色温调整分步骤位于第一判断分步骤之后时,待处理影像处理步骤中,调节的是进行调整色温处理后的待处理影像的水面画面区域和/或水中画面区域的饱和度。When the color temperature adjustment sub-step is after the first judgment sub-step, if the judgment result of the first judgment sub-step is yes, the color temperature adjustment process is performed on the image to be processed. Those skilled in the art can understand that when the judgment processing step includes the first judgment step and does not include the second judgment step, the case where the judgment result of the judgment processing step is yes includes the judgment result of the first judgment substep being yes; In the case where the judgment processing step includes the first judgment step and the second judgment step, the case where the judgment result of the judgment processing step is yes includes the judgment result of the first judgment substep is yes and the judgment result of the second judgment substep is Yes. Those skilled in the art can also understand that when the color temperature adjustment sub-step is after the first judgment sub-step, in the image processing step to be processed, what is adjusted is the water surface area and/or water surface of the image to be processed after the color temperature adjustment process is performed. The saturation of the picture area.
在色温调整分步骤位于第一判断分步骤之前时,则直接对待处理影像进行调整色温处理。When the color temperature adjustment sub-step is before the first judgment sub-step, the color temperature adjustment process is directly performed on the image to be processed.
色温调整分步骤中,对待处理影像进行调整色温处理可以包括但不限于对待处理影像进行调高色温处理。色温调整分步骤可以减少待处理影像在一定程度上的水面画面区域偏红的情况,从而在待处理影像中同时存在水面画面区域以及水中画面区域的情况下,使得待处理影像整体的视觉效果较好。In the color temperature adjustment sub-steps, the process of adjusting the color temperature of the image to be processed may include, but is not limited to, the process of increasing the color temperature of the image to be processed. The color temperature adjustment step by step can reduce the reddishness of the water surface area of the image to be processed to a certain extent, so that when there are both water surface area and water image area in the image to be processed, the overall visual effect of the image to be processed is better. good.
在一些实施例中,可以通过自动白平衡的方式对待处理影像进行调整色温处理,并且可以根据水面画面区域的红色通道增益以及强光光照强度的区域的权重来调高色温,例如,当水面画面区域的红色通道增益越高,则色温调整得越高,当强光光照强度的区域的权重越大,则色温调整得越高等,并且色温调整的幅度可以根据保证待处理影像的画面整体色温正常且符合人眼视觉习惯来设定。In some embodiments, the color temperature of the image to be processed can be adjusted by means of automatic white balance, and the color temperature can be increased according to the red channel gain of the water surface area and the weight of the strong light intensity area, for example, when the water surface area is The higher the red channel gain of the area, the higher the color temperature adjustment. When the weight of the strong light intensity area is, the higher the color temperature adjustment, etc., and the range of color temperature adjustment can be based on ensuring that the overall color temperature of the image to be processed is normal And set in accordance with the visual habits of the human eye.
判断处理步骤还可以包括但不限于第二判断分步骤,第二判断分步骤在色温调整分步骤以及第一判断分步骤后。第二判断分步骤包括但不限于判断水面画面区域的第一预设颜色的饱和度是否大于饱和度阈值。其中,第一预设颜色可以为红色和/或橙色。其中,饱和度阈值的数值可以通过实验方法确定。同样较为合适地,RGB值落入[236 232 187]至[255 69 0]范围,例如RGB值为[255 130 71]、[255 165 0]、[250 128 114]或[238 118 33]时,可以判定为偏红或偏橙,此时可以针对用户偏好或事先标定调整颜色的饱和度,以实现更贴近人眼视觉的图像效果。特别地,在不影响其他色彩或者是画面美感的同时,将RGB值调整为[255 255 255]是较为理想的。The judgment processing step may also include, but is not limited to, a second judgment sub-step. The second judgment sub-step is after the color temperature adjustment sub-step and the first judgment sub-step. The second judgment step includes, but is not limited to, judging whether the saturation of the first preset color in the water surface image area is greater than the saturation threshold. Wherein, the first preset color may be red and/or orange. Among them, the value of the saturation threshold can be determined by experimental methods. It is also appropriate that the RGB value falls within the range of [236 232 187] to [255 69 0], for example, when the RGB value is [255 130 71], [255 165 0], [250 128 114], or [238 118 33] , It can be judged to be reddish or orangeish. At this time, the saturation of the color can be adjusted according to user preference or pre-calibrated to achieve an image effect closer to human vision. In particular, it is ideal to adjust the RGB value to [255 255 255] without affecting other colors or the beauty of the picture.
在判断处理步骤的判断结果为否的情况下,可以对待处理影像进行第二白平衡调整和/或输出待处理影像。本领域技术人员可以理解地,在判断处理步骤包括第一判断步骤且不包括第二判断步骤的情况下,判断处理步骤的判断结果为否的情况包括第一判断分步骤的判断结果为否;在判断处理步骤包括第一判断步骤且包括第二判断步骤的情况下,判断处理步骤的判断结果为否的情况包括第一判断分步骤的判断结果为否或第二判断分步骤的判断结果为否。这种方式使得在待处理影像既使不同时存在水面画面区域以及水中画面区域或水面画面区域的第一预设颜色的饱和度不大于饱和度阈值的情况下,也能获 得较好效果的影像。In the case that the judgment result of the judgment processing step is no, the second white balance adjustment can be performed on the image to be processed and/or the image to be processed can be output. Those skilled in the art can understand that when the judgment processing step includes the first judgment step and does not include the second judgment step, the case where the judgment result of the judgment processing step is no includes the judgment result of the first judgment substep being no; In the case that the judgment processing step includes the first judgment step and the second judgment step, the case where the judgment result of the judgment processing step is no includes whether the judgment result of the first judgment step is no or the judgment result of the second judgment step is no. This method makes it possible to obtain a better image even if the image to be processed does not simultaneously exist in the water surface area and the water surface area or the first preset color saturation of the water surface area is not greater than the saturation threshold. .
在一些实施例中,在判断处理步骤的判断结果为否的情况下,对待处理影像仅进行第二白平衡调整,在另一些实施例中,在判断处理步骤的判断结果为否的情况下,仅输出待处理影像,在其他实施例中,在判断处理步骤的判断结果为否的情况下,对待处理影像进行第二白平衡调整和输出待处理影像,也就是说,先对待处理影像进行第二白平衡调整,再输出待处理影像。In some embodiments, when the judgment result of the judgment processing step is no, only the second white balance adjustment is performed on the image to be processed. In other embodiments, when the judgment result of the judgment processing step is no, Only the image to be processed is output. In other embodiments, when the judgment result of the processing step is no, the image to be processed is adjusted for the second white balance and the image to be processed is output, that is, the image to be processed is first performed 2. Adjust the white balance, and then output the image to be processed.
第二白平衡处理可以使用white patch(白色斑点)算法或gray world(灰度世界)算法等,由于这些算法本身是本领域技术人员所习知的,在此不做赘述。The second white balance processing can use white patch (white spot) algorithm or gray world (gray world) algorithm, etc., since these algorithms themselves are well known by those skilled in the art, they will not be described in detail here.
在一些实施例中,调节水面画面区域和/或水中画面区域的饱和度可以包括但不限于降低水面画面区域的红色和/或橙色饱和度,也就是说,可以仅降低水面画面区域的红色饱和度,或者仅降低水面画面区域的橙色饱和度,又或者同时降低水面画面区域的红色和橙色饱和度。In some embodiments, adjusting the saturation of the water surface image area and/or the water image area may include, but is not limited to, reducing the red and/or orange saturation of the water surface image area, that is, it may only reduce the red saturation of the water surface image area. Degree, or only reduce the orange saturation of the water surface area, or reduce the red and orange saturation of the water surface area at the same time.
在另一些实施例中,调节水面画面区域和/或水中画面区域的饱和度可以包括但不限于提高水中画面区域的蓝色饱和度。In other embodiments, adjusting the saturation of the water surface image area and/or the water image area may include, but is not limited to, increasing the blue saturation of the water image area.
调节水面画面区域和/或水中画面区域的饱和度还可以包括但不限于按照用户设定的方式调节水面画面区域和/或水中画面区域的饱和度。例如,用户可以设定降低水面画面区域的红色饱和度的方式,用户还可以设定降低水面画面区域的橙色饱和度的方式,用户还可以设定同时降低水面画面区域的红色和橙色饱和度的方式,用户还可以设定提高水中画面区域的蓝色饱和度的方式,用户还可以设定降低水面画面区域的红色饱和度且提高水中画面区域的蓝色饱和度的方式,用户还可以设定降低水面画面区域的橙色饱和度且提高水中画面区域的蓝色饱和度的方式,用户还可以设定降低水面画面区域的红色和橙色饱和度且提高水中画面区域的蓝色饱和度的方式等。Adjusting the saturation of the water surface image area and/or the underwater image area may also include, but is not limited to, adjusting the saturation of the water surface image area and/or the underwater image area in a manner set by the user. For example, the user can set the method to reduce the red saturation of the water surface area, the user can also set the method to reduce the orange saturation of the water surface area, and the user can also set the method to reduce the red and orange saturation of the water surface area at the same time. The user can also set the way to increase the blue saturation of the water screen area, and the user can also set the way to reduce the red saturation of the water screen area and increase the blue saturation of the water screen area. The user can also set The method of reducing the orange saturation of the water surface image area and increasing the blue saturation of the underwater image area, the user can also set the method of reducing the red and orange saturation of the water surface image area and increasing the blue saturation of the underwater image area, etc.
并且,用户还可以设定调节饱和度的程度,例如,降低水面画面区域的红色饱和度的程度、降低水面画面区域的橙色饱和度的程度、提高水中画面区域的蓝色饱和度的程度等。In addition, the user can also set the degree of saturation adjustment, for example, the degree of reducing the red saturation of the water surface image area, the degree of reducing the orange saturation of the water image area, the degree of increasing the blue saturation of the underwater image area, and so on.
这种方式使得影像处理方法更加智能,可以根据用户喜好的方式来调节水面画面区域和/或水中画面区域的饱和度,提升了用户体验。This method makes the image processing method more intelligent, and can adjust the saturation of the water surface image area and/or the water image area according to the user's preference, which improves the user experience.
在一些实施例中,待处理影像处理步骤前还可以包括但不限于记录步骤,记录步骤包括但不限于记录已完成的调节水面画面区域和/或水中画面区域的饱和度的操作。且待处理影像处理步骤中,调节水面画面区域和/或水中画面区域的饱和度的操作根据记录步骤的记录结果执行。In some embodiments, the processing step of the image to be processed may also include but is not limited to a recording step. The recording step includes but is not limited to recording the completed operation of adjusting the saturation of the water surface area and/or the water image area. Moreover, in the image processing step to be processed, the operation of adjusting the saturation of the water surface image area and/or the water image area is performed according to the recording result of the recording step.
例如,当记录步骤的记录结果表示已完成的调节水面画面区域和/或水中画面区域的饱和度的操作中,通过降低水面画面区域的红色饱和度的方式最多,则待处理影像处理步骤中,调节水面画面区域和/或水中画面区域的饱和度的操作为降低水面画面区域的红色饱和度。For example, when the recording result of the recording step indicates that the operation of adjusting the saturation of the water surface image area and/or the water image area has been completed, the way to reduce the red saturation of the water surface image area is the most, then in the image processing step to be processed, The operation of adjusting the saturation of the water surface image area and/or the water image area is to reduce the red saturation of the water surface image area.
又例如,当记录步骤的记录结果表示已完成的调节水面画面区域和/或水中画面区域的饱和度的操作中,通过降低水面画面区域的橙色饱和度的方式最多,则待处理影像处理步骤中,调节水面画面区域和/或水中画面区域的饱和度的操作为降低水面画面区域的橙色饱和度。For another example, when the recording result of the recording step indicates that the operation of adjusting the saturation of the water surface image area and/or the water image area has been completed, the way to reduce the orange saturation of the water surface image area is the most, then the image processing step to be processed , The operation of adjusting the saturation of the water surface image area and/or the water image area is to reduce the orange saturation of the water surface image area.
再例如,当记录步骤的记录结果表示已完成的调节水面画面区域和/或水中画面区域的饱和度的操作中,通过提高水中画面区域的蓝色饱和度的方式最多,则待处理影像处理步骤中,调节水面画面区域和/或水中画面区域的饱和度的操作为提高水中画面区域的蓝色饱和度等。For another example, when the recording result of the recording step indicates that in the completed operation of adjusting the saturation of the water surface image area and/or the water image area, the way to increase the blue saturation of the water image area is the most, then the image processing step to be processed , The operation of adjusting the saturation of the water surface image area and/or the underwater image area is to increase the blue saturation of the underwater image area or the like.
这种方式使得影像处理方法处理后得到的影像更加适合用户的喜好,且不需要用户手动操作来选择喜好的方式,极大地提升了用户体验。This method makes the image processed by the image processing method more suitable for the user's preferences, and does not require manual operation by the user to select the preferred method, which greatly improves the user experience.
影像处理方法还可以包括但不限于再处理步骤,再处理步骤包括但不限于对水面画面区域进行调整色相和/或羽化处理。The image processing method may further include but is not limited to a reprocessing step. The reprocessing step includes, but is not limited to, adjusting the hue and/or feathering of the water surface image area.
在一些实施例中,可以仅对水面画面区域进行调整色相处理;在另一些实施例中,可以仅对水面画面区域进行羽化处理;在其他实施例中,可以同时对水面画面区域进行调整色相和羽化处理。In some embodiments, only the water surface image area can be adjusted hue processing; in other embodiments, only the water surface image area can be feathered; in other embodiments, the water surface image area can be adjusted at the same time. Eclosion treatment.
调整色相可以使得颜色不至于调整到失真,羽化处理使得待处理影像的各区域衔接地更加自然,提高待处理影像的整体视觉效果。Adjusting the hue can prevent the color from being adjusted to distortion, and the feathering process makes the connection of the various areas of the image to be processed more natural, and improves the overall visual effect of the image to be processed.
再处理步骤可以在待处理影像处理步骤后执行,则羽化处理可以对水面画面区域和/或水中画面区域的边缘进行,以使得水面画面区域与水中画面区域的衔接更加自然。The reprocessing step may be performed after the image processing step to be processed, and the feathering process may be performed on the edge of the water surface image area and/or the water image area, so that the connection between the water surface image area and the water image area is more natural.
影像处理方法还可以包括但不限于白平衡处理步骤,白平衡处理步骤包括但不限于对水面画面区域进行第一白平衡调整。The image processing method may further include, but is not limited to, a white balance processing step. The white balance processing step includes, but is not limited to, performing a first white balance adjustment on the water surface image area.
白平衡处理步骤可以在再处理步骤后执行。可以以水中画面区域为参照对水面画面区域进行第一白平衡调整,以进一步降低水面画面区域偏红的现象。The white balance processing step can be executed after the reprocessing step. The first white balance adjustment can be performed on the water surface image area with the underwater image area as a reference to further reduce the reddish phenomenon of the water surface image area.
其中,第一白平衡处理可以与第二白平衡处理相同,也可以与第二白平衡处理不同。第一白平衡处理可以使用white patch(白色斑点)算法或gray world(灰度世界)算法等。Wherein, the first white balance processing may be the same as the second white balance processing, or may be different from the second white balance processing. The first white balance processing can use a white patch (white spot) algorithm or a gray world (gray world) algorithm, etc.
在使用white patch算法时既可以保留水中画面区域偏蓝的色彩,又可以降低水面画面区域的红色,使整体的色温和画面色彩更趋近于真实。When using the white patch algorithm, it can not only retain the bluish color in the water image area, but also reduce the red in the water surface image area, so that the overall color temperature and image color are closer to reality.
在使用gray world算法时,可以将待处理影像分区,计算每个区的标准差,标准差大表示对应的区的颜色较丰富,可以加大标准差大的区在统计时的权重,从而保证水中画面区域的蓝色。When using the gray world algorithm, the image to be processed can be partitioned, and the standard deviation of each area can be calculated. A large standard deviation indicates that the corresponding area has richer colors. The statistical weight of the area with a large standard deviation can be increased to ensure The blue of the picture area in the water.
由于已经调节了水面画面区域和/或水中画面区域的饱和度,使得第一白平衡处理时的水中画面区域受水面画面区域偏红的影响较小,既能保证水面画面区域不至于偏红,又能保证水中画面区域色彩趋近于真实。Since the saturation of the water surface image area and/or the water image area has been adjusted, the water image area during the first white balance processing is less affected by the redness of the water surface image area, which can ensure that the water surface image area does not become reddish. It can also ensure that the color of the image area in the water is close to real.
这种影像处理方法通过对同时存在水面画面区域以及水中画面区域的待处理影像进行调节水面画面区域和/或水中画面区域的饱和度,可以有效地解决上述影像同时存在水中画面区域以及水面画面区域时会存在水面画面区域的红色饱和度过高,从而导致同时存在水中画面区域以及水面画面区域的影像的效果不好的问题。这种影像处理方法在待处理影像中同时存在水面画面区域以及水中画面区域时也能得到效果较好的影像,提升了待处理影像的画面质量和用户体验。This image processing method adjusts the saturation of the water surface image area and/or the water image area of the to-be-processed image that simultaneously exists in the water surface image area and the water image area, which can effectively solve the problem that the above-mentioned image simultaneously exists in the water image area and the water surface image area. Sometimes, the red saturation of the water surface image area is too high, which leads to the problem that the image effect of the water image area and the water surface image area is not good at the same time. This image processing method can also obtain a better image when there are both a water surface area and an underwater image area in the image to be processed, which improves the image quality and user experience of the image to be processed.
实施例一Example one
图2是根据本发明的第一个实施例的影像处理方法的流程图;如图2所示,本实施例一的影像处理方法包括但不限于:Fig. 2 is a flowchart of an image processing method according to the first embodiment of the present invention; as shown in Fig. 2, the image processing method of the first embodiment includes but is not limited to:
S202,获取预设帧数与待处理影像对应的检测图像。步骤S202后执行步骤S204。S202: Acquire a detection image corresponding to a preset number of frames and the image to be processed. Step S204 is executed after step S202.
S204,第一判断分步骤:判断待处理影像是否同时存在水面画面区域以及水中画面区域。S204, the first judgment is divided into steps: judging whether the image to be processed simultaneously exists in the water surface image area and the underwater image area.
在预设帧数检测图像均出现包含预设特征的特征区域,且特征区域的红色通道增益高于通道增益阈值的情况下,则判断待处理影像存在水面画面区域。在水面画面区域外的区域检测到蓝色画面的情况下判断待处理影像还存在水中画面区域。In the case that the detected images with the preset number of frames all have feature regions containing preset features, and the red channel gain of the feature region is higher than the channel gain threshold, it is determined that the image to be processed has a water surface area. When a blue screen is detected in an area outside the water surface image area, it is determined that the image to be processed still has an underwater image area.
步骤S204中,若判断结果为是,则执行步骤S206,若判断结果为否,则执行步骤S218。In step S204, if the judgment result is yes, step S206 is executed, and if the judgment result is no, step S218 is executed.
S206,色温调整分步骤:对待处理影像进行调整色温处理。步骤S206后执行步骤S208。S206, the color temperature adjustment is divided into steps: adjusting the color temperature of the image to be processed. Step S208 is executed after step S206.
可以对待处理影像进行调高色温处理。色温调整分步骤可以减少待处理影像在一定程度上的水面画面区域偏红的情况,从而在待处理影像中同时存在水面画面区域以及水中画面区域的情况下,使得待处理影像整体的视觉效果较好。You can increase the color temperature of the image to be processed. The color temperature adjustment step by step can reduce the reddishness of the water surface area of the image to be processed to a certain extent, so that when there are both water surface area and water image area in the image to be processed, the overall visual effect of the image to be processed is better. good.
S208,第二判断分步骤:判断水面画面区域的第一预设颜色的饱和度是否大于饱和度阈值。第一预设颜色可以为红色和/或橙色。S208, the second judgment is divided into steps: judging whether the saturation of the first preset color in the water surface image area is greater than the saturation threshold. The first preset color may be red and/or orange.
步骤S208中,若判断结果为是,则执行步骤S210,若判断结果为否,则执行步骤S216。In step S208, if the judgment result is yes, step S210 is executed, and if the judgment result is no, step S216 is executed.
S210,待处理影像处理步骤:调节水面画面区域和/或水中画面区域的饱和度。步骤S210后执行步骤S212。S210, the image processing step to be processed: adjusting the saturation of the water surface image area and/or the water image area. Step S212 is executed after step S210.
可以降低水面画面区域的红色和/或橙色饱和度,还可以提高水中画面区域的蓝色饱和度。待处理影像处理步骤可以减少待处理影像的水面画面区域偏红的情况,从而在待处理影像中同时存在水面画面区域以及水中画面区域的情况下,使得待处理影像整体的视觉效果较好。It can reduce the red and/or orange saturation of the water surface image area, and can also increase the blue saturation of the water image area. The processing step of the image to be processed can reduce the reddishness of the water surface image area of the image to be processed, so that the overall visual effect of the image to be processed is better when there are both water surface image area and underwater image area in the image to be processed.
调节水面画面区域和/或水中画面区域的饱和度还可以包括但不限于按照用户设定的方式调节水面画面区域和/或水中画面区域的饱和度。这种方式使得影像处理方法更加智能,可以根据用户喜好的方式来调节水面画面区域和/或水中画面区域的饱和度,提升了用户体验。Adjusting the saturation of the water surface image area and/or the underwater image area may also include, but is not limited to, adjusting the saturation of the water surface image area and/or the underwater image area in a manner set by the user. This method makes the image processing method more intelligent, and can adjust the saturation of the water surface image area and/or the water image area according to the user's preference, which improves the user experience.
S212,再处理步骤:对水面画面区域进行调整色相和/或羽化处理。步骤S212后执行步骤S214。S212, a further processing step: adjusting the hue and/or feathering of the water surface image area. Step S214 is executed after step S212.
调整色相可以使得颜色不至于调整到失真,羽化处理使得水面画面区域与水中画面区域的衔接更加自然,提高待处理影像的整体视觉效果。Adjusting the hue can prevent the color from being distorted. The feathering process makes the connection between the water surface area and the water image area more natural, and improves the overall visual effect of the image to be processed.
S214,白平衡处理步骤:对水面画面区域进行第一白平衡调整。步骤S214后执行步骤S216。S214, white balance processing step: performing a first white balance adjustment on the water surface image area. Step S216 is executed after step S214.
可以以水中画面区域为参照对水面画面区域进行第一白平衡调整,以进一步降低水面画面区域偏红的现象。The first white balance adjustment can be performed on the water surface image area with the underwater image area as a reference to further reduce the reddish phenomenon of the water surface image area.
S216,输出待处理影像。S216: Output the image to be processed.
S218,对待处理影像进行第二白平衡调整。使得在待处理影像既使不同时存在水面画面区域以及水中画面区域的情况下,也能获得较好效果的影像。步骤S218后执行步骤S216。S218: Perform a second white balance adjustment on the image to be processed. Therefore, even in the case that the image to be processed does not have a water surface area and a water image area at the same time, an image with a better effect can be obtained. Step S216 is executed after step S218.
本实施例一提供的这种影像处理方法通过对同时存在水面画面区域以及水中画面区域的待处理影像进行调节水面画面区域和/或水中画面区域的饱和度,可以有效地解决影像同时存在水中画面区域以及水面画面区域时会存在水面画面区域的红色饱和度过高,从而导致同时存在水中画面区域以及水面画面区域的影像的效果不好问题。这种影像处理方法在待处理影像中同时存在水面画面区域以及水中画面区域时也能得到效果较好的影像,提升了待处理影像的画面质量和用户体验。The image processing method provided in the first embodiment adjusts the saturation of the water surface image area and/or the water image area of the image to be processed that simultaneously exists in the water surface image area and the underwater image area, which can effectively solve the problem that the image also exists in the water image. The red saturation of the water surface area is too high in the area and the water surface image area, which leads to the problem of poor image effects of the water image area and the water surface image area at the same time. This image processing method can also obtain a better image when there are both a water surface area and an underwater image area in the image to be processed, which improves the image quality and user experience of the image to be processed.
实施例二Example two
图3是根据本发明的第二个实施例的影像处理方法的流程图;如图3所示,本实施例二的影像处理方法包括但不限于:Fig. 3 is a flowchart of an image processing method according to a second embodiment of the present invention; as shown in Fig. 3, the image processing method of the second embodiment includes but is not limited to:
S302,色温调整分步骤:对待处理影像进行调整色温处理。步骤 S302后执行步骤S304。S302, the color temperature adjustment is divided into steps: adjusting the color temperature of the image to be processed. Step S304 is executed after step S302.
可以对待处理影像进行调高色温处理。色温调整分步骤可以减少待处理影像在一定程度上的水面画面区域偏红的情况,从而在待处理影像中同时存在水面画面区域以及水中画面区域的情况下,使得待处理影像整体的视觉效果较好。You can increase the color temperature of the image to be processed. The color temperature adjustment step by step can reduce the reddishness of the water surface area of the image to be processed to a certain extent, so that when there are both water surface area and water image area in the image to be processed, the overall visual effect of the image to be processed is better. good.
S304,第一判断分步骤:判断待处理影像是否同时存在水面画面区域以及水中画面区域。S304, the first judgment is divided into steps: judging whether the image to be processed has a water surface image area and an underwater image area at the same time.
在待处理影像中存在第二预设颜色且具有第二预设颜色的画面占待处理影像的比例位于预设比例范围内的情况下,则判断待处理影像同时存在水面画面区域以及水中画面区域。第二预设颜色可以为蓝色。In the case that there is a second preset color in the image to be processed and the proportion of the frame with the second preset color to the image to be processed is within the preset ratio range, it is determined that the image to be processed simultaneously exists in the water surface area and the underwater area . The second preset color may be blue.
步骤S304中,若判断结果为是,则执行步骤S306,若判断结果为否,则执行步骤S316。In step S304, if the judgment result is yes, step S306 is executed, and if the judgment result is no, step S316 is executed.
S306,第二判断分步骤:判断水面画面区域的第一预设颜色的饱和度是否大于饱和度阈值。第一预设颜色可以为红色和/或橙色。S306, the second judgment is divided into steps: judging whether the saturation of the first preset color in the water surface image area is greater than the saturation threshold. The first preset color may be red and/or orange.
步骤S306中,若判断结果为是,则执行步骤S308,若判断结果为否,则执行步骤S316。In step S306, if the judgment result is yes, step S308 is executed, and if the judgment result is no, step S316 is executed.
S308,记录步骤:记录已完成的调节水面画面区域和/或水中画面区域的饱和度的操作。步骤S308后执行步骤S310。S308, recording step: recording the completed operation of adjusting the saturation of the water surface image area and/or the water image area. Step S310 is executed after step S308.
S310,待处理影像处理步骤:调节水面画面区域和/或水中画面区域的饱和度。步骤S310后执行步骤S312。S310, the image processing step to be processed: adjusting the saturation of the water surface image area and/or the water image area. Step S312 is executed after step S310.
可以降低水面画面区域的红色和/或橙色饱和度,还可以提高水中画面区域的蓝色饱和度。待处理影像处理步骤可以减少待处理影像的水面画面区域偏红的情况,从而在待处理影像中同时存在水面画面区域以及水中画面区域的情况下,使得待处理影像整体的视觉效果较好。It can reduce the red and/or orange saturation of the water surface image area, and can also increase the blue saturation of the water image area. The processing step of the image to be processed can reduce the reddishness of the water surface image area of the image to be processed, so that the overall visual effect of the image to be processed is better when there are both water surface image area and underwater image area in the image to be processed.
调节水面画面区域和/或水中画面区域的饱和度的操作根据记录步骤的记录结果执行。The operation of adjusting the saturation of the water surface picture area and/or the water picture area is performed according to the recording result of the recording step.
S312,再处理步骤:对水面画面区域进行调整色相和/或羽化处理。步骤S312后执行步骤S314。S312, the reprocessing step: adjusting the hue and/or feathering of the water surface image area. Step S314 is executed after step S312.
调整色相可以使得颜色不至于调整到失真,羽化处理使得水面画面区域与水中画面区域的衔接更加自然,提高待处理影像的整体视觉效果。Adjusting the hue can prevent the color from being distorted. The feathering process makes the connection between the water surface area and the water image area more natural, and improves the overall visual effect of the image to be processed.
S314,白平衡处理步骤:对水面画面区域进行第一白平衡调整。步骤S314后执行步骤S316。S314. White balance processing step: performing a first white balance adjustment on the water surface image area. Step S316 is executed after step S314.
可以以水中画面区域为参照对水面画面区域进行第一白平衡调整,以进一步降低水面画面区域偏红的现象。The first white balance adjustment can be performed on the water surface image area with the underwater image area as a reference to further reduce the reddish phenomenon of the water surface image area.
S316,输出待处理影像。S316, output the image to be processed.
本实施例二提供的影像处理方法通过对同时存在水面画面区域以及水中画面区域的待处理影像进行调节水面画面区域和/或水中画面区域的饱和度,可以有效地解决影像同时存在水中画面区域以及水面画面区域时会存在水面画面区域的红色饱和度过高,从而导致同时存在水中画面区域以及水面画面区域的影像的效果不好的问题。这种影像处理方法在待处理影像中同时存在水面画面区域以及水中画面区域时也能得到效果较好的影像,提升了待处理影像的画面质量和用户体验。The image processing method provided in the second embodiment adjusts the saturation of the water surface image area and/or the underwater image area of the image to be processed that simultaneously exists in the water surface image area and the underwater image area, which can effectively solve the problem that the image simultaneously exists in the water image area and the water image area. In the water surface image area, the red saturation of the water surface image area may be too high, which leads to the problem that the image effects of the water image area and the water surface image area are not good at the same time. This image processing method can also obtain a better image when there are both a water surface area and an underwater image area in the image to be processed, which improves the image quality and user experience of the image to be processed.
本实施例还提供了一种设备10,图4是根据本发明的一个实施例的设备10的结构框图。设备10包括但不限于设备处理器100。This embodiment also provides a device 10, and FIG. 4 is a structural block diagram of the device 10 according to an embodiment of the present invention. The device 10 includes but is not limited to a device processor 100.
设备处理器100配置成:判断待处理影像是否同时存在水面画面区域以及水中画面区域。且在待处理影像满足预设条件的情况下,调节水面画面区域和/或水中画面区域的饱和度,预设条件包括但不限于待处理影像同时存在水面画面区域以及水中画面区域。The device processor 100 is configured to determine whether the image to be processed simultaneously exists in the water surface image area and the water image area. And when the image to be processed meets preset conditions, the saturation of the water surface image area and/or the water image area is adjusted. The preset conditions include but are not limited to the presence of the image to be processed in the water surface image area and the water image area at the same time.
在一些实施例中,设备处理器100还可以配置成:获取预设帧数与待处理影像对应的检测图像。当待处理影像为照片时,可以获取预设帧数与该照片对应的检测图像,例如通过成像单元重复获取与该照片获得位置以及角度相同的照片,还可以复制该照片以获得预设帧数的检测图像等;当待处理影像为视频时,可以直接从该段视频中获取预设帧数的检测图像,也可以复制该视频中的每帧照片以得到针对每帧照片的预设帧数的检测图像等。In some embodiments, the device processor 100 may also be configured to: obtain a detection image corresponding to the preset number of frames and the image to be processed. When the image to be processed is a photo, the detection image corresponding to the preset number of frames can be obtained. For example, the imaging unit can repeatedly obtain the photo with the same position and angle as the photo obtained, and the photo can also be copied to obtain the preset number of frames. When the image to be processed is a video, you can directly obtain a preset number of detected images from the video, or you can copy each frame of photos in the video to get the preset number of frames for each frame of photos The detection image and so on.
在预设帧数检测图像均出现包含预设特征的特征区域,且特征区 域的红色通道增益高于通道增益阈值的情况下,则判断待处理影像存在水面画面区域。When the preset number of detected images all have feature areas containing preset features, and the red channel gain of the feature area is higher than the channel gain threshold, it is determined that the image to be processed has a water surface area.
其中预设特征可以为水波纹或一定数值的强光光照强度等,该强光光照强度的具体数值大小可以根据实验情况测定。其中,预设特征的识别可以通过智能场景判断等方法,判断特征区域的红色通道增益是否高于通道增益阈值可以结合白平衡判定特征区域的红色通道增益是否高于通道增益阈值。还可以进一步判断待处理影像是否还存在水中画面区域,可以在水面画面区域外的区域检测到蓝色画面的情况下判断待处理影像还存在水中画面区域等。The preset feature can be water ripples or a certain value of strong light intensity, etc. The specific value of the strong light intensity can be determined according to experimental conditions. Among them, the identification of the preset feature can use methods such as intelligent scene judgment to determine whether the red channel gain of the feature region is higher than the channel gain threshold, and white balance can be combined to determine whether the red channel gain of the feature region is higher than the channel gain threshold. It can also be further determined whether the image to be processed still has an underwater image area, and it can be determined that the image to be processed still has an underwater image area when a blue image is detected in an area outside the water surface image area.
在另一些实施例中,设备处理器100还可以配置成:在待处理影像中存在第二预设颜色且具有第二预设颜色的画面占待处理影像的比例位于预设比例范围内的情况下,则判断待处理影像同时存在水面画面区域以及水中画面区域。In other embodiments, the device processor 100 may also be configured to: in the image to be processed, there is a second preset color and the ratio of the frame with the second preset color to the image to be processed is within the preset ratio range Next, it is determined that the image to be processed simultaneously exists in the water surface area and the underwater area.
其中,第二预设颜色可以为蓝色,例如浅蓝色、深蓝色等。预设比例范围可以为70%至95%。Wherein, the second preset color may be blue, such as light blue, dark blue, etc. The preset ratio can range from 70% to 95%.
可以在暗光光照强度时,通过这种判断待处理影像中存在第二预设颜色且具有第二预设颜色的画面占待处理影像的比例位于预设比例范围内的方式来判断待处理影像是否同时存在水面画面区域以及水中画面区域,该暗光光照强度可以低于强光光照强度,暗光光照强度的数值大小可以通过实验方法测定。It is possible to determine the image to be processed by this way of determining that there is a second preset color in the image to be processed and the proportion of the frame with the second preset color to the image to be processed is within the range of the preset ratio when the light intensity is low. Whether there is a water surface image area and a water image area at the same time, the dark light illumination intensity can be lower than the strong light illumination intensity, and the numerical value of the dark light illumination intensity can be determined by an experimental method.
设备处理器100还可以配置成:在待处理影像同时存在水面画面区域以及水中画面区域的情况下,对待处理影像进行调整色温处理,且调节进行调整色温处理后的待处理影像的水面画面区域和/或水中画面区域的饱和度;或在判断待处理影像是否同时存在水面画面区域以及水中画面区域前对待处理影像进行调整色温处理。The device processor 100 may also be configured to adjust the color temperature of the image to be processed when the image to be processed has both a water surface image area and an underwater image area, and adjust the water surface image area and the image area of the image to be processed after the color temperature adjustment process. / Or the saturation of the image area in the water; or adjust the color temperature of the image to be processed before judging whether the image to be processed simultaneously exists in the water surface image area and the underwater image area.
对待处理影像进行调整色温处理可以包括但不限于对待处理影像进行调高色温处理。由此可以减少待处理影像在一定程度上的水面画面区域偏红的情况,从而使得在待处理影像中同时存在水面画面区域以及水中画面区域的情况下,使得待处理影像整体的视觉效果较好。The process of adjusting the color temperature of the image to be processed may include, but is not limited to, the process of adjusting the color temperature of the image to be processed. This can reduce the redness of the water surface area of the image to be processed to a certain extent, so that when there are both water surface area and underwater image area in the image to be processed, the overall visual effect of the image to be processed is better. .
在一些实施例中,可以通过自动白平衡的方式对待处理影像进行调整色温处理,并且可以根据水面画面区域的红色通道增益以及强光光照强度的区域的权重来调高色温,例如,当水面画面区域的红色通道增益越高,则色温调整得越高,当强光光照强度的区域的权重越大,则色温调整得越高等,并且色温调整的幅度可以根据保证待处理影像的画面整体色温正常且符合人眼视觉习惯来设定。In some embodiments, the color temperature of the image to be processed can be adjusted by means of automatic white balance, and the color temperature can be increased according to the red channel gain of the water surface area and the weight of the strong light intensity area, for example, when the water surface area is The higher the red channel gain of the area, the higher the color temperature adjustment. When the weight of the strong light intensity area is, the higher the color temperature adjustment, etc., and the range of color temperature adjustment can be based on ensuring that the overall color temperature of the image to be processed is normal And set in accordance with the visual habits of the human eye.
设备处理器100还可以配置成:在对待处理影像进行调整色温处理且判断待处理影像是否同时存在水面画面区域以及水中画面区域后,还判断水面画面区域的第一预设颜色的饱和度是否大于饱和度阈值;且预设条件包括但不限于待处理影像同时存在水面画面区域以及水中画面区域且水面画面区域的第一预设颜色的饱和度大于饱和度阈值。第一预设颜色可以为红色和/或橙色。The device processor 100 may also be configured to: after adjusting the color temperature of the image to be processed and determining whether the image to be processed simultaneously exists in the water surface image area and the underwater image area, it also determines whether the saturation of the first preset color of the water surface image area is greater than Saturation threshold; and the preset conditions include, but are not limited to, that the image to be processed has both a water surface image area and an underwater image area, and the saturation of the first preset color of the water surface image area is greater than the saturation threshold. The first preset color may be red and/or orange.
设备处理器100还可以配置成:在待处理影像不同时存在水面画面区域以及水中画面区域或水面画面区域的第一预设颜色的饱和度不大于饱和度阈值的情况下,对待处理影像进行第二白平衡调整和/或输出待处理影像。The device processor 100 may also be configured to: when the image to be processed does not exist in the water surface area and the saturation of the first preset color of the water image area or the water surface area is not greater than the saturation threshold, the image to be processed is 2. White balance adjustment and/or output image to be processed.
第二白平衡调整使得在待处理影像既使不同时存在水面画面区域以及水中画面区域或水面画面区域的第一预设颜色的饱和度不大于饱和度阈值的情况下,也能获得较好效果的影像。The second white balance adjustment makes it possible to obtain better results even if the image to be processed does not have the water surface area and the water surface area or the first preset color saturation is not greater than the saturation threshold. Of the image.
在一些实施例中,调节水面画面区域和/或水中画面区域的饱和度包括但不限于降低水面画面区域的红色和/或橙色饱和度。在另一些实施例中,调节水面画面区域和/或水中画面区域的饱和度包括但不限于提高水中画面区域的蓝色饱和度。In some embodiments, adjusting the saturation of the water surface image area and/or the water image area includes, but is not limited to, reducing the red and/or orange saturation of the water surface image area. In other embodiments, adjusting the saturation of the water surface image area and/or the underwater image area includes, but is not limited to, increasing the blue saturation of the water image area.
在一些实施例中,调节水面画面区域和/或水中画面区域的饱和度可以包括但不限于:按照用户设定的方式调节水面画面区域和/或水中画面区域的饱和度。这种方式使得影像处理方法更加智能,可以根据用户喜好的方式来调节水面画面区域和/或水中画面区域的饱和度,提升了用户体验。In some embodiments, adjusting the saturation of the water surface image area and/or the underwater image area may include, but is not limited to: adjusting the saturation of the water surface image area and/or the underwater image area in a manner set by the user. This method makes the image processing method more intelligent, and can adjust the saturation of the water surface image area and/or the water image area according to the user's preference, which improves the user experience.
在另一些实施例中,设备处理器100还可以配置成:记录已完成的调节水面画面区域和/或水中画面区域的饱和度的操作;且调节水 面画面区域和/或水中画面区域的饱和度的操作根据记录执行。这种方式使得影像处理方法处理后得到的影像更加适合用户的喜好,且不需要用户手动操作来选择喜好的方式,极大地提升了用户体验。In other embodiments, the device processor 100 may also be configured to: record the completed operations of adjusting the saturation of the water surface image area and/or the water image area; and adjust the saturation of the water surface image area and/or the water image area The operation is performed according to the record. This method makes the image processed by the image processing method more suitable for the user's preferences, and does not require manual operation by the user to select the preferred method, which greatly improves the user experience.
设备处理器100还可以配置成:对水面画面区域进行调整色相和/或羽化处理。The device processor 100 may also be configured to adjust the hue and/or feathering of the water surface image area.
在一些实施例中,可以仅对水面画面区域进行调整色相处理;在另一些实施例中,可以仅对水面画面区域进行羽化处理;在其他实施例中,可以同时对水面画面区域进行调整色相和羽化处理。In some embodiments, only the water surface image area can be adjusted hue processing; in other embodiments, only the water surface image area can be feathered; in other embodiments, the water surface image area can be adjusted at the same time. Eclosion treatment.
调整色相可以使得颜色不至于调整到失真,羽化处理使得待处理影像的各区域衔接地更加自然,提高待处理影像的整体视觉效果。Adjusting the hue can prevent the color from being adjusted to distortion, and the feathering process makes the connection of the various areas of the image to be processed more natural, and improves the overall visual effect of the image to be processed.
设备处理器100还可以配置成:在调节水面画面区域和/或水中画面区域的饱和度后,对水面画面区域进行调整色相和/或羽化处理。则羽化处理可以对水面画面区域和/或水中画面区域的边缘进行,以使得水面画面区域与水中画面区域的衔接更加自然。The device processor 100 may also be configured to adjust the hue and/or feathering of the water surface image area after adjusting the saturation of the water surface image area and/or the water image area. Then, the feathering process can be performed on the edge of the water surface image area and/or the water image area, so that the connection between the water surface image area and the underwater image area is more natural.
设备处理器100还配置成:对水面画面区域进行第一白平衡调整。第一白平衡处理可以与第二白平衡处理相同,也可以与第二白平衡处理不同。第一白平衡处理可以使用white patch(白色斑点)算法或gray world(灰度世界)算法等。The device processor 100 is further configured to: perform a first white balance adjustment on the water surface image area. The first white balance processing may be the same as the second white balance processing, or may be different from the second white balance processing. The first white balance processing can use a white patch (white spot) algorithm or a gray world (gray world) algorithm, etc.
由于已经调节了水面画面区域和/或水中画面区域的饱和度,使得第一白平衡处理时的水中画面区域受水面画面区域偏红的影响较小,既能保证水面画面区域不至于偏红,又能保证水中画面区域色彩趋近于真实。Since the saturation of the water surface image area and/or the water image area has been adjusted, the water image area during the first white balance processing is less affected by the redness of the water surface image area, which can ensure that the water surface image area does not become reddish. It can also ensure that the color of the image area in the water is close to real.
设备处理器100还可以配置成:在调节水面画面区域和/或水中画面区域的饱和度后,对水面画面区域进行第一白平衡调整。The device processor 100 may also be configured to perform a first white balance adjustment on the water surface image area after adjusting the saturation of the water surface image area and/or the water image area.
设备处理器100还可以配置成:以水中画面区域为参照对水面画面区域进行第一白平衡调整。以进一步降低水面画面区域偏红的现象。The device processor 100 may also be configured to perform the first white balance adjustment on the water surface image area with reference to the underwater image area. In order to further reduce the phenomenon of reddish water surface area.
设备10通过对同时存在水面画面区域以及水中画面区域的待处理影像进行调节水面画面区域和/或水中画面区域的饱和度,可以有效地解决上述影像同时存在水中画面区域以及水面画面区域时会存 在水面画面区域的红色饱和度过高,从而导致同时存在水中画面区域以及水面画面区域的影像的效果不好的问题。这种设备10在待处理影像中同时存在水面画面区域以及水中画面区域时也能得到效果较好的影像,提升了待处理影像的画面质量和用户体验。The device 10 adjusts the saturation of the water surface image area and/or the water image area of the image to be processed that simultaneously exists in the water surface image area and the water image area, which can effectively solve the problem that the above image will exist when the water image area and the water surface image area exist at the same time. The red saturation of the water surface image area is too high, which leads to the problem that the image effects of the water image area and the water surface image area are not good at the same time. Such a device 10 can also obtain a better image when there are both a water surface image area and an underwater image area in the image to be processed, which improves the image quality and user experience of the image to be processed.
本实施例还提供了一种计算机可读存储介质20,图5是根据本发明的一个实施例的计算机可读存储介质20的结构框图。计算机可读存储介质20可以包括但不限于非易失性或易失性存储介质,例如随机存取存储器(RAM)、静态RAM、动态RAM、只读存储器(ROM)、可编程ROM、可擦除可编程ROM、电可擦除可编程ROM、闪存、安全数字(SD)卡等。计算机可读存储介质20可以用于存储有指令200,指令200用于实现上述任一影像处理方法。This embodiment also provides a computer-readable storage medium 20. FIG. 5 is a structural block diagram of the computer-readable storage medium 20 according to an embodiment of the present invention. The computer-readable storage medium 20 may include, but is not limited to, non-volatile or volatile storage media, such as random access memory (RAM), static RAM, dynamic RAM, read-only memory (ROM), programmable ROM, erasable In addition to programmable ROM, electrically erasable programmable ROM, flash memory, secure digital (SD) card, etc. The computer-readable storage medium 20 may be used to store instructions 200, which are used to implement any of the above-mentioned image processing methods.
此外,用于执行本文描述的任何方法的指令都可以存储在计算机可读存储介质20中。这些指令200可以由处理器来执行。In addition, instructions for performing any of the methods described herein may be stored in the computer-readable storage medium 20. These instructions 200 can be executed by a processor.
计算机可读存储介质20中的指令200可以在被执行时通过对同时存在水面画面区域以及水中画面区域的待处理影像进行调节水面画面区域和/或水中画面区域的饱和度,可以有效地解决上述影像同时存在水中画面区域以及水面画面区域时会存在水面画面区域的红色饱和度过高,从而导致同时存在水中画面区域以及水面画面区域的影像的效果不好的问题。通过这种计算机可读存储介质20可使得在待处理影像中同时存在水面画面区域以及水中画面区域时也能得到效果较好的影像,提升了待处理影像的画面质量和用户体验。The instruction 200 in the computer-readable storage medium 20 can effectively solve the above problem by adjusting the saturation of the water surface area and/or the water image area by adjusting the saturation of the water surface area and/or the water area area when being executed. When the image exists in both the underwater screen area and the water surface screen area, the red saturation of the water surface screen area will be too high, which leads to the problem of poor image effects of the underwater screen area and the water surface screen area at the same time. Through this computer-readable storage medium 20, a better image can be obtained when there are both a water surface image area and an underwater image area in the image to be processed, which improves the image quality and user experience of the image to be processed.
本实施例还提供了一种成像设备30,图6是根据本发明的一个实施例的成像设备30的结构框图。成像设备30包括但不限于成像单元300、判断模块400以及处理模块500。判断模块400以及处理模块500可以是硬件、固件或者硬件和固件的组合。This embodiment also provides an imaging device 30. FIG. 6 is a structural block diagram of the imaging device 30 according to an embodiment of the present invention. The imaging device 30 includes, but is not limited to, an imaging unit 300, a judgment module 400, and a processing module 500. The judgment module 400 and the processing module 500 may be hardware, firmware, or a combination of hardware and firmware.
在一些实施例中,成像设备30可以为照相机、摄像机或具有拍摄功能的手机等,照相机包括但不限于运动相机。In some embodiments, the imaging device 30 may be a camera, a video camera, or a mobile phone with a shooting function, etc. The camera includes but is not limited to a sports camera.
成像单元300生成待处理影像。The imaging unit 300 generates images to be processed.
判断模块400判断待处理影像是否同时存在水面画面区域以及水中画面区域。The judging module 400 judges whether the image to be processed has both a water surface image area and an underwater image area.
处理模块500在待处理影像满足预设条件的情况下,调节水面画面区域和/或水中画面区域的饱和度,预设条件包括但不限于待处理影像同时存在水面画面区域以及水中画面区域。The processing module 500 adjusts the saturation of the water surface image area and/or the water image area when the image to be processed meets preset conditions. The preset conditions include, but are not limited to, the presence of the image to be processed simultaneously in the water surface image area and the water image area.
在一些实施例中,处理模块500还配置成获取预设帧数与待处理影像对应的检测图像。当待处理影像为照片时,成像单元300可以生成预设帧数与该照片对应的检测图像以供处理模块500获取,例如通过成像单元300重复生成与该照片获得位置以及角度相同的照片,还可以复制该照片以获得预设帧数的检测图像等;当待处理影像为视频时,可以直接从该段视频中获取预设帧数的检测图像,也可以复制该视频中的每帧照片以得到针对每帧照片的预设帧数的检测图像等。In some embodiments, the processing module 500 is further configured to obtain a detection image corresponding to a predetermined number of frames and the image to be processed. When the image to be processed is a photo, the imaging unit 300 may generate a detection image corresponding to the photo with a preset number of frames for the processing module 500 to obtain, for example, the imaging unit 300 repeatedly generates a photo with the same position and angle as the photo obtained, You can copy the photo to obtain a preset number of detection images, etc.; when the image to be processed is a video, you can directly obtain a preset number of detection images from the video, or you can copy each frame of the video to Obtain the detection images of the preset number of frames for each frame of photos, etc.
且判断模块400还配置成在预设帧数检测图像均出现包含预设特征的特征区域,且特征区域的红色通道增益高于通道增益阈值的情况下,则判断待处理影像存在水面画面区域。And the judgment module 400 is further configured to judge that the image to be processed exists in the water surface area when the characteristic area including the preset characteristic appears in the detected images with the preset number of frames, and the red channel gain of the characteristic area is higher than the channel gain threshold.
其中预设特征可以为水波纹或一定数值的强光光照强度等,该强光光照强度的具体数值大小可以根据实验情况测定。其中,预设特征的识别可以通过智能场景判断等方法,判断特征区域的红色通道增益是否高于通道增益阈值可以结合白平衡判定特征区域的红色通道增益是否高于通道增益阈值。还可以进一步判断待处理影像是否还存在水中画面区域,可以在水面画面区域外的区域检测到蓝色画面的情况下判断待处理影像还存在水中画面区域等。The preset feature can be water ripples or a certain value of strong light intensity, etc. The specific value of the strong light intensity can be determined according to experimental conditions. Among them, the identification of the preset feature can use methods such as intelligent scene judgment to determine whether the red channel gain of the feature region is higher than the channel gain threshold, and white balance can be combined to determine whether the red channel gain of the feature region is higher than the channel gain threshold. It can also be further determined whether the image to be processed still has an underwater image area, and it can be determined that the image to be processed still has an underwater image area when a blue image is detected in an area outside the water surface image area.
在另一些实施例中,判断模块400还可以配置成在待处理影像中存在第二预设颜色且具有第二预设颜色的画面占待处理影像的比例位于预设比例范围内的情况下,则判断待处理影像同时存在水面画面区域以及水中画面区域。In other embodiments, the determining module 400 may also be configured to, in the case where there is a second preset color in the image to be processed and the ratio of the frame with the second preset color to the image to be processed is within the preset ratio range, It is determined that the image to be processed simultaneously exists in the water surface image area and the water image area.
其中,第二预设颜色可以为蓝色,例如浅蓝色、深蓝色等。预设比例范围可以为70%至95%。Wherein, the second preset color may be blue, such as light blue, dark blue, etc. The preset ratio can range from 70% to 95%.
可以在暗光光照强度时,通过这种判断待处理影像中存在第二预设颜色且具有第二预设颜色的画面占待处理影像的比例位于预设比例范围内的方式来判断待处理影像是否同时存在水面画面区域以及水中画面区域,该暗光光照强度可以低于强光光照强度,暗光光照强 度的数值大小可以通过实验方法测定。It is possible to determine the image to be processed by this way of determining that there is a second preset color in the image to be processed and the proportion of the frame with the second preset color to the image to be processed is within the range of the preset ratio when the light intensity is low. Whether there is a water surface image area and a water image area at the same time, the dark light illumination intensity can be lower than the strong light illumination intensity, and the numerical value of the dark light illumination intensity can be determined by an experimental method.
处理模块500还可以配置成在待处理影像同时存在水面画面区域以及水中画面区域的情况下,对待处理影像进行调整色温处理,且调节进行调整色温处理后的待处理影像的水面画面区域和/或水中画面区域的饱和度;或在判断待处理影像是否同时存在水面画面区域以及水中画面区域前对待处理影像进行调整色温处理。The processing module 500 may also be configured to adjust the color temperature of the image to be processed when the image to be processed has both a water surface area and an underwater image area, and adjust the water surface area and/or of the image to be processed after adjusting the color temperature. Saturation of the image area in the water; or adjust the color temperature of the image to be processed before judging whether the image to be processed has both a water surface image area and an underwater image area.
对待处理影像进行调整色温处理可以包括但不限于对待处理影像进行调高色温处理。由此可以减少待处理影像在一定程度上的水面画面区域偏红的情况,从而使得在待处理影像中同时存在水面画面区域以及水中画面区域的情况下,使得待处理影像整体的视觉效果较好。The process of adjusting the color temperature of the image to be processed may include, but is not limited to, the process of adjusting the color temperature of the image to be processed. This can reduce the redness of the water surface area of the image to be processed to a certain extent, so that when there are both water surface area and underwater image area in the image to be processed, the overall visual effect of the image to be processed is better. .
在一些实施例中,可以通过自动白平衡的方式对待处理影像进行调整色温处理,并且可以根据水面画面区域的红色通道增益以及强光光照强度的区域的权重来调高色温,例如,当水面画面区域的红色通道增益越高,则色温调整得越高,当强光光照强度的区域的权重越大,则色温调整得越高等,并且色温调整的幅度可以根据保证待处理影像的画面整体色温正常且符合人眼视觉习惯来设定。In some embodiments, the color temperature of the image to be processed can be adjusted by means of automatic white balance, and the color temperature can be increased according to the red channel gain of the water surface area and the weight of the strong light intensity area, for example, when the water surface area is The higher the red channel gain of the area, the higher the color temperature adjustment. When the weight of the strong light intensity area is, the higher the color temperature adjustment, etc., and the range of color temperature adjustment can be based on ensuring that the overall color temperature of the image to be processed is normal And set in accordance with the visual habits of the human eye.
判断模块400还可以配置成在判断待处理影像是否同时存在水面画面区域以及水中画面区域以及对待处理影像进行调整色温处理后,判断水面画面区域的第一预设颜色的饱和度是否大于饱和度阈值。预设条件包括但不限于待处理影像同时存在水面画面区域以及水中画面区域且水面画面区域的第一预设颜色的饱和度大于饱和度阈值。第一预设颜色可以为红色和/或橙色。The judging module 400 may also be configured to determine whether the saturation of the first preset color of the water surface area is greater than the saturation threshold after judging whether the image to be processed simultaneously exists in the water surface area and the area in the water area, and after adjusting the color temperature of the image to be processed. . The preset conditions include, but are not limited to, that the image to be processed has both a water surface image area and an underwater image area, and the saturation of the first preset color of the water surface image area is greater than the saturation threshold. The first preset color may be red and/or orange.
处理模块500还可以配置成在待处理影像不同时存在水面画面区域以及水中画面区域或水面画面区域的第一预设颜色的饱和度不大于饱和度阈值的情况下,对待处理影像进行第二白平衡调整和/或输出待处理影像。The processing module 500 may also be configured to perform a second whitening on the image to be processed when the image to be processed does not exist at the same time in the water surface image area and the saturation of the first preset color of the water image area or the water surface image area is not greater than the saturation threshold. Balance adjustment and/or output image to be processed.
第二白平衡调整使得在待处理影像既使不同时存在水面画面区域以及水中画面区域或水面画面区域的第一预设颜色的饱和度不大于饱和度阈值的情况下,也能获得较好效果的影像。The second white balance adjustment makes it possible to obtain better results even if the image to be processed does not have the water surface area and the water surface area or the first preset color saturation is not greater than the saturation threshold. Of the image.
在一些实施例中,调节水面画面区域和/或水中画面区域的饱和度包括但不限于:降低水面画面区域的红色和/或橙色饱和度。在另一些实施例中,调节水面画面区域和/或水中画面区域的饱和度包括但不限于提高水中画面区域的蓝色饱和度。In some embodiments, adjusting the saturation of the water surface image area and/or the water image area includes, but is not limited to: reducing the red and/or orange saturation of the water surface image area. In other embodiments, adjusting the saturation of the water surface image area and/or the underwater image area includes, but is not limited to, increasing the blue saturation of the water image area.
在一些实施例中,调节水面画面区域和/或水中画面区域的饱和度包括但不限于:按照用户设定的方式调节水面画面区域和/或水中画面区域的饱和度。In some embodiments, adjusting the saturation of the water surface image area and/or the underwater image area includes, but is not limited to: adjusting the saturation of the water surface image area and/or the underwater image area in a manner set by the user.
这种方式使得影像处理方法更加智能,可以根据用户喜好的方式来调节水面画面区域和/或水中画面区域的饱和度,提升了用户体验。This method makes the image processing method more intelligent, and can adjust the saturation of the water surface image area and/or the water image area according to the user's preference, which improves the user experience.
在另一些实施例中,处理模块500还可以配置成在调节水面画面区域和/或水中画面区域的饱和度前,记录已完成的调节水面画面区域和/或水中画面区域的饱和度的操作,且调节水面画面区域和/或水中画面区域的饱和度的操作根据记录执行。In other embodiments, the processing module 500 may also be configured to record the completed operation of adjusting the saturation of the water surface area and/or the underwater image area before adjusting the saturation of the water surface area and/or the underwater image area, And the operation of adjusting the saturation of the water surface image area and/or the water image area is performed according to the record.
这种方式使得影像处理方法处理后得到的影像更加适合用户的喜好,且不需要用户手动操作来选择喜好的方式,极大地提升了用户体验。This method makes the image processed by the image processing method more suitable for the user's preferences, and does not require manual operation by the user to select the preferred method, which greatly improves the user experience.
处理模块500还可以配置成对水面画面区域进行调整色相和/或羽化处理。The processing module 500 may also be configured to adjust the hue and/or feathering of the water surface image area.
在一些实施例中,可以仅对水面画面区域进行调整色相处理;在另一些实施例中,可以仅对水面画面区域进行羽化处理;在其他实施例中,可以同时对水面画面区域进行调整色相和羽化处理。In some embodiments, only the water surface image area can be adjusted hue processing; in other embodiments, only the water surface image area can be feathered; in other embodiments, the water surface image area can be adjusted at the same time. Eclosion treatment.
调整色相可以使得颜色不至于调整到失真,羽化处理使得待处理影像的各区域衔接地更加自然,提高待处理影像的整体视觉效果。Adjusting the hue can prevent the color from being adjusted to distortion, and the feathering process makes the connection of the various areas of the image to be processed more natural, and improves the overall visual effect of the image to be processed.
处理模块500还可以配置成在调节水面画面区域和/或水中画面区域的饱和度后,对水面画面区域进行调整色相和/或羽化处理。则羽化处理可以对水面画面区域和/或水中画面区域的边缘进行,以使得水面画面区域与水中画面区域的衔接更加自然。The processing module 500 may also be configured to adjust the hue and/or feathering of the water surface image area after adjusting the saturation of the water surface image area and/or the water image area. Then, the feathering process can be performed on the edge of the water surface image area and/or the water image area, so that the connection between the water surface image area and the underwater image area is more natural.
处理模块500还可以配置成对水面画面区域进行第一白平衡调整。第一白平衡处理可以与第二白平衡处理相同,也可以与第二白平衡处理不同。第一白平衡处理可以使用white patch(白色斑点)算 法或gray world(灰度世界)算法等。The processing module 500 may also be configured to perform the first white balance adjustment on the water surface image area. The first white balance processing may be the same as the second white balance processing, or may be different from the second white balance processing. The first white balance processing can use the white patch algorithm or the gray world algorithm.
由于已经调节了水面画面区域和/或水中画面区域的饱和度,使得第一白平衡处理时的水中画面区域受水面画面区域偏红的影响较小,既能保证水面画面区域不至于偏红,又能保证水中画面区域色彩趋近于真实。Since the saturation of the water surface image area and/or the water image area has been adjusted, the water image area during the first white balance processing is less affected by the redness of the water surface image area, which can ensure that the water surface image area does not become reddish. It can also ensure that the color of the image area in the water is close to real.
处理模块500还可以配置成在对水面画面区域进行调整色相和/或羽化处理后,对水面画面区域进行第一白平衡调整。The processing module 500 may also be configured to perform the first white balance adjustment on the water surface image area after the hue and/or feathering processing is performed on the water surface image area.
处理模块500还可以配置成以水中画面区域为参照对水面画面区域进行第一白平衡调整。以进一步降低水面画面区域偏红的现象。The processing module 500 may also be configured to perform the first white balance adjustment on the water surface image area with the underwater image area as a reference. In order to further reduce the phenomenon of reddish water surface area.
成像设备30还可以包括但不限于压力探测装置600,压力探测装置600用于探测成像单元300所处区域的压力。The imaging device 30 may also include, but is not limited to, a pressure detection device 600 for detecting the pressure of the area where the imaging unit 300 is located.
且处理模块500还被配置成在压力大于第一压力阈值时执行判断待处理影像是否同时存在水面画面区域以及水中画面区域的操作。其中,第一压力阈值的数值可以通过实验方法确定。较为合适地,第一压力阈值可以为1.1×10 4Pa,即测得压力大于等于≥1.1×10 4Pa时认定为成像设备的拍摄环境可能为水下环境,进而处理模块500执行判断待处理影像是否同时存在水面画面区域以及水中画面区域的操作。 And the processing module 500 is also configured to perform an operation of determining whether the image to be processed has both a water surface area and an underwater area when the pressure is greater than the first pressure threshold. Among them, the value of the first pressure threshold can be determined through experimental methods. More appropriately, the first pressure threshold may be 1.1×10 4 Pa, that is, when the measured pressure is greater than or equal to 1.1×10 4 Pa, it is considered that the shooting environment of the imaging device may be an underwater environment, and the processing module 500 executes the judgment to be processed Whether there are operations on the water surface area and the underwater area of the image at the same time.
压力大于第一压力阈值时表示成像单元300可能位于水下,当成像单元300位于水下时,成像单元300生成的待处理影像才可能同时存在水面画面区域以及水中画面区域。这种方式使得成像设备更加智能。When the pressure is greater than the first pressure threshold, it means that the imaging unit 300 may be underwater. When the imaging unit 300 is underwater, the image to be processed generated by the imaging unit 300 may exist in both the water surface area and the underwater area. This way makes the imaging device more intelligent.
压力探测装置600还可以配置成在压力大于第二压力阈值和/或小于第三压力阈值时发出警报信号。其中,第二压力阈值的数值可以通过实验方法确定。第三压力阈值的数值也可以通过实验方法确定。较为合适地,第二压力阈值可以为6.5×10 4Pa,第三压力阈值可以为1.1×10 5Pa,例如,测得压力大于等于6.5×10 4Pa时可以认定成像设备的拍摄环境可能压力过高,例如设备所处水深超过预定深度,进而发出警报信号。当然地,可以为不同的压力范围设置不同的警报信号,例如测得压力大于等于6.5×10 4Pa且小于等于1.1×10 5Pa时提 示用户水深即将超过成像设备的承载值,显示文字或图像建议不要使设备继续下潜;例如测得压力大于等于1.1×10 5Pa时提示用户水深已经超过成像设备的承载值,在显示文字或图像建议立即使设备上浮的同时加入声音、灯光、震动等其他警示方式。 The pressure detection device 600 may also be configured to issue an alarm signal when the pressure is greater than the second pressure threshold and/or less than the third pressure threshold. Among them, the value of the second pressure threshold can be determined by experimental methods. The value of the third pressure threshold can also be determined experimentally. More appropriately, the second pressure threshold may be 6.5×10 4 Pa, and the third pressure threshold may be 1.1×10 5 Pa. For example, when the measured pressure is greater than or equal to 6.5×10 4 Pa, it can be determined that the imaging device’s shooting environment may be under pressure. Too high, for example, the water depth of the equipment exceeds a predetermined depth, and then an alarm signal is issued. Of course, different alarm signals can be set for different pressure ranges, for example, when the measured pressure is greater than or equal to 6.5×10 4 Pa and less than or equal to 1.1×10 5 Pa, it will prompt the user that the water depth is about to exceed the bearing value of the imaging device, and display text or images. It is recommended not to let the device continue to dive; for example, when the measured pressure is greater than or equal to 1.1×10 5 Pa, it will prompt the user that the depth of water has exceeded the carrying value of the imaging device. When displaying text or images, it is recommended to immediately float the device while adding sound, light, vibration, etc. Other warning methods.
发出警报信息可以包括但不限于成像设备30发出声音警报信息或成像设备30发出振动警报信息等,在一些实施例中,成像设备30还可以包括但不限于显示装置,则发出警报信息可以包括但不限于显示装置显示文字、视频或图片等警报信息,在另一些实施例中,成像设备30可以包括但不限于气体产生装置,则发出警报信息可以包括但不限于气体产生装置产生一定颜色或气味的警报气体。The issuing of alarm information may include, but is not limited to, sound alarm information issued by the imaging device 30 or vibration alarm information issued by the imaging device 30. In some embodiments, the imaging device 30 may also include but is not limited to a display device, and the issuing of alarm information may include but The display device is not limited to displaying warning information such as text, video, or pictures. In other embodiments, the imaging device 30 may include but is not limited to a gas generating device, and issuing the warning information may include, but is not limited to, the gas generating device producing a certain color or smell. Alarm gas.
当压力大于第二压力阈值时,表示水下压力过大,可能会对用户造成伤害或对成像设备30造成损害,此时,发出警报信号可以提醒用户,以保障用户的生命财产安全。当压力小于第三压力阈值,表示气压可能过低,若用户长时间处于这种环境可能会对身体造成损害,此时,发出警报信号可以提醒用户,以保障用户的安全。When the pressure is greater than the second pressure threshold, it means that the underwater pressure is too high, which may cause injury to the user or damage to the imaging device 30. At this time, an alarm signal can be issued to remind the user to protect the user's life and property. When the pressure is less than the third pressure threshold, it indicates that the air pressure may be too low. If the user stays in this environment for a long time, it may cause damage to the body. At this time, an alarm signal can be issued to remind the user to ensure the safety of the user.
成像设备30还可以包括但不限于防水单元700,防水单元700用于防止成像单元300、判断模块400以及处理模块500中至少一者进水。在一些实施例中,防水单元700可以为包围成像单元300、判断模块400以及处理模块500中至少一者的防水壳。在另一些实施例中,防水单元700可以为设置于成像单元300、判断模块400以及处理模块500中至少一者,又或者成像单元300、判断模块400以及处理模块500中任意两者或三者间的密封圈。The imaging device 30 may further include, but is not limited to, a waterproof unit 700 for preventing at least one of the imaging unit 300, the judgment module 400, and the processing module 500 from entering water. In some embodiments, the waterproof unit 700 may be a waterproof case surrounding at least one of the imaging unit 300, the determination module 400, and the processing module 500. In other embodiments, the waterproof unit 700 may be provided in at least one of the imaging unit 300, the determination module 400, and the processing module 500, or any two or three of the imaging unit 300, the determination module 400, and the processing module 500 Between the sealing ring.
成像设备30通过对同时存在水面画面区域以及水中画面区域的待处理影像进行调节水面画面区域和/或水中画面区域的饱和度,可以有效地解决上述影像同时存在水中画面区域以及水面画面区域时会存在水面画面区域的红色饱和度过高,从而导致同时存在水中画面区域以及水面画面区域的影像的效果不好的问题。这种成像设备30在待处理影像中同时存在水面画面区域以及水中画面区域时也能得到效果较好的影像,提升了待处理影像的画面质量和用户体验。The imaging device 30 adjusts the saturation of the water surface image area and/or the water image area of the image to be processed that simultaneously exists in the water surface image area and the water image area, which can effectively solve the problem when the above-mentioned image exists in the water image area and the water surface image area at the same time. There is a problem that the red saturation of the water surface screen area is too high, which leads to the problem that the image effects of the water screen area and the water surface screen area are not good at the same time. This kind of imaging device 30 can also obtain a better image when there are both a water surface image area and an underwater image area in the image to be processed, which improves the image quality and user experience of the image to be processed.
本实施例还提供了一种影像处理系统40,图7是根据本发明的 一个实施例的影像处理系统40的结构框图。影像处理系统40包括但不限于接收器800以及系统处理器900。This embodiment also provides an image processing system 40. Fig. 7 is a structural block diagram of the image processing system 40 according to an embodiment of the present invention. The image processing system 40 includes but is not limited to a receiver 800 and a system processor 900.
接收器800用于接收待处理影像。The receiver 800 is used to receive the image to be processed.
系统处理器900配置成判断待处理影像是否同时存在水面画面区域以及水中画面区域;在待处理影像满足预设条件的情况下,调节水面画面区域和/或水中画面区域的饱和度,预设条件包括但不限于待处理影像同时存在水面画面区域以及水中画面区域。The system processor 900 is configured to determine whether the image to be processed has both a water surface image area and an underwater image area; when the image to be processed meets a preset condition, adjust the saturation of the water surface image area and/or the water image area, and the preset condition Including but not limited to the presence of both the water surface area and the water area of the image to be processed.
在一些实施例中,系统处理器900还可以配置成获取预设帧数与待处理影像对应的检测图像。当待处理影像为照片时,可以获取预设帧数与该照片对应的检测图像,例如通过接收器800重复接收与该照片拍摄位置以及角度相同的照片,还可以复制该照片以获得预设帧数的检测图像等;当待处理影像为视频时,可以直接从该段视频中获取预设帧数的检测图像,也可以复制该视频中的每帧照片以得到针对每帧照片的预设帧数的检测图像等。In some embodiments, the system processor 900 may also be configured to obtain a detection image corresponding to a predetermined number of frames and the image to be processed. When the image to be processed is a photo, the detection image corresponding to the preset number of frames can be obtained. For example, the receiver 800 can repeatedly receive the photo with the same shooting position and angle as the photo, and the photo can also be copied to obtain the preset frame Number of detected images, etc.; when the image to be processed is a video, you can directly obtain a preset number of detected images from the video, or you can copy each frame of photos in the video to get a preset frame for each frame of photos Number of detected images, etc.
在预设帧数检测图像均出现包含预设特征的特征区域,且特征区域的红色通道增益高于通道增益阈值的情况下,则判断待处理影像存在水面画面区域。In the case that the detected images with the preset number of frames all have feature regions containing preset features, and the red channel gain of the feature region is higher than the channel gain threshold, it is determined that the image to be processed has a water surface area.
其中预设特征可以为水波纹或一定数值的强光光照强度等,该强光光照强度的具体数值大小可以根据实验情况测定。其中,预设特征的识别可以通过智能场景判断等方法,判断特征区域的红色通道增益是否高于通道增益阈值可以结合白平衡判定特征区域的红色通道增益是否高于通道增益阈值。The preset feature can be water ripples or a certain value of strong light intensity, etc. The specific value of the strong light intensity can be determined according to experimental conditions. Among them, the identification of the preset feature can use methods such as intelligent scene judgment to determine whether the red channel gain of the feature region is higher than the channel gain threshold, and white balance can be combined to determine whether the red channel gain of the feature region is higher than the channel gain threshold.
在判断待处理影像存在水面画面区域后,还可以进一步判断待处理影像是否还存在水中画面区域,可以在水面画面区域外的区域检测到蓝色画面的情况下判断待处理影像还存在水中画面区域等。After judging that the image to be processed exists in the water surface area, it can be further determined whether the image to be processed still has an underwater image area, and it can be determined that the image to be processed still exists in the water image area when a blue image is detected in the area outside the water surface area. Wait.
在另一些实施例中,系统处理器900还可以配置成在待处理影像中存在第二预设颜色且具有第二预设颜色的画面占待处理影像的比例位于预设比例范围内的情况下,则判断待处理影像同时存在水面画面区域以及水中画面区域。In other embodiments, the system processor 900 may also be configured to: in the case where there is a second preset color in the image to be processed and the ratio of the frame with the second preset color to the image to be processed is within the preset ratio range , It is determined that the image to be processed simultaneously exists in the water surface area and the underwater area.
其中,第二预设颜色可以为蓝色,例如浅蓝色、深蓝色等。预设 比例范围可以为70%至95%。Wherein, the second preset color may be blue, such as light blue, dark blue, etc. The preset ratio can range from 70% to 95%.
可以在暗光光照强度时,通过这种判断待处理影像中存在第二预设颜色且具有第二预设颜色的画面占待处理影像的比例位于预设比例范围内的方式来判断待处理影像是否同时存在水面画面区域以及水中画面区域,该暗光光照强度可以低于强光光照强度,暗光光照强度的数值大小可以通过实验方法测定。It is possible to determine the image to be processed by this way of determining that there is a second preset color in the image to be processed and the proportion of the frame with the second preset color to the image to be processed is within the range of the preset ratio when the light intensity is low. Whether there is a water surface image area and a water image area at the same time, the dark light illumination intensity can be lower than the strong light illumination intensity, and the numerical value of the dark light illumination intensity can be determined by an experimental method.
系统处理器900还可以配置成在待处理影像同时存在水面画面区域以及水中画面区域的情况下,对待处理影像进行调整色温处理,且调节进行调整色温处理后的待处理影像的水面画面区域和/或水中画面区域的饱和度;或判断待处理影像是否同时存在水面画面区域以及水中画面区域前对待处理影像进行调整色温处理。The system processor 900 may also be configured to adjust the color temperature of the image to be processed when the image to be processed has both a water surface image area and an underwater image area, and adjust the water surface image area and/or of the image to be processed after adjusting the color temperature. Or the saturation of the image area in the water; or determine whether the image to be processed simultaneously exists in the water surface area and the water image area before adjusting the color temperature of the image to be processed.
色温调整分步骤中,对待处理影像进行调整色温处理可以包括但不限于对待处理影像进行调高色温处理。色温调整分步骤可以减少待处理影像在一定程度上的水面画面区域偏红的情况,从而在待处理影像中同时存在水面画面区域以及水中画面区域的情况下,使得待处理影像整体的视觉效果较好。In the color temperature adjustment sub-steps, the process of adjusting the color temperature of the image to be processed may include, but is not limited to, the process of increasing the color temperature of the image to be processed. The color temperature adjustment step by step can reduce the reddishness of the water surface area of the image to be processed to a certain extent, so that when there are both water surface area and water image area in the image to be processed, the overall visual effect of the image to be processed is better. good.
在一些实施例中,可以通过自动白平衡的方式对待处理影像进行调整色温处理,并且可以根据水面画面区域的红色通道增益以及强光光照强度的区域的权重来调高色温,例如,当水面画面区域的红色通道增益越高,则色温调整得越高,当强光光照强度的区域的权重越大,则色温调整得越高等,并且色温调整的幅度可以根据保证待处理影像的画面整体色温正常且符合人眼视觉习惯来设定。In some embodiments, the color temperature of the image to be processed can be adjusted by means of automatic white balance, and the color temperature can be increased according to the red channel gain of the water surface area and the weight of the strong light intensity area, for example, when the water surface area is The higher the red channel gain of the area, the higher the color temperature adjustment. When the weight of the strong light intensity area is, the higher the color temperature adjustment, etc., and the range of color temperature adjustment can be based on ensuring that the overall color temperature of the image to be processed is normal And set in accordance with the visual habits of the human eye.
系统处理器900还可以配置成在对待处理影像进行调整色温处理且判断待处理影像是否同时存在水面画面区域以及水中画面区域后,还判断水面画面区域的第一预设颜色的饱和度是否大于饱和度阈值。且预设条件包括但不限于待处理影像同时存在水面画面区域以及水中画面区域且水面画面区域的第一预设颜色的饱和度大于饱和度阈值。其中,第一预设颜色可以为红色和/或橙色。The system processor 900 may also be configured to, after adjusting the color temperature of the image to be processed and determining whether the image to be processed has both a water surface image area and an underwater image area, it also determines whether the saturation of the first preset color of the water surface image area is greater than saturation. Degree threshold. And the preset condition includes, but is not limited to, that the image to be processed has both a water surface image area and a water image area, and the saturation of the first preset color of the water surface image area is greater than the saturation threshold. Wherein, the first preset color may be red and/or orange.
系统处理器900还可以配置成在待处理影像不同时存在水面画面区域以及水中画面区域或水面画面区域的第一预设颜色的饱和度 不大于饱和度阈值的情况下,对待处理影像进行第二白平衡调整和/或输出待处理影像。The system processor 900 may also be configured to perform a second operation on the image to be processed when the image to be processed does not exist in the water surface area at the same time and the saturation of the first preset color in the water image area or the water surface area is not greater than the saturation threshold. Adjust the white balance and/or output the image to be processed.
第二白平衡调整使得在待处理影像既使不同时存在水面画面区域以及水中画面区域或水面画面区域的第一预设颜色的饱和度不大于饱和度阈值的情况下,也能获得较好效果的影像。The second white balance adjustment makes it possible to obtain better results even if the image to be processed does not have the water surface area and the water surface area or the first preset color saturation is not greater than the saturation threshold. Of the image.
在一些实施例中,调节水面画面区域和/或水中画面区域的饱和度包括但不限于降低水面画面区域的红色和/或橙色饱和度。在另一些实施例中,调节水面画面区域和/或水中画面区域的饱和度包括但不限于提高水中画面区域的蓝色饱和度。In some embodiments, adjusting the saturation of the water surface image area and/or the water image area includes, but is not limited to, reducing the red and/or orange saturation of the water surface image area. In other embodiments, adjusting the saturation of the water surface image area and/or the underwater image area includes, but is not limited to, increasing the blue saturation of the water image area.
调节水面画面区域和/或水中画面区域的饱和度包括但不限于按照用户设定的方式调节水面画面区域和/或水中画面区域的饱和度。Adjusting the saturation of the water surface image area and/or the underwater image area includes, but is not limited to, adjusting the saturation of the water surface image area and/or the underwater image area in a manner set by the user.
这种方式使得影像处理系统40更加智能,可以根据用户喜好的方式来调节水面画面区域和/或水中画面区域的饱和度,提升了用户体验。This method makes the image processing system 40 more intelligent, and can adjust the saturation of the water surface image area and/or the water image area according to the user's preference, thereby improving the user experience.
系统处理器900还可以配置成在调节水面画面区域和/或水中画面区域的饱和度前,记录已完成的调节水面画面区域和/或水中画面区域的饱和度的操作,且调节水面画面区域和/或水中画面区域的饱和度的操作根据记录执行。The system processor 900 may also be configured to record the completed operation of adjusting the saturation of the water surface image area and/or the water image area before adjusting the saturation of the water surface image area and/or the water image area, and adjust the water surface image area and the saturation of the water image area. / Or the operation of the saturation of the underwater picture area is performed according to the record.
这种方式使得影像处理系统40处理后得到的影像更加适合用户的喜好,且不需要用户手动操作来选择喜好的方式,极大地提升了用户体验。This method makes the image processed by the image processing system 40 more suitable for the user's preferences, and does not require the user to manually operate to select the preferred method, which greatly improves the user experience.
系统处理器900还可以配置成对水面画面区域进行调整色相和/或羽化处理。The system processor 900 may also be configured to adjust the hue and/or feathering of the water surface image area.
在一些实施例中,可以仅对水面画面区域进行调整色相处理;在另一些实施例中,可以仅对水面画面区域进行羽化处理;在其他实施例中,可以同时对水面画面区域进行调整色相和羽化处理。In some embodiments, only the water surface image area can be adjusted hue processing; in other embodiments, only the water surface image area can be feathered; in other embodiments, the water surface image area can be adjusted at the same time. Eclosion treatment.
调整色相可以使得颜色不至于调整到失真,羽化处理使得待处理影像的各区域衔接地更加自然,提高待处理影像的整体视觉效果。Adjusting the hue can prevent the color from being adjusted to distortion, and the feathering process makes the connection of the various areas of the image to be processed more natural, and improves the overall visual effect of the image to be processed.
系统处理器900还可以配置成在调节水面画面区域和/或水中画面区域的饱和度后,对水面画面区域进行调整色相和/或羽化处理。 则羽化处理可以对水面画面区域和/或水中画面区域的边缘进行,以使得水面画面区域与水中画面区域的衔接更加自然。The system processor 900 may also be configured to adjust the hue and/or feathering of the water surface image area after adjusting the saturation of the water surface image area and/or the water image area. Then, the feathering process can be performed on the edge of the water surface image area and/or the water image area, so that the connection between the water surface image area and the underwater image area is more natural.
系统处理器900还可以配置成对水面画面区域进行第一白平衡调整。第一白平衡处理可以与第二白平衡处理相同,也可以与第二白平衡处理不同。第一白平衡处理可以使用white patch(白色斑点)算法或gray world(灰度世界)算法等。The system processor 900 may also be configured to perform the first white balance adjustment on the water surface image area. The first white balance processing may be the same as the second white balance processing, or may be different from the second white balance processing. The first white balance processing can use a white patch (white spot) algorithm or a gray world (gray world) algorithm, etc.
由于已经调节了水面画面区域和/或水中画面区域的饱和度,使得第一白平衡处理时的水中画面区域受水面画面区域偏红的影响较小,既能保证水面画面区域不至于偏红,又能保证水中画面区域色彩趋近于真实。Since the saturation of the water surface image area and/or the water image area has been adjusted, the water image area during the first white balance processing is less affected by the redness of the water surface image area, which can ensure that the water surface image area does not become reddish. It can also ensure that the color of the image area in the water is close to real.
系统处理器900还可以配置成在对水面画面区域进行调整色相和/或羽化处理后,对水面画面区域进行第一白平衡调整。The system processor 900 may also be configured to perform the first white balance adjustment on the water surface image area after adjusting the hue and/or feathering of the water surface image area.
系统处理器900还可以配置成以水中画面区域为参照对水面画面区域进行第一白平衡调整。以进一步降低水面画面区域偏红的现象。The system processor 900 may also be configured to perform the first white balance adjustment on the water surface image area with the underwater image area as a reference. In order to further reduce the phenomenon of reddish water surface area.
影像处理系统40通过对同时存在水面画面区域以及水中画面区域的待处理影像进行调节水面画面区域和/或水中画面区域的饱和度,可以有效地解决上述影像同时存在水中画面区域以及水面画面区域时会存在水面画面区域的红色饱和度过高,从而导致同时存在水中画面区域以及水面画面区域的影像的效果不好的问题。这种影像处理系统40在待处理影像中同时存在水面画面区域以及水中画面区域时也能得到效果较好的影像,提升了待处理影像的画面质量和用户体验。The image processing system 40 adjusts the saturation of the water surface image area and/or the water image area of the image to be processed that simultaneously exists in the water surface image area and the underwater image area, which can effectively solve the problem that the above-mentioned image simultaneously exists in the water image area and the water surface image area. There may be a problem that the red saturation of the water surface image area is too high, which leads to a problem that the image effects of the water image area and the water surface image area are not good at the same time. This kind of image processing system 40 can also obtain a better image when there are both a water surface image area and an underwater image area in the image to be processed, which improves the image quality and user experience of the image to be processed.
对于本发明的实施例,还需要说明的是,在不冲突的情况下,本发明的实施例及实施例中的特征可以相互组合以得到新的实施例。Regarding the embodiments of the present invention, it should also be noted that the embodiments of the present invention and the features in the embodiments can be combined with each other to obtain a new embodiment if there is no conflict.
以上所述仅为本发明的优选实施例而已,并不用于限制本发明,对于本领域的技术人员来说,本发明可以有各种更改和变化。凡在本发明的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention and are not used to limit the present invention. For those skilled in the art, the present invention can have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (76)

  1. 一种影像处理方法,所述影像处理方法包括判断处理步骤,所述判断处理步骤包括:An image processing method, the image processing method includes a judgment processing step, and the judgment processing step includes:
    第一判断分步骤:判断待处理影像是否同时存在水面画面区域以及水中画面区域;且所述影像处理方法还包括:The first judgment is divided into steps: judging whether the image to be processed has both a water surface image area and an underwater image area; and the image processing method further includes:
    待处理影像处理步骤:在所述判断处理步骤的判断结果为是的情况下,调节所述水面画面区域和/或所述水中画面区域的饱和度,所述判断处理步骤的判断结果为是的情况包括所述第一判断分步骤的判断结果为是。Image processing step to be processed: in the case where the judgment result of the judgment processing step is yes, adjust the saturation of the water surface image area and/or the water image area, and the judgment result of the judgment processing step is yes The situation includes that the judgment result of the first judgment substep is yes.
  2. 根据权利要求1所述的影像处理方法,其中,在所述判断处理步骤中,The image processing method according to claim 1, wherein, in the determining processing step,
    所述第一判断分步骤之后还包括色温调整分步骤:在所述第一判断分步骤的判断结果为是的情况下,对所述待处理影像进行调整色温处理;且所述待处理影像处理步骤中,调节进行调整色温处理后的所述待处理影像的所述水面画面区域和/或所述水中画面区域的饱和度;或After the first judgment sub-step, it further includes a color temperature adjustment sub-step: if the judgment result of the first judgment sub-step is yes, perform color temperature adjustment processing on the image to be processed; and process the image to be processed In the step, adjusting the saturation of the water surface image area and/or the water image area of the image to be processed after the color temperature adjustment process is performed; or
    所述第一判断分步骤之前还包括色温调整分步骤:对所述待处理影像进行调整色温处理。Before the first judgment sub-step, it also includes a color temperature adjustment sub-step: adjusting the color temperature of the image to be processed.
  3. 根据权利要求2所述的影像处理方法,其中,所述色温调整分步骤中,对所述待处理影像进行调整色温处理包括:3. The image processing method according to claim 2, wherein in the color temperature adjustment sub-step, adjusting the color temperature of the image to be processed comprises:
    对所述待处理影像进行调高色温处理。The processing of increasing the color temperature of the image to be processed is performed.
  4. 根据权利要求2或3所述的影像处理方法,其中,在所述判断处理步骤中,所述色温调整分步骤以及所述第一判断分步骤后还包括:The image processing method according to claim 2 or 3, wherein, in the determination processing step, after the color temperature adjustment sub-step and the first determination sub-step, the method further comprises:
    第二判断分步骤:判断所述水面画面区域的第一预设颜色的饱和度是否大于饱和度阈值;且The second judging step: judging whether the saturation of the first preset color of the water surface image area is greater than the saturation threshold; and
    所述判断处理步骤的判断结果为是的情况包括:所述第一判断分步骤的判断结果为是且所述第二判断分步骤的判断结果为是。The case where the judgment result of the judgment processing step is yes includes: the judgment result of the first judgment sub-step is yes and the judgment result of the second judgment sub-step is yes.
  5. 根据权利要求4所述的影像处理方法,其中,The image processing method according to claim 4, wherein:
    所述第一预设颜色为红色和/或橙色。The first preset color is red and/or orange.
  6. 根据权利要求1至5中任一项所述的影像处理方法,其中,所述影像处理方法还包括:The image processing method according to any one of claims 1 to 5, wherein the image processing method further comprises:
    再处理步骤:对所述水面画面区域进行调整色相和/或羽化处理。The reprocessing step: adjusting the hue and/or feathering of the water surface image area.
  7. 根据权利要求6所述的影像处理方法,其中,The image processing method according to claim 6, wherein:
    所述再处理步骤在所述待处理影像处理步骤后执行。The reprocessing step is performed after the to-be-processed image processing step.
  8. 根据权利要求6或7所述的影像处理方法,其中,所述影像处理方法还包括:The image processing method according to claim 6 or 7, wherein the image processing method further comprises:
    白平衡处理步骤:对所述水面画面区域进行第一白平衡调整。White balance processing step: performing a first white balance adjustment on the water surface image area.
  9. 根据权利要求8所述的影像处理方法,其中The image processing method according to claim 8, wherein
    所述白平衡处理步骤在所述再处理步骤后执行。The white balance processing step is executed after the reprocessing step.
  10. 根据权利要求8或9所述的影像处理方法,其中,所述白平衡处理步骤中,The image processing method according to claim 8 or 9, wherein in the white balance processing step,
    以所述水中画面区域为参照对所述水面画面区域进行所述第一白平衡调整。The first white balance adjustment is performed on the water surface image area with the underwater image area as a reference.
  11. 根据权利要求1至10中任一项所述的影像处理方法,其中,所述第一判断分步骤前还包括:The image processing method according to any one of claims 1 to 10, wherein before the first judgment step, the method further comprises:
    获取预设帧数与所述待处理影像对应的检测图像;Acquiring a detection image corresponding to the preset number of frames and the image to be processed;
    所述第一判断分步骤中,在预设帧数所述检测图像均出现包含预设特征的特征区域,且所述特征区域的红色通道增益高于通道增益阈 值的情况下,则判断所述待处理影像存在所述水面画面区域。In the first judging sub-step, in the case that a feature area containing a preset feature is present in the detection image with a preset number of frames, and the red channel gain of the feature area is higher than the channel gain threshold, then the judgment is made The image to be processed exists in the water surface image area.
  12. 根据权利要求1至10中任一项所述的影像处理方法,其中,在所述待处理影像中存在第二预设颜色且具有所述第二预设颜色的画面占所述待处理影像的比例位于预设比例范围内的情况下,则判断所述待处理影像同时存在所述水面画面区域以及所述水中画面区域。The image processing method according to any one of claims 1 to 10, wherein a second preset color exists in the image to be processed and a frame with the second preset color occupies a portion of the image to be processed If the ratio is within the preset ratio range, it is determined that the image to be processed simultaneously exists in the water surface image area and the underwater image area.
  13. 根据权利要求12所述的影像处理方法,其中,The image processing method according to claim 12, wherein:
    所述第二预设颜色为蓝色。The second preset color is blue.
  14. 根据权利要求1至13中任一项所述的影像处理方法,其中,在所述判断处理步骤的判断结果为否的情况下,对所述待处理影像进行第二白平衡调整和/或输出所述待处理影像。The image processing method according to any one of claims 1 to 13, wherein, in the case where the judgment result of the judgment processing step is no, the second white balance adjustment and/or output is performed on the image to be processed The image to be processed.
  15. 根据权利要求1至14中任一项所述的影像处理方法,其中,所述待处理影像处理步骤中,调节所述水面画面区域和/或所述水中画面区域的饱和度包括:The image processing method according to any one of claims 1 to 14, wherein, in the image processing step to be processed, adjusting the saturation of the water surface image area and/or the water image area includes:
    降低所述水面画面区域的红色和/或橙色饱和度。Reduce the red and/or orange saturation of the water surface image area.
  16. 根据权利要求1至15中任一项所述的影像处理方法,其中,所述待处理影像处理步骤中,调节所述水面画面区域和/或所述水中画面区域的饱和度包括:The image processing method according to any one of claims 1 to 15, wherein, in the image processing step to be processed, adjusting the saturation of the water surface image area and/or the water image area includes:
    提高所述水中画面区域的蓝色饱和度。Increase the blue saturation of the water image area.
  17. 根据权利要求1至16中任一项所述的影像处理方法,其中,所述待处理影像处理步骤中,调节所述水面画面区域和/或所述水中画面区域的饱和度包括:The image processing method according to any one of claims 1 to 16, wherein, in the image processing step to be processed, adjusting the saturation of the water surface image area and/or the water image area includes:
    按照用户设定的方式调节所述水面画面区域和/或所述水中画面区域的饱和度。Adjust the saturation of the water surface image area and/or the water image area in a manner set by the user.
  18. 根据权利要求1至17中任一项所述的影像处理方法,其中,所述待处理影像处理步骤前还包括:The image processing method according to any one of claims 1 to 17, wherein, before the step of processing the to-be-processed image, the method further comprises:
    记录步骤:记录已完成的调节所述水面画面区域和/或所述水中画面区域的饱和度的操作;且Recording step: recording the completed operation of adjusting the saturation of the water surface image area and/or the water image area; and
    所述待处理影像处理步骤中,调节所述水面画面区域和/或所述水中画面区域的饱和度的操作根据所述记录步骤的记录结果执行。In the image processing step to be processed, the operation of adjusting the saturation of the water surface image area and/or the water image area is performed according to the recording result of the recording step.
  19. 一种设备,包括设备处理器,所述设备处理器配置成:A device includes a device processor, and the device processor is configured to:
    判断待处理影像是否同时存在水面画面区域以及水中画面区域;Determine whether the image to be processed simultaneously exists in the water surface image area and the water image area;
    在所述待处理影像满足预设条件的情况下,调节所述水面画面区域和/或所述水中画面区域的饱和度,所述预设条件包括所述待处理影像同时存在所述水面画面区域以及所述水中画面区域。When the image to be processed meets a preset condition, the saturation of the water surface image area and/or the water image area is adjusted, and the preset condition includes that the image to be processed simultaneously exists in the water surface image area And the underwater picture area.
  20. 根据权利要求19所述的设备,其中所述设备处理器还配置成:The device of claim 19, wherein the device processor is further configured to:
    在所述待处理影像同时存在所述水面画面区域以及所述水中画面区域的情况下,对所述待处理影像进行调整色温处理;且调节进行调整色温处理后的所述待处理影像的所述水面画面区域和/或所述水中画面区域的饱和度;或In the case that the image to be processed simultaneously exists in the water surface image area and the underwater image area, perform color temperature adjustment processing on the image to be processed; and adjust the color temperature adjustment process of the image to be processed The water surface picture area and/or the saturation of the water picture area; or
    在判断所述待处理影像是否同时存在所述水面画面区域以及所述水中画面区域前对所述待处理影像进行调整色温处理。Before judging whether the image to be processed simultaneously exists in the water surface image area and the underwater image area, the image to be processed is subjected to color temperature adjustment processing.
  21. 根据权利要求20所述的设备,其中对所述待处理影像进行调整调高色温处理包括:The device according to claim 20, wherein adjusting and increasing the color temperature of the image to be processed comprises:
    对所述待处理影像进行调高色温处理。The processing of increasing the color temperature of the image to be processed is performed.
  22. 根据权利要求20或21所述的设备,其中所述设备处理器还配置成:The device according to claim 20 or 21, wherein the device processor is further configured to:
    在对所述待处理影像进行调整色温处理且判断所述待处理影像 是否同时存在所述水面画面区域以及所述水中画面区域后,还判断所述水面画面区域的第一预设颜色的饱和度是否大于饱和度阈值;After adjusting the color temperature of the image to be processed and determining whether the image to be processed simultaneously exists in the water surface image area and the underwater image area, the saturation of the first preset color of the water surface image area is also determined Is it greater than the saturation threshold;
    且所述预设条件包括所述待处理影像同时存在所述水面画面区域以及所述水中画面区域且所述水面画面区域的第一预设颜色的饱和度大于所述饱和度阈值。And the preset condition includes that the image to be processed simultaneously exists in the water surface image area and the water image area, and the saturation of the first preset color of the water surface image area is greater than the saturation threshold.
  23. 根据权利要求22所述的设备,其中,The device according to claim 22, wherein:
    所述第一预设颜色为红色和/或橙色。The first preset color is red and/or orange.
  24. 根据权利要求19至23中任一项所述的设备,其中所述设备处理器还配置成:The device according to any one of claims 19 to 23, wherein the device processor is further configured to:
    对所述水面画面区域进行调整色相和/或羽化处理。The hue adjustment and/or feathering process is performed on the water surface image area.
  25. 根据权利要求24所述的设备,其中所述设备处理器还配置成:The device of claim 24, wherein the device processor is further configured to:
    在调节所述水面画面区域和/或所述水中画面区域的饱和度后,对所述水面画面区域进行所述调整色相和/或所述羽化处理。After adjusting the saturation of the water surface image area and/or the water image area, the adjusting hue and/or the feathering process is performed on the water surface image area.
  26. 根据权利要求24或25所述的设备,其中所述设备处理器还配置成:The device according to claim 24 or 25, wherein the device processor is further configured to:
    对所述水面画面区域进行第一白平衡调整。Perform a first white balance adjustment on the water surface image area.
  27. 根据权利要求26所述的设备,其中所述设备处理器还配置成:The device of claim 26, wherein the device processor is further configured to:
    在调节所述水面画面区域和/或所述水中画面区域的饱和度后,对所述水面画面区域进行所述第一白平衡调整。After adjusting the saturation of the water surface image area and/or the water image area, the first white balance adjustment is performed on the water surface image area.
  28. 根据权利要求26或27所述的设备,其中所述设备处理器还配置成:The device according to claim 26 or 27, wherein the device processor is further configured to:
    以所述水中画面区域为参照对所述水面画面区域进行所述第一 白平衡调整。The first white balance adjustment is performed on the water surface image area with the underwater image area as a reference.
  29. 根据权利要求19至28中任一项所述的设备,其中所述设备处理器还配置成:The device according to any one of claims 19 to 28, wherein the device processor is further configured to:
    获取预设帧数与所述待处理影像对应的检测图像,在预设帧数所述检测图像均出现包含预设特征的特征区域,且所述特征区域的红色通道增益高于通道增益阈值的情况下,则判断所述待处理影像存在所述水面画面区域。Obtain a detection image corresponding to the preset number of frames and the image to be processed, and the detection image in the preset number of frames has a feature area containing a preset feature, and the red channel gain of the feature area is higher than the channel gain threshold In this case, it is determined that the image to be processed exists in the water surface area.
  30. 根据权利要求19至28中任一项所述的设备,其中所述设备处理器还配置成:The device according to any one of claims 19 to 28, wherein the device processor is further configured to:
    在所述待处理影像中存在第二预设颜色且具有所述第二预设颜色的画面占所述待处理影像的比例位于预设比例范围内的情况下,则判断所述待处理影像同时存在所述水面画面区域以及所述水中画面区域。In the case that there is a second preset color in the image to be processed and the ratio of the frame with the second preset color to the image to be processed is within the preset ratio range, it is determined that the image to be processed is at the same time There are the water surface image area and the underwater image area.
  31. 根据权利要求30所述的设备,其中The device of claim 30, wherein
    所述第二预设颜色为蓝色。The second preset color is blue.
  32. 根据权利要求19至31中任一项所述的设备,其中所述设备处理器还配置成:The device according to any one of claims 19 to 31, wherein the device processor is further configured to:
    在所述待处理影像不同时存在所述水面画面区域以及所述水中画面区域或所述水面画面区域的第一预设颜色的饱和度不大于所述饱和度阈值的情况下,对所述待处理影像进行第二白平衡调整和/或输出所述待处理影像。When the image to be processed does not simultaneously exist in the water surface area and the water surface area or the first preset color of the water surface area, the saturation is not greater than the saturation threshold, the processing method is The processed image performs a second white balance adjustment and/or outputs the to-be-processed image.
  33. 根据权利要求19至32中任一项所述的设备,其中调节所述水面画面区域和/或所述水中画面区域的饱和度包括:The device according to any one of claims 19 to 32, wherein adjusting the saturation of the water surface picture area and/or the water picture area comprises:
    降低所述水面画面区域的红色和/或橙色饱和度。Reduce the red and/or orange saturation of the water surface image area.
  34. 根据权利要求19至33中任一项所述的设备,其中调节所述水面画面区域和/或所述水中画面区域的饱和度包括:The device according to any one of claims 19 to 33, wherein adjusting the saturation of the water surface picture area and/or the water picture area comprises:
    提高所述水中画面区域的蓝色饱和度。Increase the blue saturation of the water image area.
  35. 根据权利要求19至34中任一项所述的设备,其中调节所述水面画面区域和/或所述水中画面区域的饱和度包括:The device according to any one of claims 19 to 34, wherein adjusting the saturation of the water surface picture area and/or the water picture area comprises:
    按照用户设定的方式调节所述水面画面区域和/或所述水中画面区域的饱和度。Adjust the saturation of the water surface image area and/or the water image area in a manner set by the user.
  36. 根据权利要求19至35中任一项所述的设备,其中所述设备处理器还配置成:The device according to any one of claims 19 to 35, wherein the device processor is further configured to:
    记录已完成的调节所述水面画面区域和/或所述水中画面区域的饱和度的操作;且调节所述水面画面区域和/或所述水中画面区域的饱和度的操作根据所述记录执行。The completed operation of adjusting the saturation of the water surface image area and/or the underwater image area is recorded; and the operation of adjusting the saturation of the water surface image area and/or the underwater image area is performed according to the record.
  37. 一种计算机可读存储介质,其中,A computer-readable storage medium, in which,
    所述计算机可读存储介质存储有指令,所述指令用于实现根据权利要求1至18中任一项所述影像处理方法。The computer-readable storage medium stores instructions for implementing the image processing method according to any one of claims 1 to 18.
  38. 一种成像设备,所述成像设备包括:An imaging device, the imaging device comprising:
    成像单元:所述成像单元生成待处理影像;Imaging unit: The imaging unit generates images to be processed;
    判断模块:判断所述待处理影像是否同时存在水面画面区域以及水中画面区域;Judging module: Judging whether the image to be processed has both a water surface image area and an underwater image area;
    处理模块:在所述待处理影像满足预设条件的情况下,调节所述水面画面区域和/或所述水中画面区域的饱和度,所述预设条件包括所述待处理影像同时存在所述水面画面区域以及所述水中画面区域。Processing module: when the image to be processed meets a preset condition, adjust the saturation of the water surface image area and/or the water image area, and the preset condition includes that the image to be processed simultaneously exists in the The water surface picture area and the water picture area.
  39. 根据权利要求38所述的成像设备,其中,所述处理模块还配置成:The imaging device according to claim 38, wherein the processing module is further configured to:
    在所述待处理影像同时存在所述水面画面区域以及所述水中画 面区域的情况下,对所述待处理影像进行调整色温处理;且调节进行调整色温处理后的所述待处理影像的所述水面画面区域和/或所述水中画面区域的饱和度;或In the case that the image to be processed simultaneously exists in the water surface image area and the underwater image area, the image to be processed is adjusted for color temperature processing; and the image to be processed after the color temperature adjustment processing is adjusted The water surface picture area and/or the saturation of the water picture area; or
    在判断所述待处理影像是否同时存在所述水面画面区域以及所述水中画面区域前对所述待处理影像进行调整色温处理。Before judging whether the image to be processed simultaneously exists in the water surface image area and the underwater image area, the image to be processed is subjected to color temperature adjustment processing.
  40. 根据权利要求39所述的成像设备,其中,对所述待处理影像进行调整色温处理包括:The imaging device according to claim 39, wherein the adjustment of the color temperature of the image to be processed comprises:
    对所述待处理影像进行调高色温处理。The processing of increasing the color temperature of the image to be processed is performed.
  41. 根据权利要求39或40所述的成像设备,其中,所述判断模块还配置成:The imaging device according to claim 39 or 40, wherein the judgment module is further configured to:
    在判断待处理影像是否同时存在水面画面区域以及水中画面区域以及对所述待处理影像进行调整色温处理后,判断所述水面画面区域的第一预设颜色的饱和度是否大于饱和度阈值;After judging whether the image to be processed has both a water surface image area and an underwater image area and performing color temperature adjustment processing on the image to be processed, determining whether the saturation of the first preset color of the water surface image area is greater than a saturation threshold;
    所述预设条件包括所述待处理影像同时存在所述水面画面区域以及所述水中画面区域且所述水面画面区域的所述第一预设颜色的饱和度大于所述饱和度阈值。The preset condition includes that the image to be processed simultaneously exists in the water surface image area and the underwater image area, and the saturation of the first preset color of the water surface image area is greater than the saturation threshold.
  42. 根据权利要求41所述的成像设备,其中,The image forming apparatus according to claim 41, wherein:
    所述第一预设颜色为红色和/或橙色。The first preset color is red and/or orange.
  43. 根据权利要求38至42中任一项所述的成像设备,其中,所述处理模块还配置成:The imaging device according to any one of claims 38 to 42, wherein the processing module is further configured to:
    对所述水面画面区域进行调整色相和/或羽化处理。The hue adjustment and/or feathering process is performed on the water surface image area.
  44. 根据权利要求43所述的成像设备,其中,所述处理模块还配置成:The imaging device according to claim 43, wherein the processing module is further configured to:
    在调节所述水面画面区域和/或所述水中画面区域的饱和度后,对所述水面画面区域进行所述调整色相和/或所述羽化处理。After adjusting the saturation of the water surface image area and/or the water image area, the adjusting hue and/or the feathering process is performed on the water surface image area.
  45. 根据权利要求43或44所述的成像设备,其中,所述处理模块还配置成:The imaging device according to claim 43 or 44, wherein the processing module is further configured to:
    对所述水面画面区域进行第一白平衡调整。Perform a first white balance adjustment on the water surface image area.
  46. 根据权利要求45所述的成像设备,其中,所述处理模块还配置成:The imaging device according to claim 45, wherein the processing module is further configured to:
    在对所述水面画面区域进行所述调整色相和/或所述羽化处理后,对所述水面画面区域进行所述第一白平衡调整。After performing the adjustment hue and/or the feathering process on the water surface image area, the first white balance adjustment is performed on the water surface image area.
  47. 根据权利要求45或46所述的成像设备,其中,所述处理模块还配置成:The imaging device according to claim 45 or 46, wherein the processing module is further configured to:
    以所述水中画面区域为参照对所述水面画面区域进行所述第一白平衡调整。The first white balance adjustment is performed on the water surface image area with the underwater image area as a reference.
  48. 根据权利要求38至47中任一项所述的成像设备,其中,所述处理模块还配置成获取预设帧数与所述待处理影像对应的检测图像,且所述判断模块还配置成:The imaging device according to any one of claims 38 to 47, wherein the processing module is further configured to obtain a preset number of frames of detection images corresponding to the image to be processed, and the judgment module is further configured to:
    在预设帧数所述检测图像均出现包含预设特征的特征区域,且所述特征区域的红色通道增益高于通道增益阈值的情况下,则判断所述待处理影像存在所述水面画面区域。In the case that the detection images with the preset number of frames all have feature regions containing preset features, and the red channel gain of the feature region is higher than the channel gain threshold, it is determined that the image to be processed exists in the water surface area .
  49. 根据权利要求38至47中任一项所述的成像设备,其中,所述判断模块还配置成:The imaging device according to any one of claims 38 to 47, wherein the judgment module is further configured to:
    在所述待处理影像中存在第二预设颜色且具有所述第二预设颜色的画面占所述待处理影像的比例位于预设比例范围内的情况下,则判断所述待处理影像同时存在所述水面画面区域以及所述水中画面区域。In the case that there is a second preset color in the image to be processed and the ratio of the frame with the second preset color to the image to be processed is within the preset ratio range, it is determined that the image to be processed is at the same time There are the water surface image area and the underwater image area.
  50. 根据权利要求49所述的成像设备,其中,The image forming apparatus according to claim 49, wherein:
    所述第二预设颜色为蓝色。The second preset color is blue.
  51. 根据权利要求38至50中任一项所述的成像设备,其中,所述处理模块还配置成:The imaging device according to any one of claims 38 to 50, wherein the processing module is further configured to:
    在所述待处理影像不同时存在所述水面画面区域以及所述水中画面区域或所述水面画面区域的第一预设颜色的饱和度不大于所述饱和度阈值的情况下,对所述待处理影像进行第二白平衡调整和/或输出所述待处理影像。When the image to be processed does not simultaneously exist in the water surface area and the water surface area or the first preset color of the water surface area, the saturation is not greater than the saturation threshold, the processing method is The processed image performs a second white balance adjustment and/or outputs the to-be-processed image.
  52. 根据权利要求38至51中任一项所述的成像设备,其中,调节所述水面画面区域和/或所述水中画面区域的饱和度包括:The imaging device according to any one of claims 38 to 51, wherein adjusting the saturation of the water surface picture area and/or the water picture area comprises:
    降低所述水面画面区域的红色和/或橙色饱和度。Reduce the red and/or orange saturation of the water surface image area.
  53. 根据权利要求38至52中任一项所述的成像设备,其中,调节所述水面画面区域和/或所述水中画面区域的饱和度包括:The imaging device according to any one of claims 38 to 52, wherein adjusting the saturation of the water surface picture area and/or the water picture area comprises:
    提高所述水中画面区域的蓝色饱和度。Increase the blue saturation of the water image area.
  54. 根据权利要求38至53中任一项所述的成像设备,其中,调节所述水面画面区域和/或所述水中画面区域的饱和度包括:The imaging device according to any one of claims 38 to 53, wherein adjusting the saturation of the water surface picture area and/or the water picture area comprises:
    按照用户设定的方式调节所述水面画面区域和/或所述水中画面区域的饱和度。Adjust the saturation of the water surface image area and/or the water image area in a manner set by the user.
  55. 根据权利要求38至54中任一项所述的成像设备,其中,所述处理模块还配置成:The imaging device according to any one of claims 38 to 54, wherein the processing module is further configured to:
    在调节所述水面画面区域和/或所述水中画面区域的饱和度前,记录已完成的调节所述水面画面区域和/或所述水中画面区域的饱和度的操作,且调节所述水面画面区域和/或所述水中画面区域的饱和度的操作根据所述记录执行。Before adjusting the saturation of the water surface image area and/or the underwater image area, record the completed operation of adjusting the saturation of the water surface image area and/or the water image area, and adjust the water surface image The operation of the saturation of the area and/or the underwater picture area is performed according to the record.
  56. 根据权利要求38至55中任一项所述的成像设备,其中,还 包括:The imaging device according to any one of claims 38 to 55, further comprising:
    压力探测装置,用于探测所述成像单元所处区域的压力;且A pressure detecting device for detecting the pressure of the area where the imaging unit is located; and
    所述处理模块还被配置成在所述压力大于第一压力阈值时执行判断所述待处理影像是否同时存在所述水面画面区域以及所述水中画面区域的操作。The processing module is further configured to perform an operation of determining whether the image to be processed simultaneously exists in the water surface image area and the underwater image area when the pressure is greater than a first pressure threshold.
  57. 根据权利要求56所述的成像设备,其中,The image forming apparatus according to claim 56, wherein:
    所述压力探测装置还配置成在所述压力大于第二压力阈值和/或小于第三压力阈值时发出警报信号。The pressure detection device is further configured to issue an alarm signal when the pressure is greater than a second pressure threshold and/or less than a third pressure threshold.
  58. 根据权利要求38至57中任一项所述的成像设备,其中还包括:The imaging device according to any one of claims 38 to 57, further comprising:
    防水单元,所述防水单元用于防止所述成像单元、所述判断模块以及所述处理模块中至少一者进水。A waterproof unit, which is used to prevent water from entering at least one of the imaging unit, the judgment module, and the processing module.
  59. 一种影像处理系统,所述影像处理系统包括:An image processing system, the image processing system comprising:
    接收器,用于接收待处理影像;Receiver for receiving the image to be processed;
    系统处理器,配置成判断所述待处理影像是否同时存在水面画面区域以及水中画面区域;在所述待处理影像满足预设条件的情况下,调节所述水面画面区域和/或所述水中画面区域的饱和度,所述预设条件包括所述待处理影像同时存在所述水面画面区域以及所述水中画面区域。The system processor is configured to determine whether the image to be processed has a water surface image area and an underwater image area at the same time; when the image to be processed meets a preset condition, adjust the water surface image area and/or the underwater image The saturation of the area, the preset condition includes that the image to be processed simultaneously exists in the water surface image area and the underwater image area.
  60. 根据权利要求59所述的影像处理系统,其中,所述系统处理器还配置成:The image processing system of claim 59, wherein the system processor is further configured to:
    在所述待处理影像同时存在所述水面画面区域以及所述水中画面区域的情况下,对所述待处理影像进行调整色温处理;且调节进行调整色温处理后的所述待处理影像的所述水面画面区域和/或所述水中画面区域的饱和度;或In the case that the image to be processed simultaneously exists in the water surface image area and the underwater image area, perform color temperature adjustment processing on the image to be processed; and adjust the color temperature adjustment process of the image to be processed The water surface picture area and/or the saturation of the water picture area; or
    判断所述待处理影像是否同时存在所述水面画面区域以及所述 水中画面区域前对所述待处理影像进行调整色温处理。Before judging whether the image to be processed simultaneously exists in the water surface image area and the underwater image area, the image to be processed is subjected to color temperature adjustment processing.
  61. 根据权利要求60所述的影像处理系统,其中,对所述待处理影像进行调整色温处理包括:The image processing system according to claim 60, wherein the adjusting the color temperature of the image to be processed comprises:
    对所述待处理影像进行调高色温处理。The processing of increasing the color temperature of the image to be processed is performed.
  62. 根据权利要求60或61所述的影像处理系统,其中,所述系统处理器还配置成:The image processing system according to claim 60 or 61, wherein the system processor is further configured to:
    在对所述待处理影像进行调整色温处理且判断所述待处理影像是否同时存在所述水面画面区域以及所述水中画面区域后,还判断所述水面画面区域的第一预设颜色的饱和度是否大于饱和度阈值;After adjusting the color temperature of the image to be processed and determining whether the image to be processed simultaneously exists in the water surface image area and the underwater image area, the saturation of the first preset color of the water surface image area is also determined Is it greater than the saturation threshold;
    且所述预设条件包括所述待处理影像同时存在所述水面画面区域以及所述水中画面区域且所述水面画面区域的所述第一预设颜色的饱和度大于所述饱和度阈值。And the preset condition includes that the image to be processed simultaneously exists in the water surface image area and the underwater image area, and the saturation of the first preset color of the water surface image area is greater than the saturation threshold.
  63. 根据权利要求62所述的影像处理系统,其中,The image processing system according to claim 62, wherein:
    所述第一预设颜色为红色和/或橙色。The first preset color is red and/or orange.
  64. 根据权利要求59至63中任一项所述的影像处理系统,其中,所述系统处理器还配置成:The image processing system according to any one of claims 59 to 63, wherein the system processor is further configured to:
    对所述水面画面区域进行调整色相和/或羽化处理。The hue adjustment and/or feathering process is performed on the water surface image area.
  65. 根据权利要求64所述的影像处理系统,其中,所述系统处理器还配置成:The image processing system according to claim 64, wherein the system processor is further configured to:
    在调节所述水面画面区域和/或所述水中画面区域的饱和度后,对所述水面画面区域进行所述调整色相和/或所述羽化处理。After adjusting the saturation of the water surface image area and/or the water image area, the adjusting hue and/or the feathering process is performed on the water surface image area.
  66. 根据权利要求64或65所述的影像处理系统,其中,所述系统处理器还配置成:The image processing system according to claim 64 or 65, wherein the system processor is further configured to:
    对所述水面画面区域进行第一白平衡调整。Perform a first white balance adjustment on the water surface image area.
  67. 根据权利要求66所述的影像处理系统,其中,所述系统处理器还配置成:The image processing system of claim 66, wherein the system processor is further configured to:
    在对所述水面画面区域进行所述调整色相和/或所述羽化处理后,对所述水面画面区域进行所述第一白平衡调整。After performing the adjustment hue and/or the feathering processing on the water surface image area, the first white balance adjustment is performed on the water surface image area.
  68. 根据权利要求66或67所述的影像处理系统,其中,所述系统处理器还配置成:The image processing system according to claim 66 or 67, wherein the system processor is further configured to:
    以所述水中画面区域为参照对所述水面画面区域进行所述第一白平衡调整。The first white balance adjustment is performed on the water surface image area with the underwater image area as a reference.
  69. 根据权利要求59至68中任一项所述的影像处理系统,其中,所述系统处理器还配置成:The image processing system according to any one of claims 59 to 68, wherein the system processor is further configured to:
    获取预设帧数与所述待处理影像对应的检测图像,在预设帧数所述检测图像均出现包含预设特征的特征区域,且所述特征区域的红色通道增益高于通道增益阈值的情况下,则判断所述待处理影像存在所述水面画面区域。Obtain a detection image corresponding to the preset number of frames and the image to be processed, and the detection image in the preset number of frames has a feature area containing a preset feature, and the red channel gain of the feature area is higher than the channel gain threshold In this case, it is determined that the image to be processed exists in the water surface area.
  70. 根据权利要求59至68中任一项所述的影像处理系统,其中,所述系统处理器还配置成:The image processing system according to any one of claims 59 to 68, wherein the system processor is further configured to:
    在所述待处理影像中存在第二预设颜色且具有所述第二预设颜色的画面占所述待处理影像的比例位于预设比例范围内的情况下,则判断所述待处理影像同时存在所述水面画面区域以及所述水中画面区域。In the case that there is a second preset color in the image to be processed and the ratio of the frame with the second preset color to the image to be processed is within the preset ratio range, it is determined that the image to be processed is at the same time There are the water surface image area and the underwater image area.
  71. 根据权利要求70所述的影像处理系统,其中,The image processing system according to claim 70, wherein:
    所述第二预设颜色为蓝色。The second preset color is blue.
  72. 根据权利要求59至71中任一项所述的影像处理系统,其中,所述系统处理器还配置成:The image processing system according to any one of claims 59 to 71, wherein the system processor is further configured to:
    在所述待处理影像不同时存在所述水面画面区域以及所述水中画面区域或所述水面画面区域的第一预设颜色的饱和度不大于所述饱和度阈值的情况下,对所述待处理影像进行第二白平衡调整和/或输出所述待处理影像。When the image to be processed does not simultaneously exist in the water surface area and the water surface area or the first preset color of the water surface area, the saturation is not greater than the saturation threshold, the processing method is The processed image performs a second white balance adjustment and/or outputs the to-be-processed image.
  73. 根据权利要求59至72中任一项所述的影像处理系统,其中,调节所述水面画面区域和/或所述水中画面区域的饱和度包括:The image processing system according to any one of claims 59 to 72, wherein adjusting the saturation of the water surface image area and/or the water image area includes:
    降低所述水面画面区域的红色和/或橙色饱和度。Reduce the red and/or orange saturation of the water surface image area.
  74. 根据权利要求59至73中任一项所述的影像处理系统,其中,调节所述水面画面区域和/或所述水中画面区域的饱和度包括:The image processing system according to any one of claims 59 to 73, wherein adjusting the saturation of the water surface image area and/or the water image area includes:
    提高所述水中画面区域的蓝色饱和度。Increase the blue saturation of the water image area.
  75. 根据权利要求59至74中任一项所述的影像处理系统,其中,调节所述水面画面区域和/或所述水中画面区域的饱和度包括:The image processing system according to any one of claims 59 to 74, wherein adjusting the saturation of the water surface image area and/or the water image area includes:
    按照用户设定的方式调节所述水面画面区域和/或所述水中画面区域的饱和度。Adjust the saturation of the water surface image area and/or the water image area in a manner set by the user.
  76. 根据权利要求59至75中任一项所述的影像处理系统,其中,所述系统处理器还配置成:The image processing system according to any one of claims 59 to 75, wherein the system processor is further configured to:
    在调节所述水面画面区域和/或所述水中画面区域的饱和度前,记录已完成的调节所述水面画面区域和/或所述水中画面区域的饱和度的操作,且调节所述水面画面区域和/或所述水中画面区域的饱和度的操作根据所述记录执行。Before adjusting the saturation of the water surface image area and/or the underwater image area, record the completed operation of adjusting the saturation of the water surface image area and/or the water image area, and adjust the water surface image The operation of the saturation of the area and/or the underwater picture area is performed according to the record.
PCT/CN2020/093344 2020-05-29 2020-05-29 Image processing method and system WO2021237692A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2020/093344 WO2021237692A1 (en) 2020-05-29 2020-05-29 Image processing method and system
CN202080005185.9A CN112740664A (en) 2020-05-29 2020-05-29 Image processing method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/093344 WO2021237692A1 (en) 2020-05-29 2020-05-29 Image processing method and system

Publications (1)

Publication Number Publication Date
WO2021237692A1 true WO2021237692A1 (en) 2021-12-02

Family

ID=75609569

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/093344 WO2021237692A1 (en) 2020-05-29 2020-05-29 Image processing method and system

Country Status (2)

Country Link
CN (1) CN112740664A (en)
WO (1) WO2021237692A1 (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110058085A1 (en) * 2009-09-09 2011-03-10 Olympus Imaging Corp. Waterproof camera and display method
US20110187890A1 (en) * 2010-02-04 2011-08-04 Canon Kabushiki Kaisha Image processing apparatus
CN102595031A (en) * 2010-09-29 2012-07-18 奥林巴斯映像株式会社 Image-capturing device and image processing method
CN102870044A (en) * 2010-03-22 2013-01-09 伊斯曼柯达公司 Underwater camera with pressure sensor
CN105450923A (en) * 2014-09-25 2016-03-30 索尼公司 Image processing method, image processing device and electronic device
US20170214836A1 (en) * 2016-01-27 2017-07-27 Kyocera Corporation Electronic apparatus, method for controlling electronic apparatus, and non-transitory computer readable recording medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009200589A (en) * 2008-02-19 2009-09-03 Sanyo Electric Co Ltd Image processing apparatus and color corrected photography method thereof

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110058085A1 (en) * 2009-09-09 2011-03-10 Olympus Imaging Corp. Waterproof camera and display method
US20110187890A1 (en) * 2010-02-04 2011-08-04 Canon Kabushiki Kaisha Image processing apparatus
CN102870044A (en) * 2010-03-22 2013-01-09 伊斯曼柯达公司 Underwater camera with pressure sensor
CN102595031A (en) * 2010-09-29 2012-07-18 奥林巴斯映像株式会社 Image-capturing device and image processing method
CN105450923A (en) * 2014-09-25 2016-03-30 索尼公司 Image processing method, image processing device and electronic device
US20170214836A1 (en) * 2016-01-27 2017-07-27 Kyocera Corporation Electronic apparatus, method for controlling electronic apparatus, and non-transitory computer readable recording medium

Also Published As

Publication number Publication date
CN112740664A (en) 2021-04-30

Similar Documents

Publication Publication Date Title
US10397486B2 (en) Image capture apparatus and method executed by image capture apparatus
JP4046079B2 (en) Image processing device
JP4040625B2 (en) Image processing apparatus, printer apparatus, photographing apparatus, and television receiver
US8339506B2 (en) Image capture parameter adjustment using face brightness information
US9077905B2 (en) Image capturing apparatus and control method thereof
US8059187B2 (en) Image capturing apparatus
JP2008541509A (en) Method and apparatus for incorporating iris color in red-eye correction
US9177396B2 (en) Image processing apparatus and image processing method
JP2006217277A (en) Imaging device
JP2011135519A (en) Image processing apparatus, image processing method, and program
JP6904788B2 (en) Image processing equipment, image processing methods, and programs
US11115637B2 (en) Image processing apparatus, image capturing apparatus, image processing method, and storage medium
US6996270B1 (en) Method, apparatus, and recording medium for facial area adjustment of an image
JP2009124264A (en) Image processing apparatus and image processing method
JP4851505B2 (en) Image processing apparatus and image processing method
WO2021237692A1 (en) Image processing method and system
JP2010041174A (en) Image processor
JP2004088345A (en) Image forming method, image processor, print preparation device, and storage medium
JP6080531B2 (en) Image processing apparatus, image processing method, program, and storage medium
JP2007259411A (en) Exposure determination apparatus and method of determining same
JP2011135510A (en) Image processing method, image processing device, and imaging device
JP2010050568A (en) Image processor, image processing method, program and recording medium
JP4219577B2 (en) Image processing apparatus, image output apparatus, image processing method, and storage medium
JP2003216941A (en) Image processing device and method, recording medium, and program
JP5205230B2 (en) Image processing device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20937981

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20937981

Country of ref document: EP

Kind code of ref document: A1