CN117793537A

CN117793537A - Image processing method, intelligent terminal and storage medium

Info

Publication number: CN117793537A
Application number: CN202311715645.9A
Authority: CN
Inventors: 刘鑫; 漆伟; 徐瑞林
Original assignee: Shenzhen Taihengnuo Technology Co ltd
Current assignee: Shenzhen Taihengnuo Technology Co ltd
Priority date: 2023-12-13
Filing date: 2023-12-13
Publication date: 2024-03-29

Abstract

The application relates to an image processing method, an intelligent terminal and a storage medium, wherein the image processing method comprises the following steps: acquiring a target image shot by a first camera and at least one reference image with a different acquisition direction from the target image; and responding to the target image and the reference image to meet a first preset condition, and executing preset processing on the shooting result of the first camera. According to the technical scheme, the image collected by the camera and the images in different collection directions are analyzed, the shooting result of the camera is processed, the accuracy of image processing can be improved, and the intelligent camera is more intelligent.

Description

Image processing method, intelligent terminal and storage medium

Technical Field

The application relates to the technical field of terminals, in particular to an image processing method, an intelligent terminal and a storage medium.

Background

Along with the rapid development of terminal technology, the functions of mobile terminals such as mobile phones, tablet computers and the like are continuously perfected, and the mobile terminals gradually become one of the common tools in daily life and work of people.

In the process of designing and implementing the present application, the inventors found that at least the following problems exist: before processing the shooting result of the camera, only the image shot by the camera is analyzed, and the processing result is not accurate enough and intelligent enough.

The foregoing description is provided for general background information and does not necessarily constitute prior art.

Disclosure of Invention

According to the image processing method, the intelligent terminal and the storage medium, the images collected by the camera and the images in different collecting directions are analyzed, and then the shooting result of the camera is processed, so that the accuracy of image processing can be improved, and the intelligent camera is more intelligent.

The application provides an image processing method, which comprises the following steps:

s1: acquiring a target image shot by a first camera and at least one reference image with a different acquisition direction from the target image;

s2: and responding to the target image and the reference image to meet a first preset condition, and executing preset processing on the shooting result of the first camera.

Optionally, step S1 includes at least one of:

responding to a first operation, controlling a target image shot by a first camera, and acquiring at least one reference image with a different acquisition direction from the target image according to a first rule;

and acquiring a target image shot by a first camera, and responding to the target image reaching a glare condition, and acquiring at least one reference image with a different acquisition direction from the target image according to a first rule.

Optionally, the first rule includes at least one of:

in the process of detecting the rotation of the first camera, controlling the first camera to shoot at least one reference image according to a second rule;

controlling a second camera which is arranged in a non-same direction with the first camera to shoot at least one reference image;

and in the process of detecting the rotation of the second camera, controlling the second camera to shoot at least one reference image according to a second rule.

Optionally, the second rule includes at least one of:

shooting reference images at intervals of preset time length;

shooting reference images at intervals of preset rotation angles;

and shooting a reference image when the rotation angle is a preset angle.

Optionally, the method further comprises at least one of:

outputting prompt information for rotating the first camera;

and outputting prompt information for rotating the second camera.

Optionally, the meeting the first preset condition includes at least one of the following:

the target image accords with the glare condition, and the reference image does not accord with the glare condition;

the target image accords with a glare condition, and the difference value of the glare degree of the target image and the reference image is larger than a preset threshold value;

The target image and the reference image both accord with the glare condition, and the glare degree difference value of the target image and the reference image meets a second preset condition.

Optionally, the meeting the second preset condition includes at least one of the following:

the included angle between the acquisition direction of the target image and the acquisition direction of the reference image is a target included angle, and the glare degree difference value is increased along with the increase of the target included angle;

the glare degree difference value is increased along with the increase of the rotation angle of the first camera;

the glare degree difference value becomes larger as the rotation angle of the second camera becomes larger.

Optionally, the preset processing includes at least one of the following:

outputting prompt information of the first camera glare;

outputting a glare removal option for indicating at least one of a degree of glare treatment, the number of images continuously treating the glare, a time continuously treating the glare, and retaining an original image;

carrying out glare removal processing on a shooting image shot by the first camera by adopting a GAN network;

outputting the photographed image after the glare removal process.

The application also provides an intelligent terminal, including: the image processing device comprises a memory and a processor, wherein the memory stores an image processing program, and the image processing program realizes the steps of the image processing method when being executed by the processor.

The present application also provides a storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the image processing method as described in any of the above.

As described above, the image processing method of the present application includes: acquiring a target image shot by a first camera and at least one reference image with a different acquisition direction from the target image; and responding to the target image and the reference image to meet a first preset condition, and executing preset processing on the shooting result of the first camera. According to the technical scheme, the image collected by the camera and the images in different collection directions are analyzed, the shooting result of the camera is processed, the accuracy of image processing can be improved, and the intelligent camera is more intelligent.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

Fig. 1 is a schematic hardware structure diagram of an intelligent terminal implementing various embodiments of the present application;

fig. 2 is a schematic diagram of a communication network system according to an embodiment of the present application;

FIG. 3 is a flow diagram illustrating an image processing method according to one embodiment;

FIG. 4 is a schematic diagram illustrating an application scenario, according to an embodiment;

FIG. 5 is a schematic diagram illustrating an interface according to one embodiment.

The realization, functional characteristics and advantages of the present application will be further described with reference to the embodiments, referring to the attached drawings. Specific embodiments thereof have been shown by way of example in the drawings and will herein be described in more detail. These drawings and the written description are not intended to limit the scope of the inventive concepts in any way, but to illustrate the concepts of the present application to those skilled in the art by reference to specific embodiments.

Detailed Description

Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present application as detailed in the accompanying claims.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the element defined by the phrase "comprising one … …" does not exclude the presence of additional identical elements in a process, method, article, or apparatus that comprises the element and/or the elements, features, or elements having the same name in different embodiments of the present application may have the same meaning or may have different meanings, a particular meaning of which is to be determined by its interpretation in this particular embodiment or by further combining the context of this particular embodiment.

It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope herein. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "responsive to a determination", depending on the context. Furthermore, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes," and/or "including" specify the presence of stated features, steps, operations, elements, components, items, categories, and/or groups, but do not preclude the presence, presence or addition of one or more other features, steps, operations, elements, components, items, categories, and/or groups. The terms "or," "and/or," "including at least one of," and the like, as used herein, may be construed as inclusive, or meaning any one or any combination. For example, "including at least one of: A. b, C "means" any one of the following: a, A is as follows; b, a step of preparing a composite material; c, performing operation; a and B; a and C; b and C; a and B and C ", again as examples," A, B or C "or" A, B and/or C "means" any of the following: a, A is as follows; b, a step of preparing a composite material; c, performing operation; a and B; a and C; b and C; a and B and C). An exception to this definition will occur only when a combination of elements, functions, steps or operations are in some way inherently mutually exclusive.

It should be understood that, although the steps in the flowcharts in the embodiments of the present application are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited in order and may be performed in other orders, unless explicitly stated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, the order of their execution not necessarily occurring in sequence, but may be performed alternately or alternately with other steps or at least a portion of the other steps or stages.

The words "if", as used herein, may be interpreted as "at … …" or "at … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrase "if determined" or "if detected (stated condition or event)" may be interpreted as "when determined" or "in response to determination" or "when detected (stated condition or event)" or "in response to detection (stated condition or event), depending on the context.

It should be noted that, in this document, step numbers such as S10 and S20 are adopted, and the purpose of the present invention is to more clearly and briefly describe the corresponding content, and not to constitute a substantial limitation on the sequence, and those skilled in the art may execute S20 first and then execute S10 when implementing the present invention, which is within the scope of protection of the present application.

It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.

In the following description, suffixes such as "module", "component", or "unit" for representing elements are used only for facilitating the description of the present application, and are not of specific significance per se. Thus, "module," "component," or "unit" may be used in combination.

The intelligent terminal may be implemented in various forms. For example, the smart terminals described in the present application may include smart terminals such as cell phones, tablet computers, notebook computers, palm computers, personal digital assistants (Personal Digital Assistant, PDA), portable media players (Portable Media Player, PMP), navigation devices, wearable devices, smart bracelets, pedometers, and stationary terminals such as digital TVs, desktop computers, and the like.

In the following description, an intelligent terminal will be described as an example, and those skilled in the art will understand that the configuration according to the embodiment of the present application can be applied to a fixed type terminal in addition to elements particularly used for a mobile purpose.

Referring to fig. 1, which is a schematic hardware structure of an intelligent terminal for implementing various embodiments of the present application, the intelligent terminal 100 may include: an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an a/V (audio/video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111. It will be appreciated by those skilled in the art that the configuration of the intelligent terminal shown in fig. 1 is not limiting of the intelligent terminal, and the intelligent terminal may include more or less components than those illustrated, or may combine certain components, or may have a different arrangement of components.

The following describes the components of the intelligent terminal in detail with reference to fig. 1:

the radio frequency unit 101 may be used for receiving and transmitting signals during the information receiving or communication process, specifically, after receiving downlink information of the base station, processing the downlink information by the processor 110; and, the uplink data is transmitted to the base station. Typically, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. And/or the radio frequency unit 101 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol including, but not limited to, GSM (Global System of Mobile communication, global system for mobile communications), GPRS (General Packet Radio Service ), CDMA2000 (Code Division Multiple Access, 2000, CDMA 2000), WCDMA (Wideband Code Division Multiple Access ), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, time Division synchronous code Division multiple access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution, frequency Division duplex long term evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution, time Division duplex long term evolution), 5G, 6G, and the like.

WiFi belongs to a short-distance wireless transmission technology, and the intelligent terminal can help a user to send and receive emails, browse webpages, access streaming media and the like through the WiFi module 102, so that wireless broadband Internet access is provided for the user. Although fig. 1 shows a WiFi module 102, it is understood that it does not belong to the essential constitution of the intelligent terminal, and can be omitted entirely as required within the scope of not changing the essence of the invention.

The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the intelligent terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output (e.g., a call signal reception sound, a message reception sound, etc.) related to a specific function performed by the smart terminal 100. The audio output unit 103 may include a speaker, a buzzer, and the like.

The a/V input unit 104 is used to receive an audio or video signal. The a/V input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, the graphics processor 1041 processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound into audio data. The processed audio (voice) data may be converted into a format output that can be transmitted to the mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting the audio signal.

The intelligent terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor, optionally, the ambient light sensor may adjust the brightness of the display panel 1061 according to the brightness of ambient light, and the proximity sensor may turn off the display panel 1061 and/or the backlight when the smart terminal 100 moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the acceleration in all directions (generally three axes), and can detect the gravity and direction when stationary, and can be used for applications of recognizing the gesture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and knocking), and the like; as for other sensors such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that may also be configured in the mobile phone, the detailed description thereof will be omitted.

The display unit 106 is used to display information input by a user or information provided to the user. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 107 may be used to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the intelligent terminal. Alternatively, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect touch operations thereon or thereabout by a user (e.g., operations of the user on the touch panel 1071 or thereabout by using any suitable object or accessory such as a finger, a stylus, etc.) and drive the corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. Optionally, the touch detection device detects the touch azimuth of the user, detects a signal brought by touch operation, and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and sends the touch point coordinates to the processor 110, and can receive and execute commands sent from the processor 110. And/or the touch panel 1071 may be implemented in various types of resistive, capacitive, infrared, surface acoustic wave, and the like. The user input unit 107 may include other input devices 1072 in addition to the touch panel 1071. Alternatively, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, mouse, joystick, etc., as specifically not limited herein.

Alternatively, the touch panel 1071 may overlay the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or thereabout, the touch panel 1071 is transferred to the processor 110 to determine the type of touch event, and the processor 110 then provides a corresponding visual output on the display panel 1061 according to the type of touch event. Although in fig. 1, the touch panel 1071 and the display panel 1061 are two independent components for implementing the input and output functions of the smart terminal, in some embodiments, the touch panel 1071 may be integrated with the display panel 1061 to implement the input and output functions of the smart terminal, which is not limited herein.

The interface unit 108 serves as an interface through which at least one external device can be connected with the intelligent terminal 100. For example, the external devices may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the smart terminal 100 or may be used to transmit data between the smart terminal 100 and an external device.

Memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, and alternatively, the storage program area may store an operating system, an application program required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, phonebook, etc.) created according to the use of the handset, etc. And/or memory 109 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.

The processor 110 is a control center of the intelligent terminal, connects various parts of the entire intelligent terminal using various interfaces and lines, and performs various functions of the intelligent terminal and processes data by running or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the intelligent terminal. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor, the application processor optionally handling mainly an operating system, a user interface, an application program, etc., the modem processor handling mainly wireless communication. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The intelligent terminal 100 may further include a power source 111 (such as a battery) for supplying power to the respective components, and preferably, the power source 111 may be logically connected to the processor 110 through a power management system, so as to implement functions of managing charging, discharging, power consumption management, etc. through the power management system.

Although not shown in fig. 1, the intelligent terminal 100 may further include a bluetooth module or the like, which is not described herein.

In order to facilitate understanding of the embodiments of the present application, a communication network system on which the intelligent terminal of the present application is based will be described below.

Referring to fig. 2, fig. 2 is a schematic diagram of a communication network system provided in an embodiment of the present application, where the communication network system is an LTE system of a universal mobile telecommunications technology, and the LTE system includes a User Equipment (UE) 201, an evolved UMTS terrestrial radio access network (Evolved UMTS Terrestrial Radio Access Network, E-UTRAN) 202, an evolved packet core (Evolved Packet Core, EPC) 203, and an IP service 204 of an operator that are sequentially connected in communication.

Alternatively, the user equipment 201 may be the terminal 100 described above, which is not described here again.

The evolved UMTS terrestrial radio access network 202 includes an eNodeB2021 and other enodebs 2022, among others. Alternatively, the eNodeB2021 may connect with other enodebs 2022 through a backhaul (e.g., X2 interface), the eNodeB2021 is connected to the evolved packet core network 203, and the enodebs 2021 may provide access to the evolved packet core network 203 by the user equipment 201.

The evolved packet core 203 may include a mobility management entity (Mobility Management Entity, MME) 2031, a home subscriber server (Home Subscriber Server, HSS) 2032, other mobility management entities 2033, serving Gateway (SGW) 2034, packet data network gateway (PDN gateway, PGW) 2035, and policy and tariff function entity (Policy and Charging Rules Function, PCRF) 2036, etc. Optionally, the mobility management entity 2031 is a control node handling signalling between the user equipment 201 and the evolved packet core 203, providing bearer and connection management. The home subscriber server 2032 is used to provide registers for managing functions such as home location registers (not shown) and to hold user-specific information about service characteristics, data rates, etc. All user data may be sent through the service gateway 2034 and the packet data network gateway 2035 may provide IP address assignment and other functions for the user equipment 201. The policy and tariff function entity 2036 is a policy and charging control policy decision point for traffic data flows and IP bearer resources, which selects and provides available policy and charging control decisions for a policy and charging enforcement function (not shown).

IP services 204 may include the internet, intranets, IMS (IP Multimedia Subsystem ), or other IP services, etc.

Although the LTE system is described above as an example, it should be understood by those skilled in the art that the present application is not limited to LTE systems, but may be applied to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, 5G, and future new network systems (e.g., 6G), etc.

Based on the intelligent terminal hardware structure and the communication network system, various embodiments of the application are provided.

Fig. 3 is a flow diagram illustrating an image processing method according to an embodiment. As shown in fig. 3, the image processing method includes the steps of:

By the method, before the shooting result of the first camera is processed, the target image shot by the first camera and at least one reference image with different acquisition directions from the target image are analyzed, so that the shooting result can be processed in a targeted manner, the processing accuracy is improved, and the processing is more intelligent. Meanwhile, the shooting result of the first camera is processed only when the preset condition is met, and the processing effectiveness is improved.

Optionally, satisfying the first preset condition may include at least one of:

the target image accords with the glare condition, and the difference value of the glare degree of the target image and the reference image is larger than a preset threshold value;

Optionally, the degree of the image (i.e. the glare degree) is analyzed based on the dark channel prior theory, and whether the image meets the glare condition is determined according to the degree of the image. The target image and the reference image can be selected as RGB or NV21 images, the input image is converted into a gray scale image, the histogram is solved, and the degree of the occurrence of the image is analyzed based on dark channel prior theory.

The first preset condition is met to indicate that the first lens has lens glare.

Under a scene, when the target image meets the glare condition and the reference image does not meet the glare condition, the first camera can be judged to have lens glare due to different acquisition directions of the target image and the reference image, the judgment basis is simple, and the method is suitable for a scene with relatively fixed acquisition angles of the target image and the reference image.

Under another scene, the target image accords with the glare condition, the glare degree difference value of the target image and the reference image is larger than the preset threshold, and because the acquisition directions of the target image and the reference image are different, the first camera can be judged that the lens glare exists, and the judgment is more accurate because the lens glare is carried out according to the glare degree difference value, and in the scene with the adjustable acquisition angles of the target image and the reference image, the judgment can be completed without adjusting the angle or adjusting the angle slightly aiming at the scene with the larger relative acquisition angle of the target image and the reference image, so that the judgment efficiency is improved.

In still another scene, the target image and the reference image both accord with the glare condition, and the glare degree difference value of the target image and the reference image meets the second preset condition, because the acquisition directions of the target image and the reference image are different, the first camera can be judged to have lens glare, and because the judgment is continuously carried out according to the glare degree difference value under the condition that the target image and the reference image both accord with the glare condition, the judgment is more accurate, and in the scene with adjustable acquisition angles of the target image and the reference image, the judgment can be completed without adjusting the angle or adjusting the angle slightly, so that the judgment efficiency is improved.

Based on the mode, whether the first camera has lens glare or not can be judged rapidly, response speed is high, user operation and waiting time are reduced, and user experience is improved.

Optionally, meeting the second preset condition may include at least one of:

the included angle between the acquisition direction of the target image and the acquisition direction of the reference image is the target included angle, and the glare degree difference value is increased along with the increase of the target included angle;

Optionally, in the scene that the collection angle of the target image and the reference image can be adjusted, aiming at the scene that the relative collection angle of the target image and the reference image is smaller, the target image and the reference image possibly meet the glare condition at the same time, in this case, by adjusting the collection direction of the target image and/or the reference image, in the process, the analysis of the change trend of the difference value of the glare degree between the target image and the reference image can be completed, so that the judgment of whether the lens is glare can be completed, the judgment can be completed only by adjusting the angle by a small margin, the user operation and waiting time can be reduced, and the use experience of the user can be improved.

Optionally, step S1 may include at least one of:

responding to the first operation, controlling a target image shot by a first camera, and acquiring at least one reference image with a different acquisition direction from the target image according to a first rule;

and acquiring a target image shot by the first camera, and responding to the target image reaching a glare condition, and acquiring at least one reference image with a different acquisition direction from the target image according to a first rule.

Optionally, at least one reference image with a different acquisition direction from the target image can be acquired when the target image is shot by the first camera, so as to determine that the target image and the reference image are in the same shooting scene, or at least one reference image with a different acquisition direction from the target image can be acquired when the target image reaches the glare condition, so that the frequency of acquiring the reference image is reduced, and the energy consumption is reduced.

Optionally, the first rule includes at least one of:

Optionally, for a terminal, such as a flat terminal, in which the first camera and the second camera are arranged in a non-same direction, the target image and the reference image are acquired by the first camera and the second camera, respectively. For the terminal with only the first camera or only the first camera, the first camera can be rotated, including rotation by user operation or rotation by terminal control, so that reference images in different acquisition directions are acquired. The terminal with the first camera and the second camera can keep the first camera motionless and enable the second camera to rotate, and the rotation of the second camera can be operated by a user or controlled by the terminal, so that reference images in different acquisition directions are acquired.

Optionally, the second rule may include at least one of:

shooting reference images at intervals of preset time length;

shooting reference images at intervals of preset rotation angles;

and shooting a reference image when the rotation angle is a preset angle.

Optionally, in the process of rotating the first camera and/or the second camera, the reference images can be shot at intervals of a preset time period, the reference images can be shot at intervals of a preset rotation angle, and the reference images can be shot when the rotation angle is a preset angle, so that the number of the acquired reference images can be reduced, and the energy consumption of the acquired images and the analysis images can be reduced. Optionally, the preset angle is greater than or equal to 90 degrees, so that a large enough acquisition angle difference exists between the target image and the reference image, and the efficiency of detecting the lens glare is improved.

The scene in which the first camera and/or the second camera are rotatable can be applied to a folding screen with cameras. Referring to fig. 4, the first camera 311 is disposed on the first screen 31, the second camera 321 is disposed on the second screen 32, the first screen 31 and the second screen 32 can be mutually folded, when the acquisition direction of the first camera 311 needs to be adjusted, only the terminal needs to be turned or the first screen 31 needs to be folded relative to the second screen 32, and when the acquisition direction of the second camera 321 needs to be adjusted, the position of the first screen 31 is fixed, and the second screen 32 needs to be folded relative to the first screen 31. Thus, at least one reference image with a different acquisition direction from the target image can be acquired through the first camera and/or the second camera.

Optionally, the method further comprises at least one of:

outputting prompt information of the rotating first camera;

and outputting prompt information for rotating the second camera.

Optionally, the prompt information of the rotation camera may be used to prompt the user to rotate the terminal or the corresponding screen. Taking the scenario shown in fig. 4 as an example, when the reference image needs to be acquired by adjusting the direction of the first camera 311, a prompt message for adjusting the folding angle of the first screen 31 relative to the second screen 32 is output, and in the process of adjusting the camera angle, the image acquired by the first camera 311 is acquired. When the reference image is acquired by adjusting the direction of the second camera 321, a prompt message for adjusting the folding angle of the second screen 32 relative to the first screen 31 is output, and the image acquired by the second camera 321 is acquired in the process of adjusting the camera angle.

Optionally, in step S2, the preset process includes at least one of the following:

outputting prompt information of the glare of the first camera;

outputting the photographed image after the glare removal process.

Optionally, when the first camera is judged to have glare, outputting prompt information of the first camera glare. As shown in fig. 5, in a preview screen 51 of the first camera, a presentation message 52 for presenting the first camera glare is output. Alternatively, in the preview screen 51 shown in fig. 5, a photographed image after the glare removal process may be output so that the user can more clearly understand the actual photographed content.

Optionally, when determining the glare of the first camera, outputting a glare removal option, and enabling the user to select according to requirements, where the glare removal option includes at least one option of indicating a degree of glare processing, a number of images for continuously processing the glare, a time for continuously processing the glare, and retaining an original image.

For example, the user likes an atmosphere in which the image is somewhat glare, and may choose to reduce the degree of the glare treatment, for example, in the degree of removal or in the degree of removal to be low.

For another example, the current scene is already judged to be glare, and the glare processing can be performed on images acquired in a plurality of continuous sheets or seconds by default, so that user operation and glare identification operation are reduced.

As another example, the user may choose to preserve the original image without having to glare the currently acquired image.

Optionally, in response to an operation of selecting not to perform glare removal processing on the image acquired by the target camera, the glare removal function of the current shooting is turned off or suspended.

Alternatively, when the shooting scenes are the same or the camera application is running in the foreground this time, it is considered as a shooting process. Thus, user operations and glare recognition operations are reduced.

Optionally, the glare removal processing is performed on the photographed image photographed by the first camera by using the GAN network. Through constructing a lens glare-natural light data set, training the data set by utilizing a GAN network to obtain a glare removal model based on the GAN network, and deploying the trained glare removal model into the existing terminal shooting function. The GAN network uses the U-net framework as a generator to form an image without glare, and uses the classification network as a discriminator to distinguish true and false of the generated image, so that the accuracy of the generator is improved, the function of removing the image glare in a glare scene is realized, the algorithm processing is simple, the adaptability is high, the glare removal can be realized on one side of the terminal, and the user can use the device at any time and any place conveniently.

Optionally, before step S1, at least one of the following may be further included:

judging whether the mobile terminal is in a preset mode, if so, executing the step S1;

judging whether the environment is in a preset environment or not, if so, executing the step S1;

and judging whether the preset time exists, if so, executing the step S1.

Alternatively, the preset mode is, for example, a glare removal mode, the preset environment is, for example, an environment easy to be irradiated with strong light, such as a concert, an outdoor, etc., and the preset time is, for example, a time easy to be irradiated with strong light, such as noon, summer, sunny, etc. Therefore, whether glare is judged under specific conditions can be judged, the intelligent operation is realized, the user operation and the energy consumption are reduced, and the use experience is improved.

As described above, through the technical scheme of the embodiment, the images collected by the camera and the images in different collection directions are analyzed first, and then the shooting result of the camera is processed, so that the accuracy of image processing can be improved, and the system is more intelligent.

The embodiment of the application also provides an intelligent terminal, which comprises: the image processing device comprises a memory and a processor, wherein the memory stores an image processing program, and the image processing program realizes the steps of the image processing method according to any embodiment when being executed by the processor.

The present application also provides a storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the image processing method according to any of the embodiments above.

The embodiments of the intelligent terminal and the storage medium provided in the present application may include all the technical features of any one of the embodiments of the interaction method, and the expansion and explanation contents of the description are substantially the same as those of each embodiment of the method, which are not repeated herein.

The present embodiments also provide a computer program product comprising computer program code which, when run on a computer, causes the computer to perform the method in the various possible implementations as above.

The embodiments also provide a chip including a memory for storing a computer program and a processor for calling and running the computer program from the memory, so that a device on which the chip is mounted performs the method in the above possible embodiments.

It can be understood that the above scenario is merely an example, and does not constitute a limitation on the application scenario of the technical solution provided in the embodiments of the present application, and the technical solution of the present application may also be applied to other scenarios. For example, as one of ordinary skill in the art can know, with the evolution of the system architecture and the appearance of new service scenarios, the technical solutions provided in the embodiments of the present application are equally applicable to similar technical problems.

The foregoing embodiment numbers of the present application are merely for describing, and do not represent advantages or disadvantages of the embodiments.

The steps in the method of the embodiment of the application can be sequentially adjusted, combined and deleted according to actual needs.

The units in the device of the embodiment of the application can be combined, divided and pruned according to actual needs.

In this application, the same or similar term concept, technical solution, and/or application scenario description will generally be described in detail only when first appearing, and when repeated later, for brevity, will not generally be repeated, and when understanding the content of the technical solution of the present application, etc., reference may be made to the previous related detailed description thereof for the same or similar term concept, technical solution, and/or application scenario description, etc., which are not described in detail later.

In this application, the descriptions of the embodiments are focused on, and the details or descriptions of one embodiment may be found in the related descriptions of other embodiments.

The technical features of the technical solutions of the present application may be arbitrarily combined, and for brevity of description, all possible combinations of the technical features in the above embodiments are not described, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the present application.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as above, including several instructions for causing a terminal device (which may be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to perform the method of each embodiment of the present application.

In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions in accordance with embodiments of the present application are produced in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by a wired (e.g., coaxial cable, fiber optic, digital subscriber line), or wireless (e.g., infrared, wireless, microwave, etc.). Computer readable storage media can be any available media that can be accessed by a computer or data storage devices, such as servers, data centers, etc., that contain an integration of one or more available media. Usable media may be magnetic media (e.g., floppy disks, storage disks, magnetic tape), optical media (e.g., DVD), or semiconductor media (e.g., solid State Disk (SSD)), among others.

The foregoing description is only of the preferred embodiments of the present application, and is not intended to limit the scope of the claims, and all equivalent structures or equivalent processes using the descriptions and drawings of the present application, or direct or indirect application in other related technical fields are included in the scope of the claims of the present application.

Claims

1. An image processing method, characterized by comprising the steps of:

2. The method according to claim 1, characterized in that step S1 comprises at least one of the following:

responding to a first operation, controlling a first camera to shoot a target image, and acquiring at least one reference image with a different acquisition direction from the target image according to a first rule;

3. The method of claim 2, wherein the first rule comprises at least one of:

4. A method according to claim 3, wherein the second rule comprises at least one of:

shooting reference images at intervals of preset time length;

shooting reference images at intervals of preset rotation angles;

and shooting a reference image when the rotation angle is a preset angle.

5. A method according to claim 3, further comprising at least one of:

outputting prompt information for rotating the first camera;

and outputting prompt information for rotating the second camera.

6. The method according to any one of claims 1 to 5, wherein the meeting a first preset condition comprises at least one of:

7. The method of claim 6, wherein the meeting a second preset condition comprises at least one of:

8. The method of claim 6, wherein the pre-set process comprises at least one of:

outputting prompt information of the first camera glare;

outputting the photographed image after the glare removal process.

9. An intelligent terminal, characterized by comprising: a memory, a processor, wherein the memory has stored thereon an image processing program which, when executed by the processor, implements the steps of the image processing method according to any one of claims 1 to 8.

10. A storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the image processing method according to any of claims 1 to 8.