WO2020019134A1

WO2020019134A1 - Illumination information optimization method and apparatus, and electronic device

Info

Publication number: WO2020019134A1
Application number: PCT/CN2018/096694
Authority: WO
Inventors: 菲永奥利维尔; 李建亿
Original assignee: 太平洋未来科技（深圳）有限公司
Priority date: 2018-07-23
Filing date: 2018-07-23
Publication date: 2020-01-30
Also published as: CN108965535B; CN108965535A

Abstract

Embodiments of the present invention provide an illumination information optimization method and apparatus, and an electronic device, said method comprising: acquiring a target picture, and decomposing the target picture into a first pre-set number of sub-pictures; acquiring geometric centers of the sub-pictures, determining light intensity weighted centers according to image moments of the sub-pictures, and determining illumination angles of the sub-pictures on the basis of the light intensity weighted centers and the geometric centers of the sub-pictures; performing grayscale processing on the sub-pictures, and obtaining illumination intensities of the sub-pictures according to grayscale values of points on the sub-pictures; acquiring illumination intensity weight values of the sub-pictures, and obtaining an illumination intensity of the target picture according to the illumination intensities of the sub-pictures and the illumination intensity weight values of the sub-pictures; and calculating the illumination angles of the sub-pictures, so as to obtain an illumination angle of the target picture.

Description

Optimization method and device for lighting information and electronic equipment

Technical field

The present invention relates to the field of image processing technology, and in particular, to a method, an apparatus, and an electronic device for optimizing illumination information.

Background technique

Augmented Reality (AR) technology can put the virtual world on the screen and interact with it. Users can perceive the existence of virtual objects by using AR devices. However, in the process of implementing the present invention, the inventors found that in related technologies, it is generally necessary to obtain the environmental information, location, and time of a picture or video in advance, determine the lighting information corresponding to the picture or video through the above information, and then observe the virtual object Rendering of shadow effects. The above method is not only inefficient, but also may cause deviations in the light and shadow effects of the virtual object from the scene due to the inability to accurately obtain the accurate lighting angle and light intensity in the picture or video.

In addition, in order to obtain a virtual object of an AR device that is the same as a real scene, it is often captured directly through a mobile phone camera, and more and more users play AR videos directly through a mobile phone screen. In order to avoid the poor framing effect caused by shaking of the handheld device, or the inconvenience caused by the user holding the mobile phone for a long time to watch the video, it is often necessary to install the mobile phone on the stand to maintain stability. Ordinary users often use the simple stand of the mobile phone to achieve the required Framing effect and stable support effect, and the usual simple bracket is located on the protective case of the mobile phone, or pasted on the back of the mobile phone by strong adhesive. More and more users are because of the increasingly strong glass of the mobile phone, the heat dissipation problem of the mobile phone, and the aesthetics of the mobile phone. Reluctant to use mobile phone case and adhesive simple bracket.

Summary of the Invention

The method, device, and electronic device for optimizing illumination information provided by the embodiments of the present invention are used to solve at least the foregoing problems in related technologies.

One aspect of the embodiments of the present invention provides a method for optimizing illumination information, including:

Obtaining a target picture, and decomposing the target picture into a first preset number of sub-pictures; wherein the sub-picture is composed of a second preset number of pixels; obtaining a geometric center of the sub-picture according to the sub-picture The image moment determines the light intensity weighting center, and determines the illumination angle of the sub-picture based on the light intensity weighting center and the geometric center of the sub-picture; performing gray-scale processing on the sub-picture, according to each of the sub-pictures The gray value of the point is used to obtain the light intensity of the sub-picture; the light intensity weight value corresponding to the sub-picture is obtained, and the target is obtained according to the light intensity of the sub-picture and the light intensity weight value corresponding to the sub-picture The light intensity of the picture; calculating the light angle of the sub-picture to obtain the light angle of the target picture.

Further, performing the grayscale processing on the sub-picture, and obtaining the light intensity of the sub-picture according to the gray-scale value of each point on the sub-picture includes: performing gray-scale processing on the sub-picture, so that Each point on the sub-picture retains only a gray value of 0-255; the gray values of the points on the sub-picture are input into a pre-trained light intensity model to obtain the light intensity of the sub-picture.

Further, obtaining the light intensity value corresponding to the sub-picture includes: obtaining position coordinates of the sub-picture in the target picture; determining the position according to the position coordinates of the sub-picture and the size of the sub-picture The light intensity weight value corresponding to the sub-picture.

Further, calculating the illumination angle of each of the sub-pictures to obtain the illumination angle corresponding to the target picture includes: determining whether the size of the sub-picture is smaller than a preset threshold; The vectors of the illumination angles of the sub-pictures are summed to obtain the illumination angle of the target picture.

Further, calculating the lighting angle of each of the sub-pictures to obtain the lighting angle corresponding to the target picture includes: determining a lighting angle weight value corresponding to each of the sub-pictures; The vector of the illumination angle of each sub-picture is weighted and summed to calculate the illumination angle of the target picture.

Another aspect of the embodiments of the present invention provides an apparatus for optimizing illumination information, including:

An obtaining module is used to obtain a target picture and decompose the target picture into a first preset number of sub-pictures; wherein the sub-picture is composed of a second preset number of pixels; a determining module is used to obtain the sub-pictures A geometric center of the picture, determining a light intensity weighting center according to the image moment of the sub-picture, and determining an illumination angle of the sub-picture based on the light intensity weighting center and the geometric center of the sub-picture; a processing module for The sub-picture is subjected to gray-scale processing, and the light intensity of the sub-picture is obtained according to the gray value of each point on the sub-picture; a first calculation module is configured to obtain a light-intensity weight value corresponding to the sub-picture, and The light intensity of the sub-picture and the light intensity weight value corresponding to the sub-picture are used to obtain the light intensity of the target picture; a second calculation module is configured to calculate the light angle of the sub-picture to obtain the target picture Light angle.

Further, the processing module is specifically configured to perform grayscale processing on the sub-picture, so that each point on the sub-picture retains only a gray value of 0-255; and gray-scale each point on the sub-picture. The degree value is input into a pre-trained light intensity model to obtain the light intensity of the sub-picture.

Further, the first calculation module includes: an obtaining unit for obtaining position coordinates of the sub-picture in the target picture; and a determining unit for obtaining position coordinates of the sub-picture and a position of the sub-picture The size determines a light intensity weight value corresponding to the sub-picture.

Further, the first calculation module further includes: a judging unit for judging whether the size of the sub-picture is smaller than a preset threshold; and a summing unit for judging the sub-pictures if the sub-picture is smaller than the preset threshold. The vectors of the illumination angles are summed to obtain the illumination angle of the target picture.

Further, the second calculation module is further configured to determine a lighting angle weight value corresponding to each of the sub-pictures; perform weighted summation on a vector of lighting angles of each of the sub-pictures according to the lighting angle weight value, and calculate Obtain the illumination angle of the target picture.

Another aspect of the embodiments of the present invention provides an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores a memory that can be used by the at least one processor An executed instruction, where the instruction is executed by the at least one processor, so that the at least one processor can execute the foregoing optimization method of lighting information.

Further, the electronic device is a mobile phone, and the obtaining of the target picture in the method for optimizing the illumination information is performed by the mobile phone. The mobile phone includes a front panel with a display screen and a mobile phone back cover; a middle and lower part of the mobile phone back cover is provided with a recessed area, and a support plate adapted to the shape and size of the recessed area is installed in the recessed area; The upper end of the support plate is hinged with the recessed area, so that the support plate can be rotated to a predetermined angle with the back cover of the mobile phone; a lower end of the support plate is provided with a connecting piece, and one end of the connecting piece and The support plate is soft-connected, and the other end is provided with a plugging portion adapted to the shape and size of the mobile phone charging interface, and the plugging portion is mated with the mobile phone charging interface;

Further, the support plate includes a first plate body, a second plate body, a first connection plate, a second connection plate, and a link, the first plate body, the first connection plate, the second connection plate, and the second The plates are sequentially connected to form a plate; the first plate has opposite first and second ends, the second plate has opposite third and fourth ends, and the link includes a first A rod body and a second rod body, opposite ends of the first rod body are hinged to the first end and the third end, respectively, and opposite ends of the second rod body are respectively connected to the second end and the fourth end End-to-phase hinge, wherein the first rod body and the second rod body are both disposed on a side of the support plate away from the front panel; the first connection plate and the second connection plate are located on the first Between the plate body and the second plate body, one side of the first connection plate is hinged to one side of the first plate body, and one side of the second connection plate is opposite to one side of the second plate body. Hinged, the other side of the first connection plate is hinged with the other side of the second connection plate, the first connection plate and the second connection plate The first plate is provided on a side of the support plate close to the front plate; the first plate is provided with a first portion disposed along a thickness direction of the first plate, and the first portion is located at a hinge between the first plate and the link. And between the first plate body and the hinge of the first connecting plate; the second plate body is provided with a second portion provided along its thickness direction, and the second portion is located on the second plate Between the hinge between the body and the connecting rod and the hinge between the second plate and the second connecting plate; the first portion, the second portion, the first connecting plate, the second connecting plate, and the connecting rod form five Rod body mechanism.

Further, the recessed area includes a bottom wall and a side wall, and the bottom wall and / or the side wall is provided with a ventilation structure, and the ventilation structure is a plurality of ventilation holes or ventilation grilles.

Further, the connecting member is made of rubber.

Further, each of the first end, the second end, the third end, and the fourth end is provided with a recessed portion, and opposite ends of the first rod body are respectively disposed in the recessed portion of the first end and the first end. In the recessed portion at the three ends, the opposite ends of the second rod body are respectively placed in the recessed portion of the third end and the recessed portion of the fourth end.

It can be seen from the above technical solutions that the method, device, and electronic device for optimizing illumination information provided by the embodiments of the present invention obtain the entire light intensity and angle of the sub-picture, and calculate the light intensity and angle of each sub-picture to obtain the entire The lighting information of the picture, and the rendering of the light and shadow effects on the virtual object according to this, so that the virtual object can match its scene environment. In addition, the mobile phone with a support plate provided in the method for optimizing the lighting information provided by the embodiments of the present invention can make the mobile phone shoot and play more smoothly. The mobile phone does not need a protective case and a sticking part, and has a more beautiful appearance, which improves the lighting. The quality of the target picture in the information optimization method can be used separately from the above method.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly explain the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are merely These are some of the embodiments described in the embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained according to these drawings.

FIG. 1 is a flowchart of a method for optimizing illumination information according to an embodiment of the present invention; FIG.

FIG. 2 is a light intensity weighted center and a weighted center coordinate position map of a sub-picture provided by an embodiment of the present invention; FIG.

3 is a specific flowchart of step S104 provided by an embodiment of the present invention;

4 is a structural diagram of an apparatus for optimizing illumination information according to an embodiment of the present invention;

5 is a structural diagram of an apparatus for optimizing illumination information according to an embodiment of the present invention;

6 is a schematic diagram of a hardware structure of an electronic device that executes a method for optimizing illumination information provided by a method embodiment of the present invention;

7 is a schematic structural diagram of a mobile phone that obtains a target picture in a method for optimizing illumination information according to an embodiment of the present invention;

8 is an exploded view of a mobile phone support plate for obtaining a target picture in a method for optimizing illumination information according to an embodiment of the present invention;

FIG. 9 is a schematic diagram of a mobile phone support plate in a supported state for obtaining a target picture in a method for optimizing illumination information according to an embodiment of the present invention; FIG.

10 is an enlarged view of part A of FIG. 9;

11 is an enlarged view of a portion B of FIG. 9;

FIG. 12 is a schematic diagram of a mobile phone support plate that obtains a target picture in a method for optimizing lighting information according to an embodiment of the present invention in a folded state.

detailed description

In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described The embodiments are only a part of the embodiments of the present invention, but not all the embodiments. Based on the embodiments in the embodiments of the present invention, all other embodiments obtained by those skilled in the art should belong to the protection scope of the embodiments of the present invention.

Hereinafter, some embodiments of the present invention will be described in detail with reference to the drawings. In the case of no conflict, the following embodiments and features in the embodiments can be combined with each other. FIG. 1 is a flowchart of a method for optimizing illumination information according to an embodiment of the present invention. As shown in FIG. 1, a method for optimizing illumination information provided by an embodiment of the present invention includes:

S101. Obtain a target picture, and decompose the target picture into a first preset number of sub-pictures.

Specifically, the lighting information includes lighting intensity and lighting angle. In the embodiment of the present invention, the target picture is decomposed to calculate the lighting intensity and lighting angle of the target picture, respectively, to obtain the overall lighting information of the target picture. The target picture may be a certain frame in the video or a single picture frame captured from the camera, which is not limited in the present invention. The acquisition timing may be based on a user's operation instruction, or when the scene of the video meets a preset requirement or condition.

In this step, after obtaining the target picture, the target picture is decomposed into a first preset number of small square grid elements composed of a preset size, and each small square grid element is used as a sub-picture, where The sub-picture is composed of a second preset number of pixels. For example, the target picture can be decomposed into C columns and R rows (where C and R are integers, and C≥2, R≥2) to obtain multiple sub-pictures, each of which consists of p pixels.

As an optional implementation manner of this embodiment, since the lighting information does not involve color problems, for a color picture, before performing decomposition, the target picture can be extracted with grayscale, and the influence of the color on the light intensity acquisition can also be avoided.

S102: Obtain a geometric center of the sub-picture, determine a light intensity weighting center according to the image moment of the sub-picture, and determine an illumination angle of the sub-picture based on the light intensity weighting center and the geometric center of the sub-picture.

For the sub-pictures in the first preset range, the image moment of each sub-picture needs to be calculated to determine the corresponding light intensity weighting center. An image moment is a set of moments calculated from digital graphics. It usually describes the global features of the image and provides a lot of information about the different types of geometric features of the image, such as size, position, direction, and shape. For example: First-order moments are related to shape; second-order moments show the degree of expansion of a curve around a straight line average; third-order moments are a measure of the symmetry of the mean; second- and third-order moments can be used to derive a set of seven Moment invariant and invariant moment are the statistical characteristics of the image, which meet the invariant invariance of translation, expansion and rotation. In image processing, geometric invariant moment can be used as an important feature to represent an object. Classify images. The above-mentioned first, second, third and third moments and the seven invariant moments derived from the second and third moments all have specific calculation formulas. According to these formulas, determining the light intensity weighting center belongs to common technical knowledge in the field. The present invention will not repeat them here.

As shown in FIG. 2, the light intensity weighting center g is determined by the image moment, and its coordinate position in the sub-image is (x _g , y _g ).

As shown in FIG. 2, determining the coordinate position (x _c , y _c ) of the geometric center c in the sub-picture, and comparing the coordinate position of the geometric center c with the coordinate position of the light intensity weighted center g determined in step S102. Vector from geometric center c to weighted center g

The direction of is the result of being affected by light, which provides us with a local light effect indication of the target picture location where the sub-picture is located. Specifically, vectors

Represents the direction of the light, and d represents the modulus of the vector cg

α represents the lighting angle of the sub-picture. Since tanα = (y _g -y _c ) / (x _g -x _c ), then α = Arctan ((y _g -y _c ) / (x _g -x _c )), that is, The illumination angle of the sub-picture is calculated by the coordinates of the geometric center and the weighted center.

As an optional implementation of this embodiment, after determining the lighting angle of each sub-picture, it can be determined whether the lighting of the sub-picture comes from the ground according to the lighting angle vector of the sub-picture. If the lighting angle of the sub-picture comes from the ground , Indicating that the lighting does not belong to the current scene, the sub-picture is deleted.

S103. Perform grayscale processing on the sub-picture, and obtain a light intensity of the sub-picture according to a gray-scale value of each point on the sub-picture.

Because the light angle and light intensity are relatively less related to the color saturation and color gamut information of the pixels in the sub-pictures, and in order to improve the subsequent processing efficiency, we perform gray-scale processing on each sub-picture so that each sub-picture Each pixel in the picture only retains a gray value of 0-255.

Before performing this step, you can prepare a data sample set and train a light intensity model. The data sample set is composed of several pictures, and each picture carries the gray value of each pixel on the picture and the light intensity corresponding to the picture. In the training process, the gray value of each pixel on each picture is used as the input value of the model, and the output value of the model is compared with the corresponding light intensity of the picture to continuously optimize the model.

In this step, the gray value of each point on the sub-picture is input into a pre-trained light intensity model, and the light intensity model obtains the light intensity of the sub-picture by analyzing and processing the gray value of each point of the sub-picture. .

S104. Obtain a light intensity weight value corresponding to the sub-picture, and obtain the light intensity of the target picture according to the light intensity of the sub-picture and the light intensity weight value corresponding to the sub-picture.

Specifically, the light intensity weight value corresponding to the sub-picture can be obtained through the following sub-steps.

S1041: Obtain position coordinates of the sub-picture in the target picture.

For each sub-picture, determine its coordinate position (x _i , y _i ) in the target picture, where i is the sequence number of the sub-picture in the target picture, for example, the first preset number of sub-pictures is n, You can number n sub-pictures from 1 to n, i≤n. Since the sub-picture is composed of several pixels, it is necessary to select a pixel that can best represent the light intensity of the sub-picture, and use the coordinates of the point as the coordinate position of the sub-picture. Optionally, in step S103, when the light intensity model outputs the light intensity of the sub-picture, it may simultaneously output the coordinates of the pixel point corresponding to the gray value closest to the light intensity.

S1042. Determine a light intensity weight value corresponding to the sub-picture according to a position coordinate of the sub-picture and a size of the sub-picture.

Specifically, the light intensity weight value corresponding to each sub-picture can be calculated by the following formula.

F _i = F (x _i ) * F (y _i ),

Wherein, Fi is the weight value of the light intensity, S _i is the length of the sub picture.

According to the above formula, the light intensity weight value corresponding to each sub-picture can be calculated.

After obtaining the light intensity weight value corresponding to each sub-picture, the light intensity of the target picture can be calculated by the following formula.

Wherein, L is the light intensity of the target picture, and L _i is the light intensity of each sub-picture obtained in step S103.

S105. Calculate the illumination angle of the sub-picture to obtain the illumination angle of the target picture.

Specifically, the illumination angle can be obtained as follows. Determining a lighting angle weight value corresponding to each of the sub-pictures; weighting and summing a vector of lighting angles of each of the sub-pictures according to the lighting angle weight value to calculate a lighting angle of the target picture.

Specifically, a weight value corresponding to each sub-picture may be determined according to a vector module of a lighting angle corresponding to each sub-picture, and / or a lighting angle, and / or previous experience.

Optionally, first, a confidence factor may be calculated according to a weight value corresponding to each sub-picture and a vector of an illumination angle corresponding to each sub-picture, and when the confidence factor is less than a preset value, the above-mentioned weight value is adjusted. Specifically, the confidence factor is a ratio of a vector sum of the illumination angle and a sum of the weight values. The confidence factor can indicate whether the weight value matches the trend of the vector. The closer the confidence factor is to 1, this indicates that the weight value The more appropriate. When the confidence factor is less than the preset value, it means that the determined weight value is inappropriate. At this time, the weight value needs to be adjusted. After the adjustment, a new confidence factor is calculated and tested according to the above method until the new confidence factor can be greater than the preset threshold. .

Secondly, the length of the vector of the lighting angle of each sub-picture is determined according to the weight value, and then the vectors determined by each length are added to obtain the vector of the lighting angle corresponding to the target picture, and the vector of the lighting angle corresponding to the target picture , To obtain the illumination angle corresponding to the target picture according to the method described in step S102.

As another optional implementation of the embodiment of the present invention, when the size of the sub-picture is sufficiently small, it can be considered that the weight values corresponding to the sub-pictures are the same, which improves the efficiency of the optimization of the illumination angle. Specifically, it is determined whether the size of each sub-picture is smaller than a preset threshold. If it is smaller than the preset threshold, the weight value corresponding to each sub-picture need not be considered, and the vector of the illumination angle of each sub-picture is directly added to obtain the The lighting angle of the target picture. Optionally, the obtained lighting angle can be statistically corrected to obtain a more accurate lighting angle.

The method for optimizing the illumination information provided by the embodiment of the present invention obtains the illumination information of the entire picture by obtaining the illumination intensity and illumination angle of the sub-picture, and calculating the illumination intensity and illumination angle of each sub-picture respectively, and the virtual object is obtained accordingly. Render light and shadow effects so that virtual objects can match their scene environment.

FIG. 4 is a structural diagram of an apparatus for optimizing illumination information according to an embodiment of the present invention. As shown in FIG. 4, the device specifically includes: an acquisition module 100, a determination module 200, a processing module 300, a first calculation module 400 and a second calculation module 500. among them,

The obtaining module 100 is configured to obtain a target picture and decompose the target picture into a first preset number of sub-pictures; wherein the sub-picture is composed of a second preset number of pixels; a determining module 200 is configured to obtain all The geometric center of the sub-picture is determined according to the image moment of the sub-picture. The light-weighted center is determined based on the light-intensity weighted center and the geometric center of the sub-picture. The illumination angle of the sub-picture is determined. The processing module 300 uses Performing grayscale processing on the sub-picture, and obtaining the light intensity of the sub-picture according to the gray value of each point on the sub-picture; a first calculation module 400, configured to obtain a light intensity weight corresponding to the sub-picture Value to obtain the light intensity of the target picture according to the light intensity of the sub-picture and the light intensity weight value corresponding to the sub-picture; a second calculation module 500 is configured to calculate the light angle of the sub-picture, Obtain the illumination angle of the target picture.

The apparatus for optimizing the illumination information provided by the embodiment of the present invention is specifically configured to execute the method provided by the embodiment shown in FIG. 1 and FIG. 2, and its implementation principles, methods, and functional uses are similar to the embodiments shown in FIG. 1 and FIG. 2. , Will not repeat them here.

FIG. 5 is a structural diagram of an apparatus for optimizing illumination information according to an embodiment of the present invention. As shown in FIG. 5, the device specifically includes: an acquisition module 100, a determination module 200, a processing module 300, a first calculation module 400, and a second calculation module 500. among them,

The obtaining module 100 is configured to obtain a target picture and decompose the target picture into a first preset number of sub-pictures; wherein the sub-picture is composed of a second preset number of pixels; a determining module 200 is configured to obtain all The geometric center of the sub-picture is determined according to the image moment of the sub-picture, and the light-weighted center is determined based on the light-weighted center and the geometric center of the sub-picture. The illumination angle of the sub-picture is determined. The processing module 300 uses Performing grayscale processing on the sub-picture, and obtaining the light intensity of the sub-picture according to the gray value of each point on the sub-picture; a first calculation module 400, configured to obtain a light intensity weight corresponding to the sub-picture Value to obtain the light intensity of the target picture according to the light intensity of the sub-picture and the light intensity weight value corresponding to the sub-picture; a second calculation module 500 is configured to calculate the light angle of the sub-picture, Obtain the illumination angle of the target picture.

Further, the processing module 300 is specifically configured to perform grayscale processing on the sub-picture, so that each point on the sub-picture retains only a gray-scale value of 0-255; The value is input into a pre-trained light intensity model to obtain the light intensity of the sub-picture.

Further, the first calculation module 400 includes: an obtaining unit 410 and a determining unit 42. among them,

The obtaining unit 410 is configured to obtain position coordinates of the sub-picture in the target picture; and the determining unit 420 is used to determine the lighting corresponding to the sub-picture according to the position coordinates of the sub-picture and the size of the sub-picture Strength weight value.

Further, the first calculation module 400 further includes: a determining unit 430 and a summing unit 440. among them,

A judging unit 430 is configured to determine whether the size of the sub-picture is smaller than a preset threshold; and a summing unit 440 is configured to sum the vectors of the illumination angles of the sub-pictures if the sub-picture is smaller than the preset threshold to obtain the The lighting angle of the target picture.

Further, the second calculation module 500 is further configured to determine a lighting angle weight value corresponding to each of the sub-pictures; and perform weighted summation on a vector of lighting angles of each of the sub-pictures according to the lighting angle weight value to obtain a calculation The illumination angle of the target picture.

The apparatus for optimizing the illumination information provided by the embodiment of the present invention is specifically configured to execute the method provided by the embodiment shown in FIG. 1 to FIG. 3, and its implementation principles, methods, and functional uses are similar to the embodiment shown in FIG. 1-3, I will not repeat them here.

The above-mentioned apparatus for optimizing illumination information in the embodiments of the present invention may be used as one of the software or hardware functional units, which may be independently provided in the above-mentioned electronic device, or may be used as one of the functional modules integrated in the processor to execute the embodiments of the present invention. Optimization method of lighting information.

FIG. 6 is a schematic diagram of a hardware structure of an electronic device that executes a method for optimizing illumination information provided by a method embodiment of the present invention. According to FIG. 6, the electronic device includes:

One or more processors 610 and a memory 620. One processor 610 is taken as an example in FIG. 6. The device for performing the method for optimizing the illumination information may further include an input device 630 and an output device 630.

The processor 610, the memory 620, the input device 630, and the output device 640 may be connected through a bus or other methods. In FIG. 6, the connection through the bus is taken as an example.

The memory 620 is a non-volatile computer-readable storage medium, and can be used to store non-volatile software programs, non-volatile computer executable programs, and modules, such as the method for optimizing illumination information in the embodiment of the present invention. Corresponding program instructions / modules. The processor 610 executes various functional applications and data processing of the server by running non-volatile software programs, instructions, and modules stored in the memory 620, that is, an optimization method for implementing the illumination information.

The memory 620 may include a storage program area and a storage data area, where the storage program area may store an operating system and an application program required for at least one function; the storage data area may store the use of an optimization device for lighting information provided according to an embodiment of the present invention Data created, etc. In addition, the memory 620 may include a high-speed random access memory 620, and may further include a non-volatile memory 620, such as at least one magnetic disk memory 620, a flash memory device, or other non-volatile solid-state memory 620. In some embodiments, the memory 620 may optionally include a memory 620 remotely set relative to the processor 66, and these remote memories 620 may be connected to the optimization device of the lighting information through a network. Examples of the above network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

The input device 630 may receive inputted numeric or character information, and generate key signal inputs related to user settings and function control of the optimized device for lighting information. The input device 630 may include a device such as a pressing module.

The one or more modules are stored in the memory 620, and when executed by the one or more processors 610, perform an optimization method of the illumination information.

The electronic devices in the embodiments of the present invention exist in various forms, including but not limited to:

(1) Mobile communication equipment: This type of equipment is characterized by mobile communication functions, and its main goal is to provide voice and data communication. Such terminals include: smart phones (such as iPhone), multimedia phones, feature phones, and low-end phones.

(2) Ultra-mobile personal computer equipment: This type of equipment belongs to the category of personal computers, has computing and processing functions, and generally has the characteristics of mobile Internet access. Such terminals include: PDA, MID and UMPC devices, such as iPad.

(3) Portable entertainment equipment: This type of equipment can display and play multimedia content. Such devices include: audio and video players (such as iPod), handheld game consoles, e-books, as well as smart toys and portable car navigation devices.

(4) The server.

(5) Other electronic devices with data interaction function.

Specifically, the electronic device in this embodiment may be a mobile phone with a support structure. Referring to FIGS. 7-12, the mobile phone may be used to obtain a target picture in the method for optimizing illumination information in the foregoing embodiment. The mobile phone is provided with a support plate on the back cover, which can make the mobile phone support stably, and is stable enough when acquiring target images and videos, thereby obtaining high-quality target pictures, and laying a foundation for subsequent processing of the target pictures. At the same time, the mobile phone's built-in support plate prevents the user from using a mobile phone case with a stand and an externally sticky stand, which facilitates the heat dissipation of the mobile phone, improves the aesthetics, and solves the fatigue caused by the user holding the mobile phone for a long time.

As shown in FIG. 7, the mobile phone includes a front panel with a display screen (not shown in the figure) and a mobile phone back cover 1000; a middle and lower part of the mobile phone back cover 1000 is provided with a recessed area 1100, and the recessed area 1100 is inside A support plate 2000 adapted to the shape and size of the recessed area 1100 is installed; the upper end of the support plate 2000 is hinged to the recessed area 1100 so that the support plate 2000 can be rotated to the mobile phone back cover 1000 is a preset angle. Specifically, the upper end of the support plate 2000 in this embodiment may have a rotating shaft, and the upper end of the recessed portion has a shaft hole adapted to the rotating shaft. The cooperation between the rotating shaft and the shaft hole is used to realize the support plate 2000. It can be rotated, of course, other rotating mechanisms with simpler structures are also within the optional range of this embodiment.

In addition, in order to realize the detachable connection between the lower end of the support plate 2000 and the mobile phone, in this embodiment, a connection piece 3000 is provided at the lower end of the support plate 2000. One end of the connection piece 3000 is soft-connected to the support plate 2000, and the other end has A plugging portion 310 adapted to the shape and size of the mobile phone charging interface 4000. The plugging portion 310 is mated with the mobile phone charging interface 4000. This structure not only realizes the detachable connection between the lower end of the support plate 2000 and the mobile phone, but also It can also protect the charging interface 4000 and improve the functionality of the support plate 2000. Specifically, the connecting member 3000 in this embodiment is made of rubber. The use of rubber not only has good deformation ability, but also has low cost and is easy to implement.

In this embodiment, a rotatable support plate is provided in the recessed area of the back cover of the mobile phone, which can support the mobile phone side by side to meet the user's requirements. There is no need to set a mobile phone case on the mobile phone, which prevents the mobile phone case from affecting the mobile phone The effect of heat dissipation. The lower end of the support plate is fixed by connecting with the charging interface of the mobile phone, and it can also protect the charging interface and improve the functionality of the support plate. In addition, the expansion of the support plate in this embodiment is also very convenient. It only needs to be pulled out from the charging port of the mobile phone.

In addition, the existing support plate cannot play the role of fixing the mobile phone. Therefore, the inventor made further improvements to the above-mentioned support plate structure.

As shown in FIGS. 8-12, the support plate 2000 in this embodiment specifically includes a first plate body 2100, a second plate body 2200, a first connection plate 2300, a second connection plate 2400, and a connecting rod 2500. The first plate body 2100, the first connection plate 2300, the second connection plate 2400, and the second plate body 2200 are sequentially connected to form a plate body. The first plate body 2100 has opposite first ends and second ends (i.e., FIG. (The upper and lower ends shown), the second plate body 2200 has opposite third and fourth ends (ie, the upper and lower ends in the figure), and the link 2500 includes a first rod body 2510 and a second rod body 2520, opposite ends of the first rod body 2510 are hinged to the first end and the third end, respectively, and opposite ends of the second rod body 2520 are respectively connected to the second end and the fourth end Phase articulation, wherein the first rod body 2510 and the second rod body 2520 are both disposed on a side of the support plate away from the front panel.

It should be noted that the number of the connecting rods 2500 in this embodiment may also be one, and two ends of one connecting rod 2500 are respectively connected to the first and second ends, or two ends of one connecting rod 2500 are respectively connected to the first and second ends. The three ends are connected to the fourth end, or one end of a link 2500 is connected to the middle of one side of the first plate 2100, and the other end is connected to the middle of one side of the second plate 2200. At this time, the first connection The plate 2300 and the second connection plate 2400 are separate structures, that is, the first connection plate 2300 and the second connection plate 2400 are each composed of two plate-shaped members. Above a link 2500 is the first connection plate 2300 and the second connection One plate-like member of the plate 2400, and below the link 2500 is another plate-like member of the first connection plate 2300 and the second connection plate 2400.

Specifically, the first connection plate 2300 and the second connection plate 2400 in this embodiment are located between the first plate body 2100 and the second plate body 2200, and one side of the first connection plate 2300 One side of the first plate body 2100 is hinged, one side of the second connection plate 2400 is hinged with one side of the second plate body 2200, and the other side of the first connection plate 2300 is connected to the second plate The other side of the connection plate 2400 is hinged, wherein the first connection plate 2300 and the second connection plate 2400 are disposed on a side of the support plate 2000 near the front panel.

As shown in FIGS. 9-11, the first plate body 2100 in this embodiment is provided with a first portion 2110 disposed along a thickness direction thereof, and the first portion 2110 is located in the first plate body 2100 and the connecting rod 2500. Between the hinge portion of the first plate body 2100 and the hinge portion of the first connection plate 2300; the second plate body 2200 is provided with a second portion 2210 disposed along the thickness direction of the second plate body 2200, and the second portion 2210 is located between the hinge between the second plate body 2200 and the connecting rod 2500 and the hinge between the second plate body 2200 and the second connecting plate 2400; the first portion 2110, the second portion 2210, the first portion A connecting plate 2300, a second connecting plate 2400, and a connecting rod 2500 form a five-bar mechanism.

The above structure forms a five-bar mechanism through the first portion 2110, the second portion 2210, the first connection plate 2300, the second connection plate 2400, and the connecting rod 2500. When support is needed, the entire support plate 2000 structure is rotated to a certain angle. The first rod body 2510 and the second rod body 2520 are both disposed on a side of the support plate 2000 away from the front panel, and the first connection plate 2300 and the second connection plate 2400 are disposed on a side of the support plate 2000 near the front panel. When the support surface of the support plate 2000 gives a force away from the front panel, the five-link 2500 mechanism is at the first dead point position. The first plate 2100 and the first plate 2100, the first connection plate 2300, and the second connection The plate 2400 cannot be rotated, and the dead point position can only be opened by an external force near the front panel, which can ensure that the support plate 2000 is always a plate structure, which provides a stable support for the mobile phone. When the external force is used to open the dead point position, the first connecting plate and the second plate 2200 can be folded. At this time, the first connecting plate 2300 and the first connecting plate 2300 are rotated to the second dead point and the first connecting plate 2300. The second connecting plate 2400 can form a finger receiving portion for inserting a finger into the finger receiving portion, and can fix the mobile phone on a human hand to prevent the user from being crowded and colliding during use, causing the mobile phone to fall. The support plate 2000 not only plays a supporting role, but also plays a role of fixing the mobile phone, which greatly improves its functionality.

It should be noted that the implementation of the "phase articulation" between the two components described above may be provided with a shaft hole in one component, and a rotation shaft, a rotation shaft and a shaft hole matched with the shaft hole in the other component. Together, they form a rotating mechanism so that the two components can rotate relative to each other.

Advantageously, the material of the first connection plate 2300 and the second connection plate 2400 can be selected to have a certain deformability, such as soft plastic. When the first connection plate 2300 and the second connection plate 2400 form a finger receiving portion, , Inserting fingers into it can improve comfort.

In combination with FIG. 8, the first end, the second end, the third end, and the fourth end of the embodiment are each provided with a recess 2600, and the opposite ends of the first rod body 2510 are respectively disposed in the recesses. Within the recessed portion 2600 of the first end and the recessed portion 2600 of the third end, opposite ends of the second rod body 2520 are respectively placed in the recessed portion 2600 of the third end and the recessed portion 2600 of the fourth end.

In the above structure, the connecting rod 2500 mechanism is provided in the board body through the recessed portion, so that the connecting rod 2500 mechanism, the board body, and the connecting plate together form a board body structure, which improves the integrity of the entire supporting plate 2000 and facilitates the installation of the supporting plate 2000.

More advantageously, this embodiment further improves the structure of the recessed area 1100. The recessed area 1100 specifically includes a bottom wall and a side wall. The bottom wall is provided with a ventilation structure 1110, and the ventilation structure 1110 may be a plurality of The ventilation hole and the ventilation structure 1110 may be provided with a ventilation grille on the bottom wall. The design of the ventilation holes and the ventilation grille can enhance the heat dissipation effect of the mobile phone when the support plate 2000 is in a supported state or a folded state, thereby extending the service life of the mobile phone.

The device embodiments described above are only schematic, and the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, which may be located in One place, or can be distributed to multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the objective of the solution of this embodiment. Those of ordinary skill in the art can understand and implement without creative labor.

An embodiment of the present invention provides a non-transitory computer-readable storage storage medium, where the computer storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by an electronic device, the electronic device is caused The method for optimizing illumination information in any of the foregoing method embodiments is performed on the above.

An embodiment of the present invention provides a computer program product, wherein the computer program product includes a computer program stored on a non-transitory computer-readable storage medium, the computer program includes program instructions, and when the program instructions When executed by an electronic device, the electronic device is caused to execute the method for optimizing illumination information in any of the foregoing method embodiments.

Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary universal hardware platform, and of course, also by hardware. Based on such an understanding, the above-mentioned technical solution in essence or a part that contributes to the existing technology may be embodied in the form of a software product, and the computer software product may be stored in a computer-readable storage medium, the computer-readable record A medium includes any mechanism for storing or transmitting information in a form readable by a computer (eg, a computer). For example, machine-readable media include read-only memory (ROM), random-access memory (RAM), magnetic disk storage media, optical storage media, flash storage media, electrical, optical, acoustic, or other forms of propagation signals (e.g., carrier waves , Infrared signals, digital signals, etc.), the computer software product includes a number of instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute various embodiments or certain parts of the embodiments Methods.

In the end, it should be noted that the above embodiments are only used to illustrate the technical solutions of the embodiments of the present invention, rather than limiting them. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: The technical solutions described in the foregoing embodiments can still be modified, or some of the technical features are equivalently replaced; and these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and range.

Claims

A method for optimizing lighting information includes:

Obtaining a target picture, and decomposing the target picture into a first preset number of sub-pictures; wherein the sub-pictures are composed of a second preset number of pixels;

Obtaining a geometric center of the sub-picture, determining a light intensity weighting center according to the image moment of the sub-picture, and determining an illumination angle of the sub-picture based on the light intensity weighting center and the geometric center of the sub-picture;

Performing grayscale processing on the sub-picture, and obtaining the light intensity of the sub-picture according to the gray-scale value of each point on the sub-picture;

Obtaining a light intensity weight value corresponding to the sub-picture, and obtaining the light intensity of the target picture according to the light intensity of the sub-picture and the light intensity weight value corresponding to the sub-picture;

Calculate the illumination angle of the sub-picture to obtain the illumination angle of the target picture.
The method according to claim 1, wherein the step of performing grayscale processing on the sub-picture and obtaining the light intensity of the sub-picture according to the gray-scale value of each point on the sub-picture comprises:

Performing grayscale processing on the sub-picture, so that each point on the sub-picture retains only a gray-scale value of 0-255;

The gray value of each point on the sub-picture is input into a pre-trained light intensity model to obtain the light intensity of the sub-picture.
The method according to claim 2, wherein the obtaining the light intensity value corresponding to the sub-picture comprises:

Obtaining position coordinates of the sub-picture in the target picture;

A light intensity weight value corresponding to the sub-picture is determined according to a position coordinate of the sub-picture and a size of the sub-picture.
The method according to any one of claims 1 to 3, wherein the calculating an illumination angle of each of the sub-pictures to obtain an illumination angle corresponding to the target picture includes:

Determining whether the size of the sub-picture is smaller than a preset threshold;

If it is less than a preset threshold, the vectors of the illumination angles of the sub-pictures are summed to obtain the illumination angle of the target picture.
The method according to any one of claims 1 to 3, wherein the calculating an illumination angle of each of the sub-pictures to obtain an illumination angle corresponding to the target picture includes:

Determining a lighting angle weight value corresponding to each of the sub-pictures;

A vector of the illumination angle of each of the sub-pictures is weighted and summed according to the illumination angle weight value to calculate the illumination angle of the target picture.
An apparatus for optimizing illumination information, comprising:

An acquisition module, configured to acquire a target picture and decompose the target picture into a first preset number of sub-pictures; wherein the sub-pictures are composed of a second preset number of pixels;

A determining module, configured to obtain a geometric center of the sub-picture, determine a light intensity weighting center according to the image moment of the sub-picture, and determine the illumination of the sub-picture based on the light intensity weighting center and the geometric center of the sub-picture angle;

A processing module, configured to perform grayscale processing on the sub-picture, and obtain a light intensity of the sub-picture according to a gray-scale value of each point on the sub-picture;

A first calculation module, configured to obtain a light intensity weight value corresponding to the sub-picture, and obtain a light intensity of the target picture according to the light intensity of the sub-picture and the light intensity weight value corresponding to the sub-picture;

A second calculation module is configured to calculate an illumination angle of the sub-picture to obtain an illumination angle of the target picture.
The device according to claim 6, wherein the processing module is specifically configured to perform grayscale processing on the sub-picture, so that each point on the sub-picture retains only a gray-scale value of 0-255; The gray value of each point on the sub-picture is input into a pre-trained light intensity model to obtain the light intensity of the sub-picture.
The apparatus according to claim 7, wherein the first calculation module comprises:

An obtaining unit, configured to obtain position coordinates of the sub-picture in the target picture;

The determining unit is configured to determine a light intensity weight value corresponding to the sub-picture according to a position coordinate of the sub-picture and a size of the sub-picture.
The apparatus according to any one of claims 6 to 8, wherein the first calculation module further comprises:

A judging unit, configured to judge whether the size of the sub-picture is smaller than a preset threshold;

The summing unit is configured to sum the vectors of the illumination angles of the sub-pictures to obtain the illumination angles of the target picture if they are less than a preset threshold.
An electronic device, comprising: at least one processor; and

A memory connected in communication with the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute any one of claims 1 to 5. Optimization method of lighting information.