WO2020019133A1

WO2020019133A1 - Method and device for determining shadow effect and electronic device

Info

Publication number: WO2020019133A1
Application number: PCT/CN2018/096691
Authority: WO
Inventors: 菲永奥利维尔; 李建亿
Original assignee: 太平洋未来科技（深圳）有限公司
Priority date: 2018-07-23
Filing date: 2018-07-23
Publication date: 2020-01-30
Also published as: CN108986203A

Abstract

Provided by the embodiments of the present invention are a method and device for determining a shadow effect and an electronic device, the method comprising: obtaining a target picture, and decomposing the target picture into a first preset number of sub-pictures; determining a light intensity weighting center according to an image moment of the sub-pictures, and determining light source position information of the target picture on the basis of the light intensity weighting center and geometric center of the sub-pictures; and generating a shadow effect of a target object according to the light source position information and position information and contour information of the target object in the target picture. By means of the described method, device and electronic device, the position of a light source in a picture may be accurately and conveniently obtained, and other related factors are considered in the process of generating the shadow effect of a virtual object, so that the shadow effect of the virtual object is more lifelike, thereby improving the immersion feeling of the user.

Description

Method, device and electronic equipment for determining shadow effect

Technical field

The present invention relates to the technical field of image processing, and in particular, to a method, a device, and an electronic device for determining a shadow effect.

Background technique

Augmented Reality (AR) technology is a technology that calculates the position and angle of a camera image in real time, adds corresponding images, videos, and 3D models, and places virtual objects on the screen to interact with the real world. By using AR devices, users can sense the existence of virtual objects. However, in the process of implementing the present invention, the inventors found that in the related art, when rendering a virtual object with a shadow effect, the shadow shape of the virtual object is generally determined only according to the shape of the virtual object. In a real scene, due to various factors, The influence of the shadow shape will generally deviate from its object body, which makes the shadow effect of the virtual object inconsistent with the real world.

In addition, in order to obtain the same AR virtual object as the real scene, it is often captured directly through a mobile phone camera, and more and more scenes start to play AR videos directly through the mobile phone screen. In order to avoid the poor framing effect caused by the shake of the handheld device, which leads to subsequent image processing problems, or the user's physical fatigue when watching the video while holding the phone for a long time, it is often necessary to install the phone in a fixed bracket to maintain stability. It is quite good, but it is expensive and bulky. Ordinary users often use the simple bracket of the mobile phone to achieve the desired framing effect and stable support effect. However, the simple bracket is usually located on the protective case of the mobile phone or pasted with strong glue. On the back of mobile phones, more and more users are reluctant to use mobile phone protective cases and sticky simple brackets due to the increasingly strong glass of mobile phones, heat dissipation problems of mobile phones, and the aesthetics of mobile phones.

Summary of the Invention

The method, device, and electronic device for determining a shadow effect provided by the embodiments of the present invention are used to solve at least the foregoing problems in related technologies.

An embodiment of the present invention provides a method for determining a shadow effect, including:

Obtain a target picture, decompose the target picture into a first preset number of sub-pictures; determine a light intensity weighting center according to the image moment of the sub picture, and determine based on the light intensity weighting center and the geometric center of the sub-picture Light source position information of the target picture; and generating a shadow effect of the target object according to the light source position information and position information and contour information of the target object on the target picture.

Further, generating the shadow effect of the target object according to the light source position information and the position information and contour information of the target object on the target picture includes: according to the light source position information and the target on the target picture Position information of the object, determining a center position of the shadow of the target object; acquiring surrounding environment information of the target object on the target picture, and determining a corresponding shadow environment adjustment factor according to the surrounding environment information; based on the The contour information obtains the congruent graphics of the target object, and the congruent graphics are processed according to the shadow environment adjustment factor to obtain the shadow shape of the target object; generated according to the center position of the shadow and the shadow shape The shadow effect of the target object.

Further, the contour information is obtained by the following steps: judging whether the target object belongs to a regular shape through a pre-trained model; if it belongs to a regular shape, extracting feature information corresponding to the regular shape as the contour of the target object Information; if it does not belong to a regular shape, determine the outline information of the target object according to the target object and pixel values around the target object.

Further, the method further comprises: obtaining an average light intensity according to the light intensity of each of the sub-pictures as the light intensity corresponding to the target picture; and processing the shadow effect of the target object according to the light intensity.

Further, determining the light source position information of the target picture based on the light intensity weighting center and the geometric center of the sub-picture includes: according to the light intensity weighting center of the sub-picture and the geometric center of the sub-picture Determining a light angle of the sub-picture; determining a weight value corresponding to each of the sub-pictures; and performing a weighted sum of a vector of light angles of each of the sub-pictures according to the weight value to obtain a light angle corresponding to the target picture Determining the light source position information of the target picture according to the light angle and the pixel value of the target picture.

Another aspect of the embodiments of the present invention provides a device for determining a shadow effect, including:

An obtaining module is configured to obtain a target picture and decompose the target picture into a first preset number of sub-pictures; a determining module is used to determine a light intensity weighting center according to an image moment of the sub-picture, and based on the sub-picture The light intensity weighting center and the geometric center determine light source position information of the target picture; a generating module is configured to generate the target object according to the light source position information and position information and contour information of the target object on the target picture Shadow effect.

Further, the generating module includes: a first determining unit, configured to determine a center position of a shadow of the target object according to the light source position information and the position information of the target object on the target picture; a second determining unit, It is configured to obtain the surrounding environment information of the target object on the target picture, and determine a corresponding shading environment adjustment factor according to the surrounding environment information; a processing unit is configured to obtain a full range of the target object based on the contour information. Iso-graphics, and processing the congruent graphics according to the shadow environment adjustment factor to obtain the shadow shape of the target object; a generating unit for generating the target object according to the center position of the shadow and the shadow shape Shadow effect.

Further, the generating module is further configured to determine whether the target object belongs to a regular shape through a pre-trained model; if the target object belongs to a regular shape, extract feature information corresponding to the regular shape as contour information of the target object ; If it does not belong to a regular shape, determine the outline information of the target object according to the target object and pixel values around the target object.

Further, the generating module is further configured to obtain an average light intensity according to the light intensity of each of the sub-pictures as the light intensity corresponding to the target picture; and process the shadow effect of the target object according to the light intensity. .

Further, the determining module is further configured to determine a light angle of the sub-picture according to a light intensity weighting center of the sub-picture and a geometric center of the sub-picture; determine a weight value corresponding to each of the sub-pictures; The weight value is a weighted sum of a vector of light angles of the sub-pictures to obtain a light angle corresponding to the target picture; a light source of the target picture is determined according to the light angle and a pixel value of the target picture location information.

Another aspect of the embodiments of the present invention provides an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores a memory that can be used by the at least one processor And an instruction that is executed by the at least one processor, so that the at least one processor can execute the foregoing method for determining a shadow effect.

Further, the electronic device includes a mobile phone, and the target picture in the method for determining a shadow effect is obtained through a camera device of the mobile phone. The mobile phone includes a front panel with a display screen and a mobile phone back cover; a middle and lower part of the mobile phone back cover is provided with a recessed area, and a support plate adapted to the shape and size of the recessed area is installed in the recessed area; The upper end of the support plate is hinged with the recessed area, so that the support plate can be rotated to a predetermined angle with the back cover of the mobile phone; a lower end of the support plate is provided with a connecting piece, and one end of the connecting piece and The support plate is soft-connected, and the other end is provided with a plugging portion adapted to the shape and size of the mobile phone charging interface, and the plugging portion is mated with the mobile phone charging interface;

Further, the support plate includes a first plate body, a second plate body, a first connection plate, a second connection plate, and a link, the first plate body, the first connection plate, the second connection plate, and the second The plates are sequentially connected to form a plate; the first plate has opposite first and second ends, the second plate has opposite third and fourth ends, and the link includes a first A rod body and a second rod body, opposite ends of the first rod body are hinged to the first end and the third end, respectively, and opposite ends of the second rod body are respectively connected to the second end and the fourth end End-to-phase hinge, wherein the first rod body and the second rod body are both disposed on a side of the support plate away from the front panel; the first connection plate and the second connection plate are located on the first Between the plate body and the second plate body, one side of the first connection plate is hinged to one side of the first plate body, and one side of the second connection plate is opposite to one side of the second plate body. Hinged, the other side of the first connection plate is hinged with the other side of the second connection plate, the first connection plate and the second connection plate The first plate is provided on a side of the support plate near the front plate; the first plate is provided with a first portion disposed along a thickness direction of the first plate, and the first portion is located at a hinge between the first plate and the connecting rod. And between the first plate body and the hinge of the first connecting plate; the second plate body is provided with a second portion provided along its thickness direction, and the second portion is located on the second plate Between the hinge between the body and the connecting rod and the hinge between the second plate and the second connecting plate; the first portion, the second portion, the first connecting plate, the second connecting plate, and the connecting rod form five Rod body mechanism.

Further, the recessed area includes a bottom wall and a side wall, and the bottom wall and / or the side wall is provided with a ventilation structure, and the ventilation structure is a plurality of ventilation holes or ventilation grilles.

Further, the connecting member is made of rubber.

Further, each of the first end, the second end, the third end, and the fourth end is provided with a recessed portion, and opposite ends of the first rod body are respectively disposed in the recessed portion of the first end and the first end. In the recessed portion at the three ends, the opposite ends of the second rod body are respectively placed in the recessed portion of the third end and the recessed portion of the fourth end.

It can be seen from the above technical solutions that the method, device, and electronic device for determining a shadow effect provided by the embodiments of the present invention can accurately and conveniently obtain the position of a light source in a picture, while considering other antecedent factors in the process of generating a shadow effect of a virtual object, Thus, the shadow effect of the virtual object is more realistic, and the immersion of the user is improved. At the same time, a mobile phone with a support plate can make the shooting and playback of the mobile phone more stable. The user does not need to use the protective case and stickers of the mobile phone. It will not affect the heat dissipation and make the mobile phone more beautiful. The quality of image acquisition can be used separately from the above method.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly explain the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings in the following description are merely These are some of the embodiments described in the embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained according to these drawings.

FIG. 1 is a flowchart of a method for determining a shadow effect according to an embodiment of the present invention; FIG.

FIG. 2 is a light intensity weighted center and a weighted center coordinate position map of a sub-picture provided by an embodiment of the present invention; FIG.

3 is a specific flowchart of step S103 provided by an embodiment of the present invention;

4 is a structural diagram of a device for determining a shadow effect according to an embodiment of the present invention;

5 is a structural diagram of a device for determining a shadow effect according to an embodiment of the present invention;

6 is a schematic diagram of a hardware structure of an electronic device that executes a method for determining a shadow effect provided by an embodiment of a method of the present invention;

7 is a schematic structural diagram of a mobile phone that acquires a target picture in a method for determining a shadow effect according to an embodiment of the present invention;

8 is an exploded view of a mobile phone support plate for obtaining a target picture in a method for determining a shadow effect according to an embodiment of the present invention;

FIG. 9 is a schematic diagram of a mobile phone support plate for obtaining a target picture in a method for determining a shadow effect according to an embodiment of the present invention in a supported state; FIG.

10 is an enlarged view of part A of FIG. 9;

11 is an enlarged view of a portion B of FIG. 9;

FIG. 12 is a schematic diagram of a mobile phone supporting plate for obtaining a target picture in a method for determining a shadow effect according to an embodiment of the present invention in a folded state.

detailed description

In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described The embodiments are only a part of the embodiments of the present invention, but not all the embodiments. Based on the embodiments in the embodiments of the present invention, all other embodiments obtained by those skilled in the art should belong to the protection scope of the embodiments of the present invention.

The execution subject of the embodiment of the present invention is an electronic device or a server. The electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a desktop computer with a camera, and the like. Hereinafter, some embodiments of the present invention will be described in detail with reference to the drawings. In the case of no conflict, the following embodiments and features in the embodiments can be combined with each other. FIG. 1 is a flowchart of a method for determining a shadow effect according to an embodiment of the present invention. As shown in FIG. 1, a method for determining a shadow effect provided by an embodiment of the present invention includes:

S101. Obtain a target picture, and decompose the target picture into a first preset number of sub-pictures.

Specifically, the target picture may be a certain frame in a video or a single picture frame captured from a camera, which is not limited in the present invention. The acquisition timing may be based on a user's operation instruction, or when the scene of the video meets a preset requirement or condition. In the video, when the positions of the light sources in different frames are different, the shadow effect corresponding to the target object is also different.

In this step, after obtaining the target picture, the target picture is decomposed into a first preset number of small square grid elements composed of a preset size, and each small square grid element is used as a sub-picture, where The sub-picture is composed of a second preset number of pixels. For example, the target picture can be decomposed into C columns and R rows (where C and R are integers, and C≥2, R≥2) to obtain multiple sub-pictures, each of which consists of p pixels.

As an optional implementation manner of this embodiment, since the light information does not involve color problems, for a color picture, before the decomposition, the target picture can be extracted with grayscale, and the influence of the color on the light intensity acquisition can also be avoided.

S102. Determine a light intensity weighting center according to the image moment of the sub-picture, and determine light source position information of the target picture based on the light intensity weighting center and the geometric center of the sub-picture.

First, the image moment of each sub-picture needs to be calculated to determine its corresponding light intensity weighting center. An image moment is a set of moments calculated from digital graphics. It usually describes the global features of the image and provides a lot of information about the different types of geometric features of the image, such as size, position, direction, and shape. For example: First-order moments are related to shape; second-order moments show the degree of expansion of a curve around a straight line average; third-order moments are a measure of the symmetry of the mean; second- and third-order moments can be used to derive a set of seven Moment invariant and invariant moment are the statistical characteristics of the image, which meet the invariant invariance of translation, expansion and rotation. In image processing, geometric invariant moment can be used as an important feature to represent an object. Classify images. The above-mentioned first, second, third, and seven invariant moments derived from the second and third moments have specific calculation formulas in textbooks. According to these formulas, determining the light intensity weighting center belongs to this field. Technical common sense, the present invention is not described in detail here.

As shown in FIG. 2, the light intensity weighting center g is determined by the image moment, and its coordinate position in the sub-image is (x _g , y _g ).

Secondly, for each sub-picture, the light angle of the sub-picture is determined according to its light intensity weighted center and geometric center. Specifically, as shown in FIG. 2, the coordinate position (x _c , y _c ) of the geometric center c in the sub-picture is determined, and the coordinate position of the geometric center c is compared with the coordinate position of the light intensity weighted center g. Vector from center c to weighted center g

The direction of is the result of being affected by light, which provides us with a local light effect indication of the target picture location where the sub-picture is located. Specifically, vectors

Represents the direction of the light, and d represents the modulus of the vector cg

α represents the light angle of the sub-picture. Since tanα = (y _g -y _c ) / (x _g -x _c ), then α = Arctan ((y _g -y _c ) / (x _g -x _c )), that is, The light angle of the sub-picture is calculated by the coordinates of the geometric center and the weighted center.

Again, determine the weight value corresponding to each sub-picture, and perform weighted summation on the vector of the light angle of each sub-picture according to the weight value to obtain the light angle corresponding to the target picture. Specifically, a weight value corresponding to each sub-picture may be determined according to a vector mode of a light angle corresponding to each sub-picture, and / or a light angle, and / or previous experience.

As an optional implementation of the embodiment of the present invention, a confidence factor may be calculated according to a weight value corresponding to each sub-picture and a vector of a light angle corresponding to each sub-picture. When the confidence factor is less than a preset value, the weight value is Make adjustments. Specifically, the confidence factor is a ratio of the vector sum of the angle of the light rays to the sum of the weight values. The confidence factor can indicate whether the weight value matches the trend of the vector. The closer the confidence factor is to 1, this indicates that the weight value The more appropriate. When the confidence factor is less than the preset value, it means that the determined weight value is inappropriate. At this time, the weight value needs to be adjusted. After the adjustment, a new confidence factor is calculated and tested according to the above method until the new confidence factor can be greater than the preset threshold. .

The length of the vector of the light angle of each sub-picture is determined according to the weight value, and then the vectors determined by each length are added to obtain the vector of the light angle corresponding to the target picture, and the vector of the light angle corresponding to the target picture To get the light angle corresponding to the target picture.

Finally, the light source position information of the target picture is determined according to the light angle and the pixel value of the target picture. Specifically, pixel values along the ray angle and points near the ray angle in the target picture are acquired, so as to obtain the brightness distribution along the ray angle. The closer the pixel value is to zero, the darker the color of the pixel; the closer the pixel value is to the maximum value of 255, the brighter the color of the pixel. Therefore, by comparing the pixel values of these points, The point where the pixel value is the largest is inferred as the coordinate position of the light source, and optionally, the sitting mark of the light source may be (x _l , y _l ).

S103: Generate a shadow effect of the target object according to the light source position information and the position information and contour information of the target object on the target picture.

In this step, the position of the shadow display can be determined according to the position of the light source and the position of the target object, and the display shape of the shadow is obtained according to the contour information of the object. The combination of the two generates the shadow effect of the target object.

Before performing this step, as some optional implementations in this embodiment, the contour information can be obtained by the following steps:

Determine whether the target object belongs to a regular shape through a pre-trained model; if it belongs to a regular shape, extract feature information corresponding to the regular shape as contour information of the target object; if it does not belong to a regular shape, according to the The target object and pixel values around the target object determine contour information of the target object.

Specifically, the target object may be a person, an animal, an article, a flower, a tree, or the like. The regular shape refers to a general geometric shape, such as a circle, a rectangle, or the like. The irregular shape includes, but is not limited to, a contour light of a person or an animal. Prior to this, some training sets can be prepared in advance. The training set includes regular-shaped objects and irregular-shaped objects. The training set is used to train the model so that the model can identify whether each object belongs to a regular shape or an irregular shape. Further, For models with regular shapes, the model can also identify their corresponding shapes.

When it is identified through the above model that the target object belongs to a regular shape, corresponding feature information is extracted according to its corresponding shape. For example, when the target object is circular, the extracted features are radius; when the target object is rectangular, the extracted features are length and width. According to the characteristic information, the outline of the target object can be obtained.

When it is identified through the above model that the target object does not belong to a regular shape, because the pixel value included in the target object itself is very different from the pixel values at its edges, the critical points where the pixel values change suddenly can be extracted around the target object. The points are connected as outline information of the irregularly shaped target object.

Specifically, as shown in FIG. 3, this step may be performed through the following sub-steps:

S1031: Determine the center position of the shadow of the target object according to the light source position information and the position information of the target object on the target picture.

First, the position information of the target object on the target picture is generally obtained as coordinate information (x _i , y _i ) on the target image. At the same time, the light source coordinate information (x _l , y _l ) determined according to step S102 can be The shadow position of the target object relative to the shadow center position of the light source is calculated. Alternatively, the shadow center position can be determined by the following formula. Among them, x _s is the abscissa of the shadow center, and y _s is the ordinate of the shadow center.

S1032: Acquire the surrounding environment information of the target object on the target picture, and determine a corresponding shading environment adjustment factor according to the surrounding environment information.

In an actual scene, the surrounding environment of the target object (such as surrounding buildings, surrounding objects, etc.) will affect its shadow shape, so the environmental information about the target object in the target picture, such as the surrounding environment and The relative position of the target object, the shape information of the surrounding objects, and so on, determine the corresponding shadow environment adjustment factor according to these information, and is used to adjust the shadow shape of the target object.

S1033: Obtain the congruent graphics of the target object based on the contour information, and process the congruent graphics according to the shadow environment adjustment factor to obtain the shadow shape of the target object.

Based on the contour information of the target object obtained as described above, a congruent figure corresponding to the target object is obtained. Compressing or stretching the congruent graphics according to the shadow environment adjustment factor in step S1032 to obtain the shadow shape of the target object. Optionally, when the congruent graphic is a regular graphic, the radius or length and width of the regular graphic may be multiplied by the shadow environment adjustment factor to obtain a shadow shape; when the congruent graphic is an irregular graphic, the inconsistent graphic may be changed. Multiply the regular pattern by the shadow environment adjustment factor to get the shadow shape.

S1034: Generate a shadow effect of the target object according to a center position of the shadow and the shadow shape.

Specifically, first, the center point of the shadow shape is determined, and the center point of the shadow shape is placed at the center position of the shadow of the target object in the target image, thereby determining the position of the shadow in the target picture, and generating the shadow effect of the target object. .

In addition, since the intensity of the light source will affect the depth of the shadow light, as some optional implementations of the embodiments of the present invention, the average light intensity can also be obtained according to the light intensity of each sub-picture as the corresponding light intensity of the target picture; according to The light intensity adjusts the pixel value corresponding to the shape of the shadow to obtain a shadow effect corresponding to the intensity of the light source.

The method for determining a shadow effect provided by the embodiment of the present invention can accurately and conveniently obtain the position of a light source in a picture, and at the same time, consider other prerequisite factors in the process of generating a shadow effect of a virtual object, thereby making the shadow effect of the virtual object more realistic and improved. User immersion.

FIG. 4 is a structural diagram of a device for determining a shadow effect according to an embodiment of the present invention. As shown in FIG. 4, the apparatus specifically includes: an obtaining module 100, a determining module 200, and a generating module 300. among them,

An obtaining module 100 is configured to obtain a target picture and decompose the target picture into a first preset number of sub-pictures; a determining module 200 is configured to determine a light intensity weighting center according to an image moment of the sub-picture, and based on the sub-picture The light intensity weighting center and the geometric center of the picture determine the light source position information of the target picture; a generating module 300 is configured to generate all the information according to the light source position information and the position information and contour information of the target object on the target picture. Describes the shadow effect of the target object.

The apparatus for determining a shadow effect provided by an embodiment of the present invention is specifically configured to execute the method provided by the embodiment shown in FIG. 1 and FIG. 2, and its implementation principles, methods, and functional uses are similar to the embodiments shown in FIG. 1 and FIG. 2. , Will not repeat them here.

FIG. 5 is a structural diagram of a device for determining a shadow effect according to an embodiment of the present invention. As shown in FIG. 5, the device specifically includes: an acquisition module 100, a determination module 200, and a generation module 300. among them,

Optionally, the generating module 300 includes a first determining unit 310, a second determining unit 320, a processing unit 330, and a generating unit 340.

A first determining unit 310 is configured to determine a center position of a shadow of the target object according to the light source position information and the position information of the target object on the target picture; a second determining unit 320 is configured to acquire the target object The surrounding environment information on the target picture, and the corresponding shading environment adjustment factor is determined according to the surrounding environment information; the processing unit 330 is configured to obtain the congruent graphics of the target object based on the contour information, and according to the The shadow environment adjustment factor processes the congruent graphics to obtain a shadow shape of the target object; a generating unit 340 is configured to generate a shadow effect of the target object according to a center position of the shadow and the shadow shape.

Optionally, the generating module 300 is further configured to determine whether the target object belongs to a regular shape by using a pre-trained model; if the target object belongs to a regular shape, extract feature information corresponding to the regular shape as contour information of the target object ; If it does not belong to a regular shape, determine the outline information of the target object according to the target object and pixel values around the target object.

Optionally, the generating module 300 is further configured to obtain an average light intensity according to the light intensity of each of the sub-pictures as the light intensity corresponding to the target picture; and process the shadow effect of the target object according to the light intensity. .

Optionally, the determining module 200 is further configured to determine a light angle of the sub-picture according to a light intensity weighting center of the sub-picture and a geometric center of the sub-picture; determine a weight value corresponding to each of the sub-pictures; The weight value is a weighted sum of a vector of light angles of the sub-pictures to obtain a light angle corresponding to the target picture; a light source of the target picture is determined according to the light angle and a pixel value of the target picture location information.

The apparatus for determining a shadow effect provided by the embodiment of the present invention is specifically configured to execute the method provided by the embodiment shown in FIG. 1 to FIG. 3, and the implementation principles, methods, and functional uses thereof are similar to the embodiment shown in FIG. 1-3, I will not repeat them here.

The above-mentioned apparatus for determining a shadow effect according to the embodiments of the present invention may be used as one of the software or hardware functional units, which may be independently provided in the above-mentioned electronic device, or may be used as one of the functional modules integrated in the processor to execute the embodiments of the present invention. How to determine the shadow effect.

6 is a schematic diagram of a hardware structure of an electronic device that executes a method for determining a shadow effect provided by an embodiment of a method of the present invention. According to FIG. 6, the electronic device includes:

One or more processors 610 and a memory 620. One processor 610 is taken as an example in FIG. 6. The apparatus for performing the method for determining a shadow effect may further include an input device 630 and an output device 630.

The processor 610, the memory 620, the input device 630, and the output device 640 may be connected through a bus or other methods. In FIG. 6, the connection through the bus is taken as an example.

The memory 620 is a non-volatile computer-readable storage medium, and can be used to store non-volatile software programs, non-volatile computer executable programs, and modules, such as the method for determining a shadow effect in the embodiment of the present invention. Corresponding program instructions / modules. The processor 610 executes various functional applications and data processing of the server by running non-volatile software programs, instructions, and modules stored in the memory 620, that is, a method for determining the shadow effect.

The memory 620 may include a storage program area and a storage data area, wherein the storage program area may store an operating system and an application program required for at least one function; the storage data area may store a use of a determining device for a shadow effect according to an embodiment of the present invention Data created, etc. In addition, the memory 620 may include a high-speed random access memory 620, and may further include a non-volatile memory 620, such as at least one magnetic disk memory 620, a flash memory device, or other non-volatile solid-state memory 620. In some embodiments, the memory 620 may optionally include a memory 620 remotely disposed with respect to the processor 66, and these remote memories 620 may be connected to the shadow effect determining device through a network. Examples of the above network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

The input device 630 may receive inputted numeric or character information, and generate key signal inputs related to user settings and function control of the determination device of the shadow effect. The input device 630 may include a device such as a pressing module.

The one or more modules are stored in the memory 620, and when executed by the one or more processors 610, perform a method of determining the shadow effect.

The electronic devices in the embodiments of the present invention exist in various forms, including but not limited to:

(1) Mobile communication equipment: This type of equipment is characterized by mobile communication functions, and its main goal is to provide voice and data communication. Such terminals include: smart phones (such as iPhone), multimedia phones, feature phones, and low-end phones.

(2) Ultra-mobile personal computer equipment: This type of equipment belongs to the category of personal computers, has computing and processing functions, and generally has the characteristics of mobile Internet access. Such terminals include: PDA, MID and UMPC devices, such as iPad.

(3) Portable entertainment equipment: This type of equipment can display and play multimedia content. These devices include audio and video players (such as iPods), handheld game consoles, e-books, as well as smart toys and portable car navigation devices.

(4) The server.

(5) Other electronic devices with data interaction function.

Specifically, the electronic device in this embodiment may be a mobile phone with a support structure. Referring to FIGS. 7-12, the mobile phone may be used to obtain a target picture in the method for determining a shadow effect in the foregoing embodiment. The mobile phone is provided with a support plate on the back cover, which can make the mobile phone support stably, and is stable enough when acquiring target images and videos, thereby obtaining high-quality target pictures, and laying a foundation for subsequent processing of the target pictures. At the same time, the mobile phone's built-in support plate prevents the user from using a mobile phone case with a stand and an externally sticky stand, which facilitates the heat dissipation of the mobile phone, improves the aesthetics, and solves the fatigue caused by the user holding the mobile phone for a long time.

As shown in FIG. 7, the mobile phone includes a front panel with a display screen (not shown in the figure) and a mobile phone back cover 1000; a middle and lower part of the mobile phone back cover 1000 is provided with a recessed area 1100, and the recessed area 1100 is inside A support plate 2000 adapted to the shape and size of the recessed area 1100 is installed; the upper end of the support plate 2000 is hinged to the recessed area 1100 so that the support plate 2000 can be rotated to the mobile phone back cover 1000 is a preset angle. Specifically, the upper end of the support plate 2000 in this embodiment may have a rotating shaft, and the upper end of the recessed portion has a shaft hole adapted to the rotating shaft. The cooperation between the rotating shaft and the shaft hole is used to realize the support plate 2000. It can be rotated, of course, other rotating mechanisms with simpler structures are also within the optional range of this embodiment.

In addition, in order to realize the detachable connection between the lower end of the support plate 2000 and the mobile phone, in this embodiment, a connection piece 3000 is provided at the lower end of the support plate 2000. One end of the connection piece 3000 is soft-connected to the support plate 2000 and the other end has A plugging portion 310 adapted to the shape and size of the mobile phone charging interface 4000. The plugging portion 310 is mated with the mobile phone charging interface 4000. This structure not only realizes the detachable connection between the lower end of the support plate 2000 and the mobile phone, but also It can also protect the charging interface 4000 and improve the functionality of the support plate 2000. Specifically, the connecting member 3000 in this embodiment is made of rubber. The use of rubber not only has good deformation ability, but also has low cost and is easy to implement.

In this embodiment, a rotatable support plate is provided in the recessed area of the back cover of the mobile phone, which can support the mobile phone side by side to meet the user's requirements. There is no need to set a mobile phone case on the mobile phone, which prevents the mobile phone case from affecting the mobile phone The effect of heat dissipation. The lower end of the support plate is fixed by connecting with the charging interface of the mobile phone, and it can also protect the charging interface and improve the functionality of the support plate. In addition, the expansion of the support plate in this embodiment is also very convenient. It only needs to be pulled out from the charging port of the mobile phone.

In addition, the existing support plate cannot play the role of fixing the mobile phone. Therefore, the inventor made further improvements to the above-mentioned support plate structure.

As shown in FIGS. 8-12, the support plate 2000 in this embodiment specifically includes a first plate body 2100, a second plate body 2200, a first connection plate 2300, a second connection plate 2400, and a connecting rod 2500. The first plate body 2100, the first connection plate 2300, the second connection plate 2400, and the second plate body 2200 are sequentially connected to form a plate body. The first plate body 2100 has opposite first ends and second ends (i.e., FIG. (The upper and lower ends shown), the second plate body 2200 has opposite third and fourth ends (ie, the upper and lower ends in the figure), and the link 2500 includes a first rod body 2510 and a second rod body 2520, opposite ends of the first rod body 2510 are hinged to the first end and the third end, respectively, and opposite ends of the second rod body 2520 are respectively connected to the second end and the fourth end Phase articulation, wherein the first rod body 2510 and the second rod body 2520 are both disposed on a side of the support plate away from the front panel.

It should be noted that the number of the connecting rods 2500 in this embodiment may also be one, and two ends of one connecting rod 2500 are respectively connected to the first and second ends, or two ends of one connecting rod 2500 are respectively connected to the first and second ends. The three ends are connected to the fourth end, or one end of a link 2500 is connected to the middle of one side of the first plate 2100, and the other end is connected to the middle of one side of the second plate 2200. At this time, the first connection The plate 2300 and the second connection plate 2400 are separate structures, that is, the first connection plate 2300 and the second connection plate 2400 are each composed of two plate-shaped members. Above a link 2500 is the first connection plate 2300 and the second connection One plate-like member of the plate 2400, and below the link 2500 is another plate-like member of the first connection plate 2300 and the second connection plate 2400.

Specifically, the first connection plate 2300 and the second connection plate 2400 in this embodiment are located between the first plate body 2100 and the second plate body 2200, and one side of the first connection plate 2300 One side of the first plate body 2100 is hinged, one side of the second connection plate 2400 is hinged with one side of the second plate body 2200, and the other side of the first connection plate 2300 is connected to the second plate The other side of the connection plate 2400 is hinged, wherein the first connection plate 2300 and the second connection plate 2400 are disposed on a side of the support plate 2000 near the front panel.

As shown in FIGS. 9-11, the first plate body 2100 in this embodiment is provided with a first portion 2110 disposed along a thickness direction thereof, and the first portion 2110 is located in the first plate body 2100 and the connecting rod 2500. Between the hinge portion of the first plate body 2100 and the hinge portion of the first connection plate 2300; the second plate body 2200 is provided with a second portion 2210 disposed along the thickness direction of the second plate body 2200, and the second portion 2210 is located between the hinge between the second plate body 2200 and the connecting rod 2500 and the hinge between the second plate body 2200 and the second connecting plate 2400; the first portion 2110, the second portion 2210, the first portion A connecting plate 2300, a second connecting plate 2400, and a connecting rod 2500 form a five-bar mechanism.

The above structure forms a five-bar mechanism through the first portion 2110, the second portion 2210, the first connection plate 2300, the second connection plate 2400, and the connecting rod 2500. When support is needed, the entire support plate 2000 structure is rotated to a certain angle. The first rod body 2510 and the second rod body 2520 are both disposed on a side of the support plate 2000 away from the front panel, and the first connection plate 2300 and the second connection plate 2400 are disposed on a side of the support plate 2000 near the front panel. When the support surface of the support plate 2000 gives a force away from the front panel, the five-link 2500 mechanism is at the first dead point position. The first plate 2100 and the first plate 2100, the first connection plate 2300, and the second connection The plate 2400 cannot be rotated, and the dead point position can only be opened by an external force near the front panel, which can ensure that the support plate 2000 is always a plate structure, which provides a stable support for the mobile phone. When the external force is used to open the dead point position, the first connecting plate and the second plate 2200 can be folded. At this time, the first connecting plate 2300 and the first connecting plate 2300 are rotated to the second dead point and the first connecting plate 2300. The second connecting plate 2400 can form a finger receiving portion for inserting a finger into the finger receiving portion, and can fix the mobile phone on a human hand to prevent the user from being crowded and colliding during use, causing the mobile phone to fall. The support plate 2000 not only plays a supporting role, but also plays a role of fixing the mobile phone, which greatly improves its functionality.

It should be noted that the implementation of the "phase articulation" between the two components described above may be provided with a shaft hole in one component, and a rotation shaft, a rotation shaft and a shaft hole matched with the shaft hole in the other component. Together, they form a rotating mechanism so that the two components can rotate relative to each other.

Advantageously, the material of the first connection plate 2300 and the second connection plate 2400 can be selected to have a certain deformability, such as soft plastic. When the first connection plate 2300 and the second connection plate 2400 form a finger receiving portion, , Inserting fingers into it can improve comfort.

In combination with FIG. 8, the first end, the second end, the third end, and the fourth end of the embodiment are each provided with a recess 2600, and the opposite ends of the first rod body 2510 are respectively disposed in the recesses. Within the recessed portion 2600 of the first end and the recessed portion 2600 of the third end, opposite ends of the second rod body 2520 are respectively placed in the recessed portion 2600 of the third end and the recessed portion 2600 of the fourth end.

In the above structure, the link 2500 mechanism is provided in the board body through the recessed portion, so that the link 2500 mechanism, the board body, and the connecting plate together form a board structure, which improves the integrity of the entire support plate 2000 and facilitates the installation of the support plate 2000.

More advantageously, this embodiment further improves the structure of the recessed area 1100. The recessed area 1100 specifically includes a bottom wall and a side wall. The bottom wall is provided with a ventilation structure 1110, and the ventilation structure 1110 may be a plurality of The ventilation hole and the ventilation structure 1110 may be provided with a ventilation grille on the bottom wall. The design of the ventilation holes and the ventilation grille can enhance the heat dissipation effect of the mobile phone when the support plate 2000 is in a supported state or a folded state, thereby extending the service life of the mobile phone.

The device embodiments described above are only schematic, and the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, which may be located in One place, or can be distributed to multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the objective of the solution of this embodiment. Those of ordinary skill in the art can understand and implement without creative labor.

An embodiment of the present invention provides a non-transitory computer-readable storage storage medium, where the computer storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by an electronic device, the electronic device is caused The method for determining a shadow effect in any of the foregoing method embodiments is performed above.

An embodiment of the present invention provides a computer program product, wherein the computer program product includes a computer program stored on a non-transitory computer-readable storage medium, the computer program includes program instructions, and when the program instructions When executed by an electronic device, the electronic device is caused to execute the method for determining a shadow effect in any of the foregoing method embodiments.

Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary universal hardware platform, and of course, also by hardware. Based on such an understanding, the above-mentioned technical solution in essence or a part that contributes to the existing technology may be embodied in the form of a software product, and the computer software product may be stored in a computer-readable storage medium, the computer-readable record A medium includes any mechanism for storing or transmitting information in a form readable by a computer (eg, a computer). For example, machine-readable media include read-only memory (ROM), random-access memory (RAM), magnetic disk storage media, optical storage media, flash storage media, electrical, optical, acoustic, or other forms of propagation signals (e.g., carrier waves , Infrared signals, digital signals, etc.), the computer software product includes a number of instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute various embodiments or certain parts of the embodiments Methods.

In the end, it should be noted that the above embodiments are only used to illustrate the technical solutions of the embodiments of the present invention, rather than limiting them. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: The technical solutions described in the foregoing embodiments can still be modified, or some of the technical features are equivalently replaced; and these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and range.

Claims

A method for determining a shadow effect, including:

Acquiring a target picture, and decomposing the target picture into a first preset number of sub-pictures;

Determining a light intensity weighting center according to the image moment of the sub-picture, and determining light source position information of the target picture based on the light intensity weighting center and the geometric center of the sub-picture;

Generating the shadow effect of the target object according to the light source position information and the position information and contour information of the target object on the target picture.
The method according to claim 1, wherein generating the shadow effect of the target object based on the light source position information and the position information and contour information of the target object on the target picture comprises:

Determining the center position of the shadow of the target object according to the light source position information and the position information of the target object on the target picture;

Acquiring the surrounding environment information of the target object on the target picture, and determining a corresponding shading environment adjustment factor according to the surrounding environment information;

Obtaining the congruent graphics of the target object based on the contour information, and processing the congruent graphics according to the shadow environment adjustment factor to obtain the shadow shape of the target object;

A shadow effect of the target object is generated according to a center position of the shadow and the shadow shape.
The method according to claim 2, wherein the contour information is obtained by the following steps:

Judging whether the target object belongs to a regular shape through a pre-trained model;

If it belongs to a regular shape, extracting feature information corresponding to the regular shape as contour information of the target object;

If it does not belong to a regular shape, the outline information of the target object is determined according to the target object and pixel values around the target object.
The method according to claim 1, further comprising:

Obtaining an average light intensity according to the light intensity of each of the sub-pictures, as the light intensity corresponding to the target picture;

And processing the shadow effect of the target object according to the light intensity.
The method according to any one of claims 1-4, wherein determining the light source position information of the target picture based on the light intensity weighted center and geometric center of the sub-picture includes:

Determining a light angle of the sub-picture according to a light-weighted center of the sub-picture and a geometric center of the sub-picture;

Determining a weight value corresponding to each of the sub-pictures;

Performing weighted summation on a vector of light angles of each of the sub-pictures according to the weight value to obtain a light angle corresponding to the target picture;

Determining light source position information of the target picture according to the light angle and the pixel value of the target picture.
A device for determining a shadow effect, comprising:

An obtaining module, configured to obtain a target picture and decompose the target picture into a first preset number of sub-pictures;

A determining module, configured to determine a light intensity weighting center according to the image moment of the sub-picture, and determine light source position information of the target picture based on the light intensity weighting center and the geometric center of the sub-picture;

A generating module is configured to generate a shadow effect of the target object according to the light source position information and the position information and contour information of the target object on the target picture.
The apparatus according to claim 1, wherein the generating module comprises:

A first determining unit, configured to determine a center position of a shadow of the target object according to the light source position information and the position information of the target object on the target picture;

A second determining unit, configured to obtain surrounding environment information of the target object on the target picture, and determine a corresponding shading environment adjustment factor according to the surrounding environment information;

A processing unit, configured to obtain the congruent graphics of the target object based on the contour information, and process the congruent graphics according to the shadow environment adjustment factor to obtain the shadow shape of the target object;

A generating unit is configured to generate a shadow effect of the target object according to a center position of the shadow and the shadow shape.
The device according to claim 7, wherein the generating module is further configured to determine whether the target object belongs to a regular shape by using a pre-trained model; if the target object belongs to a regular shape, extract features corresponding to the regular shape The information is used as the outline information of the target object; if it does not belong to a regular shape, the outline information of the target object is determined according to the target object and pixel values around the target object.
The device according to claim 6, wherein the generating module is further configured to obtain an average light intensity according to the light intensity of each of the sub-pictures as the light intensity corresponding to the target picture; and according to the light intensity And processing a shadow effect of the target object.
An electronic device, comprising: at least one processor; and

A memory connected in communication with the at least one processor; wherein,

The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute any one of claims 1 to 5. Method for determining the shadow effect.