CN110493512B - Photographic composition method, photographic composition device, photographic equipment, electronic device and storage medium - Google Patents

Photographic composition method, photographic composition device, photographic equipment, electronic device and storage medium Download PDF

Info

Publication number
CN110493512B
CN110493512B CN201910703960.7A CN201910703960A CN110493512B CN 110493512 B CN110493512 B CN 110493512B CN 201910703960 A CN201910703960 A CN 201910703960A CN 110493512 B CN110493512 B CN 110493512B
Authority
CN
China
Prior art keywords
frame
cosome
composition
initial
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910703960.7A
Other languages
Chinese (zh)
Other versions
CN110493512A (en
Inventor
汪毅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
4u Beijing Technology Co ltd
Original Assignee
Shanghai Tianli Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Tianli Intelligent Technology Co ltd filed Critical Shanghai Tianli Intelligent Technology Co ltd
Priority to CN201910703960.7A priority Critical patent/CN110493512B/en
Publication of CN110493512A publication Critical patent/CN110493512A/en
Application granted granted Critical
Publication of CN110493512B publication Critical patent/CN110493512B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders
    • H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
    • H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Studio Devices (AREA)

Abstract

The invention provides a photographic composition method, a photographic composition device, photographic equipment, an electronic device and a storage medium, comprising: acquiring contour information of a shooting target; generating an initial framing frame for the shooting target according to the contour information; when no accompany body exists in the initial frame, outputting the initial frame as a target frame; when an cosome exists in the initial composition frame and the cosome is not taken as a shooting target, regenerating a cosome influence degree which is not more than the current composition frame and outputting the cosome as a target composition frame; and when the cosome exists in the initial frame and the cosome must also be used as a shooting target, forming the cosome and the shooting target into a new shooting target, and replacing the shooting target with the new shooting target to re-execute the steps. The invention adaptively adjusts the frame configuration frame according to the actual scene to adapt to the change of the number of people in the shooting scene, avoids the phenomena of hand cutting, foot cutting and the like, and obtains the picture with higher quality.

Description

Photographic composition method, photographic composition device, photographic equipment, electronic device and storage medium
Technical Field
The present invention relates to the field of automatic photography technologies, and in particular, to a photography composition method, apparatus, photography device, electronic apparatus, and storage medium.
Background
In daily life, people record images and videos around their bodies using an imaging device such as a camera. Generally, it is necessary to manually operate an imaging device to obtain an image or video of an object to be imaged. At present, an unmanned intelligent shooting device is applied to various commercial scenes, such as entertainment occasions like a child playground, and the like, replaces people to shoot targets, can automatically select shot targets, and can continuously shoot the targets.
Smart photography involves a variety of technologies, such as: human body detection, key point detection, expression recognition, action recognition, key object recognition, automatic composition and the like. Before the composition action is executed, the head frame, the body frame and the human body joint points of a target person are obtained through person detection, the outer envelope of a target task is obtained, and then the composition frame containing the outer envelope is generated by taking the outer envelope as the center. A multi-person scenario is unavoidable in a real business scenario. How to carry out generalized composition under the condition that the number of people is uncertain in a multi-person shooting scene so as to avoid the situations of cutting hands, legs and the like in a large number in the shooting process is a problem worthy of solving.
Disclosure of Invention
One of the objectives of the present invention is to overcome at least some of the deficiencies in the prior art by providing a method, an apparatus, a photographing device, an electronic apparatus, and a storage medium for composing a picture frame in a self-adaptive manner according to an actual scene to adapt to the change of people number, so as to avoid the occurrence of hand-cut and leg-cut during photographing.
The technical scheme provided by the invention is as follows:
an automatic photographic composition method, comprising: acquiring contour information of a shooting target; generating an initial framing frame for the shooting target according to the contour information; judging whether an accompanying body exists in the initial framing frame, wherein the accompanying body is other photographable targets; when no accompany body exists in the initial composition frame, outputting the initial composition frame as a target composition frame; when an accompanying body exists in the initial composition frame, judging whether the accompanying body exists or not and whether the accompanying body is required to be also used as a shooting target or not; when the cosome exists in the initial composition frame and all the cosomes are not taken as the shooting targets, regenerating a cosome influence degree not larger than the current composition frame and outputting the cosome influence degree as a target composition frame; and when the cosome exists in the initial composition frame and at least one cosome exists and must also be taken as a shooting target, forming a new shooting target by the cosome which must also be taken as the shooting target and the shooting target, and replacing the shooting target with the new shooting target to re-execute the steps.
Further optionally, the generating an initial composition frame for the photographic target according to the contour information includes: establishing an outer envelope frame of the shooting target according to the contour information; and generating an initial frame structure according to the outer envelope frame, wherein the initial frame structure comprises the outer envelope frame and is concentric with the outer envelope frame.
Further optionally, the contour information includes head frame coordinates, body frame coordinates, and coordinates of each joint point of the photographic target; the outer enveloping frame for establishing the shooting target according to the contour information comprises: taking the minimum value of the head frame coordinate, the body frame coordinate and the x coordinate value in each joint point coordinate of the shooting target as a left x coordinate value; taking the maximum value of the head frame coordinate, the body frame coordinate and the x coordinate value in each joint point coordinate of the shooting target as a right x coordinate value; taking the minimum value of the head frame coordinate, the body frame coordinate and the y coordinate value in each joint point coordinate of the shooting target as a lower y coordinate value; taking the maximum value of the head frame coordinate, the body frame coordinate and the y coordinate value in each joint point coordinate of the shooting target as an upper y coordinate value; obtaining a left upper corner coordinate and a right lower corner coordinate according to the left side x coordinate value, the right side x coordinate value, the lower side y coordinate value and the upper side y coordinate value, and determining an outer envelope frame of the shooting target according to the left upper corner coordinate and the right lower corner coordinate; or obtaining a lower left corner coordinate and an upper right corner coordinate according to the left side x coordinate value, the right side x coordinate value, the lower side y coordinate value and the upper side y coordinate value, and determining an outer envelope frame of the shooting target according to the lower left corner coordinate and the upper right corner coordinate.
Further optionally, the generating an initial composition frame according to the outer envelope frame comprises: respectively calculating the width ratio and the height ratio according to the width and the height of the outer envelope frame and a preset shooting width-height ratio; comparing the width ratio and the height ratio; when the height ratio is larger than the width ratio, calculating the width of an initial framing frame according to the height of the outer envelope frame and the photographic width-height ratio, keeping the height of the outer envelope frame unchanged, and symmetrically extending the width of the outer envelope frame to the width of the initial framing frame to obtain a rectangular frame serving as the initial framing frame; and when the height ratio is not greater than the width ratio, calculating the height of the initial framing frame according to the width of the outer envelope frame and the photographic width-height ratio, keeping the width of the outer envelope frame unchanged, symmetrically extending the height of the outer envelope frame to the height of the initial framing frame, and obtaining the rectangular frame as the initial framing frame.
Further optionally, when the accompany body exists in the initial composition frame, the determining whether there exists an accompany body that must also be taken as a shooting target includes: when the cosome exists in the initial composition frame, respectively calculating the overlapping area ratio of each cosome, wherein the overlapping area ratio is the proportion of the overlapping area of the cosome and the initial composition frame to the whole area of the cosome; judging whether the corresponding partner must be also used as a shooting target according to the overlapping area ratio of each partner; and judging whether one accompanying body is present and must be used as a shooting target according to the judgment results of all the accompanying bodies.
Further optionally, the regenerating the influence degree of the cosome is not greater than the current composition frame, and outputting the same as the target composition frame includes: obtaining at least one new frame by moving the initial frame at least once; and selecting an effective frame with the minimum cosome influence degree from the obtained new frame and the initial frame as a target frame, and outputting the target frame.
Further optionally, the regenerating the influence degree of the cosome is not greater than the current composition frame, and outputting the same as the target composition frame further includes: selecting one accompanying body from the accompanying bodies, and setting the one accompanying body as a reference accompanying body; and continuously moving the initial frame structure along the direction of moving out the reference cosome until an effective frame structure with the minimum influence degree of the cosome in the direction is obtained, taking the effective frame structure as a target frame structure, and outputting the target frame structure.
Further optionally, the regenerating the influence degree of the cosome is not greater than the current composition frame, and outputting the same as the target composition frame further includes: when a plurality of cosubs exist in the initial composition frame, traversing all the cosubs, sequentially obtaining an effective composition frame with the minimum cosubs influence degree in the moving-out direction of each cosubs, and taking the effective composition frame as a candidate composition frame corresponding to the cosubs; selecting a candidate composition frame with the minimum influence degree of a cosome from the candidate composition frames corresponding to the obtained cosomes as a target composition frame, and outputting the target composition frame; the step of obtaining the candidate framing frame corresponding to each cosome comprises the following steps: setting the cosome as a reference cosome; and continuously moving the initial frame structure frame along the direction of moving out the reference cosome until an effective frame structure frame with the minimum influence degree of the cosome in the direction is obtained and is used as a frame candidate frame corresponding to the cosome.
Further optionally, the continuously moving the initial frame structure frame in the direction of moving out the reference cosome until an effective frame structure frame with the minimum influence of the cosome in the direction is obtained includes: setting the initial frame as a reference frame; moving the reference picture frame along the direction of moving out the reference accompany body to obtain a new picture frame; when the volume influence degree of the new framed frame is larger than or equal to the volume influence degree of the reference framed frame or the new framed frame is not an effective framed frame, stopping moving, and taking the reference framed frame as the effective framed frame with the minimum volume influence degree in the direction; and when the influence degree of the cosome of the new frame is smaller than that of the reference frame and the new frame is an effective frame, replacing the reference frame with the new frame, continuing to move along the direction of moving out the reference cosome, and repeating the steps.
Further optionally, the factor for evaluating the influence of the cosome includes an overlapping area of the composition frame and the cosome, and/or a number of cosomes overlapping the composition frame.
The present invention also provides an automatic photography patterning device, comprising: the contour information acquisition module is used for acquiring the contour information of the shooting target; the framing frame generation module is used for generating an initial framing frame for the shooting target according to the outline information; the cosome judging module is used for judging whether a cosome exists in the initial framing frame, wherein the cosome is other photographable targets; the composition frame output module is used for outputting the initial composition frame as a target composition frame when no accompany body exists in the initial composition frame; the accompany body judging module is further used for judging whether an accompany body exists in the initial composition frame and is also used as a shooting target; the composition frame generation module is further used for regenerating a composition frame with an influence degree not greater than that of the current body when the body is present in the initial composition frame and all the bodies are not taken as shooting targets, and outputting the composition frame as a target composition frame; the cosome judging module is further configured to, when a cosome exists in the initial composition frame and at least one cosome exists and must also serve as a shooting target, form a new shooting target by the cosome which must also serve as the shooting target and the shooting target, and replace the shooting target with the new shooting target to regenerate the target composition frame.
The present invention also provides an automatic photographing apparatus comprising: the automatic photography patterning device of any one of the preceding claims, configured to output a target patterning frame; and the shooting component is used for executing shooting action when the target framing frame is received.
The present invention also provides an electronic device, comprising: a memory for storing a computer program; a processor for running the computer program to implement the automatic photography composition method of any one of the preceding claims.
The present invention also provides a storage medium having stored thereon a computer program which, when executed by a processor, implements the automatic photography patterning method of any of the foregoing.
Compared with the prior art, the photographic composition method provided by the invention can bring the following beneficial effects: by dynamically adjusting the shooting target, the framing frame is adaptively adjusted according to the actual scene to adapt to the change of the number of people and/or the change of the actions of people in the shooting scene, so that the phenomenon that the integrity of people is damaged by cutting hands and feet is avoided, and a picture with higher quality is obtained.
Drawings
The above features, technical features, advantages and modes of realisation of a photographic composition method, apparatus, photographic device, electronic apparatus and storage medium will be further described in the following, which will be clearly understood and appreciated, with reference to the accompanying drawings, which illustrate preferred embodiments.
FIG. 1 is a flow chart of one embodiment of an automated photographic composition method of the present invention;
FIG. 2 is a flow chart of another embodiment of an automatic photographic composition method of the present invention;
FIG. 3 is a schematic diagram of an embodiment of an automatic photographic patterning device of the present invention;
FIG. 4 is a schematic diagram of an electronic device according to an embodiment of the invention;
FIG. 5 is a schematic diagram of an embodiment of an automatic photographing apparatus according to the present invention;
FIG. 6 is a schematic diagram of contour information of a photographic target in the corresponding embodiment of FIGS. 1 and 2;
FIG. 7 is a schematic diagram illustrating a positional relationship between an initial framing frame and a cosome in the embodiment corresponding to FIGS. 1 and 2;
FIG. 8 is a schematic diagram of the generation of a target framing block in the embodiment corresponding to FIGS. 1 and 2;
FIG. 9 is another diagram of the embodiment of FIG. 1 for generating a target framing block.
The reference numbers illustrate:
100. the automatic photography device comprises an automatic photography composition device, 110, a contour information acquisition module, 120, a composition frame generation module, 130, an accompanying body judgment module, 140, a composition frame output module, 500, an automatic photography device, 502, a photography component, 400, an electronic device, 410, a memory, 420, a processor, 430, a computer program, 440, a bus, 1, a head frame, 2, a figure frame, 3, a body frame and 4, a joint point.
Detailed Description
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following description will be made with reference to the accompanying drawings. It is obvious that the drawings in the following description are only some examples of the invention, and that for a person skilled in the art, other drawings and embodiments can be derived from them without inventive effort.
For the sake of simplicity, the drawings only schematically show the parts relevant to the present invention, and they do not represent the actual structure as a product. In addition, in order to make the drawings concise and understandable, components having the same structure or function in some of the drawings are only schematically illustrated or only labeled. In addition, "upper, lower", "left, right", "front, rear", "one, another", and the like appearing in the present invention are relative concepts unless otherwise specified.
In one embodiment of the present invention, as shown in fig. 1, an automatic photography composition method includes:
step S100 acquires contour information of a photographic subject.
Specifically, the shooting target may be an adult or a child, and may be one or more characters, as needed. When the photographic subject is a person, the contour information includes position information of the head, body, and joint points of the person, and the contour of the person can be described by the position information. Since the contour information is used for the photography and composition service, the accurate information of the human body curve does not need to be obtained, and a closed geometric body with a slightly larger volume and simple characteristics can be used for replacing the contour information. As an example, as shown in fig. 6, contour information of a person, in which head position information is expressed by a position of a rectangular box (head box 1) containing a head, further, may be expressed by upper left point coordinates and lower right point coordinates of the head box, or by lower left point coordinates and upper right point coordinates; the body position information is expressed by the position of a rectangular frame (body frame 3) containing the body, and further, may be expressed by the upper left point coordinate and the lower right point coordinate of the body frame, or by the lower left point coordinate and the upper right point coordinate; each joint point expressed by the coordinates of the center point (joint point 4) of each joint; this can reduce the amount of data to be processed and the computational complexity of photography. The contour information can be obtained by human body detection and key point detection technologies.
Step S200 is to generate an initial framing frame for the shooting target according to the outline information.
Specifically, the composition frame is a closed frame having a certain shape and size, and defines the shape and size of the photographed image. Generally, a framing frame is a rectangular frame with a left-right width greater than a top-bottom height. When the camera rotates 90 degrees to realize vertical shooting, the height of the framing frame is larger than the width of the framing frame. The aspect ratio of the framing frame is required to be certain, and mainly depends on the size of a sensor of a photographic part such as a camera, and the formats are popular, such as 3:2 format, 1:1, 4:3 format, and the like, so that the framing frame needs to meet the requirement of the preset photographic aspect ratio.
In order to avoid the phenomenon that the integrity of a person is damaged by cropping or cutting limbs of a shooting target in a picture or an image output by shooting, a framing frame needs to be generated according to the outline information of the shooting target. Optionally, according to the photographing requirement, for example, only the upper body of the person needs to be photographed, the upper body information of the photographing target is extracted from the outline information, and the framing frame may only include the upper body information of the photographing target; if there is no special imaging request, the composition frame is required to include the entire outline information of the imaging target, in general, in order to ensure the integrity of the entire person.
In addition, in order to highlight the photographic subject and improve the photographic quality, the photographic subject generally needs to be placed in the center area of the composition frame according to the composition rule. As a preferred embodiment, an outer envelope of the shot object is obtained according to the contour information, optionally taking the shooting requirements into consideration; taking the center of the outer envelope frame as the center of the composition frame, and then obtaining a rectangular frame completely containing the outer envelope frame of the shooting target according to the preset shooting aspect ratio, thus obtaining an ideal composition frame which is at least the composition frame conforming to the preset position composition rule and the preset size composition rule, namely taking a person picture as an example, if only the shooting target and no other persons exist in the composition frame, outputting a shooting according to the composition frame, wherein the corresponding position of the shooting target in the picture (or the picture) conforms to the position composition rule, and the size of the shooting target in the picture (or the picture) also conforms to the size composition rule. The preset position/size composition rule is a set of preset judgments for factors such as the upper, lower, left, right spatial positions/sizes of a shooting target in a picture (or a photo) according to aesthetic requirements of shooting.
In summary, the frame structure obtained according to the contour information of the object is referred to as an initial frame structure.
Step S300 determines whether there are cosubes in the initial framing frame, where the cosubes are other objects that can be photographed.
Specifically, the cosome refers to other photographable targets similar to the photographic target. For example, when the shooting target is a natural person, the accompanying person is another person or a crowd. In a situation such as a situation where a plurality of persons gather, a photographic subject (a specific one of natural persons) is identified and distinguished from one or more accompanying bodies (other natural persons), so that a framed frame with the photographic subject as an image center can be acquired as much as possible, thereby obtaining a portrait of a single person such as a person including only the photographic subject. Therefore, in order to improve the shooting quality of the shooting target, it is necessary to determine whether the cosome or a part of the cosome exists in the initial frame (i.e., the initial frame and the cosome overlap). There may be no cosome, one cosome, or multiple cosomes within the initial framing frame.
In step S400, when there is no cosome in the initial frame, the initial frame is output as a target frame.
Specifically, no cosome exists in the initial frame, which indicates that the currently formed initial frame only includes the shooting target. Since the current frame is already an ideal frame, and a photograph including only a single person, for example, can be acquired, the initial frame can be output as the target frame.
Step S500 determines whether there is a companion body that must also be a photographic subject when the companion body exists in the initial composition frame.
Specifically, when the cosome exists in the initial composition frame, the influence of the cosome needs to be considered, for example, whether the cosome can be removed from the composition frame or not, and the cosome must also be taken as a shooting target. If the image can be moved out of the composition frame, the photographing effect of the photographing object can be further improved. The method comprises the steps of obtaining an initial frame, wherein the initial frame may have one or more cosome, respectively judging whether each cosome is also required to be used as a shooting target, and obtaining whether one cosome which is also required to be used as the shooting target exists according to the judgment result of each cosome. The judging means of each accompany body can be as follows: and calculating the overlapping area of the cosome and the initial framing frame, wherein if the overlapping area is larger than a preset value, the cosome must also be used as a shooting target. Preferably, the overlapping area of each cosome and the initial skeleton frame is calculated, and the proportion of the area to the whole area of the cosome is calculated. When the proportion is larger than or equal to a preset value, the accompany body must also be taken as a shooting target; otherwise, the partner is not a photographic target. As shown in fig. 7, a cosome exists in the initial composition frame, wherein a large frame represents the initial composition frame, a small frame represents the cosome, the left diagram is an example that the cosome must also be taken as a shooting target, and the right diagram is an example that the cosome is not taken as a shooting target; the left graph reflects most of the accompanying body in the initial frame, which shows that the accompanying body is closer to the shooting target, and even if the accompanying body can be moved out by moving the initial frame, the shooting target is located at the edge of the initial frame and does not accord with the preset composition rule, so that the accompanying body is required to be used as a part of the shooting target in the situation.
In step S600, when the cosome exists in the initial composition frame and all the cosomes are not taken as the shooting targets, the cosome influence degree is regenerated to be not more than the current composition frame and the generated composition frame is output as the target composition frame.
Specifically, when the cosome exists in the initial frame, if all the cosomes are not taken as the shooting targets, it is shown that all the cosomes have little influence on the initial frame. This situation can further improve the quality of the shot by regenerating a framed frame with a smaller volume of the cosome influence than the current framed frame. The influence degree of the cosome reflects the influence of the cosome on the framed frame, for example, the cosome is judged by the overlapping area of the cosome and the framed frame or the proportion of the overlapping area to the cosome.
For example, as shown in fig. 8, the left side is an initial composition frame, an accompanying body exists in the composition frame, and the proportion of the overlapping area of the accompanying body and the composition frame to the whole area of the accompanying body is small, which belongs to the situation that the accompanying body is not taken as a shooting target; and obtaining a frame on the right by moving the frame, wherein no cosome exists in the frame, the overlapping area of the cosome and the frame is 0, the influence of the cosome is reduced, and the cosome can be output as a target frame.
For another example, as shown in fig. 9, the left side is an initial frame, a cosome exists in the frame, and when the frame is moved to the left to avoid the right cosome, a new cosome appears on the left side, but obviously, the overlapping area of the new cosome on the left side and the frame is smaller than that of the initial frame, so that a frame with a smaller cosome influence degree can be obtained, and the frame can be output as a target frame.
In some cases, a framed frame with a smaller degree of influence of the accompanying object may not be obtained again compared to the initial framed frame, but because the influence of the accompanying object is small, even if the initial framed frame is output, the accompanying object can be prevented from existing in the actual picture by, for example, cutting the picture after photographing. Further, when a plurality of frame frames with smaller influence degrees of the cosome exist, the frame with the smallest influence degree of the cosome is selected from the frame frames and is output as the target frame.
Step S700, when a cosome exists in the initial composition frame and at least one cosome exists and must also be taken as a shooting target, forming a new shooting target by the cosome which must also be taken as the shooting target and the shooting target, replacing the shooting target with the new shooting target, and jumping to step S100.
Specifically, when an accompanying body exists in the initial frame structure and the accompanying body needs to be brought into the shooting target, the accompanying body and the shooting target are combined to obtain a new shooting target, the new shooting target is used for replacing the shooting target, and the generation and output process of a new round of target frame structure is restarted. When a plurality of cosubs exist in the initial frame construction, and part or all of the cosubs are necessary to be taken as the shooting targets, all the cosubs which are necessary to be taken as the shooting targets are combined with the shooting targets to obtain new shooting targets, the new shooting targets are used for replacing the shooting targets, and the generation and output processes of a new round of target frame construction are restarted.
The usual photography process is: finding a shooting target, adjusting a shooting component (such as a camera) to be aligned with the shooting target, wherein an image containing the shooting target exists in the visual field of the shooting component, and then setting a framing frame (similar to a preview frame in a digital camera) for the shooting target in the current image; if satisfactory to the image within the framing frame, photographing is performed. Therefore, before the framing frame is set, an image containing a shooting target exists in the visual field of the shooting part, and if a scene is dense with multiple persons, the image may contain a cosome, and the contour information of all persons in the image can be obtained. Optionally, before the photographing composition, the outline information of all persons in the image is identified and calculated at one time (or output by a previous-stage module of the photographing composition), and is stored. Therefore, when the shooting target is adjusted, for example, a cosome is added, the contour information of the cosome does not need to be re-identified and calculated, the contour information of the new shooting target can be obtained according to the stored contour information of the shooting target and the contour information of the cosome, and then the initial framing frame of the new shooting target is further obtained. Certainly, the contour information of the shooting target can be acquired firstly during shooting and composition, and then the contour information of the relevant accompany body is identified and calculated when needed; the former method is adopted in the present embodiment.
In the embodiment, in a scene with dense people, the shooting target is dynamically adjusted, so that the composition with uncertain people number and uncertain actions is adaptively realized. Although the composition method of the present embodiment is described with the object as a person, it is obvious that the method is also applicable to an object with a clear outline such as an animal, a plant, or a building, and the method is general and will not be repeated.
In another embodiment of the present invention, as shown in fig. 2, an automatic photography composition method includes:
step S100 acquires contour information of a photographic subject.
Step S210 is to establish an outer envelope frame of the shooting target according to the outline information.
The contour information is human body contour information which comprises head frame coordinates, body frame coordinates and joint point coordinates of the shooting target. The step of establishing an outer envelope frame of the shooting target according to the outline information comprises the following steps: taking the minimum value of the head frame coordinate, the body frame coordinate and the x coordinate value in each joint point coordinate of the shooting target as a left x coordinate value; taking the maximum value of the head frame coordinate, the body frame coordinate and the x coordinate value in each joint point coordinate of the shooting target as a right x coordinate value; taking the minimum value of the head frame coordinate, the body frame coordinate and the y coordinate value in each joint point coordinate of the shooting target as a lower y coordinate value; taking the maximum value of the head frame coordinate, the body frame coordinate and the y coordinate value in each joint point coordinate of the shooting target as an upper y coordinate value; obtaining a left upper corner coordinate and a right lower corner coordinate according to the left side x coordinate value, the right side x coordinate value, the lower side y coordinate value and the upper side y coordinate value, and determining an outer envelope frame of the shooting target according to the left upper corner coordinate and the right lower corner coordinate; or obtaining a lower left corner coordinate and an upper right corner coordinate according to the left side x coordinate value, the right side x coordinate value, the lower side y coordinate value and the upper side y coordinate value, and determining an outer envelope frame of the shooting target according to the lower left corner coordinate and the upper right corner coordinate.
Step S220 is to generate an initial frame structure according to the outer envelope frame, wherein the initial frame structure comprises the outer envelope frame and is concentric with the outer envelope frame.
Specifically, before composition is started, contour information of a shooting target is acquired, for example, coordinates of an upper left point and a lower right point of a head frame, coordinates of an upper left point and a lower right point of a Body frame, and coordinates of each joint point; and obtaining an outer envelope frame (a rectangular frame for short) of the shooting target according to the coordinates of each point. Specifically, the minimum value of the x coordinates of all points is taken as the x coordinate value x of the left sideminTaking the maximum value of x coordinates of all points as the right x coordinate value xmaxTaking the minimum value of all points y coordinate as the lower y coordinate value yminTaking the maximum value of the y coordinates of all points as the y coordinate value y of the upper edgemaxSo as to obtain the coordinate of the upper left corner of the figure box as (x)min，ymax) The coordinate of the lower right corner is (x)max，ymin) The coordinate of the lower left corner is (x)min，ymin) The coordinate of the upper right corner is (x)max，ymax) The figure frame can be determined according to the coordinates of the upper left corner and the lower right corner, and the figure frame can also be determined according to the coordinates of the lower left corner and the upper right corner. As an example, as shown in fig. 6, the figure frame 2 is a minimum rectangular frame completely surrounding the head, body, and joint points of the character. Optionally, according to the photographing requirement, for example, only the upper half of the person needs to be photographed, if an outer envelope of the overall outline information is established, the upper half can be cut from the outer envelope as the required outer envelope.
The center of the outer envelope frame is the center of the initial frame, and a rectangular frame (namely the initial frame) completely containing the outer envelope frame is obtained according to a preset photographing aspect ratio.
Specifically, for example, the height of the outer envelope frame is not changed (that is, the height of the initial framing frame is equal to the height of the outer envelope frame), the width of the initial framing frame is calculated according to a preset photographing aspect ratio, and if the width of the initial framing frame is greater than or equal to the width of the outer envelope frame, the side length corresponding to the width of the outer envelope frame is symmetrically extended to the width of the initial framing frame to obtain the initial framing frame; otherwise, according to the width of the outer envelope frame unchanged (namely the width of the initial frame is equal to the width of the outer envelope frame), calculating the height of the initial frame according to a preset shooting width-height ratio, and symmetrically extending the side length corresponding to the height of the outer envelope frame to the height of the initial frame to obtain the initial frame.
Preferably, the width ratio and the height ratio are respectively calculated according to the width and the height of the outer envelope frame and a preset shooting width-height ratio; comparing the width ratio and the height ratio; when the height ratio is larger than the width ratio, calculating the width of an initial framing frame according to the height of the outer envelope frame and the photographic width-height ratio, keeping the height of the outer envelope frame unchanged, symmetrically extending the width of the outer envelope frame to the width of the initial framing frame, and obtaining a rectangular frame as the initial framing frame; and when the height ratio is not greater than the width ratio, calculating the height of the initial framing frame according to the width of the outer envelope frame and the photographic width-height ratio, keeping the width of the outer envelope frame unchanged, symmetrically extending the height of the outer envelope frame to the height of the initial framing frame, and obtaining the rectangular frame as the initial framing frame. For example, if the width of an outer frame is 0.4 and the height is 0.8, the preset aspect ratio is 3:2 (indicating that the camera is imaging according to 3: 2), the width ratio (the ratio of the corresponding widths) is calculated to be 0.1333 (0.4/3), and the height ratio (the ratio of the corresponding heights) is 0.4 (0.8/2), where the height ratio is greater than the width ratio, and in order to ensure that the content in the outer frame is not cut off, the height of the outer frame is selected to be kept unchanged, the width of the initial frame is calculated to be 1.2 (0.8/2) to obtain the width of the initial frame being 1.2 and the height being 0.8; and symmetrically extending the width of the outer envelope frame to the width of the initial frame, wherein the obtained rectangular frame is the initial frame.
Step S300 determines whether there are cosubes in the initial framing frame, where the cosubes are other objects that can be photographed.
In step S400, when there is no cosome in the initial frame, the initial frame is output as a target frame.
Step S510, when an accompanying body exists in the initial composition frame, judging whether the accompanying body is also required to be used as a shooting target;
step S520, when at least two cosomes exist in the initial composition frame, respectively judging whether each cosome is also required to be taken as a shooting target;
the judging step of whether each partner must also be the shooting target is as follows:
calculating the overlapping area of the cosome and the initial framing frame, and calculating the proportion of the overlapping area to the whole area of the cosome;
judging whether the proportion is greater than or equal to a preset value; when the proportion is larger than or equal to a preset value, the accompany body must also be taken as a shooting target; and when the proportion is smaller than a preset value, the accompany body is not taken as a shooting target.
Step S530 determines whether there is a companion that must also be a photographic target.
Specifically, when a plurality of cosubs exist in the initial frame, each cosubs is determined, and which cosubs are not taken as the shooting target and which must be taken as the shooting target. And judging whether a partner exists and must be used as a shooting target according to the judgment result of each partner.
The judgment method of each accompany body is the same, and comprises the following steps: and calculating the overlapping area of the cosome and the initial framing frame, and calculating the proportion of the area to the whole area of the cosome. When the proportion is larger than or equal to a preset value, the accompany body must also be taken as a shooting target; otherwise, the partner is not a photographic target. As shown in fig. 7, the left diagram is an example in which a cosome must also be a photographic subject, and the right diagram is an example in which a cosome is not a photographic subject.
In step S610, when there are cosubjects in the initial composition frame and all the cosubjects are not taken as the shooting targets, the initial composition frame is moved to obtain a composition frame with the minimum influence of the cosubjects as a target composition frame, and the target composition frame is output.
Specifically, when the initial composition frame has the cosome and all the cosomes are not taken as the shooting targets, the initial composition frame is moved once or for multiple times to regenerate a plurality of new composition frames, and the effective composition frame with the minimum cosome influence degree is selected from the obtained new composition frames and the initial composition frames to be output as the target composition frame. The effective frame is a frame including an outer envelope of the object.
The initial framing frame may be attempted to be translated in one or more combinations selected from the 4 directions up, down, left, and right. Further, when the height of the initial framing frame is greater than the height of the outer envelope frame, an upward or downward movement may be performed. When the width of the initial framing frame is greater than the width of the outer envelope frame, the left or right movement may be performed. Further, an appropriate moving direction is selected according to the relative position relationship between the cosome and the shooting target, and preferably, the initial frame is moved in a direction of moving out of the cosome, for example, as shown in fig. 8, the cosome is moved in a direction to the left on the right side of the initial frame.
Alternatively, when only one cosome is in the initial frame, the cosome is set as the reference cosome. When a plurality of cosubs exist in the initial frame, one cosubs is selected as a reference cosubs. And moving the initial frame structure once according to a preset step along the direction of moving out the reference cosome to obtain a new frame structure. And judging whether the new frame is a valid frame (namely, the frame completely comprises the outer envelope frame of the shooting target). And if the frame is not the effective frame, outputting the initial frame as the target frame. If the frame is a valid frame, the cosome influence degree of the new frame is further calculated and compared with the cosome influence degree of the initial frame. And if the influence degree of the cosome is smaller, outputting the new frame as a target frame.
By judging whether the new frame is an effective frame, the output target frame is ensured to be an effective frame without the situations of hand interception, foot interception and the like.
Further, an effective composition frame with the minimum influence degree of the cosome in a certain direction is obtained through multiple continuous translations, and the effective composition frame is output as a target composition frame. Specifically, for example, when there is only one cosome in the initial frame, the cosome is set as the reference cosome. When a plurality of cosubs exist in the initial frame, one cosubs is selected as a reference cosubs. And moving the initial frame structure once according to a preset step along the direction of moving out the reference cosome to obtain a first new frame structure. And when the first new frame is an effective frame and the influence of the cosome is smaller, continuously moving along the original direction to obtain a second new frame, judging the influence and effectiveness of the cosome of the second new frame, and repeating the steps until the influence of the cosome of the Nth new frame is larger than that of the previous frame or the Nth new frame is not the effective frame. And outputting the N-1 th new frame structure frame as a target frame structure frame. Through the mode, the effective picture frame with the minimum effect of the cosome in a certain direction can be obtained, the effect of the cosome is further reduced, and the picture composition quality is improved.
Further, when a plurality of cosomes exist in the initial frame, selecting one cosome as a reference cosome, continuously moving the initial frame along the direction of moving out the reference cosome, and obtaining an effective frame with the minimum influence degree of the cosome in the direction according to the method and marking the effective frame as a frame candidate; selecting another cosome as a reference cosome, and repeating the method to obtain another corresponding frame candidate; thus, the frame candidate frame in each cosome moving-out direction is obtained, and the frame candidate frame with the minimum cosome influence degree is selected from the frame candidates and is output as the target frame. For example, two cosets (a coset 1 and a coset 2, the coset 1 is on the right side of the shooting target, and the coset 2 is on the left side of the shooting target), according to the above method, the initial frame structure is continuously translated along the direction (i.e. to the left) of moving out the coset 1, and an effective frame structure with the minimum coset influence degree in the direction is obtained and is marked as a frame candidate 1. Then, according to the above method, the initial frame structure is continuously translated along the direction of moving out the cosome 2 (i.e. to the right), and an effective frame structure with the minimum cosome influence degree in the direction is obtained, which is the candidate frame structure 2. And comparing the volume of influence of the candidate frame 1 and the candidate frame 2, and selecting the frame with the minimum volume of influence as the target frame to be output, so that the influence of the volume of influence of the candidate frame is further reduced, and the composition quality is improved.
Factors for evaluating the influence of the cosome include the overlapping area of the picture frame and the cosome and/or the number of cosome overlapping the picture frame. For example, the volume of the cosome is estimated according to the overlapping area of the framing frame and the cosome, and the smaller the overlapping area is, the lower the volume of the cosome is; the overlapping area is 0 and the volume of the cosome is 0, so that the frame with the smallest overlapping area between the frame and the cosome is selected. For another example, the influence degree of the frame is estimated according to the number of the frame overlapping the composition frame and the overlapping area of the frame and the frame, and further, the frame with the smaller number of the frame and the smallest overlapping area of the frame and the frame can be prioritized under the same number of the frame.
Step S700, when a cosome exists in the initial composition frame and at least one cosome exists and must also be taken as a shooting target, forming a new shooting target by the cosome which must also be taken as the shooting target and the shooting target, replacing the shooting target with the new shooting target, and jumping to step S100.
In one embodiment of the present invention, as shown in fig. 3, an automatic photography composition apparatus 100 includes a contour information obtaining module 110, a composition frame generating module 120, a partner determining module 130, and a composition frame output module 140.
The contour information acquiring module 110 is configured to acquire contour information of a shooting target.
Specifically, the shooting target may be an adult or a child, and may be one or more characters, as needed. When the photographing target is a person, the contour information may include position information of the head, body, and each joint of the person, by which the contour of the person can be described. Because the invention further provides the service for the photography and composition of the outline information, the accurate information of the human body curve does not need to be obtained, and the outline information can be replaced by a closed geometric body with a slightly larger volume and simple characteristics, thereby reducing the data amount to be processed and the complexity of the calculation and photography. The contour information can be obtained by human body detection and key point detection technologies.
The composition frame generating module 120 is configured to generate an initial composition frame for the shooting target according to the contour information.
The framing frame is a closed frame with a certain shape and size, and is used for limiting the shape and size of a photographic picture. Generally, the framing frame is a rectangular frame.
In order to avoid the phenomenon that the integrity of a person is damaged by cropping or cutting limbs of a shooting target in a picture or an image output by shooting, a framing frame needs to be generated according to the outline information of the shooting target. Optionally, according to the photographing requirement, for example, only the upper half of the person needs to be photographed, the upper half information of the photographing target is extracted from the outline information, and the composition frame only contains the upper half information of the photographing target; if there is no special imaging request, the composition frame is required to include the entire outline information of the imaging target, in general, in order to ensure the integrity of the entire person.
In addition, in order to highlight the photographing object and improve the photographing quality, the photographing object generally needs to be placed at the central region of the composition frame. As a preferred embodiment, an outer envelope of the shot object is obtained according to the contour information, optionally taking the shooting requirements into consideration; and taking the center of the outer envelope frame as the center of the composition frame, and obtaining a rectangular frame completely containing the outer envelope frame of the shooting target according to a preset shooting aspect ratio, so as to obtain an ideal composition frame which at least accords with the composition rule of a preset position and the composition rule of a preset size.
The framed frame obtained according to the contour information of the object is called an initial framed frame.
The cosome determining module 130 is configured to determine whether a cosome exists in the initial frame, where the cosome is another object that can be photographed.
The cosome refers to other photographable objects similar to the photographic object. In order to improve the shooting quality of the shooting target, it is necessary to determine whether there is a cosome or a part of the cosome in the initial frame (i.e., there is an overlap between the initial frame and the cosome). There may be no cosome, one cosome, or multiple cosomes within the initial framing frame.
The composition frame output module 140 is configured to output the initial composition frame as a target composition frame when no accompany body exists in the initial composition frame.
The partner determining module 130 is further configured to determine whether there is a partner that must also be a photographic target when there is a partner in the initial composition frame.
Specifically, when a cosome exists in the initial frame, the influence of the cosome needs to be considered. The method comprises the steps of obtaining an initial frame, wherein the initial frame may have one or more cosome, respectively judging whether each cosome is also required to be used as a shooting target, and obtaining whether one cosome which is also required to be used as the shooting target exists according to the judgment result of each cosome. The judging means of each accompany body can be as follows: and calculating the overlapping area of the cosome and the initial framing frame, wherein if the overlapping area is larger than a preset value, the cosome must also be used as a shooting target. Preferably, the overlapping area of each cosome and the initial skeleton frame is calculated, and the proportion of the area to the whole area of the cosome is calculated. When the proportion is larger than or equal to a preset value, the accompany body must also be taken as a shooting target; otherwise, the partner is not a photographic target.
The composition frame generation module 120 is further configured to, when there are cosubjects in the initial composition frame and all the cosubjects are not taken as shooting targets, regenerate a composition frame with an influence degree of the cosubjects not greater than that of the current composition frame and output the composition frame as a target composition frame.
Specifically, when the cosome exists in the initial frame, if all the cosomes are not taken as the shooting targets, it is shown that all the cosomes have little influence on the initial frame. This situation can further improve the quality of the shot by regenerating a framed frame with a smaller volume of the cosome influence than the current framed frame. The influence degree of the cosome reflects the influence of the cosome on the framed frame, for example, the cosome is judged by the overlapping area of the cosome and the framed frame or the proportion of the overlapping area to the cosome.
In some cases, a framed frame with a smaller degree of influence of the accompanying object may not be obtained again compared to the initial framed frame, but because the influence of the accompanying object is small, even if the initial framed frame is output, the accompanying object can be prevented from existing in the actual picture by, for example, cutting the picture after photographing. Further, when a plurality of frame frames with smaller influence degrees of the cosome exist, the frame with the smallest influence degree of the cosome is selected from the frame frames and is output as the target frame.
The cosome determining module 130 is further configured to, when a cosome exists in the initial composition frame and at least one cosome exists and must also serve as a shooting target, form a new shooting target with the cosome that must also serve as the shooting target and the shooting target, and replace the shooting target with the new shooting target to regenerate the target composition frame.
Specifically, when an accompanying body exists in the initial frame construction frame and the accompanying body needs to be brought into a shooting target, the accompanying body and the shooting target are combined to obtain a new shooting target, the new shooting target is used for replacing the shooting target, the outline information of the shooting target is obtained again, and a new round of generation and output process of the target frame construction frame is started. When a plurality of cosubs exist in the initial frame construction, and part or all of the cosubs are necessary to be taken as the shooting targets, all the cosubs which are necessary to be taken as the shooting targets are combined with the shooting targets to obtain new shooting targets, the new shooting targets are used for replacing the shooting targets, and the generation and output processes of a new round of target frame construction are restarted.
In the embodiment, in a scene with dense people, the shooting target is dynamically adjusted, so that the composition with uncertain people number and uncertain actions is adaptively realized. Although the present embodiment has been described with the imaging target being a person, it is obvious that the imaging target is also a clearly outlined object such as an animal, a plant, or a building, and therefore, the description thereof is not repeated.
In another embodiment of the present invention, as shown in FIG. 3, an automatic photography patterning device 100, comprises:
and a contour information acquiring module 110 for acquiring contour information of the shooting target.
The composition frame generating module 120 is configured to establish an outer envelope frame of the shooting target according to the contour information; and generating an initial frame structure according to the outer envelope frame, wherein the initial frame structure comprises the outer envelope frame and is concentric with the outer envelope frame.
The contour information is human body contour information which comprises head frame coordinates, body frame coordinates and joint point coordinates of the shooting target. The outer enveloping frame for establishing the shooting target according to the contour information comprises: taking the minimum value of the head frame coordinate, the body frame coordinate and the x coordinate value in each joint point coordinate of the shooting target as a left x coordinate value; taking the maximum value of the head frame coordinate, the body frame coordinate and the x coordinate value in each joint point coordinate of the shooting target as a right x coordinate value; taking the minimum value of the head frame coordinate, the body frame coordinate and the y coordinate value in each joint point coordinate of the shooting target as a lower y coordinate value; taking the maximum value of the head frame coordinate, the body frame coordinate and the y coordinate value in each joint point coordinate of the shooting target as an upper y coordinate value; obtaining a left upper corner coordinate and a right lower corner coordinate according to the left side x coordinate value, the right side x coordinate value, the lower side y coordinate value and the upper side y coordinate value, and determining an outer envelope frame of the shooting target according to the left upper corner coordinate and the right lower corner coordinate; or obtaining a lower left corner coordinate and an upper right corner coordinate according to the left side x coordinate value, the right side x coordinate value, the lower side y coordinate value and the upper side y coordinate value, and determining an outer envelope frame of the shooting target according to the lower left corner coordinate and the upper right corner coordinate.
The center of the outer envelope frame is the center of the initial frame, and a rectangular frame (namely the initial frame) completely containing the outer envelope frame is obtained according to a preset photographing aspect ratio.
Preferably, the width ratio and the height ratio are respectively calculated according to the width and the height of the outer envelope frame and a preset shooting width-height ratio; comparing the width ratio and the height ratio; when the height ratio is larger than the width ratio, calculating the width of an initial framing frame according to the height of the outer envelope frame and the photographic width-height ratio, keeping the height of the outer envelope frame unchanged, symmetrically extending the width of the outer envelope frame to the width of the initial framing frame, and obtaining a rectangular frame as the initial framing frame; and when the height ratio is not greater than the width ratio, calculating the height of the initial framing frame according to the width of the outer envelope frame and the photographic width-height ratio, keeping the width of the outer envelope frame unchanged, symmetrically extending the height of the outer envelope frame to the height of the initial framing frame, and obtaining the rectangular frame as the initial framing frame.
And an accompanying body judging module 130, configured to judge whether an accompanying body exists in the initial frame, where the accompanying body is another object that can be photographed.
And a composition frame output module 140, configured to output the initial composition frame as a target composition frame when no accompany body exists in the initial composition frame.
The partner determining module 130 is further configured to determine whether a partner is also required to be a shooting target when the partner exists in the initial composition frame; when at least two cosomes exist in the initial composition frame, respectively judging whether each cosome must also be taken as a shooting target; it is judged whether or not there is a companion which must also be a photographic subject.
The judging step of whether each partner must also be the shooting target is as follows: when a cosome exists in the initial composition frame, calculating the overlapping area of the cosome and the initial composition frame, and calculating the proportion of the overlapping area to the whole area of the cosome; judging whether the proportion is greater than or equal to a preset value; when the proportion is larger than or equal to a preset value, the accompany body must also be taken as a shooting target; and when the proportion is smaller than a preset value, the accompany body is not taken as a shooting target.
Specifically, when a plurality of cosubs exist in the initial frame, each cosubs is determined, and which cosubs are not taken as the shooting target and which must be taken as the shooting target. And judging whether a partner exists and must be used as a shooting target according to the judgment result of each partner.
The judgment method of each accompany body is the same, and comprises the following steps: and calculating the overlapping area of the cosome and the initial framing frame, and calculating the proportion of the area to the whole area of the cosome. When the proportion is larger than or equal to a preset value, the accompany body must also be taken as a shooting target; otherwise, the partner is not a photographic target.
The composition frame generation module 120 is further configured to, when there are cosubjects in the initial composition frame and all the cosubjects are not taken as shooting targets, move the initial composition frame to obtain a composition frame with the minimum influence of the cosubjects as a target composition frame, and output the target composition frame.
Specifically, when the initial composition frame has the cosome and all the cosomes are not taken as the shooting targets, the initial composition frame is moved once or for multiple times to regenerate a plurality of new composition frames, and the effective composition frame with the minimum cosome influence degree is selected from the obtained new composition frames and the initial composition frames to be output as the target composition frame. The effective frame is a frame including an outer envelope of the object.
The initial framing frame may be attempted to be translated in one or more combinations selected from the 4 directions up, down, left, and right. Further, when the height of the initial framing frame is greater than the height of the outer envelope frame, an upward or downward movement may be performed. When the width of the initial framing frame is greater than the width of the outer envelope frame, the left or right movement may be performed. Further, an appropriate moving direction is selected according to the relative position relationship between the cosome and the shooting target, and preferably, the initial framing frame is moved in the direction of moving out of the cosome.
Alternatively, when only one cosome is in the initial frame, the cosome is set as the reference cosome. When a plurality of cosubs exist in the initial frame, one cosubs is selected as a reference cosubs. And moving the initial frame structure once according to a preset step along the direction of moving out the reference cosome to obtain a new frame structure. And judging whether the new frame is a valid frame (namely, the frame completely comprises the outer envelope frame of the shooting target). And if the frame is not the effective frame, outputting the initial frame as the target frame. If the frame is a valid frame, the cosome influence degree of the new frame is further calculated and compared with the cosome influence degree of the initial frame. And if the influence degree of the cosome is smaller, outputting the new frame as a target frame.
By judging whether the new frame is an effective frame, the output target frame is ensured to be an effective frame without the situations of hand interception, foot interception and the like.
Further, an effective composition frame with the minimum influence degree of the cosome in a certain direction is obtained through multiple continuous translations, and the effective composition frame is output as a target composition frame. Specifically, for example, when there is only one cosome in the initial frame, the cosome is set as the reference cosome. When a plurality of cosubs exist in the initial frame, one cosubs is selected as a reference cosubs. And moving the initial frame structure once according to a preset step along the direction of moving out the reference cosome to obtain a first new frame structure. And when the first new frame is an effective frame and the influence of the cosome is smaller, continuously moving along the original direction to obtain a second new frame, judging the influence and effectiveness of the cosome of the second new frame, and repeating the steps until the influence of the cosome of the Nth new frame is larger than that of the previous frame or the Nth new frame is not the effective frame. And outputting the N-1 th new frame structure frame as a target frame structure frame. Through the mode, the effective picture frame with the minimum effect of the cosome in a certain direction can be obtained, the effect of the cosome is further reduced, and the picture composition quality is improved.
Further, when a plurality of cosomes exist in the initial frame, selecting one cosome as a reference cosome, continuously moving the initial frame along the direction of moving out the reference cosome, and obtaining an effective frame with the minimum influence degree of the cosome in the direction according to the method and marking the effective frame as a frame candidate; selecting another cosome as a reference cosome, and repeating the method to obtain another corresponding frame candidate; thus, the frame candidate frame in each cosome moving-out direction is obtained, and the frame candidate frame with the minimum cosome influence degree is selected from the frame candidates and is output as the target frame.
Factors for evaluating the influence of the cosome include the overlapping area of the picture frame and the cosome and/or the number of cosome overlapping the picture frame.
The cosome determining module 130 is further configured to, when a cosome exists in the initial composition frame and at least one cosome exists and must also serve as a shooting target, form a new shooting target with the cosome that must also serve as the shooting target and the shooting target, and replace the shooting target with the new shooting target to regenerate the target composition frame.
It should be noted that the embodiment of the automatic photographing and composition apparatus provided by the present invention and the embodiment of the automatic photographing and composition method provided by the foregoing embodiments are all based on the same inventive concept, and can achieve the same technical effects. Accordingly, other specific contents of the embodiment of the automatic photography and composition apparatus can refer to the description of the embodiment contents of the automatic photography and composition method described above.
In one embodiment of the present invention, as shown in fig. 4, an electronic device 400 includes a memory 410 and a processor 420. The memory 410 is used to store a computer program 430. The processor, when running the computer program, implements the automatic photography composition method as described above.
As an example, the processor 420, when executing the computer program, implements steps S100 to S700 according to the foregoing description. The processor 420 implements the functions of the modules and units of the automatic photography/patterning device 100 described above when executing the computer program. As yet another example, the processor 420, when executing the computer program, implements the functions of the outline information acquisition module 110, the composition frame generation module 120, the satellite determination module 130, and the composition frame output module 140.
Alternatively, the computer program may be divided into one or more modules/units according to the particular needs to accomplish the invention. Each module/unit may be a series of computer program instruction segments capable of performing a particular function. The computer program instruction segments are used to describe the execution of the computer program in the automated photographic patterning device 100. As an example, the computer program may be divided into respective modules/units in a virtual device, such as a contour information acquisition module, a composition frame generation module, a satellite determination module, and a composition frame output module.
The processor is configured to implement automatic photography composition by executing the computer program. The processor may be a Central Processing Unit (CPU), Graphics Processing Unit (GPU), Digital Signal Processor (DSP), Application Specific Integrated Circuit (ASIC), Field Programmable Gate Array (FPGA), general purpose processor or other logic device, etc., as desired.
The memory may be any internal storage unit and/or external storage device capable of storing data and programs, such as a plug-in hard disk, a smart card (SMC), a Secure Digital (SD) card, a flash memory card, and the like. The memory is used to store computer programs, other programs for the automatic photo-patterning device 100, and data.
The electronic device 400 may be any computer device, such as a desktop computer (desktop), a laptop computer (laptop), a Personal Digital Assistant (PDA), or a server (server). The electronic apparatus 400 may further include an input/output device, a display device, a network access device, a bus 440, and the like, as required. The electronic device 400 may also be a single chip computer or a computing device integrating a Central Processing Unit (CPU) and a Graphics Processing Unit (GPU).
It will be understood by those skilled in the art that the above-mentioned units and modules for implementing the corresponding functions are divided for the purpose of convenient illustration and description, and the above-mentioned units and modules are further divided or combined according to the application requirements, that is, the internal structures of the devices/apparatuses are divided and combined again to implement the above-mentioned functions. Each unit and module in the above embodiments may be separate physical units, or two or more units and modules may be integrated into one physical unit. The units and modules in the above embodiments may implement corresponding functions by using hardware and/or software functional units. Direct coupling, indirect coupling or communication connection among a plurality of units, components and modules in the above embodiments can be realized through a bus or an interface; the coupling, connection, etc. between the multiple units or devices may be electrical, mechanical, or the like. Accordingly, the specific names of the units and modules in the above embodiments are only for convenience of description and distinction, and do not limit the scope of protection of the present application.
In one embodiment of the present invention, a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, can implement the automatic photography composition method as recited in the preceding embodiments. That is, when part or all of the technical solutions of the embodiments of the present invention contributing to the prior art are embodied by means of a computer software product, the computer software product is stored in a computer-readable storage medium. The computer readable storage medium may be any portable computer program code entity apparatus or device, such as a U disk, a removable magnetic disk, a magnetic disk, an optical disk, a computer memory, a read-only memory, a RAM, etc.
In one embodiment of the present invention, as shown in fig. 5, an automatic photographing apparatus 500 includes:
the automatic photography patterning device 100 according to any of the above embodiments is used to output a target framing frame.
A photographing unit 502 for performing a photographing operation when the target framing frame is received. The photographing part 502 is used to fix optical image photographing on a corresponding storage medium. Alternatively, the photographing part 502 may be a digital camera, so that an optical image can be converted into data to be stored. The image capturing means such as the image capturing means 502 may be a technique known to those skilled in the art.
It should be noted that the above embodiments can be freely combined as necessary. The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.

Claims (18)

1. An automatic photographic composition method, comprising:
acquiring contour information of a shooting target;
generating an initial framing frame for the shooting target according to the contour information;
judging whether an accompanying body exists in the initial framing frame, wherein the accompanying body is other photographable targets;
when no accompany body exists in the initial composition frame, outputting the initial composition frame as a target composition frame;
when an accompanying body exists in the initial composition frame, judging whether the accompanying body exists or not and the accompanying body is also taken as a shooting target;
when the cosome exists in the initial composition frame and all the cosomes are not taken as the shooting targets, regenerating a cosome influence degree not larger than the current composition frame and outputting the cosome influence degree as a target composition frame;
when a cosome exists in the initial composition frame and at least one cosome exists and must also be taken as a shooting target, the cosome which must also be taken as the shooting target and the shooting target form a new shooting target, and the new shooting target is used for replacing the shooting target to re-execute the steps;
wherein, the regenerating the influence degree of the cosome is not more than the current composition frame, and outputting the same as the target composition frame comprises:
obtaining at least one new frame by moving the initial frame at least once;
and selecting an effective frame with the minimum cosome influence degree from the at least one obtained new frame and the initial frame as a target frame, and outputting the target frame.
2. The automatic photography composition method according to claim 1, wherein the generating an initial composition frame for the photographic subject according to the outline information includes:
establishing an outer envelope frame of the shooting target according to the contour information;
and generating an initial frame structure according to the outer envelope frame, wherein the initial frame structure comprises the outer envelope frame and is concentric with the outer envelope frame.
3. The automatic photography patterning method according to claim 2, wherein the contour information is human body contour information including head frame coordinates, body frame coordinates, and joint point coordinates of the photographic subject;
the outer enveloping frame for establishing the shooting target according to the contour information comprises:
taking the minimum value of the head frame coordinate, the body frame coordinate and the x coordinate value in each joint point coordinate of the shooting target as a left x coordinate value;
taking the maximum value of the head frame coordinate, the body frame coordinate and the x coordinate value in each joint point coordinate of the shooting target as a right x coordinate value;
taking the minimum value of the head frame coordinate, the body frame coordinate and the y coordinate value in each joint point coordinate of the shooting target as a lower y coordinate value;
taking the maximum value of the head frame coordinate, the body frame coordinate and the y coordinate value in each joint point coordinate of the shooting target as an upper y coordinate value;
obtaining a left upper corner coordinate and a right lower corner coordinate according to the left side x coordinate value, the right side x coordinate value, the lower side y coordinate value and the upper side y coordinate value, and determining an outer envelope frame of the shooting target according to the left upper corner coordinate and the right lower corner coordinate;
or the like, or, alternatively,
and obtaining a lower left corner coordinate and an upper right corner coordinate according to the left side x coordinate value, the right side x coordinate value, the lower side y coordinate value and the upper side y coordinate value, and determining an outer envelope frame of the shooting target according to the lower left corner coordinate and the upper right corner coordinate.
4. The automated photographic composition method of claim 3, wherein the generating an initial composition frame from the outer envelope frame comprises: respectively calculating the width ratio and the height ratio according to the width and the height of the outer envelope frame and a preset shooting width-height ratio;
comparing the width ratio and the height ratio;
when the height ratio is larger than the width ratio, calculating the width of an initial framing frame according to the height of the outer envelope frame and the photographic width-height ratio, keeping the height of the outer envelope frame unchanged, and symmetrically extending the width of the outer envelope frame to the width of the initial framing frame to obtain a rectangular frame serving as the initial framing frame;
and when the height ratio is not greater than the width ratio, calculating the height of the initial framing frame according to the width of the outer envelope frame and the photographic width-height ratio, keeping the width of the outer envelope frame unchanged, symmetrically extending the height of the outer envelope frame to the height of the initial framing frame, and obtaining the rectangular frame as the initial framing frame.
5. The automatic photography composition method according to claim 1, wherein said determining whether there is a companion body that must also be taken as a photographic subject when there is a companion body in the initial composition frame comprises:
when the cosome exists in the initial composition frame, respectively calculating the overlapping area ratio of each cosome, wherein the overlapping area ratio is the proportion of the overlapping area of the cosome and the initial composition frame to the whole area of the cosome;
judging whether the corresponding partner must be also used as a shooting target according to the overlapping area ratio of each partner;
and judging whether one accompanying body is present and must be used as a shooting target according to the judgment results of all the accompanying bodies.
6. The automatic photography and composition method according to claim 1, wherein the regenerated co-body influence degree is not greater than the current composition frame, and the generated co-body influence degree is output as a target composition frame, and can be replaced by:
selecting one accompanying body from the accompanying bodies, and setting the one accompanying body as a reference accompanying body;
and continuously moving the initial frame structure along the direction of moving out the reference cosome until an effective frame structure with the minimum influence degree of the cosome in the direction is obtained, taking the effective frame structure as a target frame structure, and outputting the target frame structure.
7. The automatic photography and composition method according to claim 1, wherein the regenerated co-body influence degree is not greater than the current composition frame, and the generated co-body influence degree is output as a target composition frame, and can be replaced by:
when a plurality of cosubs exist in the initial composition frame, traversing all the cosubs, sequentially obtaining an effective composition frame with the minimum cosubs influence degree in the moving-out direction of each cosubs, and taking the effective composition frame as a candidate composition frame corresponding to the cosubs;
selecting a candidate composition frame with the minimum influence degree of a cosome from the candidate composition frames corresponding to the obtained cosomes as a target composition frame, and outputting the target composition frame;
the step of obtaining the candidate framing frame corresponding to each cosome comprises the following steps:
setting the cosome as a reference cosome;
and continuously moving the initial frame structure frame along the direction of moving out the reference cosome until an effective frame structure frame with the minimum influence degree of the cosome in the direction is obtained and is used as a frame candidate frame corresponding to the cosome.
8. The automatic photo-composition method as claimed in claim 6 or 7, wherein said continuously moving said initial frame in the direction of moving said reference cosome until obtaining an effective frame with the least influence of the cosome in the direction comprises:
setting the initial frame as a reference frame;
moving the reference picture frame along the direction of moving out the reference accompany body to obtain a new picture frame;
when the volume influence degree of the new framed frame is larger than or equal to the volume influence degree of the reference framed frame or the new framed frame is not an effective framed frame, stopping moving, and taking the reference framed frame as the effective framed frame with the minimum volume influence degree in the direction;
and when the influence degree of the cosome of the new frame is smaller than that of the reference frame and the new frame is an effective frame, replacing the reference frame with the new frame, continuing to move along the direction of moving out the reference cosome, and repeating the steps.
9. The automatic photographic composition method of claim 1, or 6, or 7, wherein:
factors for evaluating the influence of the cosome include the overlapping area of the picture frame and the cosome and/or the number of cosome overlapping the picture frame.
10. An automatic photographic patterning device, comprising:
the contour information acquisition module is used for acquiring the contour information of the shooting target;
the framing frame generation module is used for generating an initial framing frame for the shooting target according to the outline information;
the cosome judging module is used for judging whether a cosome exists in the initial framing frame, wherein the cosome is other photographable targets;
the composition frame output module is used for outputting the initial composition frame as a target composition frame when no accompany body exists in the initial composition frame;
the accompany body judging module is further used for judging whether an accompany body exists in the initial composition frame and is also used as a shooting target;
the composition frame generation module is further used for regenerating a composition frame with an influence degree not greater than that of the current body when the body is present in the initial composition frame and all the bodies are not taken as shooting targets, and outputting the composition frame as a target composition frame;
the cosome judging module is further used for forming a new shooting target by the cosome which must be used as the shooting target and the shooting target when the cosome exists in the initial composition frame and at least one cosome which must also be used as the shooting target exists, and replacing the shooting target with the new shooting target to regenerate the target composition frame;
the composition frame generation module is further used for obtaining at least one new composition frame by moving the initial composition frame at least once when the initial composition frame has the cosome and all the cosomes are not taken as shooting targets; and selecting an effective frame with the minimum cosome influence degree from the at least one obtained new frame and the initial frame as a target frame, and outputting the target frame.
11. The automatic photographic patterning device of claim 10, wherein:
the composition frame generation module is further used for establishing an outer envelope frame of the shooting target according to the outline information; and generating an initial frame structure according to the outer envelope frame, wherein the initial frame structure comprises the outer envelope frame and is concentric with the outer envelope frame.
12. The automatic photographic patterning device of claim 10, wherein:
the cosome judging module is further configured to calculate an overlapping area proportion of each cosome when the cosome exists in the initial composition frame, where the overlapping area proportion is a proportion of the overlapping area of the cosome and the initial composition frame to the whole area of the cosome; judging whether the corresponding partner must be also used as a shooting target according to the overlapping area ratio of each partner; and judging whether one accompanying body is present and must be used as a shooting target according to the judgment results of all the accompanying bodies.
13. The automatic photographic patterning device of claim 10, wherein:
when the composition frame generation module has an assistant body in the initial composition frame and all the assistant bodies are not taken as the shooting targets, the composition frame generation module regenerates the composition frame with the influence degree of the assistant body not greater than the current composition frame and outputs the composition frame as a target composition frame, and can be replaced by:
when an accompanying body exists in the initial composition frame and the accompanying body is not used as a shooting target, selecting one accompanying body from the accompanying bodies and setting the one accompanying body as a reference accompanying body; and continuously moving the initial frame structure along the direction of moving out the reference cosome until an effective frame structure with the minimum influence degree of the cosome in the direction is obtained, taking the effective frame structure as a target frame structure, and outputting the target frame structure.
14. The automatic photographic patterning device of claim 10, wherein:
when the composition frame generation module has an assistant body in the initial composition frame and all the assistant bodies are not taken as the shooting targets, the composition frame generation module regenerates the composition frame with the influence degree of the assistant body not greater than the current composition frame and outputs the composition frame as a target composition frame, and can be replaced by:
when an accompanying body exists in the initial composition frame, the accompanying body is not taken as a shooting target, and a plurality of accompanying bodies exist in the initial composition frame, traversing all the accompanying bodies, sequentially obtaining an effective composition frame with the smallest effect degree of the accompanying body in the moving-out direction of each accompanying body, and taking the effective composition frame as a candidate composition frame corresponding to the accompanying body; selecting a candidate composition frame with the minimum influence degree of a cosome from the candidate composition frames corresponding to the obtained cosomes as a target composition frame, and outputting the target composition frame;
the step of obtaining the candidate framing frame corresponding to each cosome comprises the following steps:
setting the cosome as a reference cosome; and continuously moving the initial frame structure frame along the direction of moving out the reference cosome until an effective frame structure frame with the minimum influence degree of the cosome in the direction is obtained and is used as a frame candidate frame corresponding to the cosome.
15. The automatic photographic patterning device of claim 10, or 13, or 14, wherein:
factors for evaluating the influence of the cosome include the overlapping area of the picture frame and the cosome and/or the number of cosome overlapping the picture frame.
16. An automatic photographing apparatus, comprising:
the automatic photographic patterning device of any one of claims 10-15, configured to output a target patterning frame;
and the shooting component is used for executing shooting action when the target framing frame is received.
17. An electronic device, comprising:
a memory for storing a computer program;
a processor for implementing the automatic photography patterning method according to any one of claims 1 to 9 when running the computer program.
18. A storage medium having a computer program stored thereon, characterized in that:
the computer program, when executed by a processor, implements the automatic photography patterning method according to any one of claims 1 to 9.
CN201910703960.7A 2019-07-31 2019-07-31 Photographic composition method, photographic composition device, photographic equipment, electronic device and storage medium Active CN110493512B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910703960.7A CN110493512B (en) 2019-07-31 2019-07-31 Photographic composition method, photographic composition device, photographic equipment, electronic device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910703960.7A CN110493512B (en) 2019-07-31 2019-07-31 Photographic composition method, photographic composition device, photographic equipment, electronic device and storage medium

Publications (2)

Publication Number Publication Date
CN110493512A CN110493512A (en) 2019-11-22
CN110493512B true CN110493512B (en) 2021-08-27

Family

ID=68548891

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910703960.7A Active CN110493512B (en) 2019-07-31 2019-07-31 Photographic composition method, photographic composition device, photographic equipment, electronic device and storage medium

Country Status (1)

Country Link
CN (1) CN110493512B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20230056334A1 (en) * 2020-02-20 2023-02-23 Shenzhen Hollyland Technology Co., Ltd. Methods for controlling video data acquisition, apparatus, and systems for wireless transmission
CN111461017B (en) * 2020-04-01 2024-01-19 杭州视在科技有限公司 High-precision recognition method for kitchen work clothes after catering in urban scale
CN116684748B (en) * 2023-08-01 2023-09-26 世优（北京）科技有限公司 Photographic composition frame generation method and device and photographic equipment
CN116708995B (en) * 2023-08-01 2023-09-29 世优（北京）科技有限公司 Photographic composition method, photographic composition device and photographic equipment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1431912A2 (en) * 2002-12-20 2004-06-23 Eastman Kodak Company Method and system for determining an area of importance in an archival image
CN103227894A (en) * 2012-01-26 2013-07-31 索尼公司 Image processing apparatus, image processing method, and recording medium
CN109743493A (en) * 2018-08-27 2019-05-10 幻想动力(上海)文化传播有限公司 Automatic photography patterning process, device, Automatic Photographic Equipment, electronic device and computer readable storage medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106775238A (en) * 2016-12-14 2017-05-31 深圳市金立通信设备有限公司 A kind of photographic method and terminal
CN106937053B (en) * 2017-03-29 2019-05-17 维沃移动通信有限公司 A kind of digital image stabilization method and mobile terminal of video image

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1431912A2 (en) * 2002-12-20 2004-06-23 Eastman Kodak Company Method and system for determining an area of importance in an archival image
CN103227894A (en) * 2012-01-26 2013-07-31 索尼公司 Image processing apparatus, image processing method, and recording medium
CN109743493A (en) * 2018-08-27 2019-05-10 幻想动力(上海)文化传播有限公司 Automatic photography patterning process, device, Automatic Photographic Equipment, electronic device and computer readable storage medium

Also Published As

Publication number Publication date
CN110493512A (en) 2019-11-22

Similar Documents

Publication Publication Date Title
CN110493512B (en) Photographic composition method, photographic composition device, photographic equipment, electronic device and storage medium
US11037281B2 (en) Image fusion method and device, storage medium and terminal
KR102319177B1 (en) Method and apparatus, equipment, and storage medium for determining object pose in an image
EP3757890A1 (en) Method and device for image processing, method and device for training object detection model
CN108921782B (en) Image processing method, device and storage medium
US10284789B2 (en) Dynamic generation of image of a scene based on removal of undesired object present in the scene
US10304164B2 (en) Image processing apparatus, image processing method, and storage medium for performing lighting processing for image data
US10559062B2 (en) Method for automatic facial impression transformation, recording medium and device for performing the method
US9542735B2 (en) Method and device to compose an image by eliminating one or more moving objects
WO2018103244A1 (en) Live streaming video processing method, device, and electronic apparatus
US11176355B2 (en) Facial image processing method and apparatus, electronic device and computer readable storage medium
CN109474780A (en) A kind of method and apparatus for image procossing
CN111008935B (en) Face image enhancement method, device, system and storage medium
WO2018058476A1 (en) Image correction method and device
JP6272071B2 (en) Image processing apparatus, image processing method, and program
CN111654624A (en) Shooting prompting method and device and electronic equipment
US10282633B2 (en) Cross-asset media analysis and processing
JP5278307B2 (en) Image processing apparatus and method, and program
CN112036342A (en) Document snapshot method, device and computer storage medium
CN112689085A (en) Method, device and system for identifying PPT screen projection area and electronic equipment
JP6226050B2 (en) Image composition method and apparatus
CN113691731B (en) Processing method and device and electronic equipment
TWI823491B (en) Optimization method of a depth estimation model, device, electronic equipment and storage media
JP2017512398A (en) Method and apparatus for presenting video
CN110849317B (en) Method for determining included angle between display screens, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20210706

Address after: 201203 3rd floor, building 1, No. 400, Fangchun Road, Pudong New Area (Shanghai) pilot Free Trade Zone, Shanghai

Applicant after: Shanghai Tianli Intelligent Technology Co.,Ltd.

Address before: 200335 room 1446, 1st floor, building 8, 33 Guangshun Road, Changning District, Shanghai

Applicant before: FANTASY POWER (SHANGHAI) CULTURE COMMUNICATION Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20230803

Address after: 4B28-29, Ritan International Trade Center, No. 17 Ritan North Road, Chaoyang District, Beijing, 100020

Patentee after: 4U (BEIJING) TECHNOLOGY CO.,LTD.

Address before: 201203 3rd floor, building 1, No. 400, Fangchun Road, Pudong New Area (Shanghai) pilot Free Trade Zone, Shanghai

Patentee before: Shanghai Tianli Intelligent Technology Co.,Ltd.

TR01 Transfer of patent right