WO2020082866A1 - Procédé de synthèse de trajectoire de mouvement et dispositif électronique - Google Patents

Procédé de synthèse de trajectoire de mouvement et dispositif électronique Download PDF

Info

Publication number
WO2020082866A1
WO2020082866A1 PCT/CN2019/101435 CN2019101435W WO2020082866A1 WO 2020082866 A1 WO2020082866 A1 WO 2020082866A1 CN 2019101435 W CN2019101435 W CN 2019101435W WO 2020082866 A1 WO2020082866 A1 WO 2020082866A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
images
frame
moving subject
area
Prior art date
Application number
PCT/CN2019/101435
Other languages
English (en)
Chinese (zh)
Inventor
魏祺
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2020082866A1 publication Critical patent/WO2020082866A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/2228—Video assist systems used in motion picture production, e.g. video cameras connected to viewfinders of motion picture cameras or related video signal processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30241—Trajectory

Definitions

  • the embodiments of the present invention relate to the technical field of image processing, and in particular, to a motion track synthesis method and an electronic device.
  • Taking pictures and videos of scenes of moving subjects is one of the common life scenes of taking pictures with cameras.
  • Program sports scenes are always fleeting, such as slam dunks during basketball games, dribbling shots during football games, high jumps, long jumps, etc.
  • a sports silhouette is generated, which combines multiple sports images into one. In the image, a series of silhouette images of the trajectory of the moving subject can be synthesized.
  • the inventor found that there are at least the following problems: the moving speed of the moving subject is different, the direction of the movement is uncertain, and the size of the moving subject is different. In the composite image, the overlapping of the moving subjects may appear, and the complete motion cannot be seen. The action of the subject is shown in Figure 1, so the synthesis effect is not very good.
  • the purpose of the embodiments of the present invention is to provide a method for synthesizing a motion track and an electronic device, so that the motion subjects in the synthesized motion track do not overlap, and the synthesis effect is better.
  • an embodiment of the present invention provides a method for synthesizing a motion track, including: acquiring multiple frames of images; wherein the multiple frames of images are arranged according to the acquisition time; the multiple frames of images are divided according to a preset manner Into a plurality of grid regions; selecting from the multi-frame images several frames of images that meet a preset condition; wherein, the preset conditions include that the several frames of images all contain a moving subject and motion in any two frames of images The grid areas occupied by the main body do not overlap; the motion trajectory of the moving main body is synthesized according to the selected frames of images.
  • An embodiment of the present invention further provides an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; a camera connected to the at least one processor and the memory; wherein , The camera is used to collect images; the memory stores instructions executable by the at least one processor, the instructions are executed by the at least one processor, so that the at least one processor can perform the above movement Track synthesis method.
  • Embodiments of the present invention also provide a computer-readable storage medium that stores a computer program, and when the computer program is executed by a processor, the above-mentioned motion track synthesis method is implemented.
  • FIG. 1 is a schematic diagram of a motion trajectory synthesized in the prior art
  • FIG. 2 is a flowchart of a method for synthesizing a motion track according to the first embodiment of the present invention
  • FIG. 3 is a schematic diagram of the synthesized motion track according to the first embodiment of the present invention.
  • FIG. 4 is a flowchart of a motion track synthesis method according to a second embodiment of the present invention.
  • FIG. 5 is a flowchart of a motion track synthesis method according to a third embodiment of the present invention.
  • FIG. 6 is a schematic diagram of a grid area divided according to the third embodiment of the present invention.
  • FIG. 7 is a flowchart of a screening method in sub-step 3032 according to the third embodiment of the present invention.
  • FIG. 8 is a flowchart of a screening method in sub-step 3032 according to the fourth embodiment of the present invention.
  • FIG. 9 is a flowchart of a motion track synthesis method according to a fifth embodiment of the present invention.
  • FIG. 10 is a schematic diagram of an electronic device according to a sixth embodiment of the present invention.
  • the first embodiment of the present invention relates to a motion track synthesis method.
  • the specific process is shown in Figure 2.
  • Step 101 Acquire multi-frame images; wherein, the multi-frame images are arranged according to the acquisition time;
  • Step 102 Divide the multi-frame images into multiple grid areas according to a preset method
  • Step 103 Select a plurality of frames of images satisfying preset conditions from the multi-frame images; wherein the preset conditions include that several frames of images include moving subjects and the grid area occupied by the moving subjects in any two frames of images does not overlap;
  • Step 104 Synthesize the motion trajectory of the moving subject according to the selected frames of images.
  • this embodiment divides the image into a plurality of grid areas according to a preset method; selects from a plurality of frames of images that meet a preset condition for synthesis, where the preset condition includes an image
  • the preset condition includes an image
  • the grid method is used to select the image for synthesis, which is not affected by the movement speed of the moving subject, the direction of movement, and the change in the size of the moving subject. it is good.
  • the motion trajectory synthesis method of this embodiment can be applied to an electronic device, and the electronic device is, for example, a personal computer, a mobile phone, etc., and is not limited thereto. Please refer to FIG. 2 and FIG. 3 together, where FIG. 3 is a schematic diagram of the synthesized motion track in this embodiment.
  • the electronic device may collect multiple frames of images through a camera; the camera may be integrated on the electronic device or may be externally connected.
  • the camera may acquire images at a preset frequency, where the number of frames of the acquired image may be preset, for example, preset 60 frames, the camera may acquire 60 frames of images at a preset frequency; or, the time for acquiring images may be preset, for example If the preset time is 10 seconds, the camera will collect images at a preset frequency, and the acquisition will stop after 10 seconds.
  • the number of images collected is related to the preset time and preset frequency.
  • the collected multi-frame images are arranged according to the acquisition time.
  • each frame of image may be divided into multiple grid areas in the preset manner.
  • Each area divided by a dotted line in FIG. 3 is a grid area.
  • the preset method can be set as required. For example, it is preset that the image is divided into X grid areas, then the width W1 and height h1 of each grid area are calculated according to the width W and height h of the image, and then the grid division is performed, where the width W of the image
  • the height h can be calculated from the collected images, or can be preset in advance; or, the width W1 and height h1 of each grid area are preset, and grid division can be performed at this time; the above is only an example, not This is limited.
  • X is an integer greater than 0. When the image size is constant, the larger X is, the smaller the grid area is.
  • each frame The total area occupied by the image is the same, that is, each frame of the image is divided into grids according to a preset method, and has the same number of grid areas, and the coordinate positions of the corresponding grid areas are the same;
  • the grid regions of the frame image are encoded in the same order (for example, from the first row to the last row, and sequentially encoded from left to right), and the same grid region in each frame image is the corresponding raster. Grid area.
  • Step 103 can be implemented in the following manner.
  • each frame of the image is sequentially motion-recognized, and the images containing the moving subject are identified, and the images containing the moving subject are also arranged in sequence according to the acquisition time; wherein, motion recognition can be used in the prior art
  • motion recognition can be used in the prior art
  • the method of extracting and matching based on feature points will not be described in detail here.
  • each grid region can be numbered; then select a frame of image first, and determine the number of the grid region occupied by the moving subject in the selected image.
  • the selected image is considered to meet the preset conditions Image, as in the above example, you can select the sixth frame image, and confirm that the number of the grid area occupied by the moving subject in the sixth frame image is 1, 2, where the sixth frame image is considered to meet the preset conditions Images; then, according to the order of the images, the grid areas occupied by the moving subjects in each image are separately judged.
  • the images from the 7th frame to the 45th frame are sequentially filtered, assuming the 7th frame If the number of grid areas occupied by moving subjects in the image is 3 or 4, it is determined that the grid area occupied by moving subjects in the seventh frame image does not overlap with the grid area occupied by moving subjects in the sixth frame image (number 3, The grid area of 4 and the grid areas of numbers 1 and 2 do not overlap), so the image of the seventh frame is considered to meet the preset conditions; the number of grid areas occupied by moving subjects in the image of the eighth frame is 4, 6, 7, it is determined that the 8th frame of the image The grid area occupied by the moving subject overlaps with the grid area occupied by the moving subject in the 7th frame image (the 8th frame image and the 7th frame image both occupy the grid area of number 4), therefore, the 8th frame image is not The image that meets the preset conditions can be discarded; the number of the grid area occupied by the moving subject in the 9th frame image is 7, 9, 10, then the grid area occupied by the moving subject
  • the selected image can be set as needed, any frame of the image containing the moving subject can be used as the selected image, for example, the first frame of the image as the selected image (such as the 6th in the above example) Frame image).
  • step 103 can also be implemented in the following manner. According to the arrangement order, perform motion recognition on each frame in sequence and when recognizing the image containing the moving subject, determine the grid area occupied by the moving subject in the image, and determine the grid occupied by the moving subject in the image Whether the grid area overlaps with the grid area occupied by moving subjects in other images.
  • motion recognition is performed on the first frame image to the fifth frame image in sequence, and no moving subject is identified, then the first frame image to the fifth frame image are discarded; the sixth frame image is subjected to motion recognition and Identified the moving subject, and determined that the grid area occupied by the moving subject is numbered 1, 2.
  • the sixth frame image is the first to identify the moving subject
  • the sixth frame image is considered to meet the pre- Set the conditional first image, perform motion recognition on the seventh frame image and identify the moving subject, and determine the number of the grid area occupied by the moving subject as 3, 4, then determine the moving subject in the seventh frame image
  • the occupied grid area does not overlap with the grid area occupied by the moving subject in the sixth frame image (the grid areas numbered 3 and 4 and the grid areas numbered 1 and 2 do not overlap), so the seventh frame image is considered to be satisfactory Images with preset conditions; the recognition method of the 8th frame image to the 45th frame image is similar to the above example, and will not be repeated here; the moving subjects are not recognized in the 46th frame image to the 60th frame image, then the Images from frame 46 to frame 60 are discarded.
  • the moving subjects in the image refer to the pictures of the moving subjects in the image.
  • step 104 if the moving subjects in the image are separated from the background image, the moving subjects separated in each frame image are combined on a background image, if the moving subjects in the image are not separated from the background image.
  • the second embodiment of the present invention relates to a motion track synthesis method.
  • the second embodiment is substantially the same as the first embodiment, and the main difference is that in the second embodiment of the present invention, motion recognition will be performed on the currently collected image, and the image containing the moving subject is selected, and it is repeated multiple times in a row When no moving subject is identified in the collected image, the collection is stopped.
  • Step 201 acquiring multiple frames of images, including the following sub-steps:
  • Substep 2011, acquiring images according to a preset frequency
  • Sub-step 2012 perform motion recognition on the currently collected image and judge whether the recognition is successful; if yes, enter sub-step 2013, if not, enter sub-step 2014;
  • Sub-step 2013, add the currently acquired image to the first image sequence set; return to sub-step 2011.
  • Sub-step 2014 discard the currently acquired image; then enter sub-step 2015.
  • Substep 2015 accumulate the number of frames of consecutively discarded images, and determine whether the preset number of frames K is reached; if it is, stop the acquisition and go to step 202; if not, return to substep 2011.
  • K is the preset number of frames and L is greater than 1
  • a first image sequence set such as a sequence P
  • the electronic device also accumulates the number of consecutively discarded images and determines whether the number of consecutively discarded images reaches the preset number of frames K. If the number of consecutively discarded images reaches the preset number of frames K, the No moving subject is identified in the collected K frame images, it is considered that no moving subject has been detected, and the acquisition is stopped at this time.
  • the preset number of frames K can be set according to actual experience or actual needs.
  • K is 10, and if no moving subjects are identified in the first to tenth frames of the collected image, the number of frames of consecutively discarded images is 10, which reaches the preset number of frames K, so it is considered to be moving If the subject never enters the shooting screen, stop the acquisition (this time the trajectory synthesis ends); or, from the first frame image to the 45th frame of the collected images, the moving subject is recognized, and from the 46th frame image, it has been continuous After 10 frames were collected, no moving subjects were identified in the collected images, that is, the 46th frame to the 56th frames of the collected images did not identify the moving subject. It is considered that the moving subject has run out of the shooting screen and the collection is stopped.
  • the method of motion recognition is used to preliminarily screen the collected images, whether to continue to collect images or to stop collecting images, is determined by whether the moving subject is located in the shooting screen, rather than collected as in the prior art A preset fixed frame number of images; that is, in this embodiment, if it is detected that no moving subject is identified in the continuously acquired K frame images, then even if the number of currently acquired images containing moving subjects does not reach the preset At a fixed number of frames, the collection will stop, because even if the collection continues, because the moving subject is no longer in the shooting screen, the collected image has no practical use for the synthesis of the movement track; therefore, this embodiment is more in line with the synthesis of the movement track when acquiring the image The actual demand for the image has improved the effectiveness of image acquisition, which can improve the synthesis efficiency of the motion track.
  • the third embodiment of the present invention relates to a motion track synthesis method.
  • the third embodiment is substantially the same as the second embodiment, and the main difference is that in the third embodiment of the present invention, a specific way of dividing a plurality of grid regions is provided.
  • FIG. 5 is a flowchart of the motion track synthesis method of the third embodiment. Steps 301 and 304 are substantially the same as steps 201 and 204 in FIG. 4 and will not be repeated here. The difference is that
  • Step 302 dividing the image into multiple grid regions according to a preset method, including the following sub-steps:
  • Sub-step 3021 select a frame of images containing moving subjects from the multi-frame images, and determine the target frame area of the moving subjects in the selected image; wherein, the moving subjects in the selected image are located in the target frame area.
  • the multi-frame images acquired here are all images containing moving subjects and are arranged in order according to the acquisition order; that is, the first image sequence set P in the second embodiment Multi-frame images in.
  • the selected image may be any frame image in the first image sequence set P; for example, the first frame image P1 in the first image sequence set P may be selected, and the target of the moving subject in the selected image P1 may be determined
  • the frame area R1, or, one image in the middle of the first image sequence set P can be selected; or, the selected image can also be the motion in the first few images in the first image sequence set P
  • the image with the largest subject for example, compare the size of the moving subject in the first three frames P1, P2, P3 of the first image sequence set P, and select the larger frame of the moving subject, if the second frame of the image
  • the medium moving subject is the largest, then the selected image is the second frame image P2 in the first image sequence set P.
  • the selected image is not limited to the above example, the designer can set it according to actual needs, for example, it can also calculate the average of the size of the moving subject in the obtained multi-frame images or several of them, and then average The image with the moving subject near the value is selected as the image. For the same moving subject, the closer to the camera when moving, the larger the moving subject in the collected image, and the farther away from the camera when moving, the smaller the moving subject in the collected image.
  • the target frame area R1 is a rectangular frame area, and the target frame area R1 may be the area where the smallest circumscribed rectangular frame of the moving subject is located, thereby ensuring that the moving subject is located in the target frame area R1.
  • the target frame area R1 may be similar to the area of the smallest circumscribed rectangular frame, but the area is larger than the area of the smallest circumscribed rectangular frame, that is, after the smallest circumscribed rectangular frame of the moving subject is identified, the smallest circumscribed rectangular frame is enlarged ,
  • the target frame area R1 is slightly larger than R1min, but it is best not to exceed 1/4 of the area of the smallest circumscribed rectangular frame; that is, the area ratio of the target frame area and the area of the smallest circumscribed rectangular frame is greater than 1 and less than or equal to 5 / 4.
  • Sub-step 3022 the selected image is divided into a plurality of grid areas according to the size of the target frame area; wherein the target frame area is located in one of the grid areas.
  • the target frame region R1 is used as a basic cell to divide the image into grids.
  • the coordinate position of one of the corner points of the target frame area R1 can be used as the starting point, and the width w1 and height h1 of the target frame area R1 can be used as standard Divided by the interval w1, the height H of the entire image is divided into grid regions every h1; preferably, for example, the coordinate position of the upper corner of the target frame region R1 is used as the starting point. Therefore, the target frame area is located in one of the grid areas; in this embodiment, the target frame area is a grid unit, but it is not limited to this. It should be noted that due to the limitation of the image width W and height H, the grid area at the edge of the image may be smaller than the target frame area.
  • Step 303 select several frames of images that satisfy the preset conditions from the multi-frame images; where the preset conditions include that the image contains moving subjects and the grid area occupied by the moving subjects in any two frames of images does not overlap, including the following sub step:
  • Sub-step 3031 add the selected image to the second image sequence set, and mark the grid area where the selected image is located as occupied.
  • the second image sequence set Q can be preset in the electronic device to save the images that meet the preset conditions; the selected image is used as the basis for comparing other images, so the selected image is considered to meet the preset
  • the conditional image is added to the second image sequence set Q, and the grid area where the selected image is located is marked as occupied, where the grid area where the selected image is located is the target frame area R1.
  • the grid area that has been occupied by the moving subject is marked to facilitate subsequent comparison.
  • the screening is performed in the order of arrangement.
  • the screening methods include,
  • Sub-step 3032-1 judging whether the grid area where the moving subject in the image is marked as occupied; if not, enter sub-step 3032-2; if yes, enter sub-step 3032-3;
  • Sub-step 3032-2 add the image to the second image sequence set, and mark the grid area where the moving subject in the image is occupied as occupied.
  • Substep 3032-3 discard the image.
  • the number of grid areas where the target frame area of the moving subject is located may be one or more. If the number of grid areas where the target frame area of the moving subject is located is multiple, as long as one grid area is marked as If it is occupied, it is considered that the image does not meet the preset conditions.
  • you can number the grid area use the number to indicate the grid area where the moving subject in the image is located, determine the number of the grid area where the moving subject in the image is located, and determine whether the grid area indicated by the number has been marked For occupation, if it has been marked as occupied, it means that the image does not meet the preset conditions.
  • a specific way of dividing the grid area is proposed, that is, the target frame area of the moving subject in a frame of image is selected as the basic unit for division, wherein the moving subject in the selected image is located in the target frame area ;
  • the size of the grid area divided in this way is appropriate, so that the overlap judgment can be performed more quickly; because relative to the size of the moving subject, if the grid area is too small, the moving subject in each image will occupy If there are multiple grid areas, the amount of work spent in overlapping judgment will be greater (because it is checked whether each grid area is marked as occupied). If the grid area is too large, the selected conditions meet the preset conditions The distance between moving subjects in the image will be relatively large, making the distance between two adjacent moving subjects in the last synthesized motion trajectory larger, affecting the synthesis effect.
  • the third embodiment may also be an improvement on the basis of the first embodiment; when the third embodiment improves on the basis of the first embodiment, since step 301 does not use motion recognition
  • the collected images are filtered, so there may be images that do not contain moving subjects in the acquired multi-frame images; in step 302, the selected image must contain moving subjects. Therefore, the selected image can be many
  • the first frame of the frame image contains the image of the moving subject.
  • the fourth embodiment of the present invention relates to a motion track synthesis method.
  • the fourth embodiment is substantially the same as the third embodiment, and the main difference is that in the fourth embodiment of the present invention, the image of the moving subject suddenly being too large can be eliminated to eliminate external interference and improve the synthetic effect of the motion track.
  • FIG. 8 is a flowchart of the screening method in the fourth embodiment.
  • FIG. 8 is an improvement based on FIG. 7.
  • sub-step 3032-1 it also includes sub-step 3032-0 to determine the moving subject in the image. Whether the target frame areas are all located in one of the grid areas; if yes, go to sub-step 3032-1, if no, go to sub-step 3032-3.
  • the camera may suddenly move closer to or away from the moving subject.
  • the moving subject in the image will suddenly become larger, that is, the target frame area of the moving subject in the image will exceed a grid area.
  • the target frame area can be set to be larger than the area where the smallest circumscribed rectangular frame of the moving subject is located, as described in sub-step 3021 of the third embodiment, the target The area ratio of the frame area to the area of the smallest circumscribed rectangular frame can be greater than 1 and less than or equal to 5/4, so that a normal variable margin is left.
  • the normal variable margin refers to the moving subject during the movement The amount of change in the size of moving subjects in the image when normally approaching or away from the camera.
  • the judgment on the number of occupied grid areas is increased, and moving subjects whose moving subjects are suddenly too large can be eliminated, that is, shooting due to unstable shooting can be avoided as much as possible
  • the less accurate images participate in the trajectory synthesis, thereby improving the synthesis effect and authenticity of the motion trajectory.
  • the fifth embodiment of the present invention relates to a motion track synthesis method.
  • the fifth embodiment is almost the same as the second embodiment, the main difference is that: in the fifth embodiment of the present invention, images with excessively large moving subjects can be eliminated, and when continuous multi-frame images have the phenomenon of excessively large moving subjects , Indicating that the shooting distance is likely to be too close, and a prompt message is generated.
  • Step 601 contains sub Step 6011 to sub-step 6019, where sub-step 6011 to sub-step 6012, sub-step 6014, sub-step 6018, sub-step 6019 are substantially the same as sub-step 2011 to sub-step 2015 in FIG. 4, and will not be repeated here, The difference is that it also includes:
  • Substep 6013 determine whether the moving subject in the currently collected image meets the preset size condition; wherein, the size condition includes that the width of the moving subject is less than half the width of the currently collected image, and the height of the moving subject is less than the currently collected image the height of.
  • the judgment result of substep 6013 is yes, enter substep 6014; when the judgment result of substep 6013 is no, enter substep 6015, and then enter substep 6016.
  • Substep 6015 discard the currently acquired image.
  • Sub-step 6016 accumulating the number of frames of consecutively discarded images, and determining whether the preset number of frames L is reached; where L is the preset number of frames and L is greater than 1. If the judgment result is yes, then enter sub-step 6017, and then return to sub-step 601, if the judgment result is no, then directly return to sub-step 6011.
  • Substep 6017 generating a prompt message indicating that the moving subject is too large.
  • the preset frame number L may be set according to actual needs, and the preset frame number L and the preset frame number K in substep 6019 may be the same or different.
  • sub-step 6015 and sub-step 6016 are similar to sub-step 6018 and sub-step 6019, respectively, but the difference is that the sub-step 6015 discards an image with an excessively large moving subject, while the sub-step 6018 discards that there is no moving subject.
  • the sub-step 6016 accumulates the number of continuously captured images of moving subjects that are too large, while the sub-step 6019 accumulates the number of frames of consecutively captured images that do not recognize a moving subject.
  • images with excessively large moving subjects can be eliminated, and the photographer can be promptly reminded that the shooting distance is too close, which is beneficial for collecting images containing moving subjects of a relatively large size for the synthesis of a moving trajectory, which can improve the movement The synthetic effect of the track.
  • the sixth embodiment of the present invention relates to an electronic device, as shown in FIG. 10, including:
  • At least one processor 10 and,
  • a memory 11 communicatively connected to the at least one processor
  • a camera 12 connected to the at least one processor and the memory
  • the camera 12 is used to collect images; the memory 11 stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor 10 to enable the at least one processor 10 Able to perform the above method embodiments.
  • the bus may include any number of interconnected buses and bridges.
  • the bus connects one or more processors 10 and various circuits of the memory 11 together.
  • the bus can also connect various other circuits such as peripheral devices, voltage regulators, and power management circuits, etc., which are well known in the art, and therefore, they will not be further described herein.
  • the bus interface provides an interface between the bus and the transceiver.
  • the transceiver can be a single element or multiple elements, such as multiple receivers and transmitters, providing a unit for communicating with various other devices on the transmission medium.
  • the data processed by the processor 10 is transmitted on the wireless medium through the antenna. Further, the antenna also receives the data and transmits the data to the processor 10.
  • the processor 10 is responsible for managing the bus and general processing, and can also provide various functions, including timing, peripheral interfaces, voltage regulation, power management, and other control functions.
  • the memory 11 may be used to store data used by the processor 10 when performing operations.
  • the seventh embodiment of the present invention relates to a computer-readable storage medium that stores a computer program.
  • the computer program is executed by the processor, the above method embodiments are implemented.
  • the embodiment of the present invention divides the image into a plurality of grid areas according to a preset method; and selects a plurality of frames of images satisfying preset conditions from multiple frames of images for synthesis, where the preset conditions include,
  • the image contains moving subjects and the grid areas occupied by the moving subjects in any two frames of images do not overlap. Therefore, the grid method is used to select the image for synthesis, which is not affected by the movement speed of the moving subject, the direction of movement, and the change in the size of the moving subject. it is good.
  • a program which is stored in a storage medium and includes several instructions to make a device ( It may be a single chip microcomputer, a chip, etc.) or a processor to execute all or part of the steps of the methods described in the embodiments of the present application.
  • the aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program code .

Abstract

Les modes de réalisation de la présente invention concernent un procédé de synthèse de trajectoire de mouvement et un dispositif électronique, se rapportant au domaine technique du traitement d'image. Dans un mode de réalisation de la présente invention, le procédé de synthèse de trajectoire de mouvement consiste : à acquérir une pluralité de trames d'image, les trames d'image étant ordonnées en fonction du temps d'acquisition ; selon un procédé prédéfini, à diviser respectivement les trames d'image en une pluralité de zones de grille ; à sélectionner plusieurs trames d'image satisfaisant des conditions prédéfinies à partir de la pluralité de trames d'image, les conditions prédéfinies comprenant : les multiples trames d'image comprenant toutes un corps mobile et les zones de grille occupées par le corps mobile dans deux trames d'image quelconques ne se chevauchant pas ; et, sur la base des multiples trames d'image sélectionnées, à synthétiser la trajectoire de mouvement du corps mobile. Les modes de réalisation de la présente invention concernent également un dispositif électronique.
PCT/CN2019/101435 2018-10-25 2019-08-19 Procédé de synthèse de trajectoire de mouvement et dispositif électronique WO2020082866A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811250802.2 2018-10-25
CN201811250802.2A CN111105434A (zh) 2018-10-25 2018-10-25 运动轨迹合成方法及电子设备

Publications (1)

Publication Number Publication Date
WO2020082866A1 true WO2020082866A1 (fr) 2020-04-30

Family

ID=70330775

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/101435 WO2020082866A1 (fr) 2018-10-25 2019-08-19 Procédé de synthèse de trajectoire de mouvement et dispositif électronique

Country Status (2)

Country Link
CN (1) CN111105434A (fr)
WO (1) WO2020082866A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112433529A (zh) * 2020-11-30 2021-03-02 东软睿驰汽车技术（沈阳）有限公司 运动物体确定方法、装置及设备

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113810587B (zh) * 2020-05-29 2023-04-18 华为技术有限公司 一种图像处理方法及装置
CN112686941B (zh) * 2020-12-24 2023-09-19 北京英泰智科技股份有限公司 一种车辆运动轨迹合理性识别方法、装置及电子设备
CN112785573A (zh) * 2021-01-22 2021-05-11 上海商汤智能科技有限公司 图像处理方法及相关装置、设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060092280A1 (en) * 2002-12-20 2006-05-04 The Foundation For The Promotion Of Industrial Science Method and device for tracking moving objects in image
CN101833791A (zh) * 2010-05-11 2010-09-15 成都索贝数码科技股份有限公司 一种单摄像机下的场景建模方法及系统
CN104751489A (zh) * 2015-04-09 2015-07-01 苏州阔地网络科技有限公司 一种在线课堂中基于网格的接力跟踪方法及装置
CN106228835A (zh) * 2016-07-18 2016-12-14 北京精英智通科技股份有限公司 一种车位停车事件判断方法及系统
CN106340032A (zh) * 2016-08-27 2017-01-18 浙江捷尚视觉科技股份有限公司 一种基于光流场聚类的运动目标检测方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060092280A1 (en) * 2002-12-20 2006-05-04 The Foundation For The Promotion Of Industrial Science Method and device for tracking moving objects in image
CN101833791A (zh) * 2010-05-11 2010-09-15 成都索贝数码科技股份有限公司 一种单摄像机下的场景建模方法及系统
CN104751489A (zh) * 2015-04-09 2015-07-01 苏州阔地网络科技有限公司 一种在线课堂中基于网格的接力跟踪方法及装置
CN106228835A (zh) * 2016-07-18 2016-12-14 北京精英智通科技股份有限公司 一种车位停车事件判断方法及系统
CN106340032A (zh) * 2016-08-27 2017-01-18 浙江捷尚视觉科技股份有限公司 一种基于光流场聚类的运动目标检测方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112433529A (zh) * 2020-11-30 2021-03-02 东软睿驰汽车技术（沈阳）有限公司 运动物体确定方法、装置及设备
CN112433529B (zh) * 2020-11-30 2024-02-27 东软睿驰汽车技术（沈阳）有限公司 运动物体确定方法、装置及设备

Also Published As

Publication number Publication date
CN111105434A (zh) 2020-05-05

Similar Documents

Publication Publication Date Title
WO2020082866A1 (fr) Procédé de synthèse de trajectoire de mouvement et dispositif électronique
US9918007B2 (en) Photographing method and apparatus
US8249359B2 (en) Detector for detecting a predetermined image in an input image, and detection method and integrated circuit for performing the same
CN101840055B (zh) 基于嵌入式媒体处理器的视频自动聚焦系统
US20220166930A1 (en) Method and device for focusing on target subject, and electronic device
US9842409B2 (en) Image transmission device, image transmission method, image transmission program, image recognition and authentication system, and image reception device
CN110248096A (zh) 对焦方法和装置、电子设备、计算机可读存储介质
US11840357B2 (en) Method and device for dual-light image integration, and unmanned aerial vehicle
CN106251334A (zh) 一种摄像机参数调整方法、导播摄像机及系统
CN109040576A (zh) 具有用于图像数据统计的基于多帧的窗口的相机控制和图像处理的方法和系统
CN110473185A (zh) 图像处理方法和装置、电子设备、计算机可读存储介质
CN108174185A (zh) 一种拍照方法、装置及终端
US8625922B2 (en) Image processing method and program for determining whether sabotage has occurred to an image
US8295609B2 (en) Image processing apparatus, image processing method and computer readable-medium
CN110248101A (zh) 对焦方法和装置、电子设备、计算机可读存储介质
CN111310727B (zh) 对象检测方法及装置、存储介质、电子装置
US8928768B2 (en) Image processing device and computer-readable computer program product containing image processing program
CN112449117B (zh) 一种聚焦步长确定方法、装置、存储介质及电子装置
CN109698946A (zh) 投影设备自动对焦方法、投影设备及计算机可读存储介质
JP2013195577A (ja) 撮像装置、撮像方法及びプログラム
CN110059518A (zh) 一种扫码方法、装置及移动终端
CN116132729A (zh) 一种山体滑坡监测用全景视频拼接方法及系统
CN115379128A (zh) 曝光控制方法及装置、计算机可读介质和电子设备
WO2021259033A1 (fr) Procédé de reconnaissance faciale, dispositif électronique et support de stockage
US11501512B2 (en) Image processing apparatus, control method performed by the image processing apparatus, and storage medium, that determine a region including an object and control transmission an image corresponding to the determined region based on size thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19875411

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 07/09/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19875411

Country of ref document: EP

Kind code of ref document: A1