CN111263955A - Method and device for determining movement track of target object - Google Patents
Method and device for determining movement track of target object Download PDFInfo
- Publication number
- CN111263955A CN111263955A CN201980005227.6A CN201980005227A CN111263955A CN 111263955 A CN111263955 A CN 111263955A CN 201980005227 A CN201980005227 A CN 201980005227A CN 111263955 A CN111263955 A CN 111263955A
- Authority
- CN
- China
- Prior art keywords
- image
- target object
- target
- determining
- images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 46
- 230000002452 interceptive effect Effects 0.000 claims description 30
- 238000004422 calculation algorithm Methods 0.000 claims description 18
- 238000009434 installation Methods 0.000 claims description 17
- 230000008520 organization Effects 0.000 claims description 17
- 238000012544 monitoring process Methods 0.000 abstract description 10
- 239000013598 vector Substances 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 230000008859 change Effects 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 238000000605 extraction Methods 0.000 description 3
- 238000013528 artificial neural network Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000000513 principal component analysis Methods 0.000 description 2
- 238000013441 quality evaluation Methods 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 238000013136 deep learning model Methods 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000003062 neural network model Methods 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000007637 random forest analysis Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/292—Multi-camera tracking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
Abstract
The invention provides a method and a device for determining a movement track of a target object, wherein the method comprises the following steps: determining a target image from images stored in a storage device, wherein the images stored in the storage device comprise images of a target object shot by a plurality of shooting devices, the plurality of shooting devices at least comprise two shooting devices arranged at different positions, and the target image comprises the image of the target object in the images of the target object; and determining the movement track of the target object according to the target image. According to the method and the device provided by the invention, the images of the target object shot by the plurality of shooting devices are associated, and the motion trail of the target object is determined through the images of the target object shot by the plurality of shooting devices, so that the monitoring workload is greatly reduced, and the accuracy is improved.
Description
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to a method and an apparatus for determining a movement trajectory of a target object.
Background
The photographing apparatus is widely used in the monitoring field. The monitoring personnel monitor the target object by analyzing the image shot by the shooting device. However, in the monitoring field, a monitoring person analyzes a movement trajectory of a target object by analyzing images output from a photographing device that photographs the target object one by one, which is inefficient, labor intensive, and inaccurate.
Disclosure of Invention
The embodiment of the invention provides a method and a device for determining a moving track of a target object, which are used for determining the moving track of the target object through images shot by a plurality of shooting devices.
In a first aspect of the embodiments of the present invention, a method for determining a movement trajectory of a target object is provided, including:
determining a target image from images stored in a storage device, wherein the images stored in the storage device comprise images of a target object shot by a plurality of shooting devices, the plurality of shooting devices at least comprise two shooting devices arranged at different positions, and the target image comprises the image of the target object in the images of the target object;
and determining the movement track of the target object according to the target image.
In a second aspect of the embodiments of the present invention, there is provided an apparatus for determining a movement trajectory of a target object, including:
a memory and a processor;
the memory is used for storing program codes;
the processor, invoking the program code, when executed, is configured to:
determining a target image from images stored in a storage device, wherein the images stored in the storage device comprise images of a target object shot by a plurality of shooting devices, the plurality of shooting devices at least comprise two shooting devices arranged at different positions, and the target image comprises the image of the target object in the images of the target object;
and determining the movement track of the target object according to the target image.
According to the method and the device for determining the movement track of the target object, provided by the embodiment of the invention, the images of the target object shot by the plurality of shooting devices are associated, and the movement track of the target object is determined through the images of the target object shot by the plurality of shooting devices, so that the monitoring workload is greatly reduced, and the accuracy is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic flowchart of a method for determining a movement trajectory of a target object according to an embodiment of the present invention;
fig. 2 is a schematic view of a scene for determining a movement track of a target object according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating a moving track of a target object according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of determining a location of a target object provided by an embodiment of the present invention;
FIG. 5 is a schematic diagram of determining an orientation of a target object relative to a camera provided by embodiments of the present invention;
FIG. 6 is a diagram illustrating background images within a delete bounding box according to an embodiment of the present invention;
fig. 7 is a block diagram of a target object movement trajectory determination apparatus according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Some embodiments of the invention are described in detail below with reference to the accompanying drawings. The embodiments described below and the features of the embodiments can be combined with each other without conflict.
Referring to fig. 1, fig. 1 shows a schematic flow chart of a method for determining a movement trajectory of a target object according to an embodiment of the present invention, wherein the method may be performed by a movement trajectory determination apparatus of a target object. As shown in fig. 1, an embodiment of the present invention provides a method for determining a movement trajectory of a target object, where the method 100 includes:
in step S110, determining a target image from images stored in a storage device, wherein the images stored in the storage device include images of a subject captured by a plurality of cameras including at least two cameras disposed at different positions, and the target image includes an image of a target subject in the images of the subject;
specifically, a monitoring area 201 (e.g., a mall, an office building, etc.) may be provided with a plurality of cameras 201 (e.g., including at least two cameras), wherein each camera may be disposed at a different position of the monitoring area 201, and each camera 201 may capture one shooting area (e.g., a sector area as illustrated in the figure) to acquire an image. The image may be stored in a storage device. In some embodiments, the server may acquire images acquired by the plurality of cameras 201 and store the images in the storage device. Alternatively, the storage device may be a local storage device of the server, or may be a storage device communicatively connected to the server.
When the object 203 moves in the monitoring area 201, the object 203 is captured by the plurality of cameras 201, that is, the cameras 201 output images of the object, that is, the storage device 201 stores the images of the object. The object 203 may be any object that can move autonomously or by being subjected to an external force, for example, the object may be a pedestrian, an animal, a robot, etc., and the object is schematically illustrated as a pedestrian. The object includes a target object, which is an object of interest or designation in the object. The storage device stores an image of the target object, i.e., a target image. The movement trajectory determination means of the target object may determine the image of the target object from the images stored in the storage means, i.e., filter the target image from the images stored in the storage means.
In step S120, a movement trajectory of the target object is determined according to the target image.
In particular, after determining the target image, the target image is associated with the camera 201, and the camera 201 is set at a different location in the monitored area 201, then the target image may be used to indicate the location where the target object appears in the monitored area 201. The movement trajectory determination means of the target object may determine the movement trajectory 204 of the target object in the monitored area 201 from the target image.
Alternatively, the movement trajectory determination device of the target object may be a device in communication with the storage device, such as a computer or the like. Alternatively, the movement trajectory determination device of the target object may be the server.
According to the method for determining the moving track of the target object, the images of the target object shot by the multiple shooting devices are associated, the moving track of the target object is determined through the images of the target object shot by the multiple shooting devices, the monitoring workload is greatly reduced, and the accuracy is improved.
Optionally, according to an embodiment of the present invention, the method further includes: and displaying the movement track on an interactive interface.
Specifically, the movement trajectory determination means of the target object may display the movement trajectory on the interactive interface. Wherein, the interactive interface can be a display screen. In order to meet different user requirements, the display of the movement track can be displayed in the form of a track line graph, for example, in the mode of displaying a movement track 204 line graph shown in fig. 2; the movement trajectory may also be displayed in a text form, for example, as shown in fig. 3, such as a form in which the position where the target object arrives is displayed in terms of time. It is understood that, those skilled in the art may also display the moving track in any other way that the time and the corresponding position of the target object may be displayed, which is not limited herein.
Optionally, the determining the target image from the images stored in the storage device includes: the reference image of the target object is matched with the images stored by the storage device to determine the target image from the images stored by the storage device.
Specifically, in order to determine a target image from images stored in the storage device, the movement trajectory determination device of the target object may acquire a reference image of the target object, and then perform a matching operation on the reference image of the target object and the images stored in the storage device to determine a target image from the stored images, and further perform a matching operation on the reference image of the target object and the images of the objects stored in the storage device to determine a target image from the stored images of the objects. The reference image of the target object may be stored in a local storage device of the movement track determination device of the target object, and the reference image of the target object may also be stored in a storage device communicatively connected to the movement track determination device of the target object, and the movement track determination device of the target object may obtain the reference image of the target object from the storage device.
Optionally, the matching the reference image of the target object with the images stored in the storage device to determine the target image from the images stored in the storage device includes: matching a reference image of a target object with an image stored by the storage device to determine a matching coefficient between the reference image and the stored image; and when the matching coefficient meets a preset condition, determining an image corresponding to the matching coefficient in the stored images as a target image.
Specifically, the movement trajectory determination means of the target object may match a reference image of the target object with the stored image, and a matching coefficient may be determined by the matching, where the matching coefficient may be a parameter representing a degree of similarity between the stored image and the reference image. And when the matching coefficient does not meet the preset condition, determining that the stored image is not the target image.
Optionally, the matching coefficient comprises a euclidean distance between the stored image and the reference image. The smaller the Euclidean distance is, the higher the similarity degree between the stored image and the reference image is, and when the Euclidean distance between the stored image and the reference image is smaller than a preset Euclidean geometric distance threshold value, the stored image is represented as a target image. And when the Euclidean distance between the stored image and the reference image is greater than or equal to a preset Euclidean geometric distance threshold value, determining that the stored image is not the target image.
Specifically, the target object movement trajectory determination device may extract features from the stored image and the reference image through a trained deep learning model, where the features are feature vectors, so that the stored image features X may be obtained as (X)1，x2，...xn) And the feature Y of the reference image is (Y)1，y2，...yn) The Euclidean distance between the stored image and the reference image
Alternatively, the extracted features may be extracted by using various suitable feature extraction methods such as LBP (local binary pattern), HoG (histogram of oriented gradients), PCA (principal component analysis), or neural network to generate the plurality of feature vectors. Optionally, when the object is a pedestrian, the feature vector is generated by using the same feature extraction method for the reference image of the target object and/or the face of the object in each frame of image in the image of the object stored in the storage device. Here, the feature extraction may be performed on the face image region as a whole, or may be performed in different sub-image regions of the face image region, respectively.
Optionally, the feature vector of the reference image and the feature vector of the image stored in the storage device may be normalized vectors, that is, the vectors are normalized, and the norm of the vectors is 1, which is beneficial to improving the operation efficiency and facilitating the rapid detection of the target image.
Optionally, according to an embodiment of the present invention, the method further includes: acquiring index information of a target object input by a user through an interactive interface, and determining a reference image of the target object according to the index information of the target object.
Specifically, when the user views the movement track of a specific target object, the user may input index information of the target object on the interactive interface, where the index information may be any information capable of indexing the target object. The index information of the target object has a corresponding relationship with the reference image of the target object, and the movement trajectory determination device of the target object may determine the reference image of the target object according to the index information of the target object.
Alternatively, the index information may be at least one of identity information, biometric information, and an image of the target object. The identity information comprises at least one of a job number, an identity card number, a name, an insurance account number and the like; the biometric information may include at least one of a fingerprint, a voiceprint, an iris, and the like, and in addition, the image of the target object as the index information may include a reference image of the target object as described above.
Optionally, the obtaining the index information of the target object input by the user through the interactive interface, and determining the reference image of the target object according to the index information of the target object includes: acquiring identity information of a target object input by a user through an interactive interface; acquiring an image corresponding to the identity information according to the identity information; and determining the image corresponding to the identity information as a reference image of the target object.
Optionally, the acquiring the index information of the target object input by the user through the interactive interface, and determining the reference image of the target object according to the index information of the target object includes: the method comprises the steps of obtaining an image of a target object input by a user through an interactive interface, and determining the input image as a reference image of the target object.
When the index information includes an image, the image may be an image output by at least one of the plurality of imaging devices, or may be an image of a target object acquired by another method.
Optionally, in an embodiment, the target object movement trajectory determination device controls the interactive interface to display images captured and displayed by the plurality of cameras, determines a user-selected image from the displayed images according to a received selection operation input by the user, and determines the user-selected image as the reference image of the target object. In this way, the user can select and determine the image including the target object output by the photographing apparatus as the reference image of the target object.
Optionally, the determining a movement trajectory of the target object according to the target image includes: determining a shooting device for shooting the target image according to the target image; determining position information of a target object according to an installation position of a shooting device for shooting the target image; and according to the position information of the target object, the moving track of the target object is obtained.
Specifically, as described above, at least two cameras are installed at different positions in the monitored area, and the installation position of the camera outputting the target image may reflect the position information of the target object. Because the target image corresponds to the shooting device for shooting the target image one by one, the moving track determining device of the target object can determine the shooting device for shooting the target image according to the target image and the corresponding relation, and obtain the installation position of the shooting device, so that the position information of the target object can be determined according to the installation position of the shooting device. After the position information of the target object is determined, the movement track of the target object can be determined according to the position information of the target object. In some embodiments, when the accuracy requirement is not high, the installation position of the photographing device of the target image may be determined as the position of the target object.
Optionally, the determining the position of the target object according to the installation position of the shooting device for shooting the target image includes: and determining the position of the target object according to the installation position and the shooting direction of the shooting device for shooting the target image and the position of the target object in the shooting picture when the shooting device shoots the target image.
Specifically, referring to fig. 4, a camera 401 captures a target image of an output target object 402, and a distance d between the target object 402 and the camera may be determined according to the target image, for example, a size of an image area (which may be the target image) corresponding to the target object in the target image may be used to determine the distance d. When the image area is large, it indicates that the distance d between the target object 402 and the camera is short, and when the image area is small, it indicates that the distance d between the target object 402 and the camera is long.
In addition, the movement locus determination means of the target object may determine the orientation of the target object with respect to the photographing device according to the photographing direction of the photographing device and the position of the target object in the photographing screen when the photographing device photographs the target image. Referring to fig. 5, the position of the target object in the shooting image 501 is o1The position o can be determined1A deviation from the center o of the photographing screen 501, which may include a deviation x in the horizontal direction and a deviation y in the vertical direction. The deviation may reflect an angle of the target object from a shooting direction of the camera, from which the angle of the target object from the shooting direction of the camera may be determined, and further from the shooting direction of the camera and the angle, the orientation of the target object relative to the camera may be determined. Wherein the azimuth may include at least a pitch azimuth and a yaw azimuth.
Further, the movement locus determination means of the target object may determine the position of the target object with respect to the camera based on the distance d and the orientation, and may further determine the position of the target object based on the position of the target object with respect to the camera and the installation position of the camera.
Optionally, the method further comprises: acquiring images output by the plurality of shooting devices; determining an image of an object from the output image according to an object recognition algorithm; storing the image of the object in the storage device.
Specifically, the movement locus determination means of the target object may acquire an image output by the photographing means. The movement trajectory determination means of the target object may determine the image of the object from the image by running an object recognition algorithm on each frame of the acquired image or periodically at preset intervals.
Optionally, the determining an image of the object from the output image according to an object recognition algorithm includes: determining a bounding box of an object in the output image according to an object recognition algorithm; determining an image of the object according to the bounding box.
Specifically, referring to fig. 6, when an object is included in a map 601 output by a camera, a bounding box 602 of the object in the image can be determined from the image by the recognition algorithm, for example, a bounding box of the object in the image is determined from the image by a neural network. Further, an image of the object is determined from the bounding box, which in some embodiments may be determined to be the image of the object.
Further optionally, the determining an image of the object according to the bounding box includes: identifying an image of a background from images in a boundary frame, and deleting the image of the background; and determining the residual images in the boundary box as images of the object.
Specifically, with continued reference to fig. 6, in order to improve the accuracy of the matching as described above, and also to reduce the amount of data storage, the movement trace determining apparatus of the target object may identify the background image 603 in the bounding box 602, and may delete the background image 603. Thus, after the deletion is completed, the image 604 remaining in the bounding box 602 may be determined as the image of the object.
Optionally, the object is a pedestrian, and the method further comprises: determining an image including a front face of a target object from the target image, and displaying the image including the front face of the target object.
Specifically, in preparation for recognizing the identity of a target pedestrian, the movement trajectory determination means of the target object determines an image including the front face of the target object from the target image, and controls the interactive interface to display the image of the front face of the target object. Further, an image area of the front face can be determined from the image of the front face of the target object, the image in the image area is enlarged, and then the interactive interface is controlled to display the enlarged image so as to more clearly identify the face of the target pedestrian.
Optionally, an image including a front face of the target object may be determined from the target image through a face quality evaluation algorithm, wherein the face quality evaluation algorithm may obtain a degree of blur of the face image in the pedestrian sequence and an angle of the face based on a neural network model, and set different weights for evaluating the face picture quality.
The blurring degree of the face picture may be a neighborhood gradient change of the face picture and a blurred image of the face picture. The texture of a clear image is sharp, and the image neighborhood changes remarkably; the neighborhood of the blurred image varies less. In one embodiment, the face picture is passed through a preset low-pass filter to obtain a blurred image of the face picture, and neighborhood gradient change of the blurred image is calculated; and obtaining the fuzzy degree of the face picture by comparing the neighborhood gradient change of the selected face picture and the fuzzy image.
The angle of the face can be calculated based on a convolutional neural network structure through deep learning to obtain the angle of the face, or regression estimation is respectively carried out on the angle of the face through a self-adaptive random forest algorithm.
Optionally, the method further comprises: identifying according to the image comprising the front face of the target object to determine whether the target object belongs to a preset tissue; when the target object is determined to belong to a preset organization, displaying first prompt information, wherein the first prompt information is used for indicating that the target object belongs to the preset organization; and when the target object is determined not to belong to the preset organization, displaying second prompt information, wherein the second prompt information is used for indicating that the target line does not belong to the preset organization.
Specifically, the movement trajectory determination means of the target object determines whether the target object belongs to a preset organization, for example, whether the target pedestrian belongs to a certain company, department, group, owner group, or the like, displays the first prompt information when it is determined that the target object belongs to the preset organization, and displays the second prompt information to realize the alarm function when it is determined that the target object does not belong to the preset organization.
Optionally, the target object is a pedestrian. And face recognition is carried out based on the front face image to confirm the identity information of the target object, so that the accuracy of pedestrian recognition is further improved, and the recognition efficiency is improved.
Referring to fig. 7, fig. 7 is a schematic block diagram illustrating a movement trajectory determination apparatus of a target object according to an embodiment of the present invention. As shown in fig. 7, an embodiment of the present invention provides an apparatus for determining a movement trajectory of a target object, where the apparatus 700 includes:
a memory 701 and a processor 702;
the memory is used for storing program codes;
the processor 702, invoking the program code, when executed, is configured to:
determining a target image from images stored in a storage device, wherein the images stored in the storage device comprise images of a target object shot by a plurality of shooting devices, the plurality of shooting devices at least comprise two shooting devices arranged at different positions, and the target image comprises the image of the target object in the images of the target object;
and determining the movement track of the target object according to the target image.
Optionally, when the processor calls the program code, the following operations are further performed: and displaying the movement track on an interactive interface.
Optionally, the processor, when determining the target image from the images stored in the storage device, includes performing the following operations:
the reference image of the target object is matched with the images of the object stored by the storage device to determine the target image from the images stored by the storage device.
Optionally, the processor, when matching the reference image of the target object with the image of the object stored in the storage device to determine the target image from the image stored in the storage device, includes performing the following operations:
matching a reference image of a target object with an image of the object stored by the storage device to determine a matching coefficient between the reference image and the stored image;
and when the matching coefficient meets a preset condition, determining an image corresponding to the matching coefficient in the stored images as a target image.
Optionally, when the processor calls the program code, the following operations are further performed:
acquiring index information of a target object input by a user through an interactive interface, and determining a reference image of the target object according to the index information of the target object.
Optionally, the index information includes identity information of the target object, and the processor, when acquiring the index information of the target object input by the user through the interactive interface and determining the reference image of the target object according to the index information of the target object, performs the following operations:
acquiring identity information of a target object input by a user through an interactive interface;
acquiring an image corresponding to the identity information according to the identity information;
and determining the image corresponding to the identity information as a reference image of the target object.
Optionally, the index information includes an image, and the processor, when acquiring the index information of the target object input by the user through the interactive interface and determining the reference image of the target object according to the index information of the target object, performs the following operations:
the method comprises the steps of obtaining an image of a target object input by a user through an interactive interface, and determining the input image as a reference image of the target object.
Optionally, the determining, by the processor, the moving trajectory of the target object according to the target image includes:
determining a shooting device for shooting the target image according to the target image;
determining the position of a target object according to the installation position of a shooting device for shooting the target image;
and according to the position information of the target object, the moving track of the target object is obtained.
Optionally, when determining the position of the target object according to the installation position of the shooting device for shooting the target image, the processor performs the following operations:
and determining the position of the target object according to the installation position and the shooting direction of the shooting device for shooting the target image and the position of the target object in the shooting picture when the shooting device shoots the target image.
Optionally, when the processor calls the program code, the following operations are further performed:
acquiring images output by the plurality of shooting devices;
determining an image of an object from the output image according to an object recognition algorithm;
storing the image of the object in the storage device.
Optionally, when the processor determines the image of the object from the output image according to an object recognition algorithm, the following operations are further performed:
determining a bounding box of an object in the output image according to an object recognition algorithm;
determining an image of the object according to the bounding box.
Optionally, when determining the image of the object according to the bounding box, the processor further performs the following operations:
identifying an image of a background from a target image, and deleting the image of the background, wherein the target image is an image in a boundary frame in the output image;
and determining the residual images in the deleted target image as the images of the target object.
Optionally, the object is a pedestrian, and when the processor calls the program code, the following operation is further performed:
determining an image including a front face of a target object from the target image, and displaying the image including the front face of the target object.
Optionally, when the processor calls the program code, the following operations are further performed:
identifying according to the image comprising the front face of the target object to determine whether the target object belongs to a preset tissue;
when the target object belongs to a preset organization, displaying first prompt information, wherein the first prompt information is used for indicating that the target object belongs to the preset organization;
and when the target object is not in the preset organization, displaying second prompt information, wherein the second prompt information is used for indicating that the target line does not belong to the preset organization.
Optionally, the target object is a pedestrian.
Further, according to an embodiment of the present invention, there is also provided a storage medium on which program instructions are stored, which when executed by a computer or a processor, are used for executing the respective steps of the movement trajectory determination method of a target object according to an embodiment of the present invention, and for implementing the respective modules in the movement trajectory determination device of a target object according to an embodiment of the present invention. The storage medium may include, for example, a memory card of a smart phone, a storage component of a tablet computer, a hard disk of a personal computer, a Read Only Memory (ROM), an Erasable Programmable Read Only Memory (EPROM), a portable compact disc read only memory (CD-ROM), a USB memory, or any combination of the above storage media. The computer readable storage medium may be any combination of one or more computer readable storage media, e.g., one containing computer readable program code for randomly generating a sequence of action instructions and another containing computer readable program code for performing a trajectory determination of the movement of the target object.
In one embodiment, the computer program instructions may implement, when executed by a computer, various functional modules of a movement trajectory determination apparatus of a target object according to an embodiment of the present invention, and/or may execute a movement trajectory determination method of a target object according to an embodiment of the present invention.
The modules in the movement trajectory determination device of the target object according to the embodiment of the present invention may be implemented by a processor of an electronic device for movement trajectory determination of the target object according to the embodiment of the present invention running computer program instructions stored in a memory, or may be implemented when computer instructions stored in a computer-readable storage medium of a computer program product according to the embodiment of the present invention are run by a computer.
Although the illustrative embodiments have been described herein with reference to the accompanying drawings, it is to be understood that the foregoing illustrative embodiments are merely exemplary and are not intended to limit the scope of the invention thereto. Various changes and modifications may be effected therein by one of ordinary skill in the pertinent art without departing from the scope or spirit of the present invention. All such changes and modifications are intended to be included within the scope of the present invention as set forth in the appended claims.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It will be understood by those skilled in the art that all of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where such features are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.
The above description is only for the specific embodiment of the present invention or the description thereof, and the protection scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and the changes or substitutions should be covered within the protection scope of the present invention. The protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (30)
1. A method for determining a movement trajectory of a target object, comprising:
determining a target image from images stored in a storage device, wherein the images stored in the storage device comprise images of a target object shot by a plurality of shooting devices, the plurality of shooting devices at least comprise two shooting devices arranged at different positions, and the target image comprises the image of the target object in the images of the target object;
and determining the movement track of the target object according to the target image.
2. The method of claim 1, further comprising: and displaying the movement track on an interactive interface.
3. The method of claim 1 or 2, wherein determining the target image from the images stored in the storage device comprises:
the reference image of the target object is matched with the images stored by the storage device to determine the target image from the images stored by the storage device.
4. The method of claim 3, wherein matching the reference image of the target object with the images stored by the storage device to determine the target image from the images stored by the storage device comprises:
matching a reference image of a target object with an image stored by the storage device to determine a matching coefficient between the reference image and the stored image;
and when the matching coefficient meets a preset condition, determining an image corresponding to the matching coefficient in the stored images as a target image.
5. The method according to claim 3 or 4, characterized in that the method further comprises:
acquiring index information of a target object input by a user through an interactive interface, and determining a reference image of the target object according to the index information of the target object.
6. The method according to claim 5, wherein the index information includes identity information of a target object, the obtaining of the index information of the target object input by a user through an interactive interface, and the determining of the reference image of the target object according to the index information of the target object include:
acquiring identity information of a target object input by a user through an interactive interface;
acquiring an image corresponding to the identity information according to the identity information;
and determining the image corresponding to the identity information as a reference image of the target object.
7. The method according to claim 5, wherein the index information includes an image, the obtaining index information of a target object input by a user through an interactive interface, and determining a reference image of the target object according to the index information of the target object comprises:
the method comprises the steps of obtaining an image of a target object input by a user through an interactive interface, and determining the input image as a reference image of the target object.
8. The method of claim 1, wherein determining a movement trajectory of a target object from the target image comprises:
determining a shooting device for shooting the target image according to the target image;
determining the position of a target object according to the installation position of a shooting device for shooting the target image;
and according to the position information of the target object, the moving track of the target object is obtained.
9. The method of claim 8, wherein determining the location of the target object based on the installation location of the camera capturing the target image comprises:
and determining the position of the target object according to the installation position and the shooting direction of the shooting device for shooting the target image and the position of the target object in the shooting picture when the shooting device shoots the target image.
10. The method according to any one of claims 1-9, further comprising:
acquiring images output by the plurality of shooting devices;
determining an image of an object from the output image according to an object recognition algorithm;
storing the image of the object in the storage device.
11. The method of claim 10, wherein determining an image of an object from the output image according to an object recognition algorithm comprises:
determining a bounding box of an object in the output image according to an object recognition algorithm;
determining an image of the object according to the bounding box.
12. The method of claim 11, wherein determining the image of the object from the bounding box comprises:
identifying an image of a background from images in a boundary frame, and deleting the image of the background;
and determining the residual images in the boundary box as images of the object.
13. The method of any one of claims 1-12, wherein the object is a pedestrian, the method further comprising:
determining an image including a front face of a target object from the target image, and displaying the image including the front face of the target object.
14. The method of claim 13, further comprising:
identifying according to the image comprising the front face of the target object to determine whether the target object belongs to a preset tissue;
if so, displaying first prompt information, wherein the first prompt information is used for indicating that the target object belongs to a preset organization;
and otherwise, displaying second prompt information, wherein the second prompt information is used for indicating that the target line does not belong to the preset organization.
15. The method of any one of claims 1-12, wherein the target object is a pedestrian.
16. An apparatus for determining a movement trajectory of a ground target object, the apparatus comprising:
a memory and a processor;
the memory is used for storing program codes;
the processor, invoking the program code, when executed, is configured to:
determining a target image from images stored in a storage device, wherein the images stored in the storage device comprise images of a target object shot by a plurality of shooting devices, the plurality of shooting devices at least comprise two shooting devices arranged at different positions, and the target image comprises the image of the target object in the images of the target object;
and determining the movement track of the target object according to the target image.
17. The apparatus of claim 16, wherein the processor, when invoking the program code, further performs the following: and displaying the movement track on an interactive interface.
18. The apparatus of claim 16 or 17, wherein the processor, when determining the target image from the images stored in the storage device, comprises:
the reference image of the target object is matched with the images stored by the storage device to determine the target image from the images stored by the storage device.
19. The apparatus of claim 18, wherein the processor, when matching the reference image of the target object with the images stored by the storage device to determine the target image from the images stored by the storage device, comprises:
matching a reference image of a target object with an image stored by the storage device to determine a matching coefficient between the reference image and the stored image;
and when the matching coefficient meets a preset condition, determining an image corresponding to the matching coefficient in the stored images as a target image.
20. The apparatus of claim 18 or 19, wherein the processor, when calling the program code, further performs the following:
acquiring index information of a target object input by a user through an interactive interface, and determining a reference image of the target object according to the index information of the target object.
21. The apparatus of claim 20, wherein the index information includes identity information of a target object, and the processor, when acquiring the index information of the target object input by the user through the interactive interface and determining the reference image of the target object according to the index information of the target object, performs the following operations:
acquiring identity information of a target object input by a user through an interactive interface;
acquiring an image corresponding to the identity information according to the identity information;
and determining the image corresponding to the identity information as a reference image of the target object.
22. The apparatus of claim 20, wherein the index information comprises an image, and the processor, when acquiring index information of a target object input by a user through an interactive interface and determining a reference image of the target object according to the index information of the target object, performs the following operations:
the method comprises the steps of obtaining an image of a target object input by a user through an interactive interface, and determining the input image as a reference image of the target object.
23. The apparatus of claim 16, wherein the processor, in determining a movement trajectory of a target object from the target image, comprises:
determining a shooting device for shooting the target image according to the target image;
determining the position of a target object according to the installation position of a shooting device for shooting the target image;
and according to the position information of the target object, the moving track of the target object is obtained.
24. The apparatus of claim 23, wherein the processor, when determining the position of the target object according to the installation position of the camera capturing the target image, comprises:
and determining the position of the target object according to the installation position and the shooting direction of the shooting device for shooting the target image and the position of the target object in the shooting picture when the shooting device shoots the target image.
25. The apparatus of any of claims 16-24, wherein the processor, when invoking the program code, further performs the following:
acquiring images output by the plurality of shooting devices;
determining an image of an object from the output image according to an object recognition algorithm;
storing the image of the object in the storage device.
26. The apparatus of claim 25, wherein the processor, when determining the image of the object from the output image according to an object recognition algorithm, further performs the following:
determining a bounding box of an object in the output image according to an object recognition algorithm;
determining an image of the object according to the bounding box.
27. The apparatus of claim 26, wherein the processor, when determining the image of the object according to the bounding box, further performs the following:
identifying an image of a background from images in a boundary frame, and deleting the image of the background;
and determining the residual images in the boundary box as images of the object.
28. The apparatus according to any of claims 16-27, wherein the object is a pedestrian, and wherein the processor, when invoking the program code, further performs the following:
determining an image including a front face of a target object from the target image, and displaying the image including the front face of the target object.
29. The apparatus of claim 28, wherein the processor, when invoking the program code, further performs the following:
identifying according to the image comprising the front face of the target object to determine whether the target object belongs to a preset tissue;
when the target object belongs to a preset organization, displaying first prompt information, wherein the first prompt information is used for indicating that the target object belongs to the preset organization;
and when the target object is not in the preset organization, displaying second prompt information, wherein the second prompt information is used for indicating that the target line does not belong to the preset organization.
30. The apparatus of any one of claims 16-29, wherein the target object is a pedestrian.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2019/076557 WO2020172870A1 (en) | 2019-02-28 | 2019-02-28 | Method and apparatus for determining motion trajectory of target object |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111263955A true CN111263955A (en) | 2020-06-09 |
Family
ID=70953441
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201980005227.6A Pending CN111263955A (en) | 2019-02-28 | 2019-02-28 | Method and device for determining movement track of target object |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111263955A (en) |
| WO (1) | WO2020172870A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111970434A (en) * | 2020-07-22 | 2020-11-20 | 吉林省智擎工业软件研究院有限公司 | Multi-camera multi-target athlete tracking shooting video generation system and method |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112044075A (en) * | 2020-09-18 | 2020-12-08 | 网易（杭州）网络有限公司 | Method and device for generating motion trail |
| CN114171211A (en) * | 2021-12-14 | 2022-03-11 | 平安国际智慧城市科技股份有限公司 | Trajectory tracking method and device, computer equipment and storage medium |
| CN116883003A (en) * | 2023-07-10 | 2023-10-13 | 国家电网有限公司客户服务中心 | Mobile terminal payment electricity purchasing anti-fraud method and system based on biological probe technology |
| CN117241133B (en) * | 2023-11-13 | 2024-02-06 | 武汉益模科技股份有限公司 | Visual work reporting method and system for multi-task simultaneous operation based on non-fixed position |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105898205A (en) * | 2015-01-04 | 2016-08-24 | 伊姆西公司 | Method and device for monitoring target object by means of a plurality of cameras |
| CN107358146A (en) * | 2017-05-22 | 2017-11-17 | 深圳云天励飞技术有限公司 | Method for processing video frequency, device and storage medium |
| CN108256443A (en) * | 2017-12-28 | 2018-07-06 | 深圳英飞拓科技股份有限公司 | A kind of personnel positioning method, system and terminal device |
| CN108769598A (en) * | 2018-06-08 | 2018-11-06 | 复旦大学 | Across the camera video method for concentration identified again based on pedestrian |
| CN108876821A (en) * | 2018-07-05 | 2018-11-23 | 北京云视万维科技有限公司 | Across camera lens multi-object tracking method and system |
| CN109166261A (en) * | 2018-10-11 | 2019-01-08 | 平安科技（深圳）有限公司 | Image processing method, device, equipment and storage medium based on image recognition |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9355320B2 (en) * | 2014-10-30 | 2016-05-31 | Toyota Motor Engineering & Manufacturing North America, Inc. | Blur object tracker using group lasso method and apparatus |
| CN106127137A (en) * | 2016-06-21 | 2016-11-16 | 长安大学 | A kind of target detection recognizer based on 3D trajectory analysis |
| CN108875548B (en) * | 2018-04-18 | 2022-02-01 | 科大讯飞股份有限公司 | Character track generation method and device, storage medium and electronic equipment |
-
2019
- 2019-02-28 CN CN201980005227.6A patent/CN111263955A/en active Pending
- 2019-02-28 WO PCT/CN2019/076557 patent/WO2020172870A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105898205A (en) * | 2015-01-04 | 2016-08-24 | 伊姆西公司 | Method and device for monitoring target object by means of a plurality of cameras |
| CN107358146A (en) * | 2017-05-22 | 2017-11-17 | 深圳云天励飞技术有限公司 | Method for processing video frequency, device and storage medium |
| CN108256443A (en) * | 2017-12-28 | 2018-07-06 | 深圳英飞拓科技股份有限公司 | A kind of personnel positioning method, system and terminal device |
| CN108769598A (en) * | 2018-06-08 | 2018-11-06 | 复旦大学 | Across the camera video method for concentration identified again based on pedestrian |
| CN108876821A (en) * | 2018-07-05 | 2018-11-23 | 北京云视万维科技有限公司 | Across camera lens multi-object tracking method and system |
| CN109166261A (en) * | 2018-10-11 | 2019-01-08 | 平安科技（深圳）有限公司 | Image processing method, device, equipment and storage medium based on image recognition |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111970434A (en) * | 2020-07-22 | 2020-11-20 | 吉林省智擎工业软件研究院有限公司 | Multi-camera multi-target athlete tracking shooting video generation system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020172870A1 (en) | 2020-09-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111263955A (en) | Method and device for determining movement track of target object | |
| US10210415B2 (en) | Method and system for recognizing information on a card | |
| US10262190B2 (en) | Method, system, and computer program product for recognizing face | |
| US9613258B2 (en) | Image quality assessment | |
| US8644563B2 (en) | Recognition of faces using prior behavior | |
| CN108229297B (en) | Face recognition method and device, electronic equipment and computer storage medium | |
| CN108875542B (en) | Face recognition method, device and system and computer storage medium | |
| CN108256404B (en) | Pedestrian detection method and device | |
| CN110245561B (en) | Face recognition method and device | |
| US11176679B2 (en) | Person segmentations for background replacements | |
| JP2013210968A (en) | Object detecting device and method, and program | |
| US10650234B2 (en) | Eyeball movement capturing method and device, and storage medium | |
| US11468683B2 (en) | Population density determination from multi-camera sourced imagery | |
| CN109299658B (en) | Face detection method, face image rendering device and storage medium | |
| US20140140583A1 (en) | Image recognition apparatus and image recognition method for identifying object | |
| CN109791615A (en) | For detecting and tracking the method, target object tracking equipment and computer program product of target object | |
| CN109766755A (en) | Face identification method and Related product | |
| JP2011086261A (en) | Information processing apparatus and information processing method | |
| CN106471440A (en) | Eye tracking based on efficient forest sensing | |
| CN111160169A (en) | Face detection method, device, equipment and computer readable storage medium | |
| CN112101195A (en) | Crowd density estimation method and device, computer equipment and storage medium | |
| CN108875500B (en) | Pedestrian re-identification method, device and system and storage medium | |
| CN111291627A (en) | Face recognition method and device and computer equipment | |
| CN109711287B (en) | Face acquisition method and related product | |
| CN114241012A (en) | High-altitude parabolic determination method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200609 |
|
| WD01 | Invention patent application deemed withdrawn after publication |