WO2016119368A1

WO2016119368A1 - Target tracking method and device

Info

Publication number: WO2016119368A1
Application number: PCT/CN2015/081399
Authority: WO
Inventors: 张伟
Original assignee: 中兴通讯股份有限公司
Priority date: 2015-01-29
Filing date: 2015-06-12
Publication date: 2016-08-04
Also published as: CN105989610A

Abstract

Disclosed are a target tracking method and device, the method comprising: acquiring a characteristic image used to identify a to-be-tracked target; looking up a video file containing the characteristic image; and determining, according to a geographical position of an acquisition device of the video file and time information of the to-be-tracked target passing the acquisition device, a movement trajectory of the to-be-tracked target. The present invention addresses the problem in the related art of certain limitations when applying a moving position to the field of target tracking, and enables tracking of a target according to target characteristic image information.

Description

Target tracking method and device

Technical field

The present invention relates to the field of communications, and in particular to a target tracking method and apparatus.

Background technique

Although mobile positioning technology has been applied to target tracking, there must be a mobile terminal carried by the target, otherwise tracking cannot be achieved, so mobile positioning still has certain limitations in the target tracking application.

In view of the related art, the problem that the mobile positioning application has certain limitations in the target tracking field has not yet proposed an effective solution.

Summary of the invention

The embodiment of the invention provides a target tracking method and device to solve at least some problems in the related art that the mobile positioning application has certain limitations in the target tracking field.

According to an embodiment of the present invention, there is provided a target tracking method, comprising: acquiring a feature image, wherein the feature image is used to identify a target to be tracked; searching for a video file containing the feature image; The geographic location where the acquisition device is located and the time information of the target to be tracked by the acquisition device determine the movement trajectory of the target to be tracked.

The time information includes: a start time and an end time of the to-be-tracked target appearing in the video file.

Determining, according to the geographic location where the collection device of the video file is located, and the time information of the to-be-tracked target through the collection device, the movement trajectory of the target to be tracked includes: according to the start time and the end time The collecting device sorts in time sequence to obtain a sorting result; and determines a moving track of the target according to the sorting result and a geographic position corresponding to each of the plurality of collecting devices.

After determining the moving trajectory of the target to be tracked according to the geographic location where the collecting device of the video file is located and the time information of the to-be-tracked target by the collecting device, including: according to the moving trajectory in the electronic map Corresponding to the location information, the moving track is displayed in real time on the electronic map. Further, finding a video file containing the feature image includes: locating the video file from all video files stored in the media stream server and/or the pre-unit PU.

According to another embodiment of the present invention, there is provided a target tracking apparatus, comprising: an acquisition module configured to acquire a feature image, wherein the feature image is used to identify a target to be tracked; a lookup module configured to search for the a video file of the feature image; the determining module is configured to determine a movement trajectory of the target to be tracked according to a geographic location where the collection device of the video file is located and time information of the target to be tracked by the collection device.

The determining module includes: an acquiring unit, configured to sort the plurality of the collecting devices in chronological order according to the start time and the ending time to obtain a sorting result; and the determining unit is configured to be based on the sorting result and the plurality of The respective geographic locations of the collection devices determine the movement trajectory of the target.

The determining module is further configured to display the moving track in real time on the electronic map according to corresponding position information of the moving track in an electronic map.

The lookup module is further configured to look up the video file based on all video files stored in the media stream server and/or the pre-unit PU.

According to the embodiment of the present invention, the acquiring feature image is used, wherein the feature image is used to identify the target to be tracked; the video file containing the feature image is searched; the geographic location of the device according to the video file and the target to be tracked are passed through the collecting device. The time information determines the movement trajectory of the target to be tracked. The invention solves the problem that the mobile positioning application has certain limitations in the target tracking field, and further achieves the effect of tracking the target according to the target feature image information.

DRAWINGS

The drawings described herein are intended to provide a further understanding of the invention, and are intended to be a part of the invention. In the drawing:

1 is a flow chart of a target tracking method according to an embodiment of the present invention;

2 is a block diagram showing the structure of a target tracking device according to an embodiment of the present invention;

3 is a structural block diagram (1) of a target tracking device according to an embodiment of the present invention;

4 is a block diagram showing the structure of a target tracking system according to an embodiment of the present invention;

FIG. 5 is a flowchart of feature image tracking processing according to an embodiment of the present invention.

detailed description

The invention will be described in detail below with reference to the drawings in conjunction with the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.

In this embodiment, a target tracking method is provided. FIG. 1 is a flowchart of a target tracking method according to an embodiment of the present invention. As shown in FIG. 1 , the process includes the following steps:

Step S102, acquiring a feature image, wherein the feature image is used to identify a target to be tracked;

Step S104, searching for a video file containing the feature image;

Step S106: Determine a movement trajectory of the target to be tracked according to the geographic location where the collection device of the video file is located and the time information of the target to be tracked by the collection device.

Through the above steps, by searching for the video file containing the feature image, the target corresponding to the feature image is tracked, and the gap of the tracking of the feature target in the video surveillance system is filled in the related technology, and the mobile positioning application to the target in the related art is solved. The tracking field has certain limitations, and the effect of tracking the target according to the target image information is achieved.

In an alternative embodiment, the time information includes a start time and an end time of the target to be tracked appearing in the video file.

The above step S104 involves determining the movement trajectory of the target to be tracked according to the geographical location of the collection device of the video file and the time information of the target to be tracked by the acquisition device. In an optional embodiment, according to the start time and the end The time sorts the plurality of collecting devices in chronological order, obtains the sorting result, and determines the moving track of the target according to the sorting result and the geographic location corresponding to each of the plurality of collecting devices.

In an optional embodiment, according to the geographic location where the acquisition device of the video file is located and the time information of the target to be tracked by the time information of the acquisition device, the corresponding position information in the electronic map according to the movement trajectory is determined. The movement track is displayed in real time on the electronic map, so that the geographical position of the target can be tracked. The above step S104 involves searching for a video file containing a feature image. In an alternative embodiment, the video file is searched from all video files stored in the media stream server and/or the pre-unit PU.

In this embodiment, a target tracking device is also provided, which is configured to implement the above-described embodiments and preferred embodiments, and has not been described again. As used below, the term "module" can be implemented in advance A combination of functional software and/or hardware. Although the apparatus described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware, is also possible and contemplated.

2 is a structural block diagram of a target tracking device according to an embodiment of the present invention. As shown in FIG. 2, the device includes: an acquiring module 22 configured to acquire a feature image, wherein the feature image is used to identify a target to be tracked; and the searching module 24 And determining, by the determining module 26, determining the movement trajectory of the target to be tracked according to the geographical location of the collection device of the video file and the time information of the target to be tracked by the acquisition device.

Optionally, the time information includes: a start time and an end time of the target to be tracked appearing in the video file.

3 is a structural block diagram (1) of a target tracking device according to an embodiment of the present invention. As shown in FIG. 3, the determining module 26 includes: an obtaining unit 262 configured to time according to a start time and an end time for a plurality of the collecting devices. Sorting sequentially to obtain a sorting result; determining unit 264 is configured to determine a moving trajectory of the target according to the sorting result and a geographic location corresponding to each of the plurality of collecting devices.

Optionally, the determining module 26 is further configured to display the moving trajectory in real time on the electronic map according to the corresponding location information of the moving trajectory in the electronic map. Optionally, the lookup module 24 is further configured to look up the video files from all of the video files stored in the media stream server and/or the pre-unit PU.

It should be noted that each of the above modules may be implemented by software or hardware. For the latter, the foregoing may be implemented by, but not limited to, the foregoing modules are all located in the same processor; or, the above modules are respectively located. In the first processor, the second processor, and the third processor.

For the above-mentioned problems existing in the related art, the following description will be made in conjunction with an alternative embodiment in which the above-described optional embodiments and alternative embodiments thereof are combined.

The optional embodiment proposes a video surveillance system based on feature image tracking, and the main purpose is to solve the limitation problem of the current mobile positioning system in the target tracking field.

The system has the following characteristics:

(1) Searching for the feature image (such as face feature information, back image feature information) information from the video file (corresponding to the above video file), thereby determining all the pre-units (Pre Unit, referred to as PU) through which the feature object passes, PU It is a network element device in the video surveillance system. Its network port is connected to the platform server, and its serial port is connected to the camera, which is set to manage and control the camera channel and so on. A PU can be connected to multiple cameras. Here is to find matches from all saved video files (such as mp4 files or other format files); the videos may be saved in the magnetic array of the media stream server (called network video files, from multiple PUs), or may be saved in PU hard disk (called For the front-end video files, from this PU), but there is no need to distinguish between these two types of video files, whether it is a network video file or a front-end video file, you can traverse the search by saving the path (usually the network path).

(2) Combining the geographical location information of the PU and the timestamp through the PU, the moving trajectory of the feature target can be obtained, and the history or real-time tracking of the feature target can be performed. For each video file, you can know which PU record is recorded through the save path (the folder contains the PU ID information), and the file's uniform resource locator (Uniform) can be known by its save path and file name. Resoure Locator (referred to as URL) address (combined together); the recording file name (including absolute time information) and the video file content (including relative time information) can know the start time and end time of the target. Knowing which PU the target object has passed, the purpose is to know which location the target has passed, knowing that the purpose of the URL is to facilitate the playback of the video file for playback at any time (this is very meaningful), knowing the start and end time can provide for the playback. According to the playing time period, the valid information is quickly found and played; in addition, knowing the starting time can also sort the target objects through the points in the starting time to obtain the moving track of the target object. After successfully finding a match to a video file, it is equivalent to knowing which PU the target object has passed, the start and end time of the elapsed time, and the URL of the video file.

The movement trajectory is obtained to know which points have passed through the target object, and each trajectory point contains information on the time period through which the recording URLs related to the points, the geographical location information of the points, and the like, so that For example, when the Public Security Bureau solves the case, it knows where the target has passed and the video playback provides convenience and basis, and can also judge according to the geographical location information and time of the last point of the target (if the time is near the current time) The current location of the target for real-time playback (non-video playback, which is more real-time) for real-time tracking observation or capture.

According to this alternative embodiment, a video surveillance system based on feature image tracking is provided. 4 is a structural block diagram of a target tracking system according to an embodiment of the present invention. As shown in FIG. 4, the system is composed of a VSS platform, a VSS portal, a PU, an SS, and a CU/PCU; wherein a client unit (CU/PCU) generates a feature image. Source and process the movement track information returned by the VSS platform; the feature image search engine of the VSS platform searches all the video files in the media stream server and the PU according to the feature information provided by the feature image source, and records the PU corresponding to the video when the feature image is found. The URL address, start timestamp and end timestamp of the video file are then transmitted to the target mobile trajectory analysis module of the VSS platform for analysis; the trajectory analysis module performs PU sorting according to the start/end timestamp relationship; and then according to the PU corresponding The geographic location information maps the ordered PU series into a sequence of latitude and longitude coordinate points, thereby obtaining the moving track information of the target; then the VSS platform returns the target moving track information to the CU/PCU, and the CU/PCU receives the moving track information. Performing the target movement trajectory on the map and playing the target Record the video file, determine the geographical location information of the target, and realize the historical and real-time tracking of the target; the specific implementation is as follows:

(1) Generation of CU/PCU feature image source, FIG. 5 is a flow chart of feature image tracking processing according to an embodiment of the present invention. As shown in FIG. 5, the flow includes the following steps:

Step S502: The CU/PCU selects a target image to be tracked, such as a personal photo, from the image library;

Step S504: The CU/PCU selects a feature image, such as a human face;

Step S506: The CU/PCU performs feature information extraction on the selected feature image.

Step S508: The extracted feature information is sent to the VSS platform to request target tracking.

(2) VSS platform feature information search engine, as shown in Figure 5,

Step S510: The VSS platform receives the feature image information sent by the CU/PCU, and the feature information search engine searches all the video files in the media stream server for feature information matching by using the feature image information, and the matching succeeds to enter the next step; otherwise, the search continues.

Step S512: Record the PU corresponding to the video file, the URL address of the video file, and the start/end timestamp of the target, and send the above information to the target mobile trajectory analysis module.

(3) VSS platform target moving trajectory analysis module, as shown in Figure 5,

Step S514: Sort the corresponding PUs according to the chronological order of the start/end timestamps in which the targets appear.

Step S516: Convert the sorted PU sequence into a sequence of latitude and longitude coordinate points according to the latitude and longitude information of the PU, and the sequence of the coordinate points is the target moving track. The latitude and longitude information of the PU is configured when the PU is added to the VSS portal.

Step S518: Send a sequence of latitude and longitude coordinate points to the CU/PCU. Each of the latitude and longitude coordinate points corresponds to the PU information, the URL address list of the video file, and the start/end timestamp list of the target in the video file.

(4) The processing of the movement track information by the CU/PCU, as shown in FIG. 5,

Step S520: The CU/PCU receives the movement track information returned by the VSS platform. The movement track of the target is displayed on the electronic map according to the latitude and longitude coordinate points.

Step S522: Each of the track points can select a video file of the track to play.

Step S524:: comparing the end timestamp of the last track point with the current system time to determine whether the target is still in the monitoring of the video monitoring system PU, that is, tracking the current geographic location of the target and performing real-time target Play.

In summary, the embodiment of the present invention provides a video surveillance system based on feature image tracking, which introduces a feature target tracking function in a video surveillance system, that is, tracking a moving track of an object by recording video recording. This breaks the limitation of mobile positioning in target tracking, and will be more extensive in the application field, such as tracking the escape route of prisoners when the public security organs solve the case, tracking the location of the prisoner's crime, and tracking the route. The blank of tracking the feature target in the video surveillance system in the related art is solved, and the problem that the mobile positioning application has certain limitations in the target tracking field is solved.

In another embodiment, a software is provided that is configured to perform the technical solutions described in the above embodiments and preferred embodiments.

In another embodiment, a storage medium is further provided, wherein the software includes the above-mentioned software, including but not limited to: an optical disk, a floppy disk, a hard disk, an erasable memory, and the like.

It will be apparent to those skilled in the art that the various modules or steps of the present invention described above can be implemented by a general-purpose computing device that can be centralized on a single computing device or distributed across a network of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein. The steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated as a single integrated circuit module. Thus, the invention is not limited to any specific combination of hardware and software.

The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Industrial applicability

As described above, the object tracking method and apparatus provided by the embodiments of the present invention have the following beneficial effects: the problem that the mobile positioning application has certain limitations in the target tracking field is solved, and the feature image according to the target is achieved. The effect of information tracking on the target.

Claims

A target tracking method, including:

Obtaining a feature image, wherein the feature image is used to identify a target to be tracked;

Finding a video file containing the feature image;

Determining a movement trajectory of the target to be tracked according to a geographical location of the collection device of the video file and time information of the to-be-tracked target through the collection device.
The method of claim 1, wherein the time information comprises a start time and an end time of the target to be tracked appearing in the video file.
The method according to claim 2, wherein determining the movement trajectory of the target to be tracked according to the geographical location of the collection device of the video file and the time information of the to-be-tracked target through the collection device comprises:

Sorting a plurality of the collection devices in chronological order according to the start time and the end time to obtain a sort result;

Determining a movement trajectory of the target according to the ranking result and a geographic location corresponding to each of the plurality of collection devices.
The method according to claim 3, wherein, after determining a moving trajectory of the target to be tracked according to a geographical location of the collection device of the video file and time information of the to-be-tracked target through the collecting device, :

The moving track is displayed on the electronic map in real time according to the corresponding position information of the moving track in the electronic map.
The method according to any one of claims 1 to 4, wherein finding a video file containing the feature image comprises:

The video file is looked up from all video files stored in the media stream server and/or the pre-unit PU.
A target tracking device comprising:

An acquiring module, configured to acquire a feature image, wherein the feature image is used to identify a target to be tracked;

a lookup module configured to find a video file containing the feature image;

And a determining module, configured to determine a movement trajectory of the to-be-tracked target according to a geographical location where the collection device of the video file is located and time information of the to-be-tracked target through the collection device.
The apparatus of claim 6, wherein the time information comprises a start time and an end time of the to-be-tracked target appearing in the video file.
The apparatus of claim 7, wherein the determining module comprises:

An obtaining unit, configured to sort the plurality of the collecting devices in chronological order according to the start time and the ending time, and obtain a sorting result;

a determining unit, configured to determine a moving trajectory of the target according to the sorting result and a geographic location corresponding to each of the plurality of collecting devices.
The apparatus of claim 8, wherein the determining module is further configured to display the movement trajectory in real time on the electronic map according to corresponding position information of the movement trajectory in an electronic map.
Apparatus according to any one of claims 6 to 9, wherein the lookup module is further arranged to look up the video file from all video files stored in the media stream server and/or the pre-unit PU.