WO2014067117A1

WO2014067117A1 - Method, server, terminal and video surveillance system for processing video data

Info

Publication number: WO2014067117A1
Application number: PCT/CN2012/083915
Authority: WO
Inventors: 张群君
Original assignee: 华为技术有限公司
Priority date: 2012-11-01
Filing date: 2012-11-01
Publication date: 2014-05-08
Also published as: CN103947189A; CN103947189B

Abstract

Disclosed are a method, a server, a terminal and a video surveillance system for processing video data. The method comprises: obtaining video data captured by a mobile camera and the location information of where the mobile camera captures the video data; establishing a correlation between the video data and the location information according to the time information corresponding to said video data and location information; and storing said correlation, so that the terminal obtains, according to the location information, the video data corresponding to said location information. According to the video data processing method, server, terminal and video surveillance system provided in the embodiments of the present invention, the server establishes a correlation between the video data captured by the mobile camera and the location information of where the mobile camera captures the video data, so that the terminal can obtain the video data corresponding to the location information according to same, and thus improving user experience.

Description

Method, server, terminal and video monitoring system for processing video data

The present invention relates to the field of video surveillance, and more particularly to a method, a server, a terminal, and a video surveillance system for processing video data in the field of video surveillance. Background technique

In the field of video surveillance, mobile cameras are introduced in the face of more and more mobile scenes. In general, the user's use of the mobile camera will be combined with the Geographic Information System (GIS) map, and the user's focus is usually on the following aspects: I hope that the mobile camera can be in the GIS. Real-time positioning on the map; I want to be able to view the position information of the video or video when viewing the live video and video of the mobile camera; I want to display the motion track of the mobile camera in the GIS map; and I want to view the corresponding camera according to the location information. Video recording.

In the current technical solution, the mobile camera can automatically acquire its own geographical location information, and upload the acquired geographical location information to the server; the server then records the geographical location information of the mobile camera on the server, and pushes it to the terminal or configures There is a terminal of the client; the terminal can mark the geographical location of the mobile camera on the client map, so that the user can know the current geographical location of the mobile camera in real time and accurately through the map in the client, and know the real-time acquisition of the mobile camera through the map in the client. Video recording.

However, the user cannot retrieve the video recording recorded by the mobile camera at the specified location in the later stage, and the user experience is poor. Summary of the invention

Embodiments of the present invention provide a method, a server, a terminal, and a video monitoring system for processing video data, so that a user can acquire video data corresponding to location information according to location information.

In a first aspect, an embodiment of the present invention provides a method for processing video data, the method comprising: acquiring video data captured by a mobile camera, and location information of the mobile camera when capturing the video data; The time information corresponding to the location information is used to establish an association relationship between the video data and the location information. The association relationship is saved, so that the terminal acquires video data corresponding to the location information according to the location information. In a first possible implementation manner of the first aspect, the method further includes: receiving, by the terminal, a video data query request that includes a specified location; determining, according to the association relationship and the specified location, a designation corresponding to the specified location Video data; the specified video data is sent to the terminal.

With reference to the first aspect or the first possible implementation manner of the first aspect, in a second possible implementation manner of the first aspect, the acquiring the video data captured by the mobile camera, and the moving camera capturing the video data The location information includes: receiving a video encoding frame sent by the mobile camera, the video encoding frame includes the location information and the video data in the same encoding format; and decoding the video encoding frame to obtain the video data and the location information.

In conjunction with the first aspect, the first or the second possible implementation of the first aspect, in a third possible implementation manner of the first aspect, the acquiring video data captured by the mobile camera, and the moving camera capturing the The location information of the video data includes: receiving a real-time transport protocol (RTP) message sent by the mobile camera, where the header of the RTP message carries the location information, and the payload of the RTP message carries the video data; The RTP packet is parsed to obtain the video data and the location information.

In a second aspect, an embodiment of the present invention provides a method for processing video data, the method comprising: sending, to a server, a video data query request for requesting specified video data, where the video data query request includes a mobile camera capturing the specified video data. a specified location at which the time is received; receiving the specified video data sent by the server according to the video data query request, the specified video data being captured by the server according to the specified location, and the video data captured by the mobile camera and the mobile camera capturing the video The association relationship between the location information at which the data is located is determined; the specified video data is presented to the user in the form of superimposed playback with the specified location.

In a first possible implementation manner of the second aspect, the video data query request further includes a specified time; the specified video data is determined by the server according to the specified location, the specified time, and the video data and the location information The video data determined by the association.

In a third aspect, an embodiment of the present invention provides a server, where the server includes: an acquiring module, configured to acquire video data captured by a mobile camera, and location information of the mobile camera when capturing the video data; And establishing, according to the time information corresponding to the video data and the location information, an association relationship between the video data acquired by the acquiring module and the location information; and a storage module, configured to save the association relationship established by the establishing module, so that The terminal acquires video data corresponding to the location information according to the location information.

In a first possible implementation manner of the third aspect, the server further includes: a receiving module, And a determining module, configured to determine, according to the association relationship and the specified location received by the receiving module, the specified video data corresponding to the specified location; the sending module, And transmitting the specified video data determined by the determining module to the terminal.

With the third aspect or the first possible implementation manner of the third aspect, in a second possible implementation manner of the third aspect, the acquiring module includes: a first receiving unit, configured to receive a video sent by the mobile camera An encoding frame, the video encoding frame includes the location information and the video data in the same encoding format; the first acquiring unit is configured to: decode the video encoding frame received by the first receiving unit, and obtain the video data and the location information.

In conjunction with the third aspect or the first or second possible implementation manner of the third aspect, in a third possible implementation manner of the third aspect, the acquiring module includes: a second receiving unit, configured to receive the mobile a real-time transmission protocol RTP packet sent by the camera, the packet header of the RTP packet carries the location information, the payload of the RTP packet carries the video data, and the second obtaining unit is configured to receive the second receiving unit The RTP message is parsed to obtain the video data and the location information.

According to a fourth aspect, an embodiment of the present invention provides a terminal, where the terminal includes: a sending module, configured to send, to a server, a video data query request for requesting specified video data, where the video data query request includes a mobile camera capturing the specified video a specified location where the data is located; a receiving module, configured to receive the specified video data sent by the server according to the video data query request sent by the sending module, the specified video data is determined by the server according to the specified location, and the mobile Determining an association relationship between the video data captured by the camera and the location information when the mobile camera captures the video data; the display module, configured to superimpose the specified video data received by the receiving module and the specified location Presented to the user.

In a first possible implementation manner of the fourth aspect, the video data query request sent by the sending module further includes a specified time; the specified video data received by the receiving module is the server according to the specified location, the specified time, and The video data determined by the association relationship between the video data and the location information.

In a fifth aspect, an embodiment of the present invention provides a video monitoring system, including: a server according to an embodiment of the present invention; and a mobile camera, where the server includes: an acquiring module, configured to acquire a captured by a mobile camera Video data, and location information of the mobile camera when capturing the video data; establishing a module for using the video data and the location information Corresponding time information, establishing an association relationship between the video data acquired by the acquiring module and the location information; and a storage module, configured to save the association relationship established by the establishing module, so that the terminal acquires the location according to the location information Corresponding video data; the mobile camera includes: an acquisition module, configured to capture video data and obtain location information when the video data is captured; and a sending module, configured to send the video data and the location information to the server, to And causing the server to establish an association relationship between the video data and the location information according to time information corresponding to the video data and the location information.

In a first possible implementation manner of the fifth aspect, the sending module includes: a first sending unit, configured to send a video encoding frame to the server, where the video encoding frame includes the location information acquired by the acquiring module, and the video Data, the location information and the video data are encoded in the same format.

In a second possible implementation manner of the fifth aspect, the sending module includes: a second sending unit, configured to send a real-time transport protocol (RTP) packet to the server, where the packet header of the RTP packet carries the acquiring module to obtain The location information, the payload of the RTP message carries the video data acquired by the acquiring module.

With reference to the fifth aspect, or the first or second possible implementation manner of the fifth aspect, in a third possible implementation manner of the fifth aspect, the video monitoring system further includes a terminal according to the embodiment of the present invention, The terminal includes: a sending module, configured to send, to the server, a video data query request for requesting specified video data, where the video data query request includes a specified location where the mobile camera captures the specified video data; and a receiving module, configured to: Receiving, by the server, the specified video data sent according to the video data query request sent by the sending module, where the specified video data is captured by the server according to the specified location, and the video data captured by the mobile camera and the mobile camera captures the video data. The relationship between the location information is determined by the display module, and the display module is configured to present the specified video data received by the receiving module to the user in a superimposed manner.

Based on the foregoing technical solution, a method, a server, a terminal, and a video monitoring system for processing video data according to an embodiment of the present invention establish, between a video data captured by a mobile camera and a location information when the mobile camera captures the video data, by using a server. The association relationship enables the terminal to acquire video data corresponding to the location information according to the location information, thereby improving the user experience. DRAWINGS

In order to more clearly illustrate the technical solution of the embodiment of the present invention, the following will be The drawings to be used are described in a single manner. Obviously, the drawings described below are only some embodiments of the present invention, and those skilled in the art can also perform without creative work. Other figures are obtained from these figures.

FIG. 1 is a schematic structural diagram of a video monitoring networking according to an embodiment of the present invention.

2 is a schematic flow chart of a method of processing video data according to an embodiment of the present invention.

FIG. 3 is another schematic flowchart of a method of processing video data according to an embodiment of the present invention. 4 is a schematic flow diagram of a method of acquiring video data and location information in accordance with an embodiment of the present invention.

FIG. 5 is another schematic flowchart of a method of acquiring video data and location information according to an embodiment of the present invention.

FIG. 6 is a schematic flowchart of a method of processing video data according to another embodiment of the present invention. FIG. 7 is a schematic flowchart of a method of processing video data according to still another embodiment of the present invention. FIG. 8 is a schematic flowchart of a method of processing video data according to still another embodiment of the present invention. 9 is a schematic block diagram of a server in accordance with an embodiment of the present invention.

FIG. 10 is another schematic block diagram of a server according to an embodiment of the present invention.

11 is a schematic block diagram of an acquisition module in accordance with an embodiment of the present invention.

Figure 12 is another schematic block diagram of an ear block in accordance with an embodiment of the present invention.

FIG. 13 is a schematic block diagram of a terminal according to an embodiment of the present invention.

Figure 14 is a schematic block diagram of a mobile camera in accordance with an embodiment of the present invention.

Figure 15 is a schematic block diagram of a video surveillance system in accordance with an embodiment of the present invention.

Figure 16 is a schematic block diagram of a mobile camera in accordance with an embodiment of the present invention.

17 is another schematic block diagram of a video surveillance system in accordance with an embodiment of the present invention. detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are a part of the embodiments of the present invention, and not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without making creative labor are within the scope of the present invention.

FIG. 1 shows a schematic architectural diagram of a video monitoring networking in accordance with an embodiment of the present invention. As shown in FIG. 1, the video surveillance system can be composed of a mobile camera, a terminal, and a server, wherein the mobile camera, the terminal, and the server can pass through, for example, an Internet Protocol ("IP"). The communication network of the network is connected to each other.

Specifically, for example, the mobile camera can be integrated with a global positioning module, so that in addition to capturing real-time audio and video signals, the mobile camera can also acquire the geographical location information of the mobile camera, that is, the mobile camera mainly performs The collection and encoding of video data and location information; the server can mainly perform mobile camera management, terminal management, business process management, and data storage, etc., for example, the server is used to implement location information, video data analysis, storage, and access to the terminal. Providing a query service to the terminal, etc.; the terminal may be configured with a client to provide an entry for the user to perform video service operations, management, and the like.

It should be understood that the technical solutions of the embodiments of the present invention can be applied to various communication networks or communication systems, for example, Global System of Mobile communication ("GSM") system, code division multiple (Code Division Multiple) Access, called "CDMA" system, Wideband Code Division Multiple Access ("WCDMA") system, General Packet Radio Service (General Packet Radio Service, called "GPRS"), Long Term Evolution (LTE) system, LTE Frequency Division Duplex (FCD) system, LTE Time Division Duplex (TDD) ), Universal Mobile Telecommunication System (UMTS), Worldwide Interoperability for Microwave Access (WiMAX) communication system, etc.

It should also be understood that in the embodiment of the present invention, a terminal (Terminal) may be referred to as a user equipment (User).

Equipment, the tube is called "UE"), the mobile station (Mobile Station, the tube is called "MS"), the mobile terminal (Mobile Terminal), etc., and the user equipment can be accessed via the radio access network (Radio Access Network). RAN") communicates with one or more core networks. For example, the user equipment may be a mobile phone (or "cellular, telephone"), a computer with a mobile terminal, etc., for example, the user equipment may also be portable, pocket-sized Mobile, built-in, computer-mounted or in-vehicle mobile devices that exchange voice and/or data with a wireless access network. The method 100 can be performed, for example, by a server for video surveillance. As shown in FIG. 2, the method 100 includes:

S110, acquiring video data captured by the mobile camera, and location information of the mobile camera when capturing the video data; S120. Establish an association relationship between the video data and the location information according to time information corresponding to the video data and the location information.

S130. The association relationship is saved, so that the terminal acquires video data corresponding to the location information according to the location information.

In order to enable the terminal to acquire video data corresponding to the location information according to the location information, the server may be based on the acquired video data of the mobile camera and the location information of the mobile camera when capturing the video data, based on the video data and The time information corresponding to the location information establishes and maintains an association relationship between the video data and the location information, thereby enabling the terminal to perform mutual query between the location information and the video data.

Therefore, the method for processing video data in the embodiment of the present invention establishes an association relationship between video data captured by the mobile camera and location information when the mobile camera captures the video data, so that the terminal can acquire and obtain information according to the location information. The location information corresponds to the video data, thereby improving the user experience.

In the embodiment of the present invention, optionally, as shown in FIG. 3, the method 100 further includes:

S140. Receive a video data query request that is sent by the terminal and includes a specified location.

S150. Determine, according to the association relationship and the designated location, specified video data corresponding to the specified location.

S160. Send the specified video data to the terminal.

Specifically, the terminal may send a video data query request to the server through the client, where the video data query request includes a specified location that the user wishes to query. For example, the user can input or select a specified location through a query window provided by the client; the user can also select the starting and ending point of the moving camera motion track on the GIS map to determine the specified location, so that the client can send the specified location to the server. Video data query request. After receiving the request sent by the terminal, the server may determine the specified video data corresponding to the specified location according to the association relationship between the video data and the location information, and send the specified video data to the terminal.

It should be understood that, in various embodiments of the present invention, information may be transmitted between a server, a terminal, and a mobile camera through a message interface, or may be transmitted through an Application Programming Interface ("API"). The information is transmitted by other types of interfaces or other means, and embodiments of the present invention are not limited thereto.

It should also be understood that in various embodiments of the invention, various "requests" or "responses" refer only to a certain carrier, such as a message, etc., that carries information or content, and is not limited to a particular name. E.g, The "video data query request" is only used to indicate that the terminal requests video data from the server, and is not limited to the request named video data query request.

In the embodiment of the present invention, optionally, the location information includes at least one of longitude information, dimension information, and height information.

In S110, the server can obtain the video data captured by the mobile camera in various manners, and the position information of the mobile camera when capturing the video data, which will be described in detail below with reference to FIG. 4 and FIG. 5.

As shown in FIG. 4, optionally, the method 110 for acquiring video data and location information according to an embodiment of the present invention includes:

S111. Receive a video coding frame sent by the mobile camera, where the video coding frame includes the location information with the same coding format and the video data.

S112. Acquire the video data and the location information by decoding the video encoded frame. Specifically, when the video camera performs video data encoding and compression, the location information is compression-encoded together, for example, the location information and the video data may be encoded in the same encoding format to form a video encoding frame, and The encoded video encoded frame is sent to the server. After receiving the video encoded frame sent by the mobile camera, the server may obtain the video data and the location information by decoding the video encoded frame.

The video data encoding and decoding technology H.264 will be used as an example for video data. It should be understood that the video codec technology H.264 is a highly compressed digital video codec standard proposed by the Joint Video Group (JVT) composed of the Video Coding Experts Group (VCEG) and the Moving Picture Experts Group (MPEG). It should be understood that the embodiment of the present invention is only described by taking H.264 as an example, but the embodiment of the present invention is not limited thereto, and other video coding and decoding technologies may be used in the present invention, for example, a motion picture expert group (Movie Pictures Experts Group) The cartridge is called "MPEG" video encoding and decoding technology, motion still image compression technology or motion image frame-by-frame compression technology (Motion Joint Photographic Experts Group, called "MJPEG").

The structure of H.264's elementary stream (Elementary Stream, called "ES") can be divided into two layers, including video coding layer (Video Coding Layer, called "VCL") and network adaptation layer (Network Abstraction Layer). The cartridge is called "NAL", where the video encoding layer is responsible for efficient video content representation, and the network adaptation layer is responsible for packaging and transmitting the data in the appropriate manner required by the network. The basic stream of H.264 is composed of a series of Network Abstraction Layer Units ("NALU"), and the data volume of different NALUs may be different. Each NALU unit consists of a one-byte NALU header (NALU Header) and a number of bytes of raw byte sequence payload (Row Byte Sequence Payload, called "RBSP"). The format of the NALU header can be as shown in Table 1:

Table 1

In Table 1, the field F (forbidden_zero_bit) indicates the forbidden bit of the NALU. If there is a syntax conflict, the field F can be set to 1, for example, when the network recognizes that the unit has a bit error, it can be set to 1 to receive The field NRI ( nal_ref_idc ) indicates the importance level of the NALU. The larger the value of the NRI field, the more important the current NALU is. The field TYPE indicates the type of the NALU. The value of the TYPE field is 0~31. The value 0-12 is the type already used by H.264. The value 13-23 is the reserved type specified by the H.264 specification. The value 24-31 is the unspecified type.

For example, the encoding of the location information may also be carried out in a manner of a custom NALU unit, and the NALU unit carrying the video data may be combined, wherein in the custom NALU unit, the TYPE value in the NALU header may be specified as 24, and The location information (e.g., longitude, latitude, altitude) is placed in the RBSP of the NALU unit, i.e., the location information and the video data are encoded in the same encoding format to form a video encoded frame. It should also be understood that the above-described custom NALU unit can be inserted in the NALU unit of the video data when the position of the mobile camera changes.

It should be understood that, in the embodiment of the present invention, the terminal may further transmit the location information to the server by using other coding formats or NALU units using other data structures, and the embodiment of the present invention is not limited thereto.

Therefore, by encoding and transmitting the location information together with the video data, and adopting the same encoding format, the terminal can transmit the location information and the video data to the server, and can associate the location information and the video data with the time information of the video encoding frame. So that the server establishes an association relationship, so that the terminal can acquire video data corresponding to the location information according to the location information, thereby improving the user experience.

In the embodiment of the present invention, as shown in FIG. 5, optionally, the method 110 includes:

S113: Receive a real-time transport protocol RTP packet sent by the mobile camera, where a packet header of the RTP packet carries the location information, where a payload of the RTP packet carries the video data; S114. Acquire the video data and the location information by parsing the RTP packet. Specifically, the mobile camera separately encodes and compresses the video data, but when transmitting the encoded video data, carries the location information corresponding to the video data in the header of the packet, and carries the payload information in the payload portion of the packet. Video data. In the following, the mobile camera uses a Real-time Transport Protocol (RTP) to transmit data to the server as an example, but it should be understood that the mobile camera can also transmit data to the server by using other transmission protocols. The embodiment is not limited to this.

For example, when the mobile camera transmits a data message to the server through the RTP message, the mobile camera can separately compress and encode the video data, and add the video data corresponding to the payload in the extension field of the header of the RTP message. The location information, that is, the mobile camera can send the RTP data packet of the RTP message extension header to the server. Therefore, after receiving the RTP message sent by the mobile camera, the server may parse the RTP file to obtain the video data and the location information.

The extended header of the RTP message according to an embodiment of the present invention has, for example, a format as shown in Table 2. In Table 2, the field V represents the version number of the protocol, and the field may include 2 bytes; the field REV is a reserved field, and the field may include 14 bytes; the field L indicates the length of the RTP header, that is, Including the length of the field V, the field REV and the field L, the field may include 16 bytes; the fields DATA 1 to DATA n represent fields carrying data, the field may carry location information corresponding to the video data, for example may include moving At least one of longitude information, dimensional information, and altitude information in which the video camera captures the video data. It should be understood that headers of other formats may also be used for carrying location information, and embodiments of the present invention are not limited thereto.

Table 2

Field V Field REV Field L

Field DATA 1 Field DATA n In the embodiment of the present invention, optionally, when the mobile camera transmits data to the server, the video data and the location data may be separately transmitted, and the server analyzes the two types of data.

Specifically, for example, a hypertext transport protocol (HyperText Transport Protocol, called "Ηττρ") is used as an example to illustrate how a mobile camera transmits location information to an HTTP method. Server.

Assuming that the data format used by the mobile camera to transmit using HTTP is the Extensible Markup Language ("XML") format, the mobile camera can transmit the location information to the server, for example, in the following format:

<MSG>

<丁1^^8丁^^〉Timestamp </TIMESTAMP>

</header>

<longitude>Longitude </longitude>

<altitude>height</31111;11(16>

</content>

</MSG>

In the above XML format, the content included in the <content> portion is position information corresponding to the video data, and the location information includes, for example, at least the longitude information, the dimensional information, and the height information in which the mobile camera captures the video data. A kind of information.

Therefore, when the mobile camera sends video data to the server, the location information (longitude, latitude, and altitude) can be assembled according to the above message format, and sent to the server through the HTTP protocol, and the video data and location information are followed by the server. Processing, thereby enabling the terminal to acquire video data corresponding to the location information according to the location information, and improving the user experience.

In S120, the server establishes an association relationship between the video data and the location information according to time information corresponding to the video data and the location information.

Specifically, when the server receives the video encoded frame sent by the mobile camera to obtain the video data and the location information, the server may parse the video encoded frame to determine time and location information of each frame image, thereby The server can establish an association relationship between the video data and the location information according to the time information. For example, the server can establish an association between video data and location information; the server can also establish associations between video data, location information, and time information.

Similarly, when the server receives the RTP message sent by the mobile camera, thereby acquiring the video data and the location information, or when the server receives the video data and the location information respectively The server may establish an association relationship between the video data and the location information according to the time information corresponding to the video data and the location information, where the association relationship may include only video data and location information, and may also include other related information. For example, time information, the embodiment of the present invention is not limited thereto.

In S130, the server saves the association relationship, so that the terminal acquires video data corresponding to the location information according to the location information.

Specifically, the server may save the correspondence between the location information and the video data as a separate file, and the associated file may be divided according to the mobile camera and the time. For example, each mobile camera may store the associated data file for each hour as a separate file. The server may also store the corresponding relationship between the location information and the video data in the database; the server may also use other methods to save the correspondence between the location information and the video data, and the embodiment of the present invention is not limited thereto.

1 to 5, a method for processing video data according to an embodiment of the present invention is described in detail from the perspective of a server. Hereinafter, an embodiment according to the present invention will be described from the perspective of a terminal and a moving camera with reference to FIGS. 6 to 8. The method of processing video data. Executing, the method 200 includes:

S210. Send, to the server, a video data query request for requesting specified video data, where the video data query request includes a specified location where the mobile camera captures the specified video data;

S220. Receive the specified video data sent by the server according to the video data query request, where the specified video data is used by the server according to the specified location, and the video data captured by the mobile camera and the video camera captures the video data. The relationship between the location information is determined;

S230. Present the specified video data to the specified position in a superimposed manner to the user. In the embodiment of the present invention, optionally, the video data query request further includes a specified time; the specified video data is determined by the server according to the specified location, the specified time, and an association relationship between the video data and the location information. Video data.

In the embodiment of the present invention, optionally, the location information includes longitude information, dimension information, and high At least one of the degrees of information.

Therefore, the method for processing video data in the embodiment of the present invention establishes an association relationship between video data captured by the mobile camera and location information when the mobile camera captures the video data, so that the terminal can acquire and obtain information according to the location information. The location information corresponds to the video data, thereby improving the user experience. The method 300 can be performed by a mobile camera. As shown in FIG. 7, the method 300 includes: S310, capturing video data and acquiring location information when the video data is captured;

S320, sending a video coding frame and/or a real-time transmission protocol RTP message to the server, where the video coding frame includes the location information and the video data in the same encoding format, and the packet header of the RTP message carries the location information, the RTP The payload of the message carries the video data, so that the server establishes an association relationship between the video data and the location information according to time information corresponding to the video data and the location information.

A specific application according to an embodiment of the present invention will be described in detail below with reference to FIG. It should be understood that the embodiment of the present invention is described by taking only the application shown in FIG. 8 as an example, but the embodiment of the present invention is not limited thereto.

As shown in FIG. 8, the first application manner according to the embodiment of the present invention is as follows: The user views the video of the specified mobile camera, and simultaneously views the location information corresponding to the video. In the first application mode, the user specifies the video start and end time of the mobile camera to be viewed, as shown in step 401 in FIG. 8; then, the client queries the server for the video data of the user specified recording start and end time and the associated video. The location information (for example, latitude and longitude data), and the client superimposes the video data and the latitude and longitude position data, for example, superimposing the position information on the upper layer, and the recorded video data is placed on the lower layer for playing, as shown in step 402 in FIG.

The second application mode according to the embodiment of the present invention is as follows: The user displays the motion track of the mobile camera based on the GIS through the client, and views the video recording corresponding to the track line. In the second application mode, the client first accesses the server to request basic data related to the GIS map; Selecting or determining the mobile camera that needs to display the trajectory, and setting the start and end time of the display trajectory, as shown in step 411 in FIG. 8; the client queries the server according to the input information of the user, the latitude and longitude of the specified mobile camera within a specified time period. Associate the data, as shown in step 412 in FIG. 8; the client may superimpose the latitude and longitude data of the query onto the GIS map to form a trajectory line, as shown in step 413 in FIG. 8; the user may select all or a trajectory The client records the location data selected by the user, as shown in step 414 in FIG. 8; the client can query the server for the video data corresponding to the location information, and the server can transmit the video data corresponding to the location information to the client, the client. The video data and the latitude and longitude position data may be superimposed and played, for example, the position information is superimposed on the upper layer, and the recorded video data is superimposed on the lower layer, as shown in step 415 in FIG.

A second application mode according to an embodiment of the present invention is, for example, the user queries the video of the mobile camera according to the location. In the third application mode, the client can query the server for location information (latitude and longitude data) of the specified mobile camera within a specified time period according to the input of the user, and steps 411 and 412 in the same manner as in the second method; Go to the location information, and view the recorded video data of the mobile camera in the specified location segment, as shown in step 416 of FIG.

It should be understood that, in various embodiments of the present invention, the size of the sequence numbers of the above processes does not mean the order of execution, and the order of execution of each process should be determined by its function and internal logic, and should not be taken to the embodiments of the present invention. The implementation process constitutes any limitation.

A method of processing video data according to an embodiment of the present invention is described in detail above with reference to FIGS. 1 through 8. Hereinafter, a server, a terminal, and a mobile for processing video data according to an embodiment of the present invention will be described in detail with reference to FIGS. 9 through 14. Camera.

FIG. 9 shows a schematic block diagram of a server 500 in accordance with an embodiment of the present invention. As shown in FIG. 9, the server 500 includes:

The acquiring module 510 is configured to acquire video data captured by the mobile camera, and location information of the mobile camera when the video data is captured;

The establishing module 520 is configured to establish, according to the time information corresponding to the video data and the location information, an association relationship between the video data acquired by the acquiring module 510 and the location information.

The storage module 530 is configured to save the association established by the establishing module 520, so as to end The terminal acquires video data corresponding to the location information according to the location information.

Therefore, the server for processing video data in the embodiment of the present invention establishes an association relationship between the video data captured by the mobile camera and the location information when the mobile camera captures the video data, so that the terminal can acquire and obtain the location information according to the location information. The location information corresponds to the video data, thereby improving the user experience.

In the embodiment of the present invention, optionally, as shown in FIG. 10, the server 500 further includes: a receiving module 540, configured to receive, by the terminal, a video data query request including a specified location;

a determining module 550, configured to determine, according to the association relationship and the specified location received by the receiving module 540, specified video data corresponding to the specified location;

The sending module 560 is configured to send the specified video data determined by the determining module to the terminal. In the embodiment of the present invention, optionally, as shown in FIG. 11, the acquiring module 510 includes: a first receiving unit 511, configured to receive a video encoding frame sent by the mobile camera, where the video encoding frame includes the same encoding format. The location information and the video data;

The first obtaining unit 512 is configured to obtain the video data and the location information by decoding the video encoded frame received by the first receiving unit 511.

In the embodiment of the present invention, optionally, as shown in FIG. 12, the acquiring module 510 includes: a second receiving unit 513, configured to receive a real-time transport protocol RTP message sent by the mobile camera, and the RTP message report The header carries the location information, and the payload of the RTP packet carries the video data;

The second obtaining unit 514 is configured to obtain the video data and the location information by parsing the RTP packet received by the second receiving unit 513.

In the embodiment of the present invention, the location information acquired by the acquiring module 510 includes at least one of longitude information, dimension information, and altitude information.

It should be understood that the server 500 for processing video data according to an embodiment of the present invention may correspond to the server in the embodiment of the present invention, and the above and other operations and/or functions of the respective modules in the server 500 are respectively implemented in order to implement FIGS. 1 to 8. The corresponding processes of the various methods in the process are not repeated here.

Therefore, the server for processing video data in the embodiment of the present invention establishes an association relationship between the video data captured by the mobile camera and the location information when the mobile camera captures the video data, so that the terminal can acquire and obtain the location information according to the location information. The number of videos corresponding to this location information According to this, the user experience can be improved.

FIG. 13 shows a schematic block diagram of a terminal 600 in accordance with an embodiment of the present invention. As shown in FIG. 13, the terminal 600 includes:

a sending module 610, configured to send, to the server, a video data query request for requesting specified video data, where the video data query request includes a specified location where the mobile camera captures the specified video data;

The receiving module 620 is configured to receive the specified video data sent by the server according to the video data query request sent by the sending module 610, where the specified video data is used by the server according to the specified location, and the video data captured by the mobile camera Determining an association relationship between location information when the mobile camera captures the video data;

The display module 630 is configured to present the specified video data received by the receiving module 620 to the user in a superimposed manner.

In the embodiment of the present invention, optionally, the video data query request sent by the sending module 610 further includes a specified time; the specified video data received by the receiving module 620 is the server according to the specified location, the specified time, and the The video data determined by the association relationship between the video data and the location information.

It should be understood that the terminal 600 for processing video data according to an embodiment of the present invention may correspond to a server in the embodiment of the present invention, and the above and other operations and/or functions of the respective modules in the terminal 600 are respectively implemented in order to implement FIGS. 1 to 8. The corresponding processes of the various methods in the process are not repeated here.

Therefore, the terminal that processes the video data in the embodiment of the present invention establishes an association relationship between the video data captured by the mobile camera and the location information when the mobile camera captures the video data, so that the terminal can acquire and obtain the location information according to the location information. The location information corresponds to the video data, thereby improving the user experience.

Figure 14 shows a schematic block diagram of a mobile camera 700 in accordance with an embodiment of the present invention. As shown

As shown in Figure 14, the mobile camera 700 includes:

The acquiring module 710 is configured to capture video data and obtain location information when the video data is captured;

The sending module 720 is configured to send a video encoding frame and/or a real-time transport protocol (RTP) message to the server, where the video encoding frame includes the location information acquired by the acquiring module 710 and the video data, where the location information and the video data are used. The encoding format is the same, and the header of the RTP packet carries the packet header. Obtaining the location information obtained by the module 710, the payload of the RTP packet carries the video data acquired by the obtaining module 710, so that the server establishes the video data according to time information corresponding to the video data and the location information. The relationship between the location information.

It should be understood that the mobile camera 700 that processes video data according to an embodiment of the present invention may correspond to the mobile camera in the embodiment of the present invention, and that the above and other operations and/or functions of the respective modules in the mobile camera 700 are respectively implemented in order to implement FIG. The corresponding processes of the respective methods in FIG. 8 are not described here.

Therefore, the mobile camera that processes the video data in the embodiment of the present invention establishes an association relationship between the video data captured by the mobile camera and the location information when the mobile camera captures the video data, so that the terminal can obtain the location information according to the location information. The video data corresponding to the location information can improve the user experience.

Figure 15 shows a schematic block diagram of a video surveillance system 800 in accordance with an embodiment of the present invention. As shown in Figures 15 and 16, the video surveillance system 800 includes:

a server 810 according to an embodiment of the present invention; and

Moving the camera 820,

The server 810 includes:

An acquiring module, configured to acquire video data captured by the mobile camera 820, and location information of the mobile camera 820 when capturing the video data; and an establishing module, configured to establish, according to time information corresponding to the video data and the location information, The association relationship between the video data and the location information acquired by the acquiring module; the storage module is configured to save the association relationship established by the establishing module, so that the terminal acquires video data corresponding to the location information according to the location information;

The mobile camera 820 includes:

The obtaining module 821 is configured to capture video data and obtain location information when the video data is captured;

The sending module 822 is configured to send the video data and the location information to the server 810, so that the server 810 establishes an association between the video data and the location information according to time information corresponding to the video data and the location information. relationship.

Therefore, the video surveillance system of the embodiment of the present invention establishes an association relationship between the video data captured by the mobile camera and the location information when the mobile camera captures the video data, so that the terminal can acquire the location according to the location information. The corresponding video data of the information can improve the user experience. In the embodiment of the present invention, the sending module 822 includes: a first sending unit, configured to send a video encoding frame to the server 810, where the video encoding frame includes the location information acquired by the acquiring module 821 and the video Data, the location information and the video data are encoded in the same format.

In the embodiment of the present invention, optionally, the sending module 822 includes: a second sending unit, configured to send a real-time transport protocol (RTP) packet to the server 810, where the packet header of the RTP packet is sent by the acquiring module 821. The location information, the payload of the RTP message carries the video data acquired by the obtaining module 821.

In the embodiment of the present invention, optionally, as shown in FIG. 17, the video monitoring system 800 further includes a terminal 830 according to an embodiment of the present invention, where the terminal 830 includes: a sending module, configured to send to the server 810, Requesting a video data query request for specifying video data, the video data query request includes a specified location where the mobile camera 820 captures the specified video data, and a receiving module, configured to receive the video data query sent by the server 810 according to the sending module The designated video data sent by the request, the specified video data is associated with the specified location by the server 810, and the video data captured by the mobile camera 820 and the location information of the mobile camera 820 when the video data is captured. And a display module, configured to present, to the user, the specified video data received by the receiving module and the specified location in a superimposed manner.

It should be understood that the server 810 and the terminal 830 included in the video monitoring system 800 according to the embodiment of the present invention may respectively correspond to the server 500 and the terminal 600 in the embodiment of the present invention, and the above-mentioned sum of each module in the server 500 and the terminal 600. Other operations and/or functions are respectively omitted in order to implement the corresponding processes of the respective methods in FIGS. 1 to 8.

Therefore, the video surveillance system of the embodiment of the present invention establishes an association relationship between the video data captured by the mobile camera and the location information when the mobile camera captures the video data, so that the terminal can acquire the location according to the location information. The corresponding video data of the information can improve the user experience.

The embodiment of the present invention further provides a server, where the server includes a processor, configured to acquire video data captured by the mobile camera, and location information of the mobile camera when capturing the video data; And establishing, according to the time information corresponding to the video data and the location information, an association relationship between the video data and the location information; the processor is further configured to save the established association relationship, so that the terminal acquires the location information according to the location information. The location information corresponds to the video data. In an embodiment of the present invention, optionally, the server further includes a receiver and a transmitter, where the receiver is configured to receive a video data query request that is sent by the terminal, including the specified location; the processor is further configured to use the association relationship according to the association relationship Determining, with the designated location received by the receiver, specified video data corresponding to the designated location; the transmitter is configured to send the specified video data determined by the processor to the terminal.

In an embodiment of the present invention, optionally, the server further includes a receiver, configured to receive a video encoding frame sent by the mobile camera, where the video encoding frame includes the location information and the video data in the same encoding format; The processor is configured to obtain the video data and the location information by decoding the video encoded frame received by the receiver.

In the embodiment of the present invention, optionally, the server further includes a receiver, configured to receive a real-time transport protocol RTP packet sent by the mobile camera, where the header of the RTP packet carries the location information, the RTP The payload of the packet carries the video data; the processor is configured to obtain the video data and the location information by parsing the RTP packet received by the receiver.

In the embodiment of the present invention, optionally, the location information acquired by the processor includes at least one of longitude information, dimension information, and altitude information.

The embodiment of the present invention further provides a terminal, where the terminal includes: a transmitter, a receiver, and a processor, where the transmitter is configured to send, to the server, a video data query request for requesting specified video data, where the video data query request includes a specified location at which the mobile camera captures the specified video data; the receiver is configured to receive the specified video data sent by the server according to the video data query request sent by the sender, the specified video data being specified by the server according to the specified a location, and an association relationship between video data captured by the mobile camera and location information when the mobile camera captures the video data; the processor is configured to: use the specified video data received by the receiver with the designated location The form of the overlay play is presented to the user.

In the embodiment of the present invention, optionally, the video data query request sent by the transmitter further includes a specified time; the specified video data received by the receiver is the server according to the specified location, the specified time, and the video data. The video data determined by the association relationship with the location information.

An embodiment of the present invention further provides a mobile camera, where the mobile camera includes a processor and a transmitter, where the processor is configured to capture video data and obtain location information when the video data is captured; the transmitter is configured to The server sends a video encoding frame and/or a real-time transport protocol RTP message, where the video encoding frame includes the location information acquired by the processor and the video data, and the location information is the same as the encoding format used by the video data, and the RTP packet is used. The header of the message carries the processor Taking the location information, the payload of the RTP message carries the video data acquired by the processor, so that the server establishes the video data and the location information according to time information corresponding to the video data and the location information. The relationship between the two.

Therefore, the server, the terminal, and the mobile camera that process the video data in the embodiment of the present invention establish a relationship between the video data captured by the mobile camera and the location information when the mobile camera captures the video data, so that the terminal can enable the terminal to The video data corresponding to the location information is obtained based on the location information, thereby improving the user experience.

The embodiment of the present invention further provides a video monitoring system, including: a server according to an embodiment of the present invention; and a mobile camera, where the server includes a processor, and the processor is configured to acquire video data captured by the mobile camera. And the location information of the mobile camera when the video data is captured; the processor is further configured to establish an association relationship between the video data and the location information according to time information corresponding to the video data and the location information; The processor is further configured to save the established association relationship, so that the terminal acquires video data corresponding to the location information according to the location information; the mobile camera includes a processor and a transmitter, where the processor is configured to capture video data and obtain The location information of the video data is captured; the transmitter is configured to send the video data and the location information to the server, so that the server establishes the video data according to time information corresponding to the video data and the location information. The association with the location information Department.

In the embodiment of the present invention, the transmitter is further configured to send a video encoding frame to the server, where the video encoding frame includes the location information acquired by the acquiring module, the video data, the location information, and the video data. The encoding format used is the same.

In the embodiment of the present invention, the transmitter is further configured to send a real-time transport protocol (RTP) packet to the server, where the packet header of the RTP packet carries the location information obtained by the acquiring module, where the RTP packet is received. The payload carries the video data acquired by the acquisition module.

In an embodiment of the present invention, optionally, the video monitoring system further includes a terminal according to an embodiment of the present invention, where the terminal includes: a transmitter, a receiver, and a processor, where the transmitter is configured to send to a server for requesting designation. a video data query request of the video data, the video data query request includes a specified location where the mobile camera captures the specified video data; the receiver is configured to receive the server to send the video data query request sent by the transmitter Specifying video data determined by the server according to the specified location, and an association relationship between video data captured by the mobile camera and location information when the mobile camera captures the video data; the processor is configured to The specified video data received by the receiver is superimposed with the specified location The form of release is presented to the user.

In addition, the terms "system" and "network" are often used interchangeably herein. The term "and/or," in this context is merely an association that describes an associated object, indicating that there can be three relationships, for example, A and / or B, which can mean: A exists separately, and both A and B exist, alone There are three cases of B. In addition, the character "," in this paper, indicates that the contextual object is an "or" relationship.

It should be understood that in the embodiment of the present invention, "B corresponding to A" means that B is associated with A, and B can be determined based on A. However, it should be understood that determining B according to A does not mean that B is determined only on the basis of A, but also based on A and/or other information.

Those of ordinary skill in the art will appreciate that the elements and algorithm steps of the various examples described in connection with the embodiments disclosed herein can be implemented in electronic hardware, computer software or a combination of both, in order to clearly illustrate hardware and software. Interchangeability, the composition and steps of the various examples have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for implementing the described functions for each particular application, but such implementation should not be considered to be beyond the scope of the present invention.

A person skilled in the art can clearly understand that, for the convenience and the cleaning of the description, the specific working processes of the system, the device and the unit described above can refer to the corresponding processes in the foregoing method embodiments, and details are not described herein again.

In the several embodiments provided herein, it should be understood that the disclosed systems, devices, and methods may be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, or an electrical, mechanical or other form of connection. The components displayed for the unit may or may not be physical units, ie may be located in one place, or may be distributed over multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the embodiments of the present invention.

In addition, each functional unit in various embodiments of the present invention may be integrated into one processing unit In addition, each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention contributes in essence or to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a USB flash drive, a mobile hard disk, and a read only memory (ROM,

Read-Only Memory), random access memory (RAM), disk or optical disk, etc., which can store program code.

The above is only the specific embodiment of the present invention, but the scope of the present invention is not limited thereto, and any equivalent person can be easily conceived within the technical scope of the present invention. Modifications or substitutions are intended to be included within the scope of the invention. Therefore, the scope of the invention should be determined by the scope of the claims.

Claims

Rights request

1. A method for processing video data, which is characterized by including:

Obtain the video data captured by the mobile camera, and the location information where the mobile camera captured the video data;

Establish an association between the video data and the location information according to the time information corresponding to the video data and the location information;

The association relationship is saved to facilitate the terminal to obtain video data corresponding to the location information according to the location information.

2. The method according to claim 1, characterized in that, the method further includes: receiving a video data query request including a specified location sent by the terminal;

According to the association relationship and the designated position, determine the designated video data corresponding to the designated position;

Send the designated video data to the terminal.

3. The method according to claim 1 or 2, characterized in that said obtaining the video data captured by the mobile camera and the location information of the mobile camera when capturing the video data includes:

Receive a video encoding frame sent by the mobile camera, where the video encoding frame includes the position information and the video data in the same encoding format;

By decoding the video encoding frame, the video data and the location information are obtained.

4. The method according to claim 1 or 2, characterized in that said obtaining the video data captured by the mobile camera and the location information of the mobile camera when capturing the video data includes:

Receive the real-time transmission protocol RTP message sent by the mobile camera, the message header of the RTP message carries the location information, and the payload of the RTP message carries the video data; By processing the RTP message Perform analysis to obtain the video data and location information.

5. A method of processing video data, characterized by including:

Send a video data query request to the server for requesting specified video data, where the video data query request includes the specified position where the mobile camera captures the specified video data; receive the video data query request sent by the server according to the video data query request The specified video data, the specified video data is determined by the server according to the specified location, and between the video data captured by the mobile camera and the location information where the mobile camera captured the video data. The relationship is determined;

The specified video data and the specified position are presented to the user in the form of overlay playback.

6. The method according to claim 5, characterized in that, the video data query request further includes a specified time; the specified video data is obtained by the server according to the specified location, the specified time and the video data Video data determined in association with the location information.

7. A server, characterized by including:

An acquisition module, used to acquire the video data captured by the mobile camera, and the location information where the mobile camera captured the video data;

An establishment module, configured to establish an association between the video data and the location information obtained by the acquisition module based on the time information corresponding to the video data and the location information; A storage module, used to save all The association relationship established by the establishing module is used to facilitate the terminal to obtain video data corresponding to the location information according to the location information.

8. The server according to claim 7, wherein the server further includes: a receiving module, configured to receive a video data query request including a specified location sent by the terminal;

Determining module, configured to determine the designated video data corresponding to the designated position according to the association relationship and the designated position received by the receiving module;

A sending module, configured to send the specified video data determined by the determining module to the terminal.

9. The server according to claim 7 or 8, characterized in that the acquisition module includes:

The first receiving unit is configured to receive the video encoding frame sent by the mobile camera, where the video encoding frame includes the position information and the video data in the same encoding format;

A first acquisition unit, configured to acquire the video data and the location information by decoding the video encoding frame received by the first receiving unit.

10. The server according to claim 7 or 8, characterized in that the acquisition module includes:

The second receiving unit is configured to receive the real-time transmission protocol RTP message sent by the mobile camera, the message header of the RTP message carries the location information, and the payload of the RTP message carries the video data; The second obtaining unit is configured to obtain the video data and the location information by parsing the RTP message received by the second receiving unit.

11. A terminal, characterized in that it includes:

A sending module, configured to send a video data query request for requesting specified video data to the server, where the video data query request includes the specified position where the mobile camera captures the specified video data;

A receiving module, configured to receive the specified video data sent by the server according to the video data query request sent by the sending module, the specified video data being sent by the server according to the specified location, and the movement Determining a correlation between the video data captured by the camera and the location information at which the mobile camera captured the video data;

A display module, configured to present the specified video data and the specified position received by the receiving module to the user in the form of overlay playback.

12. The terminal according to claim 11, characterized in that: the video data query request sent by the sending module also includes a specified time; the specified video data received by the receiving module is the specified time for the server according to the Video data determined by the specified location, the specified time, and the correlation between the video data and the location information.

13. A video surveillance system, characterized by including:

A server according to any one of claims 7 to 10; and

mobile camera,

Wherein, the mobile camera includes:

The acquisition module is used to capture video data and obtain the location information when the video data is captured. The sending module is used to send the video data and the location information to the server, so that the server can obtain the location information according to the location information. Time information corresponding to the video data and the location information establishes an association between the video data and the location information.

14. The video surveillance system according to claim 13, characterized in that the sending module includes:

The first sending unit is configured to send a video encoding frame to the server. The video encoding frame includes the location information and the video data obtained by the acquisition module. The location information and the encoding used for the video data are The format is the same.

15. The video surveillance system according to claim 13, characterized in that: the sending mode Blocks include:

The second sending unit is configured to send a real-time transmission protocol RTP message to the server. The message header of the RTP message carries the location information obtained by the acquisition module. The payload of the RTP message carries the location information obtained by the acquisition module. The video data obtained by the acquisition module.

16. The video surveillance system according to any one of claims 13 to 15, characterized in that the video surveillance system further includes a terminal according to claim 11 or 12.