WO2014206123A1

WO2014206123A1 - Shake detection method, system, and computer storage medium

Info

Publication number: WO2014206123A1
Application number: PCT/CN2014/074392
Authority: WO
Inventors: 权佳成; 熊壮; 熊培杰
Original assignee: 中兴通讯股份有限公司
Priority date: 2013-06-26
Filing date: 2014-03-31
Publication date: 2014-12-31
Also published as: CN104253934A

Abstract

Embodiments of the present invention relate to a shake detection method, system, and a computer storage medium. The method comprises: analyzing current video data of each camera on a building and/or pre-stored video data of each camera on the building in real time or periodically or when a shake detection instruction sent by a client is detected, to generate shake information corresponding to each camera; and generating general shake information of the building according to retrieved shake information corresponding to each camera and position information of each camera. The embodiments of the present invention implement effective detection of shake information of a building, so that a user can learn first-hand data about a shake hazard of the building effectively and in time, so as to effectively prevent damage risks of the building or secondary disasters thereby caused.

Description

Method, system and calculation for detecting jitter

The present invention relates to the field of image processing technologies, and in particular, to a method, system, and computer storage medium for detecting jitter. Background technique

In real life, some buildings (such as bridges, light rail tracks, etc.) can cause damage or even collapse of buildings after the jitter amplitude exceeds the safety threshold of the jitter amplitude that they can withstand, causing serious damage to people's lives and property. influences.

How to effectively detect the jitter amplitude and/or jitter frequency of these buildings to reduce the risk of building damage or the resulting secondary disaster is of significant significance. However, there is currently no technical solution to effectively detect the jitter amplitude and/or jitter frequency of a building. Summary of the invention

In view of this, in order to solve the existing technical problems, the embodiments of the present invention provide:

A method of detecting jitter, including:

Real-time or timing or when detecting the jitter detection command sent by the client, parsing the current video data of each camera of the building and/or the pre-stored video data of each camera of the building to generate the jitter corresponding to each camera Information

The overall jitter information of the building is generated based on the extracted jitter information of each camera and the position information of each camera.

Preferably, the generating the jitter information corresponding to each camera includes:

Determining at least one image frame from the plurality of image frames of the video data as a reference frame, and setting a reference point on the image in the reference frame;

Calculating the reference point according to the relationship between the corresponding points in the subsequent image frames by the reference point The offset is based on the offset to generate jitter information corresponding to each camera.

Preferably, after the generating the overall jitter information of the building, the method further includes: sending the generated overall jitter information to the client.

Preferably, the method further comprises: sending the current video data of the camera and/or the pre-stored video data of the camera to the client when the amplitude of the jitter in the jitter information corresponding to the camera is greater than or equal to the first preset threshold end.

Preferably, after the generating the overall jitter information of the building, the method further includes: when the amplitude of the jitter in the overall jitter information is greater than or equal to the first preset threshold or the second preset threshold, to the client Send an alert prompt.

A system for detecting jitter is provided, including:

The parsing module is configured to parse the current video data of each camera of the building and/or the pre-stored video data of each camera of the building when real-time or timing or when detecting the jitter detection instruction sent by the client, to generate Jitter information corresponding to each camera;

The processing module is configured to generate overall jitter information of the building according to the extracted jitter information of each camera and the position information of each camera.

Preferably, the parsing module comprises:

a setting unit configured to determine at least one image frame from the plurality of image frames of the video data as a reference frame, and set a reference point on the image in the reference frame;

And a calculating unit configured to calculate an offset of the reference point according to a relationship between the corresponding points in the subsequent image frame by the reference point, and generate the jitter information corresponding to each camera based on the offset.

Preferably, the system further comprises: a transceiver module configured to send the generated overall jitter information to the client.

Preferably, the transceiver module is further configured to: when the amplitude of the jitter in the jitter information corresponding to the camera is greater than or equal to the first preset threshold, the current video data of the camera and/or the camera The header's pre-stored video data is sent to the client.

Preferably, the transceiver module is further configured to send an alert prompt to the client when the jitter amplitude in the overall jitter information is greater than or equal to the first preset threshold or the second preset threshold.

A computer storage medium having stored therein computer executable instructions for performing the methods described above.

In the embodiment of the present invention, image analysis of the camera video data installed on the building is performed, and the overall jitter information of the building is determined according to the analysis result and the position information of each camera, thereby realizing effective detection of the building jitter information. The user can effectively and timely grasp the first-hand data of the building jitter risk, thereby effectively preventing the risk of building damage or the resulting secondary disaster. DRAWINGS

1 is a schematic flow chart of a first embodiment of a method for detecting jitter according to the present invention;

2 is a schematic flow chart of a second embodiment of a method for detecting jitter according to the present invention;

3 is a schematic flow chart of a third embodiment of a method for detecting jitter according to the present invention;

4 is a schematic structural view of a first embodiment of a system for detecting jitter according to the present invention;

FIG. 5 is a schematic structural diagram of an embodiment of a parsing module in a system for detecting jitter according to the present invention; FIG. 6 is a schematic structural diagram of a second embodiment of a system for detecting jitter according to the present invention. detailed description

The technical solution of the present invention will be further described below with reference to the accompanying drawings and specific embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

1 is a schematic flowchart of a first embodiment of a method for detecting jitter according to the present invention. Referring to FIG. 1, a method for detecting jitter provided by the embodiment includes:

Step S10, real time or timing or when detecting a jitter detection instruction sent by the client, Parsing current video data of each camera of the building and/or pre-stored video data of each camera of the building to generate jitter information corresponding to each camera;

In this embodiment, the respective cameras are mounted on the building. A time may be preset to analyze the current video data of each camera of the building and/or the pre-stored video data of each camera of the building when the preset time is reached. The preset time is a time interval, which may be every 10 seconds, or may be a time point, for example, 14:00 or 15:00, which is not limited herein. When the interval or time point is reached, the current video data of each camera of the building and/or the pre-stored video data of each camera of the building are started to be parsed.

In other embodiments of the present invention, the current video data of each camera of the building and/or the pre-stored video data of each camera of the building may be in real time or when detecting the jitter detection instruction sent by the client. Analyze to generate jitter information corresponding to each camera.

The generating the jitter information corresponding to each camera comprises: determining at least one image frame from the plurality of image frames of the video data as a reference frame, and setting a reference point on the image in the reference frame; The reference point calculates an offset of the reference point in a relationship between corresponding points in a subsequent image frame, and based on the offset amount, generates jitter information corresponding to each camera. For example, the video data includes 120 frames of images, and the first frame may be the reference frame, and the center pixel position of the image in the first frame is used as a reference point. Determining an offset of an image of each frame subsequent to the first frame from an image of the first frame according to coordinates of the reference point and coordinates of a point corresponding to the reference point in an image of a frame subsequent to the first frame In the offset direction, the jitter information of the camera corresponding to the video data is calculated according to the determined respective offsets and offset directions.

The step of generating the jitter information corresponding to each camera based on the offset includes: determining a jitter direction of the corresponding camera according to a direction of the offset of the reference point, and determining a corresponding camera according to the offset of the reference point The amplitude and/or frequency of the jitter.

In this embodiment, the jitter information includes a jitter direction and a jitter amplitude. In order to more accurately evaluate the jitter risk of the building, in other embodiments of the present invention, the jitter information is further included. Includes the jitter frequency.

Preferably, in order to prevent the point corresponding to the reference point caused by the excessively large amplitude of the jitter of the building from jumping out of the image range of the image frame, the reference point is set at the image center pixel position in the reference frame.

Step S20, generating overall jitter information of the building according to the extracted jitter information corresponding to each camera and the position information of each camera.

The overall jitter information of the building is generated by data fitting according to the amplitude of the jitter in the jitter information corresponding to the camera and the position information of the camera. The overall jitter information of the building includes: jitter amplitude, jitter direction, jitter frequency, jitter center, etc.; the position information of each camera is the position of each camera on the building.

Preferably, in order to exchange the overall jitter information to the client, the method further comprises the steps of: sending the generated overall jitter information to the client after the step S20.

In the embodiment of the present invention, image analysis of the camera video data installed on the building is performed, and the overall jitter information of the building is determined according to the result of the analysis and the position information of each camera. In turn, the effective detection of the jitter information of the building is realized, so that the user can grasp the first-hand data of the building jitter risk effectively and timely, thereby effectively preventing the risk of building damage or the resulting secondary disaster zone. Come to the premise of implementation. A second embodiment of the method for detecting jitter according to the present invention is provided based on the first embodiment. FIG. 2 is a schematic flowchart of a second embodiment of the method for detecting jitter according to the present invention. Referring to FIG. 2, before step S20, the method includes: Step S30, corresponding to a camera. When the amplitude of the jitter in the jitter information is greater than or equal to the first preset threshold, the current video data of the camera and/or the pre-stored video data of the camera are sent to the client.

When parsing the current video data of each camera of the building and/or the pre-stored video data of each camera of the building, if the jitter amplitude of the video data is greater than or equal to the first preset value, for example, the first The preset value is 50. When the jitter amplitude is greater than or equal to 50 during the jitter detection, the current video data of the camera and/or the pre-stored video data of the camera are sent. For the client, to facilitate the user to view the video data with higher jitter. A third embodiment of the method for detecting jitter according to the present invention is provided based on the first embodiment. FIG. 3 is a schematic flowchart of a third embodiment of the method for detecting jitter according to the present invention. Referring to FIG. 3, after step S20, the method includes: Step S40, in the whole When the amplitude of the jitter in the jitter information is greater than or equal to the first preset threshold or the second preset threshold, an alert prompt is sent to the client.

In this embodiment, when the jitter amplitude in the overall jitter information is greater than or equal to the first preset value or the second preset value, an alert prompt is sent to the client. For example, the first preset value is 50 and the second preset value is 100. That is, when the amplitude of the jitter is greater than or equal to 50 or greater than or equal to 100, it indicates that the jitter at this time has a certain damage to the building, and an early warning prompt is sent to prompt the user to prevent the building. By sending the warning prompt, the user can easily grasp the critical situation of the jitter risk of the building, and perform preventive work according to the critical situation of the jitter risk, which can effectively reduce the risk of damage to the building or effectively avoid the resulting Secondary disaster. 4 is a schematic structural diagram of a first embodiment of a system for detecting jitter according to the present invention. Referring to FIG. 4, the system 1 for detecting jitter provided by the embodiment includes:

The parsing module 10 is configured to parse the current video data of each camera of the building and/or the pre-stored video data of each camera of the building in real time or timing or when detecting the jitter detection instruction sent by the client, Generating jitter information corresponding to each camera;

In this embodiment, the respective cameras are mounted on the building. The time may be preset. When the preset time is reached, the parsing module 10 parses the current video data of each camera of the building and/or the pre-stored video data of each camera of the building. The preset time is a time interval, which may be every 10 seconds, or may be a time point, for example, 14:00 or 15:00, which is not limited herein. When the interval or time point is reached, the parsing module 10 begins parsing the current video data of the various cameras of the building and/or the pre-stored video data of the respective cameras of the building. In other embodiments of the present invention, the parsing module 10 may also be the current video data of each camera of the building and/or each camera of the building in real time or when detecting the jitter detection instruction sent by the client. The pre-stored video data is parsed to generate jitter information corresponding to each camera.

FIG. 5 is a schematic structural diagram of an embodiment of a parsing module in a system for detecting jitter according to the present invention. Referring to FIG. 5, the parsing module 10 includes:

The setting unit 110 determines at least one image frame from the plurality of image frames of the video data as a reference frame, and sets a reference point on the image in the reference frame;

The calculating unit 111 calculates an offset of the reference point according to a relationship between the corresponding points in the subsequent image frames, and generates jitter information corresponding to each camera based on the offset.

For example, the video data includes 120 frames of images, and the setting unit 110 may use the first frame as the reference frame and the center pixel position of the image in the first frame as a reference point. The calculating unit 111 determines, according to the coordinates of the reference point and the coordinates of the point corresponding to the reference point in the image of the frame subsequent to the first frame, the image of each frame subsequent to the first frame is offset from the image of the first frame. The shifting and offset directions calculate the jitter information of the camera corresponding to the video data according to the determined respective offsets and offset directions.

The generating, by the parsing module 10, the jitter information corresponding to each camera according to the offset includes: determining a shaking direction of the corresponding camera according to the direction of the offset of the reference point, and determining according to the offset of the reference point The amplitude and/or frequency of the corresponding camera shake.

In this embodiment, the jitter information includes a jitter direction and a jitter amplitude. In order to more accurately evaluate the jitter risk of the building, in other embodiments of the invention, the jitter information also includes a jitter frequency.

The processing module 20 is configured to: according to the extracted jitter information of each camera and each photo Like the position information of the head, the overall jitter information of the building is generated.

The processing module 20 generates overall jitter information of the building by data fitting according to the amplitude of the jitter in the jitter information corresponding to the camera and the position information of the camera. The overall jitter information of the building includes: jitter amplitude, jitter direction, jitter frequency, jitter center, etc.; the position information of each camera is the position of each camera on the building.

Preferably, in order to exchange the overall jitter information to the client, the system 1 further includes: the transceiver module 30 sends the generated overall jitter information to the client.

In the embodiment of the present invention, image analysis of the camera video data installed on the building is performed, and the overall jitter information of the building is determined according to the result of the analysis and the position information of each camera. In turn, the effective detection of the jitter information of the building is realized, so that the user can grasp the first-hand data of the building jitter risk effectively and timely, thereby effectively preventing the risk of building damage or the resulting secondary disaster zone. Come to the premise of implementation. A second embodiment of the system 1 for detecting jitter according to the present invention is provided based on the foregoing embodiment. FIG. 6 is a schematic structural diagram of a second embodiment of the system for detecting jitter according to the present invention. Referring to FIG. 6, in the embodiment, the transceiver module 30 is further configured. The current video data of the camera and/or the pre-stored video data of the camera are sent to the client when the amplitude of the jitter in the jitter information corresponding to the camera is greater than or equal to the first preset threshold.

The parsing module 10, when parsing the current video data of each camera of the building and/or the pre-stored video data of each camera of the building, if the jitter amplitude of the video data is greater than or equal to the first preset value, for example The first preset value is 50. When the jitter amplitude is greater than or equal to 50 when the jitter is detected, the transceiver module 30 sends the current video data of the camera and/or the pre-stored video data of the camera to the client, so as to facilitate the user. View video data with a high jitter level. Preferably, the transceiver module 30 is further configured to detect a jitter amplitude in the overall jitter information. When the first preset threshold or the second preset threshold is greater than or equal to, the warning prompt is sent to the client. In this embodiment, when the amplitude of the jitter in the overall jitter information is greater than or equal to the first preset value or the second preset value, the transceiver module 30 sends an alert prompt to the client. For example, the first preset value is 50 and the second preset value is 100. That is, when the amplitude of the jitter is greater than or equal to 50 or greater than or equal to 100, it indicates that the jitter at this time has a certain damage to the building, and an alert prompt is sent to prompt the user to prevent the building. By sending the warning prompt, the user can easily grasp the critical situation of the jitter risk of the building, and perform preventive work according to the critical situation of the jitter risk, which can effectively reduce the risk of damage to the building or effectively avoid the resulting Secondary disaster.

Each of the above modules or units may be implemented by a central processing unit (CPU), a digital signal processor (DSP) or a Field-Programmable Gate Array (FPGA) in the electronic device.

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of a hardware embodiment, a software embodiment, or an embodiment of a combination of software and hardware. Moreover, the invention can be embodied in the form of a computer program product embodied on one or more computer usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.

The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a general purpose computer, a special purpose computer, an embedded processor or other programmable data processing device processor to produce a machine such that a flow or a block diagram of a flow or a block diagram or A device that has multiple functions specified in the box. The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the invention, and the equivalent structural changes made by the specification and the drawings of the present invention are directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention.

Claims

claims

1. A method for detecting jitter, wherein the method includes:

Analyze the current video data of each camera in the building and/or the pre-stored video data of each camera in the building in real time or regularly or when detecting the jitter detection command sent by the client to generate jitter corresponding to each camera. information;

Based on the extracted jitter information corresponding to each camera and the position information of each camera, the overall jitter information of the building is generated.

2. The method according to claim 1, wherein the generating jitter information corresponding to each camera includes:

Determine at least one image frame as a reference frame from a plurality of image frames of the video data, and set a reference point on the image in the reference frame;

The offset of the reference point is calculated based on the relationship between the corresponding points of the reference point in subsequent image frames, and jitter information corresponding to each camera is generated based on the offset.

3. The method according to claim 1, wherein after generating the overall jitter information of the building, the method further includes:

Send the resulting overall jitter information to the client.

4. The method according to claim 1, wherein the method further includes:

When the jitter amplitude in the jitter information corresponding to the camera is greater than or equal to the first preset threshold, the current video data of the camera and/or the pre-stored video data of the camera are sent to the client.

5. The method according to any one of claims 1 to 4, wherein after generating the overall jitter information of the building, the method further includes:

When the jitter amplitude in the overall jitter information is greater than or equal to the first preset threshold or the second preset threshold, an early warning prompt is sent to the client.

6. A system for detecting jitter, wherein the system includes: The parsing module is configured to parse the current video data of each camera of the building and/or the pre-stored video data of each camera of the building in real time or regularly or when detecting the jitter detection instruction sent by the client to generate The jitter information corresponding to each camera;

The processing module is configured to generate the overall jitter information of the building based on the extracted jitter information corresponding to each camera and the position information of each camera.

7. The system according to claim 6, wherein the parsing module includes: a setting unit configured to determine at least one image frame as a reference frame from a plurality of image frames of the video data, and in the reference frame Set the reference point on the image;

The calculation unit is configured to calculate an offset of the reference point based on the relationship between corresponding points of the reference point in subsequent image frames, and generate jitter information corresponding to each camera based on the offset.

8. The system according to claim 6, wherein the system further includes:

A transceiver module configured to send the generated overall jitter information to the client.

9. The system according to claim 6, wherein the transceiver module is further configured to convert the current video data of the camera when the jitter amplitude in the jitter information corresponding to the camera is greater than or equal to the first preset threshold. And/or the camera's pre-stored video data is sent to the client.

10. The system according to any one of claims 6 to 9, wherein the transceiver module is further configured such that the jitter amplitude in the overall jitter information is greater than or equal to the first preset threshold or the second preset When the threshold is exceeded, an early warning prompt is sent to the client.

11. A computer storage medium in which computer-executable instructions are stored, and the computer-executable instructions are used to execute the method described in any one of claims 1 to 5.