CN115497037A - Information processing method, device, terminal equipment, storage medium and system - Google Patents

Information processing method, device, terminal equipment, storage medium and system Download PDF

Info

Publication number
CN115497037A
CN115497037A CN202210994003.6A CN202210994003A CN115497037A CN 115497037 A CN115497037 A CN 115497037A CN 202210994003 A CN202210994003 A CN 202210994003A CN 115497037 A CN115497037 A CN 115497037A
Authority
CN
China
Prior art keywords
information
early warning
view
behavior
image information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210994003.6A
Other languages
Chinese (zh)
Inventor
李志明
方小帅
李阔
杨春晖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hainan Shilian Communication Technology Co ltd
Original Assignee
Hainan Shilian Communication Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hainan Shilian Communication Technology Co ltd filed Critical Hainan Shilian Communication Technology Co ltd
Priority to CN202210994003.6A priority Critical patent/CN115497037A/en
Publication of CN115497037A publication Critical patent/CN115497037A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/103—Static body considered as a whole, e.g. static pedestrian or occupant recognition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B31/00—Predictive alarm systems characterised by extrapolation or other computation using updated historic data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/07—Target detection

Landscapes

  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Alarm Systems (AREA)

Abstract

The embodiment of the invention provides an information processing method, an information processing device, terminal equipment, a storage medium and an information processing system, wherein image information in a video is extracted; matching the image information with preset image information to obtain target character image information, wherein the target character image information comprises character view information, behavior information and social relation information, and the character view information corresponds to the behavior information and the social relation information respectively; determining an early warning strategy according to the image information of the target person; according to the early warning strategy, the early warning information corresponding to the early warning strategy is generated, so that the target person can be monitored in real time, the view information, the behavior information and the social relation information of the target person can be acquired in time, the target person is supervised according to the generated early warning information, the occurrence of criminal behaviors is prevented, manpower and material resources are saved, and the working efficiency is improved.

Description

Information processing method, device, terminal equipment, storage medium and system
Technical Field
The present invention relates to the field of information processing technologies, and in particular, to an information processing method, an information processing apparatus, a terminal device, a storage medium, and a system.
Background
Although the traditional video monitoring system can store and playback the monitoring video and interconnect and intercommunicate video streams of various manufacturers, people, vehicles and other information in the monitoring video cannot be subjected to accurate feature extraction, and target information such as people, vehicles and objects in the monitoring video cannot be accurately identified, positioned and searched. If the omnidirectional real-time monitoring and command scheduling are to be realized, a large number of workers need to stare at the monitoring video at all times, playback the related video record, and search suspicious personnel, vehicle targets and clues.
In recent years, video monitoring technology is developed dramatically, and people management, face recognition, intrusion detection, license plate recognition, motion detection, target tracking, video segmentation, behavior recognition and other aspects in the field of video monitoring intelligent analysis are greatly improved. The video monitoring intelligent analysis technology is becoming an academic world, an industrial world, and a new research hotspot and development direction.
At present, most of video monitoring intelligent analysis systems carry out video data analysis after a case occurs, limited fragmented information is obtained by analyzing video data stored by massive video monitoring equipment, and the system can assist a case clerk to solve a case, so that the help of the case clerk to handle a case is limited. For some suspicious personnel needing attention, criminal behaviors of the suspicious personnel are mainly prevented in advance, and workers need to spend a long time on fragmented information to search relevant information of the suspicious personnel, so that a large amount of manpower and material resources are consumed, and the working efficiency is low.
Disclosure of Invention
In view of the above, embodiments of the present invention are proposed to provide an early warning system for criminal acts that overcomes or at least partially solves the above mentioned problems.
In a first aspect, an embodiment of the present invention provides an information processing method, where the method includes:
extracting image information in a video;
matching the image information with preset image information to obtain target character image information, wherein the target character image information comprises character view information, behavior information and social relationship information, and the character view information corresponds to the behavior information and the social relationship information respectively;
determining an early warning strategy according to the target person image information;
and generating early warning information corresponding to the early warning strategy according to the early warning strategy.
Optionally, the matching the image information with preset image information to obtain target person image information, where the target person image information includes person view information, behavior information, and social relationship information, and the view information corresponds to the behavior information and the social relationship information, respectively, and includes:
matching the figure view information in the image information with figure view information in preset image information to obtain a first result, wherein the first result comprises the figure view information of a target figure;
acquiring behavior information and social relationship information corresponding to the character view information of the target character according to the first result to obtain a second result, wherein the second result comprises the behavior information of the target character and/or the social relationship information of the target character;
and taking the first result and the second result as the target person image information.
Optionally, the person view information at least includes one of facial feature information, carried article feature information, and person attribute information, the behavior information at least includes person action information and traffic information, and the social relationship information at least includes a probability of occurrence of a target person in a preset location.
Optionally, the determining an early warning policy according to the target person image information includes: matching corresponding view early warning rules according to the character view information of the target character, wherein the view early warning rules at least comprise suspicious character monitoring rules, dangerous goods monitoring rules and controlled goods rules;
matching corresponding behavior early warning rules according to the behavior information of the target person, wherein the behavior early warning rules comprise action monitoring rules and vehicle monitoring rules;
and matching a corresponding social relation early warning rule according to the social relation information of the target person, wherein the social relation early warning rule is used for indicating the occurrence probability of the target person in a preset place.
And determining the early warning strategy according to the matched view early warning rule, the matched behavior early warning rule or the matched social relation early warning rule.
Optionally, the determining the warning policy according to the matched view warning rule, behavior warning rule or social relationship warning rule includes:
if the character view information of the target character meets the triggering condition generated by the view early warning rule strategy, generating a first early warning strategy; or
And if the character view information of the target character and the behavior information of the target character respectively accord with the triggering conditions generated by the view early warning rule and the behavior early warning rule strategy, generating a second early warning strategy.
Optionally, the determining the early warning policy according to the matched view early warning rule, the behavior early warning rule, or the social relationship early warning rule includes:
if the view information of the target person and the social relation information of the target person respectively accord with the triggering conditions generated by the view early warning rule and the social relation early warning rule strategy, generating a third early warning strategy; or
And if the view information of the target person, the behavior information of the target person and the social relationship of the target person respectively accord with the trigger conditions generated by the view early warning rule, the view early warning rule and the social relationship early warning rule strategy, generating a fourth early warning strategy.
In a second aspect, an embodiment of the present invention provides an information processing apparatus, including:
the acquisition module is used for extracting image information in the video;
the matching module is used for matching the image information with preset image information to obtain target character image information, the target character image information comprises character view information, behavior information and social relationship information, and the character view information corresponds to the behavior information and the social relationship information respectively;
the determining module is used for determining an early warning strategy according to the target person image information;
and the early warning module is used for generating early warning information corresponding to the early warning strategy according to the early warning strategy.
Optionally, the matching module is configured to:
matching the figure view information in the image information with figure view information in preset image information to obtain a first result, wherein the first result comprises the figure view information of a target figure;
acquiring behavior information and social relationship information corresponding to the character view information of the target character according to the first result to obtain a second result, wherein the second result comprises the behavior information of the target character and/or the social relationship information of the target character;
and taking the first result and the second result as the target person image information.
Optionally, the person view information at least includes one of facial feature information, carried article feature information, and person attribute information, the behavior information at least includes person action information and traffic information, and the social relationship information at least includes a probability that a target person appears in a preset place.
Optionally, the determining module is configured to:
matching corresponding view early warning rules according to the figure view information of the target figure, wherein the view early warning rules at least comprise suspicious person monitoring rules, dangerous goods monitoring rules and controlled goods rules;
matching corresponding behavior early warning rules according to the behavior information of the target person, wherein the behavior early warning rules comprise action monitoring rules and vehicle monitoring rules;
and matching a corresponding social relation early warning rule according to the social relation information of the target person, wherein the social relation early warning rule is used for indicating the occurrence probability of the target person in a preset place.
And determining the early warning strategy according to the matched view early warning rule, behavior early warning rule or social relation early warning rule.
Optionally, the determining module is configured to:
if the character view information of the target character meets the triggering condition generated by the view early warning rule strategy, a first early warning strategy is generated; or
And if the character view information of the target character and the behavior information of the target character respectively accord with the triggering conditions generated by the view early warning rule and the behavior early warning rule strategy, generating a second early warning strategy.
Optionally, the determining module is configured to:
if the view information of the target person and the social relation information of the target person respectively accord with the triggering conditions generated by the view early warning rule and the social relation early warning rule strategy, generating a third early warning strategy; or
And if the view information of the target person, the behavior information of the target person and the social relationship of the target person respectively accord with the triggering conditions generated by the view early warning rule, the view early warning rule and the social relationship early warning rule strategy, generating a fourth early warning strategy.
In a third aspect, an embodiment of the present invention provides a terminal device, including: at least one processor and memory;
the memory stores a computer program; the at least one processor executes the computer program stored in the memory to implement the information processing method provided in the first aspect.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed, implements the information processing method provided in the first aspect.
In a fifth aspect, an embodiment of the present invention provides an information processing system, where the system at least includes a monitoring device, a processing server, and a display device, where the monitoring device is configured to provide a video for the processing server, the processing server is configured to execute the information processing method according to the first aspect, and the display device is configured to display warning information.
The embodiment of the invention has the following advantages:
the information processing method, the information processing device, the terminal equipment, the storage medium and the information processing system provided by the embodiment of the invention extract image information in a video; matching the image information with preset image information to obtain target character image information, wherein the target character image information comprises character view information, behavior information and social relation information, and the character view information corresponds to the behavior information and the social relation information respectively; determining an early warning strategy according to the image information of the target person; according to the method and the device, the image information in the video is matched with the preset image information of the target person to determine the image information of the target person, the image information at least comprises the person view information, the behavior information and the social relation information, the corresponding early warning strategy is determined according to the image information of the target person, and then the early warning information corresponding to the early warning strategy is generated according to the early warning strategy, so that the target person can be monitored in real time, the view information, the behavior information and the social relation information of the target person can be timely acquired, the target person can be monitored according to the generated early warning information, crime behaviors are prevented, manpower and material resources are saved, and the working efficiency is improved.
Drawings
FIG. 1 is a flow chart of the steps of an embodiment of an information processing method of the present invention;
FIG. 2 is a flow chart of steps in another information processing method embodiment of the present invention;
FIG. 3 is a flow chart of steps in yet another information processing method embodiment of the present invention;
FIG. 4 is a block diagram of an embodiment of an information processing apparatus according to the present invention;
fig. 5 is a schematic structural diagram of a terminal device of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
An embodiment of the present invention provides an information processing method, which is used for performing an early warning on a target person in a video. The execution main body of the embodiment is an information processing device, and is arranged on a terminal device, wherein the electronic device can be a computer, a tablet computer, a mobile phone terminal and the like.
Referring to fig. 1, a flowchart illustrating steps of an embodiment of an information processing method according to the present invention is shown, where the method may specifically include the following steps:
s101, extracting image information in a video;
specifically, the terminal device obtains a video, which may be a monitoring video or other videos, and the video may be obtained from each monitoring device or a video downloaded from a network, which is not specifically limited in the embodiment of the present invention.
After the terminal equipment acquires the video, analyzing the video to acquire image information in the video, wherein the image information at least comprises character view information, behavior information and social relation information.
S102, matching the image information with preset image information to obtain target person image information, wherein the target person image information comprises person view information, behavior information and social relation information, and the person view information corresponds to the behavior information and the social relation information respectively;
the terminal equipment matches a large amount of image information analyzed from the video with preset image information, and if the analyzed image information is matched with the preset image information, the image information is determined to be target person image information, the target person image information comprises person view information, behavior information and social relation information, and the person view information corresponds to the behavior information and the social relation information respectively.
Illustratively, the target person may be person a, and person view information, behavior information and social relationship information of person a are acquired, wherein the person view information at least includes facial feature information of person a, the behavior information includes body movements or vehicles in the vehicle, and the social relationship information includes probabilities of being present in certain places and persons who have contacted.
In the specific implementation process, the facial feature information in the acquired character view information is matched with the facial feature information in the preset image information, and if the facial feature information is matched with the facial feature information in the preset image information, the behavior information and/or the social relationship information corresponding to the character view information of the target character is determined according to the behavior information and/or the social relationship information corresponding to the character view information.
S103, determining an early warning strategy according to the target person image information;
and the terminal equipment judges the acquired image information of the target person and determines a corresponding early warning strategy according to different judgment results.
Specifically, various pre-warning rules are preset on the terminal device, for example, a view pre-warning rule, a behavior pre-warning rule and a social relationship pre-warning rule, after the person view information, the behavior information and the social relationship information in the image information of the target person are obtained, the corresponding pre-warning rules are respectively adopted to judge each item in the image information, for example, the view pre-warning rule is adopted to judge the person view information, the behavior pre-warning rule is adopted to judge the behavior information, and the social relationship information is adopted to judge the social relationship information.
In a specific implementation process, one or more of the early warning rules can be adopted to perform early warning judgment, and then a corresponding early warning strategy is generated according to different judgment results.
And S104, generating early warning information corresponding to the early warning strategy according to the early warning strategy.
Specifically, the terminal device generates early warning information corresponding to the early warning policy according to different early warning policies, for example, if the early warning policy includes a view early warning rule, the generated early warning information includes the type, number, and the like of the carried objects in the person view information; if the early warning strategy comprises a view early warning rule and a behavior early warning rule, the generated early warning information comprises carried objects in the figure view information, body actions of some crimes and the like; if the early warning strategy comprises a view early warning rule, a behavior early warning rule and a social relation early warning rule, the generated early warning information comprises carried objects, limb actions, riding vehicles, contacted people and places which are frequently appeared in the figure view information. And then the early warning information is displayed, and the target person can be positioned in real time according to the displayed early warning information, so that the occurrence of criminal behaviors is prevented.
The information processing method provided by the embodiment of the invention extracts the image information in the video; matching the image information with preset image information to obtain target character image information, wherein the target character image information comprises character view information, behavior information and social relation information, and the character view information corresponds to the behavior information and the social relation information respectively; determining an early warning strategy according to the image information of the target person; according to the method and the device, the image information in the video is matched with the preset image information of the target person to determine the image information of the target person, the image information at least comprises the person view information, the behavior information and the social relation information, the corresponding early warning strategy is determined according to the image information of the target person, and then the early warning information corresponding to the early warning strategy is generated according to the early warning strategy, so that the target person can be monitored in real time, the view information, the behavior information and the social relation information of the target person can be timely acquired, the target person can be monitored according to the generated early warning information, crime behaviors are prevented, manpower and material resources are saved, and the working efficiency is improved.
The present invention further provides a supplementary description of the information processing method provided in the above embodiment.
As shown in fig. 2, there is shown a flow chart of steps of another embodiment of an information processing method of the present invention, the information processing method comprising:
s201, extracting image information in a video; the target character image information comprises character view information, behavior information and social relationship information, and the view information corresponds to the behavior information and the social relationship information respectively;
the terminal device acquires a video, which may be a monitoring video or other videos, and the video may be acquired from each monitoring device or downloaded from a network, which is not specifically limited in the embodiment of the present invention.
After the terminal equipment acquires the video, analyzing the video to acquire image information in the video, wherein the image information at least comprises character view information, behavior information and social relation information.
S202, matching the person view information in the image information with the person view information in the preset image information to obtain a first result, wherein the first result comprises the person view information of a target person;
after the terminal device obtains the image information, matching is carried out by adopting the person view information and the person view information in the preset image information, so as to match a target person, namely a suspicious person needing attention, and if the matching is carried out, a first result is obtained, wherein the first result comprises the person view information of the target person.
S203, acquiring behavior information and social relation information corresponding to the character view information of the target character according to the first result to obtain a second result, wherein the second result comprises the behavior information of the target character and/or the social relation information of the target character;
the method comprises the steps that character view information, behavior information and social relation information corresponding to the character view information are stored in a terminal device in advance, after a first result is obtained, namely a target character is determined, the behavior information and/or the social relation information corresponding to the character view information of the target character are obtained, and a second result is obtained.
The character view information at least comprises one of face feature information, carried article feature information and character attribute information, the behavior information at least comprises character action information and traffic information, and the social relation information at least comprises the probability of the target character appearing in a preset place.
S204, taking the first result and the second result as the target person image information.
Specifically, the target person image information includes person view information and behavior information, or person view information and social relationship information, or person view information, behavior information, and social relationship information.
S205, matching corresponding view early warning rules according to the person view information of the target person, wherein the view early warning rules at least comprise suspicious person monitoring rules, dangerous goods monitoring rules and controlled goods rules;
specifically, various pre-warning rules are preset on the terminal device, for example, a view pre-warning rule, a behavior pre-warning rule and a social relationship pre-warning rule, after the person view information, the behavior information and the social relationship information in the target person image information are acquired, the corresponding pre-warning rules are respectively adopted to judge each item in the image information, for example, the view pre-warning rule is adopted to judge the person view information, the behavior pre-warning rule is adopted to judge the behavior information, and the social relationship information is adopted to judge the social relationship information.
Firstly, the terminal equipment matches a corresponding view early warning rule according to the figure view information of the target figure, wherein the view early warning rule at least comprises a suspicious person monitoring rule, a dangerous article monitoring rule and a controlled article rule.
S206, matching corresponding behavior early warning rules according to the behavior information of the target person, wherein the behavior early warning rules comprise action monitoring rules and vehicle monitoring rules; the action monitoring rule at least comprises monitoring of some limb actions of the target person, and the vehicle monitoring rule is monitoring of a vehicle in which the target person is seated.
And S207, matching a corresponding social relation early warning rule according to the social relation information of the target person, wherein the social relation early warning rule is used for indicating the occurrence probability of the target person in a preset place.
S208, determining the early warning strategy according to the matched view early warning rule, the behavior early warning rule or the social relation early warning rule.
Specifically, in a specific implementation process, the terminal device may perform the early warning judgment by using one or more of the above early warning rules, and then generate the corresponding early warning policy according to different judgment results.
As an optional implementation manner, if the person view information of the target person meets the triggering condition generated by the view early warning rule policy, a first early warning policy is generated;
exemplarily, if the carried object in the person view information of the target person is judged, if the carried object is a dangerous object, optionally, the dangerous object is a biochemical dangerous object, for example, a chemical hazardous object marked with sulfuric acid, a bomb, a controlled gun cutter, etc., and the terminal device generates a first early warning policy according to a judgment result;
as another optional implementation manner, if the person view information of the target person and the behavior information of the target person respectively meet the triggering conditions generated by the view early warning rule and the behavior early warning rule policy, a second early warning policy is generated.
Exemplarily, the terminal device judges the person view information of the target person by using the view early warning rule, judges the behavior information of the target person by using the behavior early warning rule, and generates a second early warning policy if the person view information meets the triggering condition of the view early warning rule and the behavior information meets the triggering condition of the behavior early warning rule.
Illustratively, the object person carrying object is judged, if the carrying object is a dangerous object such as firecracker and pesticide, the behavior information of the object person is judged, and if the behavior information is a behavior action of an violence attempt, the terminal device generates a second early warning strategy according to the carrying object and the behavior action.
As another optional implementation method, if the view information of the target person and the social relationship information of the target person respectively conform to the triggering conditions generated by the view early warning rule and the social relationship early warning rule policy, a third early warning policy is generated;
and the terminal equipment judges the view information of the target person by adopting the view early warning rule, judges the social relation information of the target person by adopting the social relation early warning rule, and generates a third early warning strategy according to the view judgment result and the social relation judgment result.
As another optional implementation manner, if the view information of the target person, the behavior information of the target person, and the social relationship of the target person respectively conform to the triggering conditions generated by the view warning rule, and the social relationship warning rule policy, a fourth warning policy is generated.
Specifically, the terminal device judges all three items in the image information, so that the judgment accuracy is higher, adopts a view early warning rule to judge the figure view information of the target figure, adopts a behavior early warning rule to judge the behavior information of the target figure, also adopts a social relationship early warning rule to judge the social relationship information of the target figure, and generates a fourth early warning strategy according to the combination of the view judgment result, the behavior judgment result and the social relationship judgment result.
S209, generating early warning information corresponding to the early warning strategy according to the early warning strategy.
Specifically, the terminal device generates first early warning information corresponding to the first early warning strategy, second early warning information corresponding to the second early warning strategy, third early warning information corresponding to the third early warning strategy and fourth early warning information corresponding to the fourth early warning strategy according to the first early warning strategy, the second early warning strategy, the third early warning strategy and the fourth early warning strategy. And then the early warning information is displayed, and the target person can be positioned in real time according to the displayed early warning information, so that the occurrence of criminal behaviors is prevented.
In the above discussion, the method can be applied between internet devices and also between video networking devices, and the video networking devices are taken as an example and specifically described below.
Fig. 3 is a flowchart of steps of still another embodiment of the information processing method of the present invention, as shown in fig. 3, applied to an information processing system including an identification server, an early warning server, a criminal investigation server, a video big data police platform, a view library server, a behavior library server, and a social relationship library server, which are arranged in a view network. All the devices in the video network communicate through the virtual terminals of the video network, and all the virtual terminals in the information processing system need to perform network access authentication to the network management server.
The monitoring equipment is connected to the monitoring access server A, the monitoring access server B, the monitoring access server C and the monitoring access server D. And the monitoring access server A and the monitoring access server B are connected to the monitoring access server C. And the monitoring access server B and the monitoring access server C are connected to the identification server.
The recognition server is connected to the view library server, the behavior library server and the social relation library server. The view library server, the behavior library server and the social relation server are respectively connected to the early warning server.
The early warning server is connected to the video big data police service platform, and the video big data police service platform is connected to various police service terminals.
The information processing method includes:
and the monitoring access server D pulls the video data to the monitoring equipment D2. And the monitoring access server D pushes the pulled video data to the identification server.
And the identification server receives the pushed video data and intelligently analyzes the video data. And the recognition server pushes the analyzed view information to the view server. And the identification server pushes the analyzed behavior information to the behavior server. The identification server pushes the analyzed social relationship information to a social relationship service server. And the view library server, the behavior library server and the social relation library server receive the data pushed by the identification service and respectively store the data in the view library, the behavior library and the social relation library.
Pre-setting an early warning rule on an early warning server, wherein the early warning rule comprises a suspicious personnel monitoring rule;
the early warning rule at least comprises a view early warning rule, a behavior early warning rule and a social relation early warning rule. The view early warning rules at least comprise dangerous goods monitoring rules, controlled goods rules and facial feature monitoring rules, and the dangerous goods monitoring rules comprise gas tanks, gasoline drums, dangerous chemicals and the like; the controlled item rules include controlled knives, controlled firearms, controlled instruments, and the like.
The early warning server continuously trains early warning rules in turn and sends the early warning rules to the view base server, the behavior base server and the social relation base server;
the image of a target person is judged according to the early warning rules, relevant early warning information is obtained according to the judgment result, specifically, after the person view information, the behavior information and the social relationship information in the image information of the target person are obtained, each item in the image information is judged by adopting the corresponding early warning rules respectively, for example, the person view information is judged by adopting the view early warning rules, the behavior information is judged by adopting the behavior early warning rules, the social relationship information is judged by adopting the social relationship information early warning rules, the early warning information is generated, and the early warning information is pushed to the early warning server.
And the early warning server receives the early warning information and processes the early warning information. And acquiring related data from the view library server, the behavior library server and the social relation library server through the processed early warning data. And processing the view information, the behavior information and the social relation library information to generate effective early warning information. The early warning server pushes the effective early warning information to a video big data police service platform. And after receiving the early warning information, the video big data police service platform pushes the early warning information to a corresponding police service information terminal. The police intervenes the possible criminal behavior in advance through the police information terminal by the displayed information to reduce the criminal behavior.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
The information processing method provided by the embodiment of the invention extracts the image information in the video; matching the image information with preset image information to obtain target character image information, wherein the target character image information comprises character view information, behavior information and social relation information, and the character view information corresponds to the behavior information and the social relation information respectively; determining an early warning strategy according to the image information of the target person; the method comprises the steps of generating early warning information corresponding to an early warning strategy according to the early warning strategy, determining the image information of a target person by matching the image information in a video with preset image information of the target person, wherein the image information at least comprises person view information, behavior information and social relation information, determining the corresponding early warning strategy according to the image information of the target person, and generating the early warning information corresponding to the early warning strategy according to the early warning strategy, so that the target person can be monitored in real time, the view information, the behavior information and the social relation information of the target person can be timely obtained, the target person can be monitored according to the generated early warning information, criminal behaviors are prevented, manpower and material resources are saved, and the working efficiency is improved.
Another embodiment of the present invention provides an information processing apparatus for executing the information processing method provided in the above embodiment.
Referring to fig. 4, a block diagram of an embodiment of an information processing apparatus according to the present invention is shown, where the apparatus may be applied in a video network, and specifically includes the following modules: an obtaining module 401, a matching module 402, a determining module 403 and an early warning module 404, wherein:
the obtaining module 401 is configured to extract image information in a video;
the matching module 402 is configured to match the image information with preset image information to obtain target person image information, where the target person image information includes person view information, behavior information, and social relationship information, and the person view information corresponds to the behavior information and the social relationship information, respectively;
the determining module 403 is configured to determine an early warning policy according to the target person image information;
the early warning module 404 is configured to generate early warning information corresponding to the early warning policy according to the early warning policy.
The information processing device provided by the embodiment of the invention extracts the image information in the video; matching the image information with preset image information to obtain target character image information, wherein the target character image information comprises character view information, behavior information and social relation information, and the character view information corresponds to the behavior information and the social relation information respectively; determining an early warning strategy according to the image information of the target person; according to the method and the device, the image information in the video is matched with the preset image information of the target person to determine the image information of the target person, the image information at least comprises the person view information, the behavior information and the social relation information, the corresponding early warning strategy is determined according to the image information of the target person, and then the early warning information corresponding to the early warning strategy is generated according to the early warning strategy, so that the target person can be monitored in real time, the view information, the behavior information and the social relation information of the target person can be timely acquired, the target person can be monitored according to the generated early warning information, crime behaviors are prevented, manpower and material resources are saved, and the working efficiency is improved.
The present invention further provides an information processing apparatus according to the above embodiment.
Optionally, the matching module is configured to:
matching the figure view information in the image information with figure view information in preset image information to obtain a first result, wherein the first result comprises the figure view information of a target figure;
acquiring behavior information and social relation information corresponding to the character view information of the target character according to the first result to obtain a second result, wherein the second result comprises the behavior information of the target character and/or the social relation information of the target character;
and taking the first result and the second result as the target person image information.
Optionally, the person view information at least includes one of facial feature information, carried article feature information, and person attribute information, the behavior information at least includes person action information and traffic information, and the social relationship information at least includes a probability that a target person appears in a preset place.
Optionally, the determining module is configured to:
matching corresponding view early warning rules according to the character view information of the target character, wherein the view early warning rules at least comprise suspicious character monitoring rules, dangerous goods monitoring rules and controlled goods rules;
matching corresponding behavior early warning rules according to the behavior information of the target person, wherein the behavior early warning rules comprise action monitoring rules and vehicle monitoring rules;
and matching a corresponding social relation early warning rule according to the social relation information of the target person, wherein the social relation early warning rule is used for indicating the occurrence probability of the target person in a preset place.
And determining the early warning strategy according to the matched view early warning rule, the matched behavior early warning rule or the matched social relation early warning rule.
Optionally, the determining module is configured to:
if the character view information of the target character meets the triggering condition generated by the view early warning rule strategy, generating a first early warning strategy; or
And if the character view information of the target character and the behavior information of the target character respectively accord with the triggering conditions generated by the view early warning rule and the behavior early warning rule strategy, generating a second early warning strategy.
Optionally, the determining module is configured to:
if the view information of the target person and the social relation information of the target person respectively accord with the triggering conditions generated by the view early warning rule and the social relation early warning rule strategy, generating a third early warning strategy; or
And if the view information of the target person, the behavior information of the target person and the social relationship of the target person respectively accord with the triggering conditions generated by the view early warning rule, the view early warning rule and the social relationship early warning rule strategy, generating a fourth early warning strategy.
It should be noted that the respective implementable modes in the present embodiment may be implemented individually, or may be implemented in combination in any combination without conflict, and the present application is not limited thereto.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The information processing device provided by the embodiment of the invention extracts the image information in the video; matching the image information with preset image information to obtain target character image information, wherein the target character image information comprises character view information, behavior information and social relation information, and the character view information corresponds to the behavior information and the social relation information respectively; determining an early warning strategy according to the image information of the target person; the method comprises the steps of generating early warning information corresponding to an early warning strategy according to the early warning strategy, determining the image information of a target person by matching the image information in a video with preset image information of the target person, wherein the image information at least comprises person view information, behavior information and social relation information, determining the corresponding early warning strategy according to the image information of the target person, and generating the early warning information corresponding to the early warning strategy according to the early warning strategy, so that the target person can be monitored in real time, the view information, the behavior information and the social relation information of the target person can be timely obtained, the target person can be monitored according to the generated early warning information, criminal behaviors are prevented, manpower and material resources are saved, and the working efficiency is improved.
Still another embodiment of the present invention provides a terminal device, configured to execute the information processing method provided in the foregoing embodiment.
Fig. 5 is a schematic structural diagram of a terminal device of the present invention, and as shown in fig. 5, the terminal device includes: at least one processor 501 and memory 502;
the memory stores a computer program; the at least one processor executes the computer program stored in the memory to implement the information processing method provided by the above-described embodiment.
The terminal device provided by the embodiment extracts image information in a video; matching the image information with preset image information to obtain target character image information, wherein the target character image information comprises character view information, behavior information and social relation information, and the character view information corresponds to the behavior information and the social relation information respectively; determining an early warning strategy according to the image information of the target person; according to the method and the device, the image information in the video is matched with the preset image information of the target person to determine the image information of the target person, the image information at least comprises the person view information, the behavior information and the social relation information, the corresponding early warning strategy is determined according to the image information of the target person, and then the early warning information corresponding to the early warning strategy is generated according to the early warning strategy, so that the target person can be monitored in real time, the view information, the behavior information and the social relation information of the target person can be timely acquired, the target person can be monitored according to the generated early warning information, crime behaviors are prevented, manpower and material resources are saved, and the working efficiency is improved.
Yet another embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed, the computer program implements the information processing method provided in any one of the above embodiments.
According to the computer-readable storage medium of the present embodiment, by extracting image information in a video; matching the image information with preset image information to obtain target character image information, wherein the target character image information comprises character view information, behavior information and social relation information, and the character view information corresponds to the behavior information and the social relation information respectively; determining an early warning strategy according to the image information of the target person; the method comprises the steps of generating early warning information corresponding to an early warning strategy according to the early warning strategy, determining the image information of a target person by matching the image information in a video with preset image information of the target person, wherein the image information at least comprises person view information, behavior information and social relation information, determining the corresponding early warning strategy according to the image information of the target person, and generating the early warning information corresponding to the early warning strategy according to the early warning strategy, so that the target person can be monitored in real time, the view information, the behavior information and the social relation information of the target person can be timely obtained, the target person can be monitored according to the generated early warning information, criminal behaviors are prevented, manpower and material resources are saved, and the working efficiency is improved.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those of skill in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the embodiments of the invention.
The early warning system for criminal behaviors provided by the embodiment of the invention comprises: the system comprises a monitoring access server, an identification server, a processing server, an early warning server and a video big data police platform; the monitoring access server is connected with the processing server through the identification server, the processing server is connected with the early warning server, and the early warning server is connected with the video big data police service platform; the monitoring access server is used for acquiring monitoring videos of all monitoring devices and sending the monitoring videos to the identification server; the identification server is used for identifying the monitoring video to obtain image information and sending the image information to the processing server, wherein the image information at least comprises the character information and the associated information corresponding to the character information; the processing server is used for judging according to the image information and the preset identification information of the first target person by adopting a preset early warning rule, determining early warning information corresponding to the first target person and transmitting the early warning information to the early warning server; the early warning server is used for acquiring image information corresponding to the first target person from the processing server according to the early warning information of the first target person, determining effective early warning information according to the image information and the early warning information, and sending the effective early warning information to the video big data police service platform; the video big data police service platform is used for carrying out early warning according to effective early warning information, and the early warning system for criminal behaviors provided by the embodiment of the invention can track suspicious characters, judge the image information of the suspicious characters according to the preset early warning rules, determine the effective early warning information, further carry out early warning according to the effective early warning information, prevent the suspicious characters from crime again and reduce the incidence rate of criminal behaviors.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, electronic devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing electronic device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing electronic device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing electronic device to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing electronic device to cause a series of operational steps to be performed on the computer or other programmable electronic device to produce a computer implemented process such that the instructions which execute on the computer or other programmable electronic device provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "include", "including" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or electronic device including a series of elements includes not only those elements but also other elements not explicitly listed or inherent to such process, method, article, or electronic device. Without further limitation, an element defined by the phrases "comprising a," "8230," "8230," or "comprising" does not exclude the presence of additional like elements in a process, method, article, or electronic device comprising the element.
The foregoing detailed description of an information processing method and an information processing apparatus according to the present invention has been presented, and the principles and embodiments of the present invention are explained herein by using specific examples, which are only used to help understand the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (10)

1. An information processing method, characterized in that the method comprises:
extracting image information in a video;
matching the image information with preset image information to obtain target character image information, wherein the target character image information comprises character view information, behavior information and social relationship information, and the character view information corresponds to the behavior information and the social relationship information respectively;
determining an early warning strategy according to the image information of the target person;
and generating early warning information corresponding to the early warning strategy according to the early warning strategy.
2. The method of claim 1, wherein the matching the image information with preset image information to obtain target person image information, the target person image information including person view information, behavior information and social relationship information, the view information corresponding to the behavior information and the social relationship information respectively comprises:
matching the figure view information in the image information with figure view information in preset image information to obtain a first result, wherein the first result comprises the figure view information of a target figure;
acquiring behavior information and social relation information corresponding to the character view information of the target character according to the first result to obtain a second result, wherein the second result comprises the behavior information of the target character and/or the social relation information of the target character;
and taking the first result and the second result as the target character image information.
3. The method of claim 2, wherein the people view information comprises at least one of facial feature information, carried article feature information and people attribute information, the behavior information comprises at least people action information and traffic information, and the social relationship information comprises at least a probability of occurrence of a target person at a preset location.
4. The method of claim 3, wherein determining an early warning strategy based on the target person image information comprises:
matching corresponding view early warning rules according to the character view information of the target character, wherein the view early warning rules at least comprise suspicious character monitoring rules, dangerous goods monitoring rules and controlled goods rules;
matching corresponding behavior early warning rules according to the behavior information of the target person, wherein the behavior early warning rules comprise action monitoring rules and vehicle monitoring rules;
matching a corresponding social relation early warning rule according to the social relation information of the target person, wherein the social relation early warning rule is used for indicating the occurrence probability of the target person in a preset place;
and determining the early warning strategy according to the matched view early warning rule, the matched behavior early warning rule or the matched social relation early warning rule.
5. The method of claim 4, wherein determining the warning policy according to the matched view warning rule, behavior warning rule, or social relationship warning rule comprises:
if the character view information of the target character meets the triggering condition generated by the view early warning rule strategy, generating a first early warning strategy; or
And if the character view information of the target character and the behavior information of the target character respectively accord with the triggering conditions generated by the view early warning rule and the behavior early warning rule strategy, generating a second early warning strategy.
6. The method of claim 4, wherein determining the warning policy according to the matched view warning rule, behavior warning rule or social relationship warning rule comprises:
if the view information of the target person and the social relation information of the target person respectively accord with the triggering conditions generated by the view early warning rule and the social relation early warning rule strategy, generating a third early warning strategy; or
And if the view information of the target person, the behavior information of the target person and the social relationship of the target person respectively accord with the triggering conditions generated by the view early warning rule, the view early warning rule and the social relationship early warning rule strategy, generating a fourth early warning strategy.
7. A behavior processing apparatus, characterized in that the apparatus comprises:
the acquisition module is used for extracting image information in the video;
the matching module is used for matching the image information with preset image information to obtain target character image information, the target character image information comprises character view information, behavior information and social relationship information, and the character view information corresponds to the behavior information and the social relationship information respectively;
the determining module is used for determining an early warning strategy according to the target person image information;
and the early warning module is used for generating early warning information corresponding to the early warning strategy according to the early warning strategy.
8. A terminal device, comprising: at least one processor and memory;
the memory stores a computer program; the at least one processor executes the computer program stored by the memory to implement the information processing method of any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that a computer program is stored therein, which when executed, implements the information processing method of any one of claims 1 to 6.
10. An information processing system, characterized in that the system at least comprises a monitoring device, a processing server and a display device, wherein the monitoring device is used for providing video for the processing server, the processing server is used for executing the information processing method according to any one of claims 1 to 6, and the display device is used for displaying early warning information.
CN202210994003.6A 2022-08-18 2022-08-18 Information processing method, device, terminal equipment, storage medium and system Pending CN115497037A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210994003.6A CN115497037A (en) 2022-08-18 2022-08-18 Information processing method, device, terminal equipment, storage medium and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210994003.6A CN115497037A (en) 2022-08-18 2022-08-18 Information processing method, device, terminal equipment, storage medium and system

Publications (1)

Publication Number Publication Date
CN115497037A true CN115497037A (en) 2022-12-20

Family

ID=84465577

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210994003.6A Pending CN115497037A (en) 2022-08-18 2022-08-18 Information processing method, device, terminal equipment, storage medium and system

Country Status (1)

Country Link
CN (1) CN115497037A (en)

Similar Documents

Publication Publication Date Title
CN109816397B (en) Fraud discrimination method, device and storage medium
CN109325429B (en) Method, device, storage medium and terminal for associating feature data
CN108229297B (en) Face recognition method and device, electronic equipment and computer storage medium
US20220092881A1 (en) Method and apparatus for behavior analysis, electronic apparatus, storage medium, and computer program
KR101825023B1 (en) Risk early warning method and device
CN109446936A (en) A kind of personal identification method and device for monitoring scene
CN106503121A (en) A kind of description method of X-ray safety check image and system
US10030986B2 (en) Incident response analytic maps
CN112580470A (en) City visual perception method and device, electronic equipment and storage medium
CN115294528A (en) Pedestrian safety monitoring method and device
CN113435753A (en) Enterprise risk judgment method, device, equipment and medium in high-risk industry
CN110738077B (en) Foreign matter detection method and device
CN112256809A (en) Data processing method and device
CN115497037A (en) Information processing method, device, terminal equipment, storage medium and system
CA3069539C (en) Role-based perception filter
CN111553826B (en) Smart city data processing method
CN115546711A (en) Information processing method and device, terminal equipment and storage medium
CN111831841B (en) Information retrieval method, device, electronic equipment and storage medium
CN113691524A (en) Alarm information processing method, system, electronic equipment and storage medium
CN113343010A (en) Image identification method, electronic equipment and computer readable storage medium
CN113037714A (en) Network security analysis method based on network big data and block chain financial cloud system
CN113342978A (en) City event processing method and device
Varshney et al. A deep learning based approach to detect suspicious weapons
CN113011576A (en) Method and device for identifying case type
Jaleel et al. Towards Proactive Surveillance through CCTV Cameras under Edge-Computing and Deep Learning

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination