WO2018210039A1 - Data processing method, data processing device, and storage medium - Google Patents

Data processing method, data processing device, and storage medium Download PDF

Info

Publication number
WO2018210039A1
WO2018210039A1 PCT/CN2018/078632 CN2018078632W WO2018210039A1 WO 2018210039 A1 WO2018210039 A1 WO 2018210039A1 CN 2018078632 W CN2018078632 W CN 2018078632W WO 2018210039 A1 WO2018210039 A1 WO 2018210039A1
Authority
WO
WIPO (PCT)
Prior art keywords
alarm information
pieces
video
image
positive integer
Prior art date
Application number
PCT/CN2018/078632
Other languages
French (fr)
Chinese (zh)
Inventor
邱璐
尹义
苏建钢
曾科凡
万历
邱建平
Original Assignee
深圳云天励飞技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳云天励飞技术有限公司 filed Critical 深圳云天励飞技术有限公司
Publication of WO2018210039A1 publication Critical patent/WO2018210039A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/41Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/06Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063Operations research, analysis or management
    • G06Q10/0631Resource planning, allocation, distributing or scheduling for enterprises or organisations
    • G06Q10/06311Scheduling, planning or task assignment for a person or group
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/26Government or public services
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30168Image quality inspection

Definitions

  • the present invention relates to the field of video surveillance technologies, and in particular, to a data processing method, a data processing device, and a storage medium.
  • the embodiment of the invention provides a data processing method, a data processing device and a storage medium, which can detect an alarm situation and implement reasonable processing of the alarm.
  • a first aspect of the embodiments of the present invention provides a data processing method, including:
  • N is a positive integer
  • the acquiring the N pieces of alarm information includes:
  • the video can be obtained by multiple cameras, multiple video segments are obtained, and each video segment is subjected to behavior analysis to obtain N pieces of alarm information.
  • the alarm information can be quickly analyzed from the video segments by behavior analysis.
  • the performing, by using the behavior analysis of the X video segments, the N pieces of alarm information include:
  • the Z video images are filtered to obtain N video images, and each video image corresponds to one alarm information.
  • multiple video segments can be parsed first, and each frame image is analyzed for behavior, and a video image conforming to the preset behavior is selected. Since the selected image also has image quality problems, it can be further filtered and filtered. Each frame of the image corresponds to an alarm message, thus reducing the false alarm rate and improving the alarm accuracy.
  • the performing the behavior analysis on the X video segments to obtain the N pieces of alarm information include:
  • the A is a positive integer
  • the N is smaller than the Q
  • the N is smaller than the A
  • image segmentation can be performed on a plurality of videos, the segmented face images are merged, and the merged face images are matched with the face images in the image library, and alarm information is generated according to the matching result.
  • the alarm information can be generated only for the face image in the original library, which can be used to implement alarm processing for the specified target.
  • the target user equipment allocates M pieces of alarm information, including:
  • the location of the user equipment may be obtained, and the alarm information may be allocated according to the location and the corresponding task status. If the user equipment is far away from the alarm information, the user equipment may not be allocated, and the user equipment may be allocated alarm information.
  • a second aspect of the embodiments of the present invention provides a data processing apparatus, including:
  • a first acquiring unit configured to acquire a current task state of the target user equipment
  • a second acquiring unit configured to acquire N pieces of alarm information, where the N is a positive integer
  • an allocating unit configured to allocate M pieces of alarm information to the target user equipment according to the current task status, where the N pieces of alarm information include the M pieces of alarm information, where the M is an integer less than or equal to the N.
  • the second acquiring unit includes:
  • a first acquiring module configured to acquire video from the X cameras, to obtain the X video segments, each of the cameras corresponding to one of the video segments, where X is a positive integer;
  • the first analysis module is configured to perform behavior analysis on the X video segments to obtain the N pieces of alarm information.
  • the first analysis module includes:
  • a parsing module configured to parse the X video segments to obtain a Y frame video image, where the Y is a positive integer
  • a second analysis module configured to perform behavior analysis on each frame of the video image of the Y frame to obtain Z video images that conform to a preset behavior, where the Z is a positive integer;
  • the screening module is configured to filter the Z video images to obtain N video images, and each video image corresponds to one alarm information.
  • the first analysis module includes:
  • a segmentation module configured to perform image segmentation on the X video segments to obtain a P personal face image, where P is a positive integer
  • a merging module configured to merge the P personal face images to obtain a Q personal face image, where the Q is a positive integer less than or equal to the P;
  • a matching module configured to match the Q facial image with an A facial image in the image library to obtain the N facial image, wherein the A is a positive integer, and the N is smaller than the Q, the N Less than the A;
  • a generating module configured to generate the N pieces of alarm information according to the N personal face image.
  • a second acquiring module configured to acquire a location of the target user equipment
  • an allocating module configured to allocate M pieces of alarm information to the target user equipment according to the location and the current task status.
  • a third aspect of the embodiments of the present invention provides a data processing apparatus, wherein the data processing apparatus includes a processor, and the processor is configured to implement the data processing method according to any one of the above, when the computer program is stored in a memory.
  • a fourth aspect of the embodiments of the present invention provides a computer readable storage medium storing a computer program, the computer program being executed by a processor to implement the method of any of the first aspect or the first aspect .
  • the data processing device can obtain the current task status of the target user equipment, obtain N pieces of alarm information, and N is a positive integer, and allocate M pieces of alarm information to the target user equipment according to the current task status, N pieces.
  • the alarm information includes M alarms, and M is an integer less than or equal to N. Therefore, the current task status of the user equipment can be obtained, such as: pending tasks, processed tasks, and timeout unprocessed.
  • Alarm information can be allocated less for it. When there are fewer tasks, more alarm information is assigned to it, and the alarm information can be processed reasonably.
  • FIG. 1 is a schematic flow chart of a first embodiment of a data processing method according to an embodiment of the present invention
  • FIG. 2 is a schematic flow chart of a second embodiment of a data processing method according to an embodiment of the present invention.
  • 2a is a schematic diagram showing a demonstration of a current task state of a user equipment according to an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of a first embodiment of a data processing apparatus according to an embodiment of the present invention.
  • FIG. 3b is a schematic structural diagram of a second acquiring unit of the data processing apparatus described in FIG. 3a according to an embodiment of the present disclosure
  • FIG. 3c is a schematic structural diagram of a first embodiment of a first analysis module of the second obtaining unit described in FIG. 3a according to an embodiment of the present disclosure
  • FIG. 3 is a schematic structural diagram of a second embodiment of a first analysis module of the second obtaining unit depicted in FIG. 3a according to an embodiment of the present disclosure
  • FIG. 3e is a schematic structural diagram of an allocation unit of the data processing apparatus described in FIG. 3a according to an embodiment of the present invention
  • FIG. 4 is a schematic structural diagram of a second embodiment of a data processing apparatus according to an embodiment of the present invention.
  • references to "an embodiment” herein mean that a particular feature, structure, or characteristic described in connection with the embodiments can be included in at least one embodiment of the invention.
  • the appearances of the phrases in various places in the specification are not necessarily referring to the same embodiments, and are not exclusive or alternative embodiments that are mutually exclusive. Those skilled in the art will understand and implicitly understand that the embodiments described herein can be combined with other embodiments.
  • the data processing apparatus described in the embodiments of the present invention may include a smart phone (such as an Android mobile phone, an iOS mobile phone, a Windows Phone mobile phone, etc.), a tablet computer, a palmtop computer, a notebook computer, a mobile Internet device (MID, Mobile Internet Devices), or a wearable device.
  • a smart phone such as an Android mobile phone, an iOS mobile phone, a Windows Phone mobile phone, etc.
  • a tablet computer such as an Android mobile phone, an iOS mobile phone, a Windows Phone mobile phone, etc.
  • a palmtop computer such as an Apple MacBook Air Traffic, etc.
  • a wearable device such as an iPad, Samsung Galaxy Tabs, etc.
  • the user equipment can be a smart phone (such as an Android phone, an iOS phone, a Windows Phone, etc.), a tablet, a palmtop, a laptop, a mobile Internet device (MID, Mobile Internet Devices) or a wearable device, a walkie-talkie, and the like.
  • the data processing apparatus in the embodiment of the present invention may be connected to multiple cameras, and each camera may be used to capture video images, and each camera may have a corresponding position mark, or there may be one The number corresponding to it.
  • cameras can be placed in public places, such as schools, museums, crossroads, pedestrian streets, office buildings, garages, airports, hospitals, subway stations, stations, bus stops, supermarkets, hotels, entertainment venues, and more.
  • the video image can be saved to the memory of the system where the data processing device is located.
  • a plurality of image libraries can be stored in the memory, and each image library can include different video images of the same person.
  • each image library can also be used to store a video image of one area or a video image taken by a specified camera.
  • each frame of the video image captured by the camera corresponds to one attribute information
  • the attribute information is at least one of the following: a shooting time of the video image, a position of the video image, and an attribute parameter of the video image ( Format, size, resolution, etc.), the number of the video image, and the character characteristics in the video image.
  • the character feature attributes in the above video image may include, but are not limited to, the number of people in the video image, the position of the person, the angle of the person, and the like.
  • the video image captured by each camera is usually a dynamic face image. Therefore, in the embodiment of the present invention, the angle of the face image may be analyzed, and the angle may include, but is not limited to, a horizontal rotation angle and a pitch. Angle or inclination.
  • the definition of dynamic face image data requires that the distance between the two eyes is not less than 30 pixels, and it is recommended to be more than 60 pixels.
  • the horizontal rotation angle does not exceed ⁇ 30°
  • the pitch angle does not exceed ⁇ 20°
  • the inclination angle does not exceed ⁇ 45°. It is recommended that the horizontal rotation angle does not exceed ⁇ 15°, the pitch angle does not exceed ⁇ 10°, and the inclination angle does not exceed ⁇ 15°.
  • the picture format of the video image in the embodiment of the present invention may include, but is not limited to, BMP, JPEG, JPEG2000, PNG, etc., and the size may be between 10-30 KB, and each video image may also correspond to one shooting time and shooting.
  • Information such as a camera number of the video image, a link of a panoramic image corresponding to the face image, and the like (a face image and a global image creation feature correspondence relationship file).
  • FIG. 1 is a schematic flowchart diagram of a first embodiment of a data processing method according to an embodiment of the present invention.
  • the data processing method described in this embodiment includes the following steps:
  • the data processing device may send a task status acquisition request to the target user equipment, and after receiving the task status acquisition request, the target user equipment may send the current task status of the target user equipment to the data processing device.
  • the data processing device can be coupled to a plurality of user devices, the target user device being one of the plurality of user devices.
  • the current task status may include at least one of the following: a task to be processed, a processed task and a timeout unprocessed, a task content being processed, an importance level, and the like.
  • the task to be processed may be the task to be processed next, and may include the content and quantity of the task to be processed. For example, if an alarm condition is found, it needs to be processed.
  • N is a positive integer.
  • the data processing device can be connected to a plurality of cameras. Therefore, if any target is captured by any of the cameras, an alarm message can be generated, and N pieces of alarm information can be obtained, where N is a positive integer.
  • a camera may capture 1 target, and may capture 2 targets. Of course, it may not capture any target.
  • several alarm information may be obtained according to actual conditions.
  • Each of the alarm information may include at least one target object, and the target object may be a crime object (for example, a thief appearing in a supermarket), or specify a target person.
  • acquiring N pieces of alarm information may include the following steps:
  • the data processing device can acquire X video segments through X cameras connected thereto, each camera can correspond to one video segment, and can analyze X video segments, and can be analyzed in the following two manners. Get N alarms.
  • performing behavior analysis on the X video segments to obtain the N pieces of alarm information may include the following steps:
  • the preset behavior may be set by the user equipment, for example, destroying an item, stealing an item, and the like.
  • the data processing device can parse the X video segments, thereby obtaining an image of one frame and one frame, that is, a Y frame video image, and performing behavior analysis on each frame video image in the Y frame video image, thereby obtaining Z
  • Z is a positive integer.
  • Z video images can be filtered, and Z video images can be filtered as follows, for example, image quality evaluation of Z video images is obtained.
  • the preset image quality threshold can be set by the user equipment or the system defaults.
  • the data processing apparatus may perform image quality evaluation on the Z video images by using at least one image quality evaluation index to obtain an image quality evaluation value, wherein the image quality evaluation index may include Not limited to: average gray, mean square error, entropy, edge retention, signal to noise ratio, and so on. It can be defined that the larger the image quality evaluation value obtained, the better the image quality.
  • Image quality can be evaluated by using 2 to 10 image quality evaluation indicators. Specifically, the number of image quality evaluation indicators and which indicator are selected are determined according to specific implementation conditions. Of course, it is also necessary to select image quality evaluation indicators in combination with specific scenes, and the image quality indicators in the dark environment and the image quality evaluation in the bright environment may be different.
  • an image quality evaluation index may be used for evaluation.
  • the image quality evaluation value is processed by entropy processing, and the entropy is larger, indicating that the image quality is higher.
  • the smaller the entropy the worse the image quality.
  • the image to be evaluated may be evaluated by using multiple image quality evaluation indicators, and the image quality evaluation may be performed when the image quality evaluation index is used for image quality evaluation.
  • the weight of each image quality evaluation index in the plurality of image quality evaluation indicators may obtain a plurality of image quality evaluation values, and the final image quality evaluation value may be obtained according to the plurality of image quality evaluation values and corresponding weights, for example, three
  • the image quality evaluation indicators are: A index, B index and C index.
  • the weight of A is a1
  • the weight of B is a2
  • the weight of C is a3.
  • the image quality evaluation value corresponding to A is b1
  • the image quality evaluation value corresponding to B is b2
  • the image quality evaluation value corresponding to C is b3.
  • the final image quality evaluation value a1b1+a2b2+a3b3.
  • the larger the image quality evaluation value the better the image quality.
  • screening the Z video images may also be implemented as follows:
  • Determining the angle of the face image included in the video image i determining whether the angle is within a preset angle range, and if so, retaining the video image i, the video image i is any one of the Z video images.
  • performing behavior analysis on the X video segments to obtain the N pieces of alarm information may include the following steps:
  • X video segments may include multiple frames of images.
  • not every frame image includes a face image.
  • some frames may also include multiple face images, and thus, each frame may be The image is segmented to obtain a P face image, and P is a positive integer.
  • different image frames may also include a face image of the same person.
  • the P face image may be further combined to obtain a Q face image, and Q is a positive integer less than or equal to P.
  • the Q face image can be matched with the A face image in the image library to obtain an N face image, where N is smaller than Q and N is smaller than A.
  • the A personal face image in the image library may be a face image of an alarm target that is pre-recorded into the system, that is, an alarm target appears, and an alarm information may be generated. Further, N pieces of alarm information are generated according to the N personal face image, and each face image can correspond to one piece of alarm information.
  • matching the Q personal face image with the A personal face image in the image library may include the following steps:
  • A1 performing feature extraction on each face image in the Q facial image to obtain the Q first feature sets
  • A5. Obtain a face image corresponding to the N matching values from the Q face image to obtain the N face image.
  • the Q face image can be extracted, and the Q first feature sets can be obtained.
  • the feature extraction method can include, but is not limited to, a Harris corner detection algorithm and a scale invariant feature (Scale Invariant Feature Transform). , SIFT) extraction algorithm, using classifier for feature extraction, classifiers may include but are not limited to: Support Vector Machine (SVM), convolutional neural network, cascading neural network, genetic algorithm and so on.
  • SVM Support Vector Machine
  • convolutional neural network convolutional neural network
  • cascading neural network genetic algorithm and so on.
  • the Q first feature sets and the A second feature sets may be matched by using Structural Similarity Index Measurement (SSIM) to obtain Q*A matching values.
  • SSIM Structural Similarity Index Measurement
  • the above preset matching threshold may be set by the system default or by the user equipment. Therefore, a matching value whose matching value is greater than a preset matching threshold value may be selected from the Q*A matching values to obtain N eigenvalues, and further, a face image corresponding to the N matching values may be obtained from the Q facial image. Get N face images.
  • the data processing device may allocate M pieces of alarm information to the target user equipment according to the current task status. There may be multiple user equipments in the current environment. Therefore, the N pieces of alarm information may not be allocated to one user equipment.
  • the target user equipment allocates M pieces of alarm information, where M is an integer less than or equal to N. For example, the alarm information may be allocated less frequently according to the needs of the current task to be processed. Of course, the alarm information may be allocated according to the location of the user. If the location of the alarm information is close to the target user equipment, the alarm information may be prioritized.
  • allocating the M pieces of alarm information to the target user equipment according to the current task status may include the following steps:
  • the data processing device can obtain the location of the target user equipment by using a camera or a positioning technology, and then allocates M pieces of alarm information to the user equipment according to the location and the current task status.
  • the user equipment may have fewer tasks to be processed.
  • the data processing device can obtain the current task status of the target user equipment, obtain N pieces of alarm information, and N is a positive integer, and allocate M pieces of alarm information to the target user equipment according to the current task status, N pieces.
  • the alarm information includes M alarms, and M is an integer less than or equal to N. Therefore, the current task status of the user equipment can be obtained, such as: pending tasks, processed tasks, and timeout unprocessed.
  • Alarm information can be allocated less for it. When there are fewer tasks, more alarm information is assigned to it, and the alarm information can be processed reasonably.
  • FIG. 2 it is a schematic flowchart of a second embodiment of a data processing method according to an embodiment of the present invention.
  • the data processing method described in this embodiment includes the following steps:
  • the video processing device acquires a current task status of the target user equipment.
  • the video processing device acquires N pieces of alarm information, where N is a positive integer.
  • the video processing device allocates M pieces of alarm information to the target user equipment according to the current task status, where the N pieces of alarm information include the M pieces of alarm information, where the M is less than or equal to the N Integer.
  • step 101 - step 103 of the data processing method described in FIG. 1 the specific description of the foregoing step 201 - step 203 can be referred to step 101 - step 103 of the data processing method described in FIG. 1 .
  • the target user equipment receives the M pieces of alarm information.
  • the target user equipment acquires a current location.
  • the target user equipment determines a distance between the current location and the M locations corresponding to the M pieces of alarm information, to obtain the M distance values.
  • the target user equipment displays the M pieces of alarm information on the target user equipment according to the M distance values.
  • the user can click “Alarm Statistics” in the task bar on the target user device to display all the alarm data statistics of the day, including: total number of alarms, false positives, normal shopping, theft stop, no finds, timeout Unprocessed, pending; click on each column of information, you can display the list of related alarm information, of course, all the columns in the alarm statistics can only be operated on the "pending" items, and others can only be viewed.
  • the target user equipment clicks the alarm information to enter the corresponding page directly, and the person who receives the information can process the information, including (false positives, normal shopping, stop, undiscovered), and can also be assigned to the store. Any one of the people can track the event. If the user equipment is mobile, the video of the camera next to the current location can be provided. Thus, the user equipment can search for the target appearing in the alarm information according to the video.
  • the data processing device can obtain the current task status of the target user equipment, obtain N pieces of alarm information, and N is a positive integer, and allocate M pieces of alarm information to the target user equipment according to the current task status, N pieces.
  • the alarm information includes M alarms. M is an integer less than or equal to N.
  • the target user equipment receives M alarms, obtains the current location, and determines the distance between the current location and the M locations corresponding to the M alarms. The distance values are based on the M distance values, and M pieces of alarm information are displayed on the target user equipment.
  • the current task status of the user equipment can be obtained, such as: a task to be processed, a processed task, and a timeout unprocessed, etc., when there are many tasks, less alarm information can be allocated for it, and when there are fewer tasks, more The alarm information is allocated to the user equipment.
  • the user equipment can display the M alarm information according to the position of the M alarm information and the distance between the M alarm information, so that the user can preferentially select the alarm information to be processed nearby, thereby implementing the The alarm information is processed reasonably.
  • FIG. 3 is a schematic structural diagram of a first embodiment of a data processing apparatus according to an embodiment of the present invention.
  • the data processing apparatus described in this embodiment includes: a first obtaining unit 301, a second obtaining unit 302, and an allocating unit 303, as follows:
  • the first obtaining unit 301 is configured to acquire a current task status of the target user equipment.
  • the second obtaining unit 302 is configured to acquire N pieces of alarm information, where the N is a positive integer;
  • the allocating unit 303 is configured to allocate M pieces of alarm information to the target user equipment according to the current task status, where the N pieces of alarm information include the M pieces of alarm information, where the M is an integer less than or equal to the N .
  • FIG. 3b is a specific refinement structure of the second obtaining unit 302 of the video processing apparatus described in FIG. 3a, where the second obtaining unit 302 may include: a first obtaining module 3021 and a first analysis.
  • Module 3022 is as follows:
  • a first obtaining module 3021 configured to acquire video from the X cameras, to obtain the X video segments, each of the cameras corresponding to one of the video segments, where X is a positive integer;
  • the first analysis module 3022 is configured to perform behavior analysis on the X video segments to obtain the N pieces of alarm information.
  • FIG. 3c is a specific refinement structure of the first analysis module 3022 of the video processing device described in FIG. 3b, where the first analysis module 3022 may include: a parsing module 401, and a second analysis.
  • the module 402 and the screening module 403 are as follows:
  • the parsing module 401 is configured to parse the X video segments to obtain a Y frame video image, where the Y is a positive integer;
  • the second analysis module 402 is configured to perform behavior analysis on each frame of the video image of the Y frame to obtain Z video images that meet preset behaviors, where the Z is a positive integer;
  • the screening module 403 is configured to filter the Z video images to obtain N video images, and each video image corresponds to one alarm information.
  • FIG. 3d is a specific refinement structure of the first analysis module 3022 of the video processing device described in FIG. 3b, where the first analysis module 3022 may include a segmentation module 404 and a merge module 405.
  • the matching module 406 and the generating module 407 are as follows:
  • a segmentation module 404 configured to perform image segmentation on the X video segments to obtain a P personal face image, where P is a positive integer;
  • the merging module 405 is configured to combine the P personal face images to obtain a Q personal face image, where the Q is a positive integer less than or equal to the P;
  • the matching module 406 is configured to match the Q personal face image with the A personal face image in the image library to obtain the N personal face image, where A is a positive integer, and the N is smaller than the Q, N is less than the A;
  • the generating module 407 is configured to generate the N pieces of alarm information according to the N personal face image.
  • the matching module 406 may include the following modules: a feature extraction module (not shown), a feature matching module (not shown), a feature value selection module (not shown), and a face acquisition. Module (not shown), as follows:
  • a feature extraction module configured to perform feature extraction on each face image in the Q personal face image to obtain the Q first feature sets
  • the feature extraction module is further configured to perform feature extraction on each face image in the A personal face image to obtain the A second feature set;
  • a feature matching module configured to match the Q first feature sets with the A second feature sets to obtain Q*A matching values
  • An eigenvalue selection module configured to select, from the Q*A matching values, a feature value that is greater than a preset matching threshold, to obtain the N matching values;
  • a face acquisition module configured to acquire a face image corresponding to the N matching values from the Q facial image to obtain the N personal face image.
  • FIG. 3e is a specific refinement structure of the allocating unit 303 of the video processing apparatus described in FIG. 3a, where the allocating unit 303 may include: a second obtaining module 3031 and an allocating module 3032, as follows:
  • the second obtaining module 3031 is configured to acquire a location of the target user equipment.
  • the allocating module 3032 is configured to allocate M pieces of alarm information to the target user equipment according to the location and the current task status.
  • the data processing device can obtain the current task status of the target user equipment, obtain N pieces of alarm information, and N is a positive integer, and allocate M pieces of alarm information to the target user equipment according to the current task status, N pieces.
  • the alarm information includes M alarms, and M is an integer less than or equal to N. Therefore, the current task status of the user equipment can be obtained, such as: pending tasks, processed tasks, and timeout unprocessed.
  • Alarm information can be allocated less for it. When there are fewer tasks, more alarm information is assigned to it, and the alarm information can be processed reasonably.
  • FIG. 4 it is a schematic structural diagram of a second embodiment of a data processing apparatus according to an embodiment of the present invention.
  • the data processing apparatus described in this embodiment includes: at least one input device 1000; at least one output device 2000; at least one processor 3000, such as a CPU; and a memory 4000, the input device 1000, the output device 2000, and the processor 3000. And the memory 4000 is connected through the bus 5000.
  • the input device 1000 may be a touch panel, a physical button, or a mouse.
  • the output device 2000 described above may specifically be a display screen.
  • the above memory 4000 may be a high speed RAM memory or a non-volatile memory such as a magnetic disk memory.
  • the above memory 4000 is used to store a set of program codes, and the input device 1000, the output device 2000, and the processor 3000 are used to call the program code stored in the memory 4000, and perform the following operations:
  • the processor 3000 is configured to:
  • N is a positive integer
  • the processor 3000 obtains N pieces of alarm information, including:
  • the processor 3000 performs behavior analysis on the X video segments to obtain the N pieces of alarm information, including:
  • the Z video images are filtered to obtain N video images, and each video image corresponds to one alarm information.
  • the processor 3000 performs behavior analysis on the X video segments to obtain the N pieces of alarm information, including:
  • the A is a positive integer
  • the N is smaller than the Q
  • the N is smaller than the A
  • the processor 3000 is configured to allocate M pieces of alarm information to the target user equipment according to the current task status, including:
  • the embodiment of the present invention further provides a computer storage medium, wherein the computer storage medium can store a program, and the program includes some or all of the steps of any one of the data processing methods described in the foregoing method embodiments.
  • embodiments of the present invention can be provided as a method, a data processing apparatus (device), or a computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code. The computer program is stored/distributed in a suitable medium, provided with other hardware or as part of the hardware, or in other distributed forms, such as over the Internet or other wired or wireless telecommunication systems.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • Economics (AREA)
  • Quality & Reliability (AREA)
  • Multimedia (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Development Economics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • Primary Health Care (AREA)
  • Software Systems (AREA)
  • Game Theory and Decision Science (AREA)
  • Operations Research (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)

Abstract

Provided are a data processing method, a data processing device, and a storage medium. The method comprises: acquiring a current task state of a target user equipment unit (101); acquiring N warning information items, N being a positive integer (102); and assigning M warning information items to the target user equipment unit according to the current task state, the N warning information items including the M warning information items, M being an integer less than or equal to N (103). The method enables identification of a warning situation and realizes reasonable processing with respect to the warning situation.

Description

数据处理方法、数据处理装置及存储介质Data processing method, data processing device and storage medium
本申请要求于2017年5月18日提交中国专利局,申请号为201710351934.3,发明名称为“数据处理方法、装置及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。The present application claims the priority of the Chinese Patent Application, which is filed on May 18, 2017, the entire disclosure of which is hereby incorporated by reference. in.
技术领域Technical field
本发明涉及视频监控技术领域,具体涉及一种数据处理方法、数据处理装置及存储介质。The present invention relates to the field of video surveillance technologies, and in particular, to a data processing method, a data processing device, and a storage medium.
背景技术Background technique
随着经济、社会、文化的快速发展,国内外影响力的与日俱增,越来越多外来人口流向城市,这些人口增加在加快城市化进程的同时,也为城市管理带来更大的挑战,虽然,视频监控对城市安全提供了技术支持,但是,目前来看,摄像头已经在城市中布局开来,各个摄像头的功能较为独立,当然,多个摄像头可属于一个系统,由该系统对一个区域进行监控,由于监控摄像头数目较多,因而,如何在发现告警情况(即出现目标人物)后,实现对告警进行合理处理的问题亟待解决。With the rapid development of economy, society and culture, the influence of domestic and foreign influences is increasing day by day, and more and more foreign populations are flowing to cities. These population increases, while accelerating the process of urbanization, also bring greater challenges to urban management, although Video surveillance provides technical support for urban security. However, at present, the camera has been laid out in the city, and the functions of each camera are relatively independent. Of course, multiple cameras can belong to one system, and the system performs on one area. Monitoring, due to the large number of surveillance cameras, how to implement the reasonable handling of alarms after the alarm is discovered (ie, the target person appears) needs to be resolved.
发明内容Summary of the invention
本发明实施例提供了一种数据处理方法、数据处理装置及存储介质,可发现告警情况,并实现对告警进行合理处理。The embodiment of the invention provides a data processing method, a data processing device and a storage medium, which can detect an alarm situation and implement reasonable processing of the alarm.
本发明实施例第一方面提供了一种数据处理方法,包括:A first aspect of the embodiments of the present invention provides a data processing method, including:
获取目标用户设备的当前任务状态;Obtain the current task status of the target user equipment;
获取N条告警信息,所述N为正整数;Obtaining N pieces of alarm information, where N is a positive integer;
根据所述当前任务状态为所述目标用户设备分配M条告警信息,所述N条告警信息包含所述M条告警信息,所述M为小于或等于所述N的整数。Assigning M pieces of alarm information to the target user equipment according to the current task status, where the N pieces of alarm information include the M pieces of alarm information, where the M is an integer less than or equal to the N.
结合本发明实施例第一方面,在第一方面的第一种可能实施方式中,所述获取N条告警信息,包括:With reference to the first aspect of the embodiments of the present invention, in the first possible implementation manner of the first aspect, the acquiring the N pieces of alarm information includes:
从X个摄像头获取视频,得到所述X个视频片段,每一所述摄像头对应一个所述视频片段,所述X为正整数;Acquiring a video from the X cameras to obtain the X video segments, each of the cameras corresponding to one of the video segments, where X is a positive integer;
对所述X个视频片段进行行为分析,得到所述N条告警信息。Performing behavior analysis on the X video segments to obtain the N pieces of alarm information.
进而,可通过多个摄像头获取视频,得到多个视频片段,并对每一视频片段进行行为分析,得到N条告警信息,如此,可通过行为分析的方式快速从视 频片段中分析出告警信息。Furthermore, the video can be obtained by multiple cameras, multiple video segments are obtained, and each video segment is subjected to behavior analysis to obtain N pieces of alarm information. Thus, the alarm information can be quickly analyzed from the video segments by behavior analysis.
结合本发明实施例第一方面的第一种可能实施方式,在第一方面的第二种可能实施方式中,所述对所述X个视频片段进行行为分析,得到所述N条告警信息,包括:With reference to the first possible implementation manner of the first aspect of the embodiment, in the second possible implementation manner of the first aspect, the performing, by using the behavior analysis of the X video segments, the N pieces of alarm information, include:
对X个视频片段进行解析,得到Y帧视频图像,所述Y为正整数;Parsing X video segments to obtain a Y frame video image, the Y being a positive integer;
对所述Y帧视频图像中的每一帧视频图像进行行为分析,得到Z个符合预设行为的视频图像,所述Z为正整数;Performing behavior analysis on each frame of the video image of the Y frame to obtain Z video images conforming to a preset behavior, where Z is a positive integer;
对所述Z个视频图像进行筛选,得到N个视频图像,每一视频图像对应一条告警信息。The Z video images are filtered to obtain N video images, and each video image corresponds to one alarm information.
进而,可先对多个视频片段进行解析,并对每一帧图像进行行为分析,选取符合预设行为的视频图像,由于选取的图像也会存在图像质量问题,因而,可进一步筛选,筛选后的每一帧图像即对应一个告警信息,如此,可降低误告警率,提高告警准确率。Furthermore, multiple video segments can be parsed first, and each frame image is analyzed for behavior, and a video image conforming to the preset behavior is selected. Since the selected image also has image quality problems, it can be further filtered and filtered. Each frame of the image corresponds to an alarm message, thus reducing the false alarm rate and improving the alarm accuracy.
结合本发明实施例第一方面的第一种可能实施方式,在第一方面的第三种可能实施方式中,所述对所述X个视频片段进行行为分析,得到所述N条告警信息,包括:With reference to the first possible implementation manner of the first aspect of the embodiments of the present disclosure, in a third possible implementation manner of the foregoing aspect, the performing the behavior analysis on the X video segments to obtain the N pieces of alarm information, include:
对所述X个视频片段进行图像分割,得到P个人脸图像,所述P为正整数;Performing image segmentation on the X video segments to obtain a P personal face image, where P is a positive integer;
对所述P个人脸图像进行合并,得到Q个人脸图像,所述Q为小于或等于所述P的正整数;Combining the P face images to obtain a Q face image, wherein the Q is a positive integer less than or equal to the P;
将所述Q个人脸图像与图像库中的A个人脸图像进行匹配,得到所述N个人脸图像,所述A为正整数,所述N小于所述Q,所述N小于所述A;Matching the Q face image with the A face image in the image library to obtain the N face image, the A is a positive integer, the N is smaller than the Q, and the N is smaller than the A;
根据所述N个人脸图像生成所述N条告警信息。Generating the N pieces of alarm information according to the N human face image.
进而,可对多个视频进行图像分割,对分割后的得到的人脸图像进行合并,再将合并后的人脸图像与图像库中的人脸图像进行匹配,根据匹配结果生成告警信息,如此,只有属于原本库中的人脸图像才可以生成告警信息,可用于实现对指定目标实现告警处理。Furthermore, image segmentation can be performed on a plurality of videos, the segmented face images are merged, and the merged face images are matched with the face images in the image library, and alarm information is generated according to the matching result. The alarm information can be generated only for the face image in the original library, which can be used to implement alarm processing for the specified target.
结合本发明实施例第一方面或第一方面的第一种至第三种中任一可能实施方式,在第一方面的第四种可能实施方式中,所述根据所述当前任务状态为所述目标用户设备分配M条告警信息,包括:With reference to the first aspect of the first embodiment of the present invention, or any one of the first to third aspects of the first aspect, in a fourth possible implementation manner of the first aspect, The target user equipment allocates M pieces of alarm information, including:
获取所述目标用户设备的位置;Obtaining a location of the target user equipment;
根据所述位置与所述当前任务状态为所述目标用户设备分配M条告警信息。And assigning M pieces of alarm information to the target user equipment according to the location and the current task status.
进而,可获取用户设备的位置,根据位置以及其对应的任务状态为其分配告警信息,即若用户设备距离告警信息较远则可以不对其进行分配,可实现人性化对用户设备分配告警信息。Further, the location of the user equipment may be obtained, and the alarm information may be allocated according to the location and the corresponding task status. If the user equipment is far away from the alarm information, the user equipment may not be allocated, and the user equipment may be allocated alarm information.
本发明实施例第二方面提供了一种数据处理装置,包括:A second aspect of the embodiments of the present invention provides a data processing apparatus, including:
第一获取单元,用于获取目标用户设备的当前任务状态;a first acquiring unit, configured to acquire a current task state of the target user equipment;
第二获取单元,用于获取N条告警信息,所述N为正整数;a second acquiring unit, configured to acquire N pieces of alarm information, where the N is a positive integer;
分配单元,用于根据所述当前任务状态为所述目标用户设备分配M条告警信息,所述N条告警信息包含所述M条告警信息,所述M为小于或等于所述N的整数。And an allocating unit, configured to allocate M pieces of alarm information to the target user equipment according to the current task status, where the N pieces of alarm information include the M pieces of alarm information, where the M is an integer less than or equal to the N.
结合本发明实施例第二方面,在第二方面的第一种可能实施方式中,所述第二获取单元包括:With reference to the second aspect of the embodiments of the present invention, in a first possible implementation manner of the second aspect, the second acquiring unit includes:
第一获取模块,用于从X个摄像头获取视频,得到所述X个视频片段,每一所述摄像头对应一个所述视频片段,所述X为正整数;a first acquiring module, configured to acquire video from the X cameras, to obtain the X video segments, each of the cameras corresponding to one of the video segments, where X is a positive integer;
第一分析模块,用于对所述X个视频片段进行行为分析,得到所述N条告警信息。The first analysis module is configured to perform behavior analysis on the X video segments to obtain the N pieces of alarm information.
结合本发明实施例第二方面的第一种可能实施方式,在第二方面的第二种可能实施方式中,所述第一分析模块包括:With reference to the first possible implementation manner of the second aspect of the embodiments of the present invention, in a second possible implementation manner of the second aspect, the first analysis module includes:
解析模块,用于对X个视频片段进行解析,得到Y帧视频图像,所述Y为正整数;a parsing module, configured to parse the X video segments to obtain a Y frame video image, where the Y is a positive integer;
第二分析模块,用于对所述Y帧视频图像中的每一帧视频图像进行行为分析,得到Z个符合预设行为的视频图像,所述Z为正整数;a second analysis module, configured to perform behavior analysis on each frame of the video image of the Y frame to obtain Z video images that conform to a preset behavior, where the Z is a positive integer;
筛选模块,用于对所述Z个视频图像进行筛选,得到N个视频图像,每一视频图像对应一条告警信息。The screening module is configured to filter the Z video images to obtain N video images, and each video image corresponds to one alarm information.
结合本发明实施例第二方面的第一种可能实施方式,在第一方面的第三种可能实施方式中,第一分析模块包括:With reference to the first possible implementation manner of the second aspect of the embodiments of the present invention, in a third possible implementation manner of the first aspect, the first analysis module includes:
分割模块,用于对所述X个视频片段进行图像分割,得到P个人脸图像,所述P为正整数;a segmentation module, configured to perform image segmentation on the X video segments to obtain a P personal face image, where P is a positive integer;
合并模块,用于对所述P个人脸图像进行合并,得到Q个人脸图像,所述Q为小于或等于所述P的正整数;a merging module, configured to merge the P personal face images to obtain a Q personal face image, where the Q is a positive integer less than or equal to the P;
匹配模块,用于将所述Q个人脸图像与图像库中的A个人脸图像进行匹配,得到所述N个人脸图像,所述A为正整数,所述N小于所述Q,所述N小于所述A;a matching module, configured to match the Q facial image with an A facial image in the image library to obtain the N facial image, wherein the A is a positive integer, and the N is smaller than the Q, the N Less than the A;
生成模块,用于根据所述N个人脸图像生成所述N条告警信息。And a generating module, configured to generate the N pieces of alarm information according to the N personal face image.
结合本发明实施例第二方面或第二方面的第一种至第三种中任一可能实施方式,在第二方面的第四种可能实施方式中,所述分配单元包括:With reference to the second aspect of the embodiment of the present invention or the first to the third possible implementation manner of the second aspect, in the fourth possible implementation manner of the second aspect,
第二获取模块,用于获取所述目标用户设备的位置;a second acquiring module, configured to acquire a location of the target user equipment;
分配模块,用于根据所述位置与所述当前任务状态为所述目标用户设备分配M条告警信息。And an allocating module, configured to allocate M pieces of alarm information to the target user equipment according to the location and the current task status.
本发明实施例第三方面提供一种数据处理装置,所述数据处理装置包括处理器,所述处理器用于执行存储器中存储的计算机程序时实现如上述任意一项 所述的数据处理方法。A third aspect of the embodiments of the present invention provides a data processing apparatus, wherein the data processing apparatus includes a processor, and the processor is configured to implement the data processing method according to any one of the above, when the computer program is stored in a memory.
本发明实施例第四方面提供了一种计算机可读存储介质,存储有计算机程序,所述计算机程序被处理器执行以实现如第一方面或第一方面的任一可能实施方式所述的方法。A fourth aspect of the embodiments of the present invention provides a computer readable storage medium storing a computer program, the computer program being executed by a processor to implement the method of any of the first aspect or the first aspect .
实施本发明实施例,具有如下有益效果:Embodiments of the present invention have the following beneficial effects:
可以看出,通过本发明实施例,数据处理装置可获取目标用户设备的当前任务状态,获取N条告警信息,N为正整数,根据当前任务状态为目标用户设备分配M条告警信息,N条告警信息包含M条告警信息,M为小于或等于N的整数,从而,可获取用户设备的当前任务状态,如:待处理任务、已处理任务和超时未处理等,在其任务较多时,则可少为其分配告警信息,在其任务较少时,则多为其分配告警信息,进而可实现对告警信息进行合理处理。It can be seen that, by using the embodiment of the present invention, the data processing device can obtain the current task status of the target user equipment, obtain N pieces of alarm information, and N is a positive integer, and allocate M pieces of alarm information to the target user equipment according to the current task status, N pieces. The alarm information includes M alarms, and M is an integer less than or equal to N. Therefore, the current task status of the user equipment can be obtained, such as: pending tasks, processed tasks, and timeout unprocessed. When there are many tasks, Alarm information can be allocated less for it. When there are fewer tasks, more alarm information is assigned to it, and the alarm information can be processed reasonably.
附图说明DRAWINGS
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are some embodiments of the present invention, Those skilled in the art can also obtain other drawings based on these drawings without paying any creative work.
图1是本发明实施例提供的一种数据处理方法的第一实施例流程示意图;1 is a schematic flow chart of a first embodiment of a data processing method according to an embodiment of the present invention;
图2是本发明实施例提供的一种数据处理方法的第二实施例流程示意图;2 is a schematic flow chart of a second embodiment of a data processing method according to an embodiment of the present invention;
图2a是本发明实施例提供的用户设备的当前任务状态的演示示意图;2a is a schematic diagram showing a demonstration of a current task state of a user equipment according to an embodiment of the present invention;
图3a是本发明实施例提供的一种数据处理装置的第一实施例结构示意图;FIG. 3 is a schematic structural diagram of a first embodiment of a data processing apparatus according to an embodiment of the present invention; FIG.
图3b是本发明实施例提供的图3a所描述的数据处理装置的第二获取单元的结构示意图;FIG. 3b is a schematic structural diagram of a second acquiring unit of the data processing apparatus described in FIG. 3a according to an embodiment of the present disclosure;
图3c是本发明实施例提供的图3a所描述的第二获取单元的第一分析模块的第一实施例结构示意图;3c is a schematic structural diagram of a first embodiment of a first analysis module of the second obtaining unit described in FIG. 3a according to an embodiment of the present disclosure;
图3d是本发明实施例提供的图3a所描述的第二获取单元的第一分析模块的第二实施例结构示意图;FIG. 3 is a schematic structural diagram of a second embodiment of a first analysis module of the second obtaining unit depicted in FIG. 3a according to an embodiment of the present disclosure;
图3e是本发明实施例提供的图3a所描述的数据处理装置的分配单元的结构示意图;3e is a schematic structural diagram of an allocation unit of the data processing apparatus described in FIG. 3a according to an embodiment of the present invention;
图4是本发明实施例提供的一种数据处理装置的第二实施例结构示意图。FIG. 4 is a schematic structural diagram of a second embodiment of a data processing apparatus according to an embodiment of the present invention.
具体实施方式detailed description
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
本发明的说明书和权利要求书及所述附图中的术语“第一”、“第二”、“第三”和“第四”等是用于区别不同对象,而不是用于描述特定顺序。此外,术语“包括”和“具有”以及它们任何变形,意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元,而是可选地还包括没有列出的步骤或单元,或可选地还包括对于这些过程、方法、产品或设备固有的其它步骤或单元。The terms "first", "second", "third", and "fourth" and the like in the specification and claims of the present invention are used to distinguish different objects, and are not intended to describe a specific order. . Furthermore, the terms "comprises" and "comprising" and "comprising" are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or device that comprises a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units not listed, or alternatively Other steps or units inherent to these processes, methods, products or equipment.
在本文中提及“实施例”意味着,结合实施例描述的特定特征、结构或特性可以包含在本发明的至少一个实施例中。在说明书中的各个位置展示该短语并不一定均是指相同的实施例,也不是与其它实施例互斥的独立的或备选的实施例。本领域技术人员显式地和隐式地理解的是,本文所描述的实施例可以与其它实施例相结合。References to "an embodiment" herein mean that a particular feature, structure, or characteristic described in connection with the embodiments can be included in at least one embodiment of the invention. The appearances of the phrases in various places in the specification are not necessarily referring to the same embodiments, and are not exclusive or alternative embodiments that are mutually exclusive. Those skilled in the art will understand and implicitly understand that the embodiments described herein can be combined with other embodiments.
本发明实施例所描述数据处理装置可以包括智能手机(如Android手机、iOS手机、Windows Phone手机等)、平板电脑、掌上电脑、笔记本电脑、移动互联网设备(MID,Mobile Internet Devices)或穿戴式设备等,上述仅是举例,而非穷举,包含但不限于上述装置,当然,上述数据处理装置还可以为服务器。用户设备可以为智能手机(如Android手机、iOS手机、Windows Phone手机等)、平板电脑、掌上电脑、笔记本电脑、移动互联网设备(MID,Mobile Internet Devices)或穿戴式设备、对讲机等等。The data processing apparatus described in the embodiments of the present invention may include a smart phone (such as an Android mobile phone, an iOS mobile phone, a Windows Phone mobile phone, etc.), a tablet computer, a palmtop computer, a notebook computer, a mobile Internet device (MID, Mobile Internet Devices), or a wearable device. The above is only an example, and not an exhaustive, including but not limited to the above device. Of course, the above data processing device may also be a server. The user equipment can be a smart phone (such as an Android phone, an iOS phone, a Windows Phone, etc.), a tablet, a palmtop, a laptop, a mobile Internet device (MID, Mobile Internet Devices) or a wearable device, a walkie-talkie, and the like.
需要说明的是,本发明实施例中的数据处理装置可与多个摄像头连接,每一摄像头均可用于抓拍视频图像,每一摄像头均可有一个与之对应的位置标记,或者,可有一个与之对应的编号。通常情况下,摄像头可设置在公共场所,例如,学校、博物馆、十字路口、步行街、写字楼、车库、机场、医院、地铁站、车站、公交站台、超市、酒店、娱乐场所等等。摄像头在拍摄到视频图像后,可将该视频图像保存到数据处理装置所在系统的存储器。存储器中可存储有多个图像库,每一图像库可包含同一人的不同视频图像,当然,每一图像库还可以用于存储一个区域的视频图像或者某个指定摄像头拍摄的视频图像。It should be noted that the data processing apparatus in the embodiment of the present invention may be connected to multiple cameras, and each camera may be used to capture video images, and each camera may have a corresponding position mark, or there may be one The number corresponding to it. Typically, cameras can be placed in public places, such as schools, museums, crossroads, pedestrian streets, office buildings, garages, airports, hospitals, subway stations, stations, bus stops, supermarkets, hotels, entertainment venues, and more. After the camera captures the video image, the video image can be saved to the memory of the system where the data processing device is located. A plurality of image libraries can be stored in the memory, and each image library can include different video images of the same person. Of course, each image library can also be used to store a video image of one area or a video image taken by a specified camera.
进一步可选地,本发明实施例中,摄像头拍摄的每一帧视频图像均对应一个属性信息,属性信息为以下至少一种:视频图像的拍摄时间、视频图像的位置、视频图像的属性参数(格式、大小、分辨率等)、视频图像的编号和视频图像中的人物特征属性。上述视频图像中的人物特征属性可包括但不仅限于:视频图像中的人物个数、人物位置、人物角度等等。Further, in the embodiment of the present invention, each frame of the video image captured by the camera corresponds to one attribute information, and the attribute information is at least one of the following: a shooting time of the video image, a position of the video image, and an attribute parameter of the video image ( Format, size, resolution, etc.), the number of the video image, and the character characteristics in the video image. The character feature attributes in the above video image may include, but are not limited to, the number of people in the video image, the position of the person, the angle of the person, and the like.
进一步需要说明的是,每一摄像头采集的视频图像通常为动态人脸图像,因而,本发明实施例中可以对人脸图像的角度进行分析,上述角度可包括但不仅限于:水平转动角度、俯仰角或者倾斜度。例如,可定义动态人脸图像数据要求两眼间距不小于30像素,建议60像素以上。水平转动角度不超过±30°、俯仰角不超过±20°、倾斜角不超过±45°。建议水平转动角度不超过±15°、 俯仰角不超过±10°、倾斜角不超过±15°。例如,还可对人脸图像是否被其他物体遮挡进行筛选,通常情况下,饰物不应遮挡脸部主要区域,饰物如深色墨镜、口罩和夸张首饰等,当然,也有可能摄像头上面布满灰尘,导致人脸图像被遮挡。本发明实施例中的视频图像的图片格式可包括但不仅限于:BMP,JPEG,JPEG2000,PNG等等,其大小可以在10-30KB之间,每一视频图像还可以对应一个拍摄时间、以及拍摄该视频图像的摄像头统一编号、与人脸图像对应的全景大图的链接等信息(人脸图像和全局图片建立特点对应性关系文件)。It should be further noted that the video image captured by each camera is usually a dynamic face image. Therefore, in the embodiment of the present invention, the angle of the face image may be analyzed, and the angle may include, but is not limited to, a horizontal rotation angle and a pitch. Angle or inclination. For example, the definition of dynamic face image data requires that the distance between the two eyes is not less than 30 pixels, and it is recommended to be more than 60 pixels. The horizontal rotation angle does not exceed ±30°, the pitch angle does not exceed ±20°, and the inclination angle does not exceed ±45°. It is recommended that the horizontal rotation angle does not exceed ±15°, the pitch angle does not exceed ±10°, and the inclination angle does not exceed ±15°. For example, it is also possible to screen whether the face image is blocked by other objects. Usually, the ornament should not block the main area of the face, such as dark sunglasses, masks and exaggerated jewelry, and of course, the camera may be covered with dust. , causing the face image to be occluded. The picture format of the video image in the embodiment of the present invention may include, but is not limited to, BMP, JPEG, JPEG2000, PNG, etc., and the size may be between 10-30 KB, and each video image may also correspond to one shooting time and shooting. Information such as a camera number of the video image, a link of a panoramic image corresponding to the face image, and the like (a face image and a global image creation feature correspondence relationship file).
请参阅图1,为本发明实施例提供的一种数据处理方法的第一实施例流程示意图。本实施例中所描述的数据处理方法,包括以下步骤:FIG. 1 is a schematic flowchart diagram of a first embodiment of a data processing method according to an embodiment of the present invention. The data processing method described in this embodiment includes the following steps:
101、获取目标用户设备的当前任务状态。101. Obtain a current task status of the target user equipment.
其中,数据处理装置可向目标用户设备发送任务状态获取请求,目标用户设备在接收到该任务状态获取请求之后,可向数据处理装置发送该目标用户设备的当前任务状态。数据处理装置可与多个用户设备连接,目标用户设备为该多个用户设备中的一个。The data processing device may send a task status acquisition request to the target user equipment, and after receiving the task status acquisition request, the target user equipment may send the current task status of the target user equipment to the data processing device. The data processing device can be coupled to a plurality of user devices, the target user device being one of the plurality of user devices.
可选地,上述当前任务状态可包含以下至少一种:待处理任务、已处理任务和超时未处理、正在处理的任务内容以及重要等级等等。其中,待处理任务可为接下来需要处理的任务,可包含待处理任务的内容和数量,例如,发现某个告警情况,则需要去处理。Optionally, the current task status may include at least one of the following: a task to be processed, a processed task and a timeout unprocessed, a task content being processed, an importance level, and the like. The task to be processed may be the task to be processed next, and may include the content and quantity of the task to be processed. For example, if an alarm condition is found, it needs to be processed.
102、获取N条告警信息,所述N为正整数。102. Obtain N pieces of alarm information, where N is a positive integer.
其中,由上述可知,数据处理装置可与多个摄像头连接,因而,可在任一摄像头抓拍到某一目标,则可生成一条告警信息,进而,可得到N条告警信息,N为正整数。当然,一个摄像头可能抓拍到1个目标,也有可能抓拍到2个目标,当然,也可能没抓拍到任何目标,进而,具体获取几条告警信息,可依据实际情况而定。其中,每一条告警信息可包含至少一个目标对象,目标对象可为作案对象(例如,在超市中出现的小偷),或者,指定目标人物。As can be seen from the above, the data processing device can be connected to a plurality of cameras. Therefore, if any target is captured by any of the cameras, an alarm message can be generated, and N pieces of alarm information can be obtained, where N is a positive integer. Of course, a camera may capture 1 target, and may capture 2 targets. Of course, it may not capture any target. Further, several alarm information may be obtained according to actual conditions. Each of the alarm information may include at least one target object, and the target object may be a crime object (for example, a thief appearing in a supermarket), or specify a target person.
可选地,上述步骤102中,获取N条告警信息,可包括如下步骤:Optionally, in the foregoing step 102, acquiring N pieces of alarm information may include the following steps:
21)、从X个摄像头获取视频,得到所述X个视频片段,每一所述摄像头对应一个所述视频片段,所述X为正整数;21) acquiring video from X cameras, and obtaining the X video segments, each of the cameras corresponding to one of the video segments, where X is a positive integer;
22)、对所述X个视频片段进行行为分析,得到所述N条告警信息。22) Perform behavior analysis on the X video segments to obtain the N pieces of alarm information.
其中,数据处理装置可通过与其连接的X个摄像头则可获取X个视频片段,每一摄像头可对应一个视频片段,可对X个视频片段进行分析,可采用如下两种方式进行分析,进而,得到N条告警信息。The data processing device can acquire X video segments through X cameras connected thereto, each camera can correspond to one video segment, and can analyze X video segments, and can be analyzed in the following two manners. Get N alarms.
可选地,上述步骤22中,对所述X个视频片段进行行为分析,得到所述N条告警信息,可包括如下步骤:Optionally, in the foregoing step 22, performing behavior analysis on the X video segments to obtain the N pieces of alarm information may include the following steps:
221)、对X个视频片段进行解析,得到Y帧视频图像,所述Y为正整数;221) parsing the X video segments to obtain a Y frame video image, where Y is a positive integer;
222)、对所述Y帧视频图像中的每一帧视频图像进行行为分析,得到Z个符合预设行为的视频图像,所述Z为正整数;222) performing behavior analysis on each frame of the video image in the Y frame to obtain Z video images that conform to a preset behavior, where Z is a positive integer;
223)、对所述Z个视频图像进行筛选,得到N个视频图像,每一视频图像对应一条告警信息。223) screening the Z video images to obtain N video images, each video image corresponding to one alarm information.
其中,上述预设行为可由用户设备自行设置,例如,毁坏某个物品、偷窃某个物品,等等。数据处理装置可对X个视频片段进行解析,从而,得到一帧一帧的图像,即Y帧视频图像,可对Y帧视频图像中的每一帧视频图像进行行为分析,进而,得到Z个符合预设行为的视频图像,Z为正整数,进一步地,可对Z个视频图像进行筛选,可按照如下方式对Z个视频图像进行筛选,例如,对Z个视频图像进行图像质量评价,得到Z个图像质量评价值,选取图像质量评价值大于预设图像质量阈值的图像质量评价值对应的视频图像,得到N个视频图像,每一视频图像对应一条告警信息,得到N条告警信息,其中,预设图像质量阈值可由用户设备自行设置或者系统默认。The preset behavior may be set by the user equipment, for example, destroying an item, stealing an item, and the like. The data processing device can parse the X video segments, thereby obtaining an image of one frame and one frame, that is, a Y frame video image, and performing behavior analysis on each frame video image in the Y frame video image, thereby obtaining Z A video image conforming to the preset behavior, Z is a positive integer. Further, Z video images can be filtered, and Z video images can be filtered as follows, for example, image quality evaluation of Z video images is obtained. Z image quality evaluation values are selected, and the video images corresponding to the image quality evaluation values whose image quality evaluation values are larger than the preset image quality threshold are selected, and N video images are obtained, and each video image corresponds to one alarm information, and N pieces of alarm information are obtained, wherein The preset image quality threshold can be set by the user equipment or the system defaults.
进一步地,数据处理装置可采用如下手段对Z个视频图像进行图像质量评价:可采用至少一个图像质量评价指标对图像进行图像质量评价,得到图像质量评价值,其中,图像质量评价指标可包括但不仅限于:平均灰度、均方差、熵、边缘保持度、信噪比等等。可定义为得到的图像质量评价值越大,则图像质量越好。Further, the data processing apparatus may perform image quality evaluation on the Z video images by using at least one image quality evaluation index to obtain an image quality evaluation value, wherein the image quality evaluation index may include Not limited to: average gray, mean square error, entropy, edge retention, signal to noise ratio, and so on. It can be defined that the larger the image quality evaluation value obtained, the better the image quality.
需要说明的是,由于采用单一评价指标对图像质量进行评价时,具有一定的局限性,因此,可采用多个图像质量评价指标对图像质量进行评价,当然,对图像质量进行评价时,并非图像质量评价指标越多越好,因为图像质量评价指标越多,图像质量评价过程的计算复杂度越高,也不见得图像质量评价效果越好,因此,在对图像质量评价要求较高的情况下,可采用2~10个图像质量评价指标对图像质量进行评价。具体地,选取图像质量评价指标的个数及哪个指标,依据具体实现情况而定。当然,也得结合具体地场景选取图像质量评价指标,在暗环境下进行图像质量评价和亮环境下进行图像质量评价选取的图像质量指标可不一样。It should be noted that since the image quality is evaluated by using a single evaluation index, there are certain limitations. Therefore, multiple image quality evaluation indicators can be used to evaluate the image quality. Of course, when evaluating the image quality, it is not an image. The more quality evaluation indicators, the better, because the more image quality evaluation indicators, the higher the computational complexity of the image quality evaluation process, and the better the image quality evaluation effect. Therefore, in the case of high image quality evaluation requirements Image quality can be evaluated by using 2 to 10 image quality evaluation indicators. Specifically, the number of image quality evaluation indicators and which indicator are selected are determined according to specific implementation conditions. Of course, it is also necessary to select image quality evaluation indicators in combination with specific scenes, and the image quality indicators in the dark environment and the image quality evaluation in the bright environment may be different.
可选地,在对图像质量评价精度要求不高的情况下,可用一个图像质量评价指标进行评价,例如,以熵对待处理图像进行图像质量评价值,可认为熵越大,则说明图像质量越好,相反地,熵越小,则说明图像质量越差。Optionally, in the case that the image quality evaluation accuracy is not high, an image quality evaluation index may be used for evaluation. For example, the image quality evaluation value is processed by entropy processing, and the entropy is larger, indicating that the image quality is higher. Well, conversely, the smaller the entropy, the worse the image quality.
可选地,在对图像质量评价精度要求较高的情况下,可以采用多个图像质量评价指标对待评价图像进行评价,在多个图像质量评价指标对待评价图像进行图像质量评价时,可设置该多个图像质量评价指标中每一图像质量评价指标的权重,可得到多个图像质量评价值,根据该多个图像质量评价值及其对应的权重可得到最终的图像质量评价值,例如,三个图像质量评价指标分别为:A 指标、B指标和C指标,A的权重为a1,B的权重为a2,C的权重为a3,采用A、B和C对某一图像进行图像质量评价时,A对应的图像质量评价值为b1,B对应的图像质量评价值为b2,C对应的图像质量评价值为b3,那么,最后的图像质量评价值=a1b1+a2b2+a3b3。通常情况下,图像质量评价值越大,说明图像质量越好。Optionally, in the case that the image quality evaluation accuracy is high, the image to be evaluated may be evaluated by using multiple image quality evaluation indicators, and the image quality evaluation may be performed when the image quality evaluation index is used for image quality evaluation. The weight of each image quality evaluation index in the plurality of image quality evaluation indicators may obtain a plurality of image quality evaluation values, and the final image quality evaluation value may be obtained according to the plurality of image quality evaluation values and corresponding weights, for example, three The image quality evaluation indicators are: A index, B index and C index. The weight of A is a1, the weight of B is a2, and the weight of C is a3. When A, B and C are used to evaluate the image quality of an image. The image quality evaluation value corresponding to A is b1, the image quality evaluation value corresponding to B is b2, and the image quality evaluation value corresponding to C is b3. Then, the final image quality evaluation value=a1b1+a2b2+a3b3. In general, the larger the image quality evaluation value, the better the image quality.
可选地,上述步骤223中,对所述Z个视频图像进行筛选,还可以按照如下方式实施:Optionally, in the foregoing step 223, screening the Z video images may also be implemented as follows:
确定视频图像i中包含的人脸图像的角度,判断该角度是否处于预设角度范围,若是,则保留该视频图像i,视频图像i为Z个视频图像中的任一视频图像。Determining the angle of the face image included in the video image i, determining whether the angle is within a preset angle range, and if so, retaining the video image i, the video image i is any one of the Z video images.
可选地,上述步骤22中,对所述X个视频片段进行行为分析,得到所述N条告警信息,可包括如下步骤:Optionally, in the foregoing step 22, performing behavior analysis on the X video segments to obtain the N pieces of alarm information may include the following steps:
224)、对所述X个视频片段进行图像分割,得到P个人脸图像,所述P为正整数;224) performing image segmentation on the X video segments to obtain a P personal face image, where P is a positive integer;
225)、对所述P个人脸图像进行合并,得到Q个人脸图像,所述Q为小于或等于所述P的正整数;225) combining the P personal face images to obtain a Q personal face image, wherein the Q is a positive integer less than or equal to the P;
226)、将所述Q个人脸图像与图像库中的A个人脸图像进行匹配,得到所述N个人脸图像,所述A为正整数,所述N小于所述Q,所述N小于所述A;226) matching the Q facial image with the A facial image in the image library to obtain the N facial image, wherein A is a positive integer, the N is smaller than the Q, and the N is smaller than A;
227)、根据所述N个人脸图像生成所述N条告警信息。227) Generate the N pieces of alarm information according to the N personal face image.
其中,X个视频片段,可包含多帧图像,当然,并非每一帧图像中都包含人脸图像,当然,有的一帧图像中也可以包含多个人脸图像,因而,可对每一帧图像进行图像分割,可得到P个人脸图像,P为正整数。当然,不同的图像帧中也可以包含同一个人的人脸图像,进而,可对P个人脸图像作进一步合并,得到Q个人脸图像,Q为小于或等于P的正整数。进一步地,可将Q个人脸图像与图像库中的A个人脸图像进行匹配,得到N个人脸图像,N小于Q,N小于A。上述图像库中的A个人脸图像可为预先录入系统的告警目标的人脸图像,即告警目标出现了,则可生成告警信息。进而,根据N个人脸图像生成N条告警信息,每一人脸图像可对应一条告警信息。Wherein, X video segments may include multiple frames of images. Of course, not every frame image includes a face image. Of course, some frames may also include multiple face images, and thus, each frame may be The image is segmented to obtain a P face image, and P is a positive integer. Of course, different image frames may also include a face image of the same person. Further, the P face image may be further combined to obtain a Q face image, and Q is a positive integer less than or equal to P. Further, the Q face image can be matched with the A face image in the image library to obtain an N face image, where N is smaller than Q and N is smaller than A. The A personal face image in the image library may be a face image of an alarm target that is pre-recorded into the system, that is, an alarm target appears, and an alarm information may be generated. Further, N pieces of alarm information are generated according to the N personal face image, and each face image can correspond to one piece of alarm information.
进一步地,上述步骤226中,将所述Q个人脸图像与图像库中的A个人脸图像进行匹配,可包含如下步骤:Further, in the above step 226, matching the Q personal face image with the A personal face image in the image library may include the following steps:
A1、对所述Q个人脸图像中每一人脸图像进行特征提取,得到所述Q个第一特征集;A1, performing feature extraction on each face image in the Q facial image to obtain the Q first feature sets;
A2、对所述A个人脸图像中每一人脸图像进行特征提取,得到所述A个第二特征集;A2, performing feature extraction on each face image in the A personal face image to obtain the A second feature set;
A3、将所述Q个第一特征集与所述A个第二特征集进行匹配,得到Q*A个匹配值;A3. Match the Q first feature sets with the A second feature sets to obtain Q*A matching values.
A4、从所述Q*A个匹配值中选取大于预设匹配阈值的特征值,得到所述N 个匹配值;A4. Select, from the Q*A matching values, a feature value that is greater than a preset matching threshold, to obtain the N matching values.
A5、从所述Q个人脸图像中获取与所述N个匹配值对应的人脸图像,得到所述N个人脸图像。A5. Obtain a face image corresponding to the N matching values from the Q face image to obtain the N face image.
其中,步骤A1中可Q个人脸图像进行特征提取,可得到Q个第一特征集,当然,特征提取的方式可包括但不仅限于:Harris角点检测算法、尺度不变特征(Scale Invariant Feature Transform,SIFT)提取算法、采用分类器进行特征提取,分类器可包括但不仅限于:支持向量机(Support Vector Machine,SVM)、卷积神经网络、级联神经网络、遗传算法等等。如此,也可以实现对A个人脸图像进行特征提取,以人脸图像i为例,其中,该人脸图像i为A个人脸图像中的任一个,可得到A个第二特征集,进而,可采用结构相似性(Structural Similarity Index Measurement,SSIM)将Q个第一特征集与A个第二特征集进行匹配,得到Q*A个匹配值。上述预设匹配阈值可由系统默认或者用户设备自行设置。因而,可从Q*A个匹配值中选取匹配值大于预设匹配阈值的匹配值,得到N个特征值,进而,可从Q个人脸图像中获取与N个匹配值对应的人脸图像,得到N个人脸图像。In the step A1, the Q face image can be extracted, and the Q first feature sets can be obtained. Of course, the feature extraction method can include, but is not limited to, a Harris corner detection algorithm and a scale invariant feature (Scale Invariant Feature Transform). , SIFT) extraction algorithm, using classifier for feature extraction, classifiers may include but are not limited to: Support Vector Machine (SVM), convolutional neural network, cascading neural network, genetic algorithm and so on. In this way, the feature extraction of the A personal face image can also be implemented, taking the face image i as an example, wherein the face image i is any one of the A personal face images, and a second feature set can be obtained. The Q first feature sets and the A second feature sets may be matched by using Structural Similarity Index Measurement (SSIM) to obtain Q*A matching values. The above preset matching threshold may be set by the system default or by the user equipment. Therefore, a matching value whose matching value is greater than a preset matching threshold value may be selected from the Q*A matching values to obtain N eigenvalues, and further, a face image corresponding to the N matching values may be obtained from the Q facial image. Get N face images.
103、根据所述当前任务状态为所述目标用户设备分配M条告警信息,所述N条告警信息包含所述M条告警信息,所述M为小于或等于所述N的整数。103. Allocate M pieces of alarm information to the target user equipment according to the current task status, where the N pieces of alarm information include the M pieces of alarm information, where the M is an integer less than or equal to the N.
其中,数据处理装置可根据当前任务状态为目标用户设备分配M条告警信息,当前环境下可能存在多个用户设备,因而,可不用将上述N条告警信息分配给一个用户设备,因而,可为目标用户设备分配M条告警信息,M为小于或等于N的整数。例如,当然,根据需要,当前待处理任务多的可以少分配告警信息,当然,也可以根据用户的位置进行分配,告警信息发生的位置与目标用户设备比较近,则可以优先该告警信息。The data processing device may allocate M pieces of alarm information to the target user equipment according to the current task status. There may be multiple user equipments in the current environment. Therefore, the N pieces of alarm information may not be allocated to one user equipment. The target user equipment allocates M pieces of alarm information, where M is an integer less than or equal to N. For example, the alarm information may be allocated less frequently according to the needs of the current task to be processed. Of course, the alarm information may be allocated according to the location of the user. If the location of the alarm information is close to the target user equipment, the alarm information may be prioritized.
可选地,上述步骤103中,根据所述当前任务状态为所述目标用户设备分配M条告警信息,可包括如下步骤:Optionally, in the foregoing step 103, allocating the M pieces of alarm information to the target user equipment according to the current task status may include the following steps:
31)、获取所述目标用户设备的位置;31) acquiring a location of the target user equipment;
32)、根据所述位置与所述当前任务状态为所述目标用户设备分配M条告警信息。32) Allocating M pieces of alarm information to the target user equipment according to the location and the current task status.
其中,数据处理装置可通过摄像头或者定位技术获取目标用户设备的位置,进而,根据该位置以及当前任务状态为用户设备分配M条告警信息,当然,用户设备当前待处理任务多则可以少分配。The data processing device can obtain the location of the target user equipment by using a camera or a positioning technology, and then allocates M pieces of alarm information to the user equipment according to the location and the current task status. Of course, the user equipment may have fewer tasks to be processed.
可以看出,通过本发明实施例,数据处理装置可获取目标用户设备的当前任务状态,获取N条告警信息,N为正整数,根据当前任务状态为目标用户设备分配M条告警信息,N条告警信息包含M条告警信息,M为小于或等于N的整数,从而,可获取用户设备的当前任务状态,如:待处理任务、已处理任务和超时未处理等,在其任务较多时,则可少为其分配告警信息,在其任务较 少时,则多为其分配告警信息,进而可实现对告警信息进行合理处理。It can be seen that, by using the embodiment of the present invention, the data processing device can obtain the current task status of the target user equipment, obtain N pieces of alarm information, and N is a positive integer, and allocate M pieces of alarm information to the target user equipment according to the current task status, N pieces. The alarm information includes M alarms, and M is an integer less than or equal to N. Therefore, the current task status of the user equipment can be obtained, such as: pending tasks, processed tasks, and timeout unprocessed. When there are many tasks, Alarm information can be allocated less for it. When there are fewer tasks, more alarm information is assigned to it, and the alarm information can be processed reasonably.
与上述一致地,请参阅图2,为本发明实施例提供的一种数据处理方法的第二实施例流程示意图。本实施例中所描述的数据处理方法,包括以下步骤:With reference to FIG. 2, it is a schematic flowchart of a second embodiment of a data processing method according to an embodiment of the present invention. The data processing method described in this embodiment includes the following steps:
201、视频处理装置获取目标用户设备的当前任务状态。201. The video processing device acquires a current task status of the target user equipment.
202、所述视频处理装置获取N条告警信息,所述N为正整数。202. The video processing device acquires N pieces of alarm information, where N is a positive integer.
203、所述视频处理装置根据所述当前任务状态为所述目标用户设备分配M条告警信息,所述N条告警信息包含所述M条告警信息,所述M为小于或等于所述N的整数。203. The video processing device allocates M pieces of alarm information to the target user equipment according to the current task status, where the N pieces of alarm information include the M pieces of alarm information, where the M is less than or equal to the N Integer.
可选地,上述步骤201-步骤203的具体描述可参见图1所描述的数据处理方法的步骤101-步骤103。Optionally, the specific description of the foregoing step 201 - step 203 can be referred to step 101 - step 103 of the data processing method described in FIG. 1 .
204、所述目标用户设备接收所述M条告警信息。204. The target user equipment receives the M pieces of alarm information.
205、所述目标用户设备获取当前位置。205. The target user equipment acquires a current location.
206、所述目标用户设备确定所述当前位置与所述M条告警信息对应的所述M个位置之间的距离,得到所述M个距离值;206. The target user equipment determines a distance between the current location and the M locations corresponding to the M pieces of alarm information, to obtain the M distance values.
207、所述目标用户设备根据所述M个距离值,在所述目标用户设备展示所述M条告警信息。207. The target user equipment displays the M pieces of alarm information on the target user equipment according to the M distance values.
可选的,用户可在目标用户设备上点击任务栏中的“报警统计”,可以展现当天所有的报警数据统计,包括:告警总数、误报、正常购物、盗窃截停、未找到人、超时未处理、待处理;点击每一栏信息,都可以显示相关告警信息的列表信息,让然,报警统计中所有栏目只有“待处理”事项可以操作,其他均只能查看。目标用户设备点击告警信息可以进入直接进入对应的页面,接收到信息的人员都可以对该信息进行处理,包括(误报、正常购物、截停、未发现人)同时也可以指派个该门店内的任何一个人来跟踪该事件,查询的话,由于用户设备是移动的,可提供当前位置旁边的摄像头的视频,如此,用户设备可根据视频进行相应查找告警信息中出现的目标。Optionally, the user can click “Alarm Statistics” in the task bar on the target user device to display all the alarm data statistics of the day, including: total number of alarms, false positives, normal shopping, theft stop, no finds, timeout Unprocessed, pending; click on each column of information, you can display the list of related alarm information, of course, all the columns in the alarm statistics can only be operated on the "pending" items, and others can only be viewed. The target user equipment clicks the alarm information to enter the corresponding page directly, and the person who receives the information can process the information, including (false positives, normal shopping, stop, undiscovered), and can also be assigned to the store. Any one of the people can track the event. If the user equipment is mobile, the video of the camera next to the current location can be provided. Thus, the user equipment can search for the target appearing in the alarm information according to the video.
可以看出,通过本发明实施例,数据处理装置可获取目标用户设备的当前任务状态,获取N条告警信息,N为正整数,根据当前任务状态为目标用户设备分配M条告警信息,N条告警信息包含M条告警信息,M为小于或等于N的整数,目标用户设备接收M条告警信息,获取当前位置,确定当前位置与M条告警信息对应的M个位置之间的距离,得到M个距离值,根据M个距离值,在目标用户设备展示M条告警信息。从而,可获取用户设备的当前任务状态,如:待处理任务、已处理任务和超时未处理等,在其任务较多时,则可少为其分配告警信息,在其任务较少时,则多为其分配告警信息,另外,用户设备可根据M个告警信息对应的位置与其之间的距离值,展示该M条告警信息,方便用户优先选择与之近的告警信息进行处理,进而可实现对告警信息进行合理处 理。It can be seen that, by using the embodiment of the present invention, the data processing device can obtain the current task status of the target user equipment, obtain N pieces of alarm information, and N is a positive integer, and allocate M pieces of alarm information to the target user equipment according to the current task status, N pieces. The alarm information includes M alarms. M is an integer less than or equal to N. The target user equipment receives M alarms, obtains the current location, and determines the distance between the current location and the M locations corresponding to the M alarms. The distance values are based on the M distance values, and M pieces of alarm information are displayed on the target user equipment. Therefore, the current task status of the user equipment can be obtained, such as: a task to be processed, a processed task, and a timeout unprocessed, etc., when there are many tasks, less alarm information can be allocated for it, and when there are fewer tasks, more The alarm information is allocated to the user equipment. In addition, the user equipment can display the M alarm information according to the position of the M alarm information and the distance between the M alarm information, so that the user can preferentially select the alarm information to be processed nearby, thereby implementing the The alarm information is processed reasonably.
与上述一致地,以下为实施上述数据处理方法的装置,具体如下:Consistent to the above, the following is an apparatus for implementing the above data processing method, as follows:
请参阅图3a,为本发明实施例提供的一种数据处理装置的第一实施例结构示意图。本实施例中所描述的数据处理装置,包括:第一获取单元301、第二获取单元302和分配单元303,具体如下:FIG. 3 is a schematic structural diagram of a first embodiment of a data processing apparatus according to an embodiment of the present invention. The data processing apparatus described in this embodiment includes: a first obtaining unit 301, a second obtaining unit 302, and an allocating unit 303, as follows:
第一获取单元301,用于获取目标用户设备的当前任务状态;The first obtaining unit 301 is configured to acquire a current task status of the target user equipment.
第二获取单元302,用于获取N条告警信息,所述N为正整数;The second obtaining unit 302 is configured to acquire N pieces of alarm information, where the N is a positive integer;
分配单元303,用于根据所述当前任务状态为所述目标用户设备分配M条告警信息,所述N条告警信息包含所述M条告警信息,所述M为小于或等于所述N的整数。The allocating unit 303 is configured to allocate M pieces of alarm information to the target user equipment according to the current task status, where the N pieces of alarm information include the M pieces of alarm information, where the M is an integer less than or equal to the N .
可选地,如图3b,图3b为图3a所描述的视频处理装置的第二获取单元302的具体细化结构,所述第二获取单元302可包括:第一获取模块3021和第一分析模块3022,具体如下:Optionally, as shown in FIG. 3b, FIG. 3b is a specific refinement structure of the second obtaining unit 302 of the video processing apparatus described in FIG. 3a, where the second obtaining unit 302 may include: a first obtaining module 3021 and a first analysis. Module 3022 is as follows:
第一获取模块3021,用于从X个摄像头获取视频,得到所述X个视频片段,每一所述摄像头对应一个所述视频片段,所述X为正整数;a first obtaining module 3021, configured to acquire video from the X cameras, to obtain the X video segments, each of the cameras corresponding to one of the video segments, where X is a positive integer;
第一分析模块3022,用于对所述X个视频片段进行行为分析,得到所述N条告警信息。The first analysis module 3022 is configured to perform behavior analysis on the X video segments to obtain the N pieces of alarm information.
可选地,如图3c,图3c为图3b所描述的视频处理装置的所述第一分析模块3022的具体细化结构,所述第一分析模块3022可包括:解析模块401、第二分析模块402和筛选模块403,具体如下:Optionally, as shown in FIG. 3c, FIG. 3c is a specific refinement structure of the first analysis module 3022 of the video processing device described in FIG. 3b, where the first analysis module 3022 may include: a parsing module 401, and a second analysis. The module 402 and the screening module 403 are as follows:
解析模块401,用于对X个视频片段进行解析,得到Y帧视频图像,所述Y为正整数;The parsing module 401 is configured to parse the X video segments to obtain a Y frame video image, where the Y is a positive integer;
第二分析模块402,用于对所述Y帧视频图像中的每一帧视频图像进行行为分析,得到Z个符合预设行为的视频图像,所述Z为正整数;The second analysis module 402 is configured to perform behavior analysis on each frame of the video image of the Y frame to obtain Z video images that meet preset behaviors, where the Z is a positive integer;
筛选模块403,用于对所述Z个视频图像进行筛选,得到N个视频图像,每一视频图像对应一条告警信息。The screening module 403 is configured to filter the Z video images to obtain N video images, and each video image corresponds to one alarm information.
可选地,如图3d,图3d为图3b所描述的视频处理装置的所述第一分析模块3022的具体细化结构,所述第一分析模块3022可包括:分割模块404、合并模块405、匹配模块406和生成模块407,具体如下:Optionally, as shown in FIG. 3d, FIG. 3d is a specific refinement structure of the first analysis module 3022 of the video processing device described in FIG. 3b, where the first analysis module 3022 may include a segmentation module 404 and a merge module 405. The matching module 406 and the generating module 407 are as follows:
分割模块404,用于对所述X个视频片段进行图像分割,得到P个人脸图像,所述P为正整数;a segmentation module 404, configured to perform image segmentation on the X video segments to obtain a P personal face image, where P is a positive integer;
合并模块405,用于对所述P个人脸图像进行合并,得到Q个人脸图像,所述Q为小于或等于所述P的正整数;The merging module 405 is configured to combine the P personal face images to obtain a Q personal face image, where the Q is a positive integer less than or equal to the P;
匹配模块406,用于将所述Q个人脸图像与图像库中的A个人脸图像进行匹配,得到所述N个人脸图像,所述A为正整数,所述N小于所述Q,所述N 小于所述A;The matching module 406 is configured to match the Q personal face image with the A personal face image in the image library to obtain the N personal face image, where A is a positive integer, and the N is smaller than the Q, N is less than the A;
生成模块407,用于根据所述N个人脸图像生成所述N条告警信息。The generating module 407 is configured to generate the N pieces of alarm information according to the N personal face image.
可选地,上述匹配模块406可包括如下模块:特征提取模块(图中未标出)、特征匹配模块(图中未标出)、特征值选取模块(图中未标出)和人脸获取模块(图中未标出),具体如下:Optionally, the matching module 406 may include the following modules: a feature extraction module (not shown), a feature matching module (not shown), a feature value selection module (not shown), and a face acquisition. Module (not shown), as follows:
特征提取模块,用于对所述Q个人脸图像中每一人脸图像进行特征提取,得到所述Q个第一特征集;a feature extraction module, configured to perform feature extraction on each face image in the Q personal face image to obtain the Q first feature sets;
所述特征提取模块,还用于对所述A个人脸图像中每一人脸图像进行特征提取,得到所述A个第二特征集;The feature extraction module is further configured to perform feature extraction on each face image in the A personal face image to obtain the A second feature set;
特征匹配模块,用于将所述Q个第一特征集与所述A个第二特征集进行匹配,得到Q*A个匹配值;a feature matching module, configured to match the Q first feature sets with the A second feature sets to obtain Q*A matching values;
特征值选取模块,用于从所述Q*A个匹配值中选取大于预设匹配阈值的特征值,得到所述N个匹配值;An eigenvalue selection module, configured to select, from the Q*A matching values, a feature value that is greater than a preset matching threshold, to obtain the N matching values;
人脸获取模块,用于从所述Q个人脸图像中获取与所述N个匹配值对应的人脸图像,得到所述N个人脸图像。a face acquisition module, configured to acquire a face image corresponding to the N matching values from the Q facial image to obtain the N personal face image.
可选地,如图3e,图3e为图3a所描述的视频处理装置的分配单元303的具体细化结构,所述分配单元303可包括:第二获取模块3031和分配模块3032,具体如下:Optionally, as shown in FIG. 3e, FIG. 3e is a specific refinement structure of the allocating unit 303 of the video processing apparatus described in FIG. 3a, where the allocating unit 303 may include: a second obtaining module 3031 and an allocating module 3032, as follows:
第二获取模块3031,用于获取所述目标用户设备的位置;The second obtaining module 3031 is configured to acquire a location of the target user equipment.
分配模块3032,用于根据所述位置与所述当前任务状态为所述目标用户设备分配M条告警信息。The allocating module 3032 is configured to allocate M pieces of alarm information to the target user equipment according to the location and the current task status.
可以看出,通过本发明实施例,数据处理装置可获取目标用户设备的当前任务状态,获取N条告警信息,N为正整数,根据当前任务状态为目标用户设备分配M条告警信息,N条告警信息包含M条告警信息,M为小于或等于N的整数,从而,可获取用户设备的当前任务状态,如:待处理任务、已处理任务和超时未处理等,在其任务较多时,则可少为其分配告警信息,在其任务较少时,则多为其分配告警信息,进而可实现对告警信息进行合理处理。It can be seen that, by using the embodiment of the present invention, the data processing device can obtain the current task status of the target user equipment, obtain N pieces of alarm information, and N is a positive integer, and allocate M pieces of alarm information to the target user equipment according to the current task status, N pieces. The alarm information includes M alarms, and M is an integer less than or equal to N. Therefore, the current task status of the user equipment can be obtained, such as: pending tasks, processed tasks, and timeout unprocessed. When there are many tasks, Alarm information can be allocated less for it. When there are fewer tasks, more alarm information is assigned to it, and the alarm information can be processed reasonably.
与上述一致地,请参阅图4,为本发明实施例提供的一种数据处理装置的第二实施例结构示意图。本实施例中所描述的数据处理装置,包括:至少一个输入设备1000;至少一个输出设备2000;至少一个处理器3000,例如CPU;和存储器4000,上述输入设备1000、输出设备2000、处理器3000和存储器4000通过总线5000连接。With reference to FIG. 4, it is a schematic structural diagram of a second embodiment of a data processing apparatus according to an embodiment of the present invention. The data processing apparatus described in this embodiment includes: at least one input device 1000; at least one output device 2000; at least one processor 3000, such as a CPU; and a memory 4000, the input device 1000, the output device 2000, and the processor 3000. And the memory 4000 is connected through the bus 5000.
其中,上述输入设备1000具体可为触控面板、物理按键或者鼠标。The input device 1000 may be a touch panel, a physical button, or a mouse.
上述输出设备2000具体可为显示屏。The output device 2000 described above may specifically be a display screen.
上述存储器4000可以是高速RAM存储器,也可为非易失存储器 (non-volatile memory),例如磁盘存储器。上述存储器4000用于存储一组程序代码,上述输入设备1000、输出设备2000和处理器3000用于调用存储器4000中存储的程序代码,执行如下操作:The above memory 4000 may be a high speed RAM memory or a non-volatile memory such as a magnetic disk memory. The above memory 4000 is used to store a set of program codes, and the input device 1000, the output device 2000, and the processor 3000 are used to call the program code stored in the memory 4000, and perform the following operations:
上述处理器3000,用于:The processor 3000 is configured to:
获取目标用户设备的当前任务状态;Obtain the current task status of the target user equipment;
获取N条告警信息,所述N为正整数;Obtaining N pieces of alarm information, where N is a positive integer;
根据所述当前任务状态为所述目标用户设备分配M条告警信息,所述N条告警信息包含所述M条告警信息,所述M为小于或等于所述N的整数。Assigning M pieces of alarm information to the target user equipment according to the current task status, where the N pieces of alarm information include the M pieces of alarm information, where the M is an integer less than or equal to the N.
可选地,上述处理器3000,获取N条告警信息,包括:Optionally, the processor 3000 obtains N pieces of alarm information, including:
从X个摄像头获取视频,得到所述X个视频片段,每一所述摄像头对应一个所述视频片段,所述X为正整数;Acquiring a video from the X cameras to obtain the X video segments, each of the cameras corresponding to one of the video segments, where X is a positive integer;
对所述X个视频片段进行行为分析,得到所述N条告警信息。Performing behavior analysis on the X video segments to obtain the N pieces of alarm information.
可选地,上述处理器3000,对所述X个视频片段进行行为分析,得到所述N条告警信息,包括:Optionally, the processor 3000 performs behavior analysis on the X video segments to obtain the N pieces of alarm information, including:
对X个视频片段进行解析,得到Y帧视频图像,所述Y为正整数;Parsing X video segments to obtain a Y frame video image, the Y being a positive integer;
对所述Y帧视频图像中的每一帧视频图像进行行为分析,得到Z个符合预设行为的视频图像,所述Z为正整数;Performing behavior analysis on each frame of the video image of the Y frame to obtain Z video images conforming to a preset behavior, where Z is a positive integer;
对所述Z个视频图像进行筛选,得到N个视频图像,每一视频图像对应一条告警信息。The Z video images are filtered to obtain N video images, and each video image corresponds to one alarm information.
可选地,上述处理器3000,对所述X个视频片段进行行为分析,得到所述N条告警信息,包括:Optionally, the processor 3000 performs behavior analysis on the X video segments to obtain the N pieces of alarm information, including:
对所述X个视频片段进行图像分割,得到P个人脸图像,所述P为正整数;Performing image segmentation on the X video segments to obtain a P personal face image, where P is a positive integer;
对所述P个人脸图像进行合并,得到Q个人脸图像,所述Q为小于或等于所述P的正整数;Combining the P face images to obtain a Q face image, wherein the Q is a positive integer less than or equal to the P;
将所述Q个人脸图像与图像库中的A个人脸图像进行匹配,得到所述N个人脸图像,所述A为正整数,所述N小于所述Q,所述N小于所述A;Matching the Q face image with the A face image in the image library to obtain the N face image, the A is a positive integer, the N is smaller than the Q, and the N is smaller than the A;
根据所述N个人脸图像生成所述N条告警信息。Generating the N pieces of alarm information according to the N human face image.
可选地,上述处理器3000,根据所述当前任务状态为所述目标用户设备分配M条告警信息,包括:Optionally, the processor 3000 is configured to allocate M pieces of alarm information to the target user equipment according to the current task status, including:
获取所述目标用户设备的位置;Obtaining a location of the target user equipment;
根据所述位置与所述当前任务状态为所述目标用户设备分配M条告警信息。And assigning M pieces of alarm information to the target user equipment according to the location and the current task status.
本发明实施例还提供一种计算机存储介质,其中,该计算机存储介质可存储有程序,该程序执行时包括上述方法实施例中记载的任何一种数据处理方法的部分或全部步骤。The embodiment of the present invention further provides a computer storage medium, wherein the computer storage medium can store a program, and the program includes some or all of the steps of any one of the data processing methods described in the foregoing method embodiments.
尽管在此结合各实施例对本发明进行了描述,然而,在实施所要求保护的本发明过程中,本领域技术人员通过查看所述附图、公开内容、以及所附权利要求书,可理解并实现所述公开实施例的其他变化。在权利要求中,“包括”(comprising)一词不排除其他组成部分或步骤,“一”或“一个”不排除多个的情况。单个处理器或其他单元可以实现权利要求中列举的若干项功能。相互不同的从属权利要求中记载了某些措施,但这并不表示这些措施不能组合起来产生良好的效果。Although the present invention has been described herein in connection with the embodiments of the present invention, it will be understood by those skilled in the <RTIgt; Other variations of the disclosed embodiments are achieved. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude a plurality. A single processor or other unit may fulfill several of the functions recited in the claims. Certain measures are recited in mutually different dependent claims, but this does not mean that the measures are not combined to produce a good effect.
本领域技术人员应明白,本发明的实施例可提供为方法、数据处理装置(设备)、或计算机程序产品。因此,本发明可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。计算机程序存储/分布在合适的介质中,与其它硬件一起提供或作为硬件的一部分,也可以采用其他分布形式,如通过Internet或其它有线或无线电信系统。Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, a data processing apparatus (device), or a computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code. The computer program is stored/distributed in a suitable medium, provided with other hardware or as part of the hardware, or in other distributed forms, such as over the Internet or other wired or wireless telecommunication systems.
本发明是参照本发明实施例的方法、数据处理装置(设备)和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present invention has been described with reference to flowchart illustrations and/or block diagrams of a method, a data processing apparatus (a device), and a computer program product of an embodiment of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
尽管结合具体特征及其实施例对本发明进行了描述,显而易见的,在不脱离本发明的精神和范围的情况下,可对其进行各种修改和组合。相应地,本说明书和附图仅仅是所附权利要求所界定的本发明的示例性说明,且视为已覆盖本发明范围内的任意和所有修改、变化、组合或等同物。显然,本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样,倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内,则本发明也意图包含这些改动和变型在内。While the invention has been described with respect to the specific embodiments and embodiments thereof, various modifications and combinations may be made without departing from the spirit and scope of the invention. Accordingly, the specification and drawings are to be construed as the It is apparent that those skilled in the art can make various modifications and variations to the invention without departing from the spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and modifications of the invention

Claims (11)

  1. 一种数据处理方法,其特征在于,包括:A data processing method, comprising:
    获取目标用户设备的当前任务状态;Obtain the current task status of the target user equipment;
    获取N条告警信息,所述N为正整数;Obtaining N pieces of alarm information, where N is a positive integer;
    根据所述当前任务状态为所述目标用户设备分配M条告警信息,所述N条告警信息包含所述M条告警信息,所述M为小于或等于所述N的整数。Assigning M pieces of alarm information to the target user equipment according to the current task status, where the N pieces of alarm information include the M pieces of alarm information, where the M is an integer less than or equal to the N.
  2. 根据权利要求1所述的方法,其特征在于,所述获取N条告警信息,包括:The method of claim 1, wherein the obtaining the N pieces of alarm information comprises:
    从X个摄像头获取视频,得到所述X个视频片段,每一所述摄像头对应一个所述视频片段,所述X为正整数;Acquiring a video from the X cameras to obtain the X video segments, each of the cameras corresponding to one of the video segments, where X is a positive integer;
    对所述X个视频片段进行行为分析,得到所述N条告警信息。Performing behavior analysis on the X video segments to obtain the N pieces of alarm information.
  3. 根据权利要求2所述的方法,其特征在于,所述对所述X个视频片段进行行为分析,得到所述N条告警信息,包括:The method according to claim 2, wherein the performing behavior analysis on the X video segments to obtain the N pieces of alarm information comprises:
    对X个视频片段进行解析,得到Y帧视频图像,所述Y为正整数;Parsing X video segments to obtain a Y frame video image, the Y being a positive integer;
    对所述Y帧视频图像中的每一帧视频图像进行行为分析,得到Z个符合预设行为的视频图像,所述Z为正整数;Performing behavior analysis on each frame of the video image of the Y frame to obtain Z video images conforming to a preset behavior, where Z is a positive integer;
    对所述Z个视频图像进行筛选,得到N个视频图像,每一视频图像对应一条告警信息。The Z video images are filtered to obtain N video images, and each video image corresponds to one alarm information.
  4. 根据权利要求2所述的方法,其特征在于,所述对所述X个视频片段进行行为分析,得到所述N条告警信息,包括:The method according to claim 2, wherein the performing behavior analysis on the X video segments to obtain the N pieces of alarm information comprises:
    对所述X个视频片段进行图像分割,得到P个人脸图像,所述P为正整数;Performing image segmentation on the X video segments to obtain a P personal face image, where P is a positive integer;
    对所述P个人脸图像进行合并,得到Q个人脸图像,所述Q为小于或等于所述P的正整数;Combining the P face images to obtain a Q face image, wherein the Q is a positive integer less than or equal to the P;
    将所述Q个人脸图像与图像库中的A个人脸图像进行匹配,得到所述N个人脸图像,所述A为正整数,所述N小于所述Q,所述N小于所述A;Matching the Q face image with the A face image in the image library to obtain the N face image, the A is a positive integer, the N is smaller than the Q, and the N is smaller than the A;
    根据所述N个人脸图像生成所述N条告警信息。Generating the N pieces of alarm information according to the N human face image.
  5. 根据权利要求1至4任一项所述的方法,其特征在于,所述根据所述当前任务状态为所述目标用户设备分配M条告警信息,包括:The method according to any one of claims 1 to 4, wherein the allocating M pieces of alarm information to the target user equipment according to the current task status comprises:
    获取所述目标用户设备的位置;Obtaining a location of the target user equipment;
    根据所述位置与所述当前任务状态为所述目标用户设备分配M条告警信息。And assigning M pieces of alarm information to the target user equipment according to the location and the current task status.
  6. 一种数据处理装置,其特征在于,包括:A data processing device, comprising:
    第一获取单元,用于获取目标用户设备的当前任务状态;a first acquiring unit, configured to acquire a current task state of the target user equipment;
    第二获取单元,用于获取N条告警信息,所述N为正整数;a second acquiring unit, configured to acquire N pieces of alarm information, where the N is a positive integer;
    分配单元,用于根据所述当前任务状态为所述目标用户设备分配M条告警 信息,所述N条告警信息包含所述M条告警信息,所述M为小于或等于所述N的整数。And an allocating unit, configured to allocate M pieces of alarm information to the target user equipment according to the current task status, where the N pieces of alarm information include the M pieces of alarm information, where the M is an integer less than or equal to the N.
  7. 根据权利要求6所述的装置,其特征在于,所述第二获取单元包括:The apparatus according to claim 6, wherein the second obtaining unit comprises:
    第一获取模块,用于从X个摄像头获取视频,得到所述X个视频片段,每一所述摄像头对应一个所述视频片段,所述X为正整数;a first acquiring module, configured to acquire video from the X cameras, to obtain the X video segments, each of the cameras corresponding to one of the video segments, where X is a positive integer;
    第一分析模块,用于对所述X个视频片段进行行为分析,得到所述N条告警信息。The first analysis module is configured to perform behavior analysis on the X video segments to obtain the N pieces of alarm information.
  8. 根据权利要求7所述的装置,其特征在于,所述第一分析模块包括:The apparatus according to claim 7, wherein the first analysis module comprises:
    解析模块,用于对X个视频片段进行解析,得到Y帧视频图像,所述Y为正整数;a parsing module, configured to parse the X video segments to obtain a Y frame video image, where the Y is a positive integer;
    第二分析模块,用于对所述Y帧视频图像中的每一帧视频图像进行行为分析,得到Z个符合预设行为的视频图像,所述Z为正整数;a second analysis module, configured to perform behavior analysis on each frame of the video image of the Y frame to obtain Z video images that conform to a preset behavior, where the Z is a positive integer;
    筛选模块,用于对所述Z个视频图像进行筛选,得到N个视频图像,每一视频图像对应一条告警信息。The screening module is configured to filter the Z video images to obtain N video images, and each video image corresponds to one alarm information.
  9. 根据权利要求7所述的装置,其特征在于,所述第一分析模块包括:The apparatus according to claim 7, wherein the first analysis module comprises:
    分割模块,用于对所述X个视频片段进行图像分割,得到P个人脸图像,所述P为正整数;a segmentation module, configured to perform image segmentation on the X video segments to obtain a P personal face image, where P is a positive integer;
    合并模块,用于对所述P个人脸图像进行合并,得到Q个人脸图像,所述Q为小于或等于所述P的正整数;a merging module, configured to merge the P personal face images to obtain a Q personal face image, where the Q is a positive integer less than or equal to the P;
    匹配模块,用于将所述Q个人脸图像与图像库中的A个人脸图像进行匹配,得到所述N个人脸图像,所述A为正整数,所述N小于所述Q,所述N小于所述A;a matching module, configured to match the Q facial image with an A facial image in the image library to obtain the N facial image, wherein the A is a positive integer, and the N is smaller than the Q, the N Less than the A;
    生成模块,用于根据所述N个人脸图像生成所述N条告警信息。And a generating module, configured to generate the N pieces of alarm information according to the N personal face image.
  10. 一种数据处理装置,其特征在于,所述数据处理装置包括处理器,所述处理器用于执行存储器中存储器的计算机程序时实现如权利要求1至5中任一项所述的数据处理方法。A data processing apparatus, comprising: a processor, wherein the processor is configured to implement the data processing method according to any one of claims 1 to 5 when the computer program of the memory in the memory is executed.
  11. 一种计算机可读存储介质,存储有计算机程序,所述计算机程序被处理器执行以实现如权利要求1至5中任一项所述的数据处理方法。A computer readable storage medium storing a computer program, the computer program being executed by a processor to implement the data processing method according to any one of claims 1 to 5.
PCT/CN2018/078632 2017-05-18 2018-03-09 Data processing method, data processing device, and storage medium WO2018210039A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710351934.3 2017-05-18
CN201710351934.3A CN107301373B (en) 2017-05-18 2017-05-18 Data processing method, device and storage medium

Publications (1)

Publication Number Publication Date
WO2018210039A1 true WO2018210039A1 (en) 2018-11-22

Family

ID=60138092

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/078632 WO2018210039A1 (en) 2017-05-18 2018-03-09 Data processing method, data processing device, and storage medium

Country Status (2)

Country Link
CN (1) CN107301373B (en)
WO (1) WO2018210039A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113051975A (en) * 2019-12-27 2021-06-29 深圳云天励飞技术有限公司 People flow statistical method and related product
CN113179423A (en) * 2021-04-23 2021-07-27 深圳市商汤科技有限公司 Event detection output method and device, electronic equipment and storage medium

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107301373B (en) * 2017-05-18 2018-03-27 深圳云天励飞技术有限公司 Data processing method, device and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020064314A1 (en) * 2000-09-08 2002-05-30 Dorin Comaniciu Adaptive resolution system and method for providing efficient low bit rate transmission of image data for distributed applications
CN102103609A (en) * 2009-12-21 2011-06-22 北京中星微电子有限公司 Information retrieval method and system
CN106127106A (en) * 2016-06-13 2016-11-16 东软集团股份有限公司 Target person lookup method and device in video
CN106408164A (en) * 2016-08-30 2017-02-15 长威信息科技发展股份有限公司 Police resource scheduling method and system
CN107301373A (en) * 2017-05-18 2017-10-27 深圳云天励飞技术有限公司 Data processing method, device and storage medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6292098B1 (en) * 1998-08-31 2001-09-18 Hitachi, Ltd. Surveillance system and network system
CN101547410A (en) * 2008-03-24 2009-09-30 华为技术有限公司 Method and device for transmitting alarm information
CN102136924A (en) * 2010-01-27 2011-07-27 新奥特(北京)视频技术有限公司 Alarming information filtering and delivery processing method and server
CN104537796B (en) * 2014-12-17 2018-04-06 广东协安机电工程有限公司 A kind of warning information processing system and processing method
CN106412491A (en) * 2015-07-30 2017-02-15 中兴通讯股份有限公司 Video monitoring method, apparatus and system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020064314A1 (en) * 2000-09-08 2002-05-30 Dorin Comaniciu Adaptive resolution system and method for providing efficient low bit rate transmission of image data for distributed applications
CN102103609A (en) * 2009-12-21 2011-06-22 北京中星微电子有限公司 Information retrieval method and system
CN106127106A (en) * 2016-06-13 2016-11-16 东软集团股份有限公司 Target person lookup method and device in video
CN106408164A (en) * 2016-08-30 2017-02-15 长威信息科技发展股份有限公司 Police resource scheduling method and system
CN107301373A (en) * 2017-05-18 2017-10-27 深圳云天励飞技术有限公司 Data processing method, device and storage medium

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113051975A (en) * 2019-12-27 2021-06-29 深圳云天励飞技术有限公司 People flow statistical method and related product
CN113051975B (en) * 2019-12-27 2024-04-02 深圳云天励飞技术有限公司 People flow statistics method and related products
CN113179423A (en) * 2021-04-23 2021-07-27 深圳市商汤科技有限公司 Event detection output method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN107301373A (en) 2017-10-27
CN107301373B (en) 2018-03-27

Similar Documents

Publication Publication Date Title
AU2017204181B2 (en) Video camera scene translation
WO2018113523A1 (en) Image processing method and device, and storage medium
WO2018210047A1 (en) Data processing method, data processing apparatus, electronic device and storage medium
US11295139B2 (en) Human presence detection in edge devices
CN109766779B (en) Loitering person identification method and related product
CN109815843B (en) Image processing method and related product
US10009579B2 (en) Method and system for counting people using depth sensor
EP3704864B1 (en) Methods and systems for generating video synopsis
Zabłocki et al. Intelligent video surveillance systems for public spaces–a survey
CN109740444B (en) People flow information display method and related product
Ha et al. Foreground objects detection using multiple difference images
JP2018160219A (en) Moving route prediction device and method for predicting moving route
CN109815839B (en) Loitering person identification method under micro-service architecture and related product
WO2020056914A1 (en) Crowd heat map obtaining method and apparatus, and electronic device and readable storage medium
WO2018210039A1 (en) Data processing method, data processing device, and storage medium
CN109840885B (en) Image fusion method and related product
JP2019160310A (en) On-demand visual analysis focalized on salient events
RU2713876C1 (en) Method and system for detecting alarm events when interacting with self-service device
JP2010015469A (en) Still area detection method, and apparatus, program and recording medium therefor
CN114743157B (en) Pedestrian monitoring method, device, equipment and medium based on video
CN109816628B (en) Face evaluation method and related product
CN107316011B (en) Data processing method, device and storage medium
CN111310595B (en) Method and device for generating information
Zhou et al. Rapid and robust traffic accident detection based on orientation map
Solmaz Video-based detection of abnormal activities in crowd using a combination of motion-based features

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18801289

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18801289

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 16/03/2020)

122 Ep: pct application non-entry in european phase

Ref document number: 18801289

Country of ref document: EP

Kind code of ref document: A1