CN116311020A - Video data processing method, system, electronic device and storage medium - Google Patents
Video data processing method, system, electronic device and storage medium Download PDFInfo
- Publication number
- CN116311020A CN116311020A CN202211564271.0A CN202211564271A CN116311020A CN 116311020 A CN116311020 A CN 116311020A CN 202211564271 A CN202211564271 A CN 202211564271A CN 116311020 A CN116311020 A CN 116311020A
- Authority
- CN
- China
- Prior art keywords
- face
- distribution image
- video data
- information
- regional
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims description 8
- 238000003860 storage Methods 0.000 title claims description 8
- 238000009826 distribution Methods 0.000 claims abstract description 148
- 238000012545 processing Methods 0.000 claims abstract description 33
- 238000000034 method Methods 0.000 claims abstract description 29
- 230000011218 segmentation Effects 0.000 claims description 42
- 239000011159 matrix material Substances 0.000 claims description 35
- 238000004590 computer program Methods 0.000 claims description 9
- 230000001815 facial effect Effects 0.000 claims description 6
- 210000000056 organ Anatomy 0.000 claims description 5
- 210000000887 face Anatomy 0.000 description 18
- 238000010586 diagram Methods 0.000 description 10
- 238000012544 monitoring process Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000000605 extraction Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012946 outsourcing Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
- G06V20/53—Recognition of crowd images, e.g. recognition of crowd congestion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/26—Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- Business, Economics & Management (AREA)
- Strategic Management (AREA)
- Human Resources & Organizations (AREA)
- Entrepreneurship & Innovation (AREA)
- Computational Linguistics (AREA)
- Economics (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Data Mining & Analysis (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Image Analysis (AREA)
Abstract
The embodiment of the invention provides a method and a system for processing video data, wherein the method comprises the following steps: acquiring video data to be processed, wherein the video data comprises various regional ranges; identifying at least one face distribution image from the video data, wherein the face distribution image corresponds to one or more regional ranges; counting the absenteeism information corresponding to each regional scope according to at least one face distribution image and the regional distribution image aiming at each regional scope; and displaying the absenteeism information. According to the embodiment of the invention, the face distribution image is obtained by identifying the video data, and the absenteeism information is obtained by combining regional distribution image statistics, so that the manual statistics of the absenteeism condition of a study room is avoided, the difficulty of statistics of the absenteeism information is reduced, and the statistics efficiency and accuracy of the absenteeism information are improved.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a video data processing method, a video data processing system, an electronic device, and a computer readable storage medium.
Background
In indoor environments such as a study room, a meeting room and the like, if the absences of students or participants need to be counted, manual statistics is often only relied on. Even with the aid of infrared sensors or the like, only the number of attendance missing can be counted.
However, students or participants are not always in the seat, and may leave the seat or even leave the study room or conference room. If the absences are counted by manpower, the counted absences information is inaccurate, and the counting difficulty is relatively high.
Disclosure of Invention
In view of the foregoing, embodiments of the present invention are directed to providing a method for processing video data and a corresponding system for processing service data, which overcome or at least partially solve the foregoing problems.
In order to solve the above problems, an embodiment of the present invention discloses a method for processing video data, which includes: acquiring video data to be processed, wherein the video data comprises various regional ranges; identifying at least one face distribution image from the video data, wherein the face distribution image corresponds to one or more regional ranges; counting the absenteeism information corresponding to each regional scope according to at least one face distribution image and the regional distribution image aiming at each regional scope; and displaying the absenteeism information.
Optionally, the identifying at least one face distribution image from the video data includes: extracting a plurality of video frame images from the video data according to a preset period; and identifying at least one face distribution image from the plurality of video frame images according to the corresponding relation between the faces in the plurality of video frame images and the area ranges.
Optionally, the identifying at least one face distribution image from the plurality of video frame images includes: recognizing a face distribution image containing a plurality of face segmentation parameters from a plurality of video frame images; wherein the face segmentation parameters correspond to facial organs.
Optionally, the identifying a face distribution image including a plurality of face segmentation parameters from a plurality of video frame images includes: acquiring face segmentation parameters of each of two adjacent video frame images; and if the face segmentation parameters of the two adjacent video frame images respectively meet the parameter requirements corresponding to the two adjacent video frame images respectively, generating the face distribution image according to the matrix coordinate information of the face segmentation parameters and the video frame images.
Optionally, the statistics of the absences information corresponding to each of the regional ranges according to at least one of the face distribution images and the regional distribution image for each of the regional ranges includes: comparing at least one face distribution image with the region distribution image to obtain result data; and determining the absenteeism information within a preset time period according to the result data.
Optionally, the face distribution image includes face matrix coordinate information of at least one face, and the area distribution image includes area matrix coordinate information of each area range; the comparing at least one face distribution image with the region distribution image to obtain result data includes: according to the face matrix coordinate information and the area matrix coordinate information, matching each face in each area range to obtain a corresponding first area range; and taking a second area range except the first area range in each area range as the result data.
Optionally, the determining the absenteeism information in a preset time period according to the result data includes: and if the same second area range continuously appears in the preset time period, taking the identity information associated with the second area range and the continuous appearing times as the absenteeism information.
The embodiment of the invention also discloses a processing system of the video data, which comprises: the video acquisition module is used for acquiring video data to be processed, wherein the video data comprises various regional ranges; the image recognition module is used for recognizing at least one face distribution image from the video data, and the face distribution image corresponds to one or more regional ranges; the information statistics module is used for counting the absenteeism information corresponding to each regional range according to at least one face distribution image and the regional distribution image aiming at each regional range; and the information display module is used for displaying the absenteeism information.
Optionally, the image recognition module includes: the video frame image extraction module is used for extracting a plurality of video frame images from the video data according to a preset period; and the face distribution image recognition module is used for recognizing at least one face distribution image from the plurality of video frame images according to the corresponding relation between the faces in the plurality of video frame images and the area ranges.
Optionally, the face distribution image recognition module is configured to recognize a face distribution image including a plurality of face segmentation parameters from a plurality of video frame images; wherein the face segmentation parameters correspond to facial organs.
Optionally, the face distribution image recognition module includes: the face segmentation parameter identification module is used for acquiring face segmentation parameters of each of two adjacent video frame images; and the face distribution image generation module is used for generating the face distribution image according to the matrix coordinate information of the face segmentation parameters and the video frame images if the face segmentation parameters of the two adjacent video frame images respectively meet the parameter requirements corresponding to the two adjacent video frame images respectively.
Optionally, the information statistics module includes: the distribution image comparison module is used for comparing at least one face distribution image with the region distribution image to obtain result data; and the absenteeism information statistics module is used for determining the absenteeism information in a preset time period according to the result data.
Optionally, the face distribution image includes face matrix coordinate information of at least one face, and the area distribution image includes area matrix coordinate information of each area range; the distributed image comparison module comprises: the region range matching module is used for matching each face in each region range according to the face matrix coordinate information and the region matrix coordinate information to obtain a corresponding first region range; and a result data determining module, configured to use, as the result data, a second area range other than the first area range in each of the area ranges.
Optionally, the absenteeism information statistics module is configured to use, if the same second area range continuously appears in the preset time period, identity information associated with the second area range and the number of times of continuous appearance as the absenteeism information.
The embodiment of the invention also discloses an electronic device, which comprises: one or more processors; and one or more machine readable media having instructions stored thereon that, when executed by the one or more processors, cause the electronic device to perform the method of processing video data as described above.
The embodiment of the invention also discloses a computer readable storage medium, which stores a computer program for causing a processor to execute the video data processing method.
The embodiment of the invention has the following advantages:
according to the processing scheme of the video data, the video data containing each area range is obtained, at least one face distribution image is obtained from the video data in a recognition mode, the face distribution image corresponds to one or more area ranges, and the absenteeism information corresponding to each area range is counted according to the at least one face distribution image and the area distribution image aiming at each area range, so that the absenteeism information is displayed.
The embodiment of the invention can acquire the video data of the study room under the scene of being applied to statistics of the absenteeism information of the study room, and the video data can comprise the regional range of each seat in the study room. Face recognition is carried out on the video data to obtain face distribution images, the face distribution images correspond to the area ranges of one or more seats, and the area distribution images of the study room are combined for statistics to obtain the absenteeism information corresponding to the area ranges of the seats, so that the absenteeism information is displayed. According to the embodiment of the invention, the face distribution image is obtained by identifying the video data, and the absenteeism information is obtained by combining regional distribution image statistics, so that the manual statistics of the absenteeism condition of a study room is avoided, the difficulty of statistics of the absenteeism information is reduced, and the statistics efficiency and accuracy of the absenteeism information are improved.
Drawings
Fig. 1 is a flowchart showing steps of a method for processing video data according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a system framework of a monitoring scheme for student absences in a study room according to an embodiment of the present invention;
fig. 3 is a block diagram of a video data processing system according to an embodiment of the present invention.
Detailed Description
In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of the invention will be rendered by reference to the appended drawings and appended detailed description.
The embodiment of the invention can collect video data of indoor environments such as a study room, a conference room and the like. The video data may include seats of a study room, a conference room, etc., and in particular, the video data may include a regional range of seats of a study room, a conference room, etc. And then, recognizing a face distribution image from the video data, and comparing the face distribution image with the regional distribution images of the study room and the conference room to obtain the absent information of the regional range of each seat, so as to display the absent information.
Referring to fig. 1, a flowchart of steps of a method for processing video data according to an embodiment of the present invention is shown. The processing method of the video data specifically comprises the following steps:
In an embodiment of the invention, the video data may originate from a video acquisition device. The video data may contain various area ranges in the environment being photographed. If the video data is the video data of the study room, the video acquisition device can be configured in the study room so as to capture the video data of the whole study room by using the video acquisition device, and the video data can be ensured to contain the regional range of each seat of the whole study room.
In the embodiment of the invention, the face distribution image can be identified from a plurality of video frame images of video data. The face distribution image may correspond to one or more regional areas. The face distribution image may include faces corresponding to one or more regional ranges. The face distribution image may represent whether one or more regional areas have corresponding faces.
And step 103, counting the absences corresponding to each area range according to at least one face distribution image and the area distribution image aiming at each area range.
In the embodiment of the present invention, the area distribution image may represent a face corresponding to an area range of each seat of the study room, the conference room, etc., or the area distribution image may represent that the area range of each seat of the study room, the conference room, etc. should have a face. In practical application, the face distribution image is compared with the area distribution image, so that whether faces appear in each area range can be determined, and further the absenteeism information of each area range is obtained through statistics.
In the embodiment of the invention, the absenteeism information of the study room and the conference room can be displayed to the display terminal.
According to the processing scheme of the video data, the video data containing each area range is obtained, at least one face distribution image is obtained from the video data in a recognition mode, the face distribution image corresponds to one or more area ranges, and the absenteeism information corresponding to each area range is counted according to the at least one face distribution image and the area distribution image aiming at each area range, so that the absenteeism information is displayed.
The embodiment of the invention can acquire the video data of the study room under the scene of being applied to statistics of the absenteeism information of the study room, and the video data can comprise the regional range of each seat in the study room. Face recognition is carried out on the video data to obtain face distribution images, the face distribution images correspond to the area ranges of one or more seats, and the area distribution images of the study room are combined for statistics to obtain the absenteeism information corresponding to the area ranges of the seats, so that the absenteeism information is displayed. According to the embodiment of the invention, the face distribution image is obtained by identifying the video data, and the absenteeism information is obtained by combining regional distribution image statistics, so that the manual statistics of the absenteeism condition of a study room is avoided, the difficulty of statistics of the absenteeism information is reduced, and the statistics efficiency and accuracy of the absenteeism information are improved.
In an exemplary embodiment of the present invention, one implementation of identifying at least one face distribution image from video data is to extract a plurality of video frame images from the video data according to a preset period; and identifying at least one face distribution image from the plurality of video frame images according to the corresponding relation between the faces in the plurality of video frame images and each region range. In practical application, the preset period may be set to 1 minute, 5 minutes, etc., and the numerical value, unit, etc. of the preset period are not particularly limited in the embodiment of the present invention. The face distribution image can be identified from the video frame image based on the existing face recognition algorithm or face recognition model. The embodiment of the invention does not limit the content, the structure and the like of the face recognition algorithm or the face recognition model in particular.
Because the video data can be understood to consist of the continuous video frame images, in the embodiment of the invention, the video frame images can be extracted from the video data according to actual conditions, and then the face distribution images can be identified from the video frame images. If a plurality of face distribution images are required to be identified in a short time, the preset period can be set to be shorter, so that the follow-up statistics of the absences information can be ensured to be obtained in a short time, and the statistics efficiency of the absences information is improved.
In an exemplary embodiment of the present invention, an implementation of identifying at least one face distribution image from a plurality of video frame images is identifying a face distribution image from a plurality of video frame images that includes a plurality of face segmentation parameters. Wherein the face segmentation parameters may correspond to facial organs. For example, the face segmentation parameters may be eyes, nose, ears, mouth, etc. Moreover, the face segmentation parameters may be further divided into left eye, right eye, left ear, right ear, nose, mouth, etc.
In the embodiment of the invention, the front face of the face in the face distribution image can face the camera of the video acquisition terminal, and the front face of the face in the face distribution image can also form an angle of 90 degrees with the camera. The face segmentation parameters can be identified from the front face of the face facing the camera to the angle of 90 degrees with the camera. Generally, the more face segmentation parameters are identified, the better the face distribution image representing effect is; the fewer face segmentation parameters are identified, the worse the effect of representing the face distribution image. Therefore, in order to obtain a face distribution image with a good effect, the face segmentation parameters are recognized as much as possible.
In an exemplary embodiment of the present invention, an implementation manner of identifying a face distribution image including a plurality of face segmentation parameters from a plurality of video frame images is to obtain face segmentation parameters of each of two adjacent video frame images; and if the face segmentation parameters of the two adjacent video frame images respectively meet the parameter requirements corresponding to the two adjacent video frame images respectively, generating a face distribution image according to the matrix coordinate information of the face segmentation parameters and the video frame images. Wherein different video frame images may correspond to the same or different parameter requirements. For example, two adjacent video frame images are a video frame image a and a video frame image b, respectively. The parameter requirement Y1 for the video frame image a is that the face corresponding to the same seat in the video frame image has at least three face segmentation parameters of left eye, right eye and nose. The parameter requirement Y2 for the video frame image b is that the face corresponding to the same seat in the video frame image has at least three face segmentation parameters of left ear, right ear and mouth. When the video frame image a meets the parameter requirement Y1 and the video frame image b meets the parameter requirement Y2, the face distribution image can be generated according to the matrix coordinate information of the three face segmentation parameters of the video frame image a and the left eye, the right eye and the nose, or the face distribution image can be generated according to the matrix coordinate information of the three face segmentation parameters of the video frame image b and the left ear, the right ear and the mouth, or the face distribution image can be generated according to the matrix coordinate information of the six face segmentation parameters of the video frame image a, the video frame image b and the left eye, the right eye, the nose, the left ear, the right ear and the mouth.
In the embodiment of the invention, the faces in the learning state or the class listening state can be identified by judging whether the face segmentation parameters in two adjacent video frames meet the parameter requirements, namely the faces in the face distribution image belong to the faces in the learning state or the class listening state, and the image containing the faces outside the learning state or the class listening state is not taken as an effective face distribution image, so that the interference of the faces outside the learning state or the class listening state on the absenteeism information statistics is eliminated, and the accuracy of the absenteeism information statistics is improved.
In an exemplary embodiment of the present invention, according to one implementation manner of counting absences corresponding to each area range according to at least one face distribution image and an area distribution image corresponding to each area range, comparing at least one face distribution image with the area distribution image to obtain result data; and determining the absenteeism information within a preset time period according to the result data. The face distribution image may include face matrix coordinate information of at least one face. The area distribution image may contain area matrix coordinate information of each area range. For example, the face distribution image Rf1 includes 5 faces and face matrix coordinate information of each of the 5 faces. The face matrix coordinate information may be coordinate values with the upper left corner of the face distribution image as the origin of coordinates. The coordinate values may be the abscissa and ordinate values of the minimum bounding rectangle of the face. The area distribution image Wf contains area matrix coordinate information of 10 area ranges and 10 area ranges. The region matrix coordinate information may be coordinate values with the upper left corner of the region distribution image as the origin of coordinates. The coordinate values may be the abscissa and ordinate values of the minimum bounding rectangle of the region range. In practical application, when at least one face distribution image is compared with an area distribution image to obtain result data, a corresponding first area range can be obtained for each face in each area range according to the face matrix coordinate information and the area matrix coordinate information; and taking a second area range except the first area range in each area range as result data. For example, the face matrix coordinate information of the face F1 corresponds to the region matrix coordinate information of the seat S1, that is, a region where the minimum outsourcing rectangle of the face F1 coincides with the minimum outsourcing rectangle of the seat S1 exists, and then the seat S1 is the first region range corresponding to the face F1. If the seats share S1, S2 and S3, the area range of the seat S2 and the area range of the seat S3 other than the area range of the seat S1 are taken as the second area range, that is, the result data is the area range of the seat S2 and the area range of the seat S3.
In an exemplary embodiment of the present invention, one implementation of determining the absenteeism information within the preset time period according to the result data is that if the same second area range continuously appears within the preset time period, the identity information associated with the second area range and the number of continuous occurrences are taken as the absenteeism information. For example, the preset time period may be 10 minutes or 20 minutes, or the like. If the second area range S2 appears continuously for 5 times within 10 minutes, the identity information (such as the name, the number, etc. of the student user 02) associated with the second area range S2 and 5 times may be regarded as the absenteeism information of the second location S2.
In the embodiment of the invention, if a certain area range continuously lacks corresponding faces for many times, the area range is considered to have the absenteeism condition, and then the identity information and the absenteeism times of the faces corresponding to the area range are used as the absenteeism information. When the absent condition exists in a plurality of area ranges, the absent information can be displayed in descending order according to the corresponding absent times, so that the severity of the absent condition is highlighted, and the importance degree of the absent information is improved.
Based on the above description about an embodiment of a video data processing method, a solution for monitoring absences of students in a study room is described below. Referring to fig. 2, a schematic diagram of a system framework of a monitoring scheme for student absences in a study room according to an embodiment of the present invention is shown. The technical scheme for monitoring the absence of students in a study room can relate to a video acquisition terminal, a video display terminal, a video processing terminal and a video processing server. The video processing terminal is respectively in communication connection with the video acquisition terminal, the video display terminal and the video processing server.
And creating a monitoring rule of a certain study room by using the video processing terminal and importing the regional distribution image. The monitoring rules may include, but are not limited to: the period of the face distribution image is identified (e.g., 1 minute), and the minimum number of consecutive times the student is not sitting, i.e., the minimum number of consecutive times the seat does not have a corresponding face (e.g., 10 times). The region distribution image may include a face corresponding to each seat in the study and region matrix coordinate information of each seat.
And acquiring video data of the study room by using the video acquisition terminal, and transmitting the video data to the video processing terminal. And intercepting video frame images from the video data according to a period (such as 1 minute) by using the video processing terminal, and transmitting the video frame images to the video processing server. And carrying out face recognition on the video frame images by using the video processing server to obtain face distribution images, and transmitting the face distribution images to the video processing terminal. And comparing the facial distribution image with the regional distribution image to obtain seats with faces and seats without faces. If no face exists in the continuous 10-time comparison of a certain seat, identity information such as student names corresponding to the seat is transmitted to the video display terminal. The video display terminal may display the identity information. If no face exists in a certain seat for 5 continuous comparisons, and the face exists in the 6 th comparison, the comparison times of the seat are reset to zero. When the video display terminal displays the identity information, the video display terminal can be arranged and displayed in descending order according to the times of absence of students corresponding to the identity information.
It should be noted that, for simplicity of description, the method embodiments are shown as a series of acts, but it should be understood by those skilled in the art that the embodiments are not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred embodiments, and that the acts are not necessarily required by the embodiments of the invention.
Referring to fig. 3, a block diagram of a video data processing system according to an embodiment of the present invention is shown, where the video data processing system may specifically include the following modules.
A video acquisition module 31, configured to acquire video data to be processed, where the video data includes each area range;
an image recognition module 32, configured to recognize at least one face distribution image from the video data, where the face distribution image corresponds to one or more of the area ranges;
an information statistics module 33, configured to count absences information corresponding to each of the area ranges according to at least one of the face distribution images and an area distribution image for each of the area ranges;
and the information display module 34 is used for displaying the absenteeism information.
In an exemplary embodiment of the present invention, the image recognition module 32 includes:
the video frame image extraction module is used for extracting a plurality of video frame images from the video data according to a preset period;
and the face distribution image recognition module is used for recognizing at least one face distribution image from the plurality of video frame images according to the corresponding relation between the faces in the plurality of video frame images and the area ranges.
In an exemplary embodiment of the present invention, the face distribution image recognition module is configured to recognize a face distribution image including a plurality of face segmentation parameters from a plurality of video frame images;
wherein the face segmentation parameters correspond to facial organs.
In an exemplary embodiment of the present invention, the face distribution image recognition module includes:
the face segmentation parameter identification module is used for acquiring face segmentation parameters of each of two adjacent video frame images;
and the face distribution image generation module is used for generating the face distribution image according to the matrix coordinate information of the face segmentation parameters and the video frame images if the face segmentation parameters of the two adjacent video frame images respectively meet the parameter requirements corresponding to the two adjacent video frame images respectively.
In an exemplary embodiment of the present invention, the information statistics module 33 includes:
the distribution image comparison module is used for comparing at least one face distribution image with the region distribution image to obtain result data;
and the absenteeism information statistics module is used for determining the absenteeism information in a preset time period according to the result data.
In an exemplary embodiment of the present invention, the face distribution image includes face matrix coordinate information of at least one face, and the area distribution image includes area matrix coordinate information of each of the area ranges;
the distributed image comparison module comprises:
the region range matching module is used for matching each face in each region range according to the face matrix coordinate information and the region matrix coordinate information to obtain a corresponding first region range;
and a result data determining module, configured to use, as the result data, a second area range other than the first area range in each of the area ranges.
In an exemplary embodiment of the present invention, the absenteeism information statistics module is configured to, if the same second area range continuously appears in the preset period of time, use identity information associated with the second area range and a number of times of continuous appearance as the absenteeism information.
For system embodiments, the description is relatively simple as it is substantially similar to method embodiments, and reference is made to the description of method embodiments for relevant points. In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described by differences from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other.
It will be apparent to those skilled in the art that embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the invention may take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or terminal device comprising the element.
The above description of the video data processing method and the service data processing system provided by the present invention applies specific examples to illustrate the principles and embodiments of the present invention, and the above description of the examples is only used to help understand the method and the core idea of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.
Claims (10)
1. A method of processing video data, the method comprising:
acquiring video data to be processed, wherein the video data comprises various regional ranges;
identifying at least one face distribution image from the video data, wherein the face distribution image corresponds to one or more regional ranges;
counting the absenteeism information corresponding to each regional scope according to at least one face distribution image and the regional distribution image aiming at each regional scope;
and displaying the absenteeism information.
2. The method of claim 1, wherein said identifying at least one face distribution image from said video data comprises:
extracting a plurality of video frame images from the video data according to a preset period;
and identifying at least one face distribution image from the plurality of video frame images according to the corresponding relation between the faces in the plurality of video frame images and the area ranges.
3. The method of claim 2, wherein said identifying at least one of said face distribution images from a plurality of said video frame images comprises:
recognizing a face distribution image containing a plurality of face segmentation parameters from a plurality of video frame images;
wherein the face segmentation parameters correspond to facial organs.
4. A method according to claim 3, wherein said identifying a face distribution image from a plurality of said video frame images comprising a plurality of face segmentation parameters comprises:
acquiring face segmentation parameters of each of two adjacent video frame images;
and if the face segmentation parameters of the two adjacent video frame images respectively meet the parameter requirements corresponding to the two adjacent video frame images respectively, generating the face distribution image according to the matrix coordinate information of the face segmentation parameters and the video frame images.
5. The method according to claim 1, wherein said counting the absences information corresponding to each of the area ranges from at least one of the face distribution images and the area distribution image for each of the area ranges includes:
comparing at least one face distribution image with the region distribution image to obtain result data;
and determining the absenteeism information within a preset time period according to the result data.
6. The method of claim 5, wherein the face distribution image comprises face matrix coordinate information of at least one face, and the region distribution image comprises region matrix coordinate information of each of the region ranges;
the comparing at least one face distribution image with the region distribution image to obtain result data includes:
according to the face matrix coordinate information and the area matrix coordinate information, matching each face in each area range to obtain a corresponding first area range;
and taking a second area range except the first area range in each area range as the result data.
7. The method of claim 6, wherein the determining the absenteeism information for a preset period of time from the result data comprises:
and if the same second area range continuously appears in the preset time period, taking the identity information associated with the second area range and the continuous appearing times as the absenteeism information.
8. A system for processing video data, the system comprising:
the video acquisition module is used for acquiring video data to be processed, wherein the video data comprises various regional ranges;
the image recognition module is used for recognizing at least one face distribution image from the video data, and the face distribution image corresponds to one or more regional ranges;
the information statistics module is used for counting the absenteeism information corresponding to each regional range according to at least one face distribution image and the regional distribution image aiming at each regional range;
and the information display module is used for displaying the absenteeism information.
9. An electronic device, comprising:
one or more processors; and
one or more machine readable media having instructions stored thereon, which when executed by the one or more processors, cause the electronic device to perform the method of processing video data of any of claims 1 to 7.
10. A computer-readable storage medium, characterized in that a computer program stored therein causes a processor to execute the video data processing method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211564271.0A CN116311020A (en) | 2022-12-07 | 2022-12-07 | Video data processing method, system, electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211564271.0A CN116311020A (en) | 2022-12-07 | 2022-12-07 | Video data processing method, system, electronic device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116311020A true CN116311020A (en) | 2023-06-23 |
Family
ID=86785750
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211564271.0A Pending CN116311020A (en) | 2022-12-07 | 2022-12-07 | Video data processing method, system, electronic device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116311020A (en) |
-
2022
- 2022-12-07 CN CN202211564271.0A patent/CN116311020A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110659397B (en) | Behavior detection method and device, electronic equipment and storage medium | |
| CN111008542A (en) | Object concentration analysis method and device, electronic terminal and storage medium | |
| CN111914811B (en) | Image data processing method, image data processing device, computer equipment and storage medium | |
| JP2011227654A (en) | Collation device | |
| CN110827432B (en) | Class attendance checking method and system based on face recognition | |
| CN112819722A (en) | Infrared image face exposure method, device, equipment and storage medium | |
| CN110765828A (en) | Visual recognition method and system | |
| CN112818732A (en) | Image processing method and device, computer equipment and storage medium | |
| CN113192164A (en) | Avatar follow-up control method and device, electronic equipment and readable storage medium | |
| CN110889314A (en) | Image processing method, device, electronic equipment, server and system | |
| CN113192468A (en) | Display adjustment method, device, equipment and storage medium | |
| CN112733619A (en) | Pose adjusting method and device for acquisition equipment, electronic equipment and storage medium | |
| CN111970471A (en) | Participant scoring method, device, equipment and medium based on video conference | |
| CN108289191B (en) | Image recognition method and device | |
| CN111881740A (en) | Face recognition method, face recognition device, electronic equipment and medium | |
| CN115273208A (en) | Track generation method, system and device and electronic equipment | |
| CN107316011B (en) | Data processing method, device and storage medium | |
| CN116340928B (en) | Data security management method and system for intelligent equipment of Internet of things | |
| CN110543813B (en) | Face image and gaze counting method and system based on scene | |
| CN116311020A (en) | Video data processing method, system, electronic device and storage medium | |
| CN111680653A (en) | Seat information generation method, device, equipment and storage medium | |
| CN108694388B (en) | Campus monitoring method and device based on intelligent camera | |
| CN111260716A (en) | Method, device, server and storage medium for determining commercial tenant seat interval | |
| CN114267006A (en) | Security monitoring method, device, system and storage medium | |
| CN112101123B (en) | Attention detection method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |