CN110019947B - Data extraction method and device - Google Patents

Data extraction method and device Download PDF

Info

Publication number
CN110019947B
CN110019947B CN201810202074.1A CN201810202074A CN110019947B CN 110019947 B CN110019947 B CN 110019947B CN 201810202074 A CN201810202074 A CN 201810202074A CN 110019947 B CN110019947 B CN 110019947B
Authority
CN
China
Prior art keywords
data
audited
preset
storage space
extraction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810202074.1A
Other languages
Chinese (zh)
Other versions
CN110019947A (en
Inventor
朱敬成
肖桂柱
林圣拿
胡靓瑾
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikvision System Technology Co Ltd
Original Assignee
Hangzhou Hikvision System Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikvision System Technology Co Ltd filed Critical Hangzhou Hikvision System Technology Co Ltd
Publication of CN110019947A publication Critical patent/CN110019947A/en
Application granted granted Critical
Publication of CN110019947B publication Critical patent/CN110019947B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73Querying
    • G06F16/735Filtering based on additional data, e.g. user or group profiles
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Library & Information Science (AREA)
  • Computational Linguistics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The embodiment of the invention provides a data extraction method and a device, wherein the method comprises the following steps: after the first type of data extraction instruction is obtained, obtaining a data extraction condition set corresponding to a preset storage space, wherein the data extraction condition is as follows: conditions for filtering invalid vehicle passing data; obtaining data to be audited meeting data extraction conditions from the data to be audited stored in the first storage device, and using the data to be audited as first data to be audited; and storing the obtained first data to be audited in a preset storage space so that auditors can extract data from the preset storage space. By applying the embodiment of the invention, invalid vehicle passing data can be filtered, the workload of auditors is reduced to a certain extent, and the auditing efficiency of the auditors is improved.

Description

Data extraction method and device
Technical Field
The invention relates to the technical field of intelligent traffic, in particular to a data extraction method and device.
Background
In the field of intelligent transportation, a data analysis system can obtain massive vehicle passing data, wherein the vehicle passing data is as follows: data identified from the images and/or videos acquired by the image acquisition device, the passing data and the images and/or videos have corresponding relations. The vehicle passing data may include: the data analysis system identifies passing data (hereinafter referred to as "to-be-checked data") used for identifying vehicle violation, and in order to determine whether the to-be-checked data is valid, that is, whether the vehicle identified by the to-be-checked data really has a violation, the to-be-checked data needs to be checked. After the data to be checked is confirmed to be valid, the user of the vehicle identified by the data to be checked is penalized in the following process. In view of this, it is necessary to manually review whether the data to be reviewed is valid. In one case, when the data to be audited identifies vehicle violation and the auditor determines that the data to be audited is valid by viewing images and/or videos corresponding to the data to be audited, the data to be audited may be determined to be the violation data. Such illegal activities include, but are not limited to: the vehicle stops illegally, the vehicle runs at an overspeed, the vehicle runs in reverse direction, the vehicle changes lanes illegally, the vehicle runs by pressing a line or the vehicle rushes to red.
In a process of examining and verifying vehicle-passing data in an existing data analysis system, as shown in fig. 1, an image acquisition device acquires images and/or videos and transmits the images and/or videos to a data access device, for example: the image acquisition device may include a ball break, a snapshot machine, a mobile phone, a police mobile device, and the like, the data access device may identify vehicle passing data from the images and/or videos, and store to-be-checked data in the vehicle passing data and images and/or videos corresponding to the to-be-checked data, as shown in fig. 1, store the to-be-checked data in a first storage device, and identify with a "DB (DataBase)", where the first storage device may further include manually entered to-be-checked data; storing the image and/or video corresponding to the to-be-checked data to a second storage device, for example: the image and/or video corresponding to the manually entered data to be audited can be stored in the second storage device as a "PMS" (Power Production Management System) identifier; subsequently, after the auditor logs in the client, the data to be audited, which needs to be audited, can be obtained from the DB through the illegal auditing platform, the image and/or the video corresponding to the data to be audited, which needs to be audited, can be obtained from the PMS, and then the auditor performs operation on the client based on the obtained image and/or video, namely audits whether the obtained data to be audited is illegal data; when the auditing personnel audit the data to be audited as illegal data, reading the user information of the vehicle identified by the data to be audited from the vehicle management library through the illegal auditing platform, and uploading the data to be audited, the image and/or video corresponding to the data to be audited and the read user information to the punishing platform by the auditing personnel for subsequent punishing. The mobile equipment is mobile police equipment; the vehicle management library stores user information corresponding to each vehicle.
In the vehicle-passing data auditing process, the to-be-audited data stored in the "DB" may include invalid vehicle-passing data caused by factors such as image acquisition device failure, low resolution of image acquisition device, road construction, and special time period management and control. In the vehicle passing data auditing process, the invalid vehicle passing data can increase the workload of auditors, and further result in lower auditing efficiency of the auditors. The invalid vehicle passing data can comprise vehicle passing data which cannot form an evidence chain (such as no vehicle identification in the vehicle passing data), vehicle passing data corresponding to a condition which does not need to be penalized, vehicle passing data corresponding to a condition of mistaken shooting by the image acquisition equipment, and the like.
Disclosure of Invention
The embodiment of the invention aims to provide a data extraction method and a data extraction device, so that invalid vehicle passing data are filtered, the workload of auditors is reduced to a certain extent, and the auditing efficiency of the auditors is improved. The specific technical scheme is as follows:
in one aspect, an embodiment of the present invention provides a data extraction method, where after a first type of data extraction instruction is obtained, a data extraction condition set corresponding to a preset storage space is obtained, where the data extraction condition is: conditions for filtering invalid vehicle passing data;
extracting the data to be checked meeting the data extraction condition from the data to be checked stored in the first storage device to serve as first data to be checked;
and storing the extracted first data to be audited in the preset storage space so that auditors can extract data from the preset storage space.
Optionally, the data extraction condition at least includes a preset effective duration;
before the step of extracting the to-be-audited data meeting the data extraction condition from the to-be-audited data stored in the first storage device, as the first to-be-audited data, the method further includes:
judging whether the first storage device has the to-be-checked data which is marked with a preset abnormal data identifier and meets other conditions except the preset effective duration in the data extraction condition, wherein the preset abnormal data identifier is as follows: after the data to be audited stored in the preset storage space is extracted, and after an audit result fed back aiming at the extracted data to be audited is not obtained after the preset audit duration is exceeded, the data to be audited is marked;
when the data is judged to exist, extracting the to-be-checked data which are marked with the preset abnormal data identification and meet other conditions except the preset effective duration in the data extraction conditions as abnormal data;
the step of storing the extracted first data to be audited in the preset storage space includes:
and storing the extracted abnormal data and the extracted first data to be audited in the preset storage space.
Optionally, the data extraction condition includes a target bayonet identification;
the step of extracting the to-be-audited data meeting the data extraction condition from the to-be-audited data stored in the first storage device as the first to-be-audited data includes:
and extracting the data to be audited containing the target bayonet identification from the data to be audited stored in the first storage device to serve as the first data to be audited.
Optionally, the data extraction condition includes a preset effective duration;
before the step of extracting the to-be-audited data meeting the data extraction condition from the to-be-audited data stored in the first storage device, as the first to-be-audited data, the method further includes:
determining whether the data extraction condition is modified relative to the data extraction condition obtained when the first-class data extraction instruction was obtained last time;
when the data are determined to be modified, deleting all the data to be audited stored in the preset storage space; executing the step of extracting the data to be checked meeting the data extraction condition from the data to be checked stored in the first storage device to be used as the first data to be checked;
when the data is determined to be unmodified, deleting expired pending verification data stored in the preset storage space, wherein the expired pending verification data is as follows: the absolute value of the difference value between the corresponding acquired time and the current time exceeds the data to be audited with the preset effective duration;
extracting the to-be-examined data which meets the data extraction condition and is not stored in the preset storage space from the to-be-examined data stored in the first storage device to serve as second to-be-examined data;
and storing the extracted second to-be-checked data in the preset storage space.
Optionally, the step of determining whether the data extraction condition is modified with respect to the data extraction condition when the first type of data extraction instruction was obtained last time includes:
determining whether a preset modification flag bit corresponding to the data extraction condition is a preset value, wherein when the preset value is determined, the data extraction condition is modified relative to the data extraction condition obtained when the first-class data extraction instruction is obtained last time; when the determination is not the predetermined value, it indicates that the data fetch condition has not been modified relative to the data fetch condition at the previous time the first type of data fetch instruction was obtained.
Optionally, after the step of obtaining the data extraction condition set corresponding to the preset storage space, the method further includes:
judging whether first to-be-audited data marked with preset extracted identifications exist in the preset storage space, wherein the preset extracted identifications are as follows: after the first data to be audited stored in the preset storage space is extracted, marking the first data to be audited;
when judging that the first to-be-audited data marked with the preset extracted identification does not exist, obtaining an operation result corresponding to a preset operation instruction;
updating the data extraction condition based on the obtained operation result.
Optionally, after the step of storing the obtained first to-be-audited data in the preset storage space, the method further includes:
obtaining a second-class data extraction instruction which is sent by a client and aims at the preset storage space, wherein the second-class data extraction instruction is as follows: and a command sent by a target auditor logging in the client, wherein the second type data extraction command carries: the target user identification of the target auditor;
acquiring extraction authority information corresponding to the target user identification as target extraction authority information according to a preset corresponding relation and the target user identification, wherein the preset corresponding relation comprises: the method comprises the following steps of corresponding relations between a plurality of pairs of user identifications and extraction authority information, wherein the extraction authority information is as follows: the information is used for representing the authority of the corresponding auditor for extracting the data;
extracting the data to be checked matched with the target extraction authority information from the first data to be checked stored in the preset storage space to serve as target data to be checked;
and sending the target to-be-examined data to the client.
Optionally, after the step of sending the target pending validation data to the client, the method further includes:
obtaining an auditing result fed back by the client and aiming at the extracted target to-be-audited data;
marking the target data to be audited stored in the first storage device as an audited state; and deleting the target to-be-examined data stored in the preset storage space.
In another aspect, an embodiment of the present invention provides a data extraction apparatus, where the apparatus includes:
the first obtaining module is used for obtaining a data extraction condition set corresponding to a preset storage space after obtaining a first type of data extraction instruction, wherein the data extraction condition is as follows: conditions for filtering invalid vehicle passing data;
the first extraction module is used for extracting the data to be checked meeting the data extraction conditions from the data to be checked stored in the first storage device to be used as first data to be checked;
the first storage module is used for storing the extracted first data to be audited in the preset storage space, so that auditors can extract data from the preset storage space.
Optionally, the data extraction condition at least includes a preset effective duration;
the device further comprises: the device comprises a first judging module and a second extracting module;
the first judging module is configured to extract, from the data to be audited stored in the first storage device, the data to be audited that meets the data extraction condition, and before the data to be audited is taken as the first data to be audited, judge whether the data to be audited that is marked with a preset abnormal data identifier and meets other conditions except for the preset valid duration in the data extraction condition exists in the first storage device, where the preset abnormal data identifier is: after the data to be audited stored in the preset storage space is extracted, and after an audit result fed back aiming at the extracted data to be audited is not obtained after the preset audit duration is exceeded, the data to be audited is marked; when the judgment result is yes, triggering the second extraction module;
the second extraction module is used for extracting the to-be-inspected data which is marked with the preset abnormal data identifier and meets other conditions except the preset effective duration in the data extraction conditions, and the to-be-inspected data is used as abnormal data;
the first storage module is specifically configured to store the extracted abnormal data and the extracted first data to be audited in the preset storage space.
Optionally, the data extraction condition includes a target bayonet identification;
the first extraction module is specifically used for
And extracting the data to be audited containing the target bayonet identification from the data to be audited stored in the first storage device to serve as the first data to be audited.
Optionally, the data extraction condition includes a preset effective duration;
the device also comprises a determining module, a first deleting module, a second deleting module, a third extracting module and a second storing module;
the determining module is configured to, before extracting, from the data to be audited stored in the first storage device, the data to be audited that meets the data extraction condition, determine whether the data extraction condition is modified with respect to a data extraction condition obtained when the first-class data extraction instruction was obtained last time before the data is taken as the first data to be audited, trigger the first deleting module when the data is determined to be modified, and trigger the second deleting module when the data is determined to be unmodified;
the first deleting module is used for deleting all the data to be audited stored in the preset storage space; triggering the first extraction module;
the second deleting module is configured to delete expired pending audit data that has been stored in the preset storage space, where the expired pending audit data is: the absolute value of the difference value between the corresponding acquired time and the current time exceeds the data to be audited with the preset effective duration;
the third extraction module is configured to extract, from the data to be checked stored in the first storage device, the data to be checked, which meets the data extraction condition and is not stored in the preset storage space, as second data to be checked;
and the second storage module is used for storing the extracted second to-be-examined data in the preset storage space.
Optionally, the determining means is specifically configured to
Determining whether a preset modification flag bit corresponding to the data extraction condition is a preset value, wherein when the preset value is determined, the data extraction condition is modified relative to the data extraction condition obtained when the first-class data extraction instruction is obtained last time; when the determination is not the predetermined value, it indicates that the data fetch condition has not been modified relative to the data fetch condition at the previous time the first type of data fetch instruction was obtained.
Optionally, the apparatus further includes a second determining module, a second obtaining module, and an updating module;
the second judging module is configured to, after the data extraction condition set corresponding to the preset storage space is obtained, judge whether the first to-be-audited data marked with the preset extracted identifier exists in the preset storage space, where the preset extracted identifier is: after the first data to be audited stored in the preset storage space is extracted, marking the first data to be audited; when judging that the first to-be-audited data marked with the preset extracted identification does not exist, triggering the second obtaining module;
the second obtaining module is used for obtaining an operation result corresponding to the preset operation instruction;
and the updating module is used for updating the data extraction condition based on the obtained operation result.
Optionally, the apparatus further comprises: the device comprises a third obtaining module, a fourth extracting module and a sending module;
the third obtaining module is configured to obtain a second type of data extraction instruction, which is sent by a client and is for the preset storage space, after the obtained first data to be audited is stored in the preset storage space, where the second type of data extraction instruction is: and a command sent by a target auditor logging in the client, wherein the second type data extraction command carries: the target user identification of the target auditor;
the fourth obtaining module is configured to obtain, according to a preset corresponding relationship and the target user identifier, extraction permission information corresponding to the target user identifier as target extraction permission information, where the preset corresponding relationship includes: the method comprises the following steps of corresponding relations between a plurality of pairs of user identifications and extraction authority information, wherein the extraction authority information is as follows: the information is used for representing the authority of the corresponding auditor for extracting the data;
the fourth extraction module is configured to extract the data to be checked, which matches the target extraction permission information, from the first data to be checked stored in the preset storage space, and use the data as target data to be checked;
and the sending module is used for sending the target to-be-audited data to the client.
Optionally, the apparatus further comprises: a fifth obtaining module and a mark deleting module;
the fifth obtaining module is configured to obtain an audit result, fed back by the client, for the extracted target to-be-audited data after the target to-be-audited data is sent to the client;
the mark deleting module is used for marking the target data to be audited stored in the first storage device as an audited state; and deleting the target to-be-examined data stored in the preset storage space.
On the other hand, the embodiment of the invention provides electronic equipment, which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus;
a memory for storing a computer program;
the processor is configured to implement any of the data extraction method steps provided in the embodiments of the present invention when executing the computer program stored in the memory.
In another aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements any of the steps of the data extraction method provided in the embodiment of the present invention.
In the embodiment of the present invention, after obtaining the first type of data extraction instruction, obtaining a data extraction condition set corresponding to a preset storage space, where the data extraction condition is: conditions for filtering invalid vehicle passing data; obtaining data to be audited meeting data extraction conditions from the data to be audited stored in the first storage device, and using the data to be audited as first data to be audited; and storing the obtained first data to be audited in a preset storage space so that auditors can extract data from the preset storage space.
In the embodiment of the invention, first to-be-audited data which does not contain invalid vehicle passing data can be extracted from the first storage device based on the set data extraction condition for filtering the invalid vehicle passing data, and the extracted first to-be-audited data is stored in the preset storage space, and then auditors can extract the to-be-audited data from the preset storage space. Therefore, invalid vehicle passing data do not exist in the data extracted by the auditors, the workload of the auditors is reduced to a certain extent, and the auditing efficiency of the auditors is improved. In addition, invalid vehicle passing data do not exist in the data extracted by the auditor, the condition that the auditor audits the invalid vehicle passing data to be valid is avoided, the auditing accuracy of the auditor is improved to a certain extent, and the condition of misaudit is avoided. Of course, it is not necessary for any product or method of practicing the invention to achieve all of the above-described advantages at the same time.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic diagram of a conventional vehicle passing data auditing process;
fig. 2 is a schematic flow chart of a data extraction method according to an embodiment of the present invention;
fig. 3 is another schematic flow chart of a data extraction method according to an embodiment of the present invention;
fig. 4 is another schematic flow chart of a data extraction method according to an embodiment of the present invention;
fig. 5 is a schematic diagram of a vehicle passing data auditing process according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a data extraction apparatus according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention provides a data extraction method and device, which are used for filtering invalid vehicle passing data, reducing the workload of auditors to a certain extent and improving the auditing efficiency of the auditors.
As shown in fig. 2, an embodiment of the present invention provides a data extraction method, which may include the following steps:
s201: after the first type of data extraction instruction is obtained, obtaining a data extraction condition set corresponding to a preset storage space, wherein the data extraction condition is as follows: conditions for filtering invalid vehicle passing data;
it can be understood that the data extraction method provided by the embodiment of the present invention may be applied to a server in a data analysis system, where the server may be used only for providing a service, or may provide both the service and data. The server can be any type of electronic device, and the electronic device can be a computer, a mobile phone and the like. The preset storage space can be located locally in the electronic equipment; the preset storage space may also be located in another device with a storage function connected to the electronic device, where the connection may include a wired connection, a wireless connection, and the like, and this is all possible, and the embodiment of the present invention does not limit a connection manner between the electronic device and the other device with the storage function, and any connection manner that enables the electronic device to read the content stored in the preset storage space may be applied to the embodiment of the present invention.
The first type of data extraction instruction may be a human-triggered instruction, or may also be an instruction automatically triggered by an electronic device, or the like. When the first type data extraction instruction is an instruction automatically triggered by the electronic device, the electronic device may automatically trigger the first type data extraction instruction periodically or aperiodically, or may automatically trigger the first type data extraction instruction every time the electronic device is restarted.
The data extraction conditions may be: conditions for filtering invalid vehicle passing data; wherein, the invalid vehicle passing data may include: the vehicle passing data of the evidence chain cannot be formed, the vehicle passing data corresponding to the punished condition and the vehicle passing data corresponding to the mistaken shooting condition of the image acquisition equipment are not needed, and the like. Wherein, the vehicle passing data which cannot form the evidence chain may include: vehicle passing data that does not include a vehicle identification. The reason for the passing data not containing the vehicle identifier may be: the resolution of the image capturing device is too low (e.g., lower than a certain value) or the capturing angle of the image capturing device is not good, so that the vehicle identifier and the like cannot be recognized from the image and/or video captured by the image capturing device. The above-mentioned situation without penalty may be: due to factors such as road construction and special time period management and control, the vehicle has illegal behaviors such as line pressing driving and reverse driving. The image capturing device mis-shooting condition may include: the image acquisition equipment identifies the acquired image and/or video of the condition that the illegal action does not occur to the vehicle as the image and/or video of the condition that the illegal action occurs to the vehicle due to the reasons of faults and the like, and transmits the image and/or video of the condition to the data access equipment of the data analysis system. Subsequently, the data access device identifies the vehicle passing data from the images and/or videos, namely, the vehicle illegal behavior can be identified. It will be appreciated that in one implementation, the data access device, the predetermined storage space, and the first storage device are all present in the data analysis system, and the image capture device is also present in the data analysis system.
In an implementation manner, when the data extraction condition is set, the setting can be performed from the angles of illegal time, illegal types, bayonet identifications, corresponding collection areas and auditors that can be administered by managers included in the vehicle passing data. For example: the jurisdiction of managers has 6 bayonets, and the bayonet sign that corresponds respectively is: the image acquisition system comprises a bayonet mark 1, a bayonet mark 2, a bayonet mark 3, a bayonet mark 4, a bayonet mark 5 and a bayonet mark 6, wherein each bayonet corresponds to an image acquisition device, namely each bayonet mark corresponds to an image acquisition device; when determining that the image acquisition equipment corresponding to the bayonet identification 1 and the bayonet identification 2 fails, the manager can set data extraction conditions as follows: bayonet socket sign 3, bayonet socket sign 4, bayonet socket sign 5 and bayonet socket sign 6, above-mentioned data extraction condition can the sign: and extracting only the passing data (i.e. the subsequent data to be checked) with the bayonet identifications being the bayonet identification 3, the bayonet identification 4, the bayonet identification 5 or the bayonet identification 6.
Another example is: the auditors which can be administered by the manager are an auditor 1, an auditor 2 and an auditor 3 respectively, wherein the auditor 1 has the authority to obtain images and/or videos collected by image collection equipment corresponding to the bayonet identification 1 and the bayonet identification 2, the auditor 2 has the authority to obtain images and/or videos collected by image collection equipment corresponding to the bayonet identification 1, the bayonet identification 2, the bayonet identification 3 and the bayonet identification 4, and the auditor 3 has the authority to obtain images and/or videos collected by image collection equipment corresponding to the bayonet identification 4 and the bayonet identification 5; as the auditors that the manager can administrate do not have the authority to obtain the images and/or videos acquired by the image acquisition equipment corresponding to the bayonet identification 6, the vehicle passing data containing the bayonet identification as the bayonet identification 6 cannot be audited; at this time, the manager may set the data extraction conditions to: bayonet socket sign 1, bayonet socket sign 2, bayonet socket sign 3, bayonet socket sign 4 and bayonet socket sign 5, above-mentioned data extraction condition can the sign: and only extracting vehicle passing data (namely subsequent data to be checked) with the bayonet identifications being the bayonet identification 1, the bayonet identification 2, the bayonet identification 3, the bayonet identification 4 or the bayonet identification 5.
Of course, in an implementation manner, the administrator may also not consider the auditors that the administrator can administer, and the data extraction conditions may be set as follows: bayonet markings 1, 2, 3, 4, 5 and 6, which are also possible.
In the embodiment of the invention, the data extraction conditions are used for extracting the data to be checked from the data to be checked stored in the first storage device, so that the vehicle passing data containing the checkpoint identifier corresponding to the image acquisition device with the fault can be filtered.
It is understood that the preset storage space may be a continuous storage space or a discontinuous storage space. In one implementation, the preset storage space may be referred to as an illegal pool, or an illegal data pool, etc.
S202: extracting data to be audited meeting data extraction conditions from the data to be audited stored in the first storage device to serve as first data to be audited;
it is to be understood that the data to be audited stored in the first storage device may include: identified by the data analysis system as: vehicle passing data for identifying vehicle violations. The vehicle passing data may include: information such as a gate identification, a vehicle type, an illegal time, an illegal region, an illegal type, an illegal action, and the like.
In one implementation manner, the process of extracting the data to be audited meeting the data extraction condition from the data to be audited stored in the first storage device may be: matching each piece of data to be checked with the data extraction conditions, and determining whether the data to be checked meets the data extraction conditions; when it is determined that the data to be audited is matched with the data extraction condition, that is, the data extraction condition is satisfied, the data to be audited may be copied until all the data to be audited satisfying the data extraction condition are determined, and all the data to be audited obtained by copying may be extracted.
In another implementation, the data extraction condition may further include a preset effective time duration, and at this time, it may be that, first, the data to be checked, whose illegal time is within the preset effective time duration, is determined from the data to be checked stored in the first storage device, and then, the data to be checked, which satisfies other conditions in the data extraction condition, is determined from the determined data to be checked, whose illegal time is within the preset effective time duration, and so on. In one case, the data to be checked stored in the first storage device may be sorted in the order of the included illegal time, that is, the data to be checked in the first storage device may be sorted and stored in the order of the illegal time from the morning to the evening.
For example, there are 6 checkpoints in the jurisdiction of the administrator, and the corresponding bayonet identifiers are: the image acquisition system comprises a bayonet mark 1, a bayonet mark 2, a bayonet mark 3, a bayonet mark 4, a bayonet mark 5 and a bayonet mark 6, wherein each bayonet corresponds to an image acquisition device, namely each bayonet mark corresponds to an image acquisition device;
the manager sets the data extraction conditions as follows: bayonet identification-bayonet identification 3, bayonet identification 4, bayonet identification 5 and bayonet identification 6; illegal type-rush to red light, line ball driving; presetting effective time length-15 days;
the electronic equipment extracts the data to be checked which meet the data extraction conditions from the data to be checked stored in the first storage equipment; namely, it is determined from the data to be audited that the illegal time is within 15 days, the included bayonet identification is the bayonet identification 3, the bayonet identification 4, the bayonet identification 5 or the bayonet identification 6, and the included data to be audited that the illegal type is rushing to red light or pressing line driving is used as the first data to be audited. Wherein, the above-mentioned illegal time can be understood as: and the absolute value of the time difference between the illegal time and the current time contained in the data to be checked does not exceed 15 days.
In one implementation, the preset validity period may be accurate to days, or accurate to hours, or accurate to minutes, or accurate to seconds, as may be appropriate. For example: when the preset effective duration is accurate to the day, the time, minutes and seconds in the illegal time contained in the data to be audited can be not considered. When the preset effective time is N days, the current time is X years, Y months, Z days and M days, N minutes and P seconds, and the illegal time corresponding to the to-be-checked data meeting the data extraction condition can be Z-N days at the earliest time.
S203: and storing the extracted first data to be audited in a preset storage space so that auditors can extract data from the preset storage space.
In this step, the extracted first data to be audited is stored in a preset storage space, which may be understood as storing the copied data to be audited in the preset storage space. In the embodiment of the present invention, the first data to be audited may be stored in the preset storage space in a cache manner.
Subsequently, the auditor having the authority to extract the data from the preset storage space can extract the to-be-audited data required to be audited from the preset storage space. In one implementation, whether the auditor has the right to extract the data from the preset storage space may depend on the information configured by the administrator.
It can be understood that, when the first to-be-audited data is cached in the preset storage space, and subsequently, when the auditor extracts the first to-be-audited data to be audited from the preset storage space, the extraction speed is relatively fast, and the time consumed by data extraction can be reduced to a certain extent.
In an implementation manner, when an auditor extracts data to be audited from the preset storage space, the auditor needs to send a data extraction request to the electronic device through the logged client, after the electronic device obtains the data extraction request, the electronic device determines first data to be audited corresponding to the data extraction request from the preset storage space, copies the determined first data to be audited, and sends the copied first data to be audited to the client, so that the auditor audits the first data to be audited. The data fetch request may be a second type of data fetch instruction mentioned later.
It can be understood that, in order to avoid the situation that multiple auditors audit the same first data to be audited, after the electronic device sends the copied first data to be audited to the client, the preset extracted identifier is marked for the first data to be audited corresponding to the data extraction request determined by the preset storage space, so that the first data to be audited can not be extracted by other auditors any more.
In an implementation manner, when there are multiple preset storage spaces, after the electronic device sends the copied first to-be-audited data to the client, in addition to marking the preset extracted identifier for the first to-be-audited data corresponding to the data extraction request determined for the preset storage space, the electronic device may also mark the identifier for the to-be-audited data correspondingly stored in the first storage device, for example: the electronic device marks the user identification of the auditor for the to-be-audited data correspondingly stored in the first storage device so as to identify that the to-be-audited data is extracted by the auditor corresponding to the user identification.
By applying the embodiment of the invention, the first data to be audited, which does not contain the invalid vehicle passing data, can be extracted from the first storage device based on the set data extraction condition for filtering the invalid vehicle passing data, the extracted first data to be audited is stored in the preset storage space, and subsequently, the auditor can extract the data to be audited from the preset storage space. Therefore, invalid vehicle passing data do not exist in the data extracted by the auditors, the workload of the auditors is reduced to a certain extent, and the auditing efficiency of the auditors is improved. In addition, invalid vehicle passing data do not exist in the data extracted by the auditor, the condition that the auditor audits the invalid vehicle passing data to be valid is avoided, the auditing accuracy of the auditor is improved to a certain extent, and the condition of misaudit is avoided.
In an implementation manner, the first type data extraction instruction may not be an instruction received by the electronic device for the first time, and at this time, there may be a case that the vehicle-passing data is already stored in the preset storage space. After the electronic device obtains the first type of data extraction instruction, all the vehicle passing data stored in the preset storage space can be deleted, and then the step of obtaining the data extraction conditions set corresponding to the preset storage space is executed, which is all right.
It can be understood that, after the first data to be audited is extracted from the preset storage space, the auditor needs to audit the extracted first data to be audited, and feeds back an audit result for each first data to be audited to the electronic device. The auditing result can represent that the first data to be audited is audited to be effective by the auditor and is uploaded to a punishment platform for subsequent punishment; the first data to be audited can also be characterized as invalid after being audited by auditors. Subsequently, after the electronic device receives the audit result for the first data to be audited, the electronic device may store the corresponding audit result and the user identifier of the auditor for each first data to be audited, identify the first data to be audited stored in the first storage device as being audited, and delete the first data to be audited stored in the preset storage space.
However, in one case, an abnormal situation may occur, which may be: after the auditor extracts the first data to be audited from the preset storage space, the condition of the audit result of the extracted first data to be audited is not fed back within the preset audit duration due to the fact that the client fails, the client is disconnected from the electronic device, or the auditor does not audit the data.
It can be understood that, in an implementation manner, in order to avoid a situation that multiple auditors audit the same first data to be audited, the first data to be audited in the preset storage space can be extracted only once. When the abnormal condition occurs, the extracted first data to be audited is lost. In order to avoid the situation that the first to-be-audited data is lost, in an implementation manner, the data extraction condition may at least include a preset valid duration; as shown in fig. 3, a data extraction method provided in an embodiment of the present invention may include the following steps:
s301: after the first type of data extraction instruction is obtained, obtaining a data extraction condition set corresponding to a preset storage space, wherein the data extraction condition is as follows: conditions for filtering invalid vehicle passing data;
here, S301 is the same as S201 shown in fig. 2.
S302: judging whether the first storage device has the to-be-checked data which is marked with the preset abnormal data identification and meets other conditions except the preset effective duration in the data extraction conditions;
the preset abnormal data identification is as follows: after the data to be audited stored in the preset storage space is extracted, and after the audit result fed back aiming at the extracted data to be audited is not obtained after the preset audit duration is exceeded, the data to be audited is marked;
s303: when the data is judged to exist, extracting the to-be-checked data which are marked with the preset abnormal data identification and meet other conditions except the preset effective duration in the data extraction conditions as abnormal data;
it can be understood that, when the electronic device determines that the to-be-audited data marked with the preset abnormal data identifier exists in the first storage device, the to-be-audited data marked with the preset abnormal data identifier may not be extracted under the time limitation, but provided that other conditions except for the preset valid duration for limiting the time in the data extraction conditions are satisfied. It will be appreciated that the predetermined anomaly data identification may be any type of identification that can identify data. In an implementation manner, the preset abnormal data identifier may be: it is all right that the user identification of the auditor of the first data to be audited, etc. is extracted from the preset storage space.
In an implementation manner, the preset auditing time length may be set by default for the electronic device, or may be set by a manager according to an actual situation.
For example, according to an actual situation, the manager sets the preset auditing time to be 30 minutes, and after the electronic device receives a data extraction request sent by an auditor a through a client a, it is determined that the auditor a needs to extract 10 pieces of first data to be audited from a preset storage space, where the first data to be audited is 1, 2, 3, 4, 5, 6, 7, 8, 9 and 10;
in one case, after the electronic device sends the 10 pieces of first data to be audited to the client where the auditor a logs in, the extracted identifiers may be preset for the 10 pieces of first data to be audited in the preset storage space, the first identifiers may be marked for the 10 pieces of first data to be auditor a user of the auditor a in the first storage device, and timing starts from 0;
in another case, before the timing of the electronic device reaches 30 minutes, the first-class data extraction instruction is not obtained, and an audit result of the first data to be audited is received, for example, after an audit result of a first number 2 of cores to be audited is received, the electronic device stores the audit result and a user identifier of an auditor corresponding to the first data 2 to be audited, identifies the first data 2 to be audited stored in the first storage device as audited, deletes the first data 2 to be audited stored in the preset storage space, and times the electronic device from 0 again;
when the timing of the electronic equipment reaches 30 minutes, a first-class data extraction instruction is obtained, all first data to be audited in a preset storage space can be directly deleted, and abnormal data identifiers are preset for the first data to be audited 1, the first data to be audited 3, the first data to be audited 4, the first data to be audited 5, the first data to be audited 6, the first data to be audited 7, the first data to be audited 8, the first data to be audited 9 and the first data to be audited 10 in the first storage equipment;
subsequently, the electronic device obtains a data extraction condition set corresponding to the preset storage space, and judges whether the first storage device has the to-be-checked data marked with the preset abnormal data identification and meeting other conditions except the preset effective duration in the data extraction condition;
when the data is judged to exist, extracting the to-be-checked data which are marked with the preset abnormal data identification and meet other conditions except the preset effective duration in the data extraction conditions as abnormal data; namely, the first to-be-audited data 1, the first to-be-audited data 3, the first to-be-audited data 4, the first to-be-audited data 5, the first to-be-audited data 6, the first to-be-audited data 7, the first to-be-audited data 8, the first to-be-audited data 9 and the first to-be-audited data 10 are determined to be abnormal data;
extracting the data to be checked meeting the data extraction condition from the data to be checked stored in the first storage device to serve as first data to be checked;
storing the extracted abnormal data and the obtained first data to be audited in a preset storage space;
in another case, when the timing of the electronic device reaches 30 minutes and the first-type data extraction instruction is not obtained during the timing, the marked preset extracted identifier of the other 9 pieces of first data to be audited in the preset storage space except the first data to be audited 2 may be directly cleared, and the marked user identifier of the auditor a in the first storage device except the first data to be audited 2 may be directly deleted, so that the other 9 pieces of first data to be audited may be extracted again.
S304: extracting data to be audited meeting data extraction conditions from the data to be audited stored in the first storage device to serve as first data to be audited;
here, S304 is the same as S202 shown in fig. 2.
S305: and storing the extracted abnormal data and the obtained first data to be audited in a preset storage space.
In the embodiment of the present invention, the step of extracting the to-be-checked data, which is marked with the preset abnormal data identifier and satisfies other conditions except the preset valid duration in the data extraction condition, as the abnormal data may be understood as follows: and determining the data to be checked of each marked preset abnormal data identifier and meeting other conditions except the preset effective duration in the data extraction conditions, copying the data to be checked, and extracting the copied data to be checked as abnormal data.
Subsequently, in an implementation manner, the extracted abnormal data and the extracted first data to be audited may be stored in a preset storage space in a cache manner.
When the image acquisition equipment is in a fault state, or the resolution ratio is set to be low, or the shooting angle is set to be poor, or the image acquisition equipment is in a road section construction state or a special time period management and control state, more invalid vehicle passing data can exist in vehicle passing data corresponding to the acquired images and/or videos. In one implementation, when the to-be-checked data is extracted from the first storage device and stored in the preset storage space, the extraction of the vehicle passing data corresponding to the image and/or video acquired by the image acquisition device in the above condition should be avoided.
In an implementation mode, when knowing the image acquisition equipment in the above situation, the manager can avoid extracting the vehicle passing data corresponding to the image acquisition equipment in the above situation by setting the data extraction condition, and store the vehicle passing data in the preset storage space. The image acquisition equipment and the image and/or the video have a corresponding relation, and the image and/or the video and the vehicle passing data have a corresponding relation, namely the image acquisition equipment and the vehicle passing data also have a corresponding relation.
In another implementation manner, the electronic device may obtain historical data, that is, all to-be-audited data obtained before setting the data extraction condition, and count the number of to-be-audited data including the bayonet identifier, which is referred to as a first number, for different bayonet identifiers; counting the auditing results which are fed back by the auditors and represent that the data to be audited are invalid according to different bayonet identifications, wherein the number of the data to be audited which correspondingly contains the bayonet identification is called as a second number; further, the ratio of the second quantity to the first quantity corresponding to the bayonet identification is calculated for different bayonet identifications, and when the ratio exceeds a first preset ratio threshold value, extraction of data to be audited containing the bayonet identifications is avoided when data extraction conditions are set. In one implementation, the ratio may be referred to as a revocation ratio.
Specifically, the data extraction condition may include a target bayonet identification;
the step of extracting the data to be audited meeting the data extraction condition from the data to be audited stored in the first storage device as the first data to be audited may include:
and extracting the data to be audited containing the target bayonet identification from the data to be audited stored in the first storage device to serve as the first data to be audited.
For example, there are 5 bayonets in the jurisdiction of the manager, and the bayonet identifiers are: the bayonet identification I, the bayonet identification II, the bayonet identification III, the bayonet identification IV and the bayonet identification V;
in one case, the manager obtains that the image acquisition equipment corresponding to the identifier bayonet identifier one and the identifier bayonet identifier two has a fault, and at the moment, the manager can set that the bayonet identifier in the data extraction condition can comprise a bayonet identifier three, a bayonet identifier four and a bayonet identifier five; or, the administrator acquires the road section where the image acquisition device corresponding to the identifier of the bayonet sign four and the identifier of the bayonet sign five is located, and at this time, the administrator can set that the bayonet sign can include the bayonet sign one, the bayonet sign two and the bayonet sign three in the data extraction condition.
In another case, the electronic device obtains ten thousand pieces of historical data, wherein one bayonet mark corresponds to two thousand pieces (a first numerical value); the second bayonet mark corresponds to two thousand (first numerical values); the third bayonet mark corresponds to two thousand (first numerical values); the bayonet sign four corresponds to two thousand (first numerical values); the bayonet mark five corresponds to two thousand (first numerical values);
the electronic equipment obtains one thousand of auditing results with invalid data to be audited, wherein four hundred pieces of data to be audited (second numerical values) including a bayonet identification I and five hundred pieces of data to be audited (second numerical values) including a bayonet identification II exist in the data to be audited corresponding to the auditing results; 0 (second numerical value) of data to be audited containing the bayonet identification III exists; fifty pieces of data to be audited (second numerical values) including the bayonet identification four exist; fifty pieces of data to be audited (second numerical values) including the bayonet identification five exist;
at this time, the electronic device calculates a ratio of 0.2 for the first bayonet identifier; the electronic equipment calculates the ratio of 0.25 for the second bayonet identifier; the electronic equipment calculates the ratio to be 0 for the third bayonet identification; the electronic equipment aims at the bayonet identification four, and the calculated ratio is 0.025; aiming at the fifth bayonet identification, the calculated ratio of the electronic equipment is 0.025;
the first preset ratio threshold value prestored in the electronic equipment is 0.2; the electronic equipment respectively compares the ratio corresponding to the bayonet identification one with a first preset ratio threshold value; comparing the ratio corresponding to the second bayonet identification with a first preset ratio threshold; comparing the ratio corresponding to the third bayonet identification with a first preset ratio threshold; comparing the ratio corresponding to the bayonet identification four with a first preset ratio threshold value; comparing the ratio corresponding to the fifth bayonet identification with a first preset ratio threshold;
the electronic equipment determines that the ratio corresponding to the second bayonet identification is greater than the first preset ratio threshold;
at this time, when the electronic device automatically sets the data extraction condition, the bayonet identification in the data extraction condition may include bayonet identification one, bayonet identification three, bayonet identification four, and bayonet identification five.
Subsequently, the electronic device may extract, from the data to be audited stored in the first storage device, data to be audited that includes a bayonet identification of one bayonet identification, a bayonet identification of three, a bayonet identification of four, or a bayonet identification of five, as the first data to be audited.
In one implementation, the data extraction condition may include a preset effective duration; as shown in fig. 4, the data extraction method provided in the embodiment of the present invention may include the following steps:
s401: after the first type of data extraction instruction is obtained, obtaining a data extraction condition set corresponding to a preset storage space, wherein the data extraction condition is as follows: conditions for filtering invalid vehicle passing data;
here, S401 is the same as S201 shown in fig. 2.
S402: determining whether the data extraction conditions are modified relative to the data extraction conditions obtained when the first-class data extraction instruction was obtained last time; when it is determined to be modified, S403 is executed: when it is determined not to be modified, S405 is executed:
s403: deleting all data to be audited stored in a preset storage space;
s404; extracting data to be audited meeting data extraction conditions from the data to be audited stored in the first storage device to serve as first data to be audited;
here, S404 is the same as S202 shown in fig. 2.
S405: deleting the stored expired data to be audited in the preset storage space;
the expired data to be checked is: the absolute value of the difference value between the corresponding acquired time and the current time exceeds the data to be audited with the preset effective duration;
it can be understood that each piece of data to be audited corresponds to an obtaining time, and the obtaining time corresponding to each piece of data to be audited may be: and identifying acquisition time corresponding to the image of the data to be checked and/or identifying a timestamp corresponding to a video frame in the video of the data to be checked.
S406: extracting the data to be checked, which meets the data extraction condition and is not stored in a preset storage space, from the data to be checked stored in the first storage device to be used as second data to be checked;
s407: and storing the extracted second to-be-checked data in the preset storage space.
In the embodiment of the present invention, the electronic device may obtain the first type data extraction instruction periodically or aperiodically, or, when the electronic device is restarted, the electronic device may also obtain the first type data extraction instruction. It is to be understood that the first type of data extraction instruction may not be the first type of data extraction instruction received by the electronic device for the first time. At this time, there may be a case that the pending data is already stored in the preset storage space.
After the electronic device obtains the first type data extraction instruction again, the data extraction condition may be obtained first, and it is determined whether the data extraction condition is modified with respect to the data extraction condition obtained when the first type data extraction instruction was obtained last time; when the data are determined to be modified, all the data to be audited stored in the preset storage space can be directly deleted; when the data is determined not to be modified, only the expired data to be audited stored in the preset storage space can be deleted; extracting the data to be checked, which meets the data extraction condition and is not stored in a preset storage space, from the data to be checked stored in the first storage device; and the second to-be-examined data is used as second to-be-examined data and stored in the preset storage space. In the embodiment of the present invention, the previous instruction for extracting the first type of data is: the first-class data extraction instruction is obtained at the current time, namely the previous time of obtaining the first-class data extraction instruction at the current time.
In one implementation, a preset modification flag may be set in the electronic device for the data extraction condition, and the preset modification flag is a predetermined value when the data extraction condition is modified between two times of obtaining the first-class data extraction instructions; when the data extraction condition is not modified between two times of obtaining the first class data extraction instructions, the preset modification flag bit is not a preset value; specifically, the step of determining whether the data extraction condition has been modified (S402) with respect to the data extraction condition obtained when the first type of data extraction instruction was obtained last time may include:
determining whether a preset modification flag bit corresponding to the data extraction condition is a preset value, wherein when the preset value is determined, the data extraction condition is modified relative to the data extraction condition obtained when the first-class data extraction instruction is obtained last time; when the determination is not the predetermined value, it indicates that the data fetch condition has not been modified relative to the data fetch condition at the previous time the first type of data fetch instruction was obtained.
In one implementation, after the step of obtaining (S201) the data extraction condition corresponding to the preset storage space setting, the method may further include:
judging whether first to-be-audited data marked with preset extracted identifications exist in a preset storage space, wherein the preset extracted identifications are: presetting a marked identifier after first data to be audited stored in a storage space is extracted;
when judging that the first to-be-audited data marked with the preset extracted identification does not exist, obtaining an operation result corresponding to a preset operation instruction;
based on the obtained operation result, the data extraction condition is updated.
In one implementation, the manager may set the data extraction condition according to the policy of the region corresponding to the data to be checked and the actual condition of the corresponding region.
The electronic equipment judges whether first to-be-audited data marked with the preset extracted identification exists in the preset storage space, namely whether auditors exist or not is determined, the first to-be-audited data extracted from the preset storage space is audited, and when the first to-be-audited data marked with the preset extracted identification exists in the preset storage space, namely the auditors audit the first to-be-audited data extracted from the preset storage space, operation corresponding to a preset operation instruction cannot be performed on the data extraction condition; when the first to-be-audited data marked with the preset extracted identification does not exist in the preset storage space, that is, when the auditor does not audit the first to-be-audited data extracted from the preset storage space, the operation corresponding to the preset operation instruction can be performed on the data extraction condition.
When the electronic device determines that the manager can perform an operation corresponding to the preset operation instruction on the data extraction condition, an operation frame corresponding to the preset operation instruction can be popped up, so that the manager can perform an operation on the data extraction condition in the operation frame. In one implementation, the preset operation instruction may be an operation of adding, modifying, deleting, and the like. When the preset operation is modification, the manager can input the modification content of the data extraction condition in the operation frame; the bayonet identification in the data extraction condition comprises a bayonet identification 1, a bayonet identification 2 and a bayonet identification 3; the modified content is as follows: the bayonet identification in the data extraction condition comprises a bayonet identification 1 and a bayonet identification 2;
after the manager can operate the data extraction condition in the operation frame, a storage instruction can be triggered to enable the electronic device to obtain an operation result of the operation;
updating data extraction conditions based on the operation result; for example: when the preset operation is modification, the data extraction condition is updated by using the modification content, and the above example is carried out: and updating the data extraction conditions to be bayonet identifications including a bayonet identification 1 and a bayonet identification 2.
Subsequently, the electronic equipment can output information for prompting whether to take effect immediately, when the administrator selects yes, namely, the information takes effect immediately, the electronic equipment immediately and automatically triggers the first type of data extraction instruction, obtains the updated data extraction conditions, and executes the subsequent data extraction process according to the updated data extraction conditions; and when the administrator selects no, namely the data is not immediately effective, the electronic equipment waits for obtaining a next first-class data extraction instruction, obtains an updated data extraction condition, and executes a subsequent data extraction process according to the updated data extraction condition.
After the step of storing the obtained first to-be-audited data in a preset storage space (S203), the method may further include:
obtaining a second-class data extraction instruction which is sent by a client and aims at a preset storage space, wherein the second-class data extraction instruction is as follows: and the instruction sent by the target auditor of the login client carries the following data in the second-class data extraction instruction: target user identification of a target auditor;
acquiring extraction authority information corresponding to the target user identification as target extraction authority information according to a preset corresponding relation and the target user identification, wherein the preset corresponding relation comprises: multiple pairs of user identifications and corresponding relations of the extraction authority information, wherein the extraction authority information is as follows: the information is used for representing the authority of the corresponding auditor for extracting the data;
extracting to-be-audited data matched with the target extraction authority information from first to-be-audited data stored in a preset storage space, and using the to-be-audited data as target to-be-audited data;
and sending the target data to be audited to the client.
In an implementation manner, the client may also exist in a data analysis system, and the data analysis system may adopt a front-end and back-end separated architecture mode, at this time, the data extraction method for implementing the embodiment of the present invention may be applied to a server for providing a service in the data analysis system, that is, the electronic device provided in the embodiment of the present invention may serve as: the server for providing a service in the data analysis system, and the first storage device may be a server for providing data in the data analysis system. The preset storage space may exist in a server for providing data in the data analysis system. The server for providing the service may implement the interfacing between the server (backend) for providing the data and the client (frontend). For example: the server for providing the service can respond to a second type data extraction instruction sent by an auditor through the client, obtain data from the server for providing the data where the preset storage space is located, and provide the obtained data to the client. In one implementation, the data analysis system may be deployed in a distributed manner to relieve the operating pressure of each device (including servers and clients) of the data analysis system. The architecture of the data analysis system may be based on an SOA (Service Oriented architecture) to increase the sources of vehicle data acquisition, i.e., to increase the sources of images and/or videos from which the data analysis system may identify vehicle data.
It can be understood that, in the embodiment of the present invention, a plurality of pairs of corresponding relationships between user identifiers and extraction permission information, that is, the preset corresponding relationship, are stored in a local device or a connected device having a storage function of an electronic device, where the extraction permission information is: the information is set by the manager and used for representing the authority of the corresponding auditor for extracting the data; each auditor can only extract the first data to be audited which meet the corresponding extraction authority information from the preset storage space.
The manager can allocate the authority for auditing the first data to be audited stored in the preset storage space and the authority for auditing the type of the first data to be audited stored in the preset storage space according to the function of each auditor in the jurisdiction range of the manager. When the manager distributes the authority for a auditor to audit the first data to be audited stored in the preset storage space, but does not set the extraction authority information for the auditor, at the moment, the auditor has the authority to audit all the first data to be audited stored in the preset storage space; when the manager distributes to a verifier, the manager verifies the authority of the first to-be-verified data stored in the preset storage space and sets the extraction authority information for the manager, and the verifier has the authority of verifying the first to-be-verified data stored in the preset storage space and meeting the corresponding extraction authority information.
It can be understood that each user identifier may correspond to one or more pieces of authority information, where an administrator may set an authority information to be in an open state for each user identifier, and the authority information in the open state may be used as the extraction authority information corresponding to the user identifier. For example: the user identifier 1 corresponds to the authority information 1, the authority information 2 and the authority information 3; the user identifier 2 corresponds to the authority information 1, the authority information 2 and the authority information 4; the user identifier 3 corresponds to the authority information 1; and when the authority information 2 corresponding to the user identifier 1 is in an open state, the extracted authority information corresponding to the user identifier 1 is the authority information 2. When the authority information 2 corresponding to the user identifier 1 is in an on state, the authority information 2 corresponding to the user identifier 2 cannot be set to be in the on state any more, because the authority information corresponding to the user identifier 2 further includes available authority information, namely the authority information 1 and the authority information 4. In the case that the authority information 2 corresponding to the user identifier 1 is in the on state, the authority information 1 or the authority information 4 corresponding to the user identifier 2 may be set to be in the on state. When the authority information 1 corresponding to the user identifier 2 is in an on state, the authority information 1 corresponding to the user identifier 3 may be set to be in the on state, because the authority information corresponding to the user identifier 3 has no other available authority information except the authority information 1.
The permission information may define a permission of the corresponding reviewer to extract the data to be reviewed, and may include any combination of data attributes of the data to be reviewed, for example: any combination of the gate identifier, the vehicle type, the type of violation, the law violation, the time information, the place of violation, and the like, that is, the extraction right information may include any combination of the data attributes, for example: any combination of a bayonet identification, a vehicle type, an illegal action, time information, an illegal place, and the like. For example, the permission information may be: the vehicle type comprises a bayonet identification, namely a bayonet identification 1 and a bayonet identification 2, illegal time, namely 7 and 5 months in 2020, 7 and 20 months in 2020, and a vehicle type, namely a truck and an illegal type, namely a red light. The data attributes of the pending data may include, but are not limited to: a bayonet sign, a vehicle type, an illegal action, an illegal time, an illegal place, and the like. Wherein the above "-" may identify an inclusion.
It can be understood that the mode that the administrator sets the authority of the audit data for the auditor can prevent the auditor from extracting the audit data at will; to a certain extent, the behavior of committing illegalities for personal gains can be reduced for auditors. Moreover, the operation flow of the auditor is reduced to a certain extent, the auditor can trigger a key extraction function without executing other operations, such as: inputting the extraction conditions of the data to be examined to be extracted.
It can be understood that when the data is checked by the auditor, it is also necessary to identify whether the data is valid, that is, whether the data is real illegal data, that is, whether the identified vehicle has illegal activities, according to the image and/or video corresponding to the data. In one implementation manner, after obtaining the second-class data extraction instruction and the target extraction permission information, the electronic device further needs to obtain target device permission information corresponding to a target user, where the target device permission information is: the information is used for representing the authority of the target auditor for obtaining the images and/or videos collected by the image collecting equipment; furthermore, first data to be audited, which meets both the target extraction permission information and the target equipment permission information, is extracted from the preset storage space, serves as target data to be audited, and is sent to the client.
For example, the target extraction permission information may include a bayonet identification 2 and a bayonet identification 3, and illegal types include overspeed driving and reverse driving; the target device authority information may include a bayonet identifier 1 and a bayonet identifier 2; the target extraction authority information represents that a target auditor has the following characteristics: the contained bayonet identification is a bayonet identification 2 or a bayonet identification 3, the contained illegal type is data to be checked of overspeed driving or reverse driving, and the target equipment permission information represents that a target auditor has the following characteristics: obtaining a bayonet corresponding to the bayonet identifier 1, a bayonet corresponding to the bayonet identifier 2 and authority of an image and/or video acquired by corresponding image acquisition equipment; the electronic device extracts the permission information from the extracted matching target in the preset storage space, and the first data to be checked matching the permission information of the target device may include: the included gate identifier is the gate identifier 2, and the included first data to be audited whose illegal type is overspeed driving or reverse driving.
In one implementation, the data to be audited is generally time-efficient, and when the violation time of the data to be audited exceeds a preset time period, the data may be considered invalid, that is, the data is considered non-violation data. When data is extracted, the data can be extracted according to the sequence of the illegal time of the data to be checked. At this time, the first data to be audited stored in the preset storage space may be arranged in time sequence, and the electronic device may extract the first data to be audited according to the arrangement sequence of the first data to be audited. In addition, in order to improve the use experience of the auditors to a certain extent and further improve the efficiency of the subsequent data audit of the auditors, the data of the vehicle to be audited, which contains the same checkpoint identifier, can be provided for the auditors as much as possible in one data extraction process.
In one case, the target extraction authority information at least includes: limiting information that a target auditor has the authority to extract first data to be audited containing a target checkpoint identifier;
when the electronic equipment extracts first to-be-checked data matched with the target extraction permission information from a preset storage space, the electronic equipment can traverse the first to-be-checked data according to the arrangement sequence of the first to-be-checked data, determine the first to-be-checked data matched with the target extraction permission information, and use the first to-be-checked data as first vehicle passing data, wherein a gate identifier contained in the first vehicle passing data belongs to a target gate identifier, and determine the first vehicle passing data as target to-be-checked data;
the electronic equipment continuously traverses the first data to be checked, and sequentially determines the first data to be checked meeting a first preset condition as second vehicle passing data, wherein the first preset condition is met: the checkpoint identification is matched with the target extraction authority information and is the same as the checkpoint identification contained in the first vehicle passing data;
determining the passing data in the determined second passing data as target to-be-examined data; and extracting all the determined target data to be examined.
For example, the target extraction authority information includes: the vehicle type comprises a bayonet mark, a bayonet mark 1, a bayonet mark 2 and a bayonet mark 3, and the illegal type comprises a car, a illegal type, illegal parking and red light grabbing; arranging the first data to be audited in time sequence;
the electronic equipment sequentially traverses each piece of first data to be audited according to the arrangement sequence of the first data to be audited, determines first data to be audited, which is matched with the target extraction authority information, as first vehicle passing data and target data to be audited, namely determines that a first included bayonet identifier is a bayonet identifier 1 or a bayonet identifier 2 or a bayonet identifier 3, the type of the included vehicle is a car, the included first data to be audited is illegal parking or red light, and determines the first vehicle passing data when the first vehicle passing data is determined, wherein the bayonet identifier included in the first vehicle passing data is the bayonet identifier 2;
at this time, the electronic device continuously traverses the first data to be audited, sequentially determines the first data to be audited meeting the first preset condition as second vehicle passing data, namely sequentially determines that the included bayonet identification is the bayonet identification 2, the included vehicle type is a car, and the included data to be audited with the illegal type of illegal parking or red light is used as the second vehicle passing data; and subsequently, determining the vehicle passing data in the determined second vehicle passing data as target to-be-examined data, extracting all the determined target to-be-examined data, and executing a subsequent process.
In one implementation manner, the electronic device may determine all the determined second vehicle passing data as target to-be-checked data; the first preset number of vehicle passing data in the determined second vehicle passing data can also be determined as the target to-be-examined data. In one case, the determined number of the second vehicle passing data may be smaller than the first preset number, and at this time, after the second vehicle passing data is determined, it may be determined whether the number of the second vehicle passing data is not smaller than the first preset number, and when the number of the second vehicle passing data is not smaller than the first preset number, the previous first preset number of vehicle passing data in the determined second vehicle passing data is determined as the target to-be-inspected data; when the determination result is less than the first preset value, the following steps may be adopted to determine the remaining target to-be-checked data until all the determined target to-be-checked data reach the first preset value plus one, or no first to-be-checked data matched with the target extraction permission information exists in other first to-be-checked data except the determined target to-be-checked data:
step A: according to the arrangement sequence of the first data to be checked, traversing other first data to be checked except the first data to be checked which is determined to be the target data to be checked, determining first data to be checked which is matched with the target extraction permission information and serves as new first passing data, wherein the checkpoint identification contained in the new first passing data belongs to the target checkpoint identification, and the new first passing data serves as the target data to be checked;
and B: continuously traversing other first data to be audited except the data which is determined to be the target data to be audited, and sequentially determining the first data to be audited which meets a second preset condition as new second vehicle passing data, wherein the data which meets the second preset condition is as follows: matching with the target extraction authority information and containing the same bayonet identification as the new first vehicle passing data;
and C: judging whether the number of the determined new second vehicle passing data is not less than a first number, wherein the first number is equal to: adding one to the first preset quantity, and subtracting the determined quantity of the first data to be audited;
step D: when the determined number of the new second vehicle passing data is not less than the first number, selecting the previous first number of vehicle passing data in the new second vehicle passing data as target data to be audited;
and returning to the step A when the determined number of the new second passing data is smaller than the first number.
In connection with the above example, the target extraction authority information includes: the vehicle type comprises a bayonet mark, a bayonet mark 1, a bayonet mark 2 and a bayonet mark 3, and the illegal type comprises a car, a illegal type, illegal parking and red light grabbing; arranging the data of the vehicles to be audited in time sequence; the first predetermined number is 19;
after the electronic equipment determines second vehicle passing data according to the flow, determining whether the number of the determined second vehicle passing data is not less than 19;
when it is determined that it is not less than 19, for example: when the number of the determined second vehicle passing data is 20, determining the first 19 vehicle passing data in the determined 20 second vehicle passing data as target to-be-checked data;
when it is determined that less than 19, for example: when the number of the determined second vehicle passing data is 10, the electronic device traverses other first data to be checked except the determined target data to be checked according to the arrangement sequence of the first data to be checked, determines first data to be checked, which is matched with the target extraction authority information, as new first vehicle passing data, namely determines that the first included bayonet identifier is a bayonet identifier 1, a bayonet identifier 2 or a bayonet identifier 3, the included vehicle type is a car, the included data to be checked, which is illegal parking or red light violation, is used as new first vehicle passing data, and when the new first vehicle passing data is determined, the included bayonet identifier is a bayonet identifier 1;
at this time, the electronic device continuously traverses other first data to be audited except the data determined as the target data to be audited, sequentially determines the first data to be audited meeting a second preset condition as second vehicle passing data, namely sequentially determines that the included gate identifier is the gate identifier 1, the included vehicle type is a car, and the included vehicle data to be audited with the illegal type of illegal parking or red light is used as new second vehicle passing data;
the electronic equipment judges whether the determined number of the new second vehicle passing data is not less than a first number 8(19+1- (1+10+1), namely a first preset number + 1-the determined number of the first data to be audited);
when the determined number of the new second vehicle passing data is not less than 8 of the first number, selecting the previous 8 vehicle passing data in the new second vehicle passing data as target data to be audited;
and when the determined number of the new second vehicle passing data is smaller than the first number 8, the electronic equipment returns to execute the operation according to the arrangement sequence of the first data to be checked, traverses other first data to be checked except the data determined as the target data to be checked, and determines the first data to be checked matched with the target extraction permission information as new first vehicle passing data.
And when all the determined target data to be checked reach the first preset quantity plus one (20), or when no first data to be checked matched with the target extraction authority information exists in other first data to be checked except the determined target data to be checked, extracting all the determined target data to be checked, and executing a subsequent process.
After the target data to be audited is sent to the client, the method may further include:
obtaining an auditing result fed back by the client and aiming at the extracted target to-be-audited data;
marking target to-be-audited data stored in the first storage device as an audited state; and deleting the target to-be-checked data stored in the preset storage space.
It can be understood that, after the electronic device sends the determined target data to be audited to the client, the client may display the target data to be audited, and an auditor may audit the target data to be audited. It can be understood that, after an auditor has audited a target to-be-audited data, an audit result for the target to-be-audited data may be sent to the electronic device through the client, where the audit result may include identification information of the target to-be-audited data and information that the target to-be-audited data is audited as valid by the auditor, or the audit result may include identification information of the target to-be-audited data and information that the target to-be-audited data is audited as invalid by the auditor.
After the electronic device obtains the auditing result for the target to-be-audited data, when the auditing result identifies that the target to-be-audited data is audited to be valid, namely the auditing result contains information which can represent that the target to-be-audited data is audited to be valid by an auditor, the electronic device can mark the target to-be-audited data stored in the first storage device to be in an audited state; and deleting the target to-be-checked data stored in the preset storage space. In an implementation manner, the electronic device may search the target data to be audited from the first storage device and the preset storage space respectively according to the identification information of the target data to be audited included in the audit result.
When the audit result identifies that the target to-be-audited nuclear data is audited to be invalid, namely the audit result contains information which can represent that the target to-be-audited nuclear data is audited to be invalid by auditors, the electronic equipment can also mark the target to-be-audited nuclear data stored in the first storage equipment to be in an audited state; and deleting the target to-be-checked data stored in the preset storage space. This is all possible.
In an implementation manner, the electronic device may count, for different bayonet identifiers, an audit result that the obtained identifier target to-be-audited data is audited to be invalid, where a corresponding number of the to-be-audited data including the bayonet identifier may be referred to as a second number, and count a number of the to-be-audited data including the bayonet identifier may be referred to as a first number. Further, for different bayonet identifications, the ratio of the second quantity and the first quantity corresponding to the bayonet identification is calculated, and when the ratio exceeds a first preset ratio threshold, the image acquisition device corresponding to the bayonet is considered to be in fault. And (4) subsequently. When data extraction conditions are set, the data to be audited containing the bayonet identification are prevented from being extracted to a preset storage space.
In another implementation manner, the electronic device may count the number of the target audit data extracted by the auditor according to the user identifiers of different auditors, that is, the number of the target audit data audited by the auditor is referred to as a third number; counting the number of the target to-be-audited data audited as invalid by the auditor, namely the number of the audit results which are fed back by the auditor and identify the target to-be-audited data audited as invalid, wherein the number is called as a fourth number; furthermore, the electronic device may calculate a ratio of the fourth quantity to the third quantity, and when the ratio exceeds a second preset ratio threshold, the electronic device may warn the auditor, and may perform secondary auditing on target auditing data audited by the auditor, so as to avoid a behavior of committing illegalities for the auditor. Furthermore, the accuracy of the vehicle passing data auditing result is improved.
It can be understood that, when an auditor audits target audit data, it is necessary to refer to an image and/or a video corresponding to the target audit data, and when the auditor audits the target audit data according to the image and/or the video corresponding to the target audit data, an upload instruction for uploading the target audit data to a penalty platform is triggered, and after the electronic device obtains the upload instruction, it may be considered that the upload instruction is: the audit result fed back by the auditor can identify that the target to-be-audited data is audited as a valid audit result;
the electronic equipment judges whether the target audit data is audited or not, and when the target audit data is determined to be audited, the process is ended; if the target audit data is determined to be not audited, judging whether other target audit data which are the same as the vehicle identification contained in the target audit data and the illegal type contained in the target audit data are uploaded;
when the uploading is determined not to be carried out, the electronic equipment marks the target to-be-audited data stored in the first storage equipment to be in an audited state; compressing the image and/or video corresponding to the target audit data, uploading the target audit data and the image and/or video corresponding to the target audit data to a punishment platform, and deleting the target to-be-audited data stored in a preset storage space by the electronic equipment after receiving the data fed back by the punishment platform and the information of completing the image and/or video reception;
when the uploading is determined, the electronic equipment sends information for prompting whether the auditor continues to upload to the client, and the client displays the prompting information; when the electronic equipment receives a command for continuing uploading fed back by the client; marking target to-be-audited data stored in the first storage device as an audited state; and compressing the image and/or video corresponding to the target audit data, uploading the target audit data and the image and/or video corresponding to the target audit data to a punishment platform, and deleting the target to-be-audited data stored in the preset storage space by the electronic equipment after receiving the data fed back by the punishment platform and the information that the image and/or video is received.
Fig. 5 is a schematic view illustrating a process of auditing vehicle passing data according to an embodiment of the present invention; corresponding to the schematic view of the process of checking vehicle-passing data shown in fig. 1, in the process shown in fig. 5, after obtaining the first type of data extraction instruction, the "illegal checking platform" (equivalent to the electronic device) may first extract the data to be checked that meets the data extraction condition from the first storage device according to the data extraction condition set by the device corresponding to the "illegal pool" (equivalent to the preset storage space), and store the data to be checked in the "illegal pool"; subsequently, when the "illegal auditing platform" obtains a second-class data extraction instruction of the client aiming at the "illegal pool", the second-class data extraction instruction carries: target user identification of a target auditor; the illegal auditing platform determines extraction permission information corresponding to the target user identification as target extraction permission information according to a preset corresponding relationship (a corresponding relationship between a plurality of pairs of user identifications and the extraction permission information) and the target user identification; extracting first data to be checked, which is matched with the target extraction authority information, from the illegal pool according to the target extraction authority information to serve as target data to be checked; and sent to the client. Meanwhile, the illegal auditing platform can also determine images and/or videos corresponding to each target data to be audited from the second storage device according to the determined target data to be audited and send the images and/or videos to the client;
it can be understood that the number of the data to be audited is very large, and multiple auditors are required to audit cooperatively. Moreover, the illegal auditing platform can also configure data issuing permission for the auditors according to the functions of the auditors; when the auditor with the data issuing authority obtains the target to-be-audited data, the obtained target to-be-audited data can be issued to other auditors.
Corresponding to the foregoing method embodiment, an embodiment of the present invention further provides a data extraction apparatus, and as shown in fig. 6, the apparatus may include:
a first obtaining module 610, configured to obtain a data extraction condition set corresponding to a preset storage space after obtaining a first type of data extraction instruction, where the data extraction condition is: conditions for filtering invalid vehicle passing data;
a first extracting module 620, configured to extract, from data to be checked stored in the first storage device, data to be checked that meets the data extraction condition, where the data to be checked is used as first data to be checked;
the first storage module 630 is configured to store the extracted first data to be audited in the preset storage space, so that an auditor extracts data from the preset storage space.
By applying the embodiment of the invention, the first data to be audited, which does not contain the invalid vehicle passing data, can be extracted from the first storage device based on the set data extraction condition for filtering the invalid vehicle passing data, the extracted first data to be audited is stored in the preset storage space, and subsequently, the auditor can extract the data to be audited from the preset storage space. Therefore, invalid vehicle passing data do not exist in the data extracted by the auditors, the workload of the auditors is reduced to a certain extent, and the auditing efficiency of the auditors is improved. In addition, invalid vehicle passing data do not exist in the data extracted by the auditor, the condition that the auditor audits the invalid vehicle passing data to be valid is avoided, the auditing accuracy of the auditor is improved to a certain extent, and the condition of misaudit is avoided.
In one implementation, the data extraction condition at least includes a preset effective duration;
the device further comprises: the device comprises a first judging module and a second extracting module;
the first judging module is configured to extract, from the data to be audited stored in the first storage device, the data to be audited that meets the data extraction condition, and before the data to be audited is taken as the first data to be audited, judge whether the data to be audited that is marked with a preset abnormal data identifier and meets other conditions except for the preset valid duration in the data extraction condition exists in the first storage device, where the preset abnormal data identifier is: after the data to be audited stored in the preset storage space is extracted, and after an audit result fed back aiming at the extracted data to be audited is not obtained after the preset audit duration is exceeded, the data to be audited is marked; when the judgment result is yes, triggering the second extraction module;
the second extraction module is used for extracting the to-be-inspected data which is marked with the preset abnormal data identifier and meets other conditions except the preset effective duration in the data extraction conditions, and the to-be-inspected data is used as abnormal data;
the first storage module is specifically configured to store the extracted abnormal data and the extracted first data to be audited in the preset storage space.
In one implementation, the data extraction condition includes a target bayonet identification;
the first extraction module 620 is specifically configured to
And extracting the data to be audited containing the target bayonet identification from the data to be audited stored in the first storage device to serve as the first data to be audited.
In one implementation, the data extraction condition includes a preset effective duration;
the device also comprises a determining module, a first deleting module, a second deleting module, a third extracting module and a second storing module;
the determining module is configured to, before extracting, from the data to be audited stored in the first storage device, the data to be audited that meets the data extraction condition, determine whether the data extraction condition is modified with respect to a data extraction condition obtained when the first-class data extraction instruction was obtained last time before the data is taken as the first data to be audited, trigger the first deleting module when the data is determined to be modified, and trigger the second deleting module when the data is determined to be unmodified;
the first deleting module is used for deleting all the data to be audited stored in the preset storage space; triggering the first extraction module 620;
the second deleting module is configured to delete expired pending audit data that has been stored in the preset storage space, where the expired pending audit data is: the absolute value of the difference value between the corresponding acquired time and the current time exceeds the data to be audited with the preset effective duration;
the third extraction module is configured to extract, from the data to be checked stored in the first storage device, the data to be checked, which meets the data extraction condition and is not stored in the preset storage space, as second data to be checked;
and the second storage module is used for storing the extracted second to-be-examined data in the preset storage space.
In one implementation, the determining module is specifically configured to
Determining whether a preset modification flag bit corresponding to the data extraction condition is a preset value, wherein when the preset value is determined, the data extraction condition is modified relative to the data extraction condition obtained when the first-class data extraction instruction is obtained last time; when the determination is not the predetermined value, it indicates that the data fetch condition has not been modified relative to the data fetch condition at the previous time the first type of data fetch instruction was obtained.
In one implementation manner, the apparatus further includes a second determining module, a second obtaining module, and an updating module;
the second judging module is configured to, after the data extraction condition set corresponding to the preset storage space is obtained, judge whether the first to-be-audited data marked with the preset extracted identifier exists in the preset storage space, where the preset extracted identifier is: after the first data to be audited stored in the preset storage space is extracted, marking the first data to be audited; when judging that the first to-be-audited data marked with the preset extracted identification does not exist, triggering the second obtaining module;
the second obtaining module is used for obtaining an operation result corresponding to the preset operation instruction;
and the updating module is used for updating the data extraction condition based on the obtained operation result.
In one implementation, the apparatus further comprises: the device comprises a third obtaining module, a fourth extracting module and a sending module;
the third obtaining module is configured to obtain a second type of data extraction instruction, which is sent by a client and is for the preset storage space, after the obtained first data to be audited is stored in the preset storage space, where the second type of data extraction instruction is: and a command sent by a target auditor logging in the client, wherein the second type data extraction command carries: the target user identification of the target auditor;
the fourth obtaining module is configured to obtain, according to a preset corresponding relationship and the target user identifier, extraction permission information corresponding to the target user identifier as target extraction permission information, where the preset corresponding relationship includes: the method comprises the following steps of corresponding relations between a plurality of pairs of user identifications and extraction authority information, wherein the extraction authority information is as follows: the information is used for representing the authority of the corresponding auditor for extracting the data;
the fourth extraction module is configured to extract the data to be checked, which matches the target extraction permission information, from the first data to be checked stored in the preset storage space, and use the data as target data to be checked;
and the sending module is used for sending the target to-be-audited data to the client.
In one implementation, the apparatus further comprises: a fifth obtaining module and a mark deleting module;
the fifth obtaining module is configured to obtain an audit result, fed back by the client, for the extracted target to-be-audited data after the target to-be-audited data is sent to the client;
the mark deleting module is used for marking the target data to be audited stored in the first storage device as an audited state; and deleting the target to-be-examined data stored in the preset storage space.
An embodiment of the present invention further provides an electronic device, as shown in fig. 7, including a processor 710, a communication interface 720, a memory 730, and a communication bus 740, where the processor 710, the communication interface 720, and the memory 730 complete mutual communication through the communication bus 740,
a memory 730 for storing a computer program;
the processor 710 is configured to, when executing the computer program stored in the memory 730, implement any of the above-mentioned data extraction method steps provided by the embodiments of the present invention, where the method includes the following steps:
after a first type of data extraction instruction is obtained, obtaining a data extraction condition set corresponding to a preset storage space, wherein the data extraction condition is as follows: conditions for filtering invalid vehicle passing data;
extracting the data to be checked meeting the data extraction condition from the data to be checked stored in the first storage device to serve as first data to be checked;
and storing the extracted first data to be audited in the preset storage space so that auditors can extract data from the preset storage space.
By applying the embodiment of the invention, the first data to be audited, which does not contain the invalid vehicle passing data, can be extracted from the first storage device based on the set data extraction condition for filtering the invalid vehicle passing data, the extracted first data to be audited is stored in the preset storage space, and subsequently, the auditor can extract the data to be audited from the preset storage space. Therefore, invalid vehicle passing data do not exist in the data extracted by the auditors, the workload of the auditors is reduced to a certain extent, and the auditing efficiency of the auditors is improved. In addition, invalid vehicle passing data do not exist in the data extracted by the auditor, the condition that the auditor audits the invalid vehicle passing data to be valid is avoided, the auditing accuracy of the auditor is improved to a certain extent, and the condition of misaudit is avoided.
In one implementation, the data extraction condition at least includes a preset effective duration;
before extracting the to-be-audited data meeting the data extraction condition from the to-be-audited data stored in the first storage device, as the first to-be-audited data, the method further includes:
judging whether the first storage device has the to-be-checked data which is marked with a preset abnormal data identifier and meets other conditions except the preset effective duration in the data extraction condition, wherein the preset abnormal data identifier is as follows: after the data to be audited stored in the preset storage space is extracted, and after an audit result fed back aiming at the extracted data to be audited is not obtained after the preset audit duration is exceeded, the data to be audited is marked;
when the data is judged to exist, extracting the to-be-checked data which are marked with the preset abnormal data identification and meet other conditions except the preset effective duration in the data extraction conditions as abnormal data;
the step of storing the extracted first data to be audited in the preset storage space includes:
and storing the extracted abnormal data and the extracted first data to be audited in the preset storage space.
In one implementation, the data extraction condition includes a target bayonet identification;
the method for extracting the data to be audited meeting the data extraction condition from the data to be audited stored in the first storage device as the first data to be audited includes:
and extracting the data to be audited containing the target bayonet identification from the data to be audited stored in the first storage device to serve as the first data to be audited.
In one implementation, the data extraction condition includes a preset effective duration;
before extracting the to-be-audited data meeting the data extraction condition from the to-be-audited data stored in the first storage device, as the first to-be-audited data, the method further includes:
determining whether the data extraction condition is modified relative to the data extraction condition obtained when the first-class data extraction instruction was obtained last time;
when the data are determined to be modified, deleting all the data to be audited stored in the preset storage space; executing the data to be checked stored in the first storage device, and extracting the data to be checked meeting the data extraction condition to serve as first data to be checked;
when the data is determined to be unmodified, deleting expired pending verification data stored in the preset storage space, wherein the expired pending verification data is as follows: the absolute value of the difference value between the corresponding acquired time and the current time exceeds the data to be audited with the preset effective duration;
extracting the to-be-examined data which meets the data extraction condition and is not stored in the preset storage space from the to-be-examined data stored in the first storage device to serve as second to-be-examined data;
and storing the extracted second to-be-checked data in the preset storage space.
In one implementation, the determining whether the data fetch condition has been modified with respect to a data fetch condition that was previously obtained for the first type of data fetch instruction includes:
determining whether a preset modification flag bit corresponding to the data extraction condition is a preset value, wherein when the preset value is determined, the data extraction condition is modified relative to the data extraction condition obtained when the first-class data extraction instruction is obtained last time; when the determination is not the predetermined value, it indicates that the data fetch condition has not been modified relative to the data fetch condition at the previous time the first type of data fetch instruction was obtained.
In one implementation manner, after the obtaining of the data extraction condition corresponding to the preset storage space setting, the method further includes:
judging whether first to-be-audited data marked with preset extracted identifications exist in the preset storage space, wherein the preset extracted identifications are as follows: after the first data to be audited stored in the preset storage space is extracted, marking the first data to be audited;
when judging that the first to-be-audited data marked with the preset extracted identification does not exist, obtaining an operation result corresponding to a preset operation instruction;
updating the data extraction condition based on the obtained operation result.
In one implementation manner, after the storing the obtained first data to be audited in the preset storage space, the method further includes:
obtaining a second-class data extraction instruction which is sent by a client and aims at the preset storage space, wherein the second-class data extraction instruction is as follows: and a command sent by a target auditor logging in the client, wherein the second type data extraction command carries: the target user identification of the target auditor;
acquiring extraction authority information corresponding to the target user identification as target extraction authority information according to a preset corresponding relation and the target user identification, wherein the preset corresponding relation comprises: the method comprises the following steps of corresponding relations between a plurality of pairs of user identifications and extraction authority information, wherein the extraction authority information is as follows: the information is used for representing the authority of the corresponding auditor for extracting the data;
extracting the data to be checked matched with the target extraction authority information from the first data to be checked stored in the preset storage space to serve as target data to be checked;
and sending the target to-be-examined data to the client.
In one implementation, after the sending the target to-be-reviewed data to the client, the method further includes:
obtaining an auditing result fed back by the client and aiming at the extracted target to-be-audited data;
marking the target data to be audited stored in the first storage device as an audited state; and deleting the target to-be-examined data stored in the preset storage space.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Optionally, the memory may also be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
Corresponding to the above method embodiment, an embodiment of the present invention provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements any of the above data extraction method steps provided by the embodiment of the present invention, where the method may include the following steps:
after a first type of data extraction instruction is obtained, obtaining a data extraction condition set corresponding to a preset storage space, wherein the data extraction condition is as follows: conditions for filtering invalid vehicle passing data;
extracting the data to be checked meeting the data extraction condition from the data to be checked stored in the first storage device to serve as first data to be checked;
and storing the extracted first data to be audited in the preset storage space so that auditors can extract data from the preset storage space.
By applying the embodiment of the invention, the first data to be audited, which does not contain the invalid vehicle passing data, can be extracted from the first storage device based on the set data extraction condition for filtering the invalid vehicle passing data, the extracted first data to be audited is stored in the preset storage space, and subsequently, the auditor can extract the data to be audited from the preset storage space. Therefore, invalid vehicle passing data do not exist in the data extracted by the auditors, the workload of the auditors is reduced to a certain extent, and the auditing efficiency of the auditors is improved. In addition, invalid vehicle passing data do not exist in the data extracted by the auditor, the condition that the auditor audits the invalid vehicle passing data to be valid is avoided, the auditing accuracy of the auditor is improved to a certain extent, and the condition of misaudit is avoided.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.

Claims (16)

1. A method of data extraction, the method comprising:
after a first type of data extraction instruction is obtained, obtaining a data extraction condition set corresponding to a preset storage space, wherein the data extraction condition is as follows: conditions for filtering invalid vehicle passing data;
extracting the data to be checked meeting the data extraction condition from the data to be checked stored in the first storage device to serve as first data to be checked;
storing the extracted first data to be audited in the preset storage space so that auditors can extract data from the preset storage space;
the method further comprises the following steps:
judging whether the first storage device has the data to be checked which is marked with a preset abnormal data identifier and meets the data extraction condition, wherein the preset abnormal data identifier is as follows: after the data to be audited stored in the preset storage space is extracted, and after an audit result fed back aiming at the extracted data to be audited is not obtained after the preset audit duration is exceeded, the data to be audited is marked;
when the data is judged to exist, extracting the to-be-checked data which are marked with preset abnormal data identifications and meet the data extraction conditions as abnormal data;
and storing the extracted abnormal data in the preset storage space so that the auditor can extract the data from the preset storage space.
2. The method according to claim 1, wherein the data extraction conditions comprise target bayonet identification;
the step of extracting the to-be-audited data meeting the data extraction condition from the to-be-audited data stored in the first storage device as the first to-be-audited data includes:
and extracting the data to be audited containing the target bayonet identification from the data to be audited stored in the first storage device to serve as the first data to be audited.
3. The method of claim 1, wherein the data extraction condition comprises a preset effective duration;
before the step of extracting the to-be-audited data meeting the data extraction condition from the to-be-audited data stored in the first storage device, as the first to-be-audited data, the method further includes:
determining whether the data extraction condition is modified relative to the data extraction condition obtained when the first-class data extraction instruction was obtained last time;
when the data are determined to be modified, deleting all the data to be audited stored in the preset storage space; executing the step of extracting the data to be checked meeting the data extraction condition from the data to be checked stored in the first storage device to be used as the first data to be checked;
when the data is determined to be unmodified, deleting expired pending verification data stored in the preset storage space, wherein the expired pending verification data is as follows: the absolute value of the difference value between the corresponding acquired time and the current time exceeds the data to be audited with the preset effective duration;
extracting the to-be-examined data which meets the data extraction condition and is not stored in the preset storage space from the to-be-examined data stored in the first storage device to serve as second to-be-examined data;
and storing the extracted second to-be-checked data in the preset storage space.
4. The method of claim 3, wherein the step of determining whether the data fetch condition was modified relative to a data fetch condition that was previously obtained for the first class of data fetch instructions comprises:
determining whether a preset modification flag bit corresponding to the data extraction condition is a preset value, wherein when the preset value is determined, the data extraction condition is modified relative to the data extraction condition obtained when the first-class data extraction instruction is obtained last time; when the determination is not the predetermined value, it indicates that the data fetch condition has not been modified relative to the data fetch condition at the previous time the first type of data fetch instruction was obtained.
5. The method according to claim 1, wherein after the step of obtaining the data extraction condition corresponding to the preset storage space setting, the method further comprises:
judging whether first to-be-audited data marked with preset extracted identifications exist in the preset storage space, wherein the preset extracted identifications are as follows: after the first data to be audited stored in the preset storage space is extracted, marking the first data to be audited;
when judging that the first to-be-audited data marked with the preset extracted identification does not exist, obtaining an operation result corresponding to a preset operation instruction;
updating the data extraction condition based on the obtained operation result.
6. The method according to any one of claims 1 to 5, wherein after the step of storing the extracted first data to be audited in the preset storage space, the method further comprises:
obtaining a second-class data extraction instruction which is sent by a client and aims at the preset storage space, wherein the second-class data extraction instruction is as follows: and a command sent by a target auditor logging in the client, wherein the second type data extraction command carries: the target user identification of the target auditor;
acquiring extraction authority information corresponding to the target user identification as target extraction authority information according to a preset corresponding relation and the target user identification, wherein the preset corresponding relation comprises: the method comprises the following steps of corresponding relations between a plurality of pairs of user identifications and extraction authority information, wherein the extraction authority information is as follows: the information is used for representing the authority of the corresponding auditor for extracting the data;
extracting the data to be checked matched with the target extraction authority information from the first data to be checked stored in the preset storage space to serve as target data to be checked;
and sending the target to-be-examined data to the client.
7. The method of claim 6, wherein after the step of sending the target audit data to the client, the method further comprises:
obtaining an auditing result fed back by the client and aiming at the extracted target to-be-audited data;
marking the target data to be audited stored in the first storage device as an audited state; and deleting the target to-be-examined data stored in the preset storage space.
8. A data extraction apparatus, characterized in that the apparatus comprises:
the first obtaining module is used for obtaining a data extraction condition set corresponding to a preset storage space after obtaining a first type of data extraction instruction, wherein the data extraction condition is as follows: conditions for filtering invalid vehicle passing data;
the first extraction module is used for extracting the data to be checked meeting the data extraction conditions from the data to be checked stored in the first storage device to be used as first data to be checked;
the first storage module is used for storing the extracted first data to be audited in the preset storage space so as to enable auditors to extract data from the preset storage space;
a first determining module, configured to determine whether to-be-checked data marked with a preset abnormal data identifier and meeting the data extraction condition exists in the first storage device, where the preset abnormal data identifier is: after the data to be audited stored in the preset storage space is extracted, and after an audit result fed back aiming at the extracted data to be audited is not obtained after the preset audit duration is exceeded, the data to be audited is marked; when the judgment result is yes, triggering a second extraction module;
the second extraction module is used for extracting the to-be-checked data which are marked with the preset abnormal data identifications and meet the data extraction conditions as abnormal data;
the first storage module is further configured to store the extracted abnormal data in the preset storage space, so that an auditor extracts data from the preset storage space.
9. The apparatus according to claim 8, wherein the data extraction condition comprises a target bayonet identification;
the first extraction module is specifically used for
And extracting the data to be audited containing the target bayonet identification from the data to be audited stored in the first storage device to serve as the first data to be audited.
10. The apparatus of claim 8, wherein the data extraction condition comprises a preset validity duration;
the device also comprises a determining module, a first deleting module, a second deleting module, a third extracting module and a second storing module;
the determining module is configured to, before extracting, from the data to be audited stored in the first storage device, the data to be audited that meets the data extraction condition, determine whether the data extraction condition is modified with respect to a data extraction condition obtained when the first-class data extraction instruction was obtained last time before the data is taken as the first data to be audited, trigger the first deleting module when the data is determined to be modified, and trigger the second deleting module when the data is determined to be unmodified;
the first deleting module is used for deleting all the data to be audited stored in the preset storage space; triggering the first extraction module;
the second deleting module is configured to delete expired pending audit data that has been stored in the preset storage space, where the expired pending audit data is: the absolute value of the difference value between the corresponding acquired time and the current time exceeds the data to be audited with the preset effective duration;
the third extraction module is configured to extract, from the data to be checked stored in the first storage device, the data to be checked, which meets the data extraction condition and is not stored in the preset storage space, as second data to be checked;
and the second storage module is used for storing the extracted second to-be-examined data in the preset storage space.
11. Device according to claim 10, characterized in that said determination module is particularly adapted to
Determining whether a preset modification flag bit corresponding to the data extraction condition is a preset value, wherein when the preset value is determined, the data extraction condition is modified relative to the data extraction condition obtained when the first-class data extraction instruction is obtained last time; when the determination is not the predetermined value, it indicates that the data fetch condition has not been modified relative to the data fetch condition at the previous time the first type of data fetch instruction was obtained.
12. The apparatus according to claim 8, further comprising a second determining module, a second obtaining module and an updating module;
the second judging module is configured to, after the data extraction condition set corresponding to the preset storage space is obtained, judge whether the first to-be-audited data marked with the preset extracted identifier exists in the preset storage space, where the preset extracted identifier is: after the first data to be audited stored in the preset storage space is extracted, marking the first data to be audited; when judging that the first to-be-audited data marked with the preset extracted identification does not exist, triggering the second obtaining module;
the second obtaining module is used for obtaining an operation result corresponding to the preset operation instruction;
and the updating module is used for updating the data extraction condition based on the obtained operation result.
13. The apparatus of any one of claims 8-12, further comprising: the device comprises a third obtaining module, a fourth extracting module and a sending module;
the third obtaining module is configured to obtain a second type of data extraction instruction, which is sent by a client and is for the preset storage space, after the extracted first data to be audited is stored in the preset storage space, where the second type of data extraction instruction is: and a command sent by a target auditor logging in the client, wherein the second type data extraction command carries: the target user identification of the target auditor;
the fourth obtaining module is configured to obtain, according to a preset corresponding relationship and the target user identifier, extraction permission information corresponding to the target user identifier as target extraction permission information, where the preset corresponding relationship includes: the method comprises the following steps of corresponding relations between a plurality of pairs of user identifications and extraction authority information, wherein the extraction authority information is as follows: the information is used for representing the authority of the corresponding auditor for extracting the data;
the fourth extraction module is configured to extract the data to be checked, which matches the target extraction permission information, from the first data to be checked stored in the preset storage space, and use the data as target data to be checked;
and the sending module is used for sending the target to-be-audited data to the client.
14. The apparatus of claim 13, further comprising: a fifth obtaining module and a mark deleting module;
the fifth obtaining module is configured to obtain an audit result, fed back by the client, for the extracted target to-be-audited data after the target to-be-audited data is sent to the client;
the mark deleting module is used for marking the target data to be audited stored in the first storage device as an audited state; and deleting the target to-be-examined data stored in the preset storage space.
15. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the steps of the data extraction method of any one of claims 1 to 7 when executing the computer program stored in the memory.
16. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the data extraction method steps of any one of claims 1 to 7.
CN201810202074.1A 2017-12-29 2018-03-12 Data extraction method and device Active CN110019947B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN2017114770852 2017-12-29
CN201711477085 2017-12-29

Publications (2)

Publication Number Publication Date
CN110019947A CN110019947A (en) 2019-07-16
CN110019947B true CN110019947B (en) 2021-06-04

Family

ID=67188239

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810202074.1A Active CN110019947B (en) 2017-12-29 2018-03-12 Data extraction method and device

Country Status (1)

Country Link
CN (1) CN110019947B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111813966B (en) * 2020-07-13 2024-02-27 湖南快乐阳光互动娱乐传媒有限公司 Data auditing method and device
CN111831953B (en) * 2020-07-20 2024-03-15 汉海信息技术(上海)有限公司 Data processing method, device, equipment and storage medium
CN114389862A (en) * 2021-12-29 2022-04-22 中科信息安全共性技术国家工程研究中心有限公司 Network illegal information detection system capable of improving monitoring performance

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090010259A (en) * 2007-07-20 2009-01-30 전병태 System and method for regulating illegal headlight vehicles
CN101944292A (en) * 2010-09-16 2011-01-12 公安部交通管理科学研究所 Suspected vehicle analysis method based on track collision
CN104732765A (en) * 2015-03-30 2015-06-24 杭州电子科技大学 Real-time urban road saturability monitoring method based on checkpoint data
CN106355924A (en) * 2016-09-06 2017-01-25 江苏智通交通科技有限公司 Traffic data quality monitoring system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20090010259A (en) * 2007-07-20 2009-01-30 전병태 System and method for regulating illegal headlight vehicles
CN101944292A (en) * 2010-09-16 2011-01-12 公安部交通管理科学研究所 Suspected vehicle analysis method based on track collision
CN104732765A (en) * 2015-03-30 2015-06-24 杭州电子科技大学 Real-time urban road saturability monitoring method based on checkpoint data
CN106355924A (en) * 2016-09-06 2017-01-25 江苏智通交通科技有限公司 Traffic data quality monitoring system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
高清智能卡口管理平台设计与实现;张建伟;《中国优秀硕士学位论文全文数据库信息科技辑》;20160315;正文第11-14页、第25-28页 *

Also Published As

Publication number Publication date
CN110019947A (en) 2019-07-16

Similar Documents

Publication Publication Date Title
CN110019947B (en) Data extraction method and device
CN106056347A (en) Engineering project management cloud platform system based on video monitoring
CN102956107A (en) Parking lot vehicle parking information acquisition and false license, slip license and illegal vehicle recognition system and method
CN111477007A (en) Vehicle checking, controlling, analyzing and managing system and method
CN107301780A (en) Vehicle information management system, method and terminal equipment
CN109993967B (en) Data extraction method and device
CN113591824B (en) Traffic violation data entry anomaly detection method and device
CN112711757B (en) Data security centralized management and control method and system based on big data platform
CN111709603A (en) Service request processing method, device and system based on wind control
CN109949569A (en) A kind of traffic violation data auditing system and its implementation
CN110969860B (en) Background auditing system and method for traffic law violation behaviors
CN113487877A (en) Road vehicle illegal parking monitoring method
CN106571040A (en) Suspicious vehicle confirmation method and equipment
CN108965317B (en) Network data protection system
CN116935659B (en) High-speed service area bayonet vehicle auditing system and method thereof
JPWO2022009715A5 (en)
CN207070219U (en) Projects supervision system based on video monitoring
CN112528325B (en) Data information security processing method and system
CN111914591A (en) Duration determination method and device
CN112668783B (en) Aircraft-based data processing method, device, equipment and readable storage medium
CN113569722A (en) Event processing method and device, electronic equipment and computer readable storage medium
CN108335050A (en) A kind of event worksheet processing intelligent control method and control device
CN106934702A (en) False invoice monitoring method and device
CN110718071B (en) Verification method and device for image acquisition equipment, computer equipment and storage medium
CN112565741B (en) Video fault processing method and device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant