CN111858779A - Data analysis method and device, electronic equipment and storage medium - Google Patents
Data analysis method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111858779A CN111858779A CN202010508187.1A CN202010508187A CN111858779A CN 111858779 A CN111858779 A CN 111858779A CN 202010508187 A CN202010508187 A CN 202010508187A CN 111858779 A CN111858779 A CN 111858779A
- Authority
- CN
- China
- Prior art keywords
- data
- target
- identifier
- request
- clue
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/55—Clustering; Classification
Abstract
The invention provides a data analysis method, a data analysis device, electronic equipment and a storage medium, wherein the method comprises the following steps: receiving a data entry set request, wherein the data entry set request comprises a data identifier corresponding to data to be entered into a target data set and a target set identifier; putting the data corresponding to the data identification into a target data set corresponding to the target set identification, wherein the target data set comprises a plurality of data associated with the target event; receiving an analysis request for a target set identifier; and acquiring a plurality of data corresponding to the target set identification, and analyzing the plurality of data according to the analysis mode in the analysis request to obtain an analysis result. According to the invention, a plurality of data related to the target event can be classified into one target data set, so that the problem that the data of one target event cannot be collected is solved, and the target event can be analyzed according to a plurality of data in the target data set, so that the analysis of the target event is realized.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a data analysis method and apparatus, an electronic device, and a storage medium.
Background
In the prior art, when images or other information are managed, only images of the same person or other information related to the person can be put into one set, and for example, a plurality of pictures taken by a person a can be put into one set.
However, a plurality of data belonging to the same set may belong to different events, and data of the same event may belong to different sets, so that information related to the same event cannot be analyzed.
Disclosure of Invention
In view of the above problems, embodiments of the present invention are proposed to provide a data analysis method, apparatus, electronic device and storage medium that overcome or at least partially solve the above problems.
According to a first aspect of the embodiments of the present invention, there is provided a data analysis method, including:
receiving a data entry set request, wherein the data entry set request comprises a data identifier corresponding to data to be entered into a target data set and a target set identifier corresponding to the target data set;
according to the data entry set request, data corresponding to the data identification are entered into a target data set corresponding to the target set identification, and the target data set comprises a plurality of data associated with a target event;
Receiving an analysis request for the target set identification;
and acquiring a plurality of data corresponding to the target set identifier, and analyzing the plurality of data according to the analysis mode in the analysis request to obtain an analysis result.
According to a second aspect of embodiments of the present invention, there is provided a data analysis apparatus including:
the data entry request receiving module is used for receiving a data entry set request, wherein the data entry set request comprises a data identifier corresponding to data to be entered into a target data set and a target set identifier corresponding to the target data set;
the data entry module is used for entering the data corresponding to the data identifier into a target data set corresponding to the target set identifier according to the data entry set request, wherein the target data set comprises a plurality of data related to a target event;
an analysis request receiving module, configured to receive an analysis request for the target set identifier;
and the data analysis module is used for acquiring a plurality of data corresponding to the target set identifier and analyzing the plurality of data according to the analysis mode in the analysis request to obtain an analysis result.
According to a third aspect of embodiments of the present invention, there is provided an electronic apparatus, including: a processor, a memory and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the data analysis method as described in the first aspect.
According to a fourth aspect of embodiments of the present invention, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the data analysis method according to the first aspect.
The data analysis method, the device, the electronic equipment and the storage medium provided by the embodiment of the invention receive the data input request comprising the data identification and the target set identification, input the data corresponding to the data identification into the target data set corresponding to the target set identification, the target data set comprises a plurality of data associated with the target event, receive the analysis request of the target set identification, acquire a plurality of data corresponding to the target set identification, and analyzing the plurality of data according to the analysis mode in the analysis request to obtain an analysis result, because a plurality of data related to the target event can be classified into one target data set, the problem that the data of one target event cannot be collected is solved, and the target event can be analyzed according to a plurality of data in the target data set, so that the multi-dimensional analysis of the target event is realized.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention.
FIG. 1 is a flow chart illustrating the steps of a data analysis method according to an embodiment of the present invention;
FIG. 2 is a flow chart illustrating steps of a method for analyzing data according to an embodiment of the present invention;
fig. 3 is a block diagram of a data analysis apparatus according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention can be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
Fig. 1 is a flowchart of steps of a data analysis method provided in an embodiment of the present invention, which may be executed by an electronic device, as shown in fig. 1, where the method may include:
The data-in-set request is issued by the current user from a display page of clue data or from a display page of trace-tracking results. The clue data display page displays clue data of the current user added into the clue library. The trajectory tracking is a process of retrieving data associated with a plurality of data corresponding to the target set identifier from a data source acquired by a server according to a trajectory tracking request of a current user for the target set identifier. It is understood that the plurality of data corresponding to the target set identifier may be picture data, and the retrieving data associated with the plurality of data corresponding to the target set identifier may be retrieving picture data having a similarity higher than a threshold value with respect to the picture data and satisfying a predetermined condition in a spatiotemporal relationship according to the picture data.
In one embodiment of the present invention, the receiving the data-in-set request includes: the online data retrieval method comprises the steps of searching a data display page on line, and displaying a plurality of clue data corresponding to a current user; and receiving a data-in-set request of a current user for putting the specified clue data under the target set identification.
And the plurality of clue data corresponding to the current user are data of the current user added into the clue library. The clue data comprises at least one of a camera snapshot result, a file snapshot result, a camera alarm result, a video alarm result, a file alarm result and a local associated picture. The locally associated picture may be a picture saved in the user terminal.
When a clue data viewing request is received, clue data corresponding to a current user are obtained from a clue library, a plurality of clue data corresponding to the current user are displayed on a clue data display page, a set-in button can be displayed corresponding to each clue data, the data set-in request of the current user is received through the set-in button, if the clicking operation of the current user on the set-in button of appointed clue data is detected, a data set identifier of an existing data set is displayed, a data set identifier selected by the user is obtained and used as a target set identifier, and therefore the data set-in request of the current user for enabling the appointed clue data to be included in the target set identifier is received. The data added into the clue library is classified into the target data set by displaying the data display page. Wherein the data set identification may comprise a data set name and/or a data set ID.
In another embodiment of the present invention, the receiving the data-in-set request comprises: receiving a track tracking request for a target set identifier; acquiring a track tracking result, wherein the track tracking result is other data which is retrieved from a server and is associated with a plurality of data corresponding to the target set identification according to the track tracking request; displaying the track tracking result; and receiving a data-in-set request for putting the specified data in the track tracking result under the target set identifier.
The data in the database retrieved by the server may include camera snapshot results, file snapshot results, camera alarm results, video alarm results, file alarm results, local associated pictures, and other data.
The user can also track the data included in the data set, and when a target data set needs to be tracked, a target set identifier corresponding to the target data set is given, for example, the set identifier of the existing data set can be displayed for the user to select one set identifier as the target set identifier, so that a track tracking request of the user for the target set identifier is received; acquiring a plurality of data corresponding to the target set identifier, taking the plurality of data corresponding to the target set identifier as a retrieval basis, retrieving other data associated with the plurality of data corresponding to the target set identifier from the server, and obtaining a track tracking result, for example, retrieving other pictures associated with one or more pictures from the server according to the one or more pictures corresponding to the target set identifier; the method comprises the steps of displaying a track tracking result, enabling a user to judge a plurality of displayed data, determining whether to add a target data set, displaying an entry set button corresponding to each data on a display page of the track tracking result, displaying a set identifier of an existing data set when clicking operation of the entry set button by the user is detected, obtaining a set identifier selected by the user as a target set identifier, and receiving a data entry set request of the user for entering specified data corresponding to the entry set button into the target set identifier. The method and the device have the advantages that the track tracking of the data in the target data set is realized, more data associated with the target data set are obtained and are included in the target data set, so that the data of the target data set are enriched, and more references can be provided for judging the target event corresponding to the target data set.
The put-in-set button may be a clue type option (for example, the same option and the similar option may be included, which respectively indicate that the user determines that the data belongs to the target data set and the user considers that the data has a high probability of belonging to the target data set but is not completely determined), the user selects a clue type when putting the data in the data set, so as to select the data, and in a display page of the trajectory tracking result, the user may select a plurality of clue types of the data to be put in the data set, and click a batch put-in-set button in the display page, so as to put the data of the clue type selected by the user in the data set together.
And step 102, according to the data entry set request, entering the data corresponding to the data identifier into a target data set corresponding to the target set identifier, wherein the target data set comprises a plurality of data associated with a target event.
After receiving a data entry set request, establishing a corresponding relation between a data identifier corresponding to data to be entered into a target data set and a target set identifier, and correspondingly storing the corresponding relation and the data. The target event may be a case, such as a traffic violation case. The plurality of data associated with the target event may include data for one or more persons associated with the target event and may also include data for other things associated with the target event, e.g., the target data set may include data for person a, person B, and car C associated with the target event.
The analysis request can comprise a preset dimension aggregation request or a data viewing request; the preset dimensions may include at least one of a goal, a time, a place, a day, an hour, a device, and a latitude and longitude. The object may be an object in the data, such as a person or object in a snapshot. The equipment can be snapshot equipment, the longitude and latitude can be the longitude and latitude where the snapshot equipment is located, and the location can also be determined according to the installation location of the snapshot equipment. The data viewing request can comprise a data list page viewing request, a data detail page viewing request, a data export request or a statistical form generation request, and the like.
An analysis request of a user for the target set identification can be received through the operation page.
And 104, acquiring a plurality of data corresponding to the target set identifier, and analyzing the plurality of data according to the analysis mode in the analysis request to obtain an analysis result.
After receiving an analysis request for a target set identifier, obtaining a plurality of data corresponding to the target set identifier from a database, that is, obtaining a plurality of data in a target data set corresponding to the target set identifier, and analyzing the plurality of data according to an analysis manner in the analysis request to obtain an analysis result, for example, when the analysis request is a time aggregation request, aggregating the plurality of data according to time to obtain an analysis result.
After the analysis result is obtained, the analysis result can be output to display the analysis result. When the analysis request is a preset dimension aggregation request, the display form of the analysis result may be displayed in the form of a histogram, a pie chart, or the like. When the analysis request is a data viewing request, data is displayed or exported according to a data viewing mode in the data viewing request, for example, the generated statistical form can display data of different data sources corresponding to the target set identifier, so that the whole judging process of the target event can be recorded.
In the data analysis method provided by this embodiment, a data entry set request including a data identifier and a target set identifier is received, data corresponding to the data identifier is entered into a target data set corresponding to the target set identifier, the target data set includes a plurality of data associated with a target event, an analysis request for the target set identifier is received, a plurality of data corresponding to the target set identifier are obtained, and the plurality of data are analyzed according to an analysis manner in the analysis request, so as to obtain an analysis result.
Fig. 2 is a flowchart of steps of a data analysis method provided in an embodiment of the present invention, which may be executed by an electronic device, as shown in fig. 2, the method may include:
The data in the clue library is clue data, and is added into the clue library when a user considers that one piece of data is clue data, and the data in the clue library is bound with the user, namely, the current user can only view the clue data corresponding to the current user identifier.
The data added into the clue library and the data classified into the data set are stored through one data table, the data in the clue library and the data classified into the data set are distinguished through the fields of the data table, and the clue data are not stored through one table and the data classified into the data set are not stored through the other table, so that the storage space can be saved, the data transmission when the data in the clue library is classified into the data set is avoided, and meanwhile, the data management is facilitated.
The format of the data table is shown in table 1, and the data table may further include a thread type field, and values of the thread type field are the same or similar. The type of the clue is determined when the user adds a piece of data to the clue library, or may be determined when the trajectory tracking result is put into the data set, and of course, the type of the clue corresponding to the data in the data table may be modified by the user. The data state may include subsumed sets, ungrouped sets, deleted, or the like. The data Identifier may be a snapshot ID, an alarm ID, or a UUID (Universally Unique Identifier) generated randomly, and when the data is added to the data table from a camera snapshot result, a file snapshot result, a camera alarm result, a video alarm result, or a file alarm result, the data Identifier is the snapshot ID or the alarm ID, and when the data is added to the data table from a local associated picture, a UUID may be generated randomly as the data Identifier of the data.
TABLE 1 data sheet
When a user adds a piece of data to the clue library, the data is stored in the data table. When a user puts data of an online cable library into a data set, the data state of the data is changed from an unreported set to a ported set in a data table, and a set identifier is added to a target set identifier given by the user. When a user confirms that certain track tracking result data is classified into a data set, the data enters a data table, the clue state is that the data is classified into the set, and the set identification is recorded as a target set identification given by the user. Each piece of data is of a cable type, and a user can change the cable type corresponding to the data added to the cable library or included in the data set. The user can also delete the clue library or a certain piece of data classified in the data set, and the data state record of the corresponding data in the data table is deleted. If the data in the clue library is deleted, the data state is deleted, and the set identifier is empty; if the archived data is deleted, the data state is deleted, the set identifier is not null, namely the set identifier is the set identifier before deletion.
The current user can check the data added into the clue library, when a clue data checking request of the current user is received, the data with the data state field of which the value is not put into the set, the value of the set identification field of which is null and the value of the user identification field of which the value is the user identification of the current user are taken as the joint index, the data with the joint index are screened from the data table, and the screened data are returned to the current user. For example, the current user userid2 views the data in the clue library, and then screens the data from the data table for presentation to the current user using the data status field with a value of unreturned set, the set identification field with a value of null, and the user identification field with a value of userid 2. The current user can only view the data added by the current user to the clue library and can not view the data added by other users to the clue library.
When receiving a request for viewing the set data of the current user, the value of the data state field is the value of the set which is already entered into the set and the value of the set identification field is the set identification in the request for viewing the set data as a joint index, and the data is screened from the data table according to the joint index and displayed to the current user. For example, if the current user userid2 views the data included in the data set, the data state field is shown to the user as included, the set identification field is not null, and the set identification field is set to the user-specified set identification. The current user can see the data classified into the data set by other users, and multiple users are allowed to operate on the same data set, that is, the users are allowed to view or share the operation of other users on the same data set, because multiple users are likely to be responsible for processing one target event. Of course, whether multiple users are allowed to operate on the same data set or which users are allowed to operate on a certain data set may be set according to user requirements.
It should be noted that the data of the same data identifier may be repeatedly stored as multiple data records in the data table, because the data may be added to the clue library by different users, that is, the corresponding user identifiers are different, or the data may be added to the clue library by the same user but categorized into different data sets, that is, the corresponding set identifiers of the data are different. However, the same data added to the clue library by one user is only stored as one data record; different users belong to the same data of the same data set and only save the data as one data record.
The current user can retrieve the data in the data source through the keywords and display the retrieved data on a retrieval result display page. When receiving a retrieval request of a current user, retrieving in a data source according to keywords in the retrieval request to obtain a retrieval result, displaying the retrieval result on a retrieval result display page, wherein the current user can browse the retrieval result displayed on the retrieval result display page, if one piece of data is considered to be a clue, the piece of data can be added into a clue library, a clue adding button can be displayed corresponding to each piece of data in the retrieval result display page, and the current user can click a clue adding button corresponding to the data to be added into the clue library, so that the front end receives the clue adding request of the current user for the specified data, and can send the clue adding request to electronic equipment, and the electronic equipment receives the clue adding request of the current user for the specified data.
The current user can also track a plurality of data corresponding to the target set identifier to obtain a track tracking result, the current user can also receive a clue adding request of the current user to the specified data on a track tracking result display page, namely, a clue adding button is displayed on each data corresponding to the track tracking result display page, the current user can click the clue adding button corresponding to the data to be added to a clue library, the front end receives the clue adding request of the current user to the specified data, the front end can send the clue adding request to the electronic equipment, and the electronic equipment receives the clue adding request of the current user to the specified data.
The thread adding button may be a thread type option (for example, may include the same option and a similar option), when the user selects the specified data to be added, the thread type of the specified data is selected, so as to select the specified data, when the user selects the data to be added, the user may select a plurality of data to be added into the thread library in the above manner, and the thread adding button of the result presentation page or the trajectory tracking result presentation page is retrieved, and the front end receives a thread adding request of the plurality of specified data, so as to add the plurality of data selected by the user into the thread library together.
When a clue adding request of a current user is received, the current user is prevented from being saved for adding repeated data, whether the specified data is saved in the data table or not can be determined when the specified data is added into the clue base, if the specified data is saved, the updating time needs to be updated, and if the specified data is not saved, the specified data is saved in the data table and indicates that the specified data is the data added into the clue base.
In determining whether the specified data is already stored in the data table, this is determined by the value of a field in the data table. Because the data added to the clue library and the data included in the data set are stored in a data table, the data added to the clue library needs to be data that is not included in the data set, namely, the data state is not included in the set, the set mark is empty, and the data in the clue library is bound with the user, different users can respectively add the same data into the clue library, that is, a data record is stored in the data table corresponding to each user, so that the data identifier whose data identifier field value is the data identifier of the designated data, the data status field value is not included in the set, the set identifier field value is null, and the user identifier whose user identifier field value is the user identifier of the current user are required to be used as the joint index, and inquiring whether a data record corresponding to the joint index exists from a data table, and further determining whether the specified data is stored as clue data according to an inquiry result.
And 204, if the data record corresponding to the joint index is inquired from the data table, updating the updating time corresponding to the joint index in the data table to be the current time.
If the data record corresponding to the joint index is inquired from the data table, it indicates that the current user has added the specified data to the clue library before, and the data does not need to be added repeatedly, and only the update time corresponding to the joint index needs to be updated to the current time.
If the data record corresponding to the joint index is not inquired from the data table, the specified data is stored in the data table, namely the data state of the specified data is determined to be not included in the set, the set identifier is empty, and the updating time is determined to be the current time, the data identifier, the data state, the set identifier, the user identifier of the current user and the updating time of the specified data are taken as one data record, and the data record is written into the data table, so that the specified data is added to the clue library.
In an embodiment of the present invention, the entering, according to the data entry set request, the data corresponding to the data identifier into a target data set corresponding to the target set identifier includes: taking the value of the data identification field as the data identification, the value of the data state field as the unreported set, the value of the set identification field as null and the value of the user identification field as the user identification of the current user as a first joint index, and inquiring whether a data record corresponding to the first joint index exists in a data table to obtain a clue inquiry result; taking the value of the data identification field as the data identification and the value of the data state field as the value of the classified set identification field and the value of the set status field as the target set identification as a second joint index, and inquiring whether a data record corresponding to the second joint index exists in a data table to obtain a set inquiry result; and according to the clue query result and the set query result, classifying the data corresponding to the data identifier into a target data set corresponding to the target set identifier, and updating the data state corresponding to the data identifier into an classified set.
Since the data grouping request may be from a clue data presentation page or a trace tracking result presentation page, in order to avoid repeated storage of data grouped into the data set, when the data grouping request is received, it is necessary to determine whether data to be grouped into the data set is in a clue library and determine whether the data is already grouped into the data set. When determining whether the data to be classified into the data set is in the clue library, inquiring whether a data record corresponding to the first joint index exists in the data table by taking the value of the data identification field as the data identification in the data classification set request, the value of the data state field as the non-classified set, the value of the set identification field as null and the value of the user identification field as the user identification of the current user as the first joint index, and obtaining a clue inquiry result. The data included in the data set may be data included in the data set by the current user, or data included in the data set by other users, that is, the data included in the data set is not bound to the user, and when a plurality of users include the same data in the same data set, only one data record corresponding to the set identifier of the data is reserved, so that only the value of the data identifier field is required to be the data identifier included in the data set request, and the value of the data status field is required to be the filed value and the value of the set identifier field is required to be the target set identifier as the second association index, and whether the data record corresponding to the second association index exists is queried in the data table, thereby obtaining the set query result. And according to the clue query result and the set query result, putting the data corresponding to the data identifier in the data put-in set request into a target data set corresponding to the target set identifier, and updating the data state corresponding to the data identifier into a put-in set. Data is classified into the data set according to the clue query result and the set query result, so that repeated storage of the data can be avoided.
The step of classifying the data corresponding to the data identifier into the target data set corresponding to the target set identifier according to the clue query result and the set query result, and updating the data state corresponding to the data identifier to be classified into a set includes at least one of the following steps: if the clue query result is empty and the set query result is empty, adding a data record corresponding to the data identifier in a data table, recording the data state corresponding to the data identifier as a classified set in the data record, recording the set identifier corresponding to the data identifier as a target set identifier, and recording the updating time as the current time; if the clue query result is not empty and the set query result is not empty, deleting the data record corresponding to the first joint index in the data table, and updating the updating time corresponding to the second joint index to the current time; if the clue query result is not empty and the set query result is empty, recording a set identifier corresponding to the data identifier as a target set identifier in the data table, and updating the updating time corresponding to the data identifier to be the current time; and if the clue query result is empty and the set query result is not empty, updating the updating time corresponding to the data identifier into the current time in the data table.
If the clue query result is empty and the set query result is empty, that is, the data to be classified into the target data set does not exist in the clue library and is not classified into the set, it is indicated that the data is obtained by trajectory tracking and a data classification request received on a display page of the trajectory tracking result is included in the data, and at this time, the data can be directly classified into the target data set, that is, a data record corresponding to the data identifier to be classified into the target data set is added in the data table, in the data record, the data state is recorded as the classified set, the set identifier is recorded as the target set identifier, and the update time is recorded as the current time. If the clue query result is non-empty and the set query result is non-empty, that is, the data to be classified into the target data set exists in the clue library, and the data is also classified into the target data set before, which indicates that at least two records of the data to be archived have been stored in the data table, at this time, the data record corresponding to the first joint index needs to be deleted, and the update time corresponding to the second joint index needs to be updated to the current time, for example, the current user userid1 wants to directly classify the image a into the data set S from the track tracking result, the electronic device determines that the image a has been added to the clue library by the userid1 before being queried, and the image a has been classified into the data set S by the current user or other users, that is, that the image a has two data records in the data table, one record is classified into the set, one record is a record added to the clue library by the current user, and when the image a is classified into the data set S, the duplicate data is deleted and the update time is updated to the current time, that is, the records added into the clue library, that is, the data records corresponding to the first joint index, are deleted, and the update time in the records classified into the set, that is, the records corresponding to the second joint index, is updated to the current time. If the clue query result is not empty and the set query result is empty, that is, the data to be classified into the target data set exists in the clue library and is not classified into the set, that is, the data is added to the clue library by the current user and is not classified into the set, then only the set identifier corresponding to the data identifier included in the data classification request is recorded as the target set identifier in the data table, and the update time corresponding to the data identifier is updated to the current time, that is, the clue data is directly transferred to the set data in the data table, for example, the current user userid1 wants to directly classify the image a into the data set S from the trajectory tracking result, and the image a is determined to have been added to the clue library by userid1 before being queried, but is not classified into the set, and at this time, only the data state in the record needs to be classified into the set, and the set identifier is recorded as S. If the clue query result is empty and the set query result is not empty, that is, the data to be included in the target data set does not exist in the clue library but is included in the set, then only the update time corresponding to the data identifier in the data inclusion request in the data table needs to be updated to the current time, for example, the current user userid1 wants to directly include the image a in the data set S from the trajectory tracking result, it is determined through the query that the image a has been previously included in the data set S by the userid1 or other users, and at this time, only the update time of the record in the table needs to be updated. Through the processing, the same data classified into the same data set is only stored in one data record, so that repeated storage of the data is avoided, modification of a data set shared by a plurality of users is realized, but the current user can only view the data added into the clue library by himself and cannot view the data added into the clue library by other users.
In the data analysis method provided by this embodiment, the data added to the thread library and the data included in the set are stored in the data table, so that the storage space can be saved, data transmission when the data in the thread library is included in the data set can be avoided, and the data in the thread library can be included in the data set only by changing the data state in the data table and adding the set identifier.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Fig. 3 is a block diagram of a data analysis apparatus according to an embodiment of the present invention, and as shown in fig. 3, the data analysis apparatus may include:
a merge request receiving module 301, configured to receive a data merge set request, where the data merge set request includes a data identifier corresponding to data to be merged into a target data set and a target set identifier corresponding to the target data set;
a data entry module 302, configured to, according to the data entry set request, enter the data corresponding to the data identifier into a target data set corresponding to the target set identifier, where the target data set includes multiple data associated with a target event;
an analysis request receiving module 303, configured to receive an analysis request for the target set identifier;
and the data analysis module 304 is configured to obtain a plurality of data corresponding to the target set identifier, and analyze the plurality of data according to the analysis manner in the analysis request to obtain an analysis result.
Optionally, the entry request receiving module includes:
the clue data display unit is used for displaying a plurality of clue data corresponding to the current user on an online clue data display page;
the first entry request receiving unit is used for receiving a data entry set request that a current user enters the specified clue data under the target set identifier.
Optionally, the entry request receiving module includes:
a trajectory tracking request receiving unit, configured to receive a trajectory tracking request for a target set identifier;
a trajectory tracking unit, configured to obtain a trajectory tracking result, where the trajectory tracking result is other data associated with the plurality of data corresponding to the target set identifier and retrieved from the server according to the trajectory tracking request;
a tracking result display unit for displaying the tracking result;
and the second entry request receiving unit is used for receiving a data entry set request for entering the specified data in the track tracking result into the target set identifier.
Optionally, the apparatus further comprises:
the data storage module is used for storing the data added into the clue library and the data classified into the data set through a data table, and the data table comprises: a data identification field, a data status field, a set identification field, a user identification field, and an update time field.
Optionally, the data table further includes a thread type field, and values of the thread type field are the same or similar.
Optionally, the apparatus further comprises:
the system comprises a clue adding request receiving unit, a clue adding unit and a data adding unit, wherein the clue adding request receiving unit is used for receiving a clue adding request of a current user to specified data, and the clue adding request comprises data identification of the specified data;
A first cable data query unit, configured to query, as a joint index, whether a data record corresponding to the joint index exists in the data table, where a value of the data identification field is a data identification of specified data, a value of the data status field is an unreturned set, a value of the set identification field is null, and a value of the user identification field is a user identification of a current user;
the clue data updating unit is used for updating the updating time corresponding to the joint index in the data table to be the current time if the data record corresponding to the joint index is inquired from the data table;
and the clue data adding unit is used for determining that the data state of the specified data is not classified into a set, the set identifier is empty and the updating time is the current time if the data record corresponding to the joint index is not inquired from a data table, and taking the data identifier, the data state, the set identifier, the user identifier of the current user and the updating time of the specified data as one data record and writing the data record into the data table.
Optionally, the data entry module includes:
the second cable data query unit is used for taking the value of the data identification field as the data identification, the value of the data state field as the unreported set, the value of the set identification field as null and the value of the user identification field as the user identification of the current user as a first joint index, and querying whether a data record corresponding to the first joint index exists or not from a data table to obtain a cable query result;
The set data query unit is used for taking the value of the data identification field as the data identification and the value of the data state field as the value of the classified set identification field as the target set identification as a second joint index, and querying whether a data record corresponding to the second joint index exists in a data table to obtain a set query result;
and the data entry unit is used for entering the data corresponding to the data identifier into the target data set corresponding to the target set identifier according to the clue query result and the set query result, and updating the data state corresponding to the data identifier into the entered set.
Optionally, the data entry unit is specifically configured to:
if the clue query result is empty and the set query result is empty, adding a data record corresponding to the data identifier in a data table, recording the data state corresponding to the data identifier as a classified set in the data record, recording the set identifier corresponding to the data identifier as a target set identifier, and recording the updating time as the current time;
if the clue query result is not empty and the set query result is not empty, deleting the data record corresponding to the first joint index in the data table, and updating the updating time corresponding to the second joint index to the current time;
If the clue query result is not empty and the set query result is empty, recording a set identifier corresponding to the data identifier as a target set identifier in the data table, and updating the updating time corresponding to the data identifier to be the current time;
and if the clue query result is empty and the set query result is not empty, updating the updating time corresponding to the data identifier into the current time in the data table.
Optionally, the analysis request includes a preset dimension aggregation request or a data viewing request; the preset dimensions include at least one of a goal, a time, a place, a day, an hour, a device, and a latitude and longitude.
The data analysis apparatus provided in this embodiment receives, by the merge request receiving module, a data merge set request including a data identifier and a target set identifier, where the data merge module merges data corresponding to the data identifier into a target data set corresponding to the target set identifier, where the target data set includes a plurality of data associated with a target event, the analysis request receiving module receives an analysis request for the target set identifier, and the data analysis module obtains a plurality of data corresponding to the target set identifier and analyzes the plurality of data according to an analysis manner in the analysis request to obtain an analysis result, where the plurality of data associated with the target event can be merged into one target data set, so as to solve a problem that data of one target event cannot be aggregated, and analyze the target event according to the plurality of data in the target data set, the analysis of the target event is realized.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
Further, according to an embodiment of the present invention, there is provided an electronic device, which may be a computer or a server, including: a processor, a memory and a computer program stored on the memory and executable on the processor, which computer program, when executed by the processor, implements the data analysis method of the foregoing embodiments.
According to an embodiment of the present invention, there is also provided a computer readable storage medium including, but not limited to, a disk memory, a CD-ROM, an optical memory, etc., having stored thereon a computer program which, when executed by a processor, implements the data analysis method of the foregoing embodiment.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The data analysis method, the data analysis device, the electronic device and the storage medium provided by the invention are described in detail, and a specific example is applied in the text to explain the principle and the implementation of the invention, and the description of the above embodiment is only used to help understanding the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (12)
1. A method of data analysis, comprising:
receiving a data entry set request, wherein the data entry set request comprises a data identifier corresponding to data to be entered into a target data set and a target set identifier corresponding to the target data set;
according to the data entry set request, data corresponding to the data identification are entered into a target data set corresponding to the target set identification, and the target data set comprises a plurality of data associated with a target event;
receiving an analysis request for the target set identification;
and acquiring a plurality of data corresponding to the target set identifier, and analyzing the plurality of data according to the analysis mode in the analysis request to obtain an analysis result.
2. The method of claim 1, wherein receiving the data-in-set request comprises:
the online data retrieval method comprises the steps of searching a data display page on line, and displaying a plurality of clue data corresponding to a current user;
and receiving a data-in-set request of a current user for putting the specified clue data under the target set identification.
3. The method of claim 1, wherein receiving the data-in-set request comprises:
Receiving a track tracking request for a target set identifier;
acquiring a track tracking result, wherein the track tracking result is other data which is retrieved from a server and is associated with a plurality of data corresponding to the target set identification according to the track tracking request;
displaying the track tracking result;
and receiving a data-in-set request for putting the specified data in the track tracking result under the target set identifier.
4. The method according to any one of claims 1-3, further comprising:
saving the data added into the clue library and the data classified into the data set through a data table, wherein the data table comprises: a data identification field, a data status field, a set identification field, a user identification field, and an update time field.
5. The method of claim 4, wherein the data table further comprises a thread type field, and wherein values of the thread type field are the same or similar.
6. The method of claim 4, further comprising:
receiving a thread adding request of a current user to specified data, wherein the thread adding request comprises a data identifier of the specified data;
taking the value of the data identification field as the data identification of the designated data, the value of the data state field as the unreturned set, the value of the set identification field as null and the value of the user identification field as the user identification of the current user as a joint index, and inquiring whether a data record corresponding to the joint index exists in the data table;
If the data record corresponding to the joint index is inquired from the data table, updating the updating time corresponding to the joint index in the data table to be the current time;
and if the data record corresponding to the joint index is not inquired from the data table, determining that the data state of the specified data is not put into the set, the set identifier is empty, and the updating time is the current time, and taking the data identifier, the data state, the set identifier, the user identifier of the current user and the updating time of the specified data as a data record and writing the data record into the data table.
7. The method according to claim 4, wherein the classifying the data corresponding to the data identifier into the target data set corresponding to the target set identifier according to the data classifying request includes:
taking the value of the data identification field as the data identification, the value of the data state field as the unreported set, the value of the set identification field as null and the value of the user identification field as the user identification of the current user as a first joint index, and inquiring whether a data record corresponding to the first joint index exists in a data table to obtain a clue inquiry result;
Taking the value of the data identification field as the data identification and the value of the data state field as the value of the classified set identification field and the value of the set status field as the target set identification as a second joint index, and inquiring whether a data record corresponding to the second joint index exists in a data table to obtain a set inquiry result;
and according to the clue query result and the set query result, classifying the data corresponding to the data identifier into a target data set corresponding to the target set identifier, and updating the data state corresponding to the data identifier into an classified set.
8. The method of claim 7, wherein the classifying the data corresponding to the data identifier into the target data set corresponding to the target set identifier and updating the data state corresponding to the data identifier into the classified set according to the clue query result and the set query result includes at least one of:
if the clue query result is empty and the set query result is empty, adding a data record corresponding to the data identifier in a data table, recording the data state corresponding to the data identifier as a classified set in the data record, recording the set identifier corresponding to the data identifier as a target set identifier, and recording the updating time as the current time;
If the clue query result is not empty and the set query result is not empty, deleting the data record corresponding to the first joint index in the data table, and updating the updating time corresponding to the second joint index to the current time;
if the clue query result is not empty and the set query result is empty, recording a set identifier corresponding to the data identifier as a target set identifier in the data table, and updating the updating time corresponding to the data identifier to be the current time;
and if the clue query result is empty and the set query result is not empty, updating the updating time corresponding to the data identifier to be the current time in the data table.
9. The method of any one of claims 1-3, wherein the analysis request comprises a preset dimension aggregation request or a data view request; the preset dimensions include at least one of a goal, a time, a place, a day, an hour, a device, and a latitude and longitude.
10. A data analysis apparatus, comprising:
the data entry request receiving module is used for receiving a data entry set request, wherein the data entry set request comprises a data identifier corresponding to data to be entered into a target data set and a target set identifier corresponding to the target data set;
The data entry module is used for entering the data corresponding to the data identifier into a target data set corresponding to the target set identifier according to the data entry set request, wherein the target data set comprises a plurality of data related to a target event;
an analysis request receiving module, configured to receive an analysis request for the target set identifier;
and the data analysis module is used for acquiring a plurality of data corresponding to the target set identifier and analyzing the plurality of data according to the analysis mode in the analysis request to obtain an analysis result.
11. An electronic device, comprising: a processor, a memory and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the data analysis method of any one of claims 1 to 9.
12. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the data analysis method according to any one of claims 1-9.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010508187.1A CN111858779A (en) | 2020-06-05 | 2020-06-05 | Data analysis method and device, electronic equipment and storage medium |
| PCT/CN2020/118406 WO2021243898A1 (en) | 2020-06-05 | 2020-09-28 | Data analysis method and apparatus, and electronic device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010508187.1A CN111858779A (en) | 2020-06-05 | 2020-06-05 | Data analysis method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111858779A true CN111858779A (en) | 2020-10-30 |
Family
ID=72986195
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010508187.1A Pending CN111858779A (en) | 2020-06-05 | 2020-06-05 | Data analysis method and device, electronic equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN111858779A (en) |
| WO (1) | WO2021243898A1 (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040088283A1 (en) * | 2002-10-31 | 2004-05-06 | Elecdecom, Inc. | Data entry, cross reference database and search systems and methods thereof |
| US20160371644A1 (en) * | 2014-02-26 | 2016-12-22 | Sicpa Holding Sa | Systems and methods for tracing items |
| CN107992503A (en) * | 2016-10-26 | 2018-05-04 | 微软技术许可有限责任公司 | Query processing in data analysis |
| CN108121816A (en) * | 2017-12-28 | 2018-06-05 | 广东欧珀移动通信有限公司 | Picture classification method, device, storage medium and electronic equipment |
| CN110276002A (en) * | 2019-06-26 | 2019-09-24 | 浙江大搜车软件技术有限公司 | Search for application data processing method, device, computer equipment and storage medium |
| CN110990473A (en) * | 2019-11-28 | 2020-04-10 | 北京海益同展信息科技有限公司 | Tag data processing system and method |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8645287B2 (en) * | 2010-02-04 | 2014-02-04 | Microsoft Corporation | Image tagging based upon cross domain context |
| US10929384B2 (en) * | 2017-08-16 | 2021-02-23 | Walmart Apollo, Llc | Systems and methods for distributed data validation |
| CN110162643B (en) * | 2018-09-13 | 2023-08-25 | 腾讯科技（深圳）有限公司 | Electronic album report generation method, device and storage medium |
| CN110610190A (en) * | 2019-07-31 | 2019-12-24 | 浙江大学 | Convolutional neural network rainfall intensity classification method for rainy pictures |
-
2020
- 2020-06-05 CN CN202010508187.1A patent/CN111858779A/en active Pending
- 2020-09-28 WO PCT/CN2020/118406 patent/WO2021243898A1/en active Application Filing
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040088283A1 (en) * | 2002-10-31 | 2004-05-06 | Elecdecom, Inc. | Data entry, cross reference database and search systems and methods thereof |
| US20160371644A1 (en) * | 2014-02-26 | 2016-12-22 | Sicpa Holding Sa | Systems and methods for tracing items |
| CN107992503A (en) * | 2016-10-26 | 2018-05-04 | 微软技术许可有限责任公司 | Query processing in data analysis |
| CN108121816A (en) * | 2017-12-28 | 2018-06-05 | 广东欧珀移动通信有限公司 | Picture classification method, device, storage medium and electronic equipment |
| CN110276002A (en) * | 2019-06-26 | 2019-09-24 | 浙江大搜车软件技术有限公司 | Search for application data processing method, device, computer equipment and storage medium |
| CN110990473A (en) * | 2019-11-28 | 2020-04-10 | 北京海益同展信息科技有限公司 | Tag data processing system and method |
Non-Patent Citations (2)
| Title |
|---|
| 刘阳等: "一种具有关联性感知的RFID网络追溯服务", 《小型微型计算机系统》 * |
| 刘阳等: "一种具有关联性感知的RFID网络追溯服务", 《小型微型计算机系统》, no. 04, 15 April 2017 (2017-04-15) * |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021243898A1 (en) | 2021-12-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10778712B2 (en) | Displaying network security events and investigation activities across investigation timelines | |
| US10237292B2 (en) | Selecting network security investigation timelines based on identifiers | |
| US9942121B2 (en) | Systems and methods for ephemeral eventing | |
| US20210117469A1 (en) | Systems and methods for selecting content items to store and present locally on a user device | |
| US20180246887A1 (en) | Systems and methods for processing crowd-sourced multimedia items | |
| US20160055164A1 (en) | News alert system and method | |
| KR20100037040A (en) | Collecting and presenting temporal-based action information | |
| US20140270550A1 (en) | Presentation and organization of content | |
| US20230214091A1 (en) | Multimedia object arrangement method, electronic device, and storage medium | |
| CN111913860A (en) | Operation behavior analysis method and device | |
| US11676345B1 (en) | Automated adaptive workflows in an extended reality environment | |
| RU2660599C1 (en) | Method of video data indexing for facet classification | |
| JP5912949B2 (en) | Business document processing system and program | |
| CN110929097A (en) | Video recording display method, device and storage medium | |
| CN107301212B (en) | Method and device for aggregating character dynamics | |
| CN111858779A (en) | Data analysis method and device, electronic equipment and storage medium | |
| JP5307258B2 (en) | Pair image posting search device and pair image posting search program | |
| US11482002B1 (en) | Codeless anchor detection for detectable features in an environment | |
| KR20080028031A (en) | System extracting and displaying keyword and contents related with the keyword and method using the system | |
| CN112667849A (en) | Information indexing method, device, system, electronic equipment and storage medium | |
| US20190087484A1 (en) | Capturing context using network visualization | |
| JP2005122683A (en) | Information providing method and system, and information providing program | |
| JPH10177511A (en) | File system | |
| CN114428874A (en) | Data retrieval method, data sharing method, related device and equipment | |
| CN114969457A (en) | Product retrieval method, product retrieval device, electronic equipment and readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |