CN113179335B - Data processing method and system, electronic device and computer readable storage medium - Google Patents

Data processing method and system, electronic device and computer readable storage medium Download PDF

Info

Publication number
CN113179335B
CN113179335B CN202110731500.2A CN202110731500A CN113179335B CN 113179335 B CN113179335 B CN 113179335B CN 202110731500 A CN202110731500 A CN 202110731500A CN 113179335 B CN113179335 B CN 113179335B
Authority
CN
China
Prior art keywords
time period
preset time
detection
collected data
sub
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110731500.2A
Other languages
Chinese (zh)
Other versions
CN113179335A (en
Inventor
张英志
叶峰
陈星光
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhilian Wanwei Technology Co ltd
Original Assignee
Zhilian Wanwei Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhilian Wanwei Technology Co ltd filed Critical Zhilian Wanwei Technology Co ltd
Priority to CN202110731500.2A priority Critical patent/CN113179335B/en
Publication of CN113179335A publication Critical patent/CN113179335A/en
Application granted granted Critical
Publication of CN113179335B publication Critical patent/CN113179335B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/06Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/7867Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Library & Information Science (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

The invention provides a data processing method and system, electronic equipment and a computer readable storage medium, wherein the method comprises the following steps: if the collected data satisfies
Figure 406094DEST_PATH_IMAGE001
For any mobile source ID in the collected data, if the number of the sub information corresponding to the mobile source ID is greater than or equal to a second preset value, storing the sub information corresponding to the mobile source ID to a sending list, otherwise, when the detection reporting time of the mobile source ID in the sub information is within the ith calculation period of the current preset time period, storing the sub information to which the detection reporting time belongs to a transfer list
Figure 100004_DEST_PATH_IMAGE002
When it is satisfied
Figure 916710DEST_PATH_IMAGE003
If so, adding the transfer list to the sending list, otherwise, giving up the transfer list; sending detection reporting time to the detection terminal ID in the sending list; and acquiring a video file corresponding to the detection reporting time. By the technical scheme, resources consumed by transmission and detection of the video file are reduced, and detection efficiency is improved.

Description

Data processing method and system, electronic device and computer readable storage medium
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a data processing method and system, an electronic device, and a computer-readable storage medium.
Background
In the field of environmental quality detection, the influence of a mobile source such as a vehicle on environmental quality can be generally judged by shooting a video and identifying video content, and for this reason, shooting devices are often arranged in a large number of road sections to shoot video files of the mobile source for detection. However, since the geographic space to be monitored is extremely large, the system resources and labor costs consumed for transmitting the shot video and checking the shot video one by one are extremely large, which is not favorable for the development and implementation of the environmental quality detection work.
Therefore, how to improve the efficiency of environmental quality detection becomes a technical problem to be solved urgently at present.
Disclosure of Invention
The embodiment of the invention provides a data processing method and system, electronic equipment and a computer readable storage medium, and aims to solve the technical problems that system resources are consumed and labor cost is excessive in environment quality detection in the related art.
In a first aspect, an embodiment of the present invention provides a data processing method, including: determining whether the collected data satisfies
Figure DEST_PATH_IMAGE001
Wherein, in the step (A),
Figure 100002_DEST_PATH_IMAGE002
the amount of sub information of the collected data in the current preset time period,
Figure DEST_PATH_IMAGE003
determining the number of pieces of sub information of the collected data in a specified preset time period before the current preset time period, wherein each piece of sub information comprises a detection terminal ID and the detection reporting time of a mobile source ID in the detection terminal,
Figure 100002_DEST_PATH_IMAGE004
is a first preset value; if the collected data satisfies
Figure 596626DEST_PATH_IMAGE001
For any moving source ID in the collected data, if the number of the sub information corresponding to the moving source ID is greater than or equal to a second preset value, storing the sub information corresponding to the moving source ID to a sending list; if the quantity of the sub information corresponding to the mobile source ID is smaller than the second preset value, when the detection reporting time of the mobile source ID in the sub information is within the ith calculation period of the current preset time period, storing the sub information to which the detection reporting time belongs to a transfer list
Figure DEST_PATH_IMAGE005
Wherein, when satisfying
Figure 100002_DEST_PATH_IMAGE006
Then adding the transit list to a delivery list, wherein,
Figure DEST_PATH_IMAGE007
is the transit list
Figure 402777DEST_PATH_IMAGE005
The number of sub-information in (a),
Figure 100002_DEST_PATH_IMAGE008
the number of sub information in the ith calculation cycle of the collected data in a specified preset time period before the current preset time period,
Figure DEST_PATH_IMAGE009
is a third predetermined value, and
Figure 30329DEST_PATH_IMAGE004
positive correlation; when it is satisfied with
Figure 100002_DEST_PATH_IMAGE010
When the transfer list is needed, the transfer list is abandoned; if the collected data satisfies
Figure DEST_PATH_IMAGE011
Adding all sub information in the collected data to the sending list; sending the detection reporting time stored in association with the detection terminal ID to the detection terminal ID in the sending list; and acquiring a video file which is from the detection terminal ID in the sending list and corresponds to the detection reporting time stored in the association mode.
In a second aspect, an embodiment of the present invention provides a data processing system, including: the system comprises a plurality of detection terminals, a processor and a video cache module, wherein each detection terminal comprises a camera module, the processor and the video cache module, the camera module is used for shooting a video file with a mobile source, the processor is used for identifying whether the video file meets a preset cache condition, and when the video file meets the preset cache condition, the video cache module is used for caching the video file, and collected data are sent to a server, and the collected data comprise a mobile source ID of the video file, a detection terminal ID for shooting the mobile source and detection reporting time; and the server is communicated with the plurality of detection terminals and is used for acquiring the collected data from the plurality of detection terminals, executing the method of the first aspect on the basis of the collected data, and acquiring video files required by the server from the plurality of detection terminals.
In a third aspect, an embodiment of the present invention provides an electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being arranged to perform the method of any of the first aspects above.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium storing computer-executable instructions for performing the method flow described in any one of the first aspect.
According to the technical scheme, aiming at the technical problem that environment quality detection in the related technology consumes excessive system resources and labor cost, the sub-information corresponding to the mobile source can be screened based on whether the mobile source has enough detection value, so that a more simplified and effective sending list is obtained, and finally only the video files corresponding to the simplified sending list are detected without detecting all the shot video files. Therefore, video files required to be detected in the environment quality detection process are greatly reduced, resources consumed by transmission and detection of the video files are reduced, and the environment quality detection efficiency is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 shows a flow diagram of a data processing method according to an embodiment of the invention.
Detailed Description
For better understanding of the technical solutions of the present invention, the following detailed descriptions of the embodiments of the present invention are provided with reference to the accompanying drawings.
It should be understood that the described embodiments are only some embodiments of the invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terminology used in the embodiments of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the examples of the present invention and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise.
Example one
The embodiment of the invention provides a data processing system for detecting environmental quality, which comprises a plurality of detection terminals and a server.
Each detection terminal comprises a camera module, a processor and a video cache module, wherein the camera module is used for shooting video files with mobile sources, and the mobile sources are objects which can generate negative influence on the environment in the physical environment, such as vehicles and the like.
The processor is used for identifying whether the video file meets a preset caching condition, for example, the processor performs vehicle identification and black smoke identification on the image in the video file, when the image is identified to have a vehicle which discharges black smoke, the image is subjected to Ringelmann blackness grade judgment, if the Ringelmann blackness grade of the image exceeds 1 grade, the vehicle is determined to have negative influence on the environment, and the video file is determined to meet the preset caching condition.
And when the video file meets the preset caching condition, the processor enables the video caching module to cache the video file, and meanwhile, the processor can send collected data such as the mobile source ID of the video file, the detection terminal ID for shooting the mobile source, the detection reporting time and the like to a server.
In one possible design, the processor stores each piece of sub information of the collected data in association with each other according to the detection sequence of the mobile source, where the sub information includes the mobile source ID, the detection terminal ID of the mobile source detected at the time, and the detection reporting time. Optionally, the data format of the collected data is as follows:
mobile source ID1, check terminal ID1, t 1;
mobile source ID1, check terminal ID2, t 2;
mobile source ID2, check terminal ID3, t 3;
the source ID3 is moved, and the terminal ID1, t4 is detected.
In another possible design, each time new sub-information is obtained, the processor searches the collected data for the mobile source ID in the sub-information, and if the mobile source ID is detected, adds the detection terminal ID and the detection reporting time in the new sub-information to the history sub-information of the mobile source ID. Otherwise, the moving source ID is not detected, and new sub information is added to the last line of the collected data. Optionally, the data format of the collected data is as follows:
a moving source ID1, (detected terminal ID1, t 1), (detected terminal ID2, t 2);
a moving source ID2, (check terminal ID3, t 3);
move source ID3, (check terminal ID1, t 4).
And the server is communicated with the detection terminals and is used for acquiring the collected data from the detection terminals and acquiring video files required by the server from the detection terminals based on the collected data. As shown in fig. 1, the process of the server acquiring the video file required by itself based on the collected data includes:
step 102, determining whether the collected data isSatisfy the requirement of
Figure 380627DEST_PATH_IMAGE001
Wherein the content of the first and second substances,
Figure 580664DEST_PATH_IMAGE002
the amount of sub information of the collected data in the current preset time period,
Figure 636345DEST_PATH_IMAGE003
determining the number of pieces of sub information of the collected data in a specified preset time period before the current preset time period, wherein each piece of sub information comprises a detection terminal ID and the detection reporting time of a mobile source ID in the detection terminal,
Figure 718571DEST_PATH_IMAGE004
is a first preset value that is, optionally,
Figure 100002_DEST_PATH_IMAGE012
in one possible design of the system, the system may be,
Figure 550523DEST_PATH_IMAGE003
and the quantity of the sub information of the collected data in the previous historical preset time period of the current preset time period is used.
In another possible design of the device according to the invention,
Figure DEST_PATH_IMAGE013
wherein, in the step (A),
Figure 100002_DEST_PATH_IMAGE014
and the number of the sub information of the collected data in the ith historical preset time period is shown, and x is the number of the historical preset time periods.
If it satisfies
Figure 729700DEST_PATH_IMAGE001
Representing the relative sub-information in the current preset time periodIf the number of sub-information in the specified preset time period has a larger increment, new detection content is obtained, and at this time, data processing can be started to screen appropriate detection content for further detection behavior.
104, if the collected data meets the requirements
Figure 425124DEST_PATH_IMAGE001
For any moving source ID in the collected data, it is determined whether the number of the sub information corresponding to the moving source ID is greater than or equal to a second preset value, and when the number of the sub information corresponding to the moving source ID is greater than or equal to the second preset value, step 106 is entered, otherwise, step 108 is entered.
Optionally, the second preset value is positively correlated with the current preset time period, and may be 2 or 3. It is to be understood that the durations of the current preset time period and the specified preset time period are equal and have no intersection with each other. Therefore, if the number of the sub information corresponding to the moving source ID is greater than or equal to the second preset value, it indicates that the moving source ID is detected by the detection terminal multiple times, and belongs to an object that continuously exerts a negative influence on the environment, and the video file related to the moving source ID has a detection value, so that step 106 may be entered, and the sub information corresponding to the moving source ID is stored in the sending list, so that the server obtains the video file where the moving source ID is located based on the sending list.
And 106, storing the sub information corresponding to the moving source ID into a sending list.
Step 108, when the detection reporting time of the mobile source ID in the sub information is within the ith calculation period of the current preset time period, storing the sub information to which the detection reporting time belongs to a transfer list
Figure 496110DEST_PATH_IMAGE005
If the number of the sub information corresponding to the moving source ID is smaller than a second preset value, it indicates that the number of times of detecting the moving source ID by the detecting terminal is not enough, and it cannot be directly determined whether the moving source belongs to an object which continuously has a negative influence on the environment. To accurately determine whether the video file related to the moving source has the detection value, the following steps are further performed.
Step 110, when the condition is satisfied
Figure 36813DEST_PATH_IMAGE006
When the transfer list is satisfied, adding the transfer list to a sending list
Figure 8180DEST_PATH_IMAGE010
And when the transfer list is not used, the transfer list is abandoned.
Wherein the content of the first and second substances,
Figure 405663DEST_PATH_IMAGE007
is the transit list
Figure 400164DEST_PATH_IMAGE005
The number of sub-information in (a),
Figure 308339DEST_PATH_IMAGE008
and the number of sub information in the ith calculation cycle of the collected data in a specified preset time period before the current preset time period is determined.
Transit list
Figure 71896DEST_PATH_IMAGE005
The number of the sub information in (1) is the number of the sub information of the mobile source in the ith calculation cycle of the current preset time period.
Figure DEST_PATH_IMAGE015
Is a third predetermined value, and
Figure 233756DEST_PATH_IMAGE004
the positive correlation, optionally,
Figure 100002_DEST_PATH_IMAGE016
due to the fact that
Figure DEST_PATH_IMAGE017
It is known that
Figure 539054DEST_PATH_IMAGE015
Greater than 1. Therefore, when satisfying
Figure 749456DEST_PATH_IMAGE006
And then, the number of the sub information in the ith calculation cycle of the current preset time period is increased compared with the ith calculation cycle of the appointed preset time period before the current preset time period.
At this time, it can be understood that, although the sub information of the moving source does not have a sufficient increment in the current preset time period with respect to the specified preset time period, the sub information of the moving source has a larger increment in a smaller time interval (calculation cycle) in the current preset time period with respect to the corresponding smaller time interval in the specified preset time period. That is, the mobile source is shot by a plurality of detecting terminals or a plurality of detecting terminals within a smaller time interval within the current preset time period. At this time, it can be determined that the moving source belongs to an object that continues to have a negative influence on the environment, and the video file thereof has a detection value.
On the contrary, the method can be used for carrying out the following steps,
Figure 367519DEST_PATH_IMAGE010
when the current preset time period does not have enough increment relative to the appointed preset time period, and the current preset time period does not have enough increment relative to the appointed preset time period in the calculation period, which shows that the detection times of the moving source ID by the detection terminal are not enough, the moving source ID does not belong to the object which continuously generates negative influence on the environment, and the corresponding video file has no detection value.
In one possible design of the system, the system may be,
Figure 100002_DEST_PATH_IMAGE018
for the sub information of the collected data in the ith calculation cycle in the previous historical preset time period of the current preset time periodThe number of the cells.
In another possible design of the device according to the invention,
Figure DEST_PATH_IMAGE019
wherein, in the step (A),
Figure 100002_DEST_PATH_IMAGE020
and the number of sub information in the ith calculation cycle in the jth historical preset time period is the collected data.
Step 112, if the collected data is satisfied
Figure 998483DEST_PATH_IMAGE011
Adding all sub information in the collected data to the delivery list.
If it is
Figure 498734DEST_PATH_IMAGE011
The sub information in the current preset time period does not have a large increment relative to the number of the sub information in the specified preset time period, so that the overall resource consumption and the calculation amount are small, and at the moment, all the sub information in the collected data can be directly added to the sending list.
Step 114, sending the detection reporting time stored in association with the detection terminal ID to the detection terminal ID in the sending list.
And step 116, obtaining a video file which is from the detection terminal ID in the sending list and corresponds to the detection reporting time of the associated storage.
According to the technical scheme, the sub-information corresponding to the mobile source can be screened based on whether the mobile source has enough detection value, so that a more simplified and effective sending list is obtained, and finally, only the video files corresponding to the simplified sending list are detected without detecting all the shot video files. Therefore, video files required to be detected in the environment quality detection process are greatly reduced, resources consumed by transmission and detection of the video files are reduced, and the environment quality detection efficiency is improved.
In one possible design, the data processing system further includes a user interaction terminal operable to delete the video file manually when the user determines that the video file does not have the detected value. Specifically, the user interaction terminal receives a deletion operation of a user on a specified video file, generates a deletion operation instruction, and sends the deletion operation instruction to the server. The server acquires a deletion operation instruction from the user interaction terminal for the specified video file, and deletes the specified video file in response to the deletion operation instruction. Accordingly, the server may delete the sub information corresponding to the video file in the transmission list synchronously. Thus, the user can further filter the video file based on actual judgment.
In addition, before step 108, the method further includes: and acquiring a plurality of calculation cycles in the current preset time period, wherein the calculation cycles are respectively distributed on a time axis in a discrete manner and have no intersection, and the union of the calculation cycles is the current preset time period. Optionally, the current preset time period includes a first calculation cycle and a second calculation cycle, where the first calculation cycle is a union of daytime hours in the current preset time period, and the second calculation cycle is a union of nighttime hours in the current preset time period. Thus, a fixed calculation period is set for the server.
In addition, a calculation period may be set for the server based on the actual environment, and two sets of this calculation period setting manner are explained below by the embodiment.
Example two
The server of the data processing system can be connected with a preset external platform, the external platform provides weather information for the server, the server determines a calculation period based on the weather information, and for the calculation period, the specific processing steps of the server comprise:
step 202, obtaining a plurality of calculation cycles, T, in the current preset time period1、T2、……、TmM is the number of calculation cycles, the calculation cycles are respectively distributed discretely on a time axis and have no intersection, and the union of the calculation cycles is the current pre-predictionSetting a time period.
After the initial calculation period is divided, the calculation period is further planned in combination with actual weather.
Step 204, obtaining a plurality of first antenna strings (str 1, str2, … …, str) covered by the current preset time period from an external platformZ) And the external platform generates a first weather character string for each preset sub-period u, wherein Z = up (current preset time period ÷ preset sub-period), and up () is an upward rounding function.
The current predetermined time period may not be divided by the predetermined sub-time period u, and therefore, the final remainder part may be increased to strZ. Alternatively, u is 30 min.
The first weather character string corresponding to the preset sub-time period is composed of characters representing the light state of the designated geographic area in the sub-time period and characters representing the weather state of the designated geographic area in the sub-time period, such as 'day-sunny' and 'night-cloudy'.
Step 206, for each first antenna character string, determining a mapping value S of the first antenna character string in a predetermined mapping tablek,SkThe detection accuracy of the environment quality corresponding to the weather state of the first weather character string is determined,
Figure DEST_PATH_IMAGE021
in step 208, the time interval [ u x (k-1), u x k ] is incremented in the calculation cycle covered with the first weather string.
The predetermined mapping table sets a corresponding mapping value for each possible first weather character string, in other words, sets a corresponding mapping value for different weather conditions, and the mapping value of each first weather character string is determined by the accuracy of the environment quality detection corresponding to the weather condition.
The calculation cycle covered with the first weather character string is the time period influenced by the weather state corresponding to the first weather character string, the time length is increased for the calculation cycle covered with the first weather character string based on the first weather character string, the detection range can be enlarged, the negative influence of the weather on the detection is neutralized, and the detection accuracy caused by the weather influence is avoided.
Optionally, the mapping value of the first weather character string is negatively correlated with the accuracy of detecting the environmental quality corresponding to the weather state of the first weather character string, and the worse the weather state is, the lower the accuracy of detecting the environmental quality is, the longer the calculation period should be extended, so as to enlarge the detection range, neutralize the negative influence of weather on the detection, and avoid the accuracy of detecting due to the influence of weather. In this regard, the higher the mapping value set correspondingly, the larger the time interval for increasing the mapping value, and the expansion of the detection range is realized.
Finally, considering the key factor of weather, the detection duration coverage range is added for the calculation period based on the mapping value of the first weather character string covered by the calculation period, so that the accuracy of environment quality detection is improved. In addition, due to the discrete distribution of the calculation periods, the single calculation period is expanded, and other calculation periods are not influenced.
An electronic device of an embodiment of the invention includes at least one memory; and a processor communicatively coupled to the at least one memory; wherein the memory stores instructions executable by the at least one processor, the instructions being arranged to perform the scheme of any of the embodiments described above. Therefore, the electronic device has the same technical effects as any of the above embodiments, and is not described herein again.
The electronic device of embodiments of the present invention exists in a variety of forms, including but not limited to:
(1) mobile communication devices, which are characterized by mobile communication capabilities and are primarily targeted at providing voice and data communications. Such terminals include smart phones (e.g., iphones), multimedia phones, functional phones, and low-end phones, among others.
(2) The ultra-mobile personal computer equipment belongs to the category of personal computers, has calculation and processing functions and generally has the characteristic of mobile internet access. Such terminals include PDA, MID, and UMPC devices, such as ipads.
(3) Portable entertainment devices such devices may display and play multimedia content. Such devices include audio and video players (e.g., ipods), handheld game consoles, electronic books, as well as smart toys and portable car navigation devices.
(4) The server is similar to a general computer architecture, but has higher requirements on processing capability, stability, reliability, safety, expandability, manageability and the like because of the need of providing highly reliable services.
(5) And other electronic devices with data interaction functions.
In addition, an embodiment of the present invention provides a computer-readable storage medium, which stores computer-executable instructions for executing the method flow described in any of the above embodiments.
The technical scheme of the invention is described in detail in the above with reference to the accompanying drawings, and by the technical scheme of the invention, the sub-information corresponding to the mobile source can be screened based on whether the mobile source has enough detection value, so that a more simplified and effective sending list can be obtained, and finally, only the video files corresponding to the simplified sending list are detected without detecting all the shot video files. Therefore, video files required to be detected in the environment quality detection process are greatly reduced, resources consumed by transmission and detection of the video files are reduced, and the environment quality detection efficiency is improved.
It should be understood that although the terms first, second, etc. may be used to describe preset values in embodiments of the present invention, these preset values should not be limited to these terms. These terms are only used to distinguish preset values from each other. For example, the first preset value may also be referred to as a second preset value, and similarly, the second preset value may also be referred to as a first preset value without departing from the scope of the embodiments of the present invention.
The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination" or "in response to a detection", depending on the context. Similarly, the phrases "if determined" or "if detected (a stated condition or event)" may be interpreted as "when determined" or "in response to a determination" or "when detected (a stated condition or event)" or "in response to a detection (a stated condition or event)", depending on the context.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present invention should be included in the scope of the present invention.

Claims (9)

1. A data processing method, comprising:
determining whether the collected data satisfies
Figure DEST_PATH_IMAGE002
Wherein, in the step (A),
Figure DEST_PATH_IMAGE004
the amount of sub information of the collected data in the current preset time period,
Figure DEST_PATH_IMAGE006
determining the number of pieces of sub information of the collected data in a specified preset time period before the current preset time period, wherein each piece of sub information comprises a detection terminal ID and the detection reporting time of a mobile source ID in the detection terminal,
Figure DEST_PATH_IMAGE008
is a first preset value;
if the collected data satisfies
Figure DEST_PATH_IMAGE010
For any movement source ID within the collected data,
if the number of the sub information corresponding to the moving source ID is larger than or equal to a second preset value, storing the sub information corresponding to the moving source ID to a sending list, wherein the second preset value is positively correlated with the current preset time period;
if the quantity of the sub information corresponding to the mobile source ID is smaller than the second preset value, when the detection reporting time of the mobile source ID in the sub information is within the ith calculation period of the current preset time period, storing the sub information to which the detection reporting time belongs to a transfer list
Figure DEST_PATH_IMAGE012
Wherein when it is satisfied
Figure DEST_PATH_IMAGE014
Then adding the transit list to a delivery list, wherein,
Figure DEST_PATH_IMAGE016
is the transit list
Figure DEST_PATH_IMAGE018
The number of sub-information in (a),
Figure DEST_PATH_IMAGE020
the number of sub information in the ith calculation cycle of the collected data in a specified preset time period before the current preset time period,
Figure DEST_PATH_IMAGE022
is a third predetermined value, and
Figure DEST_PATH_IMAGE023
positive correlation; when it is satisfied with
Figure DEST_PATH_IMAGE025
When the transfer list is needed, the transfer list is abandoned;
if the collected data satisfies
Figure DEST_PATH_IMAGE027
Adding all sub information in the collected data to the sending list;
sending the detection reporting time stored in association with the detection terminal ID to the detection terminal ID in the sending list;
and acquiring a video file which is from the detection terminal ID in the sending list and corresponds to the detection reporting time stored in the association mode.
2. The data processing method of claim 1,
Figure DEST_PATH_IMAGE029
the number of sub-information of the collected data in the previous historical preset time period of the current preset time period is equal to or
Figure DEST_PATH_IMAGE031
Wherein, in the step (A),
Figure DEST_PATH_IMAGE033
the number of sub information of the collected data in the ith historical preset time period is shown, and x is the number of the historical preset time periods;
Figure DEST_PATH_IMAGE035
the number of sub-information in the ith calculation cycle of the collected data in the previous historical preset time period of the current preset time period is set as the number of the sub-information in the ith calculation cycle of the collected data in the previous historical preset time period of the current preset time period, or
Figure DEST_PATH_IMAGE037
Wherein, in the step (A),
Figure DEST_PATH_IMAGE039
and the number of sub information in the ith calculation cycle in the jth historical preset time period is the collected data.
3. The data processing method of claim 2, wherein the collected data is satisfied
Figure DEST_PATH_IMAGE041
The method also comprises the following steps:
and acquiring a plurality of calculation cycles in the current preset time period, wherein the calculation cycles are respectively distributed on a time axis in a discrete manner and have no intersection, and the union of the calculation cycles is the current preset time period.
4. The data processing method of claim 3,
the current preset time period comprises a first calculation cycle and a second calculation cycle, wherein the first calculation cycle is a union of daytime hours in the current preset time period, and the second calculation cycle is a union of nighttime hours in the current preset time period.
5. The data processing method according to any one of claims 1 to 4, further comprising:
acquiring a deletion operation instruction from a user interaction terminal for a specified video file;
in response to the deletion operation instruction, deleting the specified video file;
and deleting the sub information of the moving source ID corresponding to the specified video file in the sending list.
6. The data processing method of claim 3, further comprising:
obtaining a plurality of first antenna strings (str 1, str2, … …, str) covered by the current preset time period from an external platformZ) Wherein the external platform is perGenerating a first weather character string in each preset sub-time period u, wherein Z = up (the current preset time period ÷ preset sub-time period), up () is an upward rounding function, and the first weather character string corresponding to each preset sub-time period consists of characters representing the light state of a specified geographic area in the sub-time period and characters representing the weather state of the specified geographic area in the sub-time period;
for each first antenna character string, determining a mapping value S of the first antenna character string in a predetermined mapping tablek,SkDetermined by the accuracy of the detection of the environmental quality corresponding to the weather condition of the first weather string, k
Figure DEST_PATH_IMAGE043
];
-increasing the time interval [ u x (k-1), u x k ] in the calculation cycle covered with said first weather string.
7. A data processing system, comprising:
the system comprises a plurality of detection terminals, a processor and a video cache module, wherein each detection terminal comprises a camera module, the processor and the video cache module, the camera module is used for shooting a video file with a mobile source, the processor is used for identifying whether the video file meets a preset cache condition, and when the video file meets the preset cache condition, the video cache module is used for caching the video file, and collected data are sent to a server, and the collected data comprise a mobile source ID of the video file, a detection terminal ID for shooting the mobile source and detection reporting time;
a server, connected to the plurality of detection terminals, for acquiring the collected data from the plurality of detection terminals and executing the data processing method according to any one of claims 1 to 6 based on the collected data, and acquiring video files required by the server from the plurality of detection terminals.
8. An electronic device, comprising: at least one processor; and a memory communicatively coupled to the at least one processor;
wherein the memory stores instructions executable by the at least one processor, the instructions being arranged to perform the method of any of the preceding claims 1 to 6.
9. A computer-readable storage medium having stored thereon computer-executable instructions for performing the method flow of any of claims 1-6.
CN202110731500.2A 2021-06-30 2021-06-30 Data processing method and system, electronic device and computer readable storage medium Active CN113179335B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110731500.2A CN113179335B (en) 2021-06-30 2021-06-30 Data processing method and system, electronic device and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110731500.2A CN113179335B (en) 2021-06-30 2021-06-30 Data processing method and system, electronic device and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN113179335A CN113179335A (en) 2021-07-27
CN113179335B true CN113179335B (en) 2021-09-24

Family

ID=76927932

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110731500.2A Active CN113179335B (en) 2021-06-30 2021-06-30 Data processing method and system, electronic device and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN113179335B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006309315A (en) * 2005-04-26 2006-11-09 Mitsubishi Electric Corp Data recorder, inspection device equipped with data recorder, and controller
CN101132619A (en) * 2006-08-22 2008-02-27 大唐移动通信设备有限公司 Method for reporting information of terminal buffer area data volume
CN106230993A (en) * 2016-09-29 2016-12-14 中国南方电网有限责任公司电网技术研究中心 The security protection compliance data acquisition method of electric power monitoring system and system
CN106709053A (en) * 2017-01-06 2017-05-24 深圳市中博科创信息技术有限公司 Data slice management method and system
CN111918372A (en) * 2020-08-11 2020-11-10 珠海格力电器股份有限公司 Communication method and device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170257658A1 (en) * 2016-03-02 2017-09-07 Le Holdings (Beijing) Co., Ltd. Method for automatically pushing video based on analysis of user behavior and electronic device
CN108306771B (en) * 2018-02-09 2021-06-18 腾讯科技(深圳)有限公司 Log reporting method, device and system
CN110275985A (en) * 2019-06-26 2019-09-24 银河水滴科技(北京)有限公司 A kind of processing method and processing unit of video frequency searching task
CN111416905A (en) * 2020-03-17 2020-07-14 浙江每日互动网络科技股份有限公司 Information processing method and device, terminal and computer readable storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006309315A (en) * 2005-04-26 2006-11-09 Mitsubishi Electric Corp Data recorder, inspection device equipped with data recorder, and controller
CN101132619A (en) * 2006-08-22 2008-02-27 大唐移动通信设备有限公司 Method for reporting information of terminal buffer area data volume
CN106230993A (en) * 2016-09-29 2016-12-14 中国南方电网有限责任公司电网技术研究中心 The security protection compliance data acquisition method of electric power monitoring system and system
CN106709053A (en) * 2017-01-06 2017-05-24 深圳市中博科创信息技术有限公司 Data slice management method and system
CN111918372A (en) * 2020-08-11 2020-11-10 珠海格力电器股份有限公司 Communication method and device

Also Published As

Publication number Publication date
CN113179335A (en) 2021-07-27

Similar Documents

Publication Publication Date Title
CN110132290B (en) Intelligent driving road side equipment perception information fusion processing method, device and equipment
CN110573837B (en) Navigation method, navigation device, storage medium and server
CN109996176B (en) Road side perception and vehicle terminal vehicle road cooperative fusion processing method and device
CN110674349B (en) Video POI (Point of interest) identification method and device and electronic equipment
CN1725212A (en) Adaptation of exponential models
CN105279236A (en) File cleaning method and device and electronic equipment
CN106909407B (en) Background application program closing method and device and terminal
CN110531788B (en) Cruise control method and device for unmanned aerial vehicle and electronic equipment
CN109548691A (en) A kind of pet recognition methods, device, medium and electronic equipment
CN113722409A (en) Method and device for determining spatial relationship, computer equipment and storage medium
CN110718212A (en) Voice wake-up method, device and system, terminal and computer readable storage medium
CN113923775B (en) Method, device, equipment and storage medium for evaluating quality of positioning information
CN113179335B (en) Data processing method and system, electronic device and computer readable storage medium
CN110706691B (en) Voice verification method and device, electronic equipment and computer readable storage medium
CN111949145A (en) Intelligent pen image processing method and device and electronic equipment
CN111091827B (en) Voice navigation method and device, terminal and computer readable storage medium
CN109558980B (en) Scenic spot traffic data prediction method and device and computer equipment
CN107490383B (en) Service providing method, server and readable medium for path health information in navigation
CN113590943A (en) Gas station recommendation method, system, electronic device and medium
CN110717386A (en) Method and device for tracking affair-related object, electronic equipment and non-transitory storage medium
CN113903105B (en) Video cyclic storage method and device, electronic equipment and storage medium
CN113283483B (en) Device type determining method based on wifi, electronic device and storage medium
CN111369794B (en) Method, device and equipment for determining traffic participation information and storage medium
CN108206850A (en) Road vehicles behavior monitoring method, apparatus and electronic equipment
JP7215325B2 (en) Information gathering system, information gathering method and information gathering program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant