CN113704652B - Data processing method, device, transfer station and data processing system - Google Patents
Data processing method, device, transfer station and data processing system Download PDFInfo
- Publication number
- CN113704652B CN113704652B CN202110785649.9A CN202110785649A CN113704652B CN 113704652 B CN113704652 B CN 113704652B CN 202110785649 A CN202110785649 A CN 202110785649A CN 113704652 B CN113704652 B CN 113704652B
- Authority
- CN
- China
- Prior art keywords
- data
- target data
- converted
- converted data
- unique identifier
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012546 transfer Methods 0.000 title claims abstract description 94
- 238000012545 processing Methods 0.000 title claims abstract description 37
- 238000003672 processing method Methods 0.000 title claims abstract description 33
- 238000012544 monitoring process Methods 0.000 claims abstract description 103
- 238000000034 method Methods 0.000 claims abstract description 26
- 238000006243 chemical reaction Methods 0.000 claims abstract description 15
- 238000004590 computer program Methods 0.000 claims description 21
- 230000003993 interaction Effects 0.000 abstract description 9
- 230000008569 process Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 238000013500 data storage Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000005856 abnormality Effects 0.000 description 1
- 238000009825 accumulation Methods 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000004880 explosion Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
- G06F16/986—Document structures and storage, e.g. HTML extensions
Abstract
The invention provides a data processing method, a data processing device, a transfer station and a data processing system. The method is applied to the transfer station and comprises the following steps: receiving target data sent by a monitoring system; performing format conversion on the target data to obtain converted data; the data size of the converted data is smaller than that of the target data; storing the corresponding relation of the target data, the converted data and the converted data; the converted data is sent to a monitoring system, and the converted data is used for indicating the monitoring system to generate path information of the converted data and sending the path information of the converted data to a browser; the path information of the converted data is used for indicating the browser to display the converted data according to the path information of the converted data. The invention can improve the interaction speed of the front end and the rear end and realize the requirement of a lightweight system.
Description
Technical Field
The present invention relates to the field of data processing technologies, and in particular, to a data processing method, a data processing device, a transfer station, and a data processing system.
Background
The front-end browser and the back-end server typically interact with each other in http (Hypertext Transfer Protocol ). The front-end browser sends a request message to the back-end server to request data, the back-end server performs a series of processing according to the request message to obtain data required by the front-end browser, generates a reply message according to the data, and sends the reply message to the front-end browser. However, when the data requested by the front-end browser is larger, the method is easy to influence the interaction speed of the front-end and the back-end, and the requirement of a lightweight system cannot be met.
Disclosure of Invention
The embodiment of the invention provides a data processing method, a data processing device, a transfer station and a data processing system, which are used for solving the problems that when data requested by a front-end browser is large, the interaction speed of the front end and the back end is easy to influence and the requirement of a lightweight system cannot be met.
In a first aspect, an embodiment of the present invention provides a data processing method, applied to a transfer station, where the data processing method includes:
receiving target data sent by a monitoring system;
performing format conversion on the target data to obtain converted data; the data size of the converted data is smaller than that of the target data;
Storing the corresponding relation of the target data, the converted data and the converted data;
the converted data is sent to a monitoring system, and the converted data is used for indicating the monitoring system to generate path information of the converted data and sending the path information of the converted data to a browser; the path information of the converted data is used for indicating the browser to display the converted data according to the path information of the converted data.
In one possible implementation, the data processing method further includes:
if the browser cannot identify the converted data, generating a unique identifier for the target data, and storing the target data, the unique identifier and a corresponding relation between the target data and the unique identifier;
transmitting the unique identifier to a monitoring system, wherein the unique identifier is used for indicating the monitoring system to generate path information of target data, and transmitting the path information of the target data to a browser; the path information of the target data is used for indicating the browser to display the target data according to the path information of the target data.
In one possible implementation, the data processing method further includes:
receiving a storage instruction sent by a monitoring system, wherein the storage instruction comprises converted data or unique identification; the storage instruction is an instruction generated by the monitoring system according to the storage request of the browser; the save request contains the converted data or unique identification;
Searching the converted data or target data corresponding to the unique identifier;
storing the target data, the converted data and the corresponding relation between the target data and the converted data in a database, and deleting the target data, the converted data and the corresponding relation between the target data and the converted data stored in the database; or, storing the target data, the unique identifier and the corresponding relation between the target data and the unique identifier in a database, and deleting the target data, the unique identifier and the corresponding relation between the target data and the unique identifier stored in the database.
In one possible implementation, after searching the converted data or the target data corresponding to the unique identifier, the method further includes:
if the converted data or the target data corresponding to the unique identifier is found, continuing to store the target data, the converted data and the corresponding relation between the target data and the converted data in a database, and deleting the target data, the converted data and the corresponding relation between the target data and the converted data stored in the database; or, storing the target data, the unique identifier and the corresponding relation between the target data and the unique identifier in a database, and deleting the target data, the unique identifier and the corresponding relation between the target data and the unique identifier stored in the database;
If the target data is not found, generating storage failure information, and sending the storage failure information to a monitoring system; the storage failure information is used for indicating the monitoring system to send the storage failure information to the browser.
In one possible implementation, the data processing method further includes:
when storing the target data, the converted data and the corresponding relation between the target data and the converted data, starting timing;
when the time length reaches the preset time length, if the corresponding relation among the target data, the converted data and the target data and the converted data is still stored, deleting the corresponding relation among the target data, the converted data and the target data and the converted data, and if the unique identifier is still stored, deleting the unique identifier and the corresponding relation between the target data and the unique identifier.
In one possible implementation, the target data is data acquired by the monitoring system from the acquisition device according to a new request of the browser.
In a second aspect, an embodiment of the present invention provides a data processing apparatus, applied to a transfer station, where the data processing apparatus includes:
the receiving module is used for receiving the target data sent by the monitoring system;
The format conversion module is used for carrying out format conversion on the target data to obtain converted data; the data size of the converted data is smaller than that of the target data;
the storage module is used for storing the target data, the converted data and the corresponding relation between the target data and the converted data;
the sending module is used for sending the converted data to the monitoring system, the converted data is used for indicating the monitoring system to generate path information of the converted data, and the path information of the converted data is sent to the browser; the path information of the converted data is used for indicating the browser to display the converted data according to the path information of the converted data.
In a third aspect, an embodiment of the present invention provides a transfer station, including a memory, a processor, and a computer program stored in the memory and executable on the processor, the processor implementing the steps of the data processing method as described above in the first aspect or any one of the possible implementations of the first aspect when the computer program is executed.
In a fourth aspect, an embodiment of the present invention provides a data processing system, including a browser, a monitoring system, and a transfer station according to the third aspect;
The monitoring system is respectively connected with the browser and the transfer station.
In a fifth aspect, embodiments of the present invention provide a computer readable storage medium storing a computer program which, when executed by a processor, implements the steps of the data processing method as described above in the first aspect or any one of the possible implementations of the first aspect.
The embodiment of the invention provides a data processing method, a data processing device, a transfer station and a data processing system, wherein the transfer station is used for carrying out format conversion on target data to obtain converted data, so that the target data with larger data quantity can be converted into data with smaller data quantity, the converted data is subsequently sent to a monitoring system, the monitoring system generates path information of the converted data and sends the path information to a browser, the browser displays the converted data according to the path information for a user to check, and even when the browser requests larger data, the monitoring system can also send smaller reply data, the front-end and back-end interaction speed can be improved, and the requirement of a lightweight system is met.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is an application scenario diagram of a data processing method provided by an embodiment of the present invention;
FIG. 2 is a flowchart of an implementation of a data processing method provided by an embodiment of the present invention;
FIG. 3 is a schematic diagram of a data processing apparatus according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a transfer station according to an embodiment of the present invention.
Detailed Description
In the following description, for purposes of explanation and not limitation, specific details are set forth such as the particular system architecture, techniques, etc., in order to provide a thorough understanding of the embodiments of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.
For the purpose of making the objects, technical solutions and advantages of the present invention more apparent, the following description will be made by way of specific embodiments with reference to the accompanying drawings.
Fig. 1 is an application scenario diagram of a data processing method according to an embodiment of the present invention. As shown in fig. 1, the browser and the monitoring system can communicate through a network, the monitoring system can be respectively connected with the acquisition device, the transfer station and the database in a communication manner, and the transfer station can be connected with the database in a communication manner and can perform data transmission. The server comprises a monitoring system and a transfer station. The monitoring system can monitor transmission data between the server and other devices or apparatuses, and can also perform some processing on the data.
The acquisition equipment can be access control acquisition equipment and can be used for acquiring face images or fingerprint images of users and the like. Of course, the collecting device may be a collecting device for other purposes, and is not particularly limited herein.
When a user needs to input a face image or a fingerprint image, a new button can be clicked in a corresponding page in the browser, and the browser generates a new request and sends the new request to the monitoring system. And the monitoring system acquires the data of the face image or the fingerprint image of the user from the acquisition equipment according to the new request, calls the data as target data, and sends the acquired target data to the transfer station.
The transfer station performs format conversion on the target data to obtain converted data, and stores the target data, the converted data and the corresponding relation between the target data and the converted data, wherein the data size of the converted data is smaller than that of the target data. Illustratively, hexadecimal data may be converted into data in a picture format (e.g., JPG, PNG, etc.), reducing the data size. The transfer station may send the converted data to a monitoring system.
The monitoring system can generate path information of the converted data according to the converted data, and send the path information of the converted data to the front-end browser. The browser may display the converted data according to path information of the converted data.
If the browser cannot identify the converted data, for example, the browser cannot identify the data in the picture format, the browser can send the unidentified information to the monitoring system, and the monitoring system sends the information to the transfer station.
After the transfer station receives the information, the browser is determined to be unable to recognize and display the converted data, at this time, the transfer station can generate a unique identifier for the target data, and store the target data, the unique identifier and the corresponding relationship between the target data and the unique identifier. The transfer station transmits the unique identification of the target data to the monitoring system. The monitoring system can generate path information of the target data according to the unique identification of the target data, and send the path information of the target data to the browser. The browser displays the target data according to the path information of the target data. Wherein the path information of the target data may include a unique identification of the target data. The interaction between the browser and the monitoring system can be performed in the form of http messages.
The user can determine whether the target data displayed by the browser, namely the face image or the fingerprint image, is satisfied, if not, the process can be repeated to acquire the image again; if satisfied, a "save" button in the browser may be clicked, and the browser generates a save request that includes the unique identification or the converted data to send to the monitoring system.
And the monitoring system generates a save instruction containing the unique identifier or the converted data according to the save request and sends the save instruction to the transfer station.
The transfer station searches the unique identifier or the target data corresponding to the converted data according to the storage instruction, stores the target data, the converted data and the corresponding relation between the target data and the converted data in a database, deletes the corresponding relation between the target data stored by the transfer station, the converted data and the target data after conversion, or stores the corresponding relation between the target data, the unique identifier and the unique identifier in the database, and deletes the corresponding relation between the target data, the unique identifier and the unique identifier stored by the transfer station. Subsequently, the monitoring system may read the data directly from the database.
The process of deleting data is similar to the process of storing data, and will not be described again.
The transfer station is in memory and the database is in disk. The transfer station can temporarily store data, and the data is automatically deleted after the storage time exceeds the preset time.
Referring to fig. 2, a flowchart of an implementation of a data processing method according to an embodiment of the present invention is shown, where the data processing method is applied to a transfer station, and is described in detail as follows:
In S201, target data transmitted by the monitoring system is received.
The target data may be larger image data, text data, or the like, or may be smaller data, and is not particularly limited.
In some embodiments of the present invention, the target data is data acquired by the monitoring system from the acquisition device according to a new request of the browser.
In the embodiment of the invention, the browser generates a new request according to the fact that the user clicks a new button, and sends the new request to the monitoring system. The monitoring system may send an acquisition request to the acquisition device. The acquisition equipment acquires target data according to the acquisition request and sends the target data to the monitoring system. The monitoring system sends the target data to the transfer station.
The acquisition device may be a card reader, for example.
After S201, the method further includes:
judging whether the target data is complete, if so, continuing to execute S202; if the target data acquisition failure information is incomplete, returning the target data acquisition failure information to the monitoring system, so that the monitoring system sends the target data acquisition failure information to the browser for display, and prompting the user.
The integrity of the target data can be judged according to the aspects of whether the target data format is correct, whether the target data is lost and the like.
In S202, format conversion is performed on the target data to obtain converted data; the data size of the converted data is smaller than the data size of the target data.
The transfer station can perform format conversion on the target data, and convert the target data with larger data volume into converted data with smaller data volume, so that interaction between a follow-up monitoring system and a front-end browser is facilitated.
Illustratively, the target data is hexadecimal data, and the converted data may be data in a picture format, such as JPG, PNG, or the like. After hexadecimal data is converted into data in a picture format, the data volume becomes smaller.
In S203, the target data, the converted data, and the correspondence relationship between the target data and the converted data are stored.
The transfer station may temporarily store data, and thus, the transfer station may temporarily store target data, converted data, and correspondence between the two. Subsequently, the method can be deleted according to the instruction of the monitoring system or automatically deleted when the storage time exceeds the preset time.
After S203, the method further includes:
judging whether the storage of the target data, the converted data and the corresponding relation between the target data and the converted data is successful, if so, continuing to execute S204, if not, generating first transfer station storage failure information, and sending the first transfer station storage failure information to a monitoring system; the first transfer station storage failure information is used for indicating the monitoring system to send the first transfer station storage failure information to the browser, so that the browser can display the first transfer station storage failure information, and remind a user of unsuccessful storage of target data, converted data and corresponding relation between the target data and the converted data.
The judging unit is configured to judge whether the target data, the converted data, and the correspondence between the target data and the converted data are successfully stored, and can judge whether the correspondence between the target data and the converted data is correct, whether the target data and the converted data are clear, whether the target data and the converted data are usable, and other data correctness aspects.
In S204, the converted data is sent to the monitoring system, and the converted data is used to instruct the monitoring system to generate path information of the converted data, and the path information of the converted data is sent to the browser; the path information of the converted data is used for indicating the browser to display the converted data according to the path information of the converted data.
In one possible implementation, the path information of the converted data includes the converted data. The browser may display the converted data according to the path information.
According to the embodiment of the invention, the format of the target data is converted through the transfer station to obtain the converted data, so that the target data with larger data quantity can be converted into the data with smaller data quantity, the converted data is subsequently sent to the monitoring system, the monitoring system generates path information of the converted data and sends the path information to the browser, the browser displays the converted data according to the path information for a user to check, even when the browser requests larger data, the monitoring system can send smaller reply data, the front-end and rear-end interaction speed can be improved, and the operation quantity, the analysis quantity and the like of the front-end browser can be reduced by sending the data with smaller data quantity to the front-end browser, so that the demand of a lightweight system is realized.
In some embodiments of the present invention, the data processing method may further include:
if the browser cannot identify the converted data, generating a unique identifier for the target data, and storing the target data, the unique identifier and a corresponding relation between the target data and the unique identifier;
transmitting the unique identifier to a monitoring system, wherein the unique identifier is used for indicating the monitoring system to generate path information of target data, and transmitting the path information of the target data to a browser; the path information of the target data is used for indicating the browser to display the target data according to the path information of the target data.
As described above, the transfer station receives the unrecognizable information, determines that the browser cannot recognize and display the converted data. At this time, the transfer station may generate a unique identifier for the target data, send the unique identifier of the target data to the monitoring system, generate path information of the target data by the monitoring system, and return the path information to the browser, so that the browser displays the target data according to the path information. Wherein the path information of the target data includes a unique identification of the target data.
After the transfer station generates the unique identifier of the target data, the unique identifier and the corresponding relationship between the target data and the unique identifier can be stored.
In one possible implementation, after storing the target data, the unique identifier, and the correspondence between the target data and the unique identifier, the stored target data, the converted data, and the correspondence between the target data and the converted data may be deleted.
In one possible implementation manner, after storing the target data, the unique identifier, and the correspondence between the target data and the unique identifier, the method may further include:
judging whether the target data, the unique identifier and the corresponding relation between the target data and the unique identifier are successfully stored, if so, continuing to execute the subsequent steps, if not, generating second transfer station storage failure information, and sending the second transfer station storage failure information to a monitoring system; the second transfer station storage failure information is used for indicating the monitoring system to send the second transfer station storage failure information to the browser, so that the browser can display the second transfer station storage failure information, and the user is reminded of unsuccessful storage of the target data, the unique identifier and the corresponding relation between the target data and the unique identifier.
The method comprises the steps of judging whether the target data, the unique identifier and the corresponding relation between the target data and the unique identifier are successfully stored, and judging whether the target data and the corresponding relation between the unique identifier are correct, whether the target data are clear, whether the target data are available and the like.
In one possible implementation manner, the generating the unique identifier for the target data includes:
the current time is obtained, and based on an MD5 Algorithm (MD 5 Message-Digest Algorithm, MD5 information summary Algorithm), a unique identifier is generated for the target data according to the current time.
In the embodiment of the invention, the unique identifier of the target data can be generated by adopting an MD5 algorithm according to the current time. The unique identification has unique non-repeating characteristics.
When the browser cannot identify the converted data, the unique identification of the target data can be generated through the transfer station, the unique identification of the target data is sent to the monitoring system, the path information of the target data is generated through the monitoring system according to the unique identification of the target data, and then the path information is sent to the browser, the browser can display the target data according to the path information of the target data for a user to check, and therefore the browser can display the target data based on the interactive data with smaller data size.
In some embodiments of the present invention, the data processing method further includes:
receiving a storage instruction sent by a monitoring system, wherein the storage instruction comprises converted data or unique identification; the storage instruction is an instruction generated by the monitoring system according to the storage request of the browser; the save request contains the converted data or unique identification;
Searching the converted data or target data corresponding to the unique identifier;
storing the target data, the converted data and the corresponding relation between the target data and the converted data in a database, and deleting the target data, the converted data and the corresponding relation between the target data and the converted data stored in the database; or, storing the target data, the unique identifier and the corresponding relation between the target data and the unique identifier in a database, and deleting the target data, the unique identifier and the corresponding relation between the target data and the unique identifier stored in the database.
After the user presses the "save" button in the browser page, the browser generates a save request containing the converted data or unique identifier. If the browser can identify the converted data, the scheme of the subsequent unique identification is not executed, and at the moment, the storage request contains the converted data; if the browser cannot identify the converted data, executing a scheme of the subsequent unique identification, wherein the storage request contains the unique identification.
The browser sends a save request to the monitoring system. And the monitoring system generates a storage instruction containing the converted data or the unique identifier according to the storage request and sends the storage instruction to the transfer station.
If the storage instruction contains the converted data, the transfer station searches for the target data corresponding to the converted data according to the converted data in the storage instruction, then stores the target data, the converted data and the corresponding relation between the target data and the converted data in a database, and deletes the corresponding relation between the target data, the converted data and the converted data stored in the transfer station after the transfer station successfully stores the target data, the converted data and the converted data in the database.
If the storage instruction contains the unique identifier, the transfer station searches for the target data corresponding to the unique identifier according to the unique identifier in the storage instruction, then stores the target data, the unique identifier and the corresponding relation between the target data and the unique identifier in the database, deletes the corresponding relation between the target data stored by the transfer station, the unique identifier and the target data and the unique identifier after the target data, the unique identifier and the corresponding relation between the target data and the unique identifier are successfully stored in the database, and deletes the target data stored by the transfer station if the transfer station still stores the converted data corresponding to the target data.
After storing the target data, the converted data, and the correspondence between the target data and the converted data in the database, or storing the target data, the unique identifier, and the correspondence between the target data and the unique identifier in the database, the method may further include:
Generating storage success information and sending the storage success information to a monitoring system; the storage success information is used for indicating the monitoring system to send the storage success information to the browser so that the browser can display the storage success information and prompt a user that the data storage is successful.
In some embodiments of the present invention, after searching the converted data or the target data corresponding to the unique identifier, the method further includes:
if the converted data or the target data corresponding to the unique identifier is found, continuing to store the target data, the converted data and the corresponding relation between the target data and the converted data in a database, and deleting the target data, the converted data and the corresponding relation between the target data and the converted data stored in the database; or, storing the target data, the unique identifier and the corresponding relation between the target data and the unique identifier in a database, and deleting the target data, the unique identifier and the corresponding relation between the target data and the unique identifier stored in the database;
if the target data is not found, generating storage failure information, and sending the storage failure information to a monitoring system; the storage failure information is used for indicating the monitoring system to send the storage failure information to the browser. So that the browser can display the information of failure in storage, and prompt the user that the data storage fails.
The possible reason why the converted data or the target data corresponding to the unique identifier is not found is that other users may perform removal or deletion actions before searching the data, so that the target identifier cannot be found in the transfer station, or the converted data or the unique identifier cannot be successfully identified.
In some embodiments of the present invention, the data processing method further includes:
when storing the target data, the converted data and the corresponding relation between the target data and the converted data, starting timing;
when the time length reaches the preset time length, if the corresponding relation among the target data, the converted data and the target data and the converted data is still stored, deleting the corresponding relation among the target data, the converted data and the target data and the converted data, and if the unique identifier is still stored, deleting the unique identifier and the corresponding relation between the target data and the unique identifier.
In the embodiment of the invention, the transfer station can be used for temporarily storing the data, and deleting the data when the data storage time length reaches the preset time length.
After deleting the unique identifier and the corresponding relation between the target data and the unique identifier, deleting the target data if the target data is detected to be still stored.
The user may not transfer or delete the data in the transfer station for a long time, or the data is left due to abnormality caused by system downtime, etc., in order to avoid the data accumulation and explosion of the memory, the data storage time is judged, and if the data storage time exceeds the preset time length, the data is deleted. The preset time period may be set according to actual requirements, and is not particularly limited herein. For example, the preset duration may be 30 minutes, 30 minutes at 10 if the data is stored at the transfer station at 00 minutes, and deleting the data if it is still stored at the transfer station.
According to the embodiment of the invention, the processing speed can be improved through the transfer station, and the main purpose of the transfer station is that large data are not required to be transmitted to the front-end browser at one time, small data are transmitted to the front-end browser through storage and processing of the transfer station, and the background server processes the data in the transfer station again according to the result of front-end response, such as data removal, data archiving and the like. In addition, the main processing object of the transfer station is a memory, and compared with a magnetic disk, the memory processing speed is high and the efficiency is high. The embodiment of the invention can improve the interaction performance of the front end and the rear end and optimize the processing of a series of big data such as texts, pictures and the like.
It should be understood that the sequence number of each step in the foregoing embodiment does not mean that the execution sequence of each process should be determined by the function and the internal logic, and should not limit the implementation process of the embodiment of the present invention.
The following are device embodiments of the invention, for details not described in detail therein, reference may be made to the corresponding method embodiments described above.
Fig. 3 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention, and for convenience of explanation, only a portion related to the embodiment of the present invention is shown, which is described in detail below:
the data processing device 30 is applied to a transfer station, and as shown in fig. 3, the data processing device 30 includes: a receiving module 31, a format conversion module 32, a storage module 33 and a transmitting module 34.
A receiving module 31, configured to receive target data sent by the monitoring system;
a format conversion module 32, configured to perform format conversion on the target data, so as to obtain converted data; the data size of the converted data is smaller than that of the target data;
a storage module 33, configured to store the target data, the converted data, and a correspondence between the target data and the converted data;
The sending module 34 is configured to send the converted data to the monitoring system, where the converted data is used to instruct the monitoring system to generate path information of the converted data, and send the path information of the converted data to the browser; the path information of the converted data is used for indicating the browser to display the converted data according to the path information of the converted data.
According to the embodiment of the invention, the format of the target data is converted through the transfer station to obtain the converted data, so that the target data with larger data quantity can be converted into the data with smaller data quantity, the converted data is subsequently sent to the monitoring system, the monitoring system generates path information of the converted data and sends the path information to the browser, the browser displays the converted data according to the path information for a user to check, and even when the browser requests larger data, the monitoring system can send smaller reply data, so that the speed of front-end and back-end interaction can be improved, and the requirement of a lightweight system is met.
In one possible implementation, the data processing apparatus 30 further includes: and a unique identification generation module.
The unique identification generation module is used for:
if the browser cannot identify the converted data, generating a unique identifier for the target data, and storing the target data, the unique identifier and a corresponding relation between the target data and the unique identifier;
Transmitting the unique identifier to a monitoring system, wherein the unique identifier is used for indicating the monitoring system to generate path information of target data, and transmitting the path information of the target data to a browser; the path information of the target data is used for indicating the browser to display the target data according to the path information of the target data.
In one possible implementation, the data processing apparatus 30 further includes: and a database storage module.
A database storage module for:
receiving a storage instruction sent by a monitoring system, wherein the storage instruction comprises converted data or unique identification; the storage instruction is an instruction generated by the monitoring system according to the storage request of the browser; the save request contains the converted data or unique identification;
searching the converted data or target data corresponding to the unique identifier;
storing the target data, the converted data and the corresponding relation between the target data and the converted data in a database, and deleting the target data, the converted data and the corresponding relation between the target data and the converted data stored in the database; or, storing the target data, the unique identifier and the corresponding relation between the target data and the unique identifier in a database, and deleting the target data, the unique identifier and the corresponding relation between the target data and the unique identifier stored in the database.
In one possible implementation, the database saving module is further configured to:
if the converted data or the target data corresponding to the unique identifier is found, continuing to store the target data, the converted data and the corresponding relation between the target data and the converted data in a database, and deleting the target data, the converted data and the corresponding relation between the target data and the converted data stored in the database; or, storing the target data, the unique identifier and the corresponding relation between the target data and the unique identifier in a database, and deleting the target data, the unique identifier and the corresponding relation between the target data and the unique identifier stored in the database;
if the target data is not found, generating storage failure information, and sending the storage failure information to a monitoring system; the storage failure information is used for indicating the monitoring system to send the storage failure information to the browser.
In one possible implementation, the data processing apparatus 30 further includes: and a timing deleting module.
A timing deleting module, configured to:
when storing the target data, the converted data and the corresponding relation between the target data and the converted data, starting timing;
When the time length reaches the preset time length, if the corresponding relation among the target data, the converted data and the target data and the converted data is still stored, deleting the corresponding relation among the target data, the converted data and the target data and the converted data, and if the unique identifier is still stored, deleting the unique identifier and the corresponding relation between the target data and the unique identifier.
In one possible implementation, the target data is data acquired by the monitoring system from the acquisition device according to a new request of the browser.
Fig. 4 is a schematic diagram of a transfer station according to an embodiment of the present invention. As shown in fig. 4, the transfer station 4 of this embodiment includes: a processor 40, a memory 41 and a computer program 42 stored in the memory 41 and executable on the processor 40. The steps of the respective data processing method embodiments described above are implemented when the processor 40 executes the computer program 42, for example, S201 to S204 shown in fig. 2. Alternatively, the processor 40, when executing the computer program 42, performs the functions of the modules/units of the apparatus embodiments described above, such as the functions of the modules/units 31-34 shown in fig. 3.
Illustratively, the computer program 42 may be partitioned into one or more modules/units that are stored in the memory 41 and executed by the processor 40 to complete the present invention. The one or more modules/units may be a series of computer program instruction segments capable of performing a specific function describing the execution of the computer program 42 in the transfer station 4. For example, the computer program 42 may be split into the modules/units 31 to 34 shown in fig. 3.
The transfer station 4 may include, but is not limited to, a processor 40, a memory 41. It will be appreciated by those skilled in the art that fig. 4 is merely an example of a transfer station 4 and is not intended to limit the transfer station 4, and may include more or fewer components than shown, or may combine certain components, or different components, e.g., the transfer station may further include input and output devices, network access devices, buses, etc.
The processor 40 may be a central processing unit (Central Processing Unit, CPU), other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field-programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory 41 may be an internal storage unit of the transfer station 4, such as a hard disk or a memory of the transfer station 4. The memory 41 may also be an external storage device of the transfer station 4, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) or the like, which are provided on the transfer station 4. Further, the memory 41 may also include both an internal storage unit and an external storage device of the transfer station 4. The memory 41 is used for storing the computer program as well as other programs and data required by the transfer station. The memory 41 may also be used for temporarily storing data that has been output or is to be output.
The embodiment of the invention also provides a data processing system which comprises a browser, a monitoring system and the transfer station; the monitoring system is respectively connected with the browser and the transfer station.
Reference may be made to the detailed description of the above methods/apparatuses for the detailed description of the data processing system, which is not repeated here.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working process of the units and modules in the above system may refer to the corresponding process in the foregoing method embodiment, which is not described herein again.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and in part, not described or illustrated in any particular embodiment, reference is made to the related descriptions of other embodiments.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided herein, it should be understood that the disclosed apparatus/transfer station and method may be implemented in other ways. For example, the apparatus/transfer station embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical functional division, and there may be additional divisions in actual implementation, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection via interfaces, devices or units, which may be in electrical, mechanical or other forms.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated modules/units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on this understanding, the present invention may implement all or part of the flow of the method of the above embodiment, or may be implemented by instructing related hardware by a computer program, where the computer program may be stored in a computer readable storage medium, and the computer program may implement the steps of each of the data processing method embodiments described above when executed by a processor. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), an electrical carrier signal, a telecommunications signal, a software distribution medium, and so forth. It should be noted that the computer readable medium may include content that is subject to appropriate increases and decreases as required by jurisdictions in which such content is subject to legislation and patent practice, such as in certain jurisdictions in which such content is not included as electrical carrier signals and telecommunication signals.
The above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention, and are intended to be included in the scope of the present invention.
Claims (10)
1. A data processing method, applied to a transfer station, comprising:
receiving target data sent by a monitoring system;
performing format conversion on the target data to obtain converted data; the data size of the converted data is smaller than that of the target data;
storing the target data, the converted data and the corresponding relation between the target data and the converted data;
transmitting the converted data to the monitoring system, wherein the converted data is used for indicating the monitoring system to generate path information of the converted data, and transmitting the path information of the converted data to a browser; the path information of the converted data is used for indicating the browser to display the converted data according to the path information of the converted data;
Receiving a storage instruction sent by the monitoring system; the storage instruction is an instruction generated by the monitoring system according to the storage request of the browser; if the browser can identify the converted data, the storage instruction contains the converted data, and the storage request contains the converted data;
searching the target data corresponding to the converted data;
storing the target data, the converted data and the corresponding relation between the target data and the converted data in a database, and deleting the corresponding relation between the target data, the converted data and the converted data stored in the database.
2. The data processing method according to claim 1, characterized in that the data processing method further comprises:
if the browser cannot identify the converted data, generating a unique identifier for the target data, and storing the target data, the unique identifier and a corresponding relation between the target data and the unique identifier;
the unique identification is sent to the monitoring system, and the unique identification is used for indicating the monitoring system to generate path information of the target data and sending the path information of the target data to the browser; the path information of the target data is used for indicating the browser to display the target data according to the path information of the target data.
3. The data processing method according to claim 2, characterized in that the data processing method further comprises:
receiving a storage instruction sent by the monitoring system, wherein if the browser cannot identify the converted data, the storage instruction contains the unique identifier, and the storage request contains the unique identifier;
searching the target data corresponding to the unique identifier;
storing the target data, the unique identifier and the corresponding relation between the target data and the unique identifier in a database, and deleting the target data, the unique identifier and the corresponding relation between the target data and the unique identifier stored in the database.
4. A data processing method according to claim 3, further comprising, after said searching for said target data corresponding to said converted data or said unique identification:
if the converted data or the target data corresponding to the unique identifier is found, continuing to execute the steps of storing the target data, the converted data and the corresponding relation between the target data and the converted data in a database, and deleting the target data, the converted data and the corresponding relation between the target data and the converted data stored in the database; or, storing the target data, the unique identifier and the corresponding relation between the target data and the unique identifier in a database, and deleting the target data, the unique identifier and the corresponding relation between the target data and the unique identifier stored in the database;
If the target data is not found, generating storage failure information, and sending the storage failure information to the monitoring system; and the storage failure information is used for indicating the monitoring system to send the storage failure information to the browser.
5. The data processing method according to claim 2, characterized in that the data processing method further comprises:
when storing the target data, the converted data and the corresponding relation between the target data and the converted data, starting timing;
when the time length reaches the preset time length, deleting the corresponding relation among the target data, the converted data and the converted data if the corresponding relation among the target data, the converted data and the converted data is still stored, and deleting the unique identifier and the corresponding relation among the target data and the unique identifier if the unique identifier is still stored.
6. The method according to any one of claims 1 to 5, wherein the target data is data acquired by the monitoring system from an acquisition device according to a new request of the browser.
7. A data processing apparatus for use in a transfer station, said data processing apparatus comprising:
the receiving module is used for receiving the target data sent by the monitoring system;
the format conversion module is used for carrying out format conversion on the target data to obtain converted data; the data size of the converted data is smaller than that of the target data;
the storage module is used for storing the target data, the converted data and the corresponding relation between the target data and the converted data;
the sending module is used for sending the converted data to the monitoring system, the converted data is used for indicating the monitoring system to generate path information of the converted data, and the path information of the converted data is sent to a browser; the path information of the converted data is used for indicating the browser to display the converted data according to the path information of the converted data;
the database storage module is used for receiving a storage instruction sent by the monitoring system; the storage instruction is an instruction generated by the monitoring system according to the storage request of the browser; if the browser can identify the converted data, the storage instruction contains the converted data, and the storage request contains the converted data; searching the target data corresponding to the converted data; storing the target data, the converted data and the corresponding relation between the target data and the converted data in a database, and deleting the corresponding relation between the target data, the converted data and the converted data stored in the database.
8. A transfer station comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the steps of the data processing method according to any of the preceding claims 1 to 6 when the computer program is executed.
9. A data processing system comprising a browser, a monitoring system, and the transfer station of claim 8;
the monitoring system is respectively connected with the browser and the transfer station.
10. A computer-readable storage medium storing a computer program, characterized in that the computer program when executed by a processor implements the steps of the data processing method according to any of the preceding claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110785649.9A CN113704652B (en) | 2021-07-12 | 2021-07-12 | Data processing method, device, transfer station and data processing system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110785649.9A CN113704652B (en) | 2021-07-12 | 2021-07-12 | Data processing method, device, transfer station and data processing system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113704652A CN113704652A (en) | 2021-11-26 |
| CN113704652B true CN113704652B (en) | 2024-01-02 |
Family
ID=78648455
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110785649.9A Active CN113704652B (en) | 2021-07-12 | 2021-07-12 | Data processing method, device, transfer station and data processing system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113704652B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004078427A (en) * | 2002-08-13 | 2004-03-11 | Sony Corp | Data conversion system, conversion controller, program, recording medium, and data conversion method |
| CN105335145A (en) * | 2014-08-06 | 2016-02-17 | 中兴通讯股份有限公司 | Operation result processing method, device and system |
| WO2018196541A1 (en) * | 2017-04-24 | 2018-11-01 | 腾讯科技（深圳）有限公司 | Document sharing method, server, terminal and storage medium |
| CN109684568A (en) * | 2018-12-13 | 2019-04-26 | 珠海天燕科技有限公司 | Image processing method and device |
| CN109768986A (en) * | 2019-02-20 | 2019-05-17 | 视联动力信息技术股份有限公司 | A kind of method and apparatus of response view networking service demand signalling |
-
2021
- 2021-07-12 CN CN202110785649.9A patent/CN113704652B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004078427A (en) * | 2002-08-13 | 2004-03-11 | Sony Corp | Data conversion system, conversion controller, program, recording medium, and data conversion method |
| CN105335145A (en) * | 2014-08-06 | 2016-02-17 | 中兴通讯股份有限公司 | Operation result processing method, device and system |
| WO2018196541A1 (en) * | 2017-04-24 | 2018-11-01 | 腾讯科技（深圳）有限公司 | Document sharing method, server, terminal and storage medium |
| CN109684568A (en) * | 2018-12-13 | 2019-04-26 | 珠海天燕科技有限公司 | Image processing method and device |
| CN109768986A (en) * | 2019-02-20 | 2019-05-17 | 视联动力信息技术股份有限公司 | A kind of method and apparatus of response view networking service demand signalling |
Non-Patent Citations (2)
| Title |
|---|
| 基于3G网络传输的视频系统的设计与实现;许立国;中国优秀硕士学位论文全文数据库信息科技辑;2013年(第12期);I136-69 * |
| 科学数据网格中数据传输技术的研究与改进;张西广;谢建军;杨德婷;阎保平;;微电子学与计算机(第12期);124-127+130 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113704652A (en) | 2021-11-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108460115B (en) | Message pushing method and device, computer equipment and storage medium | |
| CN110719332B (en) | Data transmission method, device, system, computer equipment and storage medium | |
| CN108052474B (en) | Data format conversion method, device, equipment and computer readable storage medium | |
| US20190158626A1 (en) | Method, apparatus and computer readable storage medium for processing service | |
| CN110753084A (en) | Uplink data reading method, cache server and computer readable storage medium | |
| CN106034113A (en) | Data processing method and data processing device | |
| JP6525486B2 (en) | Network request and response processing method, terminal, server and storage medium | |
| CN115622906A (en) | Application log capturing system and method | |
| CN113704652B (en) | Data processing method, device, transfer station and data processing system | |
| CN110442439B (en) | Task process processing method and device and computer equipment | |
| CN111767543A (en) | Method, device and equipment for determining replay attack vulnerability and readable storage medium | |
| US11146571B2 (en) | Data transmission method, apparatus, terminal device, and medium | |
| CN113507530B (en) | Data forwarding method, related system and device and storage medium | |
| CN115082038A (en) | System integration method and device and electronic equipment | |
| CN114285774A (en) | Flow recording method and device, electronic equipment and storage medium | |
| CN112131180A (en) | Data reporting method and device and storage medium | |
| CN109918588A (en) | Data processing method, device and the electronic equipment that accident is declared | |
| CN117061072B (en) | Message transmission method, device, equipment and storage medium | |
| CN112765196B (en) | Data processing and data recognition method and device, electronic equipment and storage medium | |
| CN114745368B (en) | File downloading method, device, computer equipment and computer readable storage medium | |
| CN112291209B (en) | Method and device for acquiring front-end equipment catalog | |
| CN109086145B (en) | Data generation method and device and computer storage medium | |
| CN116185648A (en) | Synchronous execution control method, device and equipment for multi-channel advertisement front-end tasks | |
| CN115033410A (en) | Abnormal link tracking method, system, gateway and storage medium | |
| CN117828141A (en) | Method, system, electronic equipment, server and storage medium for scanning and searching questions |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |