CN115941669A - Multi-application buried point data uploading method and device - Google Patents
Multi-application buried point data uploading method and device Download PDFInfo
- Publication number
- CN115941669A CN115941669A CN202211466726.5A CN202211466726A CN115941669A CN 115941669 A CN115941669 A CN 115941669A CN 202211466726 A CN202211466726 A CN 202211466726A CN 115941669 A CN115941669 A CN 115941669A
- Authority
- CN
- China
- Prior art keywords
- file
- uploaded
- uploading
- data
- queue
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 36
- 230000005540 biological transmission Effects 0.000 claims abstract description 121
- 239000013589 supplement Substances 0.000 claims abstract description 11
- 230000007246 mechanism Effects 0.000 claims abstract description 8
- 230000001502 supplementing effect Effects 0.000 claims description 13
- 230000000295 complement effect Effects 0.000 claims description 8
- 230000007423 decrease Effects 0.000 claims description 3
- 238000013523 data management Methods 0.000 abstract 1
- 230000006870 function Effects 0.000 description 9
- 238000004891 communication Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 238000004590 computer program Methods 0.000 description 3
- 238000012423 maintenance Methods 0.000 description 2
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a multi-application buried point data uploading method and device, wherein the method comprises the following steps: acquiring buried point data to be uploaded generated by multiple applications; uploading the data of the buried points to be uploaded through a real-time uploading channel; judging whether the buried point data to be uploaded fails to be uploaded through a real-time uploading channel, if so, writing the buried point data to be uploaded which fails to be uploaded into a file of a file queue; and judging whether the files in the file queue meet preset supplement transmission conditions, if so, uploading the files meeting the preset supplement transmission conditions through a supplement transmission channel. According to the invention, the buried point data of each application is collected and then is managed in a unified manner, so that the performance consumption of each application of the vehicle machine is reduced, the real-time uploading of the buried point data is ensured, and the loss probability is reduced; the file supplementary transmission mechanism provided by the invention maintains the buried point supplementary transmission files in a unified manner in the unified buried point data management, and prevents data loss or disorder caused by the buried point supplementary transmission files generated by each application.
Description
Technical Field
The application relates to the technical field of data uploading, in particular to a multi-application buried point data uploading method and a multi-application buried point data uploading device.
Background
With the rapid development of communication technology and the increasing transmission efficiency of data, users can experience more colorful internet services in a limited screen space. In order to enrich the life of users and improve the user experience, companies in various industries, both large and small, are networked and subsequently reach the front to package the services of their own homes into APPs (applications) which are sent to user equipment. In the car intelligent control field, in order to make the car into the intelligent terminal that is not inferior to the cell-phone, experience for the user provides convenient and practical's intelligent car, use the data of each function in the APP to the car owner in user's permission within range and gather, optimize the function experience of improving the APP according to these data, the data of gathering in these APPs can be uploaded to company high in the clouds when suitable, supply team analytical research to improve the direction in order to formulate the APP. However, most of the existing technical schemes need the mode that each application accesses the SDK, each application has a set of codes uploaded at a buried point, and each application needs to maintain a set of connection with the cloud, so that not only are a lot of redundancies in the codes exist, but also the storage space occupied by the vehicle machine system becomes large, and the connection between each application and the cloud repeatedly consumes the performance of the vehicle machine and the cloud. And the data uploading path may have a fault, and a large amount of data to be buried is discarded, so that the accuracy of the data to be buried is reduced, and continuous and reliable data support cannot be provided for data analysis personnel.
Disclosure of Invention
The present invention is directed to a method and an apparatus for uploading data of multiple applications, so as to solve at least one of the above problems.
The invention provides the following scheme:
according to one aspect of the invention, a multi-application buried point data uploading method is provided, and comprises the following steps:
acquiring buried point data to be uploaded generated by multiple applications;
uploading the data of the buried points to be uploaded through a real-time uploading channel;
judging whether the buried point data to be uploaded fails to be uploaded through a real-time uploading channel, if so, writing the buried point data to be uploaded which fails to be uploaded into a file of a file queue;
judging whether the files in the file queue meet preset supplementary transmission conditions, if so, judging whether the files in the file queue meet the preset supplementary transmission conditions
And uploading the files meeting the preset supplement transmission conditions through a supplement transmission channel.
Optionally, the uploading the to-be-uploaded buried point data through a real-time uploading channel includes:
adding the data of the buried point to be uploaded to a real-time message queue;
and uploading the data of the buried point to be uploaded in the real-time message queue through a real-time uploading channel.
Optionally, the uploading the data of the buried point to be uploaded in the real-time message queue through a real-time upload channel includes:
and uploading the buried point data to be uploaded in the real-time message queue through a real-time uploading channel according to a preset uploading period.
Optionally, the writing the to-be-uploaded buried point data with the uploading failure into a file of a file queue includes:
judging whether the file queue contains an idle file into which data of the buried point to be uploaded can be written, and if so, writing the data of the buried point to be uploaded into the idle file;
if the file queue has no idle file in which data of the buried point to be uploaded can be written, the file queue is used for storing the data of the buried point to be uploaded
Newly building a file, and writing data of buried points to be uploaded into the newly built file;
and if the number of the files in the file queue exceeds the preset number of the files after the new files are created, deleting the files with the earliest creation time in the file queue.
Optionally, the determining whether the file in the file queue meets a preset supplementary transmission condition includes:
judging whether the current writing period of the file queue meets a preset time threshold value, if so, judging whether the current writing period of the file queue meets the preset time threshold value
And stopping writing the data of the buried points to be uploaded in the current file, and putting the current file into a supplementary transmission queue. Optionally, the determining whether the files in the file queue meet a preset supplementary transmission condition includes:
judging whether the size of the file in which the buried point data file is written in the file queue meets a preset threshold value, if so, judging that the size of the file meets the preset threshold value
And stopping continuously writing the buried point data in the buried point data file being written, and putting the file in which the buried point data is being written into a supplementary transmission queue.
Optionally, the uploading the file meeting the preset supplementary transmission condition through a supplementary transmission channel includes:
acquiring files in a supplementary transmission queue;
and uploading the file through a supplementary transmission channel according to a preset supplementary transmission period.
Optionally, the uploading the file meeting the preset supplementary transmission condition through a supplementary transmission channel further includes:
if the file uploaded according to the preset transmission supplementing period fails to be uploaded, the file is uploaded according to the preset transmission supplementing period
And putting the file into the head of the supplementary transmission queue, and uploading the file in the supplementary transmission queue through a supplementary transmission channel according to a decline mechanism. Optionally, the multi-application buried point data uploading method further includes:
if the adding of the buried point data to be uploaded to the real-time message queue fails, the adding is carried out
Writing the data of the buried points to be uploaded into files of a file queue, judging whether the files in the file queue meet preset supplementary transmission conditions, and if so, writing the data of the buried points to be uploaded into the files of the file queue, and if so, judging whether the files in the file queue meet the preset supplementary transmission conditions
And uploading the files meeting the preset compensation transmission conditions through a compensation transmission channel.
The invention provides a multi-application buried point data uploading device, which comprises:
the embedded point data acquisition module to be uploaded is used for acquiring embedded point data to be uploaded generated by multiple applications;
the real-time uploading module is used for uploading the buried point data to be uploaded through a real-time uploading channel;
the uploading judgment module is used for judging whether the data of the buried point to be uploaded fails to be uploaded through a real-time uploading channel;
the file writing module is used for writing the data of the buried points to be uploaded which fails to be uploaded into a file of a file queue;
the file supplementing and transmitting judging module is used for judging whether the files in the file queue meet preset supplementing and transmitting conditions or not;
and the supplementary transmission module is used for uploading the files meeting the preset supplementary transmission conditions through the supplementary transmission channel.
Compared with the prior art, the invention has the following advantages:
according to the invention, the embedded data of each application is collected and then uploaded uniformly, so that the code amount and the packet volume of each application of the vehicle machine are reduced, the performance consumption of each application of the vehicle machine is further reduced, the real-time property of the uploading of the embedded data is ensured, and the loss probability is reduced; the file supplementary transmission mechanism provided by the invention can carry out file supplementary transmission under the condition of real-time uploading failure, solves the problem that the data of the embedded points is lost due to uploading failure, carries out unified file management and maintenance on the data of the embedded points supplementary transmission file, and avoids data loss or disorder caused by the generation of the data of the embedded points supplementary transmission file by each application.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic flow chart illustrating a multi-application buried point data uploading method according to an embodiment of the present invention;
fig. 2 is a schematic flowchart of a multi-application buried point data uploading method according to another embodiment of the present invention;
fig. 3 is a schematic structural diagram of a multi-application buried point data uploading apparatus according to an embodiment of the present invention;
fig. 4 is a structural diagram of an electronic device that can implement the multi-application buried point data uploading method of the present invention.
Detailed Description
The technical solutions of the present invention will be described clearly and completely with reference to the accompanying drawings, and it should be understood that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a schematic flow chart illustrating a multi-application buried point data uploading method according to an embodiment of the present invention;
as shown in fig. 1, a multi-application buried point data uploading method includes:
step 1: acquiring buried point data to be uploaded generated by multiple applications;
step 2: uploading data of buried points to be uploaded through a real-time uploading channel;
and step 3: judging whether the data of the buried points to be uploaded fails to be uploaded through the real-time uploading channel, if so, judging whether the data of the buried points to be uploaded fails to be uploaded through the real-time uploading channel
And 4, step 4: writing the data of the buried point to be uploaded which fails to be uploaded into the file of the file queue;
and 5: judging whether the files in the file queue meet a preset supplementary transmission condition, if so, judging whether the files in the file queue meet the preset supplementary transmission condition
Step 6: and uploading the files meeting the preset supplement transmission conditions through a supplement transmission channel.
According to the invention, the embedded data of each application is collected and then uploaded uniformly, so that the code amount and the packet volume of each application of the vehicle machine are reduced, the performance consumption of each application of the vehicle machine is further reduced, the real-time property of the uploading of the embedded data is ensured, and the loss probability is reduced; the file supplementary transmission mechanism can carry out file supplementary transmission under the condition of real-time uploading failure, solves the problem that the data of the embedded points is lost due to uploading failure, carries out unified file management and maintenance on the data of the embedded points, and avoids data loss or disorder caused by the generation of the data of the embedded points supplementary transmission files by each application.
In the embodiment, the real-time uploading channel is specifically an mqtt message pushing channel, the uploading of the data of the buried points to be uploaded in the real-time message queue is realized in time through the mqtt message pushing, and the data of the buried points are pushed to the cloud end through an mqtt protocol;
in this embodiment, the supplementary transmission channel specifically provides a data dropping mechanism when the mqtt message push channel fails to upload the data of the buried point to be uploaded in the real-time message queue, or when the mqtt real-time message queue is full and the real-time message queue is added with the data of the buried point to be uploaded fails, writes the data of the buried point to be uploaded into a file in the file queue, and uploads the file with the data of the buried point to the cloud through an http request.
In this embodiment, gzip compression is performed on all the uploaded data contents, so that traffic consumption in the network transmission process is reduced.
In this embodiment, uploading the data of the buried point to be uploaded through the real-time upload channel includes:
adding data of buried points to be uploaded to a real-time message queue;
and uploading the data of the buried points to be uploaded in the real-time message queue through a real-time uploading channel.
In this embodiment, the real-time message queue provides a thread-safe cache for real-time embedded data received from each application, and provides a thread-safe data source for the mqtt message push channel.
In this embodiment, uploading the data of the buried point to be uploaded in the real-time message queue through the real-time upload channel includes:
and uploading the data of the buried points to be uploaded in the real-time message queue through a real-time uploading channel according to a preset uploading period.
In this embodiment, the length of the real-time message queue is 1000, and the preset upload period is 10 times per second.
In this embodiment, writing the data of the buried point to be uploaded that fails to be uploaded into the file in the file queue includes:
judging whether the file queue contains an idle file in which data of the buried point to be uploaded can be written, if so, writing the data of the buried point to be uploaded in the idle file;
if the file queue has no free file in which the data of the buried point to be uploaded can be written, the file queue stores the free file
Newly building a file, and writing data of the buried points to be uploaded into the newly built file;
and if the number of the files in the file queue after the new file exceeds the preset number of the files, deleting the file with the earliest creation time in the file queue.
Specifically, the maximum writing space of the file in the file queue is 100K, when the file is written, if the tail file of the file queue has a free space which can be written with the data of the buried point to be uploaded, additional writing is carried out in the tail file, and if no free file exists, a new empty file is created and written with the data of the buried point to be uploaded; it can be understood that when the number of files exceeds the preset number of files, the new file will fail, and in order to ensure the validity of the files, after more than 50 files are stored, the file with the earliest creation time is deleted, and then the new file is created, and the data of the buried point to be uploaded is written in the new file.
In this embodiment, the determining whether the files in the file queue satisfy the predetermined retransmission condition includes:
judging whether the current writing period of the file queue meets a preset time threshold value, if so, judging whether the current writing period of the file queue meets the preset time threshold value
And stopping writing the data of the buried points to be uploaded in the current file, and putting the current file into a supplementary transmission queue. Specifically, in order to prevent the problem that the data of the embedded points falling into the file cannot be uploaded in time due to the fact that the data of the embedded points to be uploaded is not written into the file queue for a long time in the process of suddenly recovering the real-time uploading channel, every five minutes is set as a writing period of the file queue, when the file is written for 5 minutes, the current written file is closed, the file is placed into the transmission supplementing queue, and then a new file is built to continuously write the data of the embedded points to be uploaded.
In this embodiment, the determining whether the file in the file queue satisfies the predetermined supplementary transmission condition includes:
judging whether the size of a file in which a buried point data file is written in a file queue meets a preset threshold value, if so, judging whether the size of the file meets the preset threshold value
And stopping continuously writing the buried point data in the buried point data file, and putting the file in which the buried point data is being written into the supplementary transmission queue.
Specifically, for example, the maximum write space of a file is 100K, and when the file is full of 100K of data to be uploaded and the file meets the preset complementary transmission condition, the file is placed in the complementary transmission queue.
In this embodiment, uploading the file satisfying the preset supplementary transmission condition through the supplementary transmission channel includes:
acquiring files in a supplementary transmission queue;
and uploading the files in the supplementary transmission queue through the supplementary transmission channel according to a preset supplementary transmission period.
In this embodiment, uploading the file meeting the preset supplementary transmission condition through the supplementary transmission channel further includes:
if the file uploaded according to the preset supplement transmission period fails to be uploaded, the file is uploaded according to the preset supplement transmission period
And placing the file into the head position of the supplementary transmission queue, and uploading the file in the supplementary transmission queue through a supplementary transmission channel according to a decline mechanism.
In the embodiment, when the file is uploaded through the supplementary transmission channel, the problem of uploading failure may occur, and at this time, the file which is uploaded failure is placed at the head of the supplementary transmission queue, so that the file which is uploaded failure can be preferentially uploaded in the next uploading process; the decay mechanism is specifically that a preset supplementary transmission period is modified into a second supplementary transmission period, the time interval of the second supplementary transmission period is 2s, the files in the supplementary transmission queue are continuously uploaded according to the second supplementary transmission period, if the files in the supplementary transmission queue still fail to be uploaded under the condition of the second supplementary transmission period, the time interval of the second supplementary transmission period is 2s and is used as a next uploading supplementary transmission period, the supplementary transmission period is adjusted according to the uploading time interval of the last supplementary transmission period, if the uploading interval of the second supplementary transmission period is 2s, the third supplementary transmission period is 4s, and if the third supplementary transmission period still fails to be uploaded, the time interval of the last supplementary transmission period is 2s and reaches 64s at most when the supplementary transmission period is adjusted next time.
In this embodiment, the method for uploading the multi-application buried point data further includes:
if the adding of the buried point data to be uploaded to the real-time message queue fails, the data is added to the real-time message queue
Writing data of the buried points to be uploaded into files in a file queue, judging whether the files in the file queue meet preset supplementary transmission conditions, and if so, writing the data of the buried points to be uploaded into the files in the file queue, otherwise, judging whether the files in the file queue meet the preset supplementary transmission conditions
And uploading the files meeting the preset compensation transmission conditions through a compensation transmission channel.
Fig. 2 is a schematic flowchart of a multi-application buried point data uploading method according to another embodiment of the present invention;
as shown in fig. 2, the multi-application buried point data uploading method includes:
in the embodiment, data of a plurality of APP data are added to a real-time message queue;
uploading the embedded point data of the plurality of APPs in the real-time message queue to a cloud embedded point system through a real-time uploading channel;
if the addition of the real-time message queue to the embedded point data of the multiple APPs fails or the uploading of the embedded point data of the multiple APPs fails, writing the embedded point data to be uploaded into a file of a file queue;
before writing the data of the buried point to be uploaded into the file of the file queue, judging whether a free file is contained in the file queue at present and can be written into the file queue, if the free file exists, continuously writing the data of the buried point to be uploaded into the free file, if the free file does not exist, newly building a free file, and writing the data of the buried point to be uploaded into the free file;
in this embodiment, it is determined whether the file size of the file queue is 100K, or the current write cycle of the file queue is over 5 minutes, and if yes, the writing is stopped and the current write file is placed in the supplementary transmission queue;
in the embodiment, the files of the retransmission queue are obtained, and the files of the retransmission queue are retransmitted to the cloud buried point system through the retransmission channel;
and if the file in the retransmission supplementing queue fails to be retransmitted, the file is placed back to the head of the retransmission supplementing queue, so that the file is preferentially uploaded when the retransmission supplementing queue is retransmitted next time.
Fig. 3 is a schematic structural diagram of a multi-application buried point data uploading apparatus according to an embodiment of the present invention;
as shown in fig. 3, the multi-application buried point data uploading device includes a buried point data to be uploaded obtaining module, a real-time uploading module, an uploading judgment module, a file writing module, a supplementary transmission judgment module, and a supplementary transmission module; wherein the content of the first and second substances,
the embedded point data to be uploaded acquiring module is used for acquiring embedded point data to be uploaded generated by multiple applications;
the real-time uploading module is used for uploading the data of the buried points to be uploaded through the real-time uploading channel;
the uploading judgment module is used for judging whether the data of the buried point to be uploaded fails to be uploaded through the real-time uploading channel;
the file writing module is used for writing the data of the buried point to be uploaded which fails to be uploaded into the file of the file queue;
the file supplementing and transmitting judging module is used for judging whether the files in the file queue meet a preset supplementing and transmitting condition or not;
and the supplementary transmission module is used for uploading the files meeting the preset supplementary transmission conditions through the supplementary transmission channel.
It should be noted that, although the system only discloses the basic function modules such as the buried point data acquisition module to be uploaded, the real-time uploading module, the uploading judgment module, the file writing module, the supplementary transmission judgment module, and the supplementary transmission module, the device is not limited to the basic function modules, and the invention is to be expressed in the meaning that, on the basis of the basic function modules, one or more function modules may be arbitrarily added by combining with the prior art to form an infinite number of embodiments or technical solutions, that is, the system is open rather than closed, and the protection scope of the claims of the invention is considered to be limited to the basic function modules disclosed above because the embodiment only discloses individual basic function modules.
Fig. 4 is a structural diagram of an electronic device that can implement the multi-application buried point data uploading method of the present invention.
As shown in fig. 4, the electronic apparatus includes: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory complete mutual communication through the communication bus; the memory has stored therein a computer program that, when executed by the processor, causes the processor to perform the steps of the multi-application buried point data uploading method.
The present application also provides a computer-readable storage medium storing a computer program executable by an electronic device, which, when the computer program runs on the electronic device, causes the electronic device to execute the steps of the multi-application buried data uploading method.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The electronic device includes a hardware layer, an operating system layer running on top of the hardware layer, and an application layer running on top of the operating system. The hardware layer includes hardware such as a Central Processing Unit (CPU), a Memory Management Unit (MMU), and a Memory. The operating system may be any one or more computer operating systems that implement control of the electronic device through a Process (Process), such as a Linux operating system, a Unix operating system, an Android operating system, an iOS operating system, or a Windows operating system. In the embodiment of the present invention, the electronic device may be a handheld device such as a smart phone and a tablet computer, or an electronic device such as a desktop computer and a portable computer, which is not particularly limited in the embodiment of the present invention.
The execution main body of the electronic device control in the embodiment of the present invention may be the electronic device, or a functional module capable of calling a program and executing the program in the electronic device. The electronic device may obtain the firmware corresponding to the storage medium, the firmware corresponding to the storage medium is provided by a vendor, and the firmware corresponding to different storage media may be the same or different, which is not limited herein. After the electronic device acquires the firmware corresponding to the storage medium, the firmware corresponding to the storage medium may be written into the storage medium, specifically, the firmware corresponding to the storage medium is burned into the storage medium. The process of burning the firmware into the storage medium can be realized by adopting the prior art, and details are not described in the embodiment of the present invention.
The electronic device may further acquire a reset command corresponding to the storage medium, where the reset command corresponding to the storage medium is provided by a vendor, and the reset commands corresponding to different storage media may be the same or different, and are not limited herein.
At this time, the storage medium of the electronic device is a storage medium in which the corresponding firmware is written, and the electronic device may respond to the reset command corresponding to the storage medium in which the corresponding firmware is written, so that the electronic device resets the storage medium in which the corresponding firmware is written according to the reset command corresponding to the storage medium. The process of resetting the storage medium according to the reset command may be implemented in the prior art, and is not described in detail in the embodiment of the present invention.
For convenience of description, the above devices are described as being functionally divided into various units and modules. Of course, the functions of the units and modules may be implemented in one or more software and/or hardware when implementing the present application.
It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
For simplicity of explanation, the method embodiments are described as a series of acts or combinations, but those skilled in the art will appreciate that the embodiments are not limited by the order of acts described, as some steps may occur in other orders or concurrently with other steps in accordance with the embodiments of the invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
From the above description of the embodiments, it is clear to those skilled in the art that the present application can be implemented by software plus necessary general hardware platform. Based on such understanding, the technical solutions of the present application may be essentially or partially implemented in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.
Claims (10)
1. A multi-application buried point data uploading method is characterized by comprising the following steps:
acquiring buried point data to be uploaded generated by multiple applications;
uploading the data of the buried points to be uploaded through a real-time uploading channel;
judging whether the data of the buried points to be uploaded fails to be uploaded through a real-time uploading channel, if so, judging whether the data of the buried points to be uploaded fails to be uploaded through the real-time uploading channel
Writing the data of the buried point to be uploaded which fails to be uploaded into a file of a file queue;
judging whether the files in the file queue meet preset supplementary transmission conditions, if so, judging whether the files in the file queue meet the preset supplementary transmission conditions
And uploading the files meeting the preset compensation transmission conditions through a compensation transmission channel.
2. The multi-application buried point data uploading method of claim 1, wherein uploading the buried point data to be uploaded through a real-time uploading channel comprises:
adding the data of the buried points to be uploaded to a real-time message queue;
and uploading the data of the buried points to be uploaded in the real-time message queue through a real-time uploading channel.
3. The method for uploading data of multiple applications buried points according to claim 2, wherein uploading the data of the buried points to be uploaded in a real-time message queue through a real-time uploading channel comprises:
and uploading the data of the buried points to be uploaded in the real-time message queue through a real-time uploading channel according to a preset uploading period.
4. The multi-application buried point data uploading method of claim 3, wherein the writing of the buried point data to be uploaded which fails to be uploaded into a file of a file queue comprises:
judging whether the file queue contains an idle file in which data of the buried point to be uploaded can be written, and if so, writing the data of the buried point to be uploaded in the idle file;
if the file queue has no free file in which the data of the buried point to be uploaded can be written, the file queue stores the free file
Newly building a file, and writing data of buried points to be uploaded into the newly built file;
and if the number of the files in the file queue exceeds the preset number of the files after the files are newly built, deleting the files with the earliest creation time in the file queue.
5. The multi-application buried point data uploading method of claim 4, wherein the determining whether the files in the file queue meet a preset complementary uploading condition comprises:
judging whether the current writing period of the file queue meets a preset time threshold value, if so, judging whether the current writing period of the file queue meets the preset time threshold value
And stopping writing the data of the buried points to be uploaded in the current file, and putting the current file into a transmission supplementing queue.
6. The multi-application buried point data uploading method of claim 5, wherein the determining whether the files in the file queue meet a preset complementary uploading condition comprises:
judging whether the size of the file in which the buried point data file is written in the file queue meets a preset threshold value, if so, judging that the size of the file meets the preset threshold value
And stopping continuously writing the buried point data in the buried point data file being written, and putting the file in which the buried point data is being written into a supplementary transmission queue.
7. The multi-application buried point data uploading method as claimed in claim 6, wherein uploading the file satisfying the preset complementary transmission condition through the complementary transmission channel comprises:
acquiring files in a supplementary transmission queue;
and uploading the file through a supplementary transmission channel according to a preset supplementary transmission period.
8. The multi-application buried point data uploading method of claim 7, wherein uploading the file meeting the preset complementary transmission condition through the complementary transmission channel further comprises:
if the file uploaded according to the preset supplementary transmission period fails to be uploaded, the file is uploaded according to the preset supplementary transmission period
And putting the file into the head of the supplementary transmission queue, and uploading the file in the supplementary transmission queue through a supplementary transmission channel according to a decline mechanism.
9. The multi-application buried point data uploading method of claim 8, further comprising:
if the adding of the buried point data to be uploaded to the real-time message queue fails, the adding is carried out
Writing the data of the buried points to be uploaded into files of a file queue, judging whether the files in the file queue meet preset supplementary transmission conditions, and if so, writing the data of the buried points to be uploaded into the files of the file queue, and if so, judging whether the files in the file queue meet the preset supplementary transmission conditions
And uploading the files meeting the preset supplement transmission conditions through a supplement transmission channel.
10. A multi-application buried point data uploading device is characterized by comprising:
the embedded point data acquisition module to be uploaded is used for acquiring embedded point data to be uploaded generated by multiple applications;
the real-time uploading module is used for uploading the buried point data to be uploaded through a real-time uploading channel;
the uploading judgment module is used for judging whether the data of the buried point to be uploaded fails to be uploaded through a real-time uploading channel;
the file writing module is used for writing the data of the buried point to be uploaded which fails to be uploaded into a file of a file queue;
the file supplementing and transmitting judging module is used for judging whether the files in the file queue meet preset supplementing and transmitting conditions or not;
and the supplementary transmission module is used for uploading the files meeting the preset supplementary transmission conditions through the supplementary transmission channel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211466726.5A CN115941669A (en) | 2022-11-22 | 2022-11-22 | Multi-application buried point data uploading method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211466726.5A CN115941669A (en) | 2022-11-22 | 2022-11-22 | Multi-application buried point data uploading method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115941669A true CN115941669A (en) | 2023-04-07 |
Family
ID=86698507
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211466726.5A Pending CN115941669A (en) | 2022-11-22 | 2022-11-22 | Multi-application buried point data uploading method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115941669A (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104348650A (en) * | 2013-08-05 | 2015-02-11 | 腾讯科技（深圳）有限公司 | Website monitoring method, business device and website monitoring system |
| US20150127773A1 (en) * | 2013-05-20 | 2015-05-07 | Tencent Technology (Shenzhen) Company Limited | Electronic device, storage medium and file transferring method |
| CN111130956A (en) * | 2018-10-30 | 2020-05-08 | 九阳股份有限公司 | Data transmission method of intelligent household appliance and intelligent household appliance |
| CN112433920A (en) * | 2019-08-26 | 2021-03-02 | 北京京东尚科信息技术有限公司 | Buried point data reporting method, device, equipment and medium |
| WO2021047676A1 (en) * | 2019-09-12 | 2021-03-18 | 奥动新能源汽车科技有限公司 | Identification method and system for number of users in queue for battery swapping in battery swapping station |
| CN113472858A (en) * | 2021-06-10 | 2021-10-01 | 北京达佳互联信息技术有限公司 | Buried point data processing method and device and electronic equipment |
| CN114661607A (en) * | 2022-03-31 | 2022-06-24 | 芜湖雄狮汽车科技有限公司 | Point burying method and device applied to vehicle-mounted machine system, vehicle and storage medium |
| CN115134352A (en) * | 2022-06-27 | 2022-09-30 | 重庆长安汽车股份有限公司 | Method, device, equipment and medium for uploading data of buried points |
-
2022
- 2022-11-22 CN CN202211466726.5A patent/CN115941669A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150127773A1 (en) * | 2013-05-20 | 2015-05-07 | Tencent Technology (Shenzhen) Company Limited | Electronic device, storage medium and file transferring method |
| CN104348650A (en) * | 2013-08-05 | 2015-02-11 | 腾讯科技（深圳）有限公司 | Website monitoring method, business device and website monitoring system |
| CN111130956A (en) * | 2018-10-30 | 2020-05-08 | 九阳股份有限公司 | Data transmission method of intelligent household appliance and intelligent household appliance |
| CN112433920A (en) * | 2019-08-26 | 2021-03-02 | 北京京东尚科信息技术有限公司 | Buried point data reporting method, device, equipment and medium |
| WO2021047676A1 (en) * | 2019-09-12 | 2021-03-18 | 奥动新能源汽车科技有限公司 | Identification method and system for number of users in queue for battery swapping in battery swapping station |
| CN113472858A (en) * | 2021-06-10 | 2021-10-01 | 北京达佳互联信息技术有限公司 | Buried point data processing method and device and electronic equipment |
| CN114661607A (en) * | 2022-03-31 | 2022-06-24 | 芜湖雄狮汽车科技有限公司 | Point burying method and device applied to vehicle-mounted machine system, vehicle and storage medium |
| CN115134352A (en) * | 2022-06-27 | 2022-09-30 | 重庆长安汽车股份有限公司 | Method, device, equipment and medium for uploading data of buried points |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109947668B (en) | Method and device for storing data | |
| CN111414334A (en) | File fragment uploading method, device, equipment and storage medium based on cloud technology | |
| CN109815214B (en) | Database access method, system, device and storage medium | |
| US10509739B1 (en) | Optimized read IO for mix read/write scenario by chunking write IOs | |
| CN105376270B (en) | Method, device and system for improving uploading efficiency | |
| CN109756568B (en) | File processing method and device and computer readable storage medium | |
| CN103067480A (en) | Synchronized method and system of network disk | |
| CN103064637A (en) | Network disk cache synchronizing method and system | |
| US10719245B1 (en) | Transactional IO scheduler for storage systems with multiple storage devices | |
| CN103067479A (en) | Network disk synchronized method and system based on file coldness and hotness | |
| WO2014173151A1 (en) | Method, device and terminal for data processing | |
| CN106991177B (en) | Lossless acquisition method and system for real-time logs in distributed environment | |
| CN103744618A (en) | Method and system for achieving team shared storage | |
| CN104580469A (en) | Vehicle networking system based on file queue storage and transmission | |
| CN104935666B (en) | A kind of method and system for mobile terminal viewing pdf document | |
| EP3506599B1 (en) | Method for synchronizing contact information, apparatus and medium | |
| CN112748877A (en) | File integration uploading method and device and file downloading method and device | |
| CN115455058A (en) | Cache data processing method and device, computer equipment and storage medium | |
| CN103188327A (en) | Method and system of file transfer | |
| CN110347546B (en) | Dynamic adjustment method, device, medium and electronic equipment for monitoring task | |
| CN115941669A (en) | Multi-application buried point data uploading method and device | |
| CN111475468A (en) | Log access method, device, equipment and storage medium of newly added system | |
| CN102902593A (en) | Protocol distribution processing system based on cache mechanism | |
| US10599340B1 (en) | Policy driven IO scheduler to improve read IO performance in hybrid storage systems | |
| CN110069493B (en) | Data processing method, device, computer equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |