CN110231983A - Data Concurrent processing method, apparatus and system, computer equipment and readable medium - Google Patents

Data Concurrent processing method, apparatus and system, computer equipment and readable medium Download PDF

Info

Publication number
CN110231983A
CN110231983A CN201910394225.2A CN201910394225A CN110231983A CN 110231983 A CN110231983 A CN 110231983A CN 201910394225 A CN201910394225 A CN 201910394225A CN 110231983 A CN110231983 A CN 110231983A
Authority
CN
China
Prior art keywords
data
information
event
object event
parameter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910394225.2A
Other languages
Chinese (zh)
Other versions
CN110231983B (en
Inventor
杨松
刘涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN201910394225.2A priority Critical patent/CN110231983B/en
Publication of CN110231983A publication Critical patent/CN110231983A/en
Application granted granted Critical
Publication of CN110231983B publication Critical patent/CN110231983B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/48Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806Task transfer initiation or dispatching
    • G06F9/4843Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer And Data Communications (AREA)

Abstract

The present invention provides a kind of Data Concurrent processing method, apparatus and system, computer equipment and readable medium.Its method includes: the parameter of the corresponding atomic type of setting object event to be transmitted, is initialized as 0;Establish data queue, the relevant information for N number of data that stored target event includes, the address information of atomic type parameter is carried in the relevant information of each data, by multiple data sending devices according to the relevant information of data N number of in data queue, corresponding N number of data are sent to remote server parallel, and each data sending device has been sent after a data according to the address information of atomic type parameter to atomic type parameter cumulative 1;Whether the numerical value of monitoring atomic type parameter is equal to N;If being equal to, determine that all data in object event are sent completely.Technical solution of the present invention can effectively improve the concurrent processing efficiency of data, shorten the duration of data transmission, meet the demand of the relatively high scene of requirement of real-time.

Description

Data Concurrent processing method, apparatus and system, computer equipment and readable medium
[technical field]
The present invention relates to computer application technology more particularly to a kind of Data Concurrent processing method, apparatus and system, Computer equipment and readable medium.
[background technique]
Data Concurrent processing refers to transmission technology through concurrent mode, more parts of data is handled, then in handle The data handled are sent to the technology of other services.
In existing Internet technology, some data need to be handled by some steps, are then then forwarded to it He services.This kind of data are that receiving end only receives whole processed data there are one feature, can just form one A significant data cell is used for oneself.Such as a json data packet comprising picture list of file names, only this data Packet is sent to other side without what use, because of the only picture list of file names that other side obtains.In this case, only The corresponding picture of picture name is first transmitted to other side after simple processing, this json file is then transmitted to other side again, right Really group it can weave significant data just now.In the prior art, most traditional way is: picture list of file names in json Corresponding picture successively transmits together with json to other side after processing.This mode in a process or In thread, all tasks of sequential processes.And existing this technical solution logic is simple, implements and is easier.
But when above-mentioned technical proposal realization, needs all to put whole tasks in one process or thread and sequentially locate Reason, the transmission time of data can be longer, is unable to satisfy the demand of the relatively high scene of requirement of real-time.
[summary of the invention]
The present invention provides a kind of Data Concurrent processing method, apparatus and system, computer equipment and readable mediums, are used for The duration for shortening data transmission, meets the demand of the relatively high scene of requirement of real-time.
The present invention provides a kind of Data Concurrent processing method, which comprises
The parameter of the corresponding atomic type of object event to be transmitted is set, and is initialized as 0;
Data queue is established, the data queue is used to store the related letter for the N number of data for including in the object event It ceases, the address information of the parameter of the atomic type is carried in the relevant information of each data, to be sent by multiple data The relevant information of device N number of data according to the data queue is sent to remote server corresponding described N number of parallel Data, and after each data sending device has sent the data, according to the address of the parameter of the atomic type Parameter cumulative 1 of the information to the atomic type;
Whether the numerical value for monitoring the parameter of the atomic type is equal to N;
If being equal to, determine that all data in the object event are sent completely.
The present invention also provides a kind of Data Concurrent processing methods, which comprises
The relevant information of data is obtained from the data queue of object event to be transmitted;The data queue is the number It is what the object event was established according to managing device, for storing the correlation for the N number of data for including in the object event Information carries the address information of the parameter of atomic type in the relevant information of each data;The parameter of the atomic type It is what the object event was arranged for the data administrator, and is initialized as 0;
According to the relevant information of the data, corresponding data are obtained;
The data obtained are sent to remote server;
According to the address information of the parameter of the atomic type, to the parameter cumulative 1 of atomic type.
The present invention provides a kind of data administrator, and described device includes:
Setup module for the parameter of the corresponding atomic type of object event to be transmitted to be arranged, and is initialized as 0;
Module is established, for establishing data queue, the data queue is used to store include in the object event N number of The relevant information of data carries the address information of the parameter of the atomic type in the relevant information of the data, by more The relevant information of a data sending device N number of data according to the data queue, parallel to remote server transmission pair The N number of data answered, and after each data sending device has sent the data, according to the atomic type Parameter cumulative 1 of the address information of parameter to the atomic type;
Monitoring module, for monitoring whether the numerical value of parameter of the atomic type is equal to N;
Determining module determines in the object event if the numerical value of the parameter for monitoring the atomic type is equal to N All data be sent completely.
The present invention also provides a kind of data sending device, described device includes:
Module is obtained, for obtaining the relevant information of data from the data queue of object event to be transmitted;The number It is the data administrator according to queue is what the object event was established, for storing include N number of in the object event The relevant information of the data carries the address information of the parameter of atomic type in the relevant information of each data;It is described The parameter of atomic type is that the data administrator is what the object event was arranged, and is initialized as 0;
The acquisition module, is also used to the relevant information according to the data, obtains corresponding data;
Sending module, for sending the data obtained to remote server;
Modified module adds up 1 to the parameter of atomic type for the address information according to the parameter of the atomic type.
The present invention also provides a kind of Data Concurrent processing system, including data administrator and multiple data sending devices, The multiple data sending device uses the operating mode of multi-thread concurrent;Each data sending device and the data management Device communication connection;The data administrator uses data administrator as described above;Each data sending device is adopted With data sending device as described above.
The present invention also provides a kind of computer equipment, the equipment includes:
One or more processors;
Memory, for storing one or more programs;
When one or more of programs are executed by one or more of processors, so that one or more of processing Device realizes Data Concurrent processing method as described above.
The present invention also provides a kind of computer-readable mediums, are stored thereon with computer program, which is held by processor Data Concurrent processing method as described above is realized when row.
Data Concurrent processing method, apparatus and system, computer equipment and readable medium of the invention, by using multiple Data sending device transmitting data in parallel can effectively improve the efficiency of Data Concurrent processing, shorten the duration of data transmission, Meet the demand of the relatively high scene of requirement of real-time;And the present embodiment is by being arranged the corresponding atom of object event to be transmitted The mutual exclusion of the multithreading of transmitted in parallel may be implemented in the parameter of type, can effectively ensure that the standard of multiple Data Concurrent transmission True property and efficiency of transmission.
[Detailed description of the invention]
Fig. 1 is the flow chart of Data Concurrent processing method embodiment one of the invention.
Fig. 2 is the flow chart of Data Concurrent processing method embodiment two of the invention.
Fig. 3 is a kind of exemplary diagram of Data Concurrent processing method of the invention.
Fig. 4 is the structure chart of data administrator embodiment of the invention.
Fig. 5 is the structure chart of data sending device embodiment of the invention.
Fig. 6 is the structure chart of Data Concurrent processing system embodiment of the invention.
Fig. 7 is the structure chart of computer equipment embodiment of the invention.
Fig. 8 is a kind of exemplary diagram of computer equipment provided by the invention.
[specific embodiment]
To make the objectives, technical solutions, and advantages of the present invention clearer, right in the following with reference to the drawings and specific embodiments The present invention is described in detail.
Fig. 1 is the flow chart of Data Concurrent processing method embodiment one of the invention.As shown in Figure 1, the number of the present embodiment According to concurrent processing method, it can specifically include following steps:
The parameter of S100, the corresponding atomic type of setting object event to be transmitted, and it is initialized as 0;
The Data Concurrent processing method of the present embodiment, can apply has a large amount of data to be transmitted in an event Under scene.Such as there can be a large amount of monitor event to need to be transferred to remote service in the scene in the case where being newly sold this scene In device.And in each monitor event other than the parameter comprising various algorithms, confidence level, there are also a large amount of picture file names. It is final to need to guarantee in remote server, these filenames can be used, view the content of corresponding picture.So this feelings Under condition other than needing to send these monitor events itself, it is also necessary on its corresponding picture transfer to remote server. The object event to be transmitted of the present embodiment can be the monitor event under above-mentioned scene.It can also be other in practical application The event information comprising mass data under similar scene, and each data in the mass data for including in event information are again It is independent.Such as can specifically include N number of data in the object event to be transmitted of the present embodiment, each data can be for one solely Vertical individual.
Data in the present embodiment can be the data of the forms such as picture, voice or text.
It should be noted that can also include except data in the object event of the present embodiment other than including N number of data Other information such as comprising parameter, confidence level and the identification information such as title of each data of various algorithms etc..And In the scene of the present embodiment, data sending terminal can first send N number of data in object event, determine that N number of data have sent it Afterwards, the other information in object event except data is retransmited, so that also having N number of number after remote server receives other information According to supporting, the object event received in this way be exactly it is complete, it is subsequent corresponding subsequent operation to be carried out to object event.
The executing subject of the Data Concurrent processing method of the present embodiment can be for positioned at the data management of data sending terminal dress Set, the data administrator can for an independent entity or may be main thread, for sent data into Row management, sends N number of data in object event convenient for multiple data sending devices for being worked with multithreading.
In the Data Concurrent processing method of the present embodiment, it is necessary first to which the ginseng of the corresponding atomic type of object event is set Number, and it is initialized as 0.The parameter of the atomic type of the present embodiment is specifically as follows the field of an atomic type.For difference Programming language, the representation of the field of atomic type can not be identical.Such as the field for the atomic type in C++, It can be expressed as std::atomic type, in other language, can be indicated using corresponding mode.Being somebody's turn to do in the present embodiment The parameter of atomic type is for recording the quantity for having sent successful data.Therefore, in initial setting up, transmission number is not had started According to, need by the parameter initialization of the corresponding atomic type of object event be 0.
S101, data queue is established, the related letter of N number of data of the data queue for including in stored target event Breath carries the address information of the parameter of atomic type in the relevant information of each data, with by multiple data sending devices according to The relevant information of N number of data in data queue sends corresponding N number of data to remote server parallel, and each data are sent After device has sent a data, according to the address information of the parameter of atomic type to the parameter cumulative 1 of atomic type;
It is that each object event establishes corresponding data queue by data administrator in the present embodiment.The data queue In store in sequence be N number of data in object event relevant information.N number of data in the present embodiment, in data queue Relevant information can be data itself, but data itself it is shared space it is larger, in practical application, can not be data sheet Body, but the relevant parameter of data.But data sending device is available to corresponding according to the relevant information of each data Data.For example, the relevant information of the data can be the address information of data, or there to be data address address letter Breath, or can also be that can point at the pointer of data address, or can point at an address for having data address Pointer can also be the other information that can find data, and no longer citing repeats one by one herein.
Multiple data sending devices of the present embodiment can be equivalent to multiple threads with concurrent working.Each data send dress When setting work, the relevant information of a data is obtained from data queue, then according to the relevant information of the data, is obtained corresponding Data, and send, and after having sent, each data sending device can also be according to the original carried in the relevant information of data The address information of the parameter of subtype, the parameter of the corresponding atomic type of access target event, accumulates it 1.
The parameter of the atomic type of the present embodiment has a characteristic, and the mutual exclusion of the multithreading of transmitted in parallel may be implemented, make Obtaining different data sending devices can not simultaneously modify to the parameter of atomic type.The data sending device of the present embodiment is sent out When sending N number of data, it is equivalent to the mode of multi-threaded parallel work.If after a data sending device has sent a data, just Parameter to atomic type it is cumulative 1 when, and if another data sending device has also sent a data at this time, at this time separately It, could be to atom after one data sending device needs that previous data sending device is waited to modify the parameter of atomic type The parameter of type cumulative 1, and two data sending devices cannot can guarantee so simultaneously to the parameter of atomic type cumulative 1 Accurate monitoring to data have been sent guarantees the accuracy that data are sent.
For example, a kind of specific implementation of step S100 can be with are as follows: data administrator is receiving a target thing After part, event memory headroom can be distributed for the object event, and the information of object event is stored in event memory headroom, and The parameter of atomic type is set in event memory headroom, and is initialized as 0;It wherein include N number of number in the information of object event Other information accordingly and except data.The address information of the parameter of atomic type is also the address letter of event memory headroom at this time Breath.
Accordingly, a kind of specific implementation of step S101 may include steps of:
It (a) is that each data in N number of data of object event distribute datarams sky according to the information of object event Between, the identification information of corresponding data and the address information of event memory headroom are stored in datarams space;
Wherein the identification information of data can be the title of data or id etc..
(b) address information in the datarams space of N number of data is stored in a queue, as data queue, by more A data sending device successively obtains corresponding data according to the address information in datarams each in data queue space, parallel It is sent to remote server, and after each data sending device has sent one data, according to the address of event memory headroom letter Breath, to the parameter cumulative 1 of the atomic type of storage.
In the implementation, step S100 is equivalent to reception task, can be the mesh after receiving an object event Mark event distributes event memory headroom, and object event information is stored in event memory headroom, wherein the packet stored Include the other information except the N number of data and data for including in object event information.
And step S101 is equivalent to distributed tasks, because in object event including N number of data, step S101 is equal to target Case distribution at N number of data transmission task.Data administrator is each data distribution datarams space herein, but Not storing data itself in datarams space, but in the identification information of the corresponding data of storing data such as title and event The address information in space is deposited, and the address information in the datarams space of N number of data is stored in together in a queue, as data Queue.I.e. in this implementation, the relevant information of the data in data queue is the address information in the datarams space of data. In this way, each data sending device successively from data queue obtain a data memory headroom address information after, first basis The address information in the datarams space obtains the identification information of corresponding data, so from the corresponding datarams space Afterwards further according to the address information of event memory headroom, the identification information that the data are obtained from corresponding event memory headroom is corresponding Data, to remote server send.After having sent, according to the address information of event memory headroom, the original wherein stored is obtained The parameter of subtype, and add up 1 to it.
Whether the numerical value of the parameter of S102, monitoring atomic type is equal to N;If being equal to, step S103 is executed;Otherwise step is returned Rapid S102 continues to monitor;
S103, determine that all data in object event are sent completely.
Data administrator needs constantly to monitor atomic type after multiple data sending devices start to send data Whether the numerical value of parameter is equal to N;If being equal to N, so that it may determine that all data in object event are sent completely, otherwise continue to supervise Control.
It accordingly, can also include: except the data that remote server sends in object event after step S103 Other information such as comprising parameter, confidence level and the identification information such as title of each data of various algorithms etc., convenient for remote End server receives all information of object event.Target is directly sent to cloud server from data administrator at this time Other information in event except data.
Optionally, the data administrator of the present embodiment is using thread come when realizing, wherein step S100 can also be used The receiving thread of reception task is realized, and step S101-103 is realized using the main thread for managing data.It connects at this time Take-up journey is used for receive the main task of object event to be transmitted, and mesh to be transmitted is arranged for each object event to be transmitted The parameter of the corresponding atomic type of mark event, and it is initialized as 0.And task it is more i.e. object event to be transmitted quantity compared with When more, receiving thread can also accordingly establish a task queue, by each task put in the queue, with by main thread from The corresponding object event to be transmitted of each task is successively obtained in task queue, then according to above-described embodiment the step of S101-S103 carries out Data Concurrent processing to each object event.
The Data Concurrent processing method of the present embodiment can be effective using multiple data sending device transmitting data in parallel Ground improves the efficiency of Data Concurrent processing, shortens the duration of data transmission, meets the demand of the relatively high scene of requirement of real-time; And the multi-thread of transmitted in parallel may be implemented by the parameter of the corresponding atomic type of setting object event to be transmitted in the present embodiment The mutual exclusion of journey can effectively ensure that the accuracy and efficiency of transmission of multiple Data Concurrent transmission.
Fig. 2 is the flow chart of Data Concurrent processing method embodiment two of the invention.As shown in Fig. 2, the number of the present embodiment According to concurrent processing method, it can specifically include following steps:
S200, the relevant information that data are obtained from the data queue of object event to be transmitted;The data queue is number It is established according to managing device for object event, the relevant information of N number of data for including in stored target event, each data The address information of the parameter of atomic type is carried in relevant information;The parameter of the atomic type is that data administrator is target Event setting, and it is initialized as 0;
S201, the relevant information according to data, obtain corresponding data;
S202, the data obtained are sent to remote server;
S203, the address information according to the parameter of atomic type add up 1 to the parameter of atomic type.
The Data Concurrent processing method of the present embodiment, any data in multiple data sending devices of data sending terminal Sending device side describes technical solution of the present invention.
The data queue of the present embodiment is for storing the relevant information for having the N number of data for including in object event;This implementation Multiple data sending devices in example work according to the operating mode of multithreading.Each data sending device is carrying out data When transmission, the relevant information of a data is first obtained from the data queue of object event to be transmitted, then further according to acquisition Data relevant information, obtain corresponding data;And the data obtained are sent to remote server.Finally, being sent in data It, will also be according to the address information of the parameter of atomic type, to the parameter cumulative 1 of atomic type, in this way, working as multiple data after success Sending device all sends at later N number of data, and the value of the parameter of the atomic type is just equal to N.Data administrator is logical at this time The numerical value for monitoring the parameter of the atomic type is crossed, can determine whether N number of data in object event all send successfully.
For example, the relevant information of N number of data in data queue in the present embodiment is not data itself, but basis The relevant information of each data is available to arrive corresponding data.For example, the relevant information of the data can be the address of data Information, perhaps for have data address address information perhaps can also be can point at data address pointer or It is the pointer that can point at an address for having data address, can also is the other information that can find data, herein not An another citing repeats.
For example, being specifically as follows in a kind of implementation of step S200 of the present embodiment: obtaining data from data queue Datarams space address information, the datarams space of the data is that data administrator is every number in object event According to creation, the address information of the event memory headroom of identification information and object event for storing data, object event Event memory headroom is data administrator creation, for storing the information of object event, is wrapped in the information of the object event Include the other information except N number of data and data.And the parameter of atomic type is that data administrator is arranged in object event Event memory headroom in, so, the address information of the parameter of atomic type is consistent with the address information of event memory headroom.
Accordingly, in the implementation of step S201, following steps be can specifically include:
(1) according to the address information in the datarams space of data, data are obtained from corresponding datarams space The address information of the event memory headroom of identification information and object event;
(2) from the corresponding event memory headroom of the address information of event memory headroom, the identification information pair of data is obtained The data answered.
Accordingly, before the step S203 of the present embodiment, can also include: according to the address information of event memory headroom, Obtain the parameter of the atomic type stored in corresponding event memory headroom, it is subsequent can be according to step S203 to atomic type Parameter cumulative 1.
Still optionally further, in above-mentioned embodiment illustrated in fig. 2, step S201 is " according to the relevant information of data, acquisition pair The data answered ", step S202 " send the data obtained to remote server ", directly get to remote server transmission Data in practical application, in the present embodiment, can also advise after step S201, before step S202 according to preset processing Then, data are handled.If such as the data obtained are very big, can compress at this time to the data of acquisition.If Partial Feature data in the data that cloud server only needs to obtain can also extract Partial Feature number from the data of acquisition According to.In practical application, can also other preset be configured in data sending device and handles rule according to actual needs, and After the data got, according to preset processing rule, corresponding algorithm is called, data are handled, and to cloud service Device sends treated data.
Similarly, the data of the present embodiment can be picture, voice or lteral data.
The Data Concurrent processing method of the present embodiment, the difference with above-mentioned embodiment illustrated in fig. 1 are: shown in above-mentioned Fig. 1 Embodiment describes technical solution of the present invention in data administrator side, and the present embodiment appointing in multiple data sending devices One data sending device side describes technical solution of the present invention.Multiple data sending devices in the present embodiment with multithreading and The operating mode that row sends data sends the corresponding data of relevant information of N number of data in data queue.The number of the present embodiment It is identical as above-mentioned embodiment illustrated in fig. 1 according to the specific implementation of concurrent processing method, it in detail can also be with reference to shown in above-mentioned Fig. 1 The record of embodiment, details are not described herein.
The Data Concurrent processing method of the present embodiment can be effective using multiple data sending device transmitting data in parallel Ground improves the efficiency of Data Concurrent processing, shortens the duration of data transmission, meets the demand of the relatively high scene of requirement of real-time; And the multi-thread of transmitted in parallel may be implemented by the parameter of the corresponding atomic type of setting object event to be transmitted in the present embodiment The mutual exclusion of journey can effectively ensure that the accuracy and efficiency of transmission of multiple Data Concurrent transmission.
It is locked in addition, being also provided with a kind of utilize in the prior art, realizes the concurrent processing and transmission of data.Specifically Ground needs processing and one mutual exclusion lock of data application sent and a status indication to be entire.Task to be treated point It is fitted in multithreading and handles and send.After per thread is sent completely, apply for mutual exclusion lock, update mark is gone in application after again Position.After whole threads are all sent completely, main thread sends last data.Although above-mentioned technical proposal uses Concurrent function, but since each data require one for controlling the lock resource of mutual exclusion, after data are sent completely, and need Destroy lock resource.It is bigger to the resource consumption of system when there is a large amount of data to need to send.
And comparatively, using the technical solution of the present embodiment, both by being similar to the technology of multi-thread concurrent, improve The processing and transmitting efficiency of data, and the mutual exclusion that the multithreading of transmitted in parallel may be implemented in atomic type is utilized, improving number While according to processing transmitting efficiency, additionally it is possible to be effectively reduced the consumption to system resource.
Below for transmitting the next monitor event of new public safety, to describe technical solution of the present invention.Specifically, A kind of exemplary diagram of Data Concurrent processing method of the invention as shown in Figure 3.
Specifically, in the present embodiment, it may include a large amount of picture in monitor event under new public safety, be related to Parameter, confidence level and a large amount of picture file name of various algorithms etc..Due to the picture being locally stored be it is bigger, one Picture has 300KB or so.And each monitor event includes that pictures up to a hundred will cause if all pictures all pass original image The transmission quantity of data is too big.So in the present embodiment, in order to reduce the transmission quantity of data, in every picture by before transmitting, It requires by a wheel compression, picture compression to size appropriate.
The scheme on the whole of the Data Concurrent processing method of the present embodiment is exactly to pass through multithreading, and one is monitored Whole pictures of event, are assigned in different threads and carry out necessary compression, and then compressed picture is sent to far again The server at end receives.When whole pictures are all sent completely and then the other information except the image data of monitor event It is sent to remote server.When remote server receives monitor event, since picture is all sended in advance, this For picture file name in this monitor event of sample with regard to significant, entire monitor event is also complete, can carry out subsequent behaviour Make.
As shown in figure 3, receiving thread is used to receive the monitor event for needing to transmit, then receiving thread in the present embodiment Apply for one piece of new memory headroom, for storing the monitor event received.In this block memory headroom of application, it is arranged simultaneously The field succ_send_pic_count of one atomic type (can be std::atomic type in such as C++), and be arranged Initial value is 0.Then the corresponding memory pointer of monitor event received is put into an individual thread-safe by receiving thread Monitor event queue in.Optionally, after receiving thread receives the monitor event for needing to transmit, any place can not also be done Reason, and directly to main thread, it is the one piece of new memory headroom of monitor event application each to be transmitted by main thread, and store and connect The monitor event received, and the field of application atomic type.
Main thread obtains the pointer moniter_event_ of a monitor event to be sent from monitor event queue Then ptr parses picture file name therein, be then each picture file name application memory together, pointer name For moniter_event_pic_ptr.This block memory not only stores picture file name, but also stores the finger for being directed toward monitor event Needle moniter_event_ptr.Then main thread puts the corresponding pointer moniter_event_pic_ptr of each picture file Into picture queue to be processed.At the same time, main thread has got the quantity of whole pictures to be sent, all_pic_ count.After having information in picture queue to be processed, picture processing thread just starts to obtain information from picture queue to be processed, It starts to process.Picture handles thread constantly from picture queue to be sent, and pop goes out the pointer of new picture to be sent moniter_event_pic_ptr.First with filename, the corresponding content of picture is obtained, then by calling corresponding calculate Method compresses the picture, obtains a picture smaller compared with original image.Specific compression factor, can according to demand really It is fixed.After compression is completed, picture processing thread is directly communicated with remote server, and picture is sent.It has sent At later, its corresponding field: succ_send_pic_ is modified by pointer moniter_event_ptr stored before Count, adds up 1 to it.With the transmission success of picture, succ_send_pic_count is increasing, final and all_pic_ Count is equally big.
Meanwhile main thread starts constantly to compare succ_send_pic_count and all_pic_count.With picture Constantly being sent successfully, succ_send_pic_count can gradually increase, and it is last big as all_pic_count, this When main thread the other information except the data of monitor event is sent to remote server.So far, monitor event transfers Finish.
Fig. 4 is the structure chart of data administrator embodiment of the invention.As shown in figure 4, the data management of the present embodiment Device can specifically include:
Setup module 10 is used to be arranged the parameter of the corresponding atomic type of object event to be transmitted, and is initialized as 0;
Module 11 is established for establishing data queue, N number of data of the data queue for including in stored target event Relevant information carries the address information of the parameter of the atomic type of the setting of setup module 10 in the relevant information of each data, with By multiple data sending devices according to the relevant information of data N number of in data queue, corresponding N is sent to remote server parallel A data, and after each data sending device has sent a data, according to the address information of the parameter of atomic type to atom The parameter of type cumulative 1;
Whether the numerical value that monitoring module 12 is used to monitor the parameter of the atomic type of the setting of setup module 10 is equal to N;
If numerical value of the determining module 13 for the parameter that monitoring module 12 monitors atomic type is equal to N, target thing is determined All data in part are sent completely.
The data administrator of the present embodiment, by using above-mentioned module realize Data Concurrent processing realization principle and Technical effect is identical as the realization of above-mentioned related method embodiment, can refer to the record of above-mentioned related method embodiment in detail, Details are not described herein.
It still optionally further, can also include sending module 14 as shown in figure 4, in the data administrator of the present embodiment, After all data for being determined in object event in determining module 13 are sent completely, sending module 14 is triggered to remote server Send the other information except the data in object event.
Still optionally further, in the data administrator of the present embodiment, setup module 10 is specifically used for:
Event memory headroom is distributed for object event, the information of object event is stored in event memory headroom, and in thing The parameter of atomic type is set in part memory headroom, and is initialized as 0;It include N number of data and number in the information of object event Other information except.
Still optionally further, it in the data administrator of the present embodiment, establishes module 11 and is specifically used for:
It is that each data in N number of data of object event distribute datarams space according to the information of object event, The identification information of corresponding data and the address information of event memory headroom are stored in datarams space;
The address information in the datarams space of N number of data is stored in a queue, as data queue, by multiple numbers Corresponding data are successively obtained according to the address information in datarams each in data queue space according to sending device, parallel to remote It is right according to the address information of event memory headroom after end server is sent, and each data sending device has sent a data The parameter of the atomic type of storage cumulative 1.
Still optionally further, in the data administrator of the present embodiment, data are picture, voice or lteral data.
Fig. 5 is the structure chart of data sending device embodiment of the invention.As shown in figure 5, the data of the present embodiment are sent Device can specifically include:
Module 20 is obtained for obtaining the relevant information of data from the data queue of object event to be transmitted;Data team It is classified as what data administrator was established for object event, the relevant information of N number of data for including in stored target event, respectively The address information of the parameter of atomic type is carried in the relevant information of data;The parameter of atomic type is that data administrator is Object event setting, and it is initialized as 0;
It obtains module 20 and is also used to the relevant information according to data, obtain corresponding data;
Sending module 21 is used to send the data for obtaining module 20 and obtaining to remote server;
After sending module 21 issues successfully, triggering modified module 22 starts, and modified module 22 is used for according to acquisition module The address information of the parameter of the atomic type carried in the relevant information of 20 acquisition data, to the parameter cumulative 1 of atomic type.
The data sending device of the present embodiment, by using above-mentioned module realize Data Concurrent processing realization principle and Technical effect is identical as the realization of above-mentioned related method embodiment, can refer to the record of above-mentioned related method embodiment in detail, Details are not described herein.
Still optionally further, it in the data sending device of the present embodiment, obtains module 20 and is specifically used for:
The address information in the datarams space of data is obtained from data queue, the datarams space of data is data Managing device is each data creation, the event memory of identification information and object event for storing data in object event The address information in space, the event memory headroom of object event is data administrator creation, for storing object event Information includes the other information except N number of data and data in the information of object event.
Still optionally further, it in the data sending device of the present embodiment, obtains module 20 and is specifically also used to:
According to the address information in the datarams space of data, the mark of data is obtained from corresponding datarams space The address information of the event memory headroom of information and object event;
From the corresponding event memory headroom of address information of event memory headroom, the identification information for obtaining data is corresponding Data.
Still optionally further, as shown in figure 5, in the data sending device of the present embodiment, further includes:
Data processing module 23 is used to handle data according to preset processing rule.
At this point, accordingly, sending module 21 is used to send data processing module 23 to remote server treated data.
Still optionally further, in the data sending device of the present embodiment, data are picture, voice or lteral data.
Fig. 6 is the structure chart of Data Concurrent processing system embodiment of the invention.As shown in fig. 6, the data of the present embodiment Concurrent processing system, including data administrator 100 and multiple data sending devices 200, multiple data sending devices 200 use The operating mode of multi-thread concurrent;Each data sending device 200 is communicated to connect with data administrator 100;Data administrator 100 using data administrator shown in Fig. 4 as above;Each data sending device 200 sends dress using as above data shown in fig. 5 It sets.And specifically the concurrent processing of data can be realized using the Data Concurrent processing method as described in above-mentioned Fig. 1-Fig. 3 is any.
Fig. 7 is the structure chart of computer equipment embodiment of the invention.As shown in fig. 7, the computer equipment of the present embodiment, It include: one or more processors 30 and memory 40, memory 40 works as memory for storing one or more programs The one or more programs stored in 40 are executed by one or more processors 30, so that one or more processors 30 are realized such as Figure 1 above-embodiment illustrated in fig. 3 Data Concurrent processing method.In embodiment illustrated in fig. 7 for including multiple processors 30.
For example, Fig. 8 is a kind of exemplary diagram of computer equipment provided by the invention.Fig. 8, which is shown, to be suitable for being used to realizing this The block diagram of the exemplary computer device 12a of invention embodiment.The computer equipment 12a that Fig. 8 is shown is only an example, Should not function to the embodiment of the present invention and use scope bring any restrictions.
As shown in figure 8, computer equipment 12a is showed in the form of universal computing device.The component of computer equipment 12a can To include but is not limited to: one or more processor 16a, system storage 28a connect different system components (including system Memory 28a and processor 16a) bus 18a.
Bus 18a indicates one of a few class bus structures or a variety of, including memory bus or Memory Controller, Peripheral bus, graphics acceleration port, processor or the local bus using any bus structures in a variety of bus structures.It lifts For example, these architectures include but is not limited to industry standard architecture (ISA) bus, microchannel architecture (MAC) Bus, enhanced isa bus, Video Electronics Standards Association (VESA) local bus and peripheral component interconnection (PCI) bus.
Computer equipment 12a typically comprises a variety of computer system readable media.These media can be it is any can The usable medium accessed by computer equipment 12a, including volatile and non-volatile media, moveable and immovable Jie Matter.
System storage 28a may include the computer system readable media of form of volatile memory, such as deposit at random Access to memory (RAM) 30a and/or cache memory 32a.Computer equipment 12a may further include it is other it is removable/ Immovable, volatile/non-volatile computer system storage medium.Only as an example, storage system 34a can be used for reading Write immovable, non-volatile magnetic media (Fig. 8 do not show, commonly referred to as " hard disk drive ").Although being not shown in Fig. 8, The disc driver for reading and writing to removable non-volatile magnetic disk (such as " floppy disk ") can be provided, and non-easy to moving The CD drive that the property lost CD (such as CD-ROM, DVD-ROM or other optical mediums) is read and write.In these cases, each Driver can be connected by one or more data media interfaces with bus 18a.System storage 28a may include at least One program product, the program product have one group of (for example, at least one) program module, these program modules are configured to hold The function of the above-mentioned each embodiment of Fig. 1-Fig. 6 of the row present invention.
Program with one group of (at least one) program module 42a/utility 40a, can store and deposit in such as system In reservoir 28a, such program module 42a include --- but being not limited to --- operating system, one or more application program, It may include the reality of network environment in other program modules and program data, each of these examples or certain combination It is existing.Program module 42a usually executes the function and/or method in above-mentioned each embodiment of Fig. 1-Fig. 6 described in the invention.
Computer equipment 12a can also be with one or more external equipment 14a (such as keyboard, sensing equipment, display 24a etc.) communication, the equipment interacted with computer equipment 12a communication can be also enabled a user to one or more, and/or (such as network interface card is adjusted with any equipment for enabling computer equipment 12a to be communicated with one or more of the other calculating equipment Modulator-demodulator etc.) communication.This communication can be carried out by input/output (I/O) interface 22a.Also, computer equipment 12a can also by network adapter 20a and one or more network (such as local area network (LAN), wide area network (WAN) and/or Public network, such as internet) communication.As shown, network adapter 20a passes through its of bus 18a and computer equipment 12a The communication of its module.It should be understood that although not shown in the drawings, other hardware and/or software can be used in conjunction with computer equipment 12a Module, including but not limited to: microcode, device driver, redundant processor, external disk drive array, RAID system, tape Driver and data backup storage system etc..
Processor 16a by the program that is stored in system storage 28a of operation, thereby executing various function application and Data processing, such as realize Data Concurrent processing method shown in above-described embodiment.
The present invention also provides a kind of computer-readable mediums, are stored thereon with computer program, which is held by processor The Data Concurrent processing method as shown in above-described embodiment is realized when row.
The computer-readable medium of the present embodiment may include in the system storage 28a in above-mentioned embodiment illustrated in fig. 8 RAM30a, and/or cache memory 32a, and/or storage system 34a.
With the development of science and technology, the route of transmission of computer program is no longer limited by tangible medium, it can also be directly from net Network downloading, or obtained using other modes.Therefore, the computer-readable medium in the present embodiment not only may include tangible Medium can also include invisible medium.
The computer-readable medium of the present embodiment can be using any combination of one or more computer-readable media. Computer-readable medium can be computer-readable signal media or computer readable storage medium.Computer-readable storage medium Matter for example may be-but not limited to-system, device or the device of electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor, or Any above combination of person.The more specific example (non exhaustive list) of computer readable storage medium includes: with one Or the electrical connections of multiple conducting wires, portable computer diskette, hard disk, random access memory (RAM), read-only memory (ROM), Erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light Memory device, magnetic memory device or above-mentioned any appropriate combination.In this document, computer readable storage medium can With to be any include or the tangible medium of storage program, the program can be commanded execution system, device or device use or Person is in connection.
Computer-readable signal media may include in a base band or as carrier wave a part propagate data-signal, Wherein carry computer-readable program code.The data-signal of this propagation can take various forms, including --- but It is not limited to --- electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be Any computer-readable medium other than computer readable storage medium, which can send, propagate or Transmission is for by the use of instruction execution system, device or device or program in connection.
The program code for including on computer-readable medium can transmit with any suitable medium, including --- but it is unlimited In --- wireless, electric wire, optical cable, RF etc. or above-mentioned any appropriate combination.
The computer for executing operation of the present invention can be write with one or more programming languages or combinations thereof Program code, described program design language include object oriented program language-such as Java, Smalltalk, C++, Further include conventional procedural programming language-such as " C " language or similar programming language.Program code can be with It fully executes, partly execute on the user computer on the user computer, being executed as an independent software package, portion Divide and partially executes or executed on a remote computer or server completely on the remote computer on the user computer.? Be related in the situation of remote computer, remote computer can pass through the network of any kind --- including local area network (LAN) or Wide area network (WAN)-be connected to subscriber computer, or, it may be connected to outer computer (such as mentioned using Internet service It is connected for quotient by internet).
In several embodiments provided by the present invention, it should be understood that disclosed system, device and method can be with It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the unit It divides, only a kind of logical function partition, there may be another division manner in actual implementation.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme 's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list Member both can take the form of hardware realization, can also realize in the form of hardware adds SFU software functional unit.
The above-mentioned integrated unit being realized in the form of SFU software functional unit can store and computer-readable deposit at one In storage media.Above-mentioned SFU software functional unit is stored in a storage medium, including some instructions are used so that a computer It is each that equipment (can be personal computer, server or the network equipment etc.) or processor (processor) execute the present invention The part steps of embodiment the method.And storage medium above-mentioned includes: USB flash disk, mobile hard disk, read-only memory (Read- Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic or disk etc. it is various It can store the medium of program code.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all in essence of the invention Within mind and principle, any modification, equivalent substitution, improvement and etc. done be should be included within the scope of the present invention.

Claims (23)

1. a kind of Data Concurrent processing method, which is characterized in that the described method includes:
The parameter of the corresponding atomic type of object event to be transmitted is set, and is initialized as 0;
Data queue is established, the data queue is used to store the relevant information for the N number of data for including in the object event, respectively The address information of the parameter of the atomic type is carried in the relevant information of the data, by multiple data sending device roots According to the relevant information of N number of data described in the data queue, corresponding N number of data are sent to remote server parallel, And after each data sending device has sent the data, according to the address information pair of the parameter of the atomic type The parameter of the atomic type cumulative 1;
Whether the numerical value for monitoring the parameter of the atomic type is equal to N;
If being equal to, determine that all data in the object event are sent completely.
2. the method according to claim 1, wherein determining that all data in the object event are sent completely Later, the method also includes:
The other information except the data in the object event is sent to the remote server.
3. the method according to claim 1, wherein the parameter of the corresponding atomic type of setting object event, and It is initialized as 0, comprising:
Event memory headroom is distributed for the object event, the letter of the object event is stored in the event memory headroom It ceases, and the parameter of atomic type is set in the event memory headroom, and is initialized as 0;In the information of the object event Including the other information except N number of data and data.
4. according to the method described in claim 3, it is characterized in that, establishing data queue, comprising:
It is that each of described N number of data of object event data distribute number according to the information of the object event According to memory headroom, the identification information and the event memory headroom of the corresponding data are stored in the datarams space Address information;
The address information in the datarams space of N number of data is stored in a queue, as the data queue, by institute Multiple data sending devices are stated successively according to the acquisition pair of the address information in the datarams space each in the data queue The data answered are sent to the remote server parallel, and each data sending device has sent the number According to rear, according to the address information of the event memory headroom, to the parameter cumulative 1 of the atomic type of storage.
5. method according to claim 1 to 4, which is characterized in that the data are picture, voice or text number According to.
6. a kind of Data Concurrent processing method, which is characterized in that the described method includes:
The relevant information of data is obtained from the data queue of object event to be transmitted;The data queue is the data pipe Managing device is what the object event was established, for storing the relevant information for the N number of data for including in the object event, The address information of the parameter of atomic type is carried in the relevant information of each data;The parameter of the atomic type is described Data administrator is object event setting, and is initialized as 0;
According to the relevant information of the data, corresponding data are obtained;
The data obtained are sent to remote server;
According to the address information of the parameter of the atomic type, to the parameter cumulative 1 of atomic type.
7. according to the method described in claim 6, it is characterized in that, obtaining number from the data queue of object event to be transmitted According to relevant information, comprising:
The address information in the datarams space of the data is obtained from the data queue, the datarams of the data are empty Between be the data administrator be each data creation in the object event, for storing the mark of the data The address information of the event memory headroom of information and the object event, the event memory headroom of the object event are the number It include N number of number in the information of the object event for storing the information of the object event according to managing device creation Other information accordingly and except data.
8. according to the method described in claim 6, it is characterized in that, obtaining corresponding number according to the relevant information of the data According to, comprising:
According to the address information in the datarams space of the data, data are obtained from the corresponding datarams space The address information of the event memory headroom of identification information and the object event;
From the corresponding event memory headroom of address information of the event memory headroom, the identification information pair of the data is obtained The data answered.
9. according to the method described in claim 6, it is characterized in that, obtaining corresponding number according to the relevant information of the data Before the data later, obtained to remote server transmission, the method also includes:
According to preset processing rule, the data are handled.
10. according to any method of claim 6-9, which is characterized in that the data are picture, voice or text number According to.
11. a kind of data administrator, which is characterized in that described device includes:
Setup module for the parameter of the corresponding atomic type of object event to be transmitted to be arranged, and is initialized as 0;
Module is established, for establishing data queue, the data queue is for storing the N number of data for including in the object event Relevant information, the address information of the parameter of the atomic type is carried in the relevant information of each data, by multiple The relevant information of data sending device N number of data according to the data queue sends to remote server correspond to parallel N number of data, and after each data sending device has sent the data, according to the ginseng of the atomic type Parameter cumulative 1 of several address informations to the atomic type;
Monitoring module, for monitoring whether the numerical value of parameter of the atomic type is equal to N;
Determining module determines the institute in the object event if the numerical value of the parameter for monitoring the atomic type is equal to N There are data to be sent completely.
12. device according to claim 11, which is characterized in that described device further include:
Sending module, for sending the other information except the data in the object event to the remote server.
13. device according to claim 11, which is characterized in that the setup module is specifically used for:
Event memory headroom is distributed for the object event, the letter of the object event is stored in the event memory headroom It ceases, and the parameter of atomic type is set in the event memory headroom, and is initialized as 0;In the information of the object event Including the other information except N number of data and data.
14. device according to claim 13, which is characterized in that it is described to establish module, it is specifically used for:
It is that each of described N number of data of object event data distribute number according to the information of the object event According to memory headroom, the identification information and the event memory headroom of the corresponding data are stored in the datarams space Address information;
The address information in the datarams space of N number of data is stored in a queue, as the data queue, by institute Multiple data sending devices are stated successively according to the acquisition pair of the address information in the datarams space each in the data queue The data answered are sent to the remote server parallel, and each data sending device has sent the number According to rear, according to the address information of the event memory headroom, to the parameter cumulative 1 of the atomic type of storage.
15. any device of 1-14 according to claim 1, which is characterized in that the data are picture, voice or text Data.
16. a kind of data sending device, which is characterized in that described device includes:
Module is obtained, for obtaining the relevant information of data from the data queue of object event to be transmitted;The data team Being classified as the data administrator is what the object event was established, for storing include in the object event N number of described The relevant information of data carries the address information of the parameter of atomic type in the relevant information of each data;The atom The parameter of type is that the data administrator is what the object event was arranged, and is initialized as 0;
The acquisition module, is also used to the relevant information according to the data, obtains corresponding data;
Sending module, for sending the data obtained to remote server;
Modified module adds up 1 to the parameter of atomic type for the address information according to the parameter of the atomic type.
17. device according to claim 16, which is characterized in that the acquisition module is specifically used for:
The address information in the datarams space of the data is obtained from the data queue, the datarams of the data are empty Between be the data administrator be each data creation in the object event, for storing the mark of the data The address information of the event memory headroom of information and the object event, the event memory headroom of the object event are the number It include N number of number in the information of the object event for storing the information of the object event according to managing device creation Other information accordingly and except data.
18. device according to claim 16, which is characterized in that the acquisition module is specifically used for:
According to the address information in the datarams space of the data, data are obtained from the corresponding datarams space The address information of the event memory headroom of identification information and the object event;
From the corresponding event memory headroom of address information of the event memory headroom, the identification information pair of the data is obtained The data answered.
19. device according to claim 16, which is characterized in that described device further include:
Data processing module, for handling the data according to preset processing rule.
20. any device of 6-19 according to claim 1, which is characterized in that the data are picture, voice or text Data.
21. a kind of Data Concurrent processing system, which is characterized in that including data administrator and multiple data sending devices, institute State the operating mode that multiple data sending devices use multi-thread concurrent;Each data sending device and the data management fill Set communication connection;The data administrator is using any data administrator of claim 11-15 as above;It is each described Data sending device is using any data sending device of claim 16-20 as above.
22. a kind of computer equipment, which is characterized in that the equipment includes:
One or more processors;
Memory, for storing one or more programs;
When one or more of programs are executed by one or more of processors, so that one or more of processors are real Now such as method as claimed in any one of claims 1 to 5, or method of the realization as described in any in claim 6-9.
23. a kind of computer-readable medium, is stored thereon with computer program, which is characterized in that the program is executed by processor Shi Shixian method for example as claimed in any one of claims 1 to 5, or realize the method as described in any in claim 6-9.
CN201910394225.2A 2019-05-13 2019-05-13 Data concurrent processing method, device and system, computer equipment and readable medium Active CN110231983B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910394225.2A CN110231983B (en) 2019-05-13 2019-05-13 Data concurrent processing method, device and system, computer equipment and readable medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910394225.2A CN110231983B (en) 2019-05-13 2019-05-13 Data concurrent processing method, device and system, computer equipment and readable medium

Publications (2)

Publication Number Publication Date
CN110231983A true CN110231983A (en) 2019-09-13
CN110231983B CN110231983B (en) 2022-01-28

Family

ID=67860545

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910394225.2A Active CN110231983B (en) 2019-05-13 2019-05-13 Data concurrent processing method, device and system, computer equipment and readable medium

Country Status (1)

Country Link
CN (1) CN110231983B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113411365A (en) * 2020-03-17 2021-09-17 中国移动通信集团山东有限公司 Data processing method and device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1774699A (en) * 2003-04-24 2006-05-17 国际商业机器公司 Concurrent access of shared resources
CN1889046A (en) * 2006-08-03 2007-01-03 迈普(四川)通信技术有限公司 Multi-kernel parallel first-in first-out queue processing system and method
CN102486740A (en) * 2010-12-03 2012-06-06 中国科学院沈阳自动化研究所 Multithreading real-time data processing device and method
CN105786973A (en) * 2016-02-02 2016-07-20 重庆秒盈电子商务有限公司 Concurrent data processing method and system based on big data technology
CN107241281A (en) * 2017-05-27 2017-10-10 上海东土远景工业科技有限公司 A kind of data processing method and its device
CN109617833A (en) * 2018-12-25 2019-04-12 深圳市任子行科技开发有限公司 The NAT Data Audit method and system of multithreading user mode network protocol stack system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1774699A (en) * 2003-04-24 2006-05-17 国际商业机器公司 Concurrent access of shared resources
CN1889046A (en) * 2006-08-03 2007-01-03 迈普(四川)通信技术有限公司 Multi-kernel parallel first-in first-out queue processing system and method
CN102486740A (en) * 2010-12-03 2012-06-06 中国科学院沈阳自动化研究所 Multithreading real-time data processing device and method
CN105786973A (en) * 2016-02-02 2016-07-20 重庆秒盈电子商务有限公司 Concurrent data processing method and system based on big data technology
CN107241281A (en) * 2017-05-27 2017-10-10 上海东土远景工业科技有限公司 A kind of data processing method and its device
CN109617833A (en) * 2018-12-25 2019-04-12 深圳市任子行科技开发有限公司 The NAT Data Audit method and system of multithreading user mode network protocol stack system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
LAL PRATAPVERMA: "An adaptive data chunk scheduling for concurrent multipath transfer", 《COMPUTER STANDARDS & INTERFACES》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113411365A (en) * 2020-03-17 2021-09-17 中国移动通信集团山东有限公司 Data processing method and device

Also Published As

Publication number Publication date
CN110231983B (en) 2022-01-28

Similar Documents

Publication Publication Date Title
US11210131B2 (en) Method and apparatus for assigning computing task
CN108416744B (en) Image processing method, device, equipment and computer readable storage medium
KR20180075913A (en) A method for input processing using neural network calculator and an apparatus thereof
CN110650347B (en) Multimedia data processing method and device
JP7012689B2 (en) Command execution method and device
CN107315729A (en) For the data processing method of chart, medium, device and computing device
CN108495043A (en) Image processing method and relevant apparatus
CN109992956A (en) The processing method and relevant apparatus of the security strategy of container
CN106919442A (en) Many GPU dispatching devices and distributed computing system and many GPU dispatching methods
US20210264257A1 (en) AI Accelerator Virtualization
KR20170062038A (en) Electronic apparatus and operating method thereof
CN110231983A (en) Data Concurrent processing method, apparatus and system, computer equipment and readable medium
CN113656359A (en) Method and device for lightening three-dimensional model, computer equipment and storage medium
CN109240979A (en) Data processing chip and LED display system
CN108961424A (en) Virtual information processing method, equipment and storage medium
CN104463790B (en) A kind of methods, devices and systems of image procossing
KR20180110896A (en) Electronic device and method for communication using a plurality of radio interfaces
CN114363654B (en) Video push method, device, terminal equipment and storage medium
JP6274759B2 (en) DIGITAL PHOTO FRAME SERVICE PROVIDING METHOD, RECORDING MEDIUM, AND SERVER
CN107919991A (en) A kind of virtual data center creates and quota collocation method and device
CN110083357A (en) Interface construction method, device, server and storage medium
CN115062340A (en) Device access method, interface processing method and device
CN114070892A (en) Data transmission method and device
CN111160283A (en) Data access method, device, equipment and medium
CN114244557B (en) Development operation log isolation method and system based on user characteristics

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant