TW200529007A - System and method for sending data by multithread - Google Patents

Abstract

The present invention provides a system and method for sending data by multithread. The method comprises the following steps: A local application server runs a main application program; the main application program reads each data from a local database and startups a thread immediately, then reads next data and startups another new thread; after startup a certain thread, that is also said this thread, then startup HTTP to transfer these data to a remote database server; the thread obtains a state of these transferred data from the remote database server, and waits a message, which has been generated by the former thread, namely the document name; after having received the message, this thread updates a tag of these data in the local database, and then sends another message of these data to next thread to access the local database.

Description

200529007 V. Description of the invention (1) [Technical field to which the invention belongs] The present invention relates to a system and method for transmitting data, and more particularly to a system and method for transmitting data using a multi-thread mechanism. [Previous technology] Some high-end servers today generally use a combination of multiple processors, but there are also some operations that use multi-line private mechanisms to improve system performance. The thread refers to a sub-application that can perform a specific function. The multi-threading is compared with a single thread, which means that one feeder can simultaneously process a plurality of application threads or a plurality of application threads. The previous operating system used a single-threaded program structure, and its operating principle 疋 The main application has a message loop, which continuously reads from the message and the queue: reads the message to determine the next task to be completed. The message; This is done by a sub-function, and the main application can only receive another message for execution after waiting for the sub-function to return. For example, the sub-function = work is reading data from a network. The main application can only receive the next message after waiting for reading. During the execution of this sub-function, it is necessary to wait for a period of time, especially when reading network data and waiting for the user to enter, the system has more time in the waiting state. Although some operating systems have concurrent operating functions ^, they actually use the time-sharing technology of the processing mode, and do not really apply this kind of multi-line time-> However, in today's systems, each program can be the same Business. = 禝 ίThread, which means that a program can complete multiple tasks at the same time. In a network system, many functions can be executed concurrently. The best choice is to use. For example, the speed of data transmission on the network and the use of 200529007 V. Invention Description (2) The user input speed is slow, and multiple independent threads can be used to complete the data transmission without affecting other functions. Because the data is sent and received through the Hypertext Transfer Protocol (HTTP), and the additional burden of data certificate encryption is added, the bandwidth requirement must be more than 200Kbps. However, the general Internet bandwidth is generally only 10Kbps to 50Kbps, so the method of sending data one by one cannot meet the time requirements for sending large amounts of data. Supporting technology for multi-threaded data processing was disclosed in 1999/99, U.S. Patent No. 6,003,06, published on February 14th, and its patent name is, between multiple data processing workstations. System For Distributing A Plurality Of Threads Associated With A Process Initiating By One Data Processing

Station Among Data Processing Stations) ''. The patent discloses that in a computer network system, a server allocates a plurality of threads to process data between a plurality of workstations, and data tags are used between the plurality of threads to track and record while processing data. However, the shortcoming is that the invention of the patent requires multiple workstations to execute the main application program that processes data multiple times, and each time the main application program is executed requires extra time, so it takes a long time to process a large amount of data. It is impossible to meet the time requirements of some high-performance systems for processing data. In order to overcome the above-mentioned shortcomings of the prior art, it is necessary to provide a multi-threaded sending system and method. It only needs to execute the main application once to start multiple threads to perform data transmission at the same time, thereby shortening the transmission time for transmitting a large amount of data.

Page 7 200529007 V. Description of the invention (3) [Summary of the invention] The main purpose of the present invention is to provide a multi-threaded data transmission system and method. J Yishuo fetches multiple data to start multiple threads, and uses the same method to transmit data using multiple channels. The transmission method of the plural data channels refers to a transmission method in which plural threads are started simultaneously to transmit a plurality of data in parallel. The other purpose of this month is to provide a multi-threaded data transmission system and method eight, which can be used for tracking and recording when the thread is transmitting data, and using a message notification mechanism to send data between multiple threads. Material system 2: t ϊ Γ 明目 ❸ The present invention provides a multi-threaded sending resource, a land resource oblique system. The system includes: a local application server i ,.-Yucheng Gong material server, a connection And the internet. Among them, the local application server includes: a data reading module for the file name of the second time; the database update module is used to mark the data in the database, as described above. The data mark is used as "quot" 1. If the data is not sent, the current record, data record: Haibi beacon mark and-thread operation mode is used for "up" and "up" as "0"; In order to send data, follow the data transmission status in each thread and send connections to multiple threads to access the database =, = The process running module also includes a thread startup submodule = for the library Store multiple data and the corresponding broadcast of each data; name and sum: mark on page 8 200529007 5. Invention Description (4) corresponding to the data. The remote database server is used to receive the data sent by the local application server. And its corresponding building case name, and returns each data transmission status to the local application server. The invention also provides a multi-threaded data transmission method, which includes the following steps: (a) the local application server starts the main application program; (B) Main application The data reading module reads a piece of data to be sent and its file name from the local database, and the data and its file name are the current data; (c) the current data read by the main application program starts a new Thread, this thread refers to this thread, the main application will submit this read data and its file name and last data coffin name to this thread; (d) this thread will read this data And its file name is placed in the sending state; (e) the database update module updates the tags of the sent data in the local database; (f) the main application continuously reads multiple pieces of data privately, and A piece of data starts another new thread; (g) this thread starts HTTP to transmit this data and its file name to the remote database server; (h) tracks and records each thread when transmitting data, and Messages are used between multiple threads to notify other threads to access the local database; (i) the main application judges whether the materials to be sent have been sent. 'The tracking and recording of each thread when transmitting data is described in the above, and The step (h) of notifying other threads to access the local database by using messages between the plurality of threads includes the steps of: (ai) starting the current thread Ηττρ, and submitting the data and files submitted to the thread through the network. The name server 9 to the Cheng database database server, (M) The remote database server receives the data and its case name, and returns the name of the data file as the data transmission status to

Page 9 200529007

The local application servo benefits' (c 1) the thread tracking submodule receives the returned material transmission status; (dl) the thread queuing submodule waits for the message sent by the last thread whose name is the last data file name; (el) the thread notification The submodule determines whether the message is received. If it does not receive the message, the thread queues the submodule to wait for the message; if the message is successfully received, the above-mentioned returned asset status is recorded in the local database; ( Π) The thread notification submodule sends a message with the name of this data broadcast case to notify the next thread waiting for the database to be connected to the local database. By implementing the present invention, only a single execution of the main application program can start multiple threads to perform data transmission at the same time, thereby reducing the time required to send data to meet the requirements for sending a large amount of data; and the data input status in each thread can follow And record 'so the system will not cause system performance to be down due to too many databases. [Embodiment] Please refer to the first figure, which is a hardware architecture diagram of the multi-threaded data transmission system of the present invention. The multi-threaded data transmission system includes a local application server 1, a local database 2, a remote database server 3, a 'connection 4', and a network 5. The local application server 1 is connected to the local database 2 through connection 4, and is connected to the remote database server 3 through network 5. The local application server 1 is used to start the main application program and plural w threads required to send data, and to start the Hypertext Transfer Protocol (Hypertext

Transfer Protocol (HTTP) to transfer data and receive 传输 ττρ data transfer status returned from the remote database server 3, record the returned status in the local database 2, and send a message to notify other local databases that need to be connected

200529007 V. Description of the invention (6) 2 threads. The main application is a programmable application running on the local application server i, which is used to read a piece of data from the local database 2 each time, that is, to start a thread for sending data, and then Read the next data in local database 2 and start a new thread. The thread refers to a sub-application for sending data and its corresponding file name. The local database 2 is used to store plural data and their corresponding file names. 5 Xuan Departure Database Server 3 is used to receive the data sent from the local application server 1 and its corresponding file name, and return a data transmission status to the local application server 1. The connection 4 is a database connection, such as open data

Library connection (Open Database Connectivity 'ODBC), or Java Database Connectivity (JDBC). Network 5 is a communication network that supports Transmission Control Protocol / Internet Protocol (TCP / IP). It can be an intranet, the Internet, or other types of communication networks. Communication network.

Please refer to the second figure, which is a software function module diagram of the local application feeder of the multi-threaded data transmission system of the present invention. The local application server 1 includes a data reading module 11, a database update module 丨 2, and a thread running module 13. The data reading module π is used to read data from the local database 2 and its corresponding file name. The database update module 丨 2 is used to update the tag of the data sent to the remote database server 3 in the local database 2. If the data has been sent, the indication § of the data in the local database 2 has been updated to "1", which means that the data has been started to send, so as to avoid the main application repeatedly reading the started thread to send Information again

Page 11 200529007 V. Description of the invention (7) Start the thread for it. The thread running module 1 and 3 are used to start a thread for each reading of a piece of data, and transmit data using a plurality of data channels simultaneously, track and record the data transmission status in each thread, and access to a plurality of threads. The connection to be established in the local database 2 is queued. The transmission method of the plurality of data channels refers to a transmission method in which a plurality of data are transmitted in parallel by simultaneously starting a plurality of threads. The thread running module 丨 3 includes a thread starting submodule 1 3 1, a thread and a vertical submodule 1 3 2, a thread queuing submodule 1 3 3, and a thread notification submodule 1 3 4. Among them, the thread starting sub-module 1 3 1 is used to start a thread for each read of a piece of data. In a main application program, a plurality of threads are simultaneously started to transmit the data and data to the remote database server 3 through a plurality of data channels. Corresponding case name; the thread tracking sub-module 132 is used to start HTTP to transmit the data submitted to the thread and its slot case name to the remote database server 3, and perform data transmission status in each thread Track and receive the data transmission status returned by the remote database server 3, and record the returned data transfer status; the thread queuing submodule 1 3 3 is used to access the local database 2 by multiple threads in the multi-thread mechanism The connections that need to be established are queued to avoid system performance degradation and downtime due to too many databases, and to wait for the last thread to send a message called the last lean file name; the thread notification submodule 丨 34 pass Use the file name of the data sent this time as r, and? For the 4th series, the connection thread needs to be established when accessing the local database 2. When the next thread waiting in queue 4 receives the message sent by the last thread, it will establish a connection with the local database 2. Mind ^ Please refer to the third figure, which is a schematic diagram of the multi-thread operation mechanism of the multi-threaded data transmission system of the present invention 200529007 V. Description of the Invention (8). The local application server 1 starts a main application program. The main application program cyclically reads n data items from the local database 2, and then starts n threads at the same time, and uses n data channels to send n data at the same time. Because each time the main application reads an X data from the local database 2 to the thread, the thread needs to establish a connection with the local database 2. In order to avoid system performance degradation and downtime caused by too many threads connecting to the database, the thread start submodule 丨 3 i starts a thread to send data and the 'thread queue submodule 133 will need to establish a connection with the local database 2. The thread waits in a queue, and the thread notification submodule 34 issues the name of this data as the message to notify the next queued thread to access the local database 2. Please refer to the fourth figure, which is a flowchart of the main application program operation of the multi-threaded data sending method of the present invention. The local application server 1 starts the main application and initializes all the tags to be sent as “0”. This application program is used to control the sending of all data, and only starts once and terminates the operation after sending all the data (step S100). When the data reading module 11 reads a piece of data (referred to as the current data) and its corresponding file name (step 〇1) to be transmitted to the remote database server 3 from the local database 2, the thread starts the submodule The group 131 immediately starts a new thread for this data and submits the current data and its file name and the file name of the last data to the thread. The file name of the current data is used as a message for the current thread to notify the next thread waiting to access the local database 2 and for the remote database server 3 to return the data to the local application server 1. Transmission status message, the last data file name mentioned is used for the last thread

200529007 V. Description of the invention (9) Notify the thread to access the local database 2 (step sio2) The thread sets the data and its slot name to the sending state (step MM) I2 updates the flag of sending this data to "" in the local database 2 to indicate that this data is the second data (step sm). The main application records that the sending of / has been started, that is, +1 is calculated. , Where 丄 is a count variable (step si〇: when the thread starts the current data and its file name is the sending state of step si0, the database update module 12 updates the current data mark (while step si〇4) , This thread immediately starts HTTP to input this data and its name f to the remote database server 3 (step s106). After the data is transferred and uploaded, the main application releases this thread, that is, (I = i — i 7 in step S107). Then the main application judges whether i < = n, one of the fixed values, which means that each time the main application reads continuously in a certain preset gate, Data to start the number of threads to avoid two Two or more threads connected to the local database 2 caused the system performance to decrease to 20 ... (step si〇8). If ... it means that within this time = the main application program has reached the preset number of threads to start the thread within that time The main application waits for a period of time and then reads the data to be sent 5109); If i < n, it means that the main application has not yet reached the preset number of startup threads within the time interval ^, then the main application ^ ^ Whether there are any data marked with " 〇 ,, in the local f library 2 (step S110). If there is data marked with "〇" in the local database 2, the data in the local database 2 There is still no data to be sent. In step S101, the main application continues to read data from the local database.

Page 14 200529007

V. Description of the invention (10) The data marked as "0" and its file name, and a new process is restarted; if there is no data marked as "" 〇" in the local database 2, the sharp is local The data to be sent in the database 2 has been sent, and the program is terminated. Please refer to the fifth figure, which is a flowchart of the multi-threaded data sending method of the present invention. ^ Start a thread to set this data and its file name to send: After step sm, the database update module 12 updates this data tag: S104), the thread tracking sub-module 132 immediately starts Ηττρ will The unread data and its data file name are transmitted to the remote database server step sm)-. When the remote database server 3 successfully receives this time. Data, the remote private database server state 3 to receive this time The data file name is returned to the local application server as the data transmission status, and the thread tracking sub-module fetches the returned data transmission status g. The data transmission wheel is described by the file name in π 軚There are two situations to indicate it. — The data transmission is successful, the other indicates that the data transmission has failed (step ^ ^. The thread queuing submodule 133 waits for the message of the name ^ ^ material file name issued by the last thread (step sm)) Determine whether to receive it, and step S203). If the thread queuing submodule 133 does not receive the message / =: 7, the process queuing submodule 133 continues to wait for the message of the name fmV broadcast case sent by the last thread ( Step S2 ° 2); If the thread queues the sub-module,-and 133 successfully receives the message, the thread tracking sub-module 132 judges that the data owed is lost (step S2 ° 4). If the data is not successfully transmitted this time "," Shell material database update module 1 2 in the local database 2

ll p. 15 200529007

V. Description of the invention (11) = new 〃 0 W: /% ..., the file name of the group u is used as a message to notify the next thread of the two people's library 2 to access the local database 2, such as update = f access to local resources' JS20 6); if this data transmission is Jm, etc. (stepping to complete the thread transfer this time, the data transfer execution step S206. Although the present invention is better with ##, ^ Invention. Any familiar disclosure such as, but it is not intended to limit the scope of the "applicable patents" attached, so the protection of the present invention has been defined within the scope of the test.

Page 16 200529007 Brief description of the diagram [Brief description of the diagram] The first diagram is a hardware architecture diagram of the multi-threaded data transmission system of the present invention. The second figure is a software function module diagram of the local application server of the multi-threaded data transmission system of the present invention. The third figure is a schematic diagram of the multi-threaded operation mechanism of the multi-threaded data transmission system of the present invention. The fourth figure is a main application program flow chart of the multi-threaded data sending method of the present invention. The fifth figure is a flow chart of each thread transmitting data in the multi-thread data sending method of the present invention. [Description of main components] Local application server 1 Data reading module 11 Database update module 12 Thread running module 13 Thread starting submodule 131 Thread tracking submodule 132 Thread queuing submodule 133 Thread notification submodule 134 Local database 2 Remote database server 3 Connection 4 Network 5

Page 17

Claims (1)

200529007 VI. Scope of patent application 1. A multi-threaded data transmission system, which can perform data transmission. The data transmission system includes a local application feeder, t, multi-line, and a remote database server, of which: The library one local application server is used to execute a main application thread to send data. The local application server ^ spoon 卩 = activates the first data read module is used to retrieve data from the local data two = one · file name; τ 5 The fetching data and one thread operation module are used to read a line for each time; the data transmission mode of the ::: data channel is tracked and recorded with the data transmission status of ϊ :: mr? The thread that establishes the connection queues and uses the data file name sent by this person as a message to inform the next team of threads waiting to access the local database; and a database update module is used to update the local database in the local database. Marking of the data sent by the Yuan_Cheng database server; The local shell database is used to store plural data and their corresponding file names and data tags; and Yuan ^ Bay database SERVER system for receiving transmitted to the shell material and ^ corresponding to the file name from the local application server, and returns the data file for data transfer to the local application state temple wheel SERVER. • The multi-threaded sending data system described in item 1 of the patent scope, the thread running module of 2 also includes a thread starting sub-module, which is used to read the data. Each time the module reads a piece of data, p starts a thread, and submits the data read this time, its file name, and the name of the above file on the 18th page. 3 · The multi-threaded sending data system described in item 1 of Shenyan's patent scope, the thread running module further includes a thread and vertical sub-module, which is used to start HTTP The data submitted to the thread and its case name are transmitted to the remote database server, the data transmission status in the thread is tracked, and the information of the data transfer status returned from the remote database server is received . 4 · The multi-threaded sending data system described in item 1 of the scope of the patent application, the thread running module further includes a thread queuing sub-module, which is used when a plurality of threads access the local database Threads that need to establish a connection are queued. • The multi-threaded sending data system described in Item 1 of the patent scope, the thread running module also includes a thread notification sub-module, which is used to send the sent data file. The name is used as a message to inform other queued threads to access the local database. 6 · According to the multi-threaded data transmission system described in item 丨 of the patent application scope, the transmission method of the plural data channel refers to a transmission method in which plural threads are simultaneously started to transmit multiple data in parallel. 7. A multi-line = data sending method is used to send data through a local application server: a local database and a remote database server. The multi-threaded data sending method includes the following steps: Local application server Start a main application; the main application reads a piece of data to be sent and the corresponding podcast name in the local database, which is the title of this data and its file name; eight 200529007 The main application granularity is the data to be read, and the name of the read data is submitted to the thread; a thread is started, which is called the name of the current thread and its slot case, and the last data slot case. The data and the main application are marked locally in the thread; the slot case name is placed in the sending state; the database is updated to send the current data. The main application reads multiple pieces of data continuously and starts one for each piece of data read. New thread; 1. This thread starts HTTP to transmit this data and its file name to the remote database server; 'Track and record each thread while transmitting data, and use messages to inform other threads between multiple lines and private Access the local database; When the current thread finishes transmitting the data, the main application releases the resources occupied by the thread; and determines whether the data to be sent has been sent. 8 · According to the multi-threaded data sending method described in item 7 of the scope of the patent application, the method for determining whether the data to be sent has been sent further includes the steps: if the data to be sent has not been sent, the main application program reads it cyclically The next data to be sent, and restart a new thread to continue sending the data to the remote database server until the data to be sent has been sent. 9 · According to the multi-threaded data sending method described in item 8 of the scope of the patent application, the main application program cyclically reads the data to be sent and restarts the thread. The method further includes steps: the main application program needs to wait for a period of time in the local database Page 20 _ I 200529007 VI. The scope of patent application read the information to be sent. 1 〇 · As mentioned in item 7 of the scope of the patent application, the name of this data building as described in item 11 is used as a method to access the information in the local database, knowing the next-return to the local application server This time: 22 :: Serving: Device description The last data slot case name is used to access the local database when the last time mentioned. ^ 夭 本-人 线 申 "profit scope item 7: The multi-threaded local application server has one and only one execution of the main + side ^ The cycle starts multiple threads to transmit multiple data. Wang Gongyi 13. If applied The multi-threaded data sending method described in item 7 of the patent scope, which describes how to start HTTp transmission of data for each thread. * 2 Jingbei 4 tracks and records, and uses a data notification database among multiple threads. It also includes the steps as follows: 1. The thread asks the current thread to initiate HTTP to transmit the data and its file name to the database server; ^ 4 S returns a data transmission status to the local application server; receives the returned data transmission Status; waiting for the message sent by the last thread; judging whether the message was received; if the message was successfully received, the above-mentioned returned data transmission status is recorded in the local database; and the thread sends a message to notify the next queue waiting Need to connect local resources 200529007 6. Scope of patent application The threads of the material library access the local database. 14. According to the method for transmitting data by each thread of the multi-thread sending data described in item 13 of the scope of the patent application, the method for determining whether to receive the message further includes the step of: if the message is not received, then the original The secondary thread continues to wait for the message. 1 5. According to the method for transmitting data by each thread of the multi-thread sending data described in the scope of the patent application, the returned data transmission status refers to the name of the current data file sent by this thread. 16 · According to the method of transmitting data between threads by multi-thread sending data described in item 13 of the scope of the patent application, the message sent by the last thread refers to the last data file name sent by the last thread. The alum information sent by this thread refers to the name of the data file sent by this thread cake. Page 22