CN109491797A - Date storage method, system and computer readable storage medium - Google Patents
Date storage method, system and computer readable storage medium Download PDFInfo
- Publication number
- CN109491797A CN109491797A CN201811417785.7A CN201811417785A CN109491797A CN 109491797 A CN109491797 A CN 109491797A CN 201811417785 A CN201811417785 A CN 201811417785A CN 109491797 A CN109491797 A CN 109491797A
- Authority
- CN
- China
- Prior art keywords
- service server
- message
- server
- preset
- file destination
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/505—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
- G06F9/5072—Grid computing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/508—Monitor
Abstract
The embodiment of the invention discloses a kind of date storage method, system and computer readable storage mediums.The described method includes: data-message is added in message queue by distribution server if receiving the data-message of user terminal transmission；Distribution server judges whether the load of service server is less than preset load threshold；If the load of service server is less than preset load threshold, distribution server obtains data-message as target data message from message queue and is sent to service server；Service server obtains file destination according to target data message；The format of file destination is converted to preset standardized format by service server；File destination after service server converts format is stored in preset database.Method by implementing the embodiment of the present invention may make the transmission process of user terminal data to reach pseudo- real-time state, improve the usage experience of user；And it can avoid the load too high of service server and service server caused to be paralysed.
Description
Technical field
The present invention relates to technical field of data transmission more particularly to a kind of date storage methods, system and computer-readable
Storage medium.
Background technique
Cloud storage be in the conceptive extension of cloud computing (cloud computing) and a new concept developed,
It is a kind of emerging Network storage technology, refers to through functions such as cluster application, network technology or distributed file systems, by net
A large amount of various types of storage equipment gather collaborative work by application software in network, and the common data that externally provide are deposited
The system of storage and business access function.
During the realization of cloud storage, terminal needs that local file to be stored is uploaded to server in advance.It is existing
In technology, in such a way that data direct transfer, i.e., file is directly uploaded to service server by terminal, and is stored in by service server
Database.Since the traffic handing capacity of service server is limited, when portfolio is larger, on the one hand, service server may
It can collapse, and business is caused to be paralysed；On the other hand the uploading speed that will lead to terminal is limited, and seriously affected user uses body
It tests.
Summary of the invention
The embodiment of the invention provides a kind of date storage method, device, computer equipment and storage mediums, it is intended to solve
Lead to the problem that service server collapses and user's uploading speed is limited since portfolio is excessive.
In a first aspect, the method is applied to data storage system the embodiment of the invention provides a kind of date storage method
In system, the data-storage system includes distribution server and service server, which comprises
If receiving the data-message of user terminal transmission, the data-message is added to message by the distribution server
In queue；
The distribution server judges whether the load of the service server is less than preset load threshold；
If the load of the service server is less than preset load threshold, the distribution server is from the message queue
Middle acquisition data-message is sent to the service server as target data message；
The service server obtains file destination according to the target data message；
The format of the file destination is converted to preset standardized format by the service server；
File destination after the service server converts format is stored in preset database.
Second aspect, the embodiment of the invention also provides a kind of data-storage system, the data-storage system includes point
With server and service server, the distribution server includes that adding unit, the first judging unit and the first transmission are single
Member, the service server include first acquisition unit, converting unit and storage element, in which:
Adding unit, if the data-message for receiving user terminal transmission, the distribution server is by the data
Message is added in message queue；
First judging unit, for the distribution server judge the service server load whether be less than it is preset
Load threshold；
First transmission unit, if the load for the service server is less than preset load threshold, the distribution clothes
Business device obtains data-message as target data message from the message queue and is sent to the service server；
First acquisition unit, for obtaining file destination according to the target data message；
Converting unit, for the format of the file destination to be converted to preset standardized format；
Storage element is stored in preset database for the file destination after converting format.
The third aspect, the embodiment of the invention also provides a kind of data-storage system, the data-storage system includes point
With server and service server, the distribution server and service server include memory, processor and are stored in
On the memory and the computer program that can run on the processor, the place of the distribution server and service server
Reason device realizes method as described in relation to the first aspect jointly when executing corresponding computer program.
Fourth aspect, the embodiment of the invention also provides a kind of computer readable storage medium, the storage medium storage
There is computer program, the computer program can realize method described in first aspect when being executed by a processor.
By the technical solution of the application embodiment of the present invention, distribution server disappears in the data for receiving user terminal transmission
When breath, first the data-message is added in message queue, which can quickly finish, so that the biography of user terminal data
Defeated process reaches pseudo- real-time state, improves the usage experience of user.Only it is less than in the load of service server preset
When load threshold, distribution server just distributes target data message to service server, so as to avoid the negative of service server
It carries excessively high and service server is caused to be paralysed.By formatting to file destination, the unification of data format is realized, just
In being safeguarded and managed to data.
Detailed description of the invention
Technical solution in order to illustrate the embodiments of the present invention more clearly, below will be to needed in embodiment description
Attached drawing is briefly described, it should be apparent that, drawings in the following description are some embodiments of the invention, general for this field
For logical technical staff, without creative efforts, it is also possible to obtain other drawings based on these drawings.
Fig. 1 is a kind of application scenarios schematic diagram of date storage method provided in an embodiment of the present invention；
Fig. 2 is a kind of flow diagram of date storage method provided in an embodiment of the present invention；
Fig. 3 is a kind of sub-process schematic diagram of date storage method provided in an embodiment of the present invention；
Fig. 4 is a kind of sub-process schematic diagram of date storage method provided in an embodiment of the present invention；
Fig. 5 is a kind of sub-process schematic diagram of date storage method provided in an embodiment of the present invention；
Fig. 6 is a kind of sub-process schematic diagram of date storage method provided in an embodiment of the present invention；
Fig. 7 is a kind of sub-process schematic diagram of date storage method provided in an embodiment of the present invention；
Fig. 8 be another embodiment of the present invention provides a kind of date storage method flow diagram；
Fig. 9 is a kind of schematic block diagram of data-storage system provided in an embodiment of the present invention；
Figure 10 is the schematic block diagram of the first judging unit of distribution server in Fig. 9；
Figure 11 is the schematic block diagram of the first transmission unit of distribution server in Fig. 9；
Figure 12 is the schematic block diagram of the first acquisition unit of service server in Fig. 9；
Figure 13 is the schematic block diagram of the converting unit of service server in Fig. 9；
Figure 14 is the schematic block diagram of the first split cells of the converting unit of service server in Fig. 9；
Figure 15 be another embodiment of the present invention provides a kind of data-storage system schematic block diagram；And
Figure 16 is a kind of schematic block diagram of computer equipment provided in an embodiment of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair
Embodiment in bright, every other implementation obtained by those of ordinary skill in the art without making creative efforts
Example, shall fall within the protection scope of the present invention.
It should be appreciated that ought use in this specification and in the appended claims, term " includes " and "comprising" instruction
Described feature, entirety, step, operation, the presence of element and/or component, but one or more of the other feature, whole is not precluded
Body, step, operation, the presence or addition of element, component and/or its set.
It is also understood that mesh of the term used in this description of the invention merely for the sake of description specific embodiment
And be not intended to limit the present invention.As description of the invention and it is used in the attached claims, unless on
Other situations are hereafter clearly indicated, otherwise " one " of singular, "one" and "the" are intended to include plural form.
It will be further appreciated that the term "and/or" used in description of the invention and the appended claims is
Refer to any combination and all possible combinations of one or more of associated item listed, and including these combinations.
As used in this specification and in the appended claims, term " if " can be according to context quilt
Be construed to " when ... " or " once " or " in response to determination " or " in response to detecting ".Similarly, phrase " if it is determined that " or
" if detecting [described condition or event] " can be interpreted to mean according to context " once it is determined that " or " in response to true
It is fixed " or " once detecting [described condition or event] " or " in response to detecting [described condition or event] ".
Fig. 1 and Fig. 2 are please referred to, Fig. 1 is the application scenarios schematic diagram of date storage method provided in an embodiment of the present invention.Figure
2 be the schematic flow chart of date storage method provided in an embodiment of the present invention.Date storage method application proposed by the present invention
In data-storage system, data-storage system includes distribution server 80 and service server 90.If receiving user's end
The data-message uploaded is held, data-message is added in message queue by distribution server 80；Distribution server 80 judges business
Whether the load of server 90 is less than preset load threshold；If the load of service server 90 is less than preset load threshold,
Distribution server 80 obtains data-message as target data message from message queue and is sent to service server 90；Business clothes
The format of target data message is converted to preset standardized format by business device 90；Service server 90 format is converted after mesh
Data-message is marked to be stored in preset database.
It should be noted that in embodiments of the present invention, data-storage system includes an at least service server 90, industry
The quantity of business server 90 can be determined according to the actual conditions of portfolio.
Fig. 2 is the flow diagram of date storage method provided in an embodiment of the present invention.As shown, this method include with
Lower step S1-S5.
If the data-message is added to by S1, the data-message for receiving user terminal transmission, the distribution server
In message queue.
In embodiments of the present invention, data-message is sent to distribution server by user terminal, rather than is transmitted directly to
Service terminal.The data-message is first added to and disappears when receiving the data-message of user terminal transmission by distribution server
It ceases in queue.
Message queue is the container that message is saved in the transmission process of message.Message queue by message from its source
It acts as an intermediary when to its target.The main purpose of message queue is to provide routing and guarantees the transmitting of message；If hair
Recipient is unavailable when sending message, message queue meeting reservation message, until can successfully transmit message.
In embodiments of the present invention, distribution server, first will be described when receiving the data-message of user terminal transmission
Data-message is added in message queue, which can quickly finish, so that the transmission process of user terminal data reaches pseudo-
Real-time state improves the usage experience of user.
S2, distribution server judge whether the load of the service server is less than preset load threshold.
In specific implementation, distribution server judges whether the load of the service server is less than preset load threshold.
It should be noted that load threshold can be set by those skilled in the art according to the actual conditions of service server.
If the load of service server is less than preset load threshold, illustrate that the load of service server is smaller, business
Server is in idle condition；Anyway, then illustrate that the load of service server is larger, service server is in a busy state.
In one embodiment, following steps S21-S24 is specifically included referring to Fig. 3, above step S2.
S21, the distribution server receive the load information that the service server uploads.
Wherein, the load information includes the portfolio of the service server.
In specific implementation, service server uploads the load of itself at interval of preset time (such as 5s) to distribution server
Information.Correspondingly, distribution server receives the load information that the service server uploads.The load information includes the industry
The portfolio of business server.
S22, the distribution server judge whether the portfolio of the service server is less than preset traffic volume threshold.
In specific implementation, distribution server judges whether the portfolio of the service server is less than preset portfolio threshold
Value.It should be noted that traffic volume threshold can be set by those skilled in the art according to the actual conditions of service server.
For example, in one embodiment, traffic volume threshold is set as 500.
S23, if the portfolio of the service server is less than preset traffic volume threshold, the distribution server determines institute
The load for stating service server is less than preset load threshold.
In specific implementation, if the portfolio of the service server is less than preset traffic volume threshold, the distribution clothes
Business device determines that the load of the service server is less than preset load threshold.
S24, if the portfolio of the service server is not less than preset traffic volume threshold, the distribution server determines
The load of the service server is not less than preset load threshold.
In specific implementation, if the portfolio of the service server is not less than preset traffic volume threshold, the distribution
Server determines the load of the service server not less than preset load threshold.
If the load of S3, the service server is less than preset load threshold, the distribution server is from the message
Data-message, which is obtained, as target data message in queue is sent to the service server.
In specific implementation, if the load of service server is less than preset load threshold, distribution server is from message team
Data-message, which is obtained, as target data message in column is sent to service server.
In the embodiment of the present invention, only when the load of service server is less than preset load threshold, distribution server
Just target data message is distributed to service server；When the load of service server is not less than preset load threshold, distribution
Server suspend to service server distribute target data message, so as to avoid service server load too high and lead to industry
Business servers go down.
In one embodiment, referring to fig. 4, above step S3 specifically comprises the following steps S31-S32.
S31, distribution server determine the corresponding user terminal of the service server according to preset corresponding relationship.
In specific implementation, the corresponding relationship of service server and user terminal is set in distribution server in advance, then
The corresponding user terminal of service server is determined according to the corresponding relationship.It should be noted that the corresponding user of service server
Terminal is the terminal in service server compass of competency.
In one embodiment, corresponding relationship is the mapping table of service server and user terminal.
S32, distribution server obtain described in the data-message conduct of the corresponding user terminal uploads of the service server
Target data message is sent to the service server.
In specific implementation, distribution server obtains the data-message of the corresponding user terminal uploads of service server as institute
It states target data message and is sent to the service server.
In the above manner, can be realized the business service transferred to the data of user terminal in service terminal region
Device processing, improves the efficiency of business processing.
S4, service server obtain file destination according to the target data message.
In specific implementation, service server will obtain mesh according to target data message after receiving target data message
Mark file.It should be noted that user is whole in the present solution, file destination is not directly uploaded to distribution server by user terminal
It holds to distribution server and sends data-message, data-message is used to indicate the acquisition modes of file destination.Service server as a result,
File destination can be obtained according to the target data message.
In an embodiment, target data message includes download address, which is the mesh uploaded needed for user terminal
Mark the download address of file.Referring to Fig. 5, above step S4 specifically comprises the following steps S41-S42.
S41, service server parse the target data message to obtain the download address in the target data message.
In specific implementation, service server is parsed target data message to obtain the downloading in target data message
Address, the download address are the download address of file destination.
S42, service server obtain the file destination according to the download address in the target data message.
In specific implementation, service server is according to the download address downloading object file in target data message.If downloading
Failure (fails) as caused by the reasons such as network error, then automatically into retry mechanism, i.e., again according to target data message package
The download address downloading object file included.If the number retried is more than preset threshold value (for example, threshold value is 10 times), have not yet been downloaded
File destination success, then service server returns to error confirmation message to distribution server, again should by distribution server
Target data message distributes to other servers.
The format of the file destination is converted to preset standardized format by S5, service server.
In specific implementation, for service server when getting file destination, service server is by the lattice of the file destination
Formula is converted to preset standardized format.Since there may be difference for the format of file of different types of terminals, by walking above
Rapid S5 can unify the format of the file of different types of terminals, convenient for the centralized management of data.
In one embodiment, specifically comprise the following steps S51-S52 referring to Fig. 6, above step S5:
The file destination is split as multiple file fields by S51, service server.
In specific implementation, data-message includes multiple file fields, each text for the data-message that different terminal equipment uploads
The sequence of part field may be different.In the present solution, file destination is split as multiple file fields first by service server.
In one embodiment, specifically comprise the following steps S511-S512 referring to Fig. 7, above step S51:
S511, service server obtain the position of each preset separator of the file destination.
In specific implementation, by preset separators between each file field of data-message, in one embodiment, point
It is "/" every according with.Service server scans the position for obtaining each preset separator of file destination first.
The file destination is split as multiple files using the position of each separator as boundary by S512, service server
Field.
In specific implementation, the file destination is split as more by service server using the position of each separator as boundary
A file field.
S52, service server adjust the sequence of each file field according to preset order with by the file destination
Format is converted to preset standardized format.
In specific implementation, after file destination is split as multiple file fields, service server is according to preset order tune
The sequence of whole each file field is to be converted to preset standardized format for the format of the file destination.
For example, in one embodiment, file destination is contact person's file, and contact person's file includes name field, electricity
Talk about field, home address field and company field.Preset order may be set to: name field → phone field → home address
Field → company field.
File destination after S6, the service server convert format is stored in preset database.
In specific implementation, after the format of file destination is converted to preset standardized format, service server is by lattice
File destination after formula conversion is stored in preset database.
By the technical solution of the application embodiment of the present invention, distribution server disappears in the data for receiving user terminal transmission
When breath, first the data-message is added in message queue, which can quickly finish, so that the biography of user terminal data
Defeated process reaches pseudo- real-time state, improves the usage experience of user.Only it is less than in the load of service server preset
When load threshold, distribution server just distributes target data message to service server, so as to avoid the negative of service server
It carries excessively high and service server is caused to be paralysed.By formatting to file destination, the unification of data format is realized, just
In being safeguarded and managed to data.
Fig. 8 be another embodiment of the present invention provides a kind of date storage method flow diagram.As shown in figure 8, this
The date storage method of embodiment includes step S81-S88.The wherein step S1-S6 in step S81-S86 and above-described embodiment
Similar, details are not described herein.The following detailed description of in the present embodiment increase step S87-S88.
If S87, getting the file destination, the service server is replied message to distribution server confirmation.
In specific implementation, when getting file destination, service server is replied message to distribution server confirmation immediately.
It should be noted that in the prior art, message consumer's (service server in this programme) is to Message Processing
Just confirmation is sent to server after the completion to reply message.And in the present solution, getting file destination constantly, service server
It is replied message immediately to distribution server confirmation.
If S88, receiving the confirmation that the service server is sent and replying message, the distribution server is by the target
Data-message is removed from the message queue.
In specific implementation, if the confirmation for receiving service server transmission replies message, distribution server is by the target
Data-message is removed from the message queue, excessive so as to avoid the data-message in message queue, improves distribution clothes
The treatment effeciency of business device.
Fig. 9 is a kind of schematic block diagram of data-storage system 100 provided in an embodiment of the present invention.As shown in figure 9, corresponding
In above data storage method, the present invention also provides a kind of data-storage systems 100.The data-storage system 100 includes being used for
Execute the unit of above-mentioned date storage method.Specifically, referring to Fig. 9, the data-storage system 100 includes distribution server 80
And service server 90.Distribution server 80 includes adding unit 81, the first judging unit 82 and the first transmission unit 83,
The service server 90 includes first acquisition unit 91, converting unit 92 and storage element 93, in which:
Adding unit 81, if the data-message for receiving user terminal transmission, the distribution server 80 will be described
Data-message is added in message queue；
First judging unit 82 judges whether the load of the service server 90 is less than for the distribution server 80
Preset load threshold；
First transmission unit 83, if for the service server 90 load be less than preset load threshold, described point
Data-message is obtained from the message queue as target data message with server 80 is sent to the service server 90；
First acquisition unit 91, for obtaining file destination according to the target data message；
Converting unit 92, for the format of the file destination to be converted to preset standardized format；
Storage element 93 is stored in preset database for the file destination after converting format.
In one embodiment, as shown in Figure 10, first judging unit 82 includes that the judgement of receiving unit 821, second is single
Member 822 and judging unit 823.
Receiving unit 821, the load information uploaded for receiving the service server 90, the load information includes institute
State the portfolio of service server 90；
Second judgment unit 822, for judging whether the portfolio of the service server 90 is less than preset portfolio
Threshold value；
Judging unit 823 determines institute if the portfolio for the service server 90 is less than preset traffic volume threshold
The load for stating service server 90 is less than preset load threshold.
In one embodiment, as shown in figure 11, the first transmission unit 83 includes determination unit 831 and the second transmission unit
832。
Determination unit 831, for determining the corresponding user terminal of the service server 90 according to preset corresponding relationship；
Second transmission unit 832, for obtaining the data-message of the corresponding user terminal uploads of the service server 90
The service server 90 is sent to as the target data message.
In one embodiment, the target data message includes download address, as shown in figure 12, the first acquisition unit
91 include resolution unit 911 and download unit 912.
Resolution unit 911, for parsing the target data message with obtaining the downloading in the target data message
Location；
Download unit 912, for obtaining the file destination according to the download address in the target data message.
In one embodiment, as shown in figure 13, converting unit 92 includes the first split cells 921 and adjustment unit 922.
First split cells 921, for the file destination to be split as multiple file fields；
Adjustment unit 922, for adjusting the sequence of each file field according to preset order with by the file destination
Format be converted to preset standardized format.
In one embodiment, as shown in figure 14, the first split cells 921 includes that second acquisition unit 9211 and second are torn open
Sub-unit 9212.
Second acquisition unit 9211, the position of each preset separator for obtaining the file destination.
Second split cells 9212 is more for being split as the file destination using the position of each separator as boundary
A file field.
In one embodiment, as shown in figure 15, the distribution server 80 further includes removing unit 84, the business service
Device 90 further includes the second transmission unit 94.
Second transmission unit 94, if for getting the file destination, the transmission of Xiang Suoshu distribution server 80 confirms back
Multiple message；
Unit 84 is removed, if replying message for receiving the confirmation that the service server 90 is sent, by the target
Data-message is removed from the message queue.
It should be noted that it is apparent to those skilled in the art that, above-mentioned 100 He of data-storage system
The specific implementation process of each unit can refer to the corresponding description in preceding method embodiment, for convenience of description and succinctly,
Details are not described herein.
The embodiment of the present invention also proposes that a kind of data-storage system, the data-storage system include at least two computers
Equipment, including a distribution server and an at least service server.Figure 16 is please referred to, Figure 16 is the embodiment of the present application
There is provided a kind of computer equipment schematic block diagram, the computer equipment can be distribution server or service server,
Hardware configuration is identical.Refering to fig. 16, which includes the processor 502 connected by system bus 501, storage
Device and network interface 505, wherein memory may include non-volatile memory medium 503 and built-in storage 504.
The non-volatile memory medium 503 can storage program area 5031 and computer program 5032.
The processor 502 is for providing calculating and control ability, to support the operation of entire computer equipment 500.
The built-in storage 504 provides environment for the operation of the computer program 5032 in non-volatile memory medium 503.
The network interface 505 is used to carry out network communication with other equipment.It will be understood by those skilled in the art that in Figure 16
The structure shown, only the block diagram of part-structure relevant to application scheme, does not constitute and is applied to application scheme
The restriction of computer equipment 500 thereon, specific computer equipment 500 may include more more or fewer than as shown in the figure
Component perhaps combines certain components or with different component layouts.
Wherein, the processor 502 of the distribution server and service server is stored in respective memory for running
Computer program 5032, to realize following steps jointly:
If receiving the data-message of user terminal transmission, the data-message is added to message by the distribution server
In queue；
The distribution server judges whether the load of the service server is less than preset load threshold；
If the load of the service server is less than preset load threshold, the distribution server is from the message queue
Middle acquisition data-message is sent to the service server as target data message；
The service server obtains file destination according to the target data message；
The format of the file destination is converted to preset standardized format by the service server；
File destination after the service server converts format is stored in preset database.
In one embodiment, the processor 502 of the distribution server is realizing the load for judging the service server
When whether being less than preset load threshold step, it is implemented as follows step:
The distribution server receives the load information that the service server uploads, and the load information includes the industry
The portfolio of business server；
The distribution server judges whether the portfolio of the service server is less than preset traffic volume threshold；
If the portfolio of the service server is less than preset traffic volume threshold, the distribution server determines the industry
The load of business server is less than preset load threshold.
In one embodiment, the processor 502 of the distribution server is realizing the distribution server from the message
When acquisition data-message is sent to the service server step as target data message in queue, it is implemented as follows step
It is rapid:
The distribution server determines the corresponding user terminal of the service server according to preset corresponding relationship；
Described in the data-message that the distribution server obtains the corresponding user terminal uploads of the service server is used as
Target data message is sent to the service server.
In one embodiment, the processor 502 of the service server is realizing that the target data message includes downloading
Address is implemented as follows step when the service server obtains file destination step according to the target data message:
The service server parses the target data message to obtain the download address in the target data message；
The service server obtains the file destination according to the download address in the target data message.
In one embodiment, the processor 502 of the service server is realizing the service server by the target
When the format of file is converted to preset standardized format step, it is implemented as follows step:
The file destination is split as multiple file fields by the service server；
The service server adjusts the sequence of each file field according to preset order with by the file destination
Format is converted to preset standardized format.
In one embodiment, the processor 502 of the service server is realizing the service server by the target
When file declustering is multiple file field steps, it is implemented as follows step:
The service server obtains the position of each preset separator of the file destination；
The file destination is split as multiple files using the position of each separator as boundary by the service server
Field.
In one embodiment, the processor 502 of the service server also realizes following steps:
If getting the file destination, the service server sends confirmation to the distribution server and replies message.
In one embodiment, the processor 502 of the distribution server also realizes following steps:
It is replied message if receiving the confirmation that the service server is sent, the distribution server is by the target data
Message is removed from the message queue.
It should be appreciated that in the embodiment of the present application, processor 502 can be central processing unit (Central
Processing Unit, CPU), which can also be other general processors, digital signal processor (Digital
Signal Processor, DSP), specific integrated circuit (Application Specific Integrated Circuit,
ASIC), ready-made programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic
Device, discrete gate or transistor logic, discrete hardware components etc..Wherein, general processor can be microprocessor or
Person's processor is also possible to any conventional processor etc..
Those of ordinary skill in the art will appreciate that be realize above-described embodiment method in all or part of the process,
It is that relevant hardware can be instructed to complete by computer program.The computer program can be stored at least two storages Jie
In matter, which is computer readable storage medium.The computer program is by least two in the computer system
It manages device to execute, to realize the process step of the embodiment of the above method jointly.
Therefore, the present invention also provides a kind of storage mediums.The storage medium can be computer readable storage medium.This is deposited
Storage media is stored with computer program.The computer program makes processor execute following step when being executed by least two processors
It is rapid:
If receiving the data-message of user terminal transmission, the data-message is added to message by the distribution server
In queue；
The distribution server judges whether the load of the service server is less than preset load threshold；
If the load of the service server is less than preset load threshold, the distribution server is from the message queue
Middle acquisition data-message is sent to the service server as target data message；
The service server obtains file destination according to the target data message；
The format of the file destination is converted to preset standardized format by the service server；
File destination after the service server converts format is stored in preset database.
In one embodiment, the processor realizes the distribution server and judges institute in the execution computer program
When stating the load of service server and whether being less than preset load threshold step, it is implemented as follows step:
The distribution server receives the load information that the service server uploads, and the load information includes the industry
The portfolio of business server；
The distribution server judges whether the portfolio of the service server is less than preset traffic volume threshold；
If the portfolio of the service server is less than preset traffic volume threshold, the distribution server determines the industry
The load of business server is less than preset load threshold.
In one embodiment, the distribution server obtains data-message from the message queue and disappears as target data
The step of breath is sent to the service server, specifically comprises the following steps:
The distribution server determines the corresponding user terminal of the service server according to preset corresponding relationship；
Described in the data-message that the distribution server obtains the corresponding user terminal uploads of the service server is used as
Target data message is sent to the service server.
In one embodiment, the target data message includes download address, and the service server is according to the target
Data-message obtains the step of file destination, specifically comprises the following steps:
The service server parses the target data message to obtain the download address in the target data message；
The service server obtains the file destination according to the download address in the target data message.
In one embodiment, the format of the file destination is converted to preset standardized format by the service server
The step of, specifically comprise the following steps:
The file destination is split as multiple file fields by the service server；
The service server adjusts the sequence of each file field according to preset order with by the file destination
Format is converted to preset standardized format.
In one embodiment, the step of file destination is split as multiple file fields by the service server, tool
Body includes the following steps:
The service server obtains the position of each preset separator of the file destination；
The file destination is split as multiple files using the position of each separator as boundary by the service server
Field.
In one embodiment, processor is made also to execute following step when which is executed by least two processors
It is rapid:
If getting the file destination, the service server sends confirmation to the distribution server and replies message；
It is replied message if receiving the confirmation that the service server is sent, the distribution server is by the target data
Message is removed from the message queue.
The storage medium can be USB flash disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), magnetic disk
Or the various computer readable storage mediums that can store program code such as CD.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure
Member and algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware
With the interchangeability of software, each exemplary composition and step are generally described according to function in the above description.This
A little functions are implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Specially
Industry technical staff can use different methods to achieve the described function each specific application, but this realization is not
It is considered as beyond the scope of this invention.
In several embodiments provided by the present invention, it should be understood that disclosed device and method can pass through it
Its mode is realized.For example, the apparatus embodiments described above are merely exemplary.For example, the division of each unit, only
Only a kind of logical function partition, there may be another division manner in actual implementation.Such as multiple units or components can be tied
Another system is closed or is desirably integrated into, or some features can be ignored or not executed.
The steps in the embodiment of the present invention can be sequentially adjusted, merged and deleted according to actual needs.This hair
Unit in bright embodiment device can be combined, divided and deleted according to actual needs.In addition, in each implementation of the present invention
Each functional unit in example can integrate in one processing unit, is also possible to each unit and physically exists alone, can also be with
It is that two or more units are integrated in one unit.
If the integrated unit is realized in the form of SFU software functional unit and when sold or used as an independent product,
It can store in one storage medium.Based on this understanding, technical solution of the present invention is substantially in other words to existing skill
The all or part of part or the technical solution that art contributes can be embodied in the form of software products, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a
People's computer, terminal or network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, is not described in some embodiment
Part, reference can be made to the related descriptions of other embodiments.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art
Mind and range.In this way, the even these modifications and changes of the present invention range that belongs to the claims in the present invention and its equivalent technologies
Within, then the present invention is also intended to include these modifications and variations.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can readily occur in various equivalent modifications or replace
It changes, these modifications or substitutions should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be with right
It is required that protection scope subject to.
Claims (10)
1. a kind of date storage method, which is characterized in that the method is applied in data-storage system, data storage system
System includes distribution server and service server, which comprises
If receiving the data-message of user terminal transmission, the data-message is added to message queue by the distribution server
In；
The distribution server judges whether the load of the service server is less than preset load threshold；
If the load of the service server is less than preset load threshold, the distribution server is obtained from the message queue
Data-message is taken to be sent to the service server as target data message；
The service server obtains file destination according to the target data message；
The format of the file destination is converted to preset standardized format by the service server；
File destination after the service server converts format is stored in preset database.
2. the method according to claim 1, wherein the distribution server judges the negative of the service server
It carries and whether is less than preset load threshold, comprising:
The distribution server receives the load information that the service server uploads, and the load information includes the business clothes
The portfolio of business device；
The distribution server judges whether the portfolio of the service server is less than preset traffic volume threshold；
If the portfolio of the service server is less than preset traffic volume threshold, the distribution server determines the business clothes
The load of business device is less than preset load threshold.
3. the method according to claim 1, wherein the distribution server obtains number from the message queue
The service server is sent to as target data message according to message, comprising:
The distribution server determines the corresponding user terminal of the service server according to preset corresponding relationship；
The distribution server obtains the data-message of the corresponding user terminal uploads of the service server as the target
Data-message is sent to the service server.
4. the method according to claim 1, wherein the target data message includes download address, the industry
Server be engaged according to target data message acquisition file destination, comprising:
The service server parses the target data message to obtain the download address in the target data message；
The service server obtains the file destination according to the download address in the target data message.
5. the method according to claim 1, wherein the service server turns the format of the file destination
It is changed to preset standardized format, comprising:
The file destination is split as multiple file fields by the service server；
The service server adjusts the sequence of each file field according to preset order with by the format of the file destination
Be converted to preset standardized format.
6. according to the method described in claim 5, it is characterized in that, the service server file destination is split as it is more
A file field, comprising:
The service server obtains the position of each preset separator of the file destination；
The file destination is split as multiple file fields using the position of each separator as boundary by the service server.
7. the method according to claim 1, wherein the method also includes:
If getting the file destination, the service server sends confirmation to the distribution server and replies message；
It is replied message if receiving the confirmation that the service server is sent, the distribution server is by the target data message
It is removed from the message queue.
8. a kind of data-storage system, which is characterized in that the data-storage system includes distribution server and business service
Device, the distribution server include adding unit, the first judging unit and the first transmission unit, and the service server includes
First acquisition unit, converting unit and storage element, in which:
Adding unit, if the data-message for receiving user terminal transmission, the distribution server is by the data-message
It is added in message queue；
First judging unit judges whether the load of the service server is less than preset load for the distribution server
Threshold value；
First transmission unit, if the load for the service server is less than preset load threshold, the distribution server
Data-message, which is obtained, as target data message from the message queue is sent to the service server；
First acquisition unit, for obtaining file destination according to the target data message；
Converting unit, for the format of the file destination to be converted to preset standardized format；
Storage element is stored in preset database for the file destination after converting format.
9. a kind of data-storage system, which is characterized in that including distribution server and service server, the distribution server
Include memory, processor with service server and is stored in the meter that can be run on the memory and on the processor
It is realized jointly when the processor of calculation machine program, the distribution server and service server executes corresponding computer program as weighed
Benefit requires method described in any one of 1-7.
10. a kind of storage medium, which is characterized in that the storage medium is stored with computer program, and the computer program is worked as
The processor is set to execute such as method of any of claims 1-7 when being executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811417785.7A CN109491797A (en) | 2018-11-26 | 2018-11-26 | Date storage method, system and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811417785.7A CN109491797A (en) | 2018-11-26 | 2018-11-26 | Date storage method, system and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109491797A true CN109491797A (en) | 2019-03-19 |
Family
ID=65696735
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811417785.7A Pending CN109491797A (en) | 2018-11-26 | 2018-11-26 | Date storage method, system and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109491797A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110209502A (en) * | 2019-06-05 | 2019-09-06 | 北京奇艺世纪科技有限公司 | A kind of information storage means, device, electronic equipment and storage medium |
| CN110825693A (en) * | 2019-10-25 | 2020-02-21 | 武汉联影医疗科技有限公司 | Medical data storage method, device and readable storage medium |
| CN110955640A (en) * | 2019-11-26 | 2020-04-03 | 深圳市卡牛科技有限公司 | Cross-system data file processing method, device, server and storage medium |
| CN111221789A (en) * | 2019-12-27 | 2020-06-02 | 中国人民财产保险股份有限公司深圳市分公司 | Processing method and device for querying big data by group users |
| CN111400059A (en) * | 2020-03-09 | 2020-07-10 | 五八有限公司 | Data processing method and data processing device |
| CN111444160A (en) * | 2020-03-31 | 2020-07-24 | 南京领行科技股份有限公司 | Data storage system and uploading and storing method, device, equipment and medium |
| CN111813973A (en) * | 2020-05-18 | 2020-10-23 | 冠群信息技术(南京)有限公司 | License conversion method and system |
| CN111967855A (en) * | 2020-08-27 | 2020-11-20 | 吉林亿联银行股份有限公司 | Method, device and equipment for processing service data and computer readable storage medium |
| CN112256649A (en) * | 2020-09-24 | 2021-01-22 | 南阳柯丽尔科技有限公司 | Medical file storage method and device |
| CN112733491A (en) * | 2020-12-31 | 2021-04-30 | 北京乐学帮网络技术有限公司 | Data conversion method and device, computer equipment and storage medium |
| CN112948474A (en) * | 2019-12-11 | 2021-06-11 | 深圳云天励飞技术有限公司 | Data export method, device, equipment and computer readable storage medium |
| CN114125066A (en) * | 2021-01-15 | 2022-03-01 | 北京京东乾石科技有限公司 | Method and device for processing service request |
| CN115297122A (en) * | 2022-09-29 | 2022-11-04 | 数字江西科技有限公司 | Government affair operation and maintenance method and system based on load automatic monitoring |
| CN110955640B (en) * | 2019-11-26 | 2024-04-23 | 深圳市卡牛科技有限公司 | Cross-system data file processing method, device, server and storage medium |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060155633A1 (en) * | 2005-01-12 | 2006-07-13 | International Business Machines Corporation | Automatically distributing a bid request for a grid job to multiple grid providers and analyzing responses to select a winning grid provider |
| US7353277B1 (en) * | 2000-11-14 | 2008-04-01 | Hewlett-Packard Development Company, L.P. | Dynamic load balancing of video requests |
| CN101754056A (en) * | 2008-12-17 | 2010-06-23 | 中国科学院自动化研究所 | Digital content inventory management system supporting automatic mass data processing and the method thereof |
| CN101795211A (en) * | 2010-01-13 | 2010-08-04 | 北京中创信测科技股份有限公司 | Data storage method and system |
| CN101916298A (en) * | 2010-08-31 | 2010-12-15 | 深圳市赫迪威信息技术有限公司 | Database operation method, apparatus and system |
| CN102170396A (en) * | 2011-05-06 | 2011-08-31 | 浙江大学 | QoS control method of cloud storage system based on differentiated service |
| CN102299959A (en) * | 2011-08-22 | 2011-12-28 | 北京邮电大学 | Load balance realizing method of database cluster system and device |
| CN103095853A (en) * | 2013-02-27 | 2013-05-08 | 北京航空航天大学 | Cloud data center calculation capacity management system |
| US20140281604A1 (en) * | 2013-03-15 | 2014-09-18 | Charles Robert Martin | Autonomous Power Sparing Storage |
| CN104391737A (en) * | 2014-12-15 | 2015-03-04 | 成都英力拓信息技术有限公司 | Method for optimizing load balance in cloud platform |
| CN104125254B (en) * | 2013-04-27 | 2017-10-13 | 博雅网络游戏开发（深圳）有限公司 | Obtain the method and system of platform user data |
| CN107786593A (en) * | 2016-08-25 | 2018-03-09 | 阿里巴巴集团控股有限公司 | Task deployment method, example deployment method, apparatus and equipment |
| CN108829897A (en) * | 2018-07-03 | 2018-11-16 | 沈文策 | Date storage method and data-storage system |
-
2018
- 2018-11-26 CN CN201811417785.7A patent/CN109491797A/en active Pending
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7353277B1 (en) * | 2000-11-14 | 2008-04-01 | Hewlett-Packard Development Company, L.P. | Dynamic load balancing of video requests |
| US20060155633A1 (en) * | 2005-01-12 | 2006-07-13 | International Business Machines Corporation | Automatically distributing a bid request for a grid job to multiple grid providers and analyzing responses to select a winning grid provider |
| CN101754056A (en) * | 2008-12-17 | 2010-06-23 | 中国科学院自动化研究所 | Digital content inventory management system supporting automatic mass data processing and the method thereof |
| CN101795211A (en) * | 2010-01-13 | 2010-08-04 | 北京中创信测科技股份有限公司 | Data storage method and system |
| CN101916298A (en) * | 2010-08-31 | 2010-12-15 | 深圳市赫迪威信息技术有限公司 | Database operation method, apparatus and system |
| CN102170396A (en) * | 2011-05-06 | 2011-08-31 | 浙江大学 | QoS control method of cloud storage system based on differentiated service |
| CN102299959A (en) * | 2011-08-22 | 2011-12-28 | 北京邮电大学 | Load balance realizing method of database cluster system and device |
| CN103095853A (en) * | 2013-02-27 | 2013-05-08 | 北京航空航天大学 | Cloud data center calculation capacity management system |
| US20140281604A1 (en) * | 2013-03-15 | 2014-09-18 | Charles Robert Martin | Autonomous Power Sparing Storage |
| CN104125254B (en) * | 2013-04-27 | 2017-10-13 | 博雅网络游戏开发（深圳）有限公司 | Obtain the method and system of platform user data |
| CN104391737A (en) * | 2014-12-15 | 2015-03-04 | 成都英力拓信息技术有限公司 | Method for optimizing load balance in cloud platform |
| CN107786593A (en) * | 2016-08-25 | 2018-03-09 | 阿里巴巴集团控股有限公司 | Task deployment method, example deployment method, apparatus and equipment |
| CN108829897A (en) * | 2018-07-03 | 2018-11-16 | 沈文策 | Date storage method and data-storage system |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110209502A (en) * | 2019-06-05 | 2019-09-06 | 北京奇艺世纪科技有限公司 | A kind of information storage means, device, electronic equipment and storage medium |
| CN110825693A (en) * | 2019-10-25 | 2020-02-21 | 武汉联影医疗科技有限公司 | Medical data storage method, device and readable storage medium |
| CN110955640A (en) * | 2019-11-26 | 2020-04-03 | 深圳市卡牛科技有限公司 | Cross-system data file processing method, device, server and storage medium |
| CN110955640B (en) * | 2019-11-26 | 2024-04-23 | 深圳市卡牛科技有限公司 | Cross-system data file processing method, device, server and storage medium |
| CN112948474A (en) * | 2019-12-11 | 2021-06-11 | 深圳云天励飞技术有限公司 | Data export method, device, equipment and computer readable storage medium |
| CN112948474B (en) * | 2019-12-11 | 2024-01-05 | 深圳云天励飞技术有限公司 | Data export method, device, equipment and computer readable storage medium |
| CN111221789A (en) * | 2019-12-27 | 2020-06-02 | 中国人民财产保险股份有限公司深圳市分公司 | Processing method and device for querying big data by group users |
| CN111221789B (en) * | 2019-12-27 | 2023-09-12 | 中国人民财产保险股份有限公司深圳市分公司 | Method and device for processing big data of group user query |
| CN111400059A (en) * | 2020-03-09 | 2020-07-10 | 五八有限公司 | Data processing method and data processing device |
| CN111400059B (en) * | 2020-03-09 | 2023-11-14 | 五八有限公司 | Data processing method and data processing device |
| CN111444160B (en) * | 2020-03-31 | 2022-06-07 | 南京领行科技股份有限公司 | Data storage system and uploading and storing method, device, equipment and medium |
| CN111444160A (en) * | 2020-03-31 | 2020-07-24 | 南京领行科技股份有限公司 | Data storage system and uploading and storing method, device, equipment and medium |
| CN111813973A (en) * | 2020-05-18 | 2020-10-23 | 冠群信息技术(南京)有限公司 | License conversion method and system |
| CN111967855A (en) * | 2020-08-27 | 2020-11-20 | 吉林亿联银行股份有限公司 | Method, device and equipment for processing service data and computer readable storage medium |
| CN112256649A (en) * | 2020-09-24 | 2021-01-22 | 南阳柯丽尔科技有限公司 | Medical file storage method and device |
| CN112733491A (en) * | 2020-12-31 | 2021-04-30 | 北京乐学帮网络技术有限公司 | Data conversion method and device, computer equipment and storage medium |
| CN114125066A (en) * | 2021-01-15 | 2022-03-01 | 北京京东乾石科技有限公司 | Method and device for processing service request |
| CN115297122A (en) * | 2022-09-29 | 2022-11-04 | 数字江西科技有限公司 | Government affair operation and maintenance method and system based on load automatic monitoring |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109491797A (en) | Date storage method, system and computer readable storage medium | |
| CN109451002B (en) | CDN node selection method and equipment | |
| CN110365748B (en) | Service data processing method and device, storage medium and electronic device | |
| JP2018503319A (en) | Method and apparatus for NFV management and orchestration | |
| WO2019038684A1 (en) | Server request management | |
| US20140143427A1 (en) | Providing Resources in a Cloud | |
| US9961525B2 (en) | Communication system | |
| CN110233881A (en) | Service request processing method, device, equipment and storage medium | |
| CN109831524A (en) | A kind of load balance process method and device | |
| CN104901989A (en) | Field service providing system and method | |
| CN105554125B (en) | A kind of method and its system for realizing webpage fit using CDN | |
| CN114338650A (en) | File transmission method and device, electronic equipment and readable storage medium | |
| CN112584398B (en) | Data processing method, device and storage medium | |
| CN102036188B (en) | Mail proxy method, equipment and system under multi-node system | |
| CN115277598A (en) | Computing resource scheduling method and device and computer readable storage medium | |
| US9537735B2 (en) | Data collection method, mobile terminal and data storage device | |
| CN106790354B (en) | Communication method and device for preventing data congestion | |
| CN112714146B (en) | Resource scheduling method, device, equipment and computer readable storage medium | |
| CN108540546B (en) | Network node access control method, electronic device, network system, and storage medium | |
| CN111669322A (en) | Relay bridging method and gateway | |
| US20180349190A1 (en) | Process control program, process control method, information processing device, and communication device | |
| US10122812B2 (en) | Push-type information transmission device, push-type information transmission method, and program | |
| CN110391880A (en) | Access request processing method and equipment based on terminal-server framework | |
| CN114071149B (en) | Distributed video transcoding method and related device | |
| CN110442455A (en) | A kind of data processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190319 |