CN110300191A - Service system and data processing method - Google Patents
Service system and data processing method Download PDFInfo
- Publication number
- CN110300191A CN110300191A CN201910687660.4A CN201910687660A CN110300191A CN 110300191 A CN110300191 A CN 110300191A CN 201910687660 A CN201910687660 A CN 201910687660A CN 110300191 A CN110300191 A CN 110300191A
- Authority
- CN
- China
- Prior art keywords
- data
- service layer
- layer
- acquisition system
- data acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0896—Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Application provides a kind of service system and data processing method, is related to field of cloud computer technology.Service system includes: basic service layer, platform services layer, software services layer, terminal service layer.Terminal service layer includes terminal device；Terminal device is when handling data acquisition system, and when carrying out handling the amount of required first network resource to data acquisition system more than or equal to specified threshold, application software for being provided by platform services layer according to software services layer some or all of calls in the second Internet resources processing data acquisition system of basic service layer data, can improve the problem that cloud service system edge resource does not cooperate with and causes data-handling efficiency low.
Description
Technical field
The present invention relates to field of cloud computer technology, in particular to a kind of service system and data processing method.
Background technique
With the development of big data technology, cloud service system progresses into the work of people, in life.Cloud service system
Framework generally includes cloud computing and cloud storage.Cloud computing refers generally to distributed computing, is arranged by the data center of various regions and is calculated
Machine server cluster provides different applications for user by network.Cloud storage is similar with cloud computing, refers generally to distribution and deposits
Storage beyond the clouds by user data storage avoids storing using local resource, achievees the purpose that strange land uses and strange land stores.Mesh
Before, cloud service system has that edge resource does not cooperate with and causes data-handling efficiency low.
Summary of the invention
The application provides a kind of service system and data processing method, can improve cloud service system edge resource and not cooperate with
And the problem for causing data-handling efficiency low.
To achieve the goals above, technical solution provided by the embodiment of the present application is as follows:
In a first aspect, the embodiment of the present application provides a kind of service system, the service system includes: basic service layer, puts down
Platform service layer, software services layer, terminal service layer, the terminal service layer includes terminal device；The terminal device is in logarithm
When being handled according to set, and carry out handling the amount of required first network resource to the data acquisition system more than or equal to specified
When threshold value, for calling the infrastructure service according to the application software that the software services layer provides by the platform services layer
Data some or all of in the second Internet resources processing data acquisition system of layer.
In the above-described embodiment, it is greater than by the amount of first network resource needed for handling data acquisition system in terminal device
Or be equal to specified threshold when, call basic service layer the second Internet resources handle data acquisition system in some or all of data,
Can improve terminal device processing data pressure it is big, cloud service system edge resource does not cooperate with and causes data-handling efficiency low
Problem.
With reference to first aspect, in some alternative embodiments, the terminal device includes: the first cloud side collaboration mould
Block, for judging whether the amount of the first network resource is greater than or equal to the specified threshold；First resource scheduler module is used
When determining that the amount of the first network resource is greater than or equal to the specified threshold in first cloud side cooperative module, pass through
The application software that the software services layer provides from the basic service layer call the terminal service layer needed for network
Resource is some or all of to handle in the data acquisition system data.
In the above-described embodiment, real by the first cloud side cooperative module in terminal device, first resource scheduler module
The scheduling of the Internet resources of existing basic service layer facilitates the pressure for mitigating terminal device processing data.
With reference to first aspect, in some alternative embodiments, the platform services layer includes: the second cloud side collaboration mould
Block, for judging whether the amount of the first network resource is greater than or equal to the specified threshold；Secondary resource scheduler module is used
When determining that the amount of the first network resource is greater than or equal to the specified threshold in second cloud side cooperative module, pass through
The application software that the software services layer provides from the basic service layer call the terminal service layer needed for network
Resource is some or all of to handle in the data acquisition system data.
In the above-described embodiment, pass through the first cloud side cooperative module in platform services layer, first resource scheduler module
The scheduling of the Internet resources of optimized integration service layer facilitates the pressure for mitigating terminal device processing data.
With reference to first aspect, in some alternative embodiments, determine the amount of the first network resource be greater than or
When equal to the specified threshold, it is more than that the specified threshold is corresponding that the terminal device, which is also used to separate from the data acquisition system,
Partial data, and the partial data is sent to the basic service layer；The basic service layer is used for the part
Data are handled, and are sent to the terminal device for the processing result that the partial data obtains is handled.
In the above-described embodiment, it is handled by the way that the partial data in data acquisition system is sent to basic service layer,
Help to improve the efficiency of processing data acquisition system.
With reference to first aspect, in some alternative embodiments, big in the amount of the determination first network resource
When the specified threshold, the terminal device is also used to the data acquisition system being sent to the basic service layer；
The basic service layer is sent out for handling the data acquisition system, and by the processing result that the data acquisition system obtains is handled
It send to the terminal device.
In the above-described embodiment, it is handled by the way that the total data in data acquisition system is sent to basic service layer,
The Internet resources that terminal device itself can be improved are unable to satisfy processing data acquisition system, and extend the duration of processing data acquisition system,
The problem of data acquisition system can not even being handled.
With reference to first aspect, in some alternative embodiments, the first resource scheduler module is also used to: described
There are a plurality of candidates to connect network with the basic service layer for terminal service layer, and determines the terminal service layer and the basis
The current connection network of service layer is chosen a connection network from a plurality of candidate connection network and is made there are when network congestion
For new current connection network.
In the above-described embodiment, in network congestion, by select new connection network using as terminal service layer with
The new current network of basic service layer can be improved the reliability that data are transmitted in terminal service layer and basic service layer
And efficiency.
With reference to first aspect, in some alternative embodiments, the service system further includes data service layer, is used for
Target data is acquired according to the network that the basic service layer provides, according to the content of the target data to the target data
Classification, and sorted target data is stored in the basic service layer.
In the above-described embodiment, by the target data classification to acquisition, and sorted data are stored, side
Just discrete data are managed collectively, facilitate the subsequent data to acquisition and shares.
Second aspect, the application also provide a kind of data processing method, applied to above-mentioned service system, the method packet
It includes:
When the terminal device handles data acquisition system, the terminal device or platform services layer judgement pair
Whether the amount that the data acquisition system handle required first network resource is greater than or equal to specified threshold；
When the amount of the first network resource is greater than or equal to the specified threshold, the terminal device passes through described flat
Platform service layer calls the second Internet resources of the basic service layer to handle according to the application software that the software services layer provides
Data some or all of in the data acquisition system.
In conjunction with second aspect, in some alternative embodiments, the terminal device passes through the platform services layer root
The second Internet resources of the basic service layer are called to handle the data set according to the application software that the software services layer provides
Data some or all of in conjunction, comprising:
It is more than the corresponding partial data of the specified threshold that the terminal device is separated from the data acquisition system, and by institute
It states partial data and is sent to the basic service layer, second network being called for the basic service layer according to itself
Resource handles the partial data；
Alternatively, the data acquisition system is sent to the basic service layer by the terminal device, for the infrastructure service
Layer is handled the data acquisition system according to second Internet resources that itself is called.
In conjunction with second aspect, in some alternative embodiments, the method also includes:
Data service layer in the service system acquires target data, root according to the network that the basic service layer provides
Classify according to the content of the target data to the target data, and sorted target data is stored in the infrastructure service
Layer.
Detailed description of the invention
Technical solution in ord to more clearly illustrate embodiments of the present application, below will be to needed in the embodiment attached
Figure is briefly described.It should be appreciated that the following drawings illustrates only some embodiments of the application, therefore it is not construed as pair
The restriction of range for those of ordinary skill in the art without creative efforts, can also be according to this
A little attached drawings obtain other relevant attached drawings.
Fig. 1 is one of the block diagram of service system provided by the embodiments of the present application.
Fig. 2 is the two of the block diagram of service system provided by the embodiments of the present application.
Fig. 3 is one of the flow diagram of data processing method provided by the embodiments of the present application.
Fig. 4 is the two of the flow diagram of data processing method provided by the embodiments of the present application.
Icon: 10- service system；100- basic service layer；200- data service layer；210- data acquisition module；220-
Data fusion module；300- platform services layer；The second cloud of 310- side cooperative module；320- Secondary resource scheduler module；400- is soft
Part service layer；500- terminal service layer；510- terminal device；The first cloud of 511- side cooperative module；512- first resource dispatches mould
Block.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application is described.It needs
It is noted that term " first ", " second " etc. are only used for distinguishing description, it is not understood to indicate or imply relatively important
Property.
Fig. 1 is please referred to, the embodiment of the present application provides a kind of service system 10, which is properly termed as holostrome grade clothes
Business system (Full Layer Service, FLS), can be applied to the clouds such as cloud computing, big data, artificial intelligence, edge calculations
Service system framework.Service system 10 may include basic service layer 100, platform services layer 300, software services layer 400, terminal
Service layer 500.Certainly, which can also include data service layer 200.
When dividing according to cloud and marginal end to each service layer, basic service layer 100, is put down at data service layer 200
Platform service layer 300, software services layer 400 can form cloud；Terminal service layer 500 may include at least one terminal device
510 to form marginal end.
Terminal device 510 carries out data acquisition system to handle required first network when handling data acquisition system
The application when amount of resource is greater than or equal to specified threshold, for being provided by platform services layer 300 according to software services layer 400
Data some or all of in the second Internet resources processing data acquisition system of software transfer basic service layer 100.
In the present embodiment, terminal device 510, can be to needed for processing data acquisition system when handling data acquisition system
The amount of first network resource detected.When the amount of required first network resource is greater than or equal to specified threshold, terminal
The data that some or all of Internet resources can be called to handle in data acquisition system from basic service layer 100 of equipment 510, so that base
Plinth service layer 100 can cooperate with processing data acquisition system with 510 layers of terminal device.
Alternatively, terminal device 510 is when handling data acquisition system, it can be by platform services layer 300 to terminal device
The amount of first network resource needed for 510 processing data acquisition systems is detected.Be greater than when the amount of required first network resource or
When equal to specified threshold, platform services layer 300 can call Internet resources to handle in data acquisition system from basic service layer 100
Part or all of data, so that basic service layer 100 can cooperate with processing data acquisition system with 510 layers of terminal device.
Wherein, it includes but is not limited to carry out at operation to data acquisition system that terminal device 510, which handles the mode of data acquisition system,
Reason carries out storage processing to data acquisition system, carries out network transmission processing etc. to data acquisition system.
The amount of required first network resource can be but not limited to: operand needed for operational data set, storage number
According to memory capacity needed for set, the described occupied bandwidth of data acquisition system of transmission etc..Specified threshold can be according to the actual situation
It is configured, can be determined according to the maximum of the corresponding Internet resources of 510 maximum processing capability of terminal device.For example, referring to
Determine threshold value can for this maximum amount of 70% or 80% or 90%.
For example, required first network resource is the calculation resources of terminal device 510, specified threshold can set for the terminal
The 70% or 80% or 90% of standby 510 maximum operand.Certainly, which is also possible to be less than other of maximum operand
Value, is not especially limited here.
For example, required first network resource is the storage resource of terminal device 510, specified threshold can set for the terminal
The 70% or 80% or 90% of standby 510 maximum storage capacities.Certainly, which is also possible to less than maximum storage capacity
Other values are not especially limited here.
For example, required first network resource is the network bandwidth resources of terminal device 510, specified threshold can be the end
The 70% or 80% or 90% of 510 maximum network bandwidth of end equipment.Certainly, which is also possible to be less than maximum network band
Wide other values, are not especially limited here.
Data acquisition system includes but is not limited to the data acquisition systems such as document, image, audio, video, and certainly, data acquisition system can also be with
It is the set of other forms data, for example is the data such as table, character, log, function, the type of data acquisition system is not made here
It is specific to limit.
In existing cloud service system, usually led in marginal end (referring to terminal service layer 500) excess load processing data acquisition system
When marginal end being caused to break down, the Internet resources of cloud (can refer to basic service layer 100) are just called, so that marginal end handles number
According to pressure it is big, and low efficiency.That is, the Internet resources of marginal end can not be cooperateed with quickly with the Internet resources at cloud center.
In the above embodiment of the application, the money of the first network needed for terminal device 510 handles data acquisition system
The amount in source is greater than or equal to specified threshold, usually indicates that the pressure of the processing data acquisition system of terminal device 510 is larger, at this point, passing through
The Internet resources of basic service layer 100 are called to assist terminal device 510 to handle data acquisition system, can reduce terminal device 510
Data processing pressure, improve to the efficiency of data processing, improve the problem of cloud service system edge resource does not cooperate with.
Terminal device 510 may be, but not limited to, server, PC (personal computer, PC), plate
Computer, personal digital assistant (personal digital assistant, PDA), mobile internet surfing equipment (mobile
Internet device, MID) etc..
In the present embodiment, basic service layer 100 may include multiple servers, alternatively, basic service layer 100 is service
Device cluster can provide computing resource, storage resource.Server may include processing module, memory module and communication module.Place
Reason module, memory module are directly or indirectly electrically connected between each element of communication module, to realize the transmission or friendship of data
Mutually.It is electrically connected for example, these elements can be realized between each other by one or more communication bus or signal wire.
Processing module can be a kind of IC chip, the processing capacity with signal.Above-mentioned processing module can be
General processor.For example, the processor can be central processing unit (Central Processing Unit, CPU), at figure
Manage device (Graphics Processing Unit, GPU), network processing unit (Network Processor, NP) etc.；It can be with
It is digital signal processor (Digital Signal Processing, DSP), specific integrated circuit (Application
Specific Integrated Circuit, ASIC), field programmable gate array (Field-Programmable Gate
Array, FPGA) either other programmable logic device, discrete gate or transistor logic, discrete hardware components, it can be with
Realize or execute disclosed each method, step and the logic diagram in the embodiment of the present application.
Memory module may be, but not limited to, random access memory, read-only memory, and programmable read only memory can
Erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory etc..In the present embodiment, memory module can be used for
Storing data set.Certainly, memory module can be also used for storage program, and processing module executes after receiving and executing instruction
The program.
Communication module is used to build the communication connection of basic service layer 100 Yu terminal service layer 500 by network, and passes through net
Network sending and receiving data.Network can be cable network, wireless network etc..For example, communication module can use router, wired network
Network, wireless network, optical cable carry out data transmission, and can be data meter by computing resource, the storage resource connection in server
It calculates, storage, transmission offer infrastructure service.
In the present embodiment, software services layer 400 can provide application for the terminal device 510 in terminal service layer 500
Software.For example, may include that the corresponding intelligent terminal of personal rank (is properly termed as universal intelligent end in terminal service layer 500
End), then it may include the application software of personal rank in software services layer 400, the application software and universal intelligent terminal match
It closes, for universal intelligent terminal service.
In another example may include that the corresponding intelligent terminal of enterprise level (is properly termed as special intelligent in terminal service layer 500
Terminal), then it may include the application software of enterprise level, the application software and special purpose intelligent terminal phase in software services layer 400
Cooperation, for special purpose intelligent terminal service.
Referring to figure 2., in the present embodiment, data service layer 200 may include data acquisition module 210 and data fusion
Module 220.The network that data acquisition module 210 is used to be provided according to the basic service layer 100 acquires target data；Data are melted
Molding block 220 deposits sorted target data for being classified according to the content of the target data to the target data
It is stored in the basic service layer 100.
In the present embodiment, data service layer 200 can acquire target data according to the actual situation, and target data is usually
Multi-source heterogeneous data in network, the including but not limited to data such as text, picture, audio, video.For example, data service layer 200
Target data can be acquired according to the type of the preset data for needing to acquire；Or the default of data is acquired as needed
Period acquires target data in preset period of time, and the mode for acquiring target data to data service layer 200 here does not limit specifically
It is fixed.
Understandably, multi-source heterogeneous data can be from including internet, local area network different network type data source
The data such as text, audio, video, image.For example, in the acquisition of network public-opinion data, collecting network data, data acquisition
Module 210 can acquire the unstructured datas such as text, webpage, video in internet using web crawlers in real time；This
The data of earth mat (local area network) carry out real time data using ETL (Extract-Transform-Load, extraction-conversion-load)
The convergence of acquisition and historical data, and then realize the acquisition and convergence of multi-source heterogeneous data.
Data fusion module 220 can use computer readable storage medium (such as the hard disk, magnetic of basic service layer 100
Disk etc.) storage data collected.In storing data, can be divided in storage medium according to internal network and external network
Two storage regions carry out partitioned storage to the multi-source heterogeneous data of internal network, external network respectively.Wherein, directly exposure
The network of domain internet is external network, is isolated via safety equipments such as firewall, gateways, carries out the local of security protection and uses
Network is internal network.
Data fusion module 220 can use the modes such as natural language understanding, data mark and mark to the data of acquisition
Labelization.Labeling can be regarded as: according to data source, carrying out the data source mark of coarseness, can use and manually mark
Note mode；In internet data source, the natural language understanding with deep learning can be used, data are segmented, is embedding
The machine learning step such as enter, cluster, according to the content of data to data classification, realizing data label.To local network data,
It can use manual mark, natural language understanding mode carries out the different classes of labeling of data.
In addition, data fusion module 220 can also carry out knowledge architecture to sorted data, in order to intuitively to adopting
The data of collection, which are managed, checks.Carrying out knowledge architecture to sorted data can be regarded as: using deep learning model, to mark
Data after labelization, carry out entity, attribute, relationship extraction, foundation<entity, relationship, entity>triple, using Neo4j,
The databases such as MySQL carry out knowledge store, realize the creation of knowledge architecture or data directory, in order to being indexed to data or
Management.
Wherein, Neo4j is a kind of graphic data base, structural data can be stored on network rather than in table.
MySQL is a kind of relational database management system, and relational database saves the data in different tables, rather than by all numbers
According to being placed in one big warehouse, which adds the speed of data processing and flexibility is improved.Based on basic service layer 100
Data calculate, storage, transfer function can be to discrete using the acquisition of data service layer 200, classification storage, fusion function
Information carries out unification, carries out coordinated management convenient for the Internet resources to basic service layer 100, terminal service layer 500, improves because of letter
It ceases discrete and is not easy to the problem of coordinated management is carried out to the Internet resources of basic service layer 100, terminal service layer 500.
Understandably, for platform, software, terminal, fused data are transparent, that is, refer to platform, soft
Part, terminal are not necessarily to know source, the storage location, scale of construction details of data.It, can be from fusion when there is the demand for obtaining data
Corresponding data are obtained in data afterwards, can realize in this way different software, platform, terminal log evidence shared demand.
In the present embodiment, terminal device 510 may include the first cloud edge cooperative module, first resource scheduler module
512。
First cloud collaborative strategy when cooperative module 511 can be by cloud assists the Internet resources of cloud and marginal end
With distribution.Cloud side collaborative strategy carries out the distribution of resource according to cloud and marginal end to task real-time and cost of consumed resource.
May include marginal end calculative strategy and beyond the clouds task unloading strategy.When the high (reality of calculating task requirement of real-time
The height of when property can be determined according to the actual situation, for example can be determined according to the type of processing data.For example, face
Identification verifying may belong to the high task of requirement of real-time, and deep learning model training may belong to requirement of real-time lower
Business), it is big to be transferred to time delay after the processing of cloud (can be more than setting duration for time delay, which can be according to the actual situation
It is configured) when, the marginal end calculative strategy cooperateed with using cloud side is calculated and is locally completed in marginal end, and requirement of real-time is not high
Storage completed by cloud.The high task of requirement of real-time may include recognition of face, OCR (Optical Character
Recognition, optical character identification) identification.
When calculating task requirement of real-time is not high, marginal end can not provide calculating, storage resource enough, assisted using cloud side
Same cloud task unloads strategy.That is, the task that marginal end will calculate, memory requirement is high, goes back to cloud by network transmission, by cloud
End provides a large amount of calculating and store function completion processing, and result is finally back to marginal end, completes the meter to marginal end task
It calculates, storage, network guarantee, this generic task includes large-scale sensor Data Analysis Services, complicated video, voice, image, text
The training and optimization of model.
For example, the first cloud side cooperative module 511, can be used for judging whether the amount of first network resource is greater than or equal to finger
Determine threshold value.For example, whether operand needed for can be used for judging operational data set is greater than or equal to the specified threshold of operation；
Alternatively, whether memory capacity needed for can be used for judging storing data set is greater than or equal to the specified threshold of storage；Alternatively,
Whether bandwidth needed for can be used for judging transmitting data acquisition system is greater than or equal to the specified threshold of bandwidth.
First resource scheduler module 512 can be used for determining the amount of first network resource in the first cloud side cooperative module 511
When more than or equal to specified threshold, the application software provided by software services layer 400 calls terminal clothes from basic service layer 100
Internet resources needed for business layer 500 are some or all of to handle in data acquisition system data.
Understandably, if operand needed for operational data set is greater than or equal to the specified threshold of operation, first resource
The data that some or all of calculation resources can be called to handle in data acquisition system from basic service layer 100 of scheduler module 512.If
Memory capacity needed for storing data set is greater than or equal to the specified threshold of storage, and first resource scheduler module 512 can be from
Basic service layer 100 calls storage resource some or all of to carry out in storing data set data.
Optionally, the first resource scheduler module 512 can be also used for: in the terminal service layer 500 and the base
There are a plurality of candidate connection networks for plinth service layer 100, and determine the terminal service layer 500 and the basic service layer 100
Current connection network is chosen a connection network as new from a plurality of candidate connection network and is worked as there are when network congestion
Preceding connection network.
Wherein, the situation of network congestion can be to transmit data during transmitting data packet (or data acquisition system)
Network speed is less than or equal to specified network speed and duration is greater than specified duration, then it is assumed that network congestion occurs, at this point, first resource
Scheduler module 512 can select a network as terminal service layer 500 and basic service layer from a plurality of candidate connection network
100 new current network.Wherein, specify network speed that can be configured according to the actual situation with specified duration.
In the above-described embodiment, in network congestion, by selecting new connection network using as terminal service layer 500
With the new current network of basic service layer 100, it can be improved data and carried out in terminal service layer 500 and basic service layer 100
The reliability and efficiency of transmission improve the problem that network congestion causes data transmission efficiency low.
In the present embodiment, platform services layer 300 may include the second cloud side cooperative module 310 and Secondary resource scheduling mould
Block 320.
Second cloud side cooperative module 310, for judging whether the amount of the first network resource is greater than or equal to the finger
Determine threshold value.
Secondary resource scheduler module 320, for determining the first network resource in second cloud side cooperative module 310
Amount when being greater than or equal to the specified threshold, the application software provided by the software services layer 400 is from the base
Internet resources needed for the terminal service layer 500 calls in plinth service layer 100 are to handle part in the data acquisition system or complete
Portion's data.
Optionally, the Secondary resource scheduler module 320 can be also used for: in the terminal service layer 500 and the base
There are a plurality of candidate connection networks for plinth service layer 100, and determine the terminal service layer 500 and the basic service layer 100
Current connection network is chosen a connection network as new from a plurality of candidate connection network and is worked as there are when network congestion
Preceding connection network.
Understandably, the function of the second cloud cooperative module 511 in function and the first cloud of cooperative module 310
It is same or like；The function of Secondary resource scheduler module 320 and the function of first resource scheduler module 512 are similar
Seemingly, the other function effect of the second cloud side cooperative module 310, Secondary resource scheduler module 320 is referred to above-mentioned to the first cloud
The detailed description of side cooperative module 511, first resource scheduler module 512, which is not described herein again.
Optionally, platform services layer 300 can also include model library module, and model library module can use mold curing work
Tool carries out model encapsulation to functions such as data calculating, storage, transmission, data acquisition, data classification storage, data fusions, with branch
Support basic service layer 100, data service layer 200, platform services layer 300, software services layer 400, terminal service layer 500 model
It calls.
As an alternative embodiment, being greater than or equal to the specified threshold in the amount for determining the first network resource
When value, it is more than the corresponding partial data of the specified threshold that the terminal device 510, which is also used to separate from the data acquisition system,
And the partial data is sent to the basic service layer 100；The basic service layer 100 be used for the partial data into
Row processing, and the processing result that the partial data obtains will be handled and be sent to the terminal device 510.
Understandably, the amount (can be indicated with M) of the first network resource needed for handling data acquisition system is greater than or equal to
When specified threshold (can be indicated with N), terminal device 510 will can be more than the corresponding data of specified threshold in data acquisition system (should
The amount of the corresponding Internet resources of data can be indicated with P, and P=M-N) it is sent to cloud (basic service layer 100), by cloud pair
Data corresponding more than specified threshold are handled.Then by cloud, by treated, result is sent to terminal device 510 again.Its
In, the amount for the data that terminal device 510 is sent from data acquisition system can be the amount greater than P.
In the above-described embodiment, by the way that the partial data in data acquisition system is sent to basic service layer 100, by basis
The processing of service layer 100 and the common complete paired data set of terminal device 510, can be improved the efficiency to data processing.
For example, when the amount of the determination first network resource is greater than or equal to the specified threshold, the terminal
Equipment 510 is also used to for the data acquisition system to be sent to the basic service layer 100；The basic service layer 100 is used for institute
It states data acquisition system to be handled, and the processing result that the data acquisition system obtains will be handled and be sent to the terminal device 510.
In the above-described embodiment, by the way that the total data in data acquisition system is sent to basic service layer 100, by basis
Service layer 100 handles data acquisition system, and the Internet resources that can improve terminal device 510 itself are unable to satisfy processing number
The problem of according to set, and extending the duration of processing data acquisition system, or even data acquisition system can not being handled.
Referring to figure 3., the embodiment of the present application also provides a kind of data processing method, can be applied to above-mentioned service system
10, it is executed by service system 10 or each step of implementation method.The data processing method may include step S610 and step
S620。
Each step of data processing method will be described in detail below.
Step S610, when the terminal device 510 handles data acquisition system, the terminal device 510 or described
Platform services layer 300 judges whether the amount for carrying out handling required first network resource to the data acquisition system is greater than or equal to finger
Determine threshold value.
Step S620, when the amount of the first network resource is greater than or equal to the specified threshold, the terminal device
510 call the basic service layer according to the application software that the software services layer 400 provides by the platform services layer 300
Data some or all of in 100 the second Internet resources processing data acquisition system.
Step S620 may include: that the terminal device 510 is separated from the data acquisition system more than the specified threshold
Corresponding partial data, and the partial data is sent to the basic service layer 100, for the basic service layer 100
Second Internet resources being called according to itself handle the partial data.Alternatively, the terminal device 510 will
The data acquisition system is sent to the basic service layer 100, so that the basic service layer 100 is according to itself being called
Second Internet resources handle the data acquisition system.
Optionally, method can also include: that there are a plurality of with the basic service layer 100 in the terminal service layer 500
Candidate's connection network, and there are networks for the determining terminal service layer 500 and the current connection network of the basic service layer 100
When obstruction, first resource scheduler module 512 or Secondary resource scheduler module 320 choose one from a plurality of candidate connection network
Item connects network as new current connection network.
Referring to figure 4., data processing method can also include step S630.
Step S630, the net that the data service layer 200 in the service system 10 is provided according to the basic service layer 100
Network acquires target data, is classified according to the content of the target data to the target data, and by sorted target data
It is stored in the basic service layer 100.
It should be noted that it is apparent to those skilled in the art that, for convenience and simplicity of description, on
The specific work process of the data processing method of description is stated, it can be with reference to each service layer's alignment processing in aforementioned service system 10
Process no longer excessively repeats herein.
The embodiment of the present application also provides a kind of computer readable storage medium.Computer journey is stored in readable storage medium storing program for executing
Sequence, when computer program is run on computers, so that computer executes such as above-mentioned data processing side as described in the examples
Method.
Through the above description of the embodiments, those skilled in the art can be understood that the application can lead to
Hardware realization is crossed, the mode of necessary general hardware platform can also be added to realize by software, based on this understanding, this Shen
Technical solution please can be embodied in the form of software products, which can store in a non-volatile memories
In medium (can be CD-ROM, USB flash disk, mobile hard disk etc.), including some instructions are used so that a computer equipment (can be
Personal computer, server or network equipment etc.) execute method described in each implement scene of the application.
In conclusion the application provides a kind of service system and data processing method.Service system includes: infrastructure service
Layer, platform services layer, software services layer, terminal service layer, terminal service layer include terminal device；Terminal device is to data set
When conjunction is handled, and when the amount for handle required first network resource to data acquisition system is greater than or equal to specified threshold,
For being called at the second Internet resources of basic service layer by platform services layer according to the application software that software services layer provides
Data some or all of in reason data acquisition system.In this application, by being handled first needed for data acquisition system in terminal device
When the amount of Internet resources is greater than or equal to specified threshold, the second Internet resources of basic service layer is called to handle in data acquisition system
Part or all of data, can improve terminal device processing data pressure it is big, cloud service system edge resource does not cooperate with and causes
The low problem of data-handling efficiency.
In embodiment provided herein, it should be understood that disclosed devices, systems, and methods can also lead to
Other modes are crossed to realize.Devices, systems, and methods embodiment described above is only schematical, for example, in attached drawing
Flow chart and block diagram show that the system of multiple embodiments according to the application, the possibility of method and computer program product are real
Existing architecture, function and operation.In this regard, each box in flowchart or block diagram can represent module, a journey
A part of sequence section or code, a part of the module, section or code include one or more for realizing defined
The executable instruction of logic function.It should also be noted that in some implementations as replacement, function marked in the box
It can also occur in a different order than that indicated in the drawings.For example, two continuous boxes can actually be substantially in parallel
It executes, they can also be executed in the opposite order sometimes, and this depends on the function involved.It is also noted that block diagram and/
Or the combination of each box in flow chart and the box in block diagram and or flow chart, can with execute as defined in function or
The dedicated hardware based system of movement is realized, or can be realized using a combination of dedicated hardware and computer instructions.
In addition, each functional module in each embodiment of the application can integrate one independent part of formation together, it can also be with
It is modules individualism, an independent part can also be integrated to form with two or more modules.
The foregoing is merely preferred embodiment of the present application, are not intended to limit this application, for the skill of this field
For art personnel, various changes and changes are possible in this application.Within the spirit and principles of this application, made any to repair
Change, equivalent replacement, improvement etc., should be included within the scope of protection of this application.
Claims (10)
1. a kind of service system, which is characterized in that the service system includes: basic service layer, platform services layer, software service
Layer, terminal service layer, the terminal service layer includes terminal device；
The terminal device carries out the data acquisition system to handle required first network when handling data acquisition system
When the amount of resource is greater than or equal to specified threshold, for being answered by the platform services layer according to what the software services layer provided
Data some or all of in the second Internet resources processing data acquisition system of the basic service layer described in software transfer.
2. service system according to claim 1, which is characterized in that the terminal device includes:
First cloud side cooperative module, for judging whether the amount of the first network resource is greater than or equal to the specified threshold；
First resource scheduler module, for determined in first cloud side cooperative module amount of the first network resource be greater than or
When equal to the specified threshold, institute is called from the basic service layer by the application software that the software services layer provides
Internet resources needed for stating terminal service layer are some or all of to handle in the data acquisition system data.
3. service system according to claim 1, which is characterized in that the platform services layer includes:
Second cloud side cooperative module, for judging whether the amount of the first network resource is greater than or equal to the specified threshold；
Secondary resource scheduler module, for determined in second cloud side cooperative module amount of the first network resource be greater than or
When equal to the specified threshold, institute is called from the basic service layer by the application software that the software services layer provides
Internet resources needed for stating terminal service layer are some or all of to handle in the data acquisition system data.
4. service system according to claim 2 or 3, which is characterized in that big in the amount for determining the first network resource
When the specified threshold, it is more than the specified threshold that the terminal device, which is also used to separate from the data acquisition system,
Corresponding partial data, and the partial data is sent to the basic service layer；
The basic service layer is for handling the partial data, and the processing knot that will be handled the partial data and obtain
Fruit is sent to the terminal device.
5. service system according to claim 2 or 3, which is characterized in that in the determination first network resource
When amount is greater than or equal to the specified threshold, the terminal device is also used to the data acquisition system being sent to the infrastructure service
Layer；
The basic service layer is for handling the data acquisition system, and the processing knot that will be handled the data acquisition system and obtain
Fruit is sent to the terminal device.
6. service system according to claim 2, which is characterized in that the first resource scheduler module is also used to:
In the terminal service layer, there are a plurality of candidates to connect network with the basic service layer, and determines the terminal service layer
Current connection network with the basic service layer chooses one from a plurality of candidate connection network there are when network congestion
Network is connected as new current connection network.
7. service system according to claim 1, which is characterized in that the service system further includes data service layer, is used
Target data is acquired in the network provided according to the basic service layer, according to the content of the target data to the number of targets
The basic service layer is stored according to classification, and by sorted target data.
8. a kind of data processing method, which is characterized in that applied to the service system as described in any one of claim 1-7
System, which comprises
When the terminal device handles data acquisition system, the terminal device or the platform services layer judge to described
Whether the amount that data acquisition system handle required first network resource is greater than or equal to specified threshold；
When the amount of the first network resource is greater than or equal to the specified threshold, the terminal device is taken by the platform
Business layer according to the application software that the software services layer provides call the basic service layer the second Internet resources processing described in
Data some or all of in data acquisition system.
9. according to the method described in claim 8, it is characterized in that, the terminal device is by the platform services layer according to institute
The application software for stating software services layer offer calls the second Internet resources of the basic service layer to handle in the data acquisition system
Some or all of data, comprising:
It is more than the corresponding partial data of the specified threshold that the terminal device is separated from the data acquisition system, and by the portion
Divided data is sent to the basic service layer, second Internet resources being called for the basic service layer according to itself
The partial data is handled；
Alternatively, the data acquisition system is sent to the basic service layer by the terminal device, for the basic service layer root
Second Internet resources being called according to itself handle the data acquisition system.
10. according to the method described in claim 8, it is characterized in that, the method also includes:
Data service layer in the service system acquires target data according to the network that the basic service layer provides, according to institute
The content for stating target data classifies to the target data, and sorted target data is stored in the basic service layer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910687660.4A CN110300191A (en) | 2019-07-29 | 2019-07-29 | Service system and data processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910687660.4A CN110300191A (en) | 2019-07-29 | 2019-07-29 | Service system and data processing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110300191A true CN110300191A (en) | 2019-10-01 |
Family
ID=68032078
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910687660.4A Pending CN110300191A (en) | 2019-07-29 | 2019-07-29 | Service system and data processing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110300191A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111211991A (en) * | 2019-12-31 | 2020-05-29 | 联想(北京)有限公司 | Asset processing method, system and terminal equipment |
| CN111221973A (en) * | 2020-02-17 | 2020-06-02 | 河北冀联人力资源服务集团有限公司 | Occupational attribute identification method and system based on machine learning and edge calculation |
| CN111353477A (en) * | 2020-04-16 | 2020-06-30 | 银河水滴科技（北京）有限公司 | Gait recognition system and method |
| CN112367354A (en) * | 2020-10-09 | 2021-02-12 | 国网电力科学研究院有限公司 | Intelligent scheduling system and scheduling method for cloud-edge resource graph |
| CN112416570A (en) * | 2020-10-15 | 2021-02-26 | 北京旷视科技有限公司 | Picture stream access method and device, picture processing system and electronic equipment |
| CN112784014A (en) * | 2021-01-15 | 2021-05-11 | 中国核动力研究设计院 | Safe full-text retrieval system and method based on multi-source heterogeneous system |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103995738A (en) * | 2013-02-15 | 2014-08-20 | 三星电子株式会社 | Terminal apparatus, server, browser of terminal apparatus operating system and method of operating browser |
| CN106911762A (en) * | 2017-01-16 | 2017-06-30 | 西安电子科技大学 | A kind of framework calculated based on mist in SDN and its processing method |
| CN107959708A (en) * | 2017-10-24 | 2018-04-24 | 北京邮电大学 | A kind of car networking service collaboration computational methods and system based on high in the clouds-marginal end-car end |
| CN109151045A (en) * | 2018-09-07 | 2019-01-04 | 北京邮电大学 | A kind of distribution cloud system and monitoring method |
| CN109474681A (en) * | 2018-11-05 | 2019-03-15 | 安徽大学 | Resource allocation methods, system and the server system of mobile edge calculations server |
| CN109710381A (en) * | 2018-12-27 | 2019-05-03 | 北京联创信安科技股份有限公司 | High-performance calculation, big data, virtualization special container management system and method |
| CN109889599A (en) * | 2019-03-07 | 2019-06-14 | 北京邮电大学 | Data processing method and system |
-
2019
- 2019-07-29 CN CN201910687660.4A patent/CN110300191A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103995738A (en) * | 2013-02-15 | 2014-08-20 | 三星电子株式会社 | Terminal apparatus, server, browser of terminal apparatus operating system and method of operating browser |
| CN106911762A (en) * | 2017-01-16 | 2017-06-30 | 西安电子科技大学 | A kind of framework calculated based on mist in SDN and its processing method |
| CN107959708A (en) * | 2017-10-24 | 2018-04-24 | 北京邮电大学 | A kind of car networking service collaboration computational methods and system based on high in the clouds-marginal end-car end |
| CN109151045A (en) * | 2018-09-07 | 2019-01-04 | 北京邮电大学 | A kind of distribution cloud system and monitoring method |
| CN109474681A (en) * | 2018-11-05 | 2019-03-15 | 安徽大学 | Resource allocation methods, system and the server system of mobile edge calculations server |
| CN109710381A (en) * | 2018-12-27 | 2019-05-03 | 北京联创信安科技股份有限公司 | High-performance calculation, big data, virtualization special container management system and method |
| CN109889599A (en) * | 2019-03-07 | 2019-06-14 | 北京邮电大学 | Data processing method and system |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111211991A (en) * | 2019-12-31 | 2020-05-29 | 联想(北京)有限公司 | Asset processing method, system and terminal equipment |
| CN111221973A (en) * | 2020-02-17 | 2020-06-02 | 河北冀联人力资源服务集团有限公司 | Occupational attribute identification method and system based on machine learning and edge calculation |
| CN111353477A (en) * | 2020-04-16 | 2020-06-30 | 银河水滴科技（北京）有限公司 | Gait recognition system and method |
| CN111353477B (en) * | 2020-04-16 | 2024-04-19 | 公安部物证鉴定中心 | Gait recognition system and method |
| CN112367354A (en) * | 2020-10-09 | 2021-02-12 | 国网电力科学研究院有限公司 | Intelligent scheduling system and scheduling method for cloud-edge resource graph |
| CN112416570A (en) * | 2020-10-15 | 2021-02-26 | 北京旷视科技有限公司 | Picture stream access method and device, picture processing system and electronic equipment |
| CN112416570B (en) * | 2020-10-15 | 2024-06-07 | 北京旷视科技有限公司 | Picture stream access method and device, picture processing system and electronic equipment |
| CN112784014A (en) * | 2021-01-15 | 2021-05-11 | 中国核动力研究设计院 | Safe full-text retrieval system and method based on multi-source heterogeneous system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110300191A (en) | Service system and data processing method | |
| CN110147722A (en) | A kind of method for processing video frequency, video process apparatus and terminal device | |
| US11048444B2 (en) | Grouping devices as a virtual device for providing better quality of device data | |
| CN109961204A (en) | Quality of service analysis method and system under a kind of micro services framework | |
| CN112118551B (en) | Equipment risk identification method and related equipment | |
| US10834183B2 (en) | Managing idle and active servers in cloud data centers | |
| CN107612984B (en) | Big data platform based on internet | |
| CN111159897B (en) | Target optimization method and device based on system modeling application | |
| CN102546793B (en) | Self-adaption method and system of mobile terminal based on cloud computing | |
| CN109582452A (en) | A kind of container dispatching method, dispatching device and electronic equipment | |
| CN106648557A (en) | Application programming interface API sharing method and device | |
| CN112583640A (en) | Service fault detection method and device based on knowledge graph | |
| US20130325863A1 (en) | Data Clustering for Multi-Layer Social Link Analysis | |
| CN105786941A (en) | Information mining method and device | |
| CN113378768A (en) | Garbage can state identification method, device, equipment and storage medium | |
| CN111428536B (en) | Training method and device for detecting network for detecting article category and position | |
| CN110348669B (en) | Intelligent rule generation method, intelligent rule generation device, computer equipment and storage medium | |
| WO2023179038A1 (en) | Data labeling method, ai development platform, computing device cluster, and storage medium | |
| CN115565030A (en) | Method, device and equipment for screening training samples and storage medium | |
| CN105590232A (en) | Client relation generation method and apparatus, and electronic device | |
| CN112003733B (en) | Comprehensive management method and management platform for smart park Internet of things | |
| US20230122754A1 (en) | Automatically generating inventory-related information forecasts using machine learning techniques | |
| CN117519996B (en) | Data processing method, device, equipment and storage medium | |
| US20240086791A1 (en) | Automatic adjustment of constraints in task solution generation | |
| US11556810B2 (en) | Estimating feasibility and effort for a machine learning solution |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20191001 |