CN116166689A - Slot-based data processing method, device, equipment and readable storage medium - Google Patents
Slot-based data processing method, device, equipment and readable storage medium Download PDFInfo
- Publication number
- CN116166689A CN116166689A CN202310006057.1A CN202310006057A CN116166689A CN 116166689 A CN116166689 A CN 116166689A CN 202310006057 A CN202310006057 A CN 202310006057A CN 116166689 A CN116166689 A CN 116166689A
- Authority
- CN
- China
- Prior art keywords
- slot
- data
- processed
- data processing
- component
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Stored Programmes (AREA)
Abstract
The invention discloses a slot-based data processing method, a device, equipment and a readable storage medium, wherein the method comprises the following steps: receiving a data processing request of a client, wherein the data processing request comprises a service requirement field and data to be processed; configuring a target slot component according to the service demand field and the data to be processed; and calling the target slot component to process the data to be processed, and returning the data processing result to the client. Based on the method and the device, the technical problem that the processing procedure of complex logic is complicated and the data processing efficiency is reduced is solved, the format inconsistency of code connection is reduced, the occurrence of homogenized codes is reduced, and the working efficiency of technicians is improved by providing a flexible slot configuration mode.
Description
Technical Field
The present invention relates to the field of data processing, and in particular, to a slot-based data processing method, device, apparatus, and readable storage medium.
Background
In conventional data processing, different data processing requirements may have different processing logic requirements. Whether it is a single type of data processing requirement (i.e. data migration from a library to B library) or it meets a composite type of data processing requirement (i.e. data combining from a library to B library and processing to C library by a series of algorithms), there are a large number of implementation of homogeneous codes in the processing logic, and due to the complexity of the environment logic, various implicit BUGs are easily generated, and in addition, there is a need for quick response to process the user's data processing request, which is easily changed by the user.
There are two data processing schemes in the prior art, one is a scheme for coding to achieve data source acquisition and data writing, and the other is a workflow type data processor assembly scheme. The former provides some gadgets, but the overall logic still requires developer code implementation. The first solution has the following drawbacks: 1) The whole logic still needs developer coding realization, and implicit BUG is easy to appear; 2) The configuration cannot be realized, and the quick response of the change of the demand is inconvenient; 3) Complex logic implementations still require a large amount of coding and there may be a large amount of homogenized code. The latter limits the data processing to streaming scenarios, and generally a single type of data processing logic can be used, but the scheme is not applicable to scenarios such as algorithm combination, and still requires a large number of algorithm processing modules in the package of developers for use. The second solution has the following drawbacks: 1) Limiting the data processing logic to a streaming processing scene, wherein the non-streaming combined application needs hard adaptation and logic is not smooth; 2) Complex logic still requires a large number of processing modules to be packaged for use by developers. 3) Over-emphasis data flow ignores the processing logic of the program itself.
Aiming at the technical problem that the processing procedure of complex logic in the prior art is complicated and reduces the data processing efficiency, no effective solution exists at present.
Disclosure of Invention
The invention aims to provide a slot-based data processing method, a slot-based data processing device, a slot-based data processing equipment and a slot-based readable storage medium, which can solve the technical problem that a processing program of complex logic in the prior art is complicated and the data processing efficiency is reduced.
One aspect of the present invention provides a slot-based data processing method, the method comprising: receiving a data processing request of a client, wherein the data processing request comprises a service requirement field and data to be processed; configuring a target slot component according to the service demand field and the data to be processed; and calling the target slot component to process the data to be processed, and returning the data processing result to the client.
Optionally, configuring the target slot component according to the service requirement field and the data to be processed includes: determining the type combination of the slot components through the service requirement field; determining the number of slot components in the type combination through the data to be processed; and configuring the slot components according to the types and the numbers to generate target slot components.
Optionally, determining the type combination of the slot component through the service requirement field includes: judging task attributes of the business requirement field; if the service requirement field is a single task attribute, selecting one type from preset types of the slot assembly to form a type combination of the slot assembly, and defining the single task attribute as a function code of the slot assembly; if the service requirement field is a composite task attribute, selecting multiple types from preset types of the slot components to form a type combination of the slot components, splitting the composite task attribute, and defining a splitting result as a functional code of each slot component, wherein the multiple types have an execution time sequence.
Optionally, determining the number of socket components in the type combination according to the data to be processed includes: obtaining a processor list contained in each slot component in the type combination; determining, by the processor list, a data volume peak for each socket component; dividing the data to be processed through the data quantity peak value, and determining the number of slot components in the type combination.
Optionally, when the service requirement field is a single task attribute, the target slot component is invoked to process the data to be processed, and a data processing result is returned to the client, including: acquiring all processors of the target slot assembly; and processing the data to be processed by the parallel calling processors, and simultaneously returning the data processing results of the processors to the client.
Optionally, when the service requirement field is a composite task attribute, the target slot component is invoked to process the data to be processed, and the data processing result is returned to the client, including: the method comprises the steps of sending data to be processed to a first slot component, and calling all processors of the first slot component in parallel, and processing the data to be processed according to a first function code to obtain a first processing result; the first processing result is sent to the second slot component, all processors of the second slot component are called in parallel, and the first processing result is processed according to the second function code to obtain a second processing result; judging whether the traversing of the target slot assembly is finished or not; if yes, returning the second processing result to the client; if not, processing the second processing result based on the next slot component adjacent to the second slot component, and returning the processing result to the client.
Another aspect of the present invention provides a slot-based data processing apparatus, the apparatus comprising: the receiving module is used for receiving a data processing request of the client, wherein the data processing request comprises a service demand field and data to be processed; the configuration module is used for configuring the target slot component according to the service demand field and the data to be processed; the data processing module is used for calling the target slot component to process the data to be processed and returning the data processing result to the client.
Optionally, the configuration module includes: a first determining unit, configured to determine a type combination of the socket components through the service requirement field; the second determining unit is used for determining the number of slot components in the type combination through the data to be processed; and the generating unit is used for configuring the slot components according to the types and the numbers and generating target slot components.
Yet another aspect of the present invention provides a computer device comprising: a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the slot-based data processing method of any of the above embodiments when the computer program is executed by the processor.
Yet another aspect of the present invention provides a computer storage medium having stored thereon a computer program which, when executed by a processor, implements a slot-based data processing method of any of the above embodiments. Further, the computer-readable storage medium may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function, and the like; the storage data area may store data created from the use of blockchain nodes, and the like.
Compared with the prior art, the invention has at least the following advantages:
1. the module provides flexible module assembly forms supported by various slots, including front slots, rear slots and various built-in slots which can be customized, and can realize processor scheduling forms of load embedding, condition control and the like.
2. The modules can be packaged and used in a nested manner, and multiplexing of complex modules is supported.
3. The whole program logic is assembled in a configuration mode, and hidden BUG is not easy to occur.
4. Maintenance can be configured online, and changes in demand can be responded quickly.
5. After the use, the homogeneous codes can be greatly reduced, and the working efficiency of technicians is improved.
Based on the method and the device, the technical problem that the processing procedure of complex logic is complicated and the data processing efficiency is reduced is solved, the format inconsistency of code connection is reduced, the occurrence of homogenized codes is reduced, and the working efficiency of technicians is improved by providing a flexible slot configuration mode.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to designate like parts throughout the figures. In the drawings:
FIG. 1 is a flow chart showing an alternative method for slot-based data processing according to an embodiment of the present invention;
FIG. 2 is a block diagram of a slot-based data processing apparatus according to a second embodiment of the present invention; and
fig. 3 shows a block diagram of a computer device adapted to implement a slot-based data processing method according to a third embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the drawings and examples, in order to make the objects, technical solutions and advantages of the present invention more apparent. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Example 1
The present embodiment provides a slot-based data processing method, fig. 1 shows a flowchart of the slot-based data processing method, and as shown in fig. 1, the slot-based data processing method may include steps S101 to S103, where:
step S101, receiving a data processing request of a client, wherein the data processing request comprises a service demand field and data to be processed;
the business requirement field is a programming language that the user desires to execute on the data to be processed, and may be "query", "statistics", "count", etc., or may be a conventional data processing condition, which is not limited herein.
Step S102, configuring a target slot component according to a service requirement field and data to be processed;
the slot component is an external opening on the system function module, and can be used for processing data. The programs and the workload corresponding to different data to be processed are different, and the current data to be processed is configured with a reasonable target slot component by carrying out overall analysis on the service demand field and the data to be processed, so that efficient data processing is realized.
Step S103, the target slot component is called to process the data to be processed, and the data processing result is returned to the client.
Each slot component has corresponding processing logic, after the configured target slot component is obtained, the data to be processed is processed through the target slot component, a processing result is obtained, and the processing result is returned to the value client.
The present embodiment employs a configuration mode to assemble the whole program logic, and specifically provides a flexible slot assembly form for supporting multiple slot components, including a front slot, a rear slot and multiple built-in slots that can be customized. The modules of the slots can be packaged and nested, and multiplexing of complex modules is supported.
Preferably, step S102 may include steps S1021 to S1023, wherein:
step S1021, determining the type combination of the slot assembly through the service requirement field;
the preset type of the slot assembly can be a front slot, a rear slot or a built-in slot. The type of socket component that the target socket component contains is directly related to the composition of the traffic demand field.
Preferably, step S1021 may include steps A1 to A3, wherein:
a1, judging task attributes of a service demand field;
the task attributes may be single task attributes and composite task attributes. The single task attribute is typically represented by a single field, such as "query", "statistics" or "count", etc., which can only be present in one request. Composite task attributes are typically represented in a combination of fields, such as "parse" - "integrate" - "binning" into a business need field of a complete composite task attribute.
Judging the service attribute of the service requirement field to configure a slot component of a corresponding type to effectively process the data to be processed.
Step A2, if the service requirement field is a single task attribute, selecting one type from preset types of the slot assembly to form a type combination of the slot assembly, and defining the single task attribute as a function code of the slot assembly;
for the service requirement field of the single task attribute, the field indicates that the data to be processed has no obvious time sequence requirement on an execution program, and the slot components do not depend on the processing results of other slot components when processing the data, so that the slot components of the same type are configured to process the data to be processed corresponding to the field, and the high-efficiency processing of the data of the single service requirement can be realized.
Specifically, one type is selected from preset types of slot components to be used as a type combination of the slot components, the type combination can be any one of a front slot, a rear slot or a built-in slot, and a single task attribute is defined as a function code of the slot component, namely, the function code is used as an execution program for data processing by the subsequent slot component.
And step A3, if the service requirement field is a composite task attribute, selecting a type combination of the slot components from preset types of the slot components, splitting the composite task attribute, and defining a splitting result as functional codes of each slot component, wherein the types have execution time sequences.
Aiming at the service requirement field of the composite task attribute, the field indicates that the data to be processed has obvious time sequence requirement on an execution program, and the latter slot component processes the data according to the processing result of the former slot component, so that a plurality of slot component types with sequential time sequence are configured to process the data to be processed corresponding to the field, and the high-efficiency processing of the data of the composite service requirement can be realized.
In this embodiment, the combination of the plurality of slot assemblies with the sequential sequence may be a front slot+a rear slot, a front slot+a built-in slot+a rear slot. In particular, the above combinations must strictly perform data processing in order.
Specifically, one of the preset types of the slot component is selected from a plurality of types, and each type has a combination of execution sequences, the composite task attribute is split into separate fields, and each field is defined as the function code of the slot component of the same execution node according to the execution sequences. For example, the service requirement field of the composite task attribute is "query" - "warehouse entry", the configured slot component types are combined into a front slot+rear slot, the "query" is used as the function code of the front slot, and the "warehouse entry" is used as the function code of the rear slot. For another example, the service requirement field of the composite task attribute is "parse" - "integrate" - "put in storage", the configured slot component types are combined into a front slot+an internal slot+a rear slot, the "parse" is used as the function code of the front slot, the "integrate" is used as the function code of the internal slot, and the "put in storage" is used as the function code of the rear slot.
Step S1022, determining the number of slot components in the type combination according to the data to be processed;
the data to be processed can currently reflect the workload of the data processing request, and the number of slot components in the type combination is set in a targeted mode through the data to be processed, so that the data processing efficiency is improved.
Preferably, step S1022 may include steps B1 to B3, wherein:
step B1, obtaining a processor list contained in each slot component in the type combination;
each socket component has a list of processors that are directed to efficiently process data to be processed.
Step B2, determining the data volume peak value of each slot component through a processor list;
the data peak may be the maximum data that the slot component can handle. And each processor is preset with a corresponding data quantity threshold value, and the data quantity peak value of each slot component is determined by summing the data quantity threshold values of all processors in the processor list.
And B3, dividing the data to be processed through the data quantity peak value, and determining the number of slot components in the type combination.
And for the business requirement field of the single task attribute, the data volume peak value of the slot assembly is used as a grouping condition, and the data to be processed is integrally divided, so that a sufficient number of slot assemblies are configured to process the data to be processed efficiently.
For the business requirement field of the composite task attribute, firstly, taking the data quantity peak value of the slot components in the first bit in the execution sequence as a grouping condition, and carrying out integral division on the data to be processed to configure a sufficient number of first bit slot components; and secondly, taking the data quantity of the slot components in the second position in the execution sequence as a grouping condition, integrally dividing the processing result of the slot components in the first position to configure a sufficient number of the slot components in the second position, wherein the determination of the number of the slot components in the subsequent position is the same as the principle of the slot components in the second position, and further processing the processing result of the slot components in the previous position is omitted herein.
It should be noted that, for the service requirement field of the composite task attribute, the present embodiment does not configure each type of slot component at the same time, but configures the corresponding type of slot component according to the execution node, that is, only after the execution of the previous slot component is completed, the execution result of the previous slot component is taken as a reference, so as to implement the configuration of the next slot component, implement timeliness of slot configuration in the data processing process, and meanwhile, according to the number of slot components adapted to the actual requirement, avoid waste or shortage of system configuration resources.
Step S1023, configuring the slot components according to the types and the numbers to generate target slot components.
After the type and the number of the required slot components are determined, corresponding information is acquired and integrated according to the type and the number, and the target slot components are generated.
Preferably, when the service requirement field is a single task attribute, step S103 may include steps S1031 to S1032, wherein:
step S1031, obtaining all processors of the target slot assembly;
step S1032, the parallel calling processor processes the data to be processed, and the data processing results of the processors are simultaneously returned to the client.
Preferably, when the business requirement field is a compound task attribute, step S103 may further include steps S1031 'to S1035', wherein:
step S1031' sends the data to be processed to the first slot assembly, and all processors of the first slot assembly are called in parallel, and the data to be processed are processed according to the first function code to obtain a first processing result;
step S1032' sends the first processing result to the second slot assembly, and all processors of the second slot assembly are called in parallel, and the first processing result is processed according to the second function code to obtain a second processing result;
step S1033' judges whether the target slot assembly is traversed;
if yes, step S1034' returns the second processing result to the client;
if not, step S1035' processes the second processing result based on the next slot component adjacent to the second slot component, and returns the processing result to the client.
Taking a front slot, a built-in slot and a rear slot as an example, when a system receives a data processing request of a client, firstly reading complete configuration, starting to load a main processor, judging whether the main processor is a module library, if the main processor is the module library, loading the whole module library into the module library for processing, and if the main processor is not the module library, loading a corresponding processor. The corresponding processor loads and then carries out the processing of the front slot; then, parameter processing of the current processor is carried out, a processing method (functional codes) of the current processor is executed, and part of the processors call the inner slots to carry out subtask processing; and finally, processing the rear slot. And after the whole processing is finished, if a post processor returns the post processor result, and if no post processor returns the current processing result. If a processor has a value set, the result needs to be assigned to the attribute for use by other processors later.
It should be noted that, the service requirement field is essentially different in the calling sequence of the slot component between the single task attribute and the compound task attribute, and the former has no execution sequence, so that the single task attribute and the compound task attribute can be simultaneously called in parallel for the slot component with the type combination; the execution sequence exists in the latter, the slot components of the same type need to be called in parallel strictly according to the execution sequence, and the execution can not be skipped. According to the embodiment, by adopting different execution programs for different types of service demands, targeted processing of data is realized, and the occurrence of homogenization codes is avoided, so that the data processing efficiency is improved.
Compared with the prior art, the invention has at least the following advantages:
1. the module provides flexible module assembly forms supported by various slots, including front slots, rear slots and various built-in slots which can be customized, and can realize processor scheduling forms of load embedding, condition control and the like.
2. The modules can be packaged and used in a nested manner, and multiplexing of complex modules is supported.
3. The whole program logic is assembled in a configuration mode, and hidden BUG is not easy to occur.
4. Maintenance can be configured online, and changes in demand can be responded quickly.
5. After the use, the homogeneous codes can be greatly reduced, and the working efficiency of technicians is improved.
Based on the method and the device, the technical problem that the processing procedure of complex logic is complicated and the data processing efficiency is reduced is solved, the format inconsistency of code connection is reduced, the occurrence of homogenized codes is reduced, and the working efficiency of technicians is improved by providing a flexible slot configuration mode.
Example two
The second embodiment of the present invention further provides a slot-based data processing apparatus, which corresponds to the slot-based data processing method provided in the first embodiment, and corresponding technical features and technical effects are not described in detail in this embodiment, and reference is made to the first embodiment for relevant points. In particular, FIG. 2 shows a block diagram of the slot-based data processing apparatus. As shown in fig. 2, the slot-based data processing apparatus 200 includes a receiving module 201, a configuring module 202, and a data processing module 203, wherein:
a receiving module 201, configured to receive a data processing request of a client, where the data processing request includes a service requirement field and data to be processed;
the configuration module 202 is connected with the receiving module 201 and is used for configuring a target slot component according to the service requirement field and the data to be processed;
and the data processing module 203 is connected with the configuration module 202 and is used for calling the target slot component to process the data to be processed and returning the data processing result to the client.
Optionally, the configuration module includes: a first determining unit, configured to determine a type combination of the socket components through the service requirement field; the second determining unit is used for determining the number of slot components in the type combination through the data to be processed; and the generating unit is used for configuring the slot components according to the types and the numbers and generating target slot components.
Optionally, the first determining unit is specifically configured to: judging task attributes of the business requirement field; if the service requirement field is a single task attribute, selecting one type from preset types of the slot assembly to form a type combination of the slot assembly, and defining the single task attribute as a function code of the slot assembly; if the service requirement field is a composite task attribute, selecting multiple types from preset types of the slot components to form a type combination of the slot components, splitting the composite task attribute, and defining a splitting result as a functional code of each slot component, wherein the multiple types have an execution time sequence.
Optionally, the second determining unit is specifically configured to: obtaining a processor list contained in each slot component in the type combination; determining, by the processor list, a data volume peak for each socket component; dividing the data to be processed through the data quantity peak value, and determining the number of slot components in the type combination.
Optionally, when the service requirement field is a single task attribute, the data processing module is configured to: acquiring all processors of the target slot assembly; and processing the data to be processed by the parallel calling processors, and simultaneously returning the data processing results of the processors to the client.
Optionally, when the service requirement field is a composite task attribute, the data processing module is further configured to: the method comprises the steps of sending data to be processed to a first slot component, and calling all processors of the first slot component in parallel, and processing the data to be processed according to a first function code to obtain a first processing result; the first processing result is sent to the second slot component, all processors of the second slot component are called in parallel, and the first processing result is processed according to the second function code to obtain a second processing result; judging whether the traversing of the target slot assembly is finished or not; if yes, returning the second processing result to the client; if not, processing the second processing result based on the next slot component adjacent to the second slot component, and returning the processing result to the client.
Example III
Fig. 3 shows a block diagram of a computer device adapted to implement a slot-based data processing method according to a third embodiment of the present invention. In this embodiment, the computer device 300 may be a smart phone, a tablet computer, a notebook computer, a desktop computer, a rack-mounted server, a blade server, a tower server, or a rack-mounted server (including a stand-alone server or a server cluster formed by a plurality of servers) for executing programs, etc. As shown in fig. 3, the computer device 300 of the present embodiment includes at least, but is not limited to: a memory 301, a processor 302, and a network interface 303, which may be communicatively connected to each other via a system bus. It is noted that FIG. 3 only shows a computer device 300 having components 301-303, but it should be understood that not all of the illustrated components are required to be implemented, and that more or fewer components may alternatively be implemented.
In this embodiment, the memory 303 includes at least one type of computer readable storage medium, including flash memory, hard disk, multimedia card, card memory (e.g., SD or DX memory, etc.), random Access Memory (RAM), static Random Access Memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 301 may be an internal storage unit of the computer device 300, such as a hard disk or memory of the computer device 300. In other embodiments, the memory 301 may also be an external storage device of the computer device 300, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) or the like, which are provided on the computer device 300. Of course, the memory 301 may also include both internal storage units of the computer device 300 and external storage devices. In the present embodiment, the memory 301 is typically used to store an operating system and various types of application software installed on the computer device 300, such as program codes of a slot-based data processing method, and the like.
The processor 302 may be a central processing unit (Central Processing Unit, CPU), controller, microcontroller, microprocessor, or other data processing chip in some embodiments. The processor 302 is generally used to control the overall operation of the computer device 300. Such as performing control and processing related to data interaction or communication with the computer device 300. In this embodiment, the processor 302 is configured to execute program codes of steps of a slot-based data processing method stored in the memory 301.
In this embodiment, the slot-based data processing method stored in the memory 301 may also be divided into one or more program modules and executed by one or more processors (the processor 302 in this embodiment) to complete the present invention.
The network interface 303 may include a wireless network interface or a wired network interface, which network interface 303 is typically used to establish a communication link between the computer device 300 and other computer devices. For example, the network interface 303 is used to connect the computer device 300 to an external terminal through a network, establish a data transmission channel and a communication link between the computer device 300 and the external terminal, and the like. The network may be a wireless or wired network such as an Intranet (Intranet), the Internet (Internet), a global system for mobile communications (Global System of Mobile communication, abbreviated as GSM), wideband code division multiple access (Wideband Code Division Multiple Access, abbreviated as WCDMA), a 4G network, a 5G network, bluetooth (Bluetooth), wi-Fi, etc.
Example IV
The present embodiment also provides a computer-readable storage medium including a flash memory, a hard disk, a multimedia card, a card memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, a server, an App application store, etc., having stored thereon a computer program that when executed by a processor implements the steps of a slot-based data processing method.
It will be apparent to those skilled in the art that the modules or steps of the embodiments of the invention described above may be implemented in a general purpose computing device, they may be concentrated on a single computing device, or distributed across a network of computing devices, they may alternatively be implemented in program code executable by computing devices, so that they may be stored in a storage device for execution by computing devices, and in some cases, the steps shown or described may be performed in a different order than what is shown or described, or they may be separately fabricated into individual integrated circuit modules, or a plurality of modules or steps in them may be fabricated into a single integrated circuit module. Thus, embodiments of the invention are not limited to any specific combination of hardware and software.
It should be noted that, the embodiment numbers of the present invention are only for description, and do not represent the advantages and disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (10)
1. A slot-based data processing method, the method comprising:
receiving a data processing request of a client, wherein the data processing request comprises a service requirement field and data to be processed;
configuring a target slot component according to the service demand field and the data to be processed;
and calling the target slot component to process the data to be processed, and returning a data processing result to the client.
2. The method of claim 1, wherein configuring the target socket component according to the traffic demand field and the pending data comprises:
determining the type combination of the slot components through the service requirement field;
determining the number of slot components in the type combination according to the data to be processed;
and configuring the slot components according to the types and the numbers to generate target slot components.
3. The method of claim 2, wherein determining a type combination of socket components via the business need field comprises:
judging task attributes of the service demand field;
if the service requirement field is a single task attribute, selecting one type from preset types of the slot component to form a type combination of the slot component, and defining the single task attribute as a function code of the slot component;
if the service requirement field is a composite task attribute, selecting a plurality of types from preset types of the slot components to form a type combination of the slot components, splitting the composite task attribute, and defining a splitting result as a functional code of each slot component, wherein the plurality of types have an execution time sequence.
4. The method of claim 2, wherein determining the number of socket components in the type combination from the data to be processed comprises:
obtaining a processor list contained in each slot component in the type combination;
determining, by the processor list, a data volume peak for each socket component;
dividing the data to be processed through the data volume peak value, and determining the number of slot components in the type combination.
5. The method of claim 3, wherein when the service requirement field is a single task attribute, the invoking the target socket component to process the data to be processed and return a data processing result to the client comprises:
acquiring all processors of the target slot assembly;
and calling the processors in parallel to process the data to be processed, and simultaneously returning the data processing results of the processors to the client.
6. The method of claim 3, wherein when the business requirement field is a composite task attribute, the invoking the target socket component to process the data to be processed and return a data processing result to the client comprises:
the data to be processed is sent to a first slot component, all processors of the first slot component are called in parallel, the data to be processed is processed according to a first function code, and a first processing result is obtained;
the first processing result is sent to a second slot component, all processors of the second slot component are called in parallel, and the first processing result is processed according to a second function code to obtain a second processing result;
judging whether the target slot assembly is traversed;
if yes, returning the second processing result to the client;
and if not, processing the second processing result based on a next slot component adjacent to the second slot component, and returning the processing result to the client.
7. A slot-based data processing apparatus, the apparatus comprising:
the receiving module is used for receiving a data processing request of the client, wherein the data processing request comprises a service demand field and data to be processed;
the configuration module is used for configuring a target slot component according to the service demand field and the data to be processed;
and the data processing module is used for calling the target slot component to process the data to be processed and returning the data processing result to the client.
8. The method of claim 7, wherein the configuration module comprises:
a first determining unit, configured to determine a type combination of the socket components through the service requirement field;
a second determining unit, configured to determine, according to the data to be processed, the number of socket components in the type combination;
and the generating unit is used for configuring the slot components according to the types and the numbers and generating target slot components.
9. A computer device, the computer device comprising: a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the method of any of claims 1 to 6 when executing the computer program.
10. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310006057.1A CN116166689A (en) | 2023-01-03 | 2023-01-03 | Slot-based data processing method, device, equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310006057.1A CN116166689A (en) | 2023-01-03 | 2023-01-03 | Slot-based data processing method, device, equipment and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116166689A true CN116166689A (en) | 2023-05-26 |
Family
ID=86412555
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310006057.1A Pending CN116166689A (en) | 2023-01-03 | 2023-01-03 | Slot-based data processing method, device, equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116166689A (en) |
-
2023
- 2023-01-03 CN CN202310006057.1A patent/CN116166689A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11061925B2 (en) | Multi-task scheduling method and system, application server and computer-readable storage medium | |
| US10225145B2 (en) | Method and device for updating client | |
| CN106557470B (en) | Data extraction method and device | |
| CN110781180B (en) | Data screening method and data screening device | |
| CN111988337A (en) | Authority management method and system | |
| CN110543327A (en) | Service component multiplexing method and device, computer equipment and storage medium | |
| KR20070078061A (en) | Method for reporting to server and terminal thereof | |
| CN112422450A (en) | Computer equipment, and flow control method and device for service request | |
| CN111459676A (en) | Node resource management method, device and storage medium | |
| CN109586970B (en) | Resource allocation method, device and system | |
| CN111367690A (en) | Method and device for supporting combined API service calling | |
| CN111159226A (en) | Index query method and system | |
| CN116166689A (en) | Slot-based data processing method, device, equipment and readable storage medium | |
| CN111966744B (en) | Workflow deployment method and device, computer equipment and storage medium | |
| CN112395339B (en) | Intersystem data admission verification method, device, computer equipment and storage medium | |
| CN113626001A (en) | API dynamic editing method and device based on script | |
| CN110990137B (en) | Application program function module scheduling method, scheduling information processing method and device | |
| CN113791766A (en) | Method for combining data interfaces, electronic device and readable storage medium | |
| CN114003210A (en) | SDK-based multi-application program adaptation method, device, equipment and medium | |
| CN112688980B (en) | Resource distribution method and device, and computer equipment | |
| CN115543647A (en) | Function calling method | |
| CN108052380B (en) | Business function docking method and device, computer equipment and storage medium | |
| CN117290016B (en) | Page configuration method and device for view | |
| CN114827228B (en) | Link processing method and device | |
| CN113918239B (en) | Code implementation method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |