TWI777481B - Data control method, data processing method, electronic equipment and storage medium - Google Patents

Abstract

The present application provides a data control method, a data processing method, an electronic equipment, and a storage medium. The data control method runs in an engine device. The method includes: obtaining data to be processed; receiving operation status reported by a plurality of accelerator devices; determining a plurality of target accelerator devices among the plurality of accelerator devices according to the data to be processed and the operation status; dividing the data to be processed according to the operation status of the plurality of target accelerator devices to obtain a plurality of sub-data to be processed; sending each sub-data to be processed to the corresponding target accelerator device for processing. By using the present application, the efficiency of data processing can be improved.

Description

Data control method, data processing method, electronic device and storage medium

The present application relates to the technical field of data processing, and in particular, to a data control method, a data processing method, an electronic device and a storage medium.

At present, the way people get their health condition is mainly through diagnosis by professionals in medical institutions. However, due to the shortage of medical resources and busy work, people cannot go to medical institutions in time, so it is difficult to meet the demand for timely access to their health status. At the same time, when people's health problems are not detected in time, they often cause serious health problems over time. Therefore, how to improve the efficiency of health monitoring and realize the needs of people to obtain health status in time has become an urgent problem to be solved.

In view of this, the main purpose of the present application is to provide a data control method, a data processing method, an electronic device and a storage medium, aiming at solving the technical problem of how to improve the efficiency of data processing.

A first aspect of the present application provides a data control method, which runs in an engine device, and the data control method includes: acquiring data to be processed; receiving operating conditions reported by multiple accelerator devices; The operation situation determines multiple target accelerator devices among the multiple accelerator devices; divides the data to be processed according to the operation situation of the multiple target accelerator devices to obtain multiple sub-data to be processed; The data is sent to the corresponding target accelerator device for processing.

According to an optional embodiment of the present application, the determining a plurality of target accelerator devices among the plurality of accelerator devices according to the data to be processed and the operating conditions includes: calculating each accelerator device according to the operating conditions based on the load amount, determining a plurality of candidate accelerator devices among the plurality of accelerator devices; and determining a plurality of target accelerator devices among the plurality of candidate accelerator devices according to the to-be-processed data.

According to an optional embodiment of the present application, the determining a plurality of target accelerator devices among the plurality of candidate accelerator devices according to the to-be-processed data includes: calculating an acceleration amount based on the to-be-processed data; The acceleration amount is among the plurality of candidate accelerator devices, and a plurality of target accelerator devices is determined.

According to an optional embodiment of the present application, the dividing the data to be processed according to the operating conditions of the multiple target accelerator devices, and obtaining the processed data includes: acquiring a preset load threshold of each target accelerator device ; Calculate and obtain a target acceleration amount according to the operation condition of each target accelerator device and the corresponding preset load threshold; divide the data to be processed according to the target acceleration amount to obtain a plurality of sub-data to be processed.

According to an optional embodiment of the present application, the dividing the data to be processed according to the target acceleration amount to obtain a plurality of sub-data to be processed includes: acquiring a data label of the data to be processed; The target acceleration amount and the data tag are used to segment the to-be-processed data to obtain a plurality of sub-to-be-processed data.

According to an optional embodiment of the present application, the method further includes: when a plurality of target accelerator devices cannot be determined among the plurality of accelerator devices according to the data to be processed and the operating conditions, executing the engine in the engine The data to be processed is processed in the device.

According to an optional embodiment of the present application, after sending each sub-to-be-processed data to a corresponding target accelerator device for processing, the method further includes: acquiring the data of the plurality of sub-target accelerator devices for the plurality of sub-target accelerators. Processing results of the processed data; generating a processing report of the data to be processed according to the processing results.

A second aspect of the present application provides a data processing method, which runs in an accelerator device, The data control method includes: in response to a data processing instruction sent by an engine device, judging whether the calculation requirement corresponding to the data processing instruction is met; when the calculation requirement is not met, reporting the operation status of the accelerator device to the engine device. The engine device; when the calculation requirements are met, the data corresponding to the data processing instruction is accelerated, and the acceleration result is sent to the engine device, and the engine device is used to execute the data control method described above.

A third aspect of the present application provides an electronic device, the electronic device comprising: a storage for storing at least one instruction; a processor for implementing the data control method as described above or the above-described data control method when executing the at least one instruction the data processing method described.

A fourth aspect of the present application provides a computer-readable storage medium, where at least one instruction is stored in the computer-readable storage medium, and when the at least one instruction is executed by a processor, implements the data control method described above or the above data processing method.

It can be seen from the above technical solutions that the present application obtains the data to be processed and the operating conditions of multiple accelerator devices, and determines multiple target accelerator devices among the multiple accelerator devices according to the data to be processed and the operating conditions. ; Then according to the operating conditions of the multiple target accelerator devices, the data to be processed is divided to obtain a plurality of sub-data to be processed; finally, each sub-data to be processed is sent to the corresponding target accelerator device for processing. The data to be processed is segmented according to the operation status of each target accelerator device, and it is determined that each target accelerator device can process the corresponding sub-to-be-processed data, thereby improving the efficiency of acceleration.

401: Communication interface

402: Storage

403: Processor

404: Input/Output (I/O) interface

405: Busbar

S11~S15: Steps

S31~S33: Steps

In order to more clearly illustrate the technical solutions in the embodiments of the present application or in the prior art, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only It is an embodiment of the present application. For those of ordinary skill in the art, other drawings can also be obtained according to the provided drawings without any creative effort.

FIG. 1 is a schematic flowchart of a data control method according to an embodiment of the present application.

FIG. 2 is a field in which data to be processed is segmented to obtain a plurality of sub-data to be processed according to an embodiment of the present application Schematic diagram of the scene.

FIG. 3 is a schematic flowchart of a data processing method according to an embodiment of the present application.

FIG. 4 is a schematic block diagram of the structure of an electronic device according to an embodiment of the present application.

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

Embodiments of the present application provide a data control method, a data processing method, an electronic device, and a computer-readable storage medium. Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and features in the embodiments may be combined with each other without conflict.

Please refer to FIG. 1. FIG. 1 is a schematic flowchart of a data control method provided by an embodiment of the present application. As shown in FIG. 1 , the data control method specifically includes steps S11 to S15 . According to different requirements, the order of the steps in the schematic flowchart may be changed, and some may be omitted. The data control method operates in an engine device including an inference engine.

Step S11, acquiring data to be processed.

Acquire data to be processed, and the data to be processed may include image data and/or document data.

In some implementations, the engine device may establish communication with the target device, so as to receive the profile data sent by the target device, and integrate the profile data to obtain data to be processed. The engine device may establish communication with one or more target devices.

Exemplarily, the integrating the profile data to obtain the data to be processed includes: integrating the profile data according to the importance of the profile data to obtain the data to be processed. For example, the importance of the profile data can be determined according to the data label of the profile data, and the importance of the profile data can also be determined based on the execution time of the profile data. For example, the earlier the execution time, the corresponding importance level also higher. The data can be sorted according to the importance of the data, and the data to be processed can be obtained by integrating the data according to the sorting order. In the data to be processed, the data data with high importance is placed in the front, and the data data with low importance is placed in the back, thereby speeding up the processing speed.

Step S12: Receive the operating conditions reported by multiple accelerator devices.

Exemplarily, the engine device obtains the operation status of multiple accelerator devices that have undergone device authentication, so as to further ensure the safety of acceleration. The device authentication includes registration of the accelerator device on the engine device.

Step S13: Determine a plurality of target accelerator devices among the plurality of accelerator devices according to the data to be processed and the operating conditions.

A plurality of target accelerator devices is determined among the plurality of accelerator devices according to the quantity of the data to be processed and the operation conditions of the plurality of accelerator devices.

In some embodiments, the determining a plurality of target accelerator devices among the plurality of accelerator devices according to the data to be processed and the operating conditions includes: calculating the load of each accelerator device according to the operating conditions; For the load, a plurality of accelerator devices to be selected are determined among the plurality of accelerator devices; and a plurality of target accelerator devices are determined among the plurality of accelerator devices to be selected according to the data to be processed.

Exemplarily, the load of each accelerator device is calculated according to the operating conditions; it is judged whether the load is less than a preset load threshold, and an accelerator device smaller than the preset load threshold is determined as a candidate accelerator device.

In some implementation manners, the determining a plurality of target accelerator devices among the plurality of candidate accelerator devices according to the to-be-processed data includes: calculating an acceleration amount based on the to-be-processed data; Among the plurality of candidate accelerator devices, a plurality of target accelerator devices are determined.

Exemplarily, according to the amount of acceleration, an accelerator device capable of processing the data to be processed is determined among the plurality of candidate accelerator devices, that is, a plurality of target accelerator devices are determined.

Step S14: Divide the data to be processed according to the operating conditions of the multiple target accelerator devices to obtain multiple sub-data to be processed.

Exemplarily, the acceleration amount corresponding to each target accelerator device is determined according to the operation condition of each target accelerator device, and the data to be processed is segmented according to the acceleration amount to obtain a plurality of sub-data to be processed.

Exemplarily, as shown in FIG. 2 , the to-be-processed data is segmented according to the operating conditions of the multiple target accelerator devices to obtain five sub-to-be-processed data, namely task1 , task2 , task3 , task4 and task5 .

In some embodiments, the dividing the data to be processed according to the operating conditions of the multiple target accelerator devices, and obtaining the processed data includes: acquiring a preset load threshold of each target accelerator device; A target acceleration amount is obtained by calculating the operating conditions of each target accelerator device and the corresponding preset load threshold; the data to be processed is divided according to the target acceleration amount to obtain a plurality of sub-data to be processed.

Exemplarily, a load threshold of each target accelerator device may be preset, and under the load threshold, the target accelerator device can be accelerated normally. The target acceleration amount corresponding to each target accelerator device is calculated and obtained according to the operation condition of each target accelerator device and the corresponding preset load threshold. The to-be-processed data is segmented according to the size of the multiple target acceleration amounts to obtain multiple sub-to-be-processed data.

In some embodiments, dividing the data to be processed according to the target acceleration amount to obtain a plurality of sub-data to be processed includes: acquiring a data tag of the data to be processed; The data tag divides the data to be processed to obtain a plurality of sub-data to be processed.

Exemplarily, the data to be processed may include multiple data tags, and different data tags may be used to identify different data contents. The to-be-processed data is segmented according to the target acceleration amount and the data tag to obtain a plurality of sub-to-be-processed data, so that the data of the same data tag is included in one sub-to-be-processed data.

Step S15: Send each sub-data to be processed to the corresponding target accelerator device for processing.

Exemplarily, after determining the target accelerator device corresponding to the sub-data to be processed according to the acceleration amount of the sub-data to be processed, the sub-data to be processed is sent to the corresponding target accelerator device for processing.

In some embodiments, after sending each sub-data to be processed to a corresponding target accelerator device for processing, the method further includes: acquiring processing results of the plurality of sub-data to be processed by the plurality of target accelerator devices ; Generate a processing report of the data to be processed according to the processing result.

Exemplarily, the processing result of each target accelerator device on the corresponding sub-data to be processed is obtained, multiple processing results are obtained, and a processing report of the data to be processed is generated according to the multiple processing results according to a preset rule.

In some implementations, the method further includes: when a plurality of target accelerator devices cannot be determined among the plurality of accelerator devices according to the data to be processed and the operating conditions, performing an analysis on the engine device for the target accelerator device. Data to be processed is processed. When multiple target accelerator devices cannot be determined among the multiple accelerator devices, the to-be-processed data is directly processed in the engine device, thereby ensuring that the to-be-processed data is accelerated normally and improving the acceleration efficiency. Exemplarily, when a plurality of target accelerator devices cannot be determined among the plurality of accelerator devices, prompt information may be produced according to a preset rule.

In the data control method provided by the above embodiment, by acquiring the data to be processed and the operating conditions of multiple accelerator devices, and determining multiple target accelerator devices among the multiple accelerator devices according to the data to be processed and the operating conditions; Then, according to the operation of the multiple target accelerator devices, the data to be processed is divided to obtain multiple sub-data to be processed; finally, each sub-data to be processed is sent to the corresponding target accelerator device for processing. The operation status of the target accelerator device divides the data to be processed, and it is determined that each target accelerator device can process the corresponding sub-data to be processed, thereby improving the efficiency of acceleration.

Please refer to FIG. 3. FIG. 3 is a schematic flowchart of a data processing method provided by an embodiment of the present application. The data processing method specifically includes steps S31 to S33. According to different requirements, the schematic flow The order of the steps in the diagram can be changed and some can be omitted. The data processing method is applied to an accelerator device, and the accelerator device includes an AI accelerator device.

Step S31: In response to the data processing instruction sent by the engine device, determine whether the calculation requirement corresponding to the data processing instruction is satisfied.

Exemplarily, in response to a data processing instruction sent by the engine device, the data corresponding to the data processing instruction is acquired, and it is judged according to the data whether the calculation requirement corresponding to the data processing instruction is satisfied. For example, it is determined whether the calculation requirement corresponding to the data processing instruction is satisfied according to the data and the load condition of the accelerator device.

Step S32, when the calculation requirement is not met, reporting the operation status of the accelerator device to the engine device.

Exemplarily, when the requirements of the plan are not met, reporting the operation status of the accelerator device to the engine device, so that the engine device re-determines the accelerator device that executes the data.

Step S33: When the calculation requirement is satisfied, accelerate the data corresponding to the data processing instruction, and send the acceleration result to the engine device.

Wherein, the engine device is used to execute the above-mentioned data control method. When the calculation requirement is satisfied, the data corresponding to the data processing instruction is accelerated and the acceleration result is sent to the engine device.

In the data processing method provided by the above embodiment, by responding to the data processing instruction sent by the engine device, it is judged whether the calculation requirement corresponding to the data processing instruction is satisfied; when the calculation requirement is not satisfied, the operation of the accelerator device is reported. to the engine device; when the calculation requirements are met, the data corresponding to the data processing instruction is accelerated, and the acceleration result is sent to the engine device to ensure that the data corresponding to the data processing instruction can be Normal acceleration, improved acceleration efficiency.

Please refer to FIG. 4 , which is a schematic block diagram of the structure of an electronic device according to an embodiment of the present application. The electronic device 40 may be an engine device or an accelerator device. Wherein, the engine device can be for the inference engine. The accelerator device may be an electronic device such as an AI accelerator device. The network where the electronic device 40 is located includes, but is not limited to, the Internet, a wide area network, a metropolitan area network, a local area network, a virtual private network (Virtual Private Network, VPN), and the like.

As shown in FIG. 4 , the electronic device 40 includes a communication interface 401 , a storage 402 , a processor 403 , an input/output (I/O) interface 404 and a bus bar 405 . The processor 403 is coupled to the communication interface 401, the storage 402, and the I/O interface 404 through the bus bar 405, respectively.

The communication interface 401 is used for communication. The communication interface 401 may be an existing interface on the electronic device 40 , or may be a newly created interface on the electronic device 40 . The communication interface 401 may be a network interface, such as a wireless local area network (Wireless Local Area Network, WLAN) interface, a cellular network communication interface or a combination thereof.

Storage 402 may be used to store operating systems and computer programs. For example, the storage 402 stores a program corresponding to the above-mentioned data control method, or the storage 402 stores a program corresponding to the above-mentioned data processing method. It should be understood that the memory 402 may include an area for storing programs and an area for storing data. Wherein, the storage program area can be used to store the operating system, application programs required by at least one method (such as data control method, data processing method, etc.), etc.; the storage data area can store data created according to the use of the electronic device 40 (such as sub data to be processed, etc.) etc. In addition, the storage 402 may include volatile storage, and may also include non-volatile storage, such as a hard disk, a storage device, a plug-in hard disk, a Smart Media Card (SMC), a secure digital ( Secure Digital, SD) card, flash memory card (Flash Card), at least one disk storage device, flash memory device, or other storage device.

The processor 403 provides computing and control capabilities and supports the operation of the entire computer equipment. For example, the processor 403 is configured to execute the computer program stored in the storage 402 to implement the steps in the above-mentioned data control method or the above-mentioned steps in the data processing method. It should be understood that the processor 403 is a central processing unit (Central Processing Unit, CPU), and the processor may also be other general-purpose processors, digital signal processors (Digital Signal Processors, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Wherein, the general-purpose processor can be a microprocessor or the processor can also be any conventional processor or the like.

The I/O interface 404 is used to provide channels for user input or output. For example, the I/O interface 404 can be used to connect various input and output devices (mouse, keyboard or 3D touch device, etc.) and displays, so that the user can input information , or to visualize information.

The bus bar 405 is at least used to provide a communication channel among the communication interface 401 , the storage 402 , the processor 403 , and the I/O interface 404 in the electronic device 40 .

Those skilled in the art can understand that the structure shown in FIG. 4 is only a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the computer equipment to which the solution of the present application is applied. More or fewer components than shown in the figures may be included, or some components may be combined, or have a different arrangement of components.

Wherein, in one embodiment, when the processor 403 executes the computer program stored in the storage 402 to implement the data control method, it implements the following steps: acquiring data to be processed; receiving the operating conditions reported by multiple accelerator devices; The to-be-processed data and the operating conditions determine multiple target accelerator devices among the multiple accelerator devices; segment the to-be-processed data according to the operating conditions of the multiple target accelerator devices to obtain multiple sub-to-be-processed data; send each sub-data to be processed to the corresponding target accelerator device for processing.

Specifically, for the specific implementation method of the above-mentioned instruction by the processor 403, reference may be made to the description of the relevant steps in the foregoing data control method embodiment, which is not repeated here.

Wherein, in another embodiment, when the processor 403 executes the computer program stored in the storage 402 to implement the data processing method, it implements the following steps: in response to the data processing instruction sent by the engine device, judging whether the data processing is satisfied The calculation requirements corresponding to the instructions; when the calculation requirements are not met, the operation status of the accelerator device is reported to the engine device; when the calculation requirements are met, the data corresponding to the data processing instructions is accelerated, and send the acceleration result to the engine device.

Wherein, the engine device is used to execute the above-mentioned data control method. Specifically, for the specific implementation method of the above-mentioned instruction by the processor 403, reference may be made to the description of the relevant steps in the foregoing data processing method embodiment, which is not repeated here.

Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, the computer program includes program instructions, and the method implemented when the program instructions are executed may refer to this application Various embodiments of the data control method or various embodiments of the data processing method of the present application.

Wherein, the computer-readable storage medium may be an internal storage unit of the electronic device described in the foregoing embodiments, such as a hard disk or a storage of the electronic device. The computer-readable storage medium may also be an external storage device of the electronic device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, flash memory card (Flash Card), etc.

Further, the computer-readable storage medium may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function, and the like; Use the created data, etc.

The electronic device and the computer-readable storage medium provided in the foregoing embodiments can obtain the data to be processed and the operating conditions of multiple accelerator devices, and determine the data among the multiple accelerator devices according to the data to be processed and the operating conditions. A plurality of target accelerator devices; then according to the operating conditions of the plurality of target accelerator devices, the data to be processed is divided to obtain a plurality of sub-data to be processed; finally, each sub-data to be processed is sent to the corresponding target accelerator device for processing In processing, by dividing the data to be processed according to the operation conditions of multiple target accelerator devices, it is determined that each target accelerator device can process the corresponding sub-to-be-processed data, thereby improving the efficiency of acceleration.

The electronic device and the computer-readable storage medium provided by the foregoing embodiments can also judge whether the calculation requirements corresponding to the data processing instructions are met by responding to the data processing instructions sent by the engine device; when the calculation requirements are not met, the above Report the operation status of the accelerator device to the engine device; when the calculation requirements are met, accelerate the data corresponding to the data processing instruction, and Sending the acceleration result to the engine device ensures that the data corresponding to the data processing instruction can be normally accelerated, thereby improving the acceleration efficiency.

It should also be understood that the terminology used in the specification of the application herein is for the purpose of describing particular embodiments only and is not intended to limit the application. As used in the appended claims, the singular forms "a," "an," and "the" are intended to include the plural unless the context clearly dictates otherwise. It should also be understood that, as used in the appended patent application, the term "and/or" refers to and including any and all possible combinations of one or more of the associated listed items. It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or system comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or system. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article or system that includes the element.

The above-mentioned serial numbers of the embodiments of the present application are only for description, and do not represent the advantages or disadvantages of the embodiments. The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of various equivalent modifications within the technical scope disclosed in the present application. or replacement, these modifications or replacements should be covered within the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

S11~S15: Steps

Claims (9)

A data control method, running in an engine device, wherein the data control method includes: acquiring data to be processed; receiving operating conditions reported by multiple accelerator devices; Determining a plurality of target accelerator devices among the plurality of accelerator devices includes: calculating a load amount of each accelerator device according to the operating conditions; determining a plurality of candidate accelerator devices among the plurality of accelerator devices based on the load amount; Determine multiple target accelerator devices among the multiple candidate accelerator devices according to the to-be-processed data; divide the to-be-processed data according to the operating conditions of the multiple target accelerator devices to obtain multiple sub-data to be processed ; Send each sub-data to be processed to the corresponding target accelerator device for processing. The data control method according to claim 1, wherein the determining a plurality of target accelerator devices among the plurality of candidate accelerator devices according to the to-be-processed data comprises: calculating an acceleration amount based on the to-be-processed data; The acceleration amount determines a plurality of target accelerator devices among the plurality of candidate accelerator devices. The data control method according to claim 1, wherein the dividing the data to be processed according to the operating conditions of the multiple target accelerator devices to obtain multiple sub-data to be processed comprises: acquiring each target accelerator device The preset load threshold value of data to be processed. The data control method according to claim 3, wherein the dividing the data to be processed according to the target acceleration amount to obtain a plurality of sub-data to be processed comprises: acquiring a data label of the data to be processed; The to-be-processed data is segmented according to the target acceleration amount and the data tag to obtain a plurality of sub-to-be-processed data. The data control method according to claim 1, wherein the method further comprises: when a plurality of target accelerator devices cannot be determined among the plurality of accelerator devices according to the data to be processed and the operating conditions, The data to be processed is processed in the engine device. The data control method according to any one of claim 1 to 5, wherein after sending each sub-data to be processed to a corresponding target accelerator device for processing, the method further includes: acquiring each target processing results of the corresponding sub-data to be processed by the accelerator device; and generating a processing report of the data to be processed according to a plurality of the processing results. A data processing method, running in an accelerator device, wherein the data control method comprises: in response to a data processing instruction sent by an engine device, judging whether the calculation requirement corresponding to the data processing instruction is satisfied; When required, report the operation of the accelerator device to the engine device; when the calculation requirements are met, accelerate the data corresponding to the data processing instruction, and send the acceleration result to the engine device, so that The engine device executes the data control method described in any one of request items 1 to 6. An electronic device, wherein the electronic device includes a storage and a processor; the storage is used to store at least one instruction; the processor is configured to implement any one of claim 1 to 6 when executing the at least one instruction The data control method or the data processing method described in claim 7. A computer-readable storage medium, wherein at least one instruction is stored in the computer-readable storage medium, and when the at least one instruction is executed by a processor, the data control method as described in any one of claim items 1 to 6 is implemented Or the data processing method as described in claim 7.

Images