WO2021230285A1 - データ処理装置、データ処理装置の制御方法、データ処理装置の制御に用いられるコンピュータプログラム、及び、その記録媒体 - Google Patents

データ処理装置、データ処理装置の制御方法、データ処理装置の制御に用いられるコンピュータプログラム、及び、その記録媒体 Download PDF

Info

Publication number
WO2021230285A1
WO2021230285A1 PCT/JP2021/018035 JP2021018035W WO2021230285A1 WO 2021230285 A1 WO2021230285 A1 WO 2021230285A1 JP 2021018035 W JP2021018035 W JP 2021018035W WO 2021230285 A1 WO2021230285 A1 WO 2021230285A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
microservice
data processing
processes
processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/018035
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
智 高橋
直樹 北山
大貴 村山
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Latona Inc
Original Assignee
Latona Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Latona Inc filed Critical Latona Inc
Priority to US17/998,490 priority Critical patent/US20230137658A1/en
Publication of WO2021230285A1 publication Critical patent/WO2021230285A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/48—Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806—Task transfer initiation or dispatching
    • G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • G06F9/4881—Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/1734—Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
    • G06F9/5038—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061—Partitioning or combining of resources
    • G06F9/5077—Logical partitioning of resources; Management or configuration of virtualized resources
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogram communication
    • G06F9/547—Remote procedure calls [RPC]; Web services
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/04—Manufacturing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/08—Construction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00—Indexing scheme relating to G06F9/00
    • G06F2209/50—Indexing scheme relating to G06F9/50
    • G06F2209/508—Monitor

Definitions

  • the present invention relates to a data processing device, a control method for the data processing device, a computer program used for controlling the data processing device, and a recording medium thereof.
  • JP2015-106913A discloses an example of a data processing apparatus that continuously processes such a large amount of data.
  • JP2015-106913A discloses an analysis processing apparatus that performs a predetermined filter processing on the input image data and then performs a preset analysis processing on the filtered data.
  • microservice architecture that designs one system as a set of small units that are independent of each other is attracting attention. According to the microservice architecture, merits such as improvement of processing speed and facilitation of change for each component can be obtained.
  • the microservice architecture may be implemented using container orchestration technology such as kubernates.
  • the analysis processing apparatus disclosed in JP2015-10691A is designed as a dedicated system for performing a desired analysis processing. Therefore, if there is a change in the system configuration, for example, if there is a change in the order of each process or if there is an addition or deletion of processes, it may be difficult to deal with it or the man-hours for the change may increase. be.
  • the present invention has been made to solve the above-mentioned problems, and an object of the present invention is to provide a data processing device that can flexibly respond to changes in the system configuration in the device.
  • the data processing apparatus continuously applies a plurality of processes to the input data to generate output data.
  • the first process which is one of a plurality of processes, includes the first processed data obtained by performing the first processing on the data stored in the first storage area.
  • a data file containing subsequent process information indicating a second process following the first process is generated, and the second process shown in the subsequent process information of the data file is at least the first processed data.
  • the second process is performed on the data to generate the second processed data.
  • the first process creates a data file showing the first processed data and subsequent process information. Then, based on the data file, the second process shown in the succeeding process information processes the first processed data as input data. As a result, the first processed data is provided from the first process to the second process.
  • FIG. 1 is a schematic configuration diagram of a data processing system including the data processing apparatus of the present embodiment.
  • FIG. 2 is a schematic configuration diagram of a data processing system.
  • FIG. 3 is a hardware configuration diagram of the MEC device.
  • FIG. 4 is a diagram showing a general program structure.
  • FIG. 5 is a diagram showing a program configuration of the present embodiment.
  • FIG. 6 is an explanatory diagram of processing of a plurality of microservices.
  • FIG. 7 is a flow chart showing a process of transmitting processed data from the first microservice to the second microservice.
  • FIG. 8 is a diagram showing an example of a transmission data area.
  • FIG. 9 is a conceptual diagram showing an example of processing in the information processing apparatus.
  • FIG. 10 is a conceptual diagram showing processing in the information processing apparatus of the comparative example.
  • FIG. 11 is a diagram showing another example of the transmission data area.
  • FIG. 1 is a schematic configuration diagram of a data processing system including the data processing device of the present embodiment.
  • the data processing system 10 is, for example, a system that monitors each process such as a manufacturing process and a construction process and controls work equipment used in each process in a local environment such as a factory or a construction site.
  • the MEC (Mobile Edge Computing) device 12 is connected to the robot arm 13, the first camera 14, and the second camera 15 via the LAN 11. Further, the robot arm 13 includes an angle sensor 16, and the MEC device 12 acquires sensor information of the angle sensor 16 via the robot arm 13.
  • the MEC device 12 is an example of a data processing device, and controls and manages a robot arm 13 used in a manufacturing process in a local environment. Specifically, the MEC device 12 uses the sensor information acquired by the sensor, that is, the moving image captured by the first camera 14 and the second camera 15, the angle information acquired by the angle sensor 16, and the like. The robot arm 13 is controlled while determining the quality of the product manufactured by the robot arm 13.
  • the data processing system 10 is connected to a WAN (Wide Area Network) 20 and is configured to be able to communicate with the terminal 21 and the data storage 22 via the WAN 20.
  • the data processing system 10 constitutes the monitoring system 100 together with the terminal 21 and the data storage 22 connected via the WAN 20.
  • the monitoring system 100 that does not close to such a local environment may be referred to as a data processing system.
  • the terminal 21 is a device provided with a display unit and is a general-purpose computer.
  • the terminal 21 displays the sensor information acquired by the first camera 14, the second camera 15, and the angle sensor 16 in the data processing system 10, and the analysis result of the sensor information.
  • the data storage 22 stores the sensor information acquired in the data processing system 10 and stores a program used for control of the MEC device 12 and machine learning. Therefore, the MEC device 12 acquires a program image file from the data storage 22 at the time of system construction or update.
  • the sensor information and the like acquired by the data processing system 10 are temporarily stored in the MEC device 12, and are uploaded to the data storage 22 at a predetermined cycle of several hours to several days by batch processing. Then, machine learning is performed using the sensor information uploaded in the data storage 22, and the trained model that has undergone machine learning is downloaded to the MEC device 12, so that the data processing system 10 is updated.
  • the MEC device 12 Since the MEC device 12 is equipped with an orchestration tool as described later, the MEC device 12 acquires (deploys) a program image file from the data storage 22 at the time of system construction or update. Further, since the programs with high update frequency such as the trained model are periodically deployed to the MEC device 12 by using the function provided by the orchestration tool, these updates can be easily performed.
  • FIG. 2 is a schematic configuration diagram of the data processing system 10.
  • a plurality of products 18 are arranged on the belt conveyor 17, and the robot arm 13 performs work in a predetermined process on the products 18 conveyed by the belt conveyor 17.
  • the MEC device 12 controls a robot arm 13 connected via a wired LAN. Further, the MEC device 12 acquires sensor information from the angle sensor 16 via the robot arm 13 and acquires shooting data from the first camera 14 and the second camera 15 via the wireless LAN.
  • the MEC device 12 determines the quality of the product 18 after the work by the robot arm 13 by using the shooting data taken from different angles by the first camera 14 and the second camera 15. Further, the MEC device 12 determines the suitability of the work of the robot arm 13 by using the angle data acquired by the angle sensor 16. In this way, the MEC device 12 can manage the work by the robot arm 13 by using the sensor information such as the shooting data and the angle data.
  • FIG. 3 is a hardware configuration diagram of the MEC device 12.
  • the MEC device 12 includes a control unit 31 composed of a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit) that control the whole, a ROM (ReadOnlyMemory), a RAM (RandomAccessMemory), and / or a hard disk and the like.
  • a storage unit 32 that stores programs and various data, an input / output port 33 that inputs / outputs data to / from an external device, a communication unit 34 that communicates via a LAN 11 or the like, a display, and an LED.
  • a display unit 35 composed of a speaker or the like and displaying according to data
  • an input unit 36 for receiving input from the outside such as a keyboard.
  • the control unit 31, the storage unit 32, the input / output port 33, the communication unit 34, the display unit 35, and the input unit 36 are configured to be able to communicate with each other by bus connection.
  • the storage unit 32 for storing programs, various data, and the like can be configured in any form of a magnetic memory such as a hard disk drive (HDD) or an optical memory such as an optical disk. Further, a program, various data and the like may be stored in a recording medium that can be attached to and detached from the MEC device 12.
  • a program is stored in the storage unit 32, and when the stored program performs a predetermined operation, a MEC device 12 constituting a system that performs a predetermined process on the input data is configured. Further, the communication unit 34 is configured to enable LAN connection, serial communication, and the like via wired and wireless. The MEC device 12 exchanges data with the robot arm 13, the first camera 14, and the second camera 15 via the communication unit 34.
  • FIGS. 4 and 5 are software configuration diagrams of the MEC device 12.
  • each application is containerized by the container technology, and hardware resources are managed by the orchestration tool.
  • FIG. 4 shows a general program configuration in such a configuration.
  • FIG. 5 shows a specific program configuration of the present embodiment. It should be noted that these software configurations are realized by storing the program in the storage unit 32 of the MEC device 12.
  • an operating system (OS: Operating System) 41 is installed in the MEC device 12. Further, the OS 41 is provided with a container engine 42 for constructing a container environment and executing an application in the container environment, and an orchestration tool 43 for managing hardware resources of the container environment.
  • OS Operating System
  • the container engine 42 forms a logical container area by virtualizing hardware resources and the like.
  • the application is configured integrally with the library used for operation in the container environment. As a result, the application operates in the container area integrally with the library.
  • containerization the integrated configuration of the application and library in this way is sometimes called containerization.
  • containerized applications are sometimes referred to simply as containers.
  • the container environment is constructed by introducing the container engine 42, and the container can be executed in the container environment by converting the application into a container.
  • the orchestration tool 43 manages (orchestrates) the hardware resources virtualized by the container engine 42.
  • the orchestration tool 43 constructs a logical area called a cluster 44 as an environment in which a containerized application is executed.
  • the cluster 44 is provided with a master 45 that manages the entire cluster 44 and a node 46 that is an application execution environment.
  • the master 45 manages the hardware resources of the node 46, which is the execution environment of the container 47.
  • a container 47 in which the application is integrated with the library is provided, and one or more containers 47 (two containers 47 in FIG. 4) are managed in units called pods 48.
  • the pod 48 is composed of one or more containers 47.
  • the pod 48 is managed by the pod management block 49 within the node 46.
  • the pod management block 49 manages resources at the node 46 according to the instruction from the master 45.
  • the containerized application is managed in units of the pod 48. Then, the pod 48 is executed at the node 46 in the cluster 44.
  • the non-containerized application (not shown in FIG. 4) may be operated without using the resources of the cluster 44. Such a non-containerized application can communicate bidirectionally with the pod 48 in the cluster 44.
  • a plurality of nodes 46 may be provided in the cluster 44.
  • the cluster 44 is configured by using the hardware resources of one MEC device 12 is shown, but the present invention is not limited to this.
  • the cluster 44 may be configured with the hardware resources of two or more different devices.
  • the orchestration tool 43 may configure one or more clusters 44 with one or more hardware resources.
  • FIG. 5 is a diagram showing details of the software configuration in the present embodiment.
  • a data stack 51, a front end 52, and a microservice 53 are provided as pods 48 having predetermined functions in the node 46.
  • the data stack 51, the front end 52, and the microservice 53 are containerized and operate at the node 46 in the cluster 44.
  • the program related to machine learning is provided outside the cluster 44.
  • the neural network library 54 can be placed on the OS 41 without being containerized and can communicate with the containerized data stack 51, the front end 52, and the microservice 53.
  • the data stack 51 is a general-purpose application related to a database.
  • the data stack 51 is a general purpose application classified as a document-oriented NoSQL database program.
  • the data stack 51 may handle JSON format data having a schema.
  • the data stack 51 can provide a core data stack for data engineering, data preparation, and an AI environment at the edge.
  • MongoDB and the like can be mentioned.
  • the front end 52 is a general-purpose application specialized for a user interface.
  • the front end 52 displays a single page or a format suitable for developing a mobile application by using a library suitable for acquiring data that requires recording and changes in a short time.
  • a library suitable for acquiring data that requires recording and changes in a short time.
  • An example of the front end 52 is React and the like.
  • the microservice 53 is an application that performs predetermined processing on sensor information acquired by sensors such as the first camera 14, the second camera 15, and the angle sensor 16.
  • a plurality of microservices 53 are provided, and a plurality of microservices 53 continuously perform processing.
  • the microservice 53 in the next process further processes various processing results such as image analysis and object detection performed by the microservice 53 in a certain process.
  • the processing order of these plurality of microservices 53 is not constant and is dynamically determined according to the processing result.
  • the neural network library 54 is a library including various algorithms such as a neural network composed of a plurality of layers.
  • the neural network library 54 outputs by performing inference processing on the input data.
  • PyTorch and TensorFlow are examples of the neural network library 54.
  • the microservice 53 can incorporate a machine learning process, an inference process using a trained model, or the like into the process.
  • FIG. 6 is an explanatory diagram of processing of a plurality of microservices 53. As described above, in the MEC device 12, a plurality of microservices 53 continuously perform processing. In the example of this figure, three microservices 53 out of a plurality of microservices 53 that perform continuous processing are shown.
  • a service broker 61 is provided to mediate the provision of the processed data from the first microservice 531 to the subsequent microservice 53.
  • the service broker 61 will be described as one of the containerized microservices 53, but may be a non-containerized application.
  • the first microservice 531 is a data file that records information indicating the subsequent microservice 53 of the process, processed data to be transmitted to the subsequent microservice 53, and the like when the predetermined process is completed. Is recorded in its own transmission data area 721. Then, in this example, the first microservice 531 transmits the processed data contained in the data file stored in the transmission data area 721 to the subsequent reception data area 712 of the second microservice area 532. When the succeeding microservice 53 is the third microservice 533, the first microservice 531 uses the processed data contained in the data file stored in the transmission data area 721 as the succeeding third microservice. It is transmitted to the received data area 713 of 533.
  • the service broker 61 periodically monitors the transmission data area 72 in which the data file is recorded in each microservice 53, and confirms that the first microservice 531 has recorded the data file in the transmission data area 721. Then, the data file is acquired and recorded in the database in the MEC apparatus 12. Then, the service broker 61 transmits a processing execution command to the second microservice 532 that performs the subsequent processing, which is indicated as the subsequent microservice in the data file.
  • the second microservice 532 When the second microservice 532 receives the processed data from the first microservice 531 and the execution command from the service broker 61, the second microservice 532 performs a predetermined second process on the processed data of the first microservice 531. .. Then, it transmits its own processed data to the subsequent microservice 53.
  • the input data is divided in the processing of the first microservice 531 so that the processing time of the subsequent microservice 53 can be shortened.
  • the data division process may be performed by another microservice 53 in the steps before and after the first microservice 531.
  • each of the microservices 53 includes a received data area 71 and a transmission data area 72 used for transmitting and receiving processed data in the storage area associated with the microservice 53.
  • the received data area 71 stores the processed data received from the microservice 53 in the previous process
  • the transmission data area 72 stores the processed data and a data file showing the succeeding microservice information.
  • the processed data recorded in the data file is transmitted to the subsequent microservice 53.
  • the data stored in the received data area 71 and the transmitted data area 72 are stored in a short period of time and are erased at an arbitrary timing.
  • the data file stored in the transmission data area 72 may include other information in addition to the processed data of the own process and the succeeding microservice information indicating the succeeding microservice 53. Therefore, as shown in the figure, the received data area 71 tends to have a shorter data length than the transmitted data area 72. This is because the transmission data area 72 stores subsequent microservice information and other information in addition to the processed data. In this way, the data file shows the output of the own process and the subsequent process as used in the Kanban production system.
  • the received data area 71 and the transmitted data area 72 are provided in the container area in which the microservice 53 is executed as a storage area associated with the microservice 53, but are not limited to this.
  • the received data area 71 and the transmitted data area 72 may be stored in any area as long as they are associated with the corresponding microservice 53.
  • the service broker 61 acquires the data file recorded in the transmission data area 72 of each microservice 53 and records it in the database in the MEC device 12.
  • the database in which the data file is recorded is composed of the data stack 51, and can record all the processing results by the microservice 53 in the MEC device 12.
  • the data file recorded in the database is uploaded to the data storage 22 at a predetermined cycle of several hours to several days by batch processing, and then used for machine learning or the like.
  • the first microservice 531 includes a reception data area 711 and a transmission data area 721 in an area associated with the container execution environment.
  • the second microservice 532 comprises a receive data area 712 and a transmit data area 722
  • the third microservice 533 comprises a receive data area 713 and a transmit data area 723.
  • the received data area 71 and the transmitted data area 72 are provided in an area different from the database in which the data file is recorded by the service broker 61.
  • the processed data in the data file stored in the transmission data area 721 of the first microservice 531 as shown in this figure is transmitted to the second microservice 532 in the next step, and the second The details of the process of recording in the received data area 712 by the microservice 532 will be described.
  • the service broker 61 acquires the data file of the first microservice 531 and records it in the database, and also transmits an execution command to the subsequent second microservice 532.
  • the processed data of the previous process received from the microservice 53 of the previous process is stored in the received data area 711, and the stored processed data is stored. It is assumed that the first microservice 531 has performed the first process.
  • FIG. 7 is a flow chart showing the provision of processed data from the first microservice 531 to the second microservice 532. Hereinafter, each process shown in this flow chart will be described.
  • step S701 the service broker 61 periodically accesses the transmission data area 72 of each microservice 53. These transmission data areas 72 are listed and held in the MEC device 12, and the service broker 61 can access the transmission data area 72 of each microservice 53 by referring to this list.
  • step S702 the service broker 61 determines whether or not a data file is recorded in any of the transmission data areas 72 among the plurality of transmission data areas 72 accessed in step S701. If the data file is stored in any of the transmission data areas 72 (S702: YES), the service broker 61 then performs the process of step S703. If no data file is stored in any of the transmission data areas 72 (S702: NO), the service broker 61 then performs the process of step S701 again.
  • step S703 the service broker 61 acquires the stored data file from the transmission data area 721 of the first microservice 531 determined in step S702 that the data file is stored.
  • the service broker 61 has acquired the address of the transmission data area 721 in advance, and directly accesses the address to acquire the data file. As another form, the service broker 61 inquires of the first microservice 531 for the presence or absence of data in the transmission data area 721, and the data stored in the transmission data area 721 in response to the response from the first microservice 531. You may check the existence and contents of the file.
  • step S704 the service broker 61 refers to the subsequent microservice information included in the data file acquired in step S703. Thereby, the service broker 61 can specify the second microservice 532 as a subsequent microservice 53 to be processed after the first microservice 531.
  • step S705 the service broker 61 requests the second microservice 532 shown in the subsequent microservice information of the data file acquired in step S703 to establish a communication path.
  • step S706 the service broker 61 transmits an execution command to the subsequent second microservice 532 via the communication path established in step S705.
  • step S707 the service broker 61 records the data file acquired in step S703 in the database in the MEC apparatus 12. In this way, all the data files generated by the microservice 53 in the MEC apparatus 12 will be recorded in the database. Therefore, it becomes easy to analyze the processing result in the MEC device 12.
  • step S701 When the processing of steps S701 to S707 is completed, the service broker 61 performs the processing of step S701 again.
  • step S711 the first microservice 531 determines whether or not a process execution command has been received from the service broker 61. When the execution command is received (S711: YES), the first microservice 531 then performs the process of step S712. If the execution command has not been received (S712: NO), the first microservice 531 then performs the process of step S711 again.
  • step S712 the first microservice 531 determines whether or not the processed data has already been received from the microservice 53 in the previous process and the processed data is stored in the received data area 711. If the processed data is stored in the received data area 711 (S712: YES), the first microservice 531 then performs the process of step S713. If the processed data is not stored in the received data area 711 (S712: NO), the first microservice 531 then performs the process of step S711 again.
  • the first microservice 531 performs a predetermined first process on the processed data stored in the received data area 712.
  • This first process may include a process of dividing the processed data. Further, in the first process, inference processing or the like using the neural network library 54 may be performed.
  • step S714 the first microservice 531 generates processed data as the output of the first process of step S713, and determines the subsequent microservice 53.
  • the second microservice 532 next performs the processing.
  • the first microservice 531 generates a data file including the processed data and the succeeding microservice information, and stores the data file in the transmission data area 721.
  • the data file stored in the transmission data area 721 is referred to in the processing of steps S701 and S702 by the service broker 61, and its presence or absence is confirmed.
  • step S715 the first microservice 531 establishes a communication path with the subsequent second microservice 532.
  • the processed data is transmitted to the subsequent second microservice 532 via the communication path established in step S715.
  • the communication method established here uses gRPC as in the process of step S705 of the service broker 61.
  • the first microservice 531 performs the processing of step S711 again.
  • steps S721 to S726 are shown as the processes of the second microservice 532. Since these processes are equivalent to steps S711 to S716 performed by the first microservice 531, a part of the detailed description will be omitted and the description will be simplified.
  • step S721 the second microservice 532 determines whether or not a process execution command has been received from the service broker 61.
  • the second microservice 532 is shown as the subsequent microservice of the data file generated by the first microservice 531 and the second microservice 532 is executed. It is assumed that the command has been received.
  • step S722 the second microservice 532 determines whether or not the processed data is received from the first microservice 531 in the previous process. In this figure, it is assumed that the processed data is transmitted by the process of step S716 of the first microservice 531 in the previous step and is recorded in the received data area 712.
  • step S723 the second microservice 532 performs a predetermined second process on the processed data stored in the received data area 712.
  • step S724 the second microservice 532 generates a data file including processed data and subsequent microservice information, and stores it in the transmission data area 722.
  • the data file stored in the transmission data area 722 is referred to in the processing of steps S701 and S702 by the service broker 61, and its presence or absence is confirmed.
  • step S725 the second microservice 532 establishes a communication path with the subsequent microservice 53.
  • step S726 since the second microservice 532 has completed its second processing, it transmits the processed data to the subsequent microservice 53.
  • the second microservice 532 performs the processing of step S721 again.
  • the first microservice 531 determines the microservice 53 to be processed next based on its own processing result. Therefore, the destination of the processed data is not limited to the second microservice 532, and may be, for example, the third microservice 533.
  • a data file including the processed data and the succeeding microservice information is generated, and the processed data is transmitted to the succeeding second microservice 532.
  • the service broker 61 refers to the transmission data area 72 of each microservice 53, acquires a data file, and records the data file in the database. At the same time, the service broker 61 transmits an execution command to the subsequent second microservice 532 based on the subsequent microservice information in the data file.
  • the second microservice 532 performs the second process when it receives the execution command from the service broker 61 and the processed data from the first microservice 531. In this way, even when the destination of the processed data is dynamically determined, the service broker 61 acquires the data file and transmits an execution command to the subsequent second microservice 532.
  • the activation frequency of the microservice 53 can be set.
  • the microservice 53 in the process having an early processing order may be set to start more frequently than the microservice 53 in the process having a slow processing order.
  • the microservice 53, which has a fast processing order handles specific data such as sensor data and has a high load
  • the microservice 53, which has a slow processing order has a high degree of abstraction that has undergone a plurality of processes. Since the load tends to be low, there is little risk of processing delay even if the startup frequency is reduced.
  • FIG. 8 is a diagram showing an example of the transmission data area 72.
  • the transmission data area 72 is configured to be able to store a plurality of data as shown in the figure. It is assumed that an example of the transmission data area 721 of the first microservice 531 is shown in this figure.
  • the transmission data area 72 is provided with a plurality of columns in addition to the "metadata” column in which processed data is stored and the "next microservice” column in which subsequent microservice information is shown. Information in columns other than "metadata” and “next microservice” is referenced for error detection by the service broker 61, etc., machine learning performed in batch processing, etc., and as a result, the robustness of the system Improvements are being made.
  • each parameter of the transmission data area 72 will be described in detail.
  • the microservice 53 that generated the input data to the first microservice 531 is shown. That is, in the column of "pre-microservice”, the microservice 53 that performs the processing of the pre-process of the first microservice 531 is shown.
  • pre-microservice directory the directory in which the program of the pre-process microservice 53 described in the "pre-microservice” column is stored is shown.
  • processing code is a code of a random number having a plurality of digits (for example, 30 to 80 digits) given for each processing in the microservice 53. Therefore, the processing code is associated with the processing at a specific time by the microservice 53, and the code is different for each.
  • the processing history of a plurality of processes before the first microservice 531 is recorded. be able to.
  • the deletion of the transmission data area 72 has not been completed. In some cases. In such a case, if the service broker 61 accesses the transmission data area 72 again, there is a possibility that the acquired data file may be reacquired by mistake.
  • the service broker 61 reacquired the already acquired data file by recording the processing codes 1 to 3 of the acquired data file and referring to the processing codes 1 to 3 each time the data file is acquired? It can be determined whether or not. In this way, it is possible to prevent the data file from being reacquired by mistake.
  • the input file name stored in the transmission data area 72 of the microservice 53 in the previous process of the first microservice 531 is stored.
  • the file shown in the "input file name” is the input for the processing of the first microservice 531.
  • the "input file name” field is recorded in a format including the file directory structure.
  • the "output file name" column is an area for storing the data file name stored in the transmission data area 72 of the first microservice 531.
  • the data file name is recorded in a format that includes the file directory structure.
  • the “next microservice” column indicates subsequent microservice information, and has columns for "next microservice name” and "next microservice directory”.
  • the second microservice 532 following the first microservice 531 is shown in the "next microservice name” column, and the program of the second microservice 532 is stored in the "next microservice directory” column. The directory is shown.
  • start time the start time of the processing of the first microservice 531 is shown.
  • the end time of the processing of the first microservice 531 that is, the time when the transmission data area 72 is generated is shown.
  • the processed data by the first microservice 531 is shown. That is, the first microservice 531 stores the output according to the result of processing by itself in the "metadata” column.
  • the "metadata” column has a "key” column and a "value” column. In this example, it is assumed that the information about the robot arm 13 is stored.
  • the "key” column shows an outline of the type of processing that is the target of the data file, and the work type of the robot arm 13 is an example.
  • the information in this "key” column facilitates access to necessary information from the log data composed of the recorded data files.
  • the "command”, “result”, “elapsed time”, “monitor device type”, and “model” columns are included.
  • the execution process by the robot arm 13 is shown.
  • the execution result of the predetermined process by the robot arm 13 is shown.
  • the “elapsed time” indicates the elapsed time from the start of processing of the robot arm 13.
  • the manufacturer name of the robot arm 13 is shown. It is assumed that the model name of the robot arm 13 is shown in the "model name” column.
  • the information shown in the "value” column is the processed data by the first microservice 531.
  • the second microservice 532 is shown as the subsequent microservice 53. Therefore, by referring to the data file, the service broker 61 identifies the second microservice 532 of the subsequent step shown in the “next microservice” column in the process of step S704, as shown in FIG. , In the process of step S707, the data file including the "metadata" can be recorded in the database.
  • FIG. 9 is a conceptual diagram showing an example of processing in the MEC device 12.
  • the MEC apparatus 12 an example in which the processing order of the microservice 53 dynamically changes is shown.
  • an input layer showing a plurality of inputs in the MEC device 12 is shown on the left side of the figure, and an output layer showing a plurality of outputs is shown on the right side of the figure.
  • a plurality of microservices 53 sequentially perform processing in response to input from the input layer, and output the processing result to the output layer.
  • sensor input units 14A, 15A, and 16A are provided.
  • the sensor input unit 14A and the sensor input unit 15A receive input of video data taken from the first camera 14 and the second camera 15.
  • the sensor input unit 16A receives the angle information of the arm unit of the robot arm 13 from the angle sensor 16.
  • the output layer is provided with a database 51A, a first user interface 52A, and a second user interface 52B.
  • the database 51A stores processing information that has passed through a plurality of microservices 53.
  • the first user interface 52A displays the image in the processing information
  • the second user interface 52B displays the parameter related to the cause of the error in the processing information.
  • the data stack 51 shown in FIG. 5 is used for the operation of the database 51A, and the front end 52 is used for the operation of the first user interface 52A and the second user interface 52B.
  • the micro service 53A has a real-time video streaming function, and when it acquires the video data of the first camera 14 input from the sensor input unit 14A, it makes corrections for improving accuracy in the subsequent process. , Generate corrected video data.
  • the microservice 53A transmits the processed data to the microservice 53D and / or 53E.
  • the microservice 53B has a real-time video streaming function different from that of the microservice 53A, and when it acquires video data input from the sensor input units 14A and 15A, it determines the quality of the product 18 manufactured in the video data. , If an error has occurred, the error occurrence time in the video data is detected.
  • the microservice 53B transmits the processed data to the microservice 53D and / or 53E.
  • Microservice 53C is a service (Decode Data to OPC-UA) that converts data to the OPC-UA (Open Platform Communications-Unified Architecture) format.
  • the microservice 53C converts the sensor data input from the sensor input units 14A, 15A, and 16A of the input layer into the OPC-UA format.
  • the OPC-UA format is a data format standardized in edge systems.
  • the microservice 53C transmits the processed data to the microservice 53E.
  • Microservice 53D performs image analysis (Analyze Picture by Time) in time series. Specifically, the microservice 53D analyzes the image at the error occurrence time obtained by the microservice 53B among the corrected video data input from the microservice 53A, and determines whether the cause of the error is human work or a manufacturing device. Is determined. The microservice 53D transmits the processed data to the microservice 53F and / or 53G.
  • Microservice 53E inserts data into the specified database (Data Insert to DB).
  • the microservice 53E converts a plurality of image data input from the microservices 53A and 53B and OPC-UA format data input from the microservice 53C into a recording format for storage, and then transmits the data to the database 51A. do.
  • Microservice 53F performs person detection (Object Detection (Human) from Image).
  • the determination result is input to the microservice 53F.
  • the microservice 53F further performs an error analysis on the determination result regarding the human work, and outputs the analysis result to the first user interface 52A.
  • the microservice 53G performs manufacturing device detection (Object Detection (Machine) from Image).
  • the determination result is input to the microservice 53G.
  • the microservice 53G further performs error analysis on the determination result regarding the manufacturing apparatus, and outputs the analysis result to the first user interface 52A and / or the second user interface 52B.
  • the microservice 53H displays a real-time UI (DisplayRealTimeUI).
  • the microservice 53H selects an item to be displayed from the OPC-UA format data input from the microservice 53E and outputs the data to the second user interface 52B.
  • the subsequent microservice 53 is determined according to the processing result.
  • the microservice 53D determines whether the error factor is human work or a manufacturing device according to the analysis result of the image data, and selects the microservice 53F or 53G of the subsequent process for further detailed analysis. ..
  • the service broker 61 acquires the data file created by the microservice 53D, records the data file in the database, and further executes the data file to the microservice 53F or 53G indicated by the subsequent microservice information. You can send commands.
  • FIG. 10 is a conceptual diagram showing a comparative example of the MEC device 12 in which a plurality of microservices 53 sequentially perform processing.
  • the data file generated by the microservice 53 is not recorded in the database by the service broker 61, but the log acquisition function provided by the platform is used.
  • the MEC device 12 includes the orchestration tool 43 as in the present embodiment, in the log acquisition function provided by the platform, it is outside the area associated with the execution environment of the microservice 53, that is, to a position other than the cluster 44. Memory access may occur. Furthermore, in order to use the log acquisition function provided by the platform, it is necessary to include specific header / footer information, which increases the processing load.
  • the service broker 61 when the data file generated by the microservice 53 is recorded in the database, access to the outside of the area associated with the microservice 53 is suppressed. Further, since the header / footer information does not conform to a predetermined standard and includes only necessary information as shown in FIG. 8, unnecessary information can be omitted. As a result, in the present embodiment, the processing load for recording the data file generated by the microservice 53 in the database can be reduced as compared with the comparative example of FIG. 10, so that the processing can be simplified.
  • the first microservice 531 which is the first process is the first with respect to the processed data of the previous process stored in the received data area (first data area) 711. Is performed to generate processed data (first processed data), and a second microservice 532, which is a subsequent second process, is determined. Then, the first microservice 531 generates a data file showing the processed data and the subsequent second microservice 532, and stores the data file in the transmission data area 721. Then, the second process shown as the successor process in the data file performs the second processing on the processed data shown in the data file, and owns the processed data (second processed data). To generate.
  • the processed microservice 53 transmits the processed data to the subsequent microservice 53 via the data file including the processed data and the succeeding process information, whereby the microservice 53 and the microservice 53 are transmitted.
  • the load can be reduced because access to the associated area is simplified.
  • the data file contains the subsequent process information, the subsequent microservice 53 can be flexibly determined. Therefore, even when the order of each microservice 53 is changed, processing is added or deleted, or the processing order is dynamically determined, the processing order can be flexibly determined.
  • the microservice 53 is containerized in the container environment in which the container engine 42 is introduced, and the hardware resources of the container environment are managed by the orchestration tool 43.
  • the subsequent microservice is performed. Even when 53 is dynamically determined, the processing route can be flexibly set. As a result, the processing load can be reduced even when the processed data is frequently transmitted to the subsequent microservice 53.
  • the processed data is transmitted to the second microservice 532 at the timing when the first microservice 531 finishes processing (S716).
  • a unique communication path is established between the first microservice 531 and the second microservice 532 (S715).
  • communication using the remote procedure call framework is performed between the first microservice 531 and the second microservice 532.
  • communication using the remote procedure call framework it is possible for a program to execute a subroutine or procedure in another address space. Therefore, the execution of the process from one microservice 53, which is a different pod 48, to the other microservice 53 can be performed only by a simple setting without explicitly defining the process. Therefore, by speeding up and simplifying the communication processing between the plurality of microservices 53, it is possible to speed up the processing of the entire MEC device 12.
  • the first microservice 531 selects a subsequent microservice 53 according to its own processing result.
  • the microservice 53D analyzes the error occurrence time of the video data, and uses the video data of the occurrence time to determine whether the cause of the error is human work or a manufacturing apparatus. Then, the microservice 53D selects the microservice 53F or 53G to perform the subsequent processing in order to perform a more detailed analysis.
  • Subsequent microservice information is included in the data file used to provide the processed data. Therefore, even if the subsequent microservice 53 is dynamically determined, there is no need to make changes to the processed data transmission process. As a result, even when the processing order of the microservice 53 is changed, processing is added or deleted, or the processing order is dynamically determined, the microservice 53 is flexibly determined in the determined order. Processing can be executed.
  • the MEC device 12 of the present embodiment includes a service broker 61 which is an intermediary unit for transmitting an execution command to the second microservice 532 in the subsequent process.
  • the service broker 61 is a transmission data in which the microservice 53 records a data file. Area 72 is monitored on a regular basis. Then, when the service broker 61 detects that the data file has been recorded in the transmission data area 72, the service broker 61 acquires the data file and records it in the database, and at the same time, the subsequent second microservice information indicated in the subsequent microservice information of the data file. An execution command is transmitted to the microservice 532.
  • the data files generated by each microservice 53 in the database are sent to the outside of the cluster 44. Since data access is suppressed, the processing load can be reduced. Further, by providing the service broker 61 specialized for transmitting the execution command to the subsequent microservice 53, the subsequent microservice 53 can be started after the data file is surely recorded in the database. The maintainability of the system can be improved.
  • the first microservice 531 stores the processed data and the file data including the subsequent microservice information in the area associated with the container area in which the first microservice 531 operates.
  • the MEC device 12 includes a general-purpose database which is configured by using the data stack 51 and is a storage area accessible from a plurality of microservices 53.
  • the first microservice 531 includes a transmission data area 721 in an area associated with the container area in which it operates.
  • the service broker 61 records the acquired data file in the general-purpose database.
  • the service broker 61 specialized for recording the data file recorded in the area associated with the container area to a general-purpose database, the data file can be reliably recorded. can. Further, since the subsequent microservice 53 is executed after the data file is recorded as a log, the activation order of the microservice 53 can be guaranteed.
  • the data stored in the received data area 711 to be processed by the first microservice 531 is divided in the first process.
  • the subsequent microservice 53 handles small-sized data, so that the processing time can be shortened.
  • the rate-determining element can be eliminated by using a plurality of the microservices 53. That is, when balancing the load among the plurality of microservices 53, it is sufficient to increase the operation frequency of only the microservice 53 having a high load, so that the processing load can be easily adjusted. As a result, stable operation of the MEC device 12 can be obtained.
  • the microservice 53 having a faster processing order has a higher activation frequency than the microservice 53 having a slower processing order. It has been set.
  • the microservice 53 having a fast processing order handles specific data such as sensor data, so that the processing time tends to be long, whereas the microservice 53 having a slow processing order has undergone a plurality of processes.
  • the processing time is relatively short because it handles data with a high degree of abstraction. As a result, even if the activation frequency of the microservice 53 whose processing order is slow is reduced, there is little possibility that the processing will be delayed. By setting the processing frequency in this way, the microservice 53 can continuously perform processing without delay as a whole.
  • each microservice 53 uses the neural network library 54 to perform processing related to machine learning or a trained model.
  • the processed data tends to be large when it involves processing related to machine learning or a trained model.
  • the subsequent microservice 53 starts a predetermined process after receiving the processed data from the microservice 53 in the previous process and the start command from the service broker 61.
  • the subsequent microservice 53 operates after receiving the start command in addition to the processed data, so that reliable operation can be easily guaranteed.
  • the MEC device 12 including a process such as machine learning or a trained model that increases the processing time can be operated stably without delay.
  • the data files generated by the microservice 53 in the MEC device 12 are stored in the database by the service broker 61. Then, the data file stored in the database is transmitted to the data storage 22 on the cloud by batch processing. Then, by performing machine learning in the data storage 22, the function of the trained model is improved.
  • the trained model is updated by the deploy function provided by the orchestration tool 43. As a result, the trained model can be updated sequentially by deploying, so that the accuracy in the control of the robot arm 13 can be improved.
  • FIG. 11 is a diagram showing another example of the transmission data area 72. In the example of this figure, there is a difference in the data contained in the metadata as compared with the transmission data area 72 shown in FIG.
  • the metadata includes storage directories 1 and 2.
  • Storage directories 1 and 2 indicate storage locations for relatively large data. For example, when the microservice 53 is a process of extracting a plurality of still image data from the video data, the storage location of the extracted still image data is indicated in the storage directory. By doing so, it is possible to provide a relatively large amount of data to the subsequent microservice 53 while suppressing the size of the file data stored in the transmission data area 72.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Manufacturing & Machinery (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
PCT/JP2021/018035 2020-05-12 2021-05-12 データ処理装置、データ処理装置の制御方法、データ処理装置の制御に用いられるコンピュータプログラム、及び、その記録媒体 Ceased WO2021230285A1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/998,490 US20230137658A1 (en) 2020-05-12 2021-05-12 Data processing apparatus and method for controlling data processing apparatus

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020083614A JP7126712B2 (ja) 2020-05-12 2020-05-12 データ処理装置、方法、コンピュータプログラム、及び、記録媒体
JP2020-083614 2020-05-12

Publications (1)

Publication Number Publication Date
WO2021230285A1 true WO2021230285A1 (ja) 2021-11-18

Family

ID=78511433

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/018035 Ceased WO2021230285A1 (ja) 2020-05-12 2021-05-12 データ処理装置、データ処理装置の制御方法、データ処理装置の制御に用いられるコンピュータプログラム、及び、その記録媒体

Country Status (3)

Country Link
US (1) US20230137658A1 (https=)
JP (1) JP7126712B2 (https=)
WO (1) WO2021230285A1 (https=)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20230167893A (ko) * 2022-06-03 2023-12-12 삼성전자주식회사 대규모 스트리밍 데이터를 분산 처리하기 위한 시스템 및 방법
WO2024142281A1 (ja) * 2022-12-27 2024-07-04 リンクウィズ株式会社 情報処理システム、プログラム、及び情報処理方法

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012150621A (ja) * 2011-01-19 2012-08-09 Hitachi Ltd 制御システムおよびｓｏｅ装置
JP2020071689A (ja) * 2018-10-31 2020-05-07 ルネサスエレクトロニクス株式会社 半導体装置およびそれを用いるシステム

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007041720A (ja) * 2005-08-01 2007-02-15 Fujitsu Ltd ジョブステップ実行プログラムおよびジョブステップ実行方法
JP5905122B2 (ja) * 2012-11-30 2016-04-20 株式会社日立製作所 管理装置、管理方法及びプログラムを格納する記録媒体
US9552401B2 (en) * 2014-06-23 2017-01-24 International Business Machines Corporation ETL tool interface for remote mainframes
US10810316B2 (en) * 2017-05-15 2020-10-20 International Business Machines Corporation Updating monitoring systems using merged data policies
US11086974B2 (en) * 2017-09-25 2021-08-10 Splunk Inc. Customizing a user behavior analytics deployment
WO2020230447A1 (ja) * 2019-05-16 2020-11-19 京セラドキュメントソリューションズ株式会社 画像形成システム
US11176275B2 (en) * 2019-07-08 2021-11-16 International Business Machines Corporation De-identifying source entity data

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012150621A (ja) * 2011-01-19 2012-08-09 Hitachi Ltd 制御システムおよびｓｏｅ装置
JP2020071689A (ja) * 2018-10-31 2020-05-07 ルネサスエレクトロニクス株式会社 半導体装置およびそれを用いるシステム

Also Published As

Publication number Publication date
JP7126712B2 (ja) 2022-08-29
US20230137658A1 (en) 2023-05-04
JP2021179702A (ja) 2021-11-18

Similar Documents

Publication Publication Date Title
US11916764B1 (en) Server-side operations for edge analytics
US11675605B2 (en) Discovery, mapping, and scoring of machine learning models residing on an external application from within a data pipeline
US11087236B2 (en) Transmitting machine learning models to edge devices for edge analytics
US10545492B2 (en) Selective online and offline access to searchable industrial automation data
US8452451B1 (en) Methods and systems for robotic command language
US11586176B2 (en) High performance UI for customer edge IIoT applications
CN114091672B (zh) 分布式模型推理方法及装置、电子设备和介质
CN113656423B (zh) 更新数据的方法及装置、电子设备和存储介质
JP7596660B2 (ja) 予測システム、情報処理装置および情報処理プログラム
US11902386B2 (en) Smart device data access adapter
WO2021230285A1 (ja) データ処理装置、データ処理装置の制御方法、データ処理装置の制御に用いられるコンピュータプログラム、及び、その記録媒体
CN114064079A (zh) 算法应用元的打包方法及装置、设备、存储介质
CN114816913A (zh) 基于opcua协议的制造装备多模态数据智能解析方法
WO2008005817A2 (en) Apparatus and methods for ensuring visibility of display window
CN110678848A (zh) 跨装置的通用数据访问
US12346221B2 (en) Control device and non-transitory machine readable storage medium
US12585257B2 (en) Automated data transfer between automation systems and the cloud
EP4198715B1 (en) Collaborative work in industrial system projects
JP7153766B2 (ja) Ｐｌｃの資産の切り替えを検出する方法
US11687504B2 (en) Multimodal data reduction agent for high density data in IIoT applications
CN113126928A (zh) 文件移动方法及装置、电子设备和介质
US12055924B2 (en) Edge application discovering and management state machine objects in automation controllers for MES and DCS applications
US20250274515A1 (en) Systems and methods for managing an industrial digital twin and controlling an industrial device using an edge device
CN114930290B (zh) 用于管理对资产操作进行管理的应用程序的系统、设备、方法和数据栈
CN121864839A (zh) 终端设备的指令控制方法、装置及系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21803170

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21803170

Country of ref document: EP

Kind code of ref document: A1