JP2021026352A - Cooperation processing apparatus, method and program - Google Patents

Abstract

To improve efficiency of cooperative processing.SOLUTION: A cooperation processing apparatus, in which a plurality of processing sections perform a plurality of pieces of processing in cooperation, comprises: an instruction result management section that stores a result in which an instruction book storing content of each piece of processing of the plurality of pieces of processing and an order of performing the processing is executed; a processing frequency evaluation section that evaluates an execution frequency of cooperative processing included in the instruction book on the basis of the result in which the instruction book is executed; and a processing section generation section that generates a novel processing section for executing the cooperative processing on the basis of the execution frequency.SELECTED DRAWING: Figure 4

Description

The present invention relates to cooperative processing devices, methods, and programs.

Conventionally, it is known that a plurality of processing devices execute a plurality of processes in cooperation with each other. For example, Patent Document 1 discloses that an integrated function that combines a plurality of functions of an electronic device is executed.

However, in Patent Document 1, the next integrated function cannot be accepted until the processing of all the functions included in the integrated function is completed. That is, due to the necessity of managing the cooperation of each process, the next cooperation process cannot be accepted until all the processes included in the plurality of processes executed in cooperation (hereinafter, also referred to as the cooperation process) are completed. It was. Therefore, it is not possible to execute other linked processes while the linked process is being executed, and it is not possible to efficiently utilize the resources of the processing device.

Therefore, one embodiment of the present invention aims to improve the efficiency of cooperative processing.

In order to solve the above-mentioned problems, one embodiment of the present invention is a cooperative processing device in which a plurality of processing units cooperate to execute a plurality of processes, and the content of each process of the plurality of processes and the process. The instruction result management unit that stores the result of executing the instruction sheet that stores the order in which the instructions are executed, and the processing frequency evaluation unit that evaluates the execution frequency of the cooperative processing included in the instruction sheet based on the result of executing the instruction sheet. And a processing unit generation unit that generates a new processing unit for executing the cooperative processing based on the execution frequency.

According to one embodiment of the present invention, the cooperation processing can be made more efficient.

It is a block diagram of the whole of the cooperation processing system which concerns on one Embodiment of this invention. It is a hardware block diagram of the cooperation processing apparatus which concerns on one Embodiment of this invention. It is a hardware block diagram of the user terminal which concerns on one Embodiment of this invention. It is a functional block diagram of the cooperation processing apparatus which concerns on one Embodiment of this invention. It is a functional block diagram of the new processing part which concerns on one Embodiment of this invention. This is an example of data managed by the instruction result management unit according to the embodiment of the present invention. This is an example of a correspondence table between the instruction manual name and the processing unit name held by the cooperative processing management unit according to the embodiment of the present invention. It is an example of the response of the processing result which concerns on one Embodiment of this invention. This is an example of processing in which a part of the processing flow according to the embodiment of the present invention is common. This is an example of an instruction manual according to an embodiment of the present invention. It is a flowchart of the new processing part generation processing which concerns on one Embodiment of this invention. It is a flowchart of the process by the instruction which concerns on one Embodiment of this invention.

Hereinafter, each embodiment will be described with reference to the accompanying drawings. In the present specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals, so that duplicate description will be omitted.

<Overall configuration>
FIG. 1 is an overall configuration diagram of a cooperative processing system 1 according to an embodiment of the present invention. The cooperative processing system 1 includes a cooperative processing device 10 and a user terminal 20. The cooperative processing device 10 and the user terminal 20 are communicably connected via an arbitrary network 30.

The cooperative processing device 10 receives an instruction from the user terminal 20 or another system, and executes a plurality of processes in cooperation with each other. The cooperative processing device 10 is composed of one or a plurality of computers.

The user terminal 20 is a terminal used by a person who instructs the cooperation processing. The user terminal 20 transmits the data input by the user to the cooperation processing device 10. Further, the user terminal 20 receives screen data or the like from the cooperation processing device 10 and displays it on a display means such as a display. The user terminal 20 is, for example, a smartphone or the like.

The user terminal 20 is not limited to a smartphone as long as it is a device having a communication function. The user terminal 20 is, for example, an image forming device such as a multifunction device, a PJ (Projector: projector), an IWB (Interactive White Board: a white board having an electronic whiteboard function capable of mutual communication), an output device such as a digital signage, and the like. HUD (Head Up Display) devices, industrial machines, imaging devices, sound collectors, medical devices, network home appliances, automobiles (Connected Cars), notebook PCs (Personal Computers), mobile phones, tablet terminals, game machines, PDA (Personal Digital) It may be an assistant), a digital camera, a wearable PC, a desktop PC, or the like.

Although the cooperation processing device 10 and the user terminal 20 have been described as separate computers in FIG. 1, the cooperation processing device 10 and the user terminal 20 may be mounted on one computer.

The group of devices described in FIG. 1 represents only one of a plurality of computing environments for implementing the embodiments disclosed herein. In certain embodiments, the cooperative processing device 10 includes a plurality of computing devices such as a server cluster. The plurality of computing devices are configured to communicate with each other via any type of communication link, including networks, shared memory, and the like, and perform the processes disclosed herein.

<Hardware configuration>
FIG. 2 is a hardware configuration diagram of the cooperative processing device 10 according to the embodiment of the present invention.

As shown in FIG. 2, the cooperation processing device 10 is constructed by a computer, and as shown in FIG. 2, the CPU 101, ROM 102, RAM 103, HD 104, HDD (Hard Disk Drive) controller 105, It includes a display 106, an external device connection I / F (Interface) 108, a network I / F 109, a data bus 110, a controller 111, a pointing device 112, a DVD-RW (Digital Versatile Disk Rewritable) drive 114, and a media I / F 116. ..

Of these, the CPU 101 controls the operation of the entire cooperative processing device 10. The ROM 102 stores a program used to drive the CPU 101 such as an IPL. The RAM 103 is used as a work area of the CPU 101. The HD104 stores various data such as programs. The HDD controller 105 controls reading or writing of various data to the HD 104 according to the control of the CPU 101. The display 106 displays various information such as cursors, menus, windows, characters, or images. The external device connection I / F 108 is an interface for connecting various external devices. The external device in this case is, for example, a USB (Universal Serial Bus) memory, a printer, or the like. The network I / F 109 is an interface for performing data communication using the communication network 30. The bus line 110 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 101 shown in FIG.

Further, the keyboard 111 is a kind of input means including a plurality of keys for inputting characters, numerical values, various instructions and the like. The pointing device 112 is a kind of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. The DVD-RW drive 114 controls reading or writing of various data to the DVD-RW 113 as an example of the removable recording medium. In addition, it is not limited to DVD-RW, and may be DVD-R or the like. The media I / F 116 controls reading or writing (storage) of data to a recording medium 115 such as a flash memory.

FIG. 3 is a hardware configuration diagram of the user terminal 20 according to the embodiment of the present invention.

As shown in FIG. 3, the smartphone 20 includes a CPU 201, ROM 202, RAM 203, EEPROM 204, CMOS sensor 205, image sensor I / F 206, acceleration / orientation sensor 207, media I / F 209, and GPS receiver 211. There is.

Of these, the CPU 201 controls the operation of the entire smartphone 20. The ROM 202 stores a program used to drive the CPU 201 such as the CPU 201 and the IPL. The RAM 203 is used as a work area of the CPU 201. The EEPROM 204 reads or writes various data such as a smartphone program under the control of the CPU 201. The CMOS (Complementary Metal Oxide Semiconductor) sensor 205 is a kind of built-in imaging means that acquires image data by imaging a subject (mainly a self-portrait) under the control of the CPU 201. Instead of a CMOS sensor, it may be an imaging means such as a CCD (Charge Coupled Device) sensor. The image sensor I / F 206 is a circuit that controls the drive of the CMOS sensor 205. The acceleration / orientation sensor 207 is various sensors such as an electronic magnetic compass, a gyro compass, and an acceleration sensor that detect the geomagnetism. The media I / F 209 controls reading or writing (storage) of data to a recording medium 208 such as a flash memory. The GPS receiving unit 211 receives GPS signals from GPS satellites.

Further, the smartphone 20 includes a long-distance communication circuit 212, a CMOS sensor 213, an image sensor I / F214, a microphone 215, a speaker 216, a sound input / output I / F217, a display 218, an external device connection I / F (Interface) 219, and a near vicinity. It includes a range communication circuit 220, an interface 220a of the short range communication circuit 220, and a touch panel 221.

Of these, the long-distance communication circuit 212 is a circuit that communicates with other devices via the communication network 30. The CMOS sensor 213 is a kind of built-in imaging means for capturing an image of a subject and obtaining image data under the control of the CPU 201. The image sensor I / F 214 is a circuit that controls the drive of the CMOS sensor 213. The microphone 215 is a built-in circuit that converts sound into an electric signal. The speaker 216 is a built-in circuit that converts an electric signal into physical vibration to produce sounds such as music and voice. The sound input / output I / F 217 is a circuit that processes sound signal input / output between the microphone 215 and the speaker 216 under the control of the CPU 201. The display 218 is a kind of display means such as a liquid crystal or an organic EL (Electro Luminescence) for displaying an image of a subject, various icons, and the like. The external device connection I / F 219 is an interface for connecting various external devices. The short-range communication circuit 220 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark). The touch panel 221 is a kind of input means for operating the smartphone 20 by the user pressing the display 218.

In addition, the smartphone 20 includes a bus line 210. The bus line 210 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 201 shown in FIG.

<Functional block>
FIG. 4 is a functional block diagram of the cooperative processing device 10 according to the embodiment of the present invention. The cooperative processing device 10 includes an input unit 301, an output unit 302, a cooperative processing management unit 303, an instruction sheet management unit 304, an instruction result management unit 305, a processing frequency evaluation unit 306, a processing unit generation unit 307, a new processing unit 308, and a first. It has one processing unit 309, a second processing unit 310, an acquisition processing unit 311 and a storage processing unit 312. Further, the cooperative processing device 10 executes the program to execute the input unit 301, the output unit 302, the cooperative processing management unit 303, the processing frequency evaluation unit 306, the processing unit generation unit 307, the new processing unit 308, and the first processing. It functions as a unit 309, a second processing unit 310, an acquisition processing unit 311 and a storage processing unit 312. Each will be described below.

First, the instruction sheet will be described. In the present specification, the instruction sheet is data in which the contents of each process of the plurality of processes executed in cooperation with the cooperative processing device 10 and the order in which the processes are performed are stored as a series of processes. For example, the processes executed by each processing device are "process to detect a face from an image", "process to detect a license plate from an image", "process to blur a specific part of an image", and "noise of the entire image". It refers to processing such as "processing to remove", but is not limited to these processing.

The input unit 301 receives an instruction (for example, an instruction for executing a series of processes) from the user terminal 20 or another system or the like, and receives data acquired from the user terminal 20 or another system or the like as a cooperative processing management unit. It is passed to 303 or the new processing unit 308.

The output unit 302 outputs the data output by the cooperative processing management unit 303 or the new processing unit 308 (for example, the result of executing a series of processes) to the user terminal 20 or another system.

The input unit 301 may cause the new processing unit 308 to execute the process via the cooperation processing management unit 303, or the input unit 301 may directly (not via the cooperation processing management unit 303) the new processing unit 308. The process may be executed. Further, the output unit 302 may receive the execution result from the new processing unit 308 via the cooperation processing management unit 303, or the output unit 302 may directly (not via the cooperation processing management unit 303) from the new processing unit 308. You may receive the execution result.

The cooperative process management unit 303 manages the execution of a series of processes based on the instruction sheet. Specifically, the cooperative processing management unit 303 starts from the completion of holding the instruction from the user terminal 20 or another system or the instruction to the instruction management unit 304, and the plurality of processing units (that is, the first The first processing unit 309, the second processing unit 310, the acquisition processing unit 311 and the storage processing unit 312) are made to execute a series of processes. Further, the cooperation processing management unit 303 passes the execution result of a series of processing to the output unit 302.

As described above, the cooperative processing management unit 303 can also cause the new processing unit 308 to execute a series of processes and pass the execution result of the series of processes by the new processing unit 308 to the output unit 302.

The instruction sheet management unit 304 is a storage unit that holds the instruction sheet.

The instruction result management unit 305 links the "execution number", "execution date and time", "instruction name", "instruction", "cooperation process name", and "instruction evaluation" for each execution of the instruction, and gives an instruction. It is a storage unit that stores as a result (also called an execution result). Hereinafter, the instruction result will be described in more detail with reference to FIG.

FIG. 6 is an example of data managed by the instruction result management unit 305 according to the embodiment of the present invention. As described above, the instruction result data includes data of the execution number, the execution date and time, the instruction document name, the instruction sheet, the cooperation process name, and the instruction evaluation.

In the "execution number", a number assigned each time the instruction is executed is stored.

In the "execution date and time", the date and time and time when the cooperation processing management unit 303 executes the instruction sheet are stored.

In the "instruction sheet name", the name of the instruction sheet executed by the cooperation processing management unit 303 is stored. The instruction name may be any name. For example, the instruction name may be a name such as "detect and blur the face" that can be grasped at a glance, or a name such as "TEST" that cannot be grasped as to what kind of instruction content is. It may be.

In the "instruction sheet", the instruction sheet executed by the cooperation processing management unit 303 is stored. For example, the instruction sheet may be a json format file (that is, the instruction sheet data itself) or information (path) of the place where the instruction sheet is held.

In the "cooperation process name", identifiers of each process (for example, a character string such as a process name) included in a series of processes executed when the cooperation process management unit 303 executes the instruction sheet are listed in the order of execution. Is remembered. For example, in FIG. 6, the linked processing name of the execution number "0001" acquires an image from the image holding location specified by the parameter (image acquisition processing), detects a face from the acquired image (face detection processing), and then performs It indicates that a series of processes have been executed in which the detected part is blurred (blurring process) and the processed image is stored in the image holding location specified by the parameter (image storage process).

In the "instruction evaluation", an evaluation indicating whether the result of executing the instruction sheet by the cooperation processing management unit 303 is the instruction content intended by the user is stored. For example, the instruction evaluation is performed by the user confirming an image of the result of executing a series of processing of the instruction sheet (hereinafter, also referred to as a result image) and designating an evaluation value from 0.0 to 1.0. It may be remembered.

Return to FIG. The processing frequency evaluation unit 306 evaluates the execution frequency of a series of processes included in the instruction sheet from the information stored in the instruction result management unit 305, and newly processes the linked processes that are executed frequently as independent processes. Part 308 determines to execute. For example, the processing frequency evaluation unit 306 can evaluate the execution frequency of a series of processes included in the instruction sheet based on the number of times the instruction sheet is executed, the execution time of the instruction sheet, and the like.

In addition, all the processes in the series of processes included in the instruction sheet may be executed by the new processing unit 308 as independent processes, or some processes in the series of processes included in the instruction sheet may be executed. May be executed by the new processing unit 308 as an independent process.

The processing unit generation unit 307 generates a new processing unit 308 for executing at least a part of the series of processing included in the instruction sheet based on the evaluation result of the processing frequency evaluation unit 306.

Not only the new new processing unit 308 may be generated, but also the newly generated new processing unit 308 may be deleted when the execution frequency of the series of processes included in the instruction sheet is low.

The new processing unit 308 executes at least a part of the series of processes included in the instruction sheet as a single process. Hereinafter, the new processing unit 308 will be described in more detail with reference to FIG.

FIG. 5 is a functional block diagram of the new processing unit 308 according to the embodiment of the present invention. The new processing unit 308 has a receiving process 380, a first processing process 381, a second processing process 382, an acquisition processing process 383, and a storage processing process 384. For example, the receiving process 380, the first processing process 381, the second processing process 382, the acquisition processing process 383, and the storage processing process 384 are Docker containers running in the server (that is, the new processing unit 308).

The functions corresponding to the first processing unit 309, the second processing unit 310, the acquisition processing unit 311 and the storage processing unit 312 are the processing processes (that is, the first processing process 381, the second processing process 382, and the acquisition process. It is incorporated into one processing unit (that is, a new processing unit 308) as a process 383, a storage processing process 384).

The acceptance process 380 can receive processing instructions from the cooperation processing management unit 303 or the input unit 301, and recognizes which process should be executed and how.

As described above, in one embodiment of the present invention, it is possible to prevent the cooperation processing management unit 303 from being occupied by the cooperation processing having a high execution frequency. In addition, since the processing is completed within the server, performance such as data exchange is improved.

Return to FIG. The first processing unit 309 executes the first processing based on the instruction sheet.

The second processing unit 310 executes the second processing based on the instruction sheet.

Although FIG. 4 shows the first processing unit 309 and the second processing unit 310, the number of processing units is not limited to this.

The acquisition processing unit 311 acquires data from a predetermined location based on the instruction sheet.

The storage processing unit 312 stores the data in a predetermined place based on the instruction sheet.

FIG. 7 is an example of a correspondence table between the instruction manual name and the processing unit name held by the cooperative processing management unit 303 according to the embodiment of the present invention.

As shown in FIG. 7, the instruction sheet and the generated processing unit (that is, the new processing unit 308) are associated and held (in the case of No. 1 and No. 2 in FIG. 7). Further, when only a part of the processing in the instruction sheet is executed by the generated processing unit (that is, the new processing unit 308), in addition to the processing unit name, the existing processing unit (that is, the first processing unit) The processing executed by the processing unit 309, the second processing unit 310, the acquisition processing unit 311, the storage processing unit 312, etc.) is also held (in the case of No3 and No4 in FIG. 7). In the case of No3 and No4 in FIG. 7, a common process is executed in S-003 between No3 and No4, and the difference is managed as pre-process and post-process.

FIG. 8 is an example of the response of the processing result according to the embodiment of the present invention. As shown in FIG. 8, information on the processing result (result), the executed processing unit (processing unit), and the processing (replacement) replaced by the new processing unit 308 is included. As a result, it can be seen that the processing has been replaced, and the name and processing content of the new processing unit 308 can be known. Therefore, it is possible to create a new instruction sheet using this name thereafter.

FIG. 9 is an example of processing in which the flow of some processing according to the embodiment of the present invention is common. As described above, all the processes in the series of processes included in the instruction sheet may be executed by the new processing unit 308 as independent processes, or one of the series of processes included in the instruction sheet. The processing of the unit may be executed by the new processing unit 308 as an independent processing. FIG. 9 shows an example of processing in which some processing flows are common, although the processing is different as a whole. In such a case, if it is determined that the execution frequency of the instruction sheet including the common processing flow (smoothing, binarization, face detection) is equal to or higher than a certain level, the processing frequency evaluation unit 306 performs the new processing unit 308. Can be determined to be necessary.

FIG. 10 is an example of an instruction sheet according to an embodiment of the present invention. The instruction sheet is described in, for example, JSON (JavaScript Object Notation).

FIG. 11 is a flowchart of a new processing unit generation process according to an embodiment of the present invention.

In step 11 (S11), the processing frequency evaluation unit 306 evaluates the execution frequency of the cooperation processing with reference to the instruction result management unit 305 for each predetermined period, and the cooperation processing executed at a high frequency (that is, that is). (Collaboration processing that exceeds the evaluation reference value for generating the new processing unit 308) is detected.

In step 12 (S12), the processing frequency evaluation unit 306 instructs the processing unit generation unit 307 to generate a new processing unit 308 for executing the cooperative processing detected in S11. Specifically, the processing frequency evaluation unit 306 notifies the processing unit generation unit 307 of the instruction manual name and the cooperative processing to be executed by the new processing unit 308 in the instruction manual.

In step 13 (S13), the processing unit generation unit 307 acquires the instruction sheet instructed in S12 from the instruction sheet management unit 304.

In step 14 (S14), the processing unit generation unit 307 generates a new processing unit 308 based on the instruction in S12 and the instruction sheet acquired in S13.

In step 15 (S15), the processing unit generation unit 307 notifies the cooperation processing management unit 303 (or the input unit 301) of the generation of the new processing unit 308. Specifically, the processing unit generation unit 307 notifies that the new processing unit 308 is used for the processing according to the instruction sheet acquired in S13 thereafter.

FIG. 12 is a flowchart of processing according to an instruction sheet according to an embodiment of the present invention.

In step 21 (S21), the input unit 301 receives an instruction from the user terminal 20 or another system to execute the instruction sheet.

In step 22 (S22), the cooperative processing management unit 303 decodes the instruction sheet of S21, and each processing unit (that is, new processing unit 308, first processing unit 309, second processing unit 310, acquisition processing. Unit 311 and storage processing unit 312) are made to execute the processing. Specifically, the cooperation processing management unit 303 causes the new processing unit 308 to execute the processing for the cooperation processing to be executed by the new processing unit 308 in the instruction sheet. Further, the cooperative processing management unit 303 describes the processing to be executed by the individual processing units in the instruction sheet (that is, the first processing unit 309, the second processing unit 310, the acquisition processing unit 311, and the storage processing unit 312). Causes individual processing units to execute processing.

In step 23 (S23), the cooperation processing management unit 303 saves the execution result of S22.

In step 24 (S24), the cooperation processing management unit 303 returns the execution result of S22 to the output unit 302.

As described above, in one embodiment of the present invention, frequently executed processes can be offloaded to a new processing unit, and the cooperative processing management unit can concentrate on executing the cooperative processing, so that the processing can be performed efficiently. Can be executed.

Each function of the embodiment described above can be realized by one or more processing circuits. Here, the "processing circuit" in the present specification is a processor programmed to execute each function by software such as a processor implemented by an electronic circuit, or a processor designed to execute each function described above. It shall include devices such as ASIC (Application Specific Integrated Circuit), DSP (digital signal processor), FPGA (field programmable gate array) and conventional circuit modules.

The present invention is not limited to the configurations shown here, such as combinations with other elements in the configurations and the like described in the above embodiments. These points can be changed without departing from the spirit of the present invention, and can be appropriately determined according to the application form thereof.

1 Linked processing system 10 Linked processing device 20 User terminal 30 Network 301 Input unit 302 Output unit 303 Linked processing management unit 304 Instruction management unit 305 Instruction result management unit 306 Processing frequency evaluation unit 307 Processing unit generation unit 308 New processing unit 309 One processing unit 310 Second processing unit 311 Acquisition processing unit 312 Storage processing unit 380 Accepting process 381 First processing process 382 Second processing process 383 Acquisition processing process 384 Storage processing process

Japanese Unexamined Patent Publication No. 2016-11417

Claims (9)

A cooperative processing device in which multiple processing units execute multiple processes in cooperation.
An instruction result management unit that stores the result of executing an instruction sheet that stores the contents of each process of the plurality of processes and the order in which the processes are performed.
Based on the result of executing the instruction, the processing frequency evaluation unit that evaluates the execution frequency of the linked processing included in the instruction, and the processing frequency evaluation unit.
A cooperative processing device including a processing unit generating unit that generates a new processing unit for executing the linked processing based on the execution frequency. The cooperative processing apparatus according to claim 1, wherein the cooperative processing executed by the new processing unit is the same as the processing executed in cooperation with the plurality of processing units. The cooperative processing apparatus according to claim 1 or 2, wherein the processing frequency evaluation unit detects cooperation processing exceeding the evaluation reference value for generating the new processing unit at predetermined intervals. The cooperative processing apparatus according to any one of claims 1 to 3, wherein the cooperative processing is executed as a single process in the new processing unit. The invention according to any one of claims 1 to 4, further comprising an output unit for notifying the result of executing the cooperation process, the name of the new processing unit that executed the cooperation process, and the content of the cooperation process. Coordinated processing device. The cooperative processing device according to any one of claims 1 to 5, wherein the new processing unit executes one of the processes executed by the cooperative processing device. The cooperative processing apparatus according to any one of claims 1 to 6, wherein the processing frequency evaluation unit generates a new processing unit for executing cooperative processing commonly included in a plurality of instructions. A cooperative processing device in which multiple processing units execute multiple processes in cooperation
Based on the result of executing the instruction sheet that stores the content of each process of the plurality of processes and the order in which the processes are performed, the step of evaluating the execution frequency of the cooperative process included in the instruction sheet, and
A method including a step of generating a new processing unit for executing the cooperative processing based on the execution frequency. A cooperative processing device in which multiple processing units execute multiple processes in cooperation
A processing frequency evaluation unit that evaluates the execution frequency of the cooperative processing included in the instruction based on the result of executing the instruction that stores the content of each process of the plurality of processes and the order in which the processes are performed.
A program for functioning as a processing unit generation unit that generates a new processing unit for executing the linked processing based on the execution frequency.

Images