JP2022121295A - Image analysis device, program, and management method - Google Patents

Abstract

To provide an image analysis device, a program, and a management method.SOLUTION: In a system, an EAB (Edge AI Box) 300, which is an image analysis device, includes: an activation unit that performs the control to establish a communication connection with a management platform and receive an image analysis application for analyzing an image from the management platform; an application storage unit that stores an image analysis application; a captured image acquisition unit that acquires a captured image captured by a camera; an image analysis unit that analyzes the captured image acquired by the captured image acquisition unit using the image analysis application stored in the application storage unit; an analysis result transmission unit that transmits the analysis result by the image analysis unit to the management platform; and a deactivation unit that performs the control to delete the image analysis application received from the management platform from the application storage unit and disconnect the communication connection with the management platform, in response to an instruction from the management platform.SELECTED DRAWING: Figure 3

Description

The present invention relates to an image analysis device, program, and management method.

Patent Literature 1 describes a system that performs image analysis using AI (Artificial Intelligence) technology.
[Prior art documents]
[Patent Literature]
[Patent Document 1] JP 2019-079084 A

According to one embodiment of the present invention, an image analysis device is provided. The image analysis device may comprise an activator that establishes a communication connection with the management platform and controls the reception of an image analysis application for analyzing images from the management platform. The image analysis device may include an application storage section that stores an image analysis application. The image analysis device may include a captured image acquisition unit that acquires a captured image captured by a camera. The image analysis device may include an image analysis unit that analyzes the captured image acquired by the captured image acquisition unit using an image analysis application stored in the application storage unit. The image analysis device may include an analysis result transmission unit that transmits analysis results by the image analysis unit to the management platform. The image analysis apparatus may include a deactivation unit that deletes the image analysis application received from the management platform from the application storage unit and disconnects the communication connection with the management platform in accordance with instructions from the management platform.

The management platform may be arranged on a cloud platform, and the image analysis device includes a first device management unit arranged on the OS of the image analysis device and a container engine arranged on the OS of the image analysis device. and a second device management unit disposed on the container engine, the first device management unit functioning as the activation unit and the deactivation unit, and the container engine may include the image It may function as an analysis unit, and the second device management unit may function as the analysis result transmission unit. The activation unit may activate the container engine and cause the container engine to establish a communication connection with the management platform by the second device management unit. The deactivation unit may disconnect the communication connection with the management platform by stopping the container engine. The activation unit may establish a communication connection with the management platform to receive the image analysis application from the management platform when a service contract for the image analysis device by the management platform is established. , the deactivation unit deletes the image analysis application received from the management platform from the application storage unit in accordance with the instruction received from the management platform due to cancellation of the service, and deletes the image analysis application received from the management platform; You may control to cut off the communication connection with. The image analysis device may include another container engine different from the container engine arranged on the OS of the image analysis device, and a third device management unit arranged on the other container engine, The activation unit receives the image analysis application related to the first service from the management platform when a contract for the first service to the container engine and the second device management unit is established by the management platform. Then, when a contract for the second service to the other container engine and the third device management unit is established by the management platform, the image analysis application related to the second service is received from the management platform. The deactivation unit may delete the image analysis application related to the first service from the application storage unit in response to the instruction received from the management platform due to the cancellation of the first service. The image analysis application associated with the second service may be deleted from the application storage unit in response to the instruction received from the management platform due to the cancellation of the second service. The image analysis device may include a log transmission unit that transmits a log in the image analysis device to the management platform in response to an instruction from the management platform. The log transmission unit may transmit one day's worth of logs in the image analysis device to the management platform in response to an instruction from the management platform. The log transmission unit may transmit a log of the image analysis device for a period designated by the management platform to the management platform.

According to one embodiment of the present invention, there is provided a program for causing a computer to function as the image analysis device.

According to one embodiment of the present invention, a computer-implemented management method is provided. The managing method may comprise an activating step of establishing a communication connection with the managing platform to control receiving from the managing platform an image analysis app for analyzing images. The management method may comprise an application storage step of storing the image analysis application in the application storage. The management method may comprise a captured image acquisition step of acquiring a captured image captured by a camera connected to the computer. The management method may comprise an image analysis step of analyzing the captured image using an image analysis application stored in the application storage. The management method may comprise an analysis result sending step of sending the analysis results of the image analysis step to the management platform. The management method may comprise a deactivation step of controlling the image analysis application received from the management platform to be deleted from the application storage and the communication connection with the management platform to be cut off in response to an instruction from the management platform.

It should be noted that the above summary of the invention does not list all the necessary features of the invention. Subcombinations of these feature groups can also be inventions.

An example system 10 is shown schematically. An example of a process flow in system 10 is shown schematically. An example of functional composition of EAB300 is shown roughly. An example of a configuration of EAB 300 is shown schematically. Another example of the configuration of the EAB 300 is schematically shown. An example of a hardware configuration of a computer 1200 functioning as an EAB 300 is shown schematically.

In various services provided by service providers, image analysis technology can be used to improve the quality of services, and to solve labor shortages by improving productivity by replacing work performed by people with devices. be able to contribute. However, image analysis requires specialized knowledge and know-how, and image analysis suitable for services cannot be easily realized. On the other hand, for example, it is conceivable to provide a contracted service provider with an image analysis application for analyzing images that is suitable for the service provided by the service provider. As a result, even service providers who do not have specialized knowledge or know-how of image analysis can incorporate image analysis technology into their services. However, for example, there is a possibility that image analysis know-how or the like may be leaked by reverse engineering the image analysis application after the contract is canceled. The system 10 according to this embodiment provides technology that contributes to solving such problems.

Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. Also, not all combinations of features described in the embodiments are essential for the solution of the invention.

FIG. 1 schematically illustrates an example system 10 . The system 10 includes a management platform (sometimes referred to as management PF) 200 . The system 10 may include an EAB (Edge AI Box) 300 . EAB 300 may be an example of an image analysis device.

System 10 is managed by administrator 100 . The administrator 100 is a service provider that provides image analysis technology to the user 30 through the management PF 200 and the EAB 300, and may be a corporation. User 30 may be a service provider that provides any service.

For example, the administrator 100 provides the EAB 300 to the user 30 who has signed a contract. The user 30 installs the provided EAB 300 in his environment and connects it with the camera 302 . Camera 302 may be a camera owned by user 30 . Camera 302 may also be provided to user 30 by administrator 100 .

EAB 300 establishes connection with management PF 200 via network 40 . Network 40 may include the Internet.

For example, the management PF 200 transmits to the EAB 300 the image analysis application for which the purchase procedure has been completed by the user 30 . The management PF 200 may include multiple types of image analysis applications. A plurality of types of image analysis applications may be generated by the administrator 100 who has image analysis know-how and the like. In addition, a plurality of types of image analysis applications may be generated by an application developer or the like having image analysis know-how and provided to the administrator 100 . The user 30 purchases, for example, an image analysis application related to the service he/she provides.

For example, if the user 30 is a drugstore, the image analysis application analyzes the image captured by the camera 302 such as the entrance of the store, the aisle, and the vicinity of the cash register to determine the congestion situation in the store (number of visitors, social distance).

For example, if the user 30 is a hotel operator, the image analysis application analyzes the captured image captured by the camera 302 in the reception lobby to output the waiting status of the customer, or the image captured by the camera 302 in the restaurant. The vacant seat status may be output by analyzing the picked-up image.

For example, if the user 30 is a bookstore, the image analysis application analyzes the captured images captured by the camera 302 at the entrance of the store and inside the store, and analyzes the number of visitors and the length of stay (time spent in front of each product as interests) results and attribute analysis results (acquisition of gender and age) may be output.

For example, if the user 30 is a medical institution, the image analysis application may output the congestion status of the waiting room by analyzing the captured image captured by the camera 302 in the waiting room of the hospital.

For example, if the user 30 is a railway company, the image analysis application analyzes the captured image captured by the camera 302 on the platform to detect a person or object that is likely to fall from the platform, or It may be one that outputs a result of detecting a person or an object.

For example, if the user 30 is a business operator in the manufacturing industry, the image analysis application detects people who do not follow the walking rules in the factory by analyzing the captured images captured by the cameras 302 in various places in the factory. It may be one that outputs the result of

Management PF 200 is arranged on cloud platform 20 . The cloud platform 20 is, for example, Microsoft Azure (registered trademark). The cloud platform 20 may be GCP (Google Cloud Platform) (registered trademark). The cloud platform 20 may be AWS (Amazon Web Services). The cloud platform 20 may be other than these. Here, the case where the cloud platform 20 is Microsoft Azure will be mainly described as an example.

The EAB 300 analyzes the image captured by the camera 302 using the image analysis application received from the management PF 200 and transmits the analysis result to the management PF 200 . Management PF 200 analyzes the received analysis results. For example, the management PF 200 can visualize the analysis results and provide them to the user 30 . Also, for example, the administrator 100 can provide various information to the user 30 based on the analysis result by the management PF 200 .

FIG. 2 schematically shows an example of a process flow in system 10. As shown in FIG. Here, a state in which the user 30 has made a contract with the administrator 100 and has installed the EAB 300 in his own environment will be described as a start state.

In step (the step may be abbreviated as S) 102 , activation is performed between the EAB 300 and the management PF 200 . For example, the EAB 300 receives connection information for establishing communication connection with the management PF 200 from the management PF 200, and establishes communication connection with the management PF 200 using the connection information.

In S<b>104 , EAB 300 receives the image analysis application from management PF 200 . The EAB 300 stores the received image analysis application in the storage unit. For example, the management PF 200 transmits to the EAB 300 the image analysis application for which the purchase procedure has been completed by the user 30 . The purchase procedure may be performed prior to activation or may be performed during activation.

In S106, the EAB 300 analyzes the captured image captured by the camera 302 using the image analysis application received in S104, and transmits the analysis result to the management PF200. The EAB 300 , for example, continuously receives captured images from the camera 302 , executes analysis according to predetermined timing, and transmits the analysis results to the management PF 200 . Also, the EAB 300 continuously analyzes the captured images, for example, and transmits the analysis result to the management PF 200 when the analysis result satisfies a predetermined condition. The timing of receiving the captured image, the timing of executing the analysis, and the timing of transmitting the analysis result are not limited to these, and may be other timings.

In S108, the management PF 200 transmits a deactivation instruction to the EAB 300. FIG. For example, the management PF 200 transmits a deactivation instruction to the EAB 300 in response to cancellation of the service between the user 30 and the administrator 100 .

In S110, the EAB 300 deletes the image analysis application received in S104 from the storage unit in response to the deactivation instruction from the management PF200. In S112, the EAB 300 disconnects the communication connection with the management PF 200. FIG.

FIG. 3 schematically shows an example of the functional configuration of the EAB 300. As shown in FIG. The EAB 300 includes an activation unit 310, an application storage unit 312, a captured image acquisition unit 314, an image analysis unit 316, an analysis result transmission unit 318, an instruction acquisition unit 320, a deactivation unit 322, a log acquisition unit 324, a log transmission unit 326, and A processing execution unit 328 is provided. It should be noted that it is not essential for the EAB 300 to have all of these.

The activation unit 310 establishes a communication connection with the management PF 200 and controls to receive the image analysis application from the management PF 200 . The activation unit 310, for example, acquires connection information for connecting to the management PF 200 and establishes communication connection with the management PF 200 using the acquired connection information. The connection information may be information for enabling only the EAB 300 of the user 30 who has concluded a contract with the administrator 100 to establish a communication connection with the management PF 200 .

The activation unit 310 may receive from the management PF 200 the image analysis application that the user 30 has purchased. When the user 30 has completed purchase procedures for multiple image analysis applications, the activation unit 310 may receive multiple image analysis applications from the management PF 200 .

Application storage unit 312 stores an image analysis application received from management PF 200 . Application storage unit 312 stores a plurality of image analysis applications when receiving a plurality of image analysis applications from management PF 200 .

A captured image acquisition unit 314 acquires a captured image captured by the camera 302 connected to the EAB 300 from the camera 302 . Multiple cameras 302 may be connected to the EAB 300 . The captured image acquisition unit 314 may acquire captured images captured by each of the plurality of cameras 302 from each of the plurality of cameras 302 . The connection between the EAB 300 and camera 302 may be wired or wireless. The captured image acquisition unit 314 may receive moving images from the camera 302 . The captured image acquisition unit 314 may receive still images from the camera 302 .

The image analysis unit 316 uses an image analysis application stored in the application storage unit 312 to analyze the captured image captured by the captured image acquisition unit 314 . When the captured image acquisition unit 314 acquires captured images from a plurality of cameras 302, the image analysis unit 316 may analyze the captured images using one image analysis application. Further, when the captured image acquisition unit 314 acquires captured images from the plurality of cameras 302, the image analysis unit 316 may analyze each of the plurality of captured images using each of the plurality of image analysis applications. .

The analysis result transmission unit 318 transmits the analysis result by the image analysis unit 316 to the management PF 200 . The analysis result transmission unit 318 may transmit the analysis result to the management PF 200 each time the image analysis unit 316 analyzes the captured image. Further, the analysis result transmission unit 318 may store the analysis result by the image analysis unit 316 and transmit the stored analysis result to the management PF 200 according to predetermined timing.

The instruction acquisition unit 320 acquires various instructions from the management PF 200 . The instruction acquisition unit 320 acquires a deactivation instruction from the management PF 200, for example. The instruction acquisition unit 320 acquires, for example, an instruction from the management PF 200 to transmit various logs in the EAB 300 to the management PF 200 . The instruction acquisition unit 320 acquires execution instructions for various processes from the management PF 200, for example.

The deactivation unit 322 executes deactivation in accordance with the deactivation instruction from the management PF 200 acquired by the instruction acquisition unit 320 . The deactivate unit 322 may delete the image analysis application received from the management PF 200 from the application storage unit 312 . The deactivate unit 322 may perform control to cut off the communication connection with the management PF 200 .

A log acquisition unit 324 acquires various logs in the EAB 300 . The log acquisition unit 324 acquires a log including failure information of the EAB 300, for example. The log acquisition unit 324 acquires a log including a history of command operations on the EAB 300, for example.

The log transmission unit 326 transmits the log acquired by the log acquisition unit 324 to the management PF 200 in response to a log transmission instruction from the management PF 200 . The log transmission unit 326 transmits a log including failure information of the EAB 300 to the management PF 200, for example. The log transmission unit 326 transmits to the management PF 200 a log including, for example, the command operation history for the EAB 300 .

The log transmission unit 326 may transmit one day's worth of logs in the EAB 300 to the management PF 200 in accordance with an instruction from the management PF 200 . The log transmission unit 326 may transmit to the management PF 200 the log in the ON-EAB 300 during the period instructed by the management PF 200 . The log transmission unit 326 may transmit various logs for up to six months to the management PF 200 according to instructions from the management PF 200 .

The processing execution unit 328 executes various types of processing. The processing execution unit 328 executes device monitoring processing of the EAB 300, for example. For example, the process execution unit 328 executes a process of responding to life-and-death monitoring from the management PF 200 . For example, the processing execution unit 328 executes notification processing for periodically notifying the management PF 200 of the resource status of the EAB 300 . The processing execution unit 328 may restart the EAB 300 if the notification fails continuously for one day or more. The process execution unit 328 may restart the EAB 300 or initialize the ID and password according to the instruction from the management PF 200 acquired by the instruction acquisition unit 320 .

FIG. 4 schematically shows an example of the configuration of EAB 300. As shown in FIG. EAB300 may be provided with OS330 (Operating System), WebUI (User Interface) 332, DeviceManagement334, ContainerEngine340, DeviceManagement342, and AIAPP344.

OS 330 may be any known OS. The OS 330 may be Linux (registered trademark), for example.

Web UI 332 may be a user interface between management PF 200 and user 30 . The user 30 can make various inputs to the management PF 200 via the WebUI 332 . The user 30 requests activation of the EAB 300 via the WebUI 332, for example.

DeviceManagement 334 is arranged on OS 330 and operates on OS 330 . DeviceManagement 334 may be a so-called native application. DeviceManagement 334 may be an example of a first device management unit.

The ContainerEngine 340 is arranged on the OS 330 and operates on the OS 330 . The ContainerEngine 340 may be an application that operates by connecting with the cloud platform 20 . The ContainerEngine 340 is built based on Moby, for example. ContainerEngine 340 may be an example of a container engine.

DeviceManagement 342 is placed on ContainerEngine 340 and operates on ContainerEngine 340 . DeviceManagement 342 may be an example of a second device management unit.

AIAPP 344 is placed on ContainerEngine 340 and operates on ContainerEngine 340 . EAB 300 may not have AIAPP 344 before activation and obtain AIAPP 344 from management PF 200 upon activation. AIAPP 344 may be an example of an image analysis application.

Device Management 334 may function as activator 310 and deactivator 322 . ContainerEngine 340 may function as image analysis unit 316 . DeviceManagement 342 may function as analysis result transmitter 318 .

For example, when the management PF 200 establishes a service contract with the EAB 300, the DeviceManagement 334 establishes a communication connection with the management PF 200 and receives the AIAPP 344 from the management PF 200 in response to receiving an activation instruction via the WebUI 332. control to DeviceManagement 334 may launch ContainerEngine 340 . The DeviceManagement 334 may then cause the ContainerEngine 340 to establish a communication connection with the management PF 200 via the DeviceManagement 342 . DeviceManagement 334 may cause ContainerEngine 340 to receive AIAPP 344 by DeviceManagement 342 .

When the Device Management 342 receives a deactivation instruction from the management PF 200, the Device Management 342 may notify the Device Management 334 to that effect. The DeviceManagement 334 may cause the ContainerEngine 340 to delete the AIAPP 344 and stop the ContainerEngine 340 in response to the deactivation instruction from the management PF 200 , thereby disconnecting the communication connection with the management PF 200 .

EAB 300 can perform communication with management PF 200 of cloud platform 20 by DeviceManagement 342 on ContainerEngine 340 . However, DeviceManagement 342 alone cannot stop ContainerEngine 340 or delete AIAPP 344 when, for example, the administrator 100 cancels the service for user 30 . This is because DeviceManagement 342 operates on ContainerEngine 340 , so the parent ContainerEngine 340 cannot be stopped, nor can AIAPP 344 , which is also located on ContainerEngine 340 , be deleted. That is, DeviceManagement 342 alone cannot perform appropriate deactivation.

On the other hand, EAB300 which concerns on this embodiment stops ContainerEngine340 from DeviceManagement334 by further providing DeviceManagement334 which operates on OS330, or deletes AIAPP344. As a result, it is possible to prevent the permanent connection between the ContainerEngine 340 and the management PF 200 from remaining after the service cancellation, and the leakage of the know-how obtained by analyzing the AIAPP 344 due to the AIAPP 344 remaining in the EAB 300 .

FIG. 5 schematically shows another example of the configuration of EAB 300. As shown in FIG. Here, portions different from FIG. 4 will be mainly described. In the example shown in FIG. 5, EAB 300 comprises ContainerEngine 350 , DeviceManagement 352 and AIAPP 354 .

The ContainerEngine 350 is arranged on the OS 330 and operates on the OS 330 . The ContainerEngine 350 may be an application that operates by connecting with the cloud platform 20 . The ContainerEngine 350 is built based on Moby, for example. ContainerEngine 350 may be an example of another container engine.

DeviceManagement 352 is arranged on ContainerEngine 350 and operates on ContainerEngine 350 . DeviceManagement 352 may be an example of a third device management unit.

AIAPP 354 is placed on ContainerEngine 350 and operates on ContainerEngine 350 . EAB 300 may not have AIAPP 354 before activation and obtain AIAPP 354 from management PF 200 upon activation.

AIAPP 344 may be an example of an image analysis app associated with the first service. AIAPP 354 may be an example of an image analysis app associated with the second service.

The DeviceManagement 334 receives the AIAPP 344 from the management PF 200 when the contract for the first service to the ContainerEngine 340 and the DeviceManagement 342 by the management PF 200 is established, and when the contract for the management of the second service to the ContainerEngine 350 and the DeviceManagement 352 by the management PF 200 is established. AIAPP 354 may be received from PF 200 .

DeviceManagement 334 may delete AIAPP 344 from application storage 312 and stop ContainerEngine 340 in response to an instruction received from management PF 200 due to cancellation of the first service. DeviceManagement 334 may delete AIAPP 354 from application storage 312 and stop ContainerEngine 350 in response to an instruction received from management PF 200 due to cancellation of the second service.

In this way, one EAB 300 may be capable of supporting multiple services. In that case, the DeviceManagement 334 may stop the container engine and delete the image analysis application for each service in response to the cancellation.

FIG. 6 schematically shows an example of a hardware configuration of computer 1200 that functions as EAB 300. As shown in FIG. Programs installed on the computer 1200 cause the computer 1200 to function as one or more "parts" of the apparatus of the present embodiments, or cause the computer 1200 to operate or perform operations associated with the apparatus of the present invention. Multiple "units" can be executed and/or the computer 1200 can be caused to execute the process or steps of the process according to the present invention. Such programs may be executed by CPU 1212 to cause computer 1200 to perform certain operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.

Computer 1200 according to this embodiment includes CPU 1212 , RAM 1214 , and graphics controller 1216 , which are interconnected by host controller 1210 . Computer 1200 also includes input/output units such as communication interface 1222 , storage device 1224 , DVD drive, and IC card drive, which are connected to host controller 1210 via input/output controller 1220 . The DVD drive may be a DVD-ROM drive, a DVD-RAM drive, and the like. Storage devices 1224 may be hard disk drives, solid state drives, and the like. Computer 1200 also includes legacy input/output units, such as ROM 1230 and keyboard, which are connected to input/output controller 1220 via input/output chip 1240 .

The CPU 1212 operates according to programs stored in the ROM 1230 and RAM 1214, thereby controlling each unit. Graphics controller 1216 retrieves image data generated by CPU 1212 into a frame buffer or the like provided in RAM 1214 or itself, and causes the image data to be displayed on display device 1218 .

Communication interface 1222 communicates with other electronic devices over a network. Storage device 1224 stores programs and data used by CPU 1212 within computer 1200 . The DVD drive reads programs or data from a DVD-ROM or the like and provides them to the storage device 1224 . The IC card drive reads programs and data from IC cards and/or writes programs and data to IC cards.

ROM 1230 stores therein programs that are dependent on the hardware of computer 1200, such as a boot program that is executed by computer 1200 upon activation. Input/output chip 1240 may also connect various input/output units to input/output controller 1220 via USB ports, parallel ports, serial ports, keyboard ports, mouse ports, and the like.

The program is provided by a computer-readable storage medium such as DVD-ROM or IC card. The program is read from a computer-readable storage medium, installed in storage device 1224 , RAM 1214 , or ROM 1230 , which are also examples of computer-readable storage media, and executed by CPU 1212 . The information processing described within these programs is read by computer 1200 to provide coordination between the programs and the various types of hardware resources described above. An apparatus or method may be configured by implementing information operations or processing according to the use of computer 1200 .

For example, when communication is performed between the computer 1200 and an external device, the CPU 1212 executes a communication program loaded into the RAM 1214 and sends communication processing to the communication interface 1222 based on the processing described in the communication program. you can command. The communication interface 1222 reads transmission data stored in a transmission buffer area provided in a recording medium such as a RAM 1214, a storage device 1224, a DVD-ROM, or an IC card under the control of the CPU 1212, and transmits the read transmission data. Data is transmitted to the network, or received data received from the network is written in a receive buffer area or the like provided on the recording medium.

In addition, the CPU 1212 causes the RAM 1214 to read all or necessary portions of files or databases stored in an external recording medium such as a storage device 1224, a DVD drive (DVD-ROM), an IC card, etc. Various types of processing may be performed on the data. CPU 1212 may then write back the processed data to an external recording medium.

Various types of information, such as various types of programs, data, tables, and databases, may be stored on recording media and subjected to information processing. CPU 1212 performs various types of operations on data read from RAM 1214, information processing, conditional decisions, conditional branching, unconditional branching, and information retrieval, which are described throughout this disclosure and are specified by instruction sequences of programs. Various types of processing may be performed, including /replace, etc., and the results written back to RAM 1214 . In addition, the CPU 1212 may search for information in a file in a recording medium, a database, or the like. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 1212 selects the first attribute from among the plurality of entries. search for an entry that matches the specified condition of the attribute value of the attribute, read the attribute value of the second attribute stored in the entry, and thereby determine the first attribute that satisfies the predetermined condition An attribute value of the associated second attribute may be obtained.

The programs or software modules described above may be stored in a computer-readable storage medium on or near computer 1200 . Also, a recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, whereby the program can be transferred to the computer 1200 via the network. offer.

The blocks in the flowcharts and block diagrams in this embodiment may represent steps in the process in which the operations are performed or "parts" of the apparatus responsible for performing the operations. Certain steps and "sections" may be provided with dedicated circuitry, programmable circuitry provided with computer readable instructions stored on a computer readable storage medium, and/or computer readable instructions provided with computer readable instructions stored on a computer readable storage medium. It may be implemented by a processor. Dedicated circuitry may include digital and/or analog hardware circuitry, and may include integrated circuits (ICs) and/or discrete circuitry. Programmable circuits, such as Field Programmable Gate Arrays (FPGAs), Programmable Logic Arrays (PLAs), etc., perform AND, OR, EXCLUSIVE OR, NOT AND, NOT OR, and other logical operations. , flip-flops, registers, and memory elements.

A computer-readable storage medium may comprise any tangible device capable of storing instructions to be executed by a suitable device, such that a computer-readable storage medium having instructions stored thereon may be illustrated in flowchart or block diagram form. It will comprise an article of manufacture containing instructions that can be executed to create means for performing specified operations. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like. More specific examples of computer readable storage media include floppy disks, diskettes, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory) , electrically erasable programmable read only memory (EEPROM), static random access memory (SRAM), compact disc read only memory (CD-ROM), digital versatile disc (DVD), Blu-ray disc, memory stick , integrated circuit cards, and the like.

The computer readable instructions may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state configuration data, or instructions such as Smalltalk, JAVA, C++, etc. any source or object code written in any combination of one or more programming languages, including object-oriented programming languages, and conventional procedural programming languages such as the "C" programming language or similar programming languages; may include

Computer readable instructions are used to produce means for a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, or programmable circuits to perform the operations specified in the flowchart or block diagrams. A general purpose computer, special purpose computer, or other programmable data processor, locally or over a wide area network (WAN) such as the Internet, etc., to execute such computer readable instructions. It may be provided in the processor of the device or in a programmable circuit. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, and the like.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is obvious to those skilled in the art that various modifications or improvements can be made to the above embodiments. It is clear from the description of the scope of the claims that forms with such modifications or improvements can also be included in the technical scope of the present invention.

The execution order of each process such as actions, procedures, steps, and stages in the devices, systems, programs, and methods shown in the claims, the specification, and the drawings is etc., and it should be noted that they can be implemented in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the specification, and the drawings, even if the description is made using "first," "next," etc. for convenience, it means that it is essential to carry out in this order. not a thing

10 system, 20 cloud platform, 30 user, 40 network, 200 management PF, 300 EAB, 302 camera, 310 activation unit, 312 application storage unit, 314 captured image acquisition unit, 316 image analysis unit, 318 analysis result transmission unit, 320指示取得部、３２２ ディアクティベート部、３２４ ログ取得部、３２６ ログ送信部、３３０ ＯＳ、３３２ ＷｅｂＵＩ、３３４ ＤｅｖｉｃｅＭａｎａｇｅｍｅｎｔ、３４０ ＣｏｎｔａｉｎｅｒＥｎｇｉｎｅ、３４２ ＤｅｖｉｃｅＭａｎａｇｅｍｅｎｔ、３４４ ＡＩＡＰＰ、３５０ ＣｏｎｔａｉｎｅｒＥｎｇｉｎｅ、３５２ ＤｅｖｉｃｅＭａｎａｇｅｍｅｎｔ、３５４ ＡＩＡＰＰ、１２００ コンピュータ、１２１０ host controller 1212 CPU 1214 RAM 1216 graphic controller 1218 display device 1220 input/output controller 1222 communication interface 1224 storage device 1230 ROM 1240 input/output chip

The present invention relates to an image analysis device, program, and management method.

Patent Literature 1 describes a system that performs image analysis using AI (Artificial Intelligence) technology.
[Prior art documents]
[Patent Literature]
[Patent Document 1] JP 2019-079084 A

According to one embodiment of the present invention, an image analysis device is provided. The image analysis device may comprise an activator that establishes a communication connection with the management platform and controls the reception of an image analysis application for analyzing images from the management platform. The image analysis device may include an application storage section that stores an image analysis application. The image analysis device may include a captured image acquisition unit that acquires a captured image captured by a camera. The image analysis device may include an image analysis unit that analyzes the captured image acquired by the captured image acquisition unit using an image analysis application stored in the application storage unit. The image analysis device may include an analysis result transmission unit that transmits analysis results by the image analysis unit to the management platform. The image analysis apparatus may include a deactivation unit that deletes the image analysis application received from the management platform from the application storage unit and disconnects the communication connection with the management platform in accordance with instructions from the management platform.

The management platform may be arranged on a cloud platform, and the image analysis device includes a first device management unit arranged on the OS of the image analysis device and a container engine arranged on the OS of the image analysis device. and a second device management unit disposed on the container engine, the first device management unit functioning as the activation unit and the deactivation unit, and the container engine may include the image It may function as an analysis unit, and the second device management unit may function as the analysis result transmission unit. The activation unit may activate the container engine and cause the container engine to establish a communication connection with the management platform by the second device management unit. The deactivation unit may disconnect the communication connection with the management platform by stopping the container engine. The activation unit may establish a communication connection with the management platform to receive the image analysis application from the management platform when a service contract for the image analysis device by the management platform is established. , the deactivation unit deletes the image analysis application received from the management platform from the application storage unit in accordance with the instruction received from the management platform due to cancellation of the service, and deletes the image analysis application received from the management platform; You may control to cut off the communication connection with. The image analysis device may include another container engine different from the container engine arranged on the OS of the image analysis device, and a third device management unit arranged on the other container engine, The activation unit receives the image analysis application related to the first service from the management platform when a contract for the first service to the container engine and the second device management unit is established by the management platform. Then, when a contract for the second service to the other container engine and the third device management unit is established by the management platform, the image analysis application related to the second service is received from the management platform. The deactivation unit may delete the image analysis application related to the first service from the application storage unit in response to the instruction received from the management platform due to the cancellation of the first service. The image analysis application associated with the second service may be deleted from the application storage unit in response to the instruction received from the management platform due to the cancellation of the second service. The image analysis device may include a log transmission unit that transmits a log in the image analysis device to the management platform in response to an instruction from the management platform. The log transmission unit may transmit one day's worth of logs in the image analysis device to the management platform in response to an instruction from the management platform. The log transmission unit may transmit a log of the image analysis device for a period designated by the management platform to the management platform. The image analysis device may be an EAB (Edge AI (Artificial Intelligence) Box) capable of image analysis by artificial intelligence on the edge side. The image analysis device may be an EAB including an OS (Operating System), WebUI (User Interface), DeviceManagement, ContainerEngine, DeviceManagement, and AI (Artificial Intelligence) APP.

According to one embodiment of the present invention, there is provided a program for causing a computer to function as the image analysis device.

According to one embodiment of the present invention, a computer-implemented management method is provided. The managing method may comprise an activating step of establishing a communication connection with the managing platform to control receiving from the managing platform an image analysis app for analyzing images. The management method may comprise an application storage step of storing the image analysis application in the application storage. The management method may comprise a captured image acquisition step of acquiring a captured image captured by a camera connected to the computer. The management method may comprise an image analysis step of analyzing the captured image using an image analysis application stored in the application storage. The management method may comprise an analysis result sending step of sending the analysis results of the image analysis step to the management platform. The management method may comprise a deactivation step of controlling the image analysis application received from the management platform to be deleted from the application storage and the communication connection with the management platform to be cut off in response to an instruction from the management platform.

It should be noted that the above summary of the invention does not list all the necessary features of the invention. Subcombinations of these feature groups can also be inventions.

An example system 10 is shown schematically. An example of a process flow in system 10 is shown schematically. An example of functional composition of EAB300 is shown roughly. An example of a configuration of EAB 300 is shown schematically. Another example of the configuration of the EAB 300 is schematically shown. An example of a hardware configuration of a computer 1200 functioning as an EAB 300 is shown schematically.

In various services provided by service providers, image analysis technology can be used to improve the quality of services, and to solve labor shortages by improving productivity by replacing work performed by people with devices. be able to contribute. However, image analysis requires specialized knowledge and know-how, and image analysis suitable for services cannot be easily realized. On the other hand, for example, it is conceivable to provide a contracted service provider with an image analysis application for analyzing images that is suitable for the service provided by the service provider. As a result, even service providers who do not have specialized knowledge or know-how of image analysis can incorporate image analysis technology into their services. However, for example, after the contract is canceled, there is a possibility that the image analysis know-how and the like may be leaked by reverse engineering the image analysis application. The system 10 according to this embodiment provides technology that contributes to solving such problems.

Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. Also, not all combinations of features described in the embodiments are essential for the solution of the invention.

FIG. 1 schematically illustrates an example system 10 . The system 10 includes a management platform (sometimes referred to as management PF) 200 . The system 10 may include an EAB (Edge AI Box) 300 . EAB 300 may be an example of an image analysis device.

System 10 is managed by administrator 100 . The administrator 100 is a service provider that provides image analysis technology to the user 30 through the management PF 200 and the EAB 300, and may be a corporation. User 30 may be a service provider that provides any service.

For example, the administrator 100 provides the EAB 300 to the user 30 who has signed a contract. The user 30 installs the provided EAB 300 in his environment and connects it with the camera 302 . Camera 302 may be a camera owned by user 30 . Camera 302 may also be provided to user 30 by administrator 100 .

EAB 300 establishes connection with management PF 200 via network 40 . Network 40 may include the Internet.

For example, the management PF 200 transmits to the EAB 300 the image analysis application for which the purchase procedure has been completed by the user 30 . The management PF 200 may include multiple types of image analysis applications. A plurality of types of image analysis applications may be generated by the administrator 100 who has image analysis know-how and the like. In addition, a plurality of types of image analysis applications may be generated by an application developer or the like having image analysis know-how and provided to the administrator 100 . The user 30 purchases, for example, an image analysis application related to the service he/she provides.

For example, if the user 30 is a drugstore, the image analysis application analyzes the image captured by the camera 302 such as the entrance of the store, the aisle, and the vicinity of the cash register to determine the congestion situation in the store (number of visitors, social distance).

For example, if the user 30 is a hotel operator, the image analysis application analyzes the image captured by the camera 302 in the reception lobby to output the waiting status of the customer, or the camera 302 in the restaurant. The vacant seat status may be output by analyzing the picked-up image.

For example, if the user 30 is a bookstore, the image analysis application analyzes the captured images captured by the camera 302 at the entrance of the store and inside the store, and analyzes the number of visitors and the length of stay (time spent in front of each product as interests) results and attribute analysis results (acquisition of gender and age) may be output.

For example, if the user 30 is a medical institution, the image analysis application may output the congestion status of the waiting room by analyzing the captured image captured by the camera 302 in the waiting room of the hospital.

For example, if the user 30 is a railway company, the image analysis application analyzes the captured image captured by the camera 302 on the platform to detect a person or object that is likely to fall from the platform, or It may be one that outputs a result of detecting a person or an object.

For example, if the user 30 is a business operator in the manufacturing industry, the image analysis application detects a person who does not follow the walking rules in the factory by analyzing the captured images captured by the cameras 302 in various parts of the factory. It may be one that outputs the result of

Management PF 200 is arranged on cloud platform 20 . The cloud platform 20 is, for example, Microsoft Azure (registered trademark). The cloud platform 20 may be GCP (Google Cloud Platform) (registered trademark). The cloud platform 20 may be AWS (Amazon Web Services). The cloud platform 20 may be other than these. Here, the case where the cloud platform 20 is Microsoft Azure will be mainly described as an example.

The EAB 300 analyzes the image captured by the camera 302 using the image analysis application received from the management PF 200 and transmits the analysis result to the management PF 200 . Management PF 200 analyzes the received analysis results. For example, the management PF 200 can visualize the analysis results and provide them to the user 30 . Also, for example, the administrator 100 can provide various information to the user 30 based on the analysis result by the management PF 200 .

FIG. 2 schematically shows an example of a process flow in system 10. As shown in FIG. Here, a state in which the user 30 has made a contract with the administrator 100 and has installed the EAB 300 in his own environment will be described as a start state.

In step (the step may be abbreviated as S) 102 , activation is performed between the EAB 300 and the management PF 200 . For example, the EAB 300 receives connection information for establishing communication connection with the management PF 200 from the management PF 200, and establishes communication connection with the management PF 200 using the connection information.

In S<b>104 , EAB 300 receives the image analysis application from management PF 200 . The EAB 300 stores the received image analysis application in the storage unit. For example, the management PF 200 transmits to the EAB 300 the image analysis application for which the purchase procedure has been completed by the user 30 . The purchase procedure may be performed prior to activation or may be performed during activation.

In S106, the EAB 300 analyzes the captured image captured by the camera 302 using the image analysis application received in S104, and transmits the analysis result to the management PF200. The EAB 300 , for example, continuously receives captured images from the camera 302 , performs analysis according to predetermined timing, and transmits the analysis results to the management PF 200 . Also, the EAB 300 continuously analyzes the captured images, for example, and transmits the analysis result to the management PF 200 when the analysis result satisfies a predetermined condition. The timing of receiving the captured image, the timing of executing the analysis, and the timing of transmitting the analysis result are not limited to these, and may be other timings.

In S108, the management PF 200 transmits a deactivation instruction to the EAB 300. FIG. For example, the management PF 200 transmits a deactivation instruction to the EAB 300 in response to cancellation of the service between the user 30 and the administrator 100 .

In S110, the EAB 300 deletes the image analysis application received in S104 from the storage unit in response to the deactivation instruction from the management PF 200. FIG. In S112, the EAB 300 disconnects the communication connection with the management PF 200. FIG.

FIG. 3 schematically shows an example of the functional configuration of the EAB 300. As shown in FIG. The EAB 300 includes an activation unit 310, an application storage unit 312, a captured image acquisition unit 314, an image analysis unit 316, an analysis result transmission unit 318, an instruction acquisition unit 320, a deactivation unit 322, a log acquisition unit 324, a log transmission unit 326, and A processing execution unit 328 is provided. It should be noted that it is not essential for the EAB 300 to have all of these.

The activation unit 310 establishes a communication connection with the management PF 200 and controls to receive the image analysis application from the management PF 200 . The activation unit 310, for example, acquires connection information for connecting to the management PF 200 and establishes communication connection with the management PF 200 using the acquired connection information. The connection information may be information for enabling only the EAB 300 of the user 30 who has concluded a contract with the administrator 100 to establish a communication connection with the management PF 200 .

The activation unit 310 may receive from the management PF 200 the image analysis application that the user 30 has purchased. When the user 30 has completed purchase procedures for multiple image analysis applications, the activation unit 310 may receive multiple image analysis applications from the management PF 200 .

Application storage unit 312 stores an image analysis application received from management PF 200 . Application storage unit 312 stores a plurality of image analysis applications when receiving a plurality of image analysis applications from management PF 200 .

A captured image acquisition unit 314 acquires a captured image captured by the camera 302 connected to the EAB 300 from the camera 302 . Multiple cameras 302 may be connected to the EAB 300 . The captured image acquisition unit 314 may acquire captured images captured by each of the plurality of cameras 302 from each of the plurality of cameras 302 . The connection between the EAB 300 and camera 302 may be wired or wireless. The captured image acquisition unit 314 may receive moving images from the camera 302 . The captured image acquisition unit 314 may receive still images from the camera 302 .

The image analysis unit 316 uses an image analysis application stored in the application storage unit 312 to analyze the captured image captured by the captured image acquisition unit 314 . When the captured image acquisition unit 314 acquires captured images from a plurality of cameras 302, the image analysis unit 316 may analyze the captured images using one image analysis application. Further, when the captured image acquisition unit 314 acquires captured images from the plurality of cameras 302, the image analysis unit 316 may analyze each of the plurality of captured images using each of the plurality of image analysis applications. .

The analysis result transmission unit 318 transmits the analysis result by the image analysis unit 316 to the management PF 200 . The analysis result transmission unit 318 may transmit the analysis result to the management PF 200 each time the image analysis unit 316 analyzes the captured image. Further, the analysis result transmission unit 318 may store the analysis result by the image analysis unit 316 and transmit the stored analysis result to the management PF 200 according to predetermined timing.

The instruction acquisition unit 320 acquires various instructions from the management PF 200 . The instruction acquisition unit 320 acquires a deactivation instruction from the management PF 200, for example. The instruction acquisition unit 320 acquires, for example, an instruction from the management PF 200 to transmit various logs in the EAB 300 to the management PF 200 . The instruction acquisition unit 320 acquires execution instructions for various processes from the management PF 200, for example.

The deactivation unit 322 executes deactivation in accordance with the deactivation instruction from the management PF 200 acquired by the instruction acquisition unit 320 . The deactivate unit 322 may delete the image analysis application received from the management PF 200 from the application storage unit 312 . The deactivate unit 322 may perform control to cut off the communication connection with the management PF 200 .

A log acquisition unit 324 acquires various logs in the EAB 300 . The log acquisition unit 324 acquires a log including failure information of the EAB 300, for example. The log acquisition unit 324 acquires a log including a history of command operations on the EAB 300, for example.

The log transmission unit 326 transmits the log acquired by the log acquisition unit 324 to the management PF 200 in response to a log transmission instruction from the management PF 200 . The log transmission unit 326 transmits a log including failure information of the EAB 300 to the management PF 200, for example. The log transmission unit 326 transmits to the management PF 200 a log including, for example, the command operation history for the EAB 300 .

The log transmission unit 326 may transmit one day's worth of logs in the EAB 300 to the management PF 200 in accordance with an instruction from the management PF 200 . The log transmission unit 326 may transmit to the management PF 200 the log in the ON-EAB 300 during the period instructed by the management PF 200 . The log transmission unit 326 may transmit various logs for up to six months to the management PF 200 according to instructions from the management PF 200 .

The processing execution unit 328 executes various types of processing. The processing execution unit 328 executes device monitoring processing of the EAB 300, for example. For example, the process execution unit 328 executes a process of responding to life-and-death monitoring from the management PF 200 . For example, the processing execution unit 328 executes notification processing for periodically notifying the management PF 200 of the resource status of the EAB 300 . The processing execution unit 328 may restart the EAB 300 if the notification fails continuously for one day or more. The process execution unit 328 may restart the EAB 300 or initialize the ID and password according to the instruction from the management PF 200 acquired by the instruction acquisition unit 320 .

FIG. 4 schematically shows an example of the configuration of EAB 300. As shown in FIG. EAB300 may be provided with OS330 (Operating System), WebUI (User Interface) 332, DeviceManagement334, ContainerEngine340, DeviceManagement342, and AIAPP344.

OS 330 may be any known OS. The OS 330 may be Linux (registered trademark), for example.

Web UI 332 may be a user interface between management PF 200 and user 30 . The user 30 can make various inputs to the management PF 200 via the WebUI 332 . The user 30 requests activation of the EAB 300 via the WebUI 332, for example.

DeviceManagement 334 is arranged on OS 330 and operates on OS 330 . DeviceManagement 334 may be a so-called native application. DeviceManagement 334 may be an example of a first device management unit.

The ContainerEngine 340 is arranged on the OS 330 and operates on the OS 330 . The ContainerEngine 340 may be an application that operates by connecting with the cloud platform 20 . The ContainerEngine 340 is built based on Moby, for example. ContainerEngine 340 may be an example of a container engine.

DeviceManagement 342 is placed on ContainerEngine 340 and operates on ContainerEngine 340 . DeviceManagement 342 may be an example of a second device management unit.

AIAPP 344 is placed on ContainerEngine 340 and operates on ContainerEngine 340 . EAB 300 may not have AIAPP 344 before activation and obtain AIAPP 344 from management PF 200 upon activation. AIAPP 344 may be an example of an image analysis application.

Device Management 334 may function as activator 310 and deactivator 322 . ContainerEngine 340 may function as image analysis unit 316 . DeviceManagement 342 may function as analysis result transmitter 318 .

For example, when the management PF 200 establishes a service contract with the EAB 300, the DeviceManagement 334 establishes a communication connection with the management PF 200 and receives the AIAPP 344 from the management PF 200 in response to receiving an activation instruction via the WebUI 332. control to DeviceManagement 334 may launch ContainerEngine 340 . The DeviceManagement 334 may then cause the ContainerEngine 340 to establish a communication connection with the management PF 200 via the DeviceManagement 342 . DeviceManagement 334 may cause ContainerEngine 340 to receive AIAPP 344 by DeviceManagement 342 .

When the Device Management 342 receives a deactivation instruction from the management PF 200, the Device Management 342 may notify the Device Management 334 to that effect. The DeviceManagement 334 may cause the ContainerEngine 340 to delete the AIAPP 344 and stop the ContainerEngine 340 in response to the deactivation instruction from the management PF 200 , thereby disconnecting the communication connection with the management PF 200 .

EAB 300 can perform communication with management PF 200 of cloud platform 20 by DeviceManagement 342 on ContainerEngine 340 . However, DeviceManagement 342 alone cannot stop ContainerEngine 340 or delete AIAPP 344 when, for example, the administrator 100 cancels the service for user 30 . This is because DeviceManagement 342 operates on ContainerEngine 340 , so the parent ContainerEngine 340 cannot be stopped, nor can AIAPP 344 , which is also located on ContainerEngine 340 , be deleted. That is, DeviceManagement 342 alone cannot perform appropriate deactivation.

On the other hand, EAB300 which concerns on this embodiment stops ContainerEngine340 from DeviceManagement334 by further providing DeviceManagement334 which operates on OS330, or deletes AIAPP344. As a result, it is possible to prevent the constant connection between the ContainerEngine 340 and the management PF 200 from remaining after the service cancellation, and the leakage of the know-how obtained by analyzing the AIAPP 344 due to the AIAPP 344 remaining in the EAB 300 .

FIG. 5 schematically shows another example of the configuration of EAB 300. As shown in FIG. Here, portions different from FIG. 4 will be mainly described. In the example shown in FIG. 5, EAB 300 comprises ContainerEngine 350 , DeviceManagement 352 and AIAPP 354 .

The ContainerEngine 350 is arranged on the OS 330 and operates on the OS 330 . The ContainerEngine 350 may be an application that operates by connecting with the cloud platform 20 . The ContainerEngine 350 is built based on Moby, for example. ContainerEngine 350 may be an example of another container engine.

DeviceManagement 352 is arranged on ContainerEngine 350 and operates on ContainerEngine 350 . DeviceManagement 352 may be an example of a third device management unit.

AIAPP 354 is placed on ContainerEngine 350 and operates on ContainerEngine 350 . EAB 300 may not have AIAPP 354 before activation and obtain AIAPP 354 from management PF 200 upon activation.

AIAPP 344 may be an example of an image analysis app associated with the first service. AIAPP 354 may be an example of an image analysis app associated with the second service.

The DeviceManagement 334 receives the AIAPP 344 from the management PF 200 when the contract for the first service to the ContainerEngine 340 and the DeviceManagement 342 by the management PF 200 is established, and when the contract for the management of the second service to the ContainerEngine 350 and the DeviceManagement 352 by the management PF 200 is established. AIAPP 354 may be received from PF 200 .

DeviceManagement 334 may delete AIAPP 344 from application storage 312 and stop ContainerEngine 340 in response to an instruction received from management PF 200 due to cancellation of the first service. DeviceManagement 334 may delete AIAPP 354 from application storage 312 and stop ContainerEngine 350 in response to an instruction received from management PF 200 due to cancellation of the second service.

In this way, one EAB 300 may be capable of supporting multiple services. In that case, the DeviceManagement 334 may stop the container engine and delete the image analysis application for each service in response to the cancellation.

FIG. 6 schematically shows an example of a hardware configuration of computer 1200 that functions as EAB 300. As shown in FIG. Programs installed on the computer 1200 cause the computer 1200 to function as one or more "parts" of the apparatus of the present embodiments, or cause the computer 1200 to operate or perform operations associated with the apparatus of the present invention. Multiple "units" can be executed and/or the computer 1200 can be caused to execute the process or steps of the process according to the present invention. Such programs may be executed by CPU 1212 to cause computer 1200 to perform certain operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.

Computer 1200 according to this embodiment includes CPU 1212 , RAM 1214 , and graphics controller 1216 , which are interconnected by host controller 1210 . Computer 1200 also includes input/output units such as communication interface 1222 , storage device 1224 , DVD drive, and IC card drive, which are connected to host controller 1210 via input/output controller 1220 . The DVD drive may be a DVD-ROM drive, a DVD-RAM drive, and the like. Storage devices 1224 may be hard disk drives, solid state drives, and the like. Computer 1200 also includes legacy input/output units such as ROM 1230 and keyboard, which are connected to input/output controller 1220 via input/output chip 1240 .

The CPU 1212 operates according to programs stored in the ROM 1230 and RAM 1214, thereby controlling each unit. Graphics controller 1216 retrieves image data generated by CPU 1212 into a frame buffer or the like provided in RAM 1214 or itself, and causes the image data to be displayed on display device 1218 .

Communication interface 1222 communicates with other electronic devices over a network. Storage device 1224 stores programs and data used by CPU 1212 within computer 1200 . The DVD drive reads programs or data from a DVD-ROM or the like and provides them to the storage device 1224 . The IC card drive reads programs and data from IC cards and/or writes programs and data to IC cards.

ROM 1230 stores therein programs that are dependent on the hardware of computer 1200, such as a boot program that is executed by computer 1200 upon activation. Input/output chip 1240 may also connect various input/output units to input/output controller 1220 via USB ports, parallel ports, serial ports, keyboard ports, mouse ports, and the like.

The program is provided by a computer-readable storage medium such as DVD-ROM or IC card. The program is read from a computer-readable storage medium, installed in storage device 1224 , RAM 1214 , or ROM 1230 , which are also examples of computer-readable storage media, and executed by CPU 1212 . The information processing described within these programs is read by computer 1200 to provide coordination between the programs and the various types of hardware resources described above. An apparatus or method may be configured by implementing information operations or processing according to the use of computer 1200 .

For example, when communication is performed between the computer 1200 and an external device, the CPU 1212 executes a communication program loaded into the RAM 1214 and sends communication processing to the communication interface 1222 based on the processing described in the communication program. you can command. The communication interface 1222 reads transmission data stored in a transmission buffer area provided in a recording medium such as a RAM 1214, a storage device 1224, a DVD-ROM, or an IC card under the control of the CPU 1212, and transmits the read transmission data. Data is transmitted to the network, or received data received from the network is written in a receive buffer area or the like provided on the recording medium.

In addition, the CPU 1212 causes the RAM 1214 to read all or necessary portions of files or databases stored in an external recording medium such as a storage device 1224, a DVD drive (DVD-ROM), an IC card, etc. Various types of processing may be performed on the data. CPU 1212 may then write back the processed data to an external recording medium.

Various types of information, such as various types of programs, data, tables, and databases, may be stored on recording media and subjected to information processing. CPU 1212 performs various types of operations on data read from RAM 1214, information processing, conditional decisions, conditional branching, unconditional branching, and information retrieval, which are described throughout this disclosure and are specified by instruction sequences of programs. Various types of processing may be performed, including /replace, etc., and the results written back to RAM 1214 . In addition, the CPU 1212 may search for information in a file in a recording medium, a database, or the like. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 1212 selects the first attribute from among the plurality of entries. search for an entry that matches the specified condition of the attribute value of the attribute, read the attribute value of the second attribute stored in the entry, and thereby determine the first attribute that satisfies the predetermined condition An attribute value of the associated second attribute may be obtained.

The programs or software modules described above may be stored in a computer-readable storage medium on or near computer 1200 . Also, a recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, whereby the program can be transferred to the computer 1200 via the network. offer.

The blocks in the flowcharts and block diagrams in this embodiment may represent steps in a process in which operations are performed or "portions" of devices responsible for performing the operations. Certain steps and "portions" may be provided with dedicated circuitry, programmable circuitry provided with computer readable instructions stored on a computer readable storage medium, and/or computer readable instructions provided with computer readable instructions stored on a computer readable storage medium. It may be implemented by a processor. Dedicated circuitry may include digital and/or analog hardware circuitry, and may include integrated circuits (ICs) and/or discrete circuitry. Programmable circuits, such as Field Programmable Gate Arrays (FPGAs), Programmable Logic Arrays (PLAs), etc., perform AND, OR, EXCLUSIVE OR, NOT AND, NOT OR, and other logical operations. , flip-flops, registers, and memory elements.

A computer-readable storage medium may comprise any tangible device capable of storing instructions to be executed by a suitable device, such that a computer-readable storage medium having instructions stored thereon may be illustrated in flowchart or block diagram form. It will comprise an article of manufacture containing instructions that can be executed to create means for performing specified operations. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like. More specific examples of computer readable storage media include floppy disks, diskettes, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory) , electrically erasable programmable read only memory (EEPROM), static random access memory (SRAM), compact disc read only memory (CD-ROM), digital versatile disc (DVD), Blu-ray disc, memory stick , integrated circuit cards, and the like.

The computer readable instructions may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state configuration data, or instructions such as Smalltalk, JAVA, C++, etc. any source or object code written in any combination of one or more programming languages, including object-oriented programming languages, and conventional procedural programming languages such as the "C" programming language or similar programming languages; may include

Computer readable instructions are used to produce means for a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, or programmable circuits to perform the operations specified in the flowchart or block diagrams. A general purpose computer, special purpose computer, or other programmable data processor, locally or over a wide area network (WAN) such as the Internet, etc., to execute such computer readable instructions. It may be provided in the processor of the device or in a programmable circuit. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, and the like.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. It is obvious to those skilled in the art that various modifications or improvements can be made to the above embodiments. It is clear from the description of the scope of the claims that forms with such modifications or improvements can also be included in the technical scope of the present invention.

The execution order of each process such as actions, procedures, steps, and stages in the devices, systems, programs, and methods shown in the claims, the specification, and the drawings is etc., and it should be noted that they can be implemented in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the specification, and the drawings, even if the description is made using "first," "next," etc. for convenience, it means that it is essential to carry out in this order. not a thing

10 system, 20 cloud platform, 30 user, 40 network, 200 management PF, 300 EAB, 302 camera, 310 activation unit, 312 application storage unit, 314 captured image acquisition unit, 316 image analysis unit, 318 analysis result transmission unit, 320指示取得部、３２２ ディアクティベート部、３２４ ログ取得部、３２６ ログ送信部、３３０ ＯＳ、３３２ ＷｅｂＵＩ、３３４ ＤｅｖｉｃｅＭａｎａｇｅｍｅｎｔ、３４０ ＣｏｎｔａｉｎｅｒＥｎｇｉｎｅ、３４２ ＤｅｖｉｃｅＭａｎａｇｅｍｅｎｔ、３４４ ＡＩＡＰＰ、３５０ ＣｏｎｔａｉｎｅｒＥｎｇｉｎｅ、３５２ ＤｅｖｉｃｅＭａｎａｇｅｍｅｎｔ、３５４ ＡＩＡＰＰ、１２００ コンピュータ、１２１０ host controller 1212 CPU 1214 RAM 1216 graphic controller 1218 display device 1220 input/output controller 1222 communication interface 1224 storage device 1230 ROM 1240 input/output chip

Claims (11)

an activating unit that establishes a communication connection with a management platform and controls to receive an image analysis application that analyzes an image from the management platform;
an application storage unit that stores the image analysis application;
a captured image acquisition unit that acquires a captured image captured by a camera;
an image analysis unit that analyzes the captured image acquired by the captured image acquisition unit using the image analysis application stored in the application storage unit;
an analysis result transmission unit that transmits analysis results by the image analysis unit to the management platform;
and a deactivating unit that controls to delete the image analysis application received from the management platform from the application storage unit and disconnect the communication connection with the management platform in accordance with an instruction from the management platform. Device. the management platform is located on a cloud platform;
The image analysis device is
a first device management unit arranged on the OS of the image analysis apparatus;
a container engine arranged on the OS of the image analysis device;
a second device management unit disposed on the container engine;
The first device management unit functions as the activation unit and the deactivation unit,
The container engine functions as the image analysis unit,
The image analysis apparatus according to claim 1, wherein said second device management section functions as said analysis result transmission section. 3. The image analysis apparatus according to claim 2, wherein said activation unit activates said container engine and causes said container engine to establish a communication connection with said management platform by means of said second device management unit. 4. The image analysis apparatus according to claim 2, wherein the deactivation unit disconnects the communication connection with the management platform by stopping the container engine. The activation unit establishes a communication connection with the management platform and controls to receive the image analysis application from the management platform when a service contract for the image analysis device by the management platform is established,
The deactivation unit deletes the image analysis application received from the management platform from the application storage unit in accordance with the instruction received from the management platform due to cancellation of the service, and deletes the image analysis application received from the management platform. 5. The image analysis apparatus according to any one of claims 2 to 4, wherein said communication connection is cut off. another container engine different from the container engine arranged on the OS of the image analysis device;
a third device management unit arranged on the other container engine;
The activation unit receives the image analysis application related to the first service from the management platform when a contract for the first service to the container engine and the second device management unit is established by the management platform. and when a contract for the second service is established with the other container engine and the third device management unit by the management platform, the image analysis application related to the second service is received from the management platform. ,
The deactivation unit deletes the image analysis application related to the first service from the application storage unit in accordance with the instruction received from the management platform due to cancellation of the first service, 6. The image analysis application according to claim 5, wherein the image analysis application related to the second service is deleted from the application storage unit in accordance with the instruction received from the management platform due to cancellation of the second service. Image analysis device. The image analysis device according to any one of claims 1 to 6, further comprising: a log transmission unit that transmits a log in said image analysis device to said management platform in response to an instruction from said management platform. 8. The image analysis device according to claim 7, wherein said log transmission unit transmits logs for one day in said image analysis device to said management platform in accordance with an instruction from said management platform. 9. The image analysis apparatus according to claim 7, wherein said log transmission unit transmits a log in said image analysis apparatus for a period specified by said management platform to said management platform. A program for causing a computer to function as the image analysis apparatus according to any one of claims 1 to 9. A computer-implemented management method comprising:
an activating step of establishing a communication connection with a management platform and controlling the reception of an image analysis application for analyzing images from said management platform;
an application storing step of storing the image analysis application in an application storage unit;
a captured image acquiring step of acquiring a captured image captured by a camera connected to the computer;
an image analysis step of analyzing the captured image using the image analysis application stored in the application storage;
an analysis result transmission step of transmitting the analysis result in the image analysis step to the management platform;
a deactivation step of deleting the image analysis application received from the management platform from the application storage unit and disconnecting the communication connection with the management platform in response to an instruction from the management platform. .

Images