JP7017766B1 - Information processing device and software generation support method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing apparatus and a software generation support method for realizing various functions by combining various data and information. An information processing device includes a display device, an operation device, and a processor. The display device connects a plurality of icons corresponding to a plurality of modules indicating a part of the software connection state with a line indicating the software connection state and displays them on the screen. The processor instructed the input section or output section of the first icon corresponding to the first module to connect a line via the operating device, and added the input / output relationship between each of the plurality of modules. Based on the connection availability information indicating whether or not the connection is possible, it is determined whether or not the connection between modules is possible, and if the connection between modules is possible, a line is connected to the input unit or output unit of the first icon. According to the order in which each icon is connected by a line, each module corresponding to each icon is linked to support software generation. [Selection diagram] Fig. 1

Description

The present disclosure relates to an information processing apparatus that supports software generation and a software generation support method.

Conventionally, a method for creating software components for converting software into components has been known. In this software component creation method, a list of data components corresponding to objects is displayed in the data component list area of the GUI screen, and a list of linked components in which a connecting part connecting multiple objects is made into components is displayed in the link component list area. To display each. The parts editor arranges the parts selected from each parts list area as element parts in the position specified by the user in the parts definition area according to the operation of the user. Further, the component editor is for connecting the desired terminals of the group of terminals of each element component arranged in the component definition area and the group of terminals of the component defined in the software component to be created. It is described that the terminals are connected by an arrow indicating a data transmission direction according to a user's operation (see Patent Document 1).

Japanese Patent Application Laid-Open No. 2003-223321

In the software component creation method of Patent Document 1, data and information can be automatically input / output by selecting a data component or a link component as a software component. However, for example, for a general user who is not familiar with software generation, what kind of data or information should be selected in order to realize a specific function, and how the selected data or information should be selected. It is difficult to recognize whether they should work together. Therefore, it is desirable that even a general user can easily generate software by using software components.

This disclosure has been made in view of the above circumstances, and is an information processing device and software generation support that allows even a general user to easily construct software that realizes various functions by combining various data and information. Provide a method.

One aspect of the present disclosure is an information processing apparatus that supports the generation of software, comprising a processor, a display device, and an operation device, wherein the display device indicates a part of a connected state of the software. A plurality of icons corresponding to the modules are connected by a line indicating the connection state of the software and displayed on the screen, and the plurality of modules are a processing module indicating at least one process executed by the software and the processing module. The icon includes a data module indicating at least one data used for processing and a device module indicating a device that is a source of the data, and the icon is an attribute that displays information indicating an attribute of the module corresponding to the icon. A unit, an input unit in which the module inputs data or processing results from one previous-stage module in the connected state, and an output unit in which the module outputs data or processing results to one subsequent-stage module in the connected state. The input unit of each icon can be connected to at least one output unit of another icon via the line, and the output unit of each icon can be connected to another icon via the line. The icon and the line position on the screen are movable, the shape of the line on the screen is deformable, and the processor is the operation. The line was instructed to be connected to the input unit or the output unit of the first icon corresponding to the first module via the device, and the input / output relationship between each of the plurality of modules was added. The connection possibility information indicating the connection possibility is acquired, and based on the connection possibility information, the first output unit or the input unit of the second icon corresponding to the second module is connected to the first unit via the line. It is determined whether or not the inter-module connection connecting the input unit or the output unit indicated by the icon is possible, and if the inter-module connection is possible, the input unit or the output unit of the first icon is used. When the line is connected to the output unit and the connection between the modules is not possible, one or more second modules that can intervene between the first module and the second module based on the connection availability information. It is determined whether or not the third module exists, and if the third module does not exist, the first icon is not connected to the input unit or the output unit of the first icon. And the line is displayed, or a marker indicating that the input unit or the output unit of the first icon and the line cannot be connected is displayed, and each icon is connected according to the state of being connected by the line. , An information processing device that generates the software by linking each module corresponding to each icon.

One aspect of the present disclosure is a software generation support method for supporting data generation, in which a processor displays a plurality of icons corresponding to a plurality of modules indicating a part of the software connection state by displaying the software connection state. The plurality of modules have a processing module indicating at least one process executed by the software and at least one data used for the process. The icon includes a data module and a device module indicating a device that is a source of the data, and the icon includes an attribute unit that displays information indicating the attributes of the module corresponding to the icon, and the module is in the connected state. It has an input unit for inputting data or processing results from one previous-stage module, and an output unit for outputting data or processing results to one subsequent-stage module in the connected state, and the input of each icon. The unit can be connected to at least one output unit of another icon via the line, and the output unit of each icon can be connected to at least one input unit of another icon via the line. The icon and the position of the line on the screen are movable, the shape of the line on the screen is deformable, and the software generation support method is such that the processor makes the first module. The step of instructing the input unit or the output unit of the corresponding first icon to connect the line, and the connection availability information indicating the connection availability in consideration of the input / output relationship between each of the plurality of modules. Based on the acquisition step and the connection availability information, the output unit or the input unit of the second icon corresponding to the second module is instructed by the first icon via the line. The step of determining whether or not the inter-module connection connecting the input unit or the output unit is possible, and when the inter-module connection is possible, the input unit or the output unit of the first icon is described. One or more third steps that can intervene between the first module and the second module based on the step of connecting the lines and the connection availability information when the connection between the modules is not possible. It is determined whether or not a module exists, and if the third module does not exist, the line is connected to the input unit or the output unit of the first icon. A step of displaying the first icon and the line, or displaying a marker indicating that the input unit or the output unit of the first icon cannot be connected to the line, and each icon. Is a software generation support method having a step of linking each module corresponding to each icon to generate the software according to the state of being connected by the line.

According to the present disclosure, even a general user can easily construct software that realizes various functions by combining various data and information.

A block diagram showing a hardware configuration example of the software generation support device according to the first embodiment. Diagram showing an example of software generation support screen Diagram showing a configuration example of a module icon Diagram showing an example of category list information Diagram showing an example of module list information Diagram showing an example of connection availability information Diagram showing an example of module selection when measuring the number of passersby in a shopping district A diagram showing an example of module selection when collecting data such as the date and time, weather, temperature, or event of a shopping street. The figure which shows the screen display example at the time of software generation which collects and saves data by a software generation support device A diagram showing an example of screen display when learning by AI and predicting the future with a software generation support device. Flow chart showing an operation example by software generation support device Flow chart showing an operation example during module determination processing by the software generation support device Flow chart showing an operation example during connection processing between modules by the software generation support device Flow chart showing other operation examples during connection processing between modules by software generation support device Flow chart showing other operation examples during connection processing between modules by software generation support device Flow chart showing an example of change processing of connected modules by software generation support device Flow chart showing other operation examples during connection processing between modules by software generation support device Flow chart showing other operation examples during module determination processing by software generation support device Diagram showing a display example of a marker Diagram showing other display examples of markers

Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanations of already well-known matters and duplicate explanations for substantially the same configuration may be omitted. This is to avoid unnecessary redundancy of the following description and to facilitate the understanding of those skilled in the art. It should be noted that the accompanying drawings and the following description are provided for those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

For example, the "part" or "device" in the embodiment is not limited to a physical configuration realized by hardware, but also includes a function realized by software such as a program. Further, the function of one configuration may be realized by two or more physical configurations, or the function of two or more configurations may be realized by, for example, one physical configuration.

(First Embodiment)
(Configuration of software generation support device)
FIG. 1 is a diagram showing a hardware configuration example of the software generation support device 100 according to the first embodiment. The software generation support device 100 includes a processor 110, a communication device 120, a memory 130, an operation device 140, and a display device 150. The software generation support device 100 may be, for example, a PC (Personal Computer), a server device, a tablet terminal, a mobile terminal, or the like.

The processor 110 may include an MPU (Micro processing Unit), a CPU (Central Processing Unit), a DSP (Digital Signal Processor), and the like. The processor 110 realizes various functions of the software generation support device 100 (for example, a function related to support for software generation) by executing a program held in the memory 130. The processor 110 comprehensively controls each part of the software generation support device 100 and performs various processes.

The communication device 120 communicates various data and information. The communication method by the communication device 120 may be a wireless communication or a wired communication method, for example, WAN (Wide Area Network), LAN (Local Area Network), infrared communication, cellular communication for mobile phones (for example, 5G, LTE (Long)). It may include communication methods such as Term Evolution)) and power line communication.

The memory 130 includes, for example, a RAM (Random Access Memory) and a ROM (Read Only Memory). The memory 130 includes a primary storage device (eg, RAM or ROM). The memory 130 may include a secondary storage device (for example, HDD (Hard Disk Drive) or SSD (Solid State Drive)) or a tertiary storage device (for example, an optical disk or SD card). The memory 130 may include other storage devices. The memory 130 stores various data, information, programs, and the like.

The operating device 140 may include various buttons, keys, switches, keyboards, touchpads, touch panels, microphones, or other operating devices. The operation device 140 accepts input of various data and information.

The display device 150 may include a liquid crystal display device, an organic EL device, or other display device. The display device 170 displays various data and information.

Next, the outline of the support for generating the software of the present embodiment will be described.

The processor 110 performs processing related to supporting the generation of software. The processor 110 generates a plurality of software components (software modules, also simply referred to as "modules") constituting the software, and connects (coordinates) the plurality of software components (modules) to generate one software.

That is, each of the plurality of modules shows a part of the connection state of the software to be generated, and shows a part of the software generation process. The module may be, for example, various data related to software, various processes themselves, an input source or output destination of various data, or an input source or output destination of various processes. The plurality of modules include, for example, a processing module indicating at least one process executed by the software, a data module indicating at least one data used for this process, and a device module indicating a device that is a source of data. May include.

FIG. 2 is a diagram showing an example of a software generation support screen.

The processor 110 connects the module icons MA corresponding to the plurality of modules by the line LN according to the software generation order, and displays them on the screen G1. This screen G1 is a software generation support screen that supports software generation.

A module icon MA corresponding to a module for generating software is arranged on the screen G1. The module icons MA are arranged in order according to the order of processing related to the software. For example, the module icon MA corresponding to the data used for the predetermined process or the module of the process executed before the predetermined process is arranged on the input side of the module icon MA corresponding to the module of the predetermined process. For example, the module icon MA corresponding to the data obtained by the predetermined process or the module of the process executed after the predetermined process is arranged on the output side of the module icon MA corresponding to the module of the predetermined process.

The two module icons MA (for example, adjacent module icons MA) displayed on the screen G1 are connected by a line LN. That is, the line LN defines the input / output relationship of the modules corresponding to the two module icons MA connected to both ends of the line. The module corresponding to the module icon MA arranged on the front stage side in the software connection state (generation process) by connecting the line LN is also referred to as a front stage module. A module corresponding to the module icon MA arranged on the rear stage side in the software connection state (generation process) by connecting the line LN is also referred to as a rear stage module. The screen area MA2 displays the processing result of the module that processes the output as a preview image.

FIG. 3 is a diagram showing a configuration example of the module icon MA. The module icon MA includes an attribute unit 11, an input unit 12, and an output unit 13. The input unit 12 may be absent from the frontmost module (for example, a device module) in the connected state of the software. Further, the output unit 13 may not be present in the last module (for example, display module, target module) in the connected state of the software.

The attribute unit 11 displays information about the attributes of the module corresponding to the module icon MA having the attribute unit 11. The attribute of the module here may include the content of the process performed by the module and the content of the data handled by the module. For example, when displaying information related to data, the attribute unit 11 may display by characters, figures, symbols, shapes, etc. indicating the contents of the data, or may display a file in which the data is stored. , A table listing the data may be displayed, or information about other data may be displayed. When displaying information related to processing, the attribute unit 11 may display information on a function, program, or application that performs processing, may display an image diagram or illustration showing processing, or information on other processing. May be displayed.

The input unit 12 is connected to another module icon MA via a line LN. The input unit 12 is, for example, a virtual input terminal for inputting data from another module corresponding to the other module icon MA to the module corresponding to the module icon MA. The module corresponding to the module icon MA can input data output from another module corresponding to the other module icon MA connected to the input unit 12 as input data, or can correspond to the other module icon MA. The processing result of the pre-processing, which is the processing corresponding to the module of, is input as input data. Further, the module corresponding to the module icon MA may input the function of this module and the information of the supply source to which the data is supplied as input data. The input data may be used, for example, as an argument of an algorithm executed by the module or as a part of processing.

The output unit 13 is connected to another module icon MA via a line LN. The output unit 13 is, for example, a virtual output terminal that outputs data from a module corresponding to the module icon MA to another module corresponding to another module icon MA. The module corresponding to the module icon MA outputs the data used by another module corresponding to the other module icon MA connected to the output unit 13 as output data, or another module corresponding to the other module icon MA. Data used for post-processing, which is the processing corresponding to the module, is output as output data. Further, the module corresponding to the module icon MA may output the information of the supply source indicated by this module as output data. The output data may be used, for example, as an argument or processing of an algorithm executed by another module.

The module icon MA has, for example, a rectangular shape. The attribute unit 11 is located at the center of the module icon MA, for example. The input unit 12 is inverted so as to surround a part (for example, about half) of the attribute unit 11 along one end side of the rectangular shape (for example, the peripheral end of the left half of the module icon MA in FIG. 3). It may be formed in a U-shape (or U-shape). The output unit 13 surrounds a part (for example, about half) of the attribute unit 11 along the other end side of the rectangular shape (for example, the peripheral end of the right half of the module icon MA in FIG. 3). It may be formed in a U shape (or an inverted U shape).

As a result, in the software generation support device 100, the input unit 12 and the output unit 13 of the module icon MA are formed so as to surround the attribute unit 11 in half as a whole, so that the input unit 12 and the output unit 12 are more than general terminals. The area of the output unit 13 is large, and the line LN can be easily connected to the input unit 12 and the output unit 13 from any direction.

Specifically, the shape of the module icon MA (an example of an icon) is a pair of sides along the X direction (an example of the first direction) and a pair along the Y direction perpendicular to the X direction (an example of the second direction). It may have a rectangular shape composed of the sides of. The input unit 12 of the module icon MA includes one end side of each of the pair of sides along the X direction (for example, the left side of FIG. 3) and a side connected to one end side of the pair of sides along the Y direction. It's fine. The output unit 13 of the module icon MA includes the other end side of each of the pair of sides along the X direction (for example, the right side in FIG. 3), the side connected to the other end side of the pair of sides along the Y direction, and the other side. May include.

As a result, the input unit 12 and the output unit 13 are formed in a U-shape and an inverted U-shape along the peripheral end of the rectangular module icon MA. Therefore, the software generation support device 100 can easily connect the line LN to the input unit 12 and the output unit 13 from any direction (for example, the left side or the vertical direction on the input side in FIG. 3 and the right side or the vertical direction on the output side). can.

Further, the input unit 12 and the output unit 13 of the module icon MA may be shown in different display modes as shown in FIG. As a result, the user can see the screen G1 at a glance and confirm the connection relationship of the plurality of module icons MA (for example, upstream and downstream in the software generation process). That is, when the user tries to connect the line LN to the input unit 12 or the output unit 13 of the module icon MA via the operation device 140, the user determines whether the line LN is the input unit 12 or the output unit 13 of the module icon MA. It becomes easy to distinguish. Therefore, the user can easily connect the line LN to the module icon MA and reduce connection errors.

Next, the software categories and modules will be described in detail.

Each of the modules is categorized into categories for generating software. The category is a classification of software connection states (generation processes) into multiple categories. Each of the plurality of modules belongs to one of the categories and specifically shows a part of the connection state of the predetermined software.

A menu button B1 is arranged on the screen G1 shown in FIG. When the menu button B1 is pressed via the operating device 140, the processor 110 displays a list of categories as a menu.

FIG. 4 is a diagram showing an example of category list information I1. The category includes, for example, a device category, a data source category, a data category, a data filter category, a processing category, a display format category, a display category, or a target category. The category may include other categories (for example, the AI category described later). Information indicating what kind of category exists may be included in the category list information I1 and held in the memory 130.

Each category has one or more modules. The processor 110 may select a module from the category information via the operating device 140. Information indicating what kind of module exists in each category may be included in the module list information I2 and held in the memory 130. Module list information I2 may be provided for each category. FIG. 5 is a diagram showing an example of module list information I2.

The device category is a category such as hardware for acquiring data used for software processing. Modules belonging to the device category are also referred to as device modules. The device module includes a device such as a PC (Personal Computer), a smartphone, or a sensor that provides data.

The data source category is a category of software or various functions for acquiring data used for software processing. Modules that belong to the data source category are also referred to as data source modules. A data source module is a module that connects a device and data. For example, the device module can be a notebook PC and the data source module can be a camera.

Various data sources can be considered as data sources. For example, there is a data source that accompanies the device. For example, there are a camera function, a laser scanner function, a position acquisition function, and a microphone function (voice information acquisition function) in a notebook PC device. In addition to the above, there are functions that can acquire data from an external server or the like. For example, there are a mail function, an SNS function, a WEB-related function, and the like.

A data category is a category that indicates data from a device or data source. Modules that belong to the data category are also referred to as data modules. The data module inputs various data from the device module or the data source module (also referred to as a data collection module). When either the device module or the data source module is provided, either the device module or the data source module may not be provided.

For example, the data module acquires various data in the form of mail, paper / PDF data, and various data from an application, various systems, various clouds, and the like.

The data filter category is a category for changing the format of data or adjusting data in order to process the acquired data. Modules that belong to the data filter category are also referred to as data filter modules.

The data filter module converts the collected data into a format corresponding to the processing module, filters the collected data, and stores the collected data in the memory 130 or the like. The data filter module can integrate a plurality of stored data and output it to the processing module. The data filter module may store the collected or integrated data in the memory 130 or the like, or may store the collected or integrated data on the cloud via the communication device 120. The data filter module can match the format, for example, by filtering or format conversion, and can handle the data and information exchanged by each module.

The processing category is a category that executes software processing. Modules belonging to the processing category are also referred to as processing modules.

The display format category is a category in which the format of the data is changed, filtered, or the data is processed in order to display the data obtained by the processing. Modules that belong to the display format category are also referred to as display format modules. The display format category can be, for example, matched in format by filtering or format conversion, and can handle data and information exchanged in each module.

The display category is a category for displaying the adjusted data of the display format of the data obtained by the processing. Modules that belong to the display category are also referred to as display modules. The display module can specify the display format (for example, 3D (three-dimensional) display, 2D (two-dimensional) display, or graph display), which device to display, and the like. In the display, for example, 2D information or 3D information may be visualized based on 3D data including 3D position information, point cloud data, a map, an analysis engine, and the like.

The purpose category is a category indicating the purpose for which the processing of the software is performed, that is, a category indicating the purpose for operating the information processing apparatus that executes the software. Modules that belong to the target category are also referred to as target modules.

Objectives in the objective category represent, for example, a wide range of objectives, from solving management issues and optimizing profit structures to simple statistical processing. The object may include sales transitions for a certain period (for example, monthly or daily), customer repeat rate, homepage browsing frequency, homepage ordering rate, customer attributes, etc., which are important indicators in business.

The processor 110 has a function of automatically selecting or displaying a list of each module in each category for realizing the purpose of the target module. For example, the processor 110 determines a target module, determines a data module related to data suitable for the target module, and displays a module icon MA corresponding to the determined target module and a module icon MA corresponding to the data module on the screen. Place it on G1 and display it. In this case, the processor 110 displays the module icon MA corresponding to the representative series of modules of each category on the screen G1 in order to realize the determined purpose based on the determined data, and the module 110 is in the series of modules. Each of two adjacent module icons MA in the processing order (in the generation process) may be connected by a line LN and displayed on the screen G1. In this case, the processor 110 determines whether or not the two module icons MA can be connected, that is, whether or not the two modules can be connected, for example, the connection possibility information (which will be described later) held in the memory 130. It may be determined based on (see FIG. 6).

That is, the software generation support device 100 can associate a series of modules from the data category to the display category with the purpose of the target module, and displays the module icon MA corresponding to the series of modules associated with the purpose on the screen G1. Can be made to.

The processor 110 performs the acquisition, processing, display, and other necessary processing of the data realized by each module by deciding to make the indicated set of modules a software component, for example via the operating device 140. Generate software to run. This software is software that can achieve a determined purpose. The software generation support device 100 or other information processing device can achieve the purpose of the target module by executing the generated software.

Next, the features of the software generation support by the software generation support device 100 will be illustrated.

The processor 110 may select a specific module in a specific category by operating the screen G1 via the operation device 140 and selecting, for example, a menu, a category, and a module in this order. Specifically, when the processor 110 clicks the menu button B1 on the screen G1 via the operation device 140, a plurality of categories (for example, a category list) are displayed. When one category is selected from a plurality of categories via the operation device 140, the processor 110 displays a plurality of modules (for example, a module list) belonging to the selected category. The processor 110 can select a specific module in a specific category by selecting one module from a plurality of modules via the operation device 140, and displays the module icon MA corresponding to the specific module on the screen G1. It is possible.

Further, when a plurality of modules belonging to the category selected from the menu exist, the processor 110 uses the category icon CA (not shown) corresponding to the selected category instead of the module icon MA corresponding to the specific module. It may be displayed on the screen G1. The category icon CA is an icon indicating that any module in the category is arranged, and indicates that a specific module icon MA is undecided. Whether or not there are a plurality of modules belonging to the selected category may be determined based on the module list information I2. When the processor 110 detects that the category icon CA is instructed via the operating device 140 on the screen G1, the processor 110 displays a list of modules belonging to the selected category via the display device 150. The indication of the category icon CA may include, for example, the cursor being placed or the category icon CA being clicked. The processor 110 may select and determine a desired module from the list of modules in the selection category via the operating device 140, and display the module icon MA corresponding to the determined module on the screen G1. ..

Further, when the processor 110 has one module belonging to the selection category and the module belonging to the selection category can be uniquely determined without any room for selection, the processor 110 determines the module of the selection category and corresponds to the determined module. The module icon MA to be displayed is displayed on the screen G1.

Further, when the processor 110 detects that the input unit 12 or the output unit 13 of the displayed module icon MA is instructed (for example, the cursor is placed or clicked on the module icon MA), the module icon MA Candidates for the front-stage module or the rear-stage module corresponding to the module icon MA of the front-stage or the rear-stage that can be connected to the are displayed in the form of a selection list (for example, a module list).

Further, the processor 110 connects between two module icons MA corresponding to two predetermined modules (modules corresponding to two adjacent processes in the generation process) based on the connection availability information held in the memory 130. Judge whether it is possible or not. Whether or not the connection is possible here may indicate, for example, whether or not the output unit 13 of the module icon MA in the previous stage can be connected to the input unit 12 of a certain module icon MA via the line LN. .. Further, whether or not the connection is possible here may indicate whether or not the input unit 12 of the module icon MA in the subsequent stage can be connected to the output unit 13 of a certain module icon MA via the line LN. .. Whether or not connection is possible may be determined based on the connection availability information, that is, taking into account the input / output relationship of the data and processing of each module corresponding to each module icon MA. When the predetermined two module icons MA can be connected, the line LN to be connected is displayed on the screen G1. The connection by the line LN indicates that the two modules corresponding to the two module icons MA connected by the line LN can operate in consideration of the connected input / output order. When the two module icon MAs can be connected, the processing and data of the two modules corresponding to the two module icon MAs can be linked (coordinated).

Further, when the line LN is not connected to the input unit 12 or the output unit 13 of the module icon MA displayed on the screen G1, the processor 110 clicks the input unit 12 or the output unit 13 to click the input. One end of the new line LN may be connected to the unit 12 or the output unit 13 and displayed on the screen G1. The processor 110 can move the other end of the line LN via the operating device 140, for example using a cursor, and may connect the other end of the line LN to another module icon MA. In this case, the line LN is based on the connection availability information held in the memory 130, that is, the input / output relationship of the two modules corresponding to the two module icon MAs connected to one end and the other end of the line LN is taken into consideration. Only when it is possible to connect between two module icons MA connected to both ends of the above, the clicked module icon MA and another module icon MA may be connectable.

Further, when the processor 110 clicks the line LN between the two connected module icons MA via the operation device 140, the end portion (one end or the other end) of the line LN closer to the click position is input. The module icon MA connected to the unit 12 or the output unit 13 may be separated from the module icon MA, and the connection may be disconnected. In this case, the end of the disconnected line LN can be connected to another connectable module icon MA.

It is assumed that the processor 110 determines that any two module icon MAs via the line LN cannot be connected to each other based on the connection availability information held in the memory 130. The fact that the two module icons MA cannot be connected to each other means that the output unit 13 of the second module icon MA cannot be connected to the input unit 12 of the first module via the line LN, and the first module. It is shown that the output unit 13 of the second module icon MA cannot be connected to the input unit 12 of the icon MA via the line LN. In this case, the processor 110 prohibits connecting the two modules via the line LN. That is, even if two module icon MAs that cannot connect one end and the other end of the line LN are to be connected to each other, they are not connected.

Instead, when the processor 110 tries to connect two unconnectable module icons MA with a line LN, the processor 110 displays the category icon CA of the category to which the module corresponding to the unconnectable module icon MA belongs on the screen G1. Alternatively, other module icons MA corresponding to other modules belonging to this category may be displayed. The processor 110 may be connected to the input unit 12 or the output unit 13 of the other displayed module icon MA with the end portion of the above line LN. The operation when the category icon CA is displayed is the same as described above. When the category icon CA is instructed via the operation device 140, the module list is displayed and one of the module list is displayed. Other modules may be selected. Further, when a plurality of modules that can be connected instead exist in the same category, the processor 110 displays a list of modules that can be connected in consideration of the input / output relationship based on the connection availability information, and operates. One module may be selected via device 140. Processor 110 may connect the module icon MA corresponding to the selected module to the end of the line LN that was not connectable.

Next, an example of detecting modules that can be connected will be described.

FIG. 6 is a diagram showing an example of connection availability information I3. The connection availability information I3 is held in the memory 130. FIG. 6 shows each device module belonging to the device category, each data source module belonging to the data source category, and each data module belonging to the data category. Then, whether or not the module icons MA corresponding to the modules of different categories can be connected, that is, whether or not the data or processing input or output to each module can be connected is indicated by a straight line with an arrow. There is. The arrow indicates the flow of data or processing, and indicates that the data or processing output from the root side of the arrow can be input to the module on the tip side of the arrow.

As a result, software can be generated by each connectable module repeating data input / output and processing in order in the software generation process. That is, the modules that can be linked between a plurality of categories are predetermined. The connection availability information I3 includes information on which module in which category can be connected to each module in each category. Whether or not the two modules can be connected may take into account, for example, whether or not the formats for input / output match each other. Two modules (for example, processing modules) in the same category have a context (input / output relationship) in the software generation process and may be connected.

In FIG. 6, as the device module, for example, a smartphone (also referred to simply as a smartphone), a notebook PC, a personal computer, a server, a camera (storefront), a laser scanner, a sensor (for example, various sensors provided in the smartphone), a remote control, or a voice recognition device. Etc. are included. The camera (storefront) indicates a camera installed in the storefront. The data source module includes camera function, laser scanner function, position acquisition function, microphone function, voice text function, direction acquisition function, tilt angle acquisition function, mail function, SNS (Social Networking Service) function, WEB information acquisition function, and WEB. It includes a browsing history acquisition function, a purchase history acquisition function, a communication history acquisition function, a contact acquisition function, and the like. That is, in the input / output relationship between the data module and the data source module, the function of the device is the data source. The data module also includes an image, video, 3D point cloud, latitude / longitude, water depth, altitude, velocity, acceleration, mail, address, telephone number, and the like.

For example, a notebook PC as a device module has a camera function as a data source module, a microphone function, a voice text function, a direction acquisition function, an inclination angle acquisition function, a mail function, an SNS function, a WEB information acquisition function, and a WEB browsing history acquisition function. Or, it is connected to the purchase history acquisition function by a straight line with an angle, indicating that both modules can be connected in consideration of the input / output relationship. Further, the laser scanner as a device module can be connected to a 3D point cloud as a data module. Further, the camera function as a data source module can be linked with an image and a video as a data module. Further, the laser scanner function as a data source module can be connected to a 3D point cloud as a data module. Further, the notebook PC as a device module can be linked with an email, an address, and a telephone number as a data module. In this way, when various devices as devices can directly acquire data, the intervention of the data source module can be omitted.

That is, the processor 110 can determine whether or not connection between a plurality of modules is possible, and which module should be interposed in order to connect between the plurality of modules, based on the connection availability information I3. .. For example, when the notebook PC is selected as the device module and the image is selected as the data module, the processor 110 functions as a data source module between the notebook PC module and the image module in the connection availability information I3. If it is selected and intervened, it can be determined that the notebook PC and the image can be connected via the camera function.

It should be noted that the connection permission / rejection between the two modules shown by the straight line with an arrow in FIG. 6 is an example, and may be related to other connection permission / rejection. The connection permission / rejection information I3 may include connection permission / rejection information between various two modules of various categories.

Next, an example of selecting modules in each category will be described.

FIG. 7 is a diagram showing an example of selecting a module when measuring the number of passersby in a shopping district. In FIG. 7, the illustration of the category after the processing category is omitted. Here, the target module may be to measure the number of passersby in the shopping district, or may be an arbitrary process using the measurement result of the number of passersby in the shopping district (for example, sales forecast of the store). May be good.

FIG. 7 shows that the processor 110 selects one module in each category based on the connection availability information I3, and two modules in two adjacent categories are concatenated. This corresponds to the module icon MA corresponding to two modules of two adjacent categories on the screen G1 being connected by a line LN. Further, FIG. 7 shows that the modules in the latter stage (output side) that can be connected to this module are displayed in the module list list corresponding to the modules selected in each category, and one module is selected. There is.

For example, a device category is selected from the menu, a camera (storefront) is selected as the device module, video is selected as the data module, image recognition is selected as the data filter, and pedestrian count counting is selected as the processing category. Ru. In this case, since the camera (storefront) is selected as the device module, it is shown that the video and the photograph (an example of the image) are displayed on the screen G1 as the module list of the data module in the subsequent stage. Further, since the video is selected as the data module, it is shown that the image recognition, the image extraction, the image processing, and the image change are displayed on the screen G1 as the module list list of the data filter module in the subsequent stage. In addition, since image recognition is selected as the data filter module, the number of pedestrians (also simply described as pedestrian) and the number of bicycles (also simply described as bicycle) are measured as the module list of the processing module in the subsequent stage. ), Counting the number of cars (simply described as a car), Counting the number of animals (simply described as an animal), Counting the number of plants (simply described as a plant), and Counting the number of buildings (simply also described as a building) Is displayed on the screen G1.

By selecting the camera (storefront) module as the device module, it is possible to acquire an image (for example, a video (video) or a photograph (still image)) that uses the number of passersby in the shopping district for counting. As such, the data source module is unnecessary and not selected.

Therefore, by connecting a series of selected modules, the processor 110 captures an image by a camera installed at a store in a shopping district, recognizes the image of the image, and recognizes the number of pedestrians. Build software to do. An information processing device such as a processor 110 can count the number of passersby in a shopping district by executing this software.

FIG. 8 is a diagram showing an example of selecting a module when collecting data such as the date and time, weather, temperature, or event of a shopping district. In FIG. 8, the illustration of the category after the processing category is omitted. Here, the target module may be to store various data, or may be an arbitrary process using various data (for example, sales forecast of a store).

FIG. 8 shows that the processor 110 selects one module in each category based on the connectability information I3, and two modules in two adjacent categories are connected by a line LN. This corresponds to the module icon MA corresponding to two modules of two adjacent categories on the screen G1 being connected by a line LN. Further, in FIG. 8, the modules in the latter stage (output side) that can be connected to this module are displayed in the module list according to the modules selected in each category, and one or more modules are selected. Shows.

For example, the data source category is selected from the menu (not shown), the WEB information acquisition function is selected as the data source module, and multiple modules (year / month / day, time, day, holiday, specific (○ city)) are selected as the data module. Weather in a specific place, temperature in a specific place, humidity in a specific place, events in a specific place (events in the vicinity of ○ city), news in a specific place (news in the neighborhood of ○ city), national events, And national news) is selected, and save is selected as the processing module. In this case, since the WEB information acquisition function is selected as the data source module, the date, time, day, holiday, weather of the specific (○ city) location, and identification are used as the module list of the data module in the subsequent stage. Location temperature, specific location humidity, specific location events (○ city neighborhood events), specific location news (○ city neighborhood news), national events, and national news It is shown that it is displayed on the screen G1. Further, since the above-mentioned various data are selected as the data module, it is shown that saving and transmitting are displayed on the screen G1 as a module list of the data filter module in the subsequent stage.

Therefore, the processor 110 constructs software for acquiring and storing each data included in the WEB information by the WEB information acquisition function by concatenating a series of selected modules. By executing this software, an information processing device such as a processor 110 can collect data on the date and time (date, time, etc.), weather, temperature, event, etc. of the shopping district. The information on the location of the shopping district may be acquired by, for example, the position acquisition function of a smartphone possessed by a pedestrian walking in the shopping district.

FIG. 9 is a diagram showing an example of a screen display at the time of software generation for collecting and storing data by the software generation support device 100. In FIG. 9, the illustration of the category after the processing category is omitted. Here, the target module may be to store various data, or may be an arbitrary process using various data (for example, sales forecast of a store). In FIG. 9, the module icon MA corresponding to each selected module is displayed on the screen G1.

FIG. 9 illustrates the generation of software that collects and stores data from three lines. The data of the three systems are data for measuring the number of passersby (number of pedestrians) in the shopping district, data on the shopping district (for example, data on weather, temperature, events, news, date and time, location, etc.), and data. It includes data on the sales of stores in the shopping district (for example, the product name of the purchased product, the price of the product, the gender of the purchaser, the age of the purchaser, the date and time of purchase, and the place of purchase). Since the module related to the measurement of the number of pedestrians is the same as the content shown in FIG. 7, the description will be omitted or simplified. Since the module related to the collection of data related to the shopping district is the same as the content shown in FIG. 8, the description will be omitted or simplified. In addition, a part of the number of pedestrians may include a person who enters or opens a store in a predetermined store. In addition, some people who enter or open a store may purchase products at the store. Therefore, for example, the sales information of the store can be calculated based on the measurement result of the number of pedestrians.

Modules related to pedestrian number measurement include a camera (storefront) module M11 as a device module, a video, date and time, and location module M12 as a data module, and a pedestrian number measurement module M13 as a processing module. including. The module icons MA11 to MA13 corresponding to the modules M11 to M13 are displayed on the screen G1. A line LN is connected between the module icons MA11 to MA13 in consideration of the input / output relationship. The date and time of the data module is arbitrary, but if the date and time is the current time, the data module acquires real-time video as video. As shown in the module M12, a plurality of modules belonging to the category may be collectively displayed on the screen G1 as one module.

In this case, as in FIG. 7, the processor 110 adds a module corresponding to the image recognition module as a data filter module between the data module and the processing module in order to recognize the pedestrian from the image. You may. In this case, the processor 110 may display the module icon MA corresponding to the module for image recognition on the screen G1.

The module for collecting data about the shopping district includes the module M14 for the WEB information acquisition function as a device source module, and the module M15 for the weather, temperature, event, news, date and time, and place as a data module. The module icon MA corresponding to these modules M14 and M15 is displayed on the screen G1. A line LN is connected between the module icons MA14 and MA15 in consideration of the input / output relationship.

The modules for collecting data related to store sales are the POS (Point of sale) (store) module M16 as a device module, the product name of the purchased product as a data module, the price of the product, and the gender of the purchaser. Includes the age of the purchaser, the date and time of purchase, and the module M17 at the place of purchase. The POS (point of sale) refers to a POS terminal installed in a store. The module icons MA16 and MA17 corresponding to these modules M16 and M17 are displayed on the screen G1. Then, a line LN is connected between each module icon MA in consideration of the input / output relationship.

Further, each of the module icons MA13, MA15, and MA17 and the module icon MA18 corresponding to the data storage module M18 as a processing module are connected via each line LN. Therefore, the module M4 has a function of storing data on the number of pedestrians, data on the shopping district, and data on the sales of the store in the memory 130 or the like.

Therefore, the processor 110 can construct a software component that stores the following three systems of data by a series of modules corresponding to the series of module icons MA connected by the line LN. The data of one system is obtained by capturing an image at a predetermined date and time and place by a camera installed at the storefront of a store in a shopping district, measuring the number of pedestrians based on the image, and measuring the number of pedestrians. It is data. The data of the other one system is each data such as the date and time, the weather, the temperature, the event, the news, the date and time, and the place of the shopping district acquired from the WEB information by the WEB information acquisition function. The data of the other one system is the product name of the purchased product, the price of the product, the gender of the purchaser, the age of the purchaser, the date and time of purchase, and the place of purchase collected from the POS terminal installed in the store. Each data.

As described above, the processor 110 generates software for collecting and storing data of the three systems based on the connection availability information I3 and the arrangement relationship of each module and the connection relationship of the line LN. For example, the processor 110 can acquire incidental information such as a date, weather, and time in the shopping district and the vicinity of the store from the WEB information. In addition, store information (for example, POS information) can be stored as another data. Then, in the data storage, for example, the obtained number of pedestrians, incidental information, store information, etc. can be saved while being associated with the time information (date and time information, etc.). The data saved here can be used for performing various processes in the real space, or can be used as learning data of a learning device as described later.

In FIG. 9, the Start / Stop button B2 is displayed. By selecting the Start / Stop button B2 via the operating device 140, the processor 110 executes a process related to a series of modules (for example, a series of processes related to data storage), that is, the generated software. The processor 110 may end the execution of the running software by selecting the Start / Stop button B2 again via the operating device 140.

FIG. 10 is a diagram showing a screen display example when learning by AI and future prediction are performed by the software generation support device 100. FIG. 10 illustrates that the target module is today's sales forecast. The module icon MA70 corresponding to the target module may be connected and displayed on the output side of the module icon MA55 via the line LN.

The category may include the AI category together with the above-mentioned data category and the like. The AI category may include a plurality of categories comprehensively. For example, the AI category may include a data category, a data filter category, a processing category, a display category, and the like. In this case, the AI category data module is also referred to as an AI data module, the AI category data filter module is also referred to as an AI data filter module, the AI category processing module is also referred to as an AI processing module, and the AI category display module is also referred to as an AI processing module.

In FIG. 10, one or more module icons MA5 (MA51, MA52, ...) Corresponding to the AI module M5 (M51, M52, M53, ...), Which is a module related to AI learning, are arranged on the screen G1. One or more module icons MA6 (MA61, MA62, ...) Corresponding to modules M6 (M61, M62, ...) Related to processing in the real world are arranged. The processor 110 generates software components that realize predetermined functions related to AI (for example, a store sales forecast function) by each AI module M5. The processor 110 generates software components that realize a predetermined function in the real world (for example, a pedestrian number measuring function in a shopping district) by each module M6 related to processing in the real world.

The module M6 (each module corresponding to the module icons MA61 to MA63) that realizes the pedestrian number measurement function of the shopping street in the real world is the same as the module corresponding to each module icon MA11 to MA13 shown in FIG. Therefore, the description thereof will be omitted. The pedestrian number measurement function of FIG. 10 measures the measurement of the number of pedestrians in real time by using the real-time image captured by the camera installed in the storefront of the store.

In FIG. 10, the module icons MA51 to MA55 corresponding to the AI modules M51 to M55 are displayed on the screen G1. The AI module M51 is an AI data module which is arbitrary data necessary for prediction (for example, data including a purchase date and time of a product and a place of purchase). The AI module M52 is an AI data filter module that concatenates (associates) acquired data such as purchase date and time and purchase location. The AI module M53 is an AI processing module that generates a learner. This learner forecasts sales based on the data obtained via the AI data filter. The AI module M54 uses the generated learning device to measure the number of pedestrians in a shopping district based on real-time images, and the day (today) (an example of the purchase date and time) at a predetermined store (an example of a purchase place). It is an AI processing module that calculates a sales forecast (for example, sales) of. The AI module M55 is an AI display module that displays the calculation result of today's sales forecast on a predetermined display device (for example, display device 150) in a graph format.

In FIG. 10, the processor 110 connects two adjacent module icon MAs of the module icon MAs by a line LN based on the connection availability information I3 in consideration of the software generation process. The processor 110 concatenates the data and processing of each module (including the AI module M5) connected by a line to generate software.

By connecting AI modules M51 to M53 in order by line LN, the processor 110 is software that generates a learning device for predicting store sales based on arbitrary data necessary for sales prediction such as past data. Build the parts. Although the module icon corresponding to the device module or the data source module which is the data source is not shown here, for example, the data source is the memory 130.

The AI module M54 is defined by today's target module based on the processing results obtained by each AI module M regarding AI learning and the processing results obtained by each module MR regarding processing in the real world. It is an AI processing module that performs processing to realize sales forecast. The AI module M54 corresponds to a module that makes inferences by a learner. The AI module M55 is an AI display module that displays the inference result by the learner.

Therefore, the processor 110 measures based on real-time images captured by a camera (storefront) using, for example, a learning device that has learned the calculation of sales forecasts based on data (for example, past actual data) as software. Based on the number of pedestrians in the shopping street in the real world, today's sales are predicted, and software is generated to display the predicted information on a predetermined display device by a graph or the like.

The learner predicts sales at a predetermined place (for example, a predetermined store) and a predetermined date and time (for example, today). The learning device is pre-learned to predict sales at a predetermined place (for example, a predetermined store) and a predetermined date and time (for example, today) based on data necessary for sales forecast (for example, purchase place, purchase date and time). It is a trained model that has been trained.

The learner can use any condition for forecasting sales (for example, the number of pedestrians in a predetermined time zone of a shopping district where the target store is located, and incidental information about the target store or shopping district in the same predetermined time zone (for example, weather, weather, etc.). Events, news, date and time, or place), or POS data of the target store (for example, purchased product name, price, gender) in the same predetermined time zone, etc. are used as learning input data. The input data here is. For example, it may be various data stored in the memory 130. The learner generates output data corresponding to arbitrary input data (arbitrary conditions), and the learner generates output data corresponding to arbitrary input data (arbitrary conditions). The past sales record in the predetermined time zone of the target store in the above is used as the correct answer data. A large number of the input data and the correct answer data corresponding to the input data may be held in the memory 130 as the past record.

The processor 110 causes the learner to perform machine learning based on the input data and the correct answer data. In this case, the processor 110 trains the learner by adjusting the parameters of the learner so that the output data corresponding to the input data approaches the correct answer data corresponding to the input data. The processor 110 may generate a learner by deep learning using a neural network. The neural network may be, for example, a DNN (Deep Neural Network). As a result, the processor 110 can perform sales forecast corresponding to an arbitrary condition with high accuracy by using the learning device.

In this way, the processor 110 can generate software that has the function of AI and performs learning and inference. The above is an example, and what the learner learns and what the learner infers is arbitrary. The processor 110 determines the learning content of the learning device and the inference content by the learning device based on the types of the input data and the teacher data. With such an AI function, the software generation support device 100 can easily link, for example, digital twin data collection and 3D display with artificial intelligence, and can easily construct software that can predict the future.

Next, module interpolation will be described.

If the program based on one or more modules determined by the user through the operating device 140 alone cannot achieve the purpose of the target module, the processor 110 may assist in interpolating the missing module. Modules may be interpolated automatically. At the time of module interpolation, a list of modules that can be connected to the input side or the output side may be displayed and can be selected via the operation device 140. In this case, the software generation support device 100 can support the selection of the module desired by the user. Further, in the case of module interpolation, a series of modules that can be connected between the two modules may be interpolated. In this case, the user can perform module interpolation without having to select a module from the list.

For example, the processor 110 displays the category icon CA or the module icon MA related to a certain category on the screen G1 by selecting the modules of the categories before and after the certain category in the software generation process via the operation device 140. It's okay. For example, when the processor 110 selects an arbitrary device module and an arbitrary data module, the data source category icon may be displayed on the screen G1. Alternatively, in this case, the processor 110 can connect the output unit 13 of the module icon MA of the device module to the input unit 12 based on the connection availability information I3, and the input unit of the module icon MA of the data module to the output unit 13. The module icon MA of the data source module to which 12 can be connected may be displayed on the screen G1. Similarly, the processor 110 may display the category icon CA of the data filter or the module icon MA based on the connection availability information I3 on the screen G1 by selecting the data module and the processing module.

Further, when the number of modules determined by the user via the operation device 140 is one, the processor 110 sequentially connects modules that can be connected to the front stage side or the rear stage side of this module in the software generation process. It may be connected. For example, the processor 110 may sequentially determine the modules that can be connected to the input side and the output side of the module, and display the module icon MA corresponding to the module for which the connection is determined in order on the screen G1.

Next, an operation example of the software generation support device 100 will be described. According to the operation example here, a series of module icons MA connected to the line LN as shown in FIGS. 9 and 10 are displayed on the screen G1.

FIG. 11 is a flowchart showing an operation example by the software generation support device 100.

First, the processor 110 determines a module of the category desired by the user from the menu via the operation device 140, and displays the module icon MA corresponding to the determined module (module determination process) (S1). At the stage of step S1, the module icons MA (for example, the module icons MA11 to MA18 in FIG. 9) determined from the menu are only arranged on the screen G1, and the line LN is not displayed. When displaying a plurality of module icons MA on the screen G1, the processor 110 arranges, for example, adjacent modules adjacent to each other on the screen G1 in the software generation process. In this case, the user can easily understand the software generation process intuitively.

Based on the connection availability information I3, the processor 110 connects, for example, between a plurality of displayed module icons MA by a line LN, connects between a plurality of module icons, and lines together with the module icon MA via the line LN. Display the LN on the screen G1 (connection processing between modules) (S2).

In the connection process between modules, for example, the processor 110 selects an operation (line connection operation) for connecting between the module icons MA by a line LN from the menu, and inputs and outputs the input unit 12 and the output of each module icon MA. One end and the other end of the line LN are connected to the portion 13 in order. In the connection process between modules, the line LN may not be connected, the module may be changed to another module, or the module may be added (interpolated). Further, the processor 110 automatically displays the line LN instead of the line connection operation when there is a module that can be connected between the modules determined in step S1 based on the connection availability information I3. , The module icon MA corresponding to the two modules that can be connected may be connected by the line LN in consideration of the input / output relationship.

The processor 110 can move the icon such as the module icon MA displayed on the screen G1 and the position of the line LN via the operation device 140. Further, the processor 110 can deform the shape of the line LN on the screen G1 via the operation device 140. By such movement or deformation, it becomes easy to connect each terminal of each module icon MA and each line LN.

The processor 110 generates software based on the input / output connection relationship of each module and the attributes of each module (S3). That is, the processor 110 is based on the connection relationship between the input unit 12 and the output unit 13 of each module icon MA connected by the line LN based on the connection availability information I3, and the data and processing contents of each module. Generate software.

FIG. 12 is a flowchart showing an operation example at the time of the module determination processing by the software generation support device 100.

First, the processor 110 displays a list of categories on the screen G1 based on the category list information I1 by pressing the menu button B1 or the like via the operation device 140 (S11), and the list is displayed. Select any category from the above categories (S12). The processor 110 displays a list of modules belonging to the selected category on the screen G1 based on the module list information I2 (S13), and selects an arbitrary module from one or more of the listed modules. Determined (S14), and the module icon MA corresponding to the determined module is displayed on the screen G1 (S15). The processor 110 determines whether or not the selection of the desired module of the desired category is completed (S16). In this case, the processor 110 may indicate whether or not this selection has been completed, for example via the operating device 140. If the selection of the desired module in the desired category has not been completed, the process proceeds to step S11. On the other hand, when the selection of the desired module of the desired category is completed, the process of FIG. 12 is completed.

FIG. 13 is a flowchart showing an operation example at the time of connection processing between modules by the software generation support device 100.

First, the processor 110 is not connected to the terminal (input unit 12 or output unit 13) of the predetermined module icon MA displayed on the screen G1 based on the connection availability information I3 held in the memory 130. It is determined whether or not the end can be connected (S21). The predetermined module icon MA here may be specified via the operating device 140.

In this case, if none of the ends of the line LN to be connected is connected to the module icon MA, the processor 110 may determine that the first module icon MA to be connected can be connected. .. For example, the module icon MA connected to the input side or the module icon MA connected to the output side of the line LN has not been determined, and it is not necessary to take into account the format mismatch between the modules.

On the other hand, when one end of the line LN to be connected is already connected to another module icon MA, whether or not the connection is possible is determined according to the data and processing of the module corresponding to the other module icon MA. Whether or not another module icon MA can be connected to each module icon MA is held in the memory 130 as connection availability information I3.

When one end of the line LN to be connected is already connected to the input unit 12 of the other module icon MA, the processor 110 attaches the other end of the line LN to be connected to the module icon MA. It is determined whether or not it can be connected to the output unit 13 of. When one end of the line LN to be connected is already connected to the output unit 13 of the other module icon MA, the processor 110 inputs the other end of the line LN to be connected to the output unit 13 of the module icon MA. It is determined whether or not it can be connected to the unit 12.

In step S21, when the unconnected end of the line LN can be connected to the terminal of the predetermined module icon MA (Yes in step S21), the processor 110 does not connect the line LN to the terminal of the predetermined module icon MA. Is connected and displayed on the screen G1 (S22).

In step S21, when the unconnected end of the line LN cannot be connected to the terminal of the predetermined module icon MA (No in step S21), the processor 110 does not connect the line LN to the terminal of the predetermined module icon MA. The display of the screen G1 is continued without connecting the end of the screen (S23). Not connecting the unconnected end of the line LN to the terminal of the predetermined module icon MA may mean that the terminal of the module icon MA and the unconnected end of the line LN are separated from each other. Alternatively, in step S21, when the unconnected end of the line LN cannot be connected to the terminal of the predetermined module icon MA (No in step S21), the processor 110 is connected to the terminal of the predetermined module icon MA and the line LN. Information (for example, a marker) indicating that the unconnected end cannot be connected may be displayed on the screen G1 (S23). The marker here may be a cross mark or a predetermined coloring, or may be indicated by other characters, figures, symbols, shapes, patterns, or the like. This marker is superimposed on the unconnected end of the unconnectable line LN (see FIG. 19A) or on the terminal of the predetermined module icon MA (the end on which the line LN was about to be connected) (see FIG. 19A). (See FIG. 19B), may be displayed.

After the process of step S22 or step S23, the processor 110 determines whether or not the connection confirmation of the line LN to all the module icons MA displayed on the screen G1 is completed (S24).

When there is a module icon MA for which the connection confirmation of the line LN has not been completed (No of S24), the processor 110 has completed the connection confirmation of the predetermined module icon MA to be connected to the line LN. Change to any module icon MA (next module icon MA) of the missing module icons MA (S25). Then, the process proceeds to step S21. The next module icon MA here may be specified via the operating device 140.

On the other hand, when the confirmation of the connection of the line LN to all the module icons MA is completed (Yes in S24), the processor 110 ends the process of FIG.

Therefore, the processor 110 repeats the processes of steps S21 to S24 until the connection confirmation of the line LN to all the module icons MA is completed.

FIG. 14 is a flowchart showing another operation example at the time of connection processing between modules by the software generation support device 100.

When the process of step S21 in FIG. 13 is No, that is, when the unconnected end of the line LN cannot be connected to the terminal of the predetermined module icon MA, the processor 110 cannot be connected to this terminal. In the same category as the category to which the module corresponding to the module icon MA belongs, a list of modules to which the unconnected end of the line LN can be connected is displayed on the screen G1 (S31).

The processor 110 selects an arbitrary module from the displayed module list via the operating device 140, and determines a target module to be connected to the unconnected end of the line LN (S32).

The processor 110 connects the module icon MA corresponding to the determined module to the position of the module icon that could not be connected in step S21, and connects the unconnected end of the line LN to the terminal of the module icon MA. Display (S33).

After the process of S33, the process proceeds to step S24 of FIG.

In S31 to S33, the terminals of the module icon MA include an input unit 12 and an output unit 13, and the processor 110 may perform the processing of S31 to S33 for each of these terminals. For example, the processor 110 may display a list of connectable modules for each terminal, determine an arbitrary module, and display a module icon MA corresponding to the module.

When displaying the module list, the processor 110 may display the priority of each selection of the plurality of modules to be displayed, the usefulness when the modules are selected, and the like in accordance with the screen G1. This allows the user to easily select a module in consideration of priority and effect.

As a result, the software generation support device 100 executes preprocessing and data acquisition necessary for processing by this module, for example, simply by instructing the input unit 12 (an example of a terminal) of the module icon MA via the operation device 140. You can easily determine which module to use. Furthermore, modules for further preprocessing and data acquisition required for preprocessing and data acquisition can be continuously determined. That is, the determination of the previous stage module can be continuously carried out. Therefore, for example, a predetermined module can be selected, and other modules can be interpolated and arranged via the operation device 140. Further, for example, when one selected module is a target module, the software generation support device 100 can easily derive a module (software component) for performing processing and data acquisition for achieving the purpose of the target module. .. Although the effect on the input unit 12 side is illustrated, the effect on the output side is also the same, and the software generation support device 100 can continuously determine the subsequent module of the selected predetermined module.

FIG. 15 is a flowchart showing another operation example at the time of connection processing between modules by the software generation support device 100.

When the process of step S21 in FIG. 13 is No, that is, when the unconnected end of the line LN cannot be connected to the terminal of the predetermined module icon MA, the processor 110 does not connect the line LN to this terminal. Acquires information on the selection priority (connection priority) of the module to which the end of the connection can be connected (S41). This selection priority information is held in the memory 130 and may be acquired from the memory 130. The selection priority information may be included in the connection availability information I3.

The processor 110 determines the module to be connected to the unconnected end of the line LN based on the acquired selection priority (S42). For example, the module with the highest selection priority is determined as the module to be connected.

The processor 110 connects the module icon MA corresponding to the determined module to the position of the module icon MA that could not be connected in step S21, and connects the unconnected end of the line LN to the terminal of the module icon MA. , Displayed (S43).

After the process of S43, the process proceeds to step S24 of FIG.

In S41 to S43, the terminals of the module icon MA include an input unit 12 and an output unit 13, and the processor 110 may perform the processing of S41 to S43 for each of these terminals. For example, the processor 110 acquires information on the selection priority of a connectable module from the memory 130 for each terminal, determines a module based on the selection priority, and displays the module icon MA corresponding to the module. good.

FIG. 16 is a flowchart showing an example of a change process of a connected module by the software generation support device 100. The process of FIG. 15 is performed after the process of FIG. 11 is completed. At the start of the process of FIG. 16, each module icon MA and the connected line LN are displayed on the screen G1.

First, the processor 110 determines whether or not the line LN has detected that the connected module icon MA has been instructed (S51). For example, the processor 110 may detect that the module icon MA is selected when it detects that the cursor is placed on the module icon MA (for example, on the attribute unit 11) on the screen G1.

Instead of the selected module icon MA, the processor 110 causes the screen G1 to display a list of modules to which the end of the same line LN can be connected in the same category as the category to which the module corresponding to the module icon MA belongs. (S52). In this case, the processor 110 displays a list of connectable modules based on the connection availability information I3, taking into account the input / output relationship between the front-stage module and the rear-stage module of the module corresponding to the selected module icon MA. It's okay.

The processor 110 selects and determines an arbitrary module from the displayed module list via the operating device 140 (S53).

The processor 110 connects the module icon MA corresponding to the determined module to the position of the module icon MA selected in step S51, and connects the end of the line LN corresponding to the terminal of the module icon MA to the screen. Displayed on G1 (S54). The end of the line LN connected to the terminal of the new module icon MA is the end of the line LN connected to the module icon MA in S51.

FIG. 17 is a flowchart showing another operation example at the time of connection processing between modules by the software generation support device 100. In FIG. 17, it is assumed that other module icons MA are interpolated based on a plurality of module icons MA, the module icons MA are connected via a line LN, and the modules are connected. The process of FIG. 17 is performed in parallel with the process of steps S21 to S25 shown in FIG.

First, after the module determination process in step S1 is completed, the processor 110 is one or more to be arranged between any two modules among the plurality of determined modules based on the connection availability information I3. It is determined whether or not an absent module exists (S71). That is, the processor 110 determines whether or not any two modules can be connected in consideration of the input / output relationship by interposing one or more modules. The processor 110 determines one or more modules (interpolation modules) to be interposed between the two modules based on the connection availability information I3 (S72).

For example, as shown in FIG. 7, when the two selected modules are a camera (storefront) module as a device module and a pedestrian counting module as a processing module, the processor 110 determines the connection availability information I3. Based on the above, the video module as the data module and the image recognition module as the data filter module may be determined as the interpolation module. For example, as shown in FIG. 10, if the two selected modules are the module M61 for the camera (storefront) in the device category and the AI module M54 for today's sales forecast as an AI processing module, the processor 110 Based on the connection availability information I3, the video (real-time) module M62 as the data module and the pedestrian number measurement module M63 as the processing module may be determined as the interpolation module.

The processor 110 is a terminal of the module icon MA corresponding to any two selected modules based on the input / output relationship between any two selected modules and one or more determined interpolating modules. The input unit 12 and the output unit 13) and the terminals of the module icon MA corresponding to one or more interpolation modules (input unit 12 and output unit 13) are connected by a line LN and displayed on the screen G1 (S73). ..

As a result, the software generation support device 100 automatically selects an interpolation module that executes necessary processing and data acquisition between any two selected modules simply by selecting a plurality of modules via the operation device 140, for example. Can be determined. Therefore, even a user who does not understand what kind of processing or data is required between these two modules can easily generate software including these two modules.

FIG. 18 is a flowchart showing another operation example during the module determination process. In FIG. 18, it is assumed that the AI module M5 is arranged.

After the process of step S11, the processor 110 determines whether or not the AI category is selected from one or more of the listed categories via the operating device 140 (S81). When the AI category is selected, the processor 110 includes an AI module that collects training data (eg, the AI module M51 described in FIG. 10) and an AI module that generates a learner based on the training data (eg, described in FIG. 10). AI module M53), AI module inferred using a learner (for example, AI module M54 described with reference to FIG. 10), and AI module displaying the inference result by the learner (for example, AI module M55 described with reference to FIG. 10). And, (S82). The processor 110 displays the module icons MA5 (MA51, MA53, MA54, MA55) corresponding to these AI modules M5 on the screen G1 (S83).

As a result, the software generation support device 100 is, for example, a module that generates a learning device for using AI, a module that infers using the learning device based on the data obtained in real time, and makes a future prediction, and a result of future prediction. A module, which visualizes the above, can be easily derived, and software including processing related to AI can be easily generated.

In this embodiment, a plurality of flowcharts are illustrated with reference to FIGS. 11 to 18. The processor 110 may execute the processes related to these flowcharts in any combination. That is, the software generation support device 100 may have any of a plurality of functions corresponding to the processes shown in FIGS. 11 to 18.

For example, the process of FIG. 13 and the process of FIG. 17 may be performed in combination. For example, the processor 110 may perform the processing of S23 in the case of No. S21 in FIG. 13 and No. S71 in FIG. That is, when the connection between the two modules connected to both ends of the line LN is not possible, the processor 110 can intervene between the two modules based on the connection availability information I3. May be determined if is present. When the complementary module does not exist, the processor 110 continues to display the screen G1 without connecting the unconnected end of the line LN to the terminal of the module icon MA to be connected to the line LN, or this module. Information (for example, a marker) indicating that the terminal of the icon MA and the unconnected end of the line LN cannot be connected may be displayed on the screen G1. Further, for example, the processor 110 may perform the processing of S72 and S73 in the case of No of S21 in FIG. 13 and Yes of S71 in FIG. That is, in the processor 110, the connection between the above two modules is not possible, and when the complementary module exists, the interpolation module is interposed between the two modules, and the modules corresponding to the two modules and the interpolation module are interposed. The icon MA may be connected by a line and displayed on the screen G1.

According to the software generation support device 100 of the present embodiment, what data should be acquired by the software to be generated, and in what format the acquired data should be saved, the next process can be smoothly performed. It is possible to easily grasp whether it can be implemented and what kind of processing should be performed. This is because the module icon MA corresponding to the module corresponding to each data or processing is displayed on the screen G1. In addition, by selecting selectable data and processes as modules, it is possible to build software that can obtain the desired results without understanding detailed processes. For example, the process for performing 3D display is complicated and difficult to understand, but the process required for 3D display is presented as a module, and by selecting the module according to this presentation, software that performs 3D display is easy. Can be built into. Further, since the module related to AI can be handled in the same manner as other than AI, the software generation support device 100 can easily realize the cooperation between the digital twin and AI.

In addition, there are various cases where the subject holding the data. For example, in the case of 3D building data, it may be divided into various places such as a building company in the case of 3D building data, a map company in the case of a map, and an analysis company in the case of analysis. be. Even in such a case, according to the software generation support device 100, by visually connecting the modules of each data, it is possible to easily provide software that performs processing in cooperation with each data.

Further, the software generation support device 100 can form a series of modules by sequentially connecting modules belonging to each category via a line LN. The processor 110 can construct software that achieves a predetermined purpose by sequentially processing a series of modules connected by each line LN in consideration of input / output relationships.

Further, for example, when the data module is 3D data and the processing module is the association between the map data and the 3D data, the processor 110 adjusts the latitude and longitude altitude to match the coordinate data on the map, and is three-dimensional. It is possible to provide software that can be aligned and used. Further, when the target module is to create a disaster hazard map, it is possible to provide software that predicts the damage situation based on the 3D data aligned with the above map data and reproduces the prediction result in graphics.

There may be two or more types of data input to one module. In this case, the output unit 13 of two or more other module icons MA may be connected to the input unit 12 of the module icon MA. For example, the input unit 12 of one module icon MA may be connected to the output unit 13 of the module icon MA of the data module of 3D data and the output unit 13 of the module icon MA of the data module of map data. Similarly, there may be two or more types of data output from one module.

In this embodiment, the operation device 140 and the display device 150 included in the software generation support device 100 may be configured separately from the software generation support device 100.

As described above, the software generation support device 100 (an example of the information processing device) of the present embodiment includes a processor 110, a display device 150, and an operation device 140. The display device 150 connects a plurality of module icons MA (an example of an icon) corresponding to a plurality of modules indicating a part of the software connection state by a line LN indicating the software connection state, and displays the software on the screen G1. .. The plurality of module icons MA include a processing module indicating at least one process executed by the software, a data module indicating at least one data used for the process, and a device module indicating a device that is a source of data. .. The module icon MA includes an attribute unit 11 that displays information indicating the attributes of the module corresponding to the module icon MA, an input unit 12 that inputs data or processing results from the module in the previous stage when the modules are connected, and a module. It has an output unit 13 that outputs data or a processing result to one module in the subsequent stage in a connected state. The input unit 12 of each module icon MA can be connected to at least one output unit 13 of the other module icon MA via the line LN. The output unit of each module icon MA can be connected to at least one input unit 12 of another module icon MA via the line. The positions of the module icon MA and the line LN on the screen G1 are movable. The shape of the line LN on the screen G1 is deformable. The processor 110 instructs the input unit 12 or the output unit 13 of the first module icon MA corresponding to the first module to connect the line LN via the operation device 140, and among each of the plurality of modules. The connection possibility information I3 indicating the connection possibility in consideration of the input / output relationship of the above is acquired. Based on the connection availability information, the processor 110 is instructed to the output unit 13 or the input unit 12 of the second module icon MA corresponding to the second module via the line LN to indicate the first module icon MA. It is determined whether or not the module-to-module connection connecting the input unit 12 or the output unit 13 is possible. When the module-to-module connection is possible, the processor 110 connects the line LN to the input unit 12 or the output unit 13 of the first module icon MA. When the connection between modules is not possible, it is determined whether or not there is one or more interpolation modules that can intervene between the first module and the second module based on the connection availability information. .. When the complementary module does not exist, the processor 110 displays the first module icon MA and the line LN without connecting the line LN to the input unit 12 or the output unit 13 of the first module icon MA, or the first module 110. A marker indicating that the input unit 12 or the output unit 13 of the module icon MA and the line LN cannot be connected is displayed. The processor 110 generates software by linking each module corresponding to each module icon MA according to a state in which each module icon MA is connected by a line LN.

As a result, in the software generation support device 100, the module corresponding to the first icon and the other modules corresponding to the second icon connected via the line are connected by software based on the connection availability information. Whether or not connection is possible can be determined by taking into account the states (generation order, input / output relationship). In the software generation support device 100, each module can input and output data and information according to the state in which the lines are connected, and the software can be generated by linking the data and processing between the modules. If the connection between modules is not possible, determine whether other modules (third module) can interpolate between modules, and if interpolation between modules is not possible, check the marker or the like. Therefore, it can be easily confirmed that the modules cannot be connected and the interpolation between the modules cannot be performed. Therefore, the software generation support device 100 can provide a highly convenient UI for software generation. Therefore, even a general user can easily construct software that realizes various functions by combining various data and information.

Further, when the connection between modules is not possible and the third module exists, the processor 110 has the first module icon MA, the second module icon MA, and the third module based on the connection availability information. The third module icon MA corresponding to the module may be connected by the line LN and displayed on the screen G1.

As a result, the software generation support device 100 only determines one module of the upstream process in software generation and one module of the downstream process from this module, and interpolates the modules of the processes in between to correspond to each module. Each module icon MA can be displayed. In this case, the software generation support device 100 can automatically additionally arrange a third module in consideration of the input / output relationship between the two modules without requiring a special user operation for module interpolation.

Further, the connection availability information may include connection priority information when any one of a plurality of other modules is connected to each module. When the processor 110 cannot connect between modules and there are a plurality of fourth modules that can be connected to the input unit 12 or the output unit 13 of the first module icon MA, the processor 110 is the first based on the connection priority information. 4 modules may be determined. The processor 110 may connect the first module icon MA and the fourth module icon MA corresponding to the fourth module by a line LN and display them on the screen G1 based on the connection availability information.

As a result, when there are a plurality of candidates for the fourth module, the software generation support device 100 can display the fourth module icon MA corresponding to the fourth module having a higher priority. Therefore, the software generation support device 100 can support the user who does not fully understand the details of each module to understand the input and output of each module, and the module icon corresponding to the missing module. MA can be easily placed.

Further, when the attribute unit 11 of the first module icon MA connected by the line LN is instructed via the operation device 140, the processor 110 is a module that can be connected to the line LN based on the connection availability information. The list of the list may be displayed on the screen G1. The processor 110 changes the first module to the fifth module by selecting the fifth module from this list via the operating device 140, and sets the fifth module icon MA corresponding to the fifth module. It may be displayed on the screen G1.

As a result, the software generation support device 100 displays a list of candidates for the fifth module that can be manually or automatically determined and once placed, and the first module icon MA can be connected to the line LN at the same position. Can be changed manually. For example, when the module to be displayed in three dimensions is displayed on the screen G1, the software generation support device 100 can be changed to a module to be displayed in two dimensions as an alternative module, and the module once arranged can be changed according to the user's intention. can.

Further, when the input unit 12 or the output unit 13 not connected to the line LN in the first module icon MA is instructed by the processor 110 via the operation device 140, the instructed input unit 12 or the output unit 13 is instructed. A list of a list of connectable modules may be displayed on the screen G1. The processor 110 selects a second module from this list via the operating device 140, thereby corresponding to the designated input unit 12 or output unit 13 in the first module icon MA and the second module. The output unit 13 or the input unit 12 of the module icon MA of 2 may be connected via the line LN and displayed on the screen G1.

As a result, the software generation support device 100 indicates, for example, the terminal of the first module icon MA (input unit 12 or output unit 13) to which the line LN is not connected, for example, to the terminal of the first module icon MA. The second module can be easily selected from the list of modules by hovering the cursor or the like.

Further, the modules may be provided for each of a plurality of categories. The processor 110 may display the category list information I1 (an example of menu information) for selecting a category on the screen G1. The processor 110 may select a category from the category list information I1 via the operating device 140. Processor 110 may display a list of one or more modules belonging to the selected category on screen G1. The processor 110 may display the first module icon MA on the screen G1 by selecting the first module from this list via the operating device 140.

Thereby, for example, the software generation support device 100 can select and arrange one of the modules managed for each category (for example, those from data to purpose).

Further, the category may include a purpose category indicating the purpose of operating the information processing device (for example, the software generation support device 100 or other information processing device) that executes the software. The processor 110 may display the sixth module icon MA corresponding to the sixth module belonging to the target category on the screen G1.

As a result, the software generation support device 100 can clearly specify the purpose to be achieved by the processing by the software by arranging the sixth module icon MA corresponding to the target module on the screen G1. Therefore, for example, by displaying the module list I2 that can be connected to each module from the target module as a starting point and sequentially selecting the modules, the modules for achieving the target and acquiring the data can be sequentially arranged.

The category may also include an AI category that defines the generation of the learner or the processing by the learner. The AI category may include a learning data collection module that collects learning data for learning by the learner and an inference data display module that displays inference data that indicates the result of inference by the learner. When the AI category is selected from the category list information I1, the processor 110 may display the module icon MA5 corresponding to the learning data collection module and the module icon MA5 corresponding to the inference data display module on the screen G1.

As a result, the software generation support device 100 can arrange the AI-related modules on the screen G1 in the same manner as the non-AI-related modules, and can be used as a component for generating software. As an AI-related module, the software generation support device 100 can collectively manage not only the module related to the generation of the learning device but also the module that presents the result of inference by processing in the real space using the learning device. For example, the software generation support device 100 can acquire real-time real-space information, execute processing (inference) based on the real-time information using a learning device, and visualize the result. That is, the software generation support device 100 performs, for example, learning necessary for AI by connecting the displayed AI-related modules including modules other than AI-related modules on a line based on the connection availability information. , This learning result can be further linked with real-time data to predict the current situation and future.

Although various embodiments have been described above with reference to the drawings, it goes without saying that the present disclosure is not limited to such examples. It is clear that a person skilled in the art can come up with various modifications or modifications within the scope of the claims, which naturally belong to the technical scope of the present disclosure. Understood.

The present disclosure is useful for information processing devices, information processing methods, and the like that allow even general users to easily construct software that realizes various functions by combining various data and information.

11 Attribute unit 12 Input unit 13 Output unit 100 Software generation support device 110 Processor 120 Communication device 130 Memory 140 Operation device 150 Display device B1 Menu button B2 Start / Stop button G1 Screen I1 Category list information I2 Module list information I3 Connection availability information MA Module icon MK marker LN line

Claims (12)

An information processing device that supports software generation
It has a processor, a display device, and an operation device.
The display device connects a plurality of icons corresponding to a plurality of modules indicating a part of the connection state of the software by a line indicating the connection state of the software, and displays them on the screen.
The plurality of modules include a processing module indicating at least one process executed by the software, a data module indicating at least one data used in the process, and a device module indicating a device that is a source of the data. Including
The icon includes an attribute unit that displays information indicating the attributes of the module corresponding to the icon, an input unit that inputs data or a processing result from the module in the previous stage when the module is in the connected state, and the module is the module. It has an output unit that outputs data or processing results to one module in the subsequent stage in the connected state.
The input unit of each icon can be connected to at least one output unit of another icon via the line.
The output unit of each icon can be connected to at least one input unit of another icon via the line.
The positions of the icon and the line on the screen are movable and can be moved.
The shape of the line on the screen is deformable and
The processor
Instructing the line to be connected to the input unit or the output unit of the first icon corresponding to the first module via the operation device.
Acquires connection availability information indicating connection availability in consideration of the input / output relationship between each of the plurality of modules.
Based on the connection availability information, the input unit or the output of the first icon is indicated to the output unit or the input unit of the second icon corresponding to the second module via the line. Determines whether the modules that connect the units can be connected, and determines whether or not the connection is possible.
When the connection between the modules is possible, the line is connected to the input unit or the output unit of the first icon.
If the connection between the modules is not possible, whether or not there is one or more third modules that can intervene between the first module and the second module based on the connection possibility information. Judging,
When the third module does not exist, the first icon and the line are displayed without connecting the line to the input unit or the output unit of the first icon, or the first icon of the first icon. A marker indicating that the input unit or the output unit and the line cannot be connected is displayed.
According to the state in which each icon is connected by the line, each module corresponding to each icon is linked to generate the software.
Information processing equipment. The processor
When the connection between the modules is not possible and the third module exists, it corresponds to the first icon, the second icon, and the third module based on the connection availability information. The third icon is connected to the line and displayed on the screen.
The information processing apparatus according to claim 1. The connection availability information includes connection priority information when any one of a plurality of other modules is connected to each module.
The processor
When the connection between the modules is not possible and there are a plurality of fourth modules that can be connected to the input unit or the output unit of the first icon, the fourth module is based on the connection priority information. Determine the module,
Based on the connection availability information, the first icon and the fourth icon corresponding to the fourth module are connected by the line and displayed on the screen.
The information processing apparatus according to claim 1. The processor
When the attribute unit of the first icon connected by the line is instructed via the operation device, the list of modules that can be connected to the line is displayed based on the connection availability information. Display on the screen
By selecting the fifth module from the list via the operating device, the first module is changed to the fifth module, and the fifth icon corresponding to the fifth module is displayed on the screen. Display,
The information processing apparatus according to any one of claims 1 to 3. The processor
When the input unit or the output unit not connected to the line in the first icon is instructed via the operation device, a list of modules that can be connected to the instructed input unit or the output unit. Display the list on the screen and display it.
By selecting the second module from the list via the operating device, the indicated input or output unit in the first icon and the second module corresponding to the second module. The output unit or the input unit of the icon is connected via the line and displayed on the screen.
The information processing apparatus according to any one of claims 1 to 4. The modules are provided in multiple categories.
The processor
Display menu information for selecting the category on the screen,
Select the category from the menu information via the operating device.
A list of a list of one or more modules belonging to the selected category is displayed on the screen.
By selecting the first module from the list via the operating device, the first icon is displayed on the screen.
The information processing apparatus according to any one of claims 1 to 5. The category includes a purpose category indicating the purpose of operating the information processing device that executes the software.
The processor causes the screen to display a sixth icon corresponding to a sixth module belonging to the target category.
The information processing apparatus according to claim 6. The category includes an AI (Artificial Intelligence) category that defines the generation of a learner or the processing by the learner.
The AI category includes a learning data collection module that collects learning data for learning by the learning device, and an inference data display module that displays inference data indicating the result of inference by the learning device.
When the AI category is selected from the menu information, the processor causes the screen to display an icon corresponding to the learning data collection module and an icon corresponding to the inference data display module.
The information processing apparatus according to claim 6 or 7. The attribute portion of the icon is located at the center of the icon.
The input unit of the icon surrounds one end side of the attribute unit.
The output unit of the icon surrounds the other end side of the attribute unit.
The information processing apparatus according to any one of claims 1 to 8. The shape of the icon has a rectangular shape composed of a pair of sides along the first direction and a pair of sides along the second direction perpendicular to the first direction.
The input portion of the icon includes one end side of each of the pair of sides along the first direction and a side of the pair of sides along the second direction connected to the one end side.
The output unit of the icon includes the other end side of each of the pair of sides along the first direction and the side of the pair of sides along the second direction connected to the other end side.
The information processing apparatus according to claim 9. The display mode is different between the input unit and the output unit.
The information processing apparatus according to claim 9 or 10. It is a software generation support method that supports software generation.
The processor has a step of connecting a plurality of icons corresponding to a plurality of modules indicating a part of the connection state of the software with a line indicating the connection state of the software and displaying them on the screen.
The plurality of modules include a processing module indicating at least one process executed by the software, a data module indicating at least one data used in the process, and a device module indicating a device that is a source of the data. Including
The icon includes an attribute unit that displays information indicating the attributes of the module corresponding to the icon, an input unit that inputs data or a processing result from the module in the previous stage when the module is in the connected state, and the module is the module. It has an output unit that outputs data or processing results to one module in the subsequent stage in the connected state.
The input unit of each icon can be connected to at least one output unit of another icon via the line.
The output unit of each icon can be connected to at least one input unit of another icon via the line.
The positions of the icon and the line on the screen are movable and can be moved.
The shape of the line on the screen is deformable and
In the software generation support method, the processor
A step of instructing the line to be connected to the input unit or the output unit of the first icon corresponding to the first module, and
A step of acquiring connection availability information indicating connection availability in consideration of the input / output relationship between each of the plurality of modules, and a step of acquiring connection availability information.
Based on the connection availability information, the input unit or the output of the first icon is indicated to the output unit or the input unit of the second icon corresponding to the second module via the line. The step of determining whether or not the connection between modules connecting the parts is possible, and
When the module-to-module connection is possible, the step of connecting the line to the input unit or the output unit of the first icon, and
If the connection between the modules is not possible, whether or not there is one or more third modules that can intervene between the first module and the second module based on the connection possibility information. Judging,
When the third module does not exist, the first icon and the line are displayed without connecting the line to the input unit or the output unit of the first icon, or the first icon of the first icon. A step of displaying a marker indicating that the input unit or the output unit and the line cannot be connected, and
According to the state in which each icon is connected by the line, each module corresponding to each icon is linked to generate the software.
Software generation support method with.

Images