JP6651148B2 - Program creation support system and method, and program therefor - Google Patents

Description

  The present invention relates to a program creation support system and method, and a program therefor, and more particularly to a program creation support technology suitable for programming learning.

  With the development of AI (Artificial Intelligence) and information technology (IT), a shortage of IT engineers is expected, and the importance of developing human resources for programming is being called out. In Japan, the Ministry of Education, Culture, Sports, Science and Technology has advocated the importance of programming education for children as one of the measures for developing human resources for programming, and since 2020 programming education has become essential in elementary schools. Various programming education systems, educational jigs, toys and the like have already been proposed for children, and some of them have been put to practical use.

  As one of them, programming education support for beginners using computers and the Internet has been proposed. For example, in Patent Document 1, a learner client, a learn manager client, and a learn management server are connected through a network, and the process of answering the task by the learner is grasped online in real time, and a database is created. A programming education support system has been disclosed that can easily and accurately grasp the programming proficiency of each learner by reproducing the answer process on an arbitrary time axis based on the recorded data and visualizing with a graph. .

  Non-Patent Document 1 describes a program for children called “Programming” developed by the Ministry of Education, Culture, Sports, Science and Technology that combines a plurality of pictures (blocks) while operating a mouse on the screen of a display device to assemble a program. A computer-based programming for children is disclosed. Further, Non-Patent Document 2 discloses a technique of operating a robot by creating a program using image recognition using an AR marker. This means that the program is automatically transferred to the robot by taking an image of an alternately arranged "dossier card" and "joken card" on which an image serving as an AR marker is written with a tablet.

JP 2006-227218 A

Ministry of Education, Culture, Sports, Science and Technology “Programme” October 22, 2013 http://www.mext.go.jp/programin/ Toshiyuki Hara, "A Study on the Introduction of Augmented Reality into Programming Experiences in Science Experiment Classrooms for Children," Proc. Of the 75th (2013) Information Processing Society of Japan (4), Information Processing Society of Japan, March 6, 2013, pages 385-386

  The technique described in Patent Document 1 is based on the theme that a learning management server easily and accurately grasps a learner's programming proficiency, and details how to make a learner create a program is described in detail. It has not been.

  Further, since the programming introduced in Non-Patent Document 1 is operated on a screen, use of a personal computer (PC) or the like is premised. When programming learning is performed in a school lesson, PCs are required in accordance with the number of students, so that considerable costs are required. Further, students need to learn basic operations for operating the screen of the PC. Non-Patent Document 2 discloses a concept of shooting and programming a card on which an AR marker is described with a tablet, but there are specific problems and technical means for facilitating programming by children. There is no suggestion.

  Therefore, there is a need for a mechanism or educational material that does not require much cost and that enables children to learn how to create a program particularly easily.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a program creation support system capable of creating a program by a simple method, a method therefor, and a program therefor.

The program creation support system according to the present invention is preferably a program creation support system that supports creation of a program using a server and a terminal connected to the server via a network,
Curriculum identification information different for each curriculum for programming, and a curriculum management table for registering viewing characteristics of a plurality of articles and instructions of a program associated with the viewing characteristics, which are used for programming based on the curriculum. ,
A camera for photographing an array of a plurality of articles arranged at the time of creating the program,
From an image of the array of the articles acquired by the camera, an image processing unit that recognizes an image of the viewing characteristics related to the plurality of articles,
By specifying the curriculum identification information from the terminal, an instruction corresponding to the image of the visual recognition characteristic of the article recognized by the image processing unit is specified based on a plurality of instructions selected based on the curriculum management table. And a program creation processing unit for creating a program composed of the specified plurality of instructions.

Further, the program creation support system according to the present invention is preferably a program creation support system that supports creation of a program using a computer,
A plurality of planar chips having irregularities on the outer periphery and having a pattern drawn thereon,
An instruction table for registering the image of the design and the instruction of the program associated with each of the plurality of chips in association with each other,
In creating a program, a camera that captures an array of a plurality of chips arranged by engaging and recessing the chips,
From the image of the array of the plurality of chips acquired by the camera, an image processing unit that recognizes the image of the pattern that each of the plurality of chips has,
A program creation processing unit that refers to the command table, specifies a command corresponding to the image of the pattern recognized by the image processing unit, and generates a program including the specified plurality of commands; And a program creation support system characterized by having:
The present invention is also understood as a program creation support method and a program creation support program realized by the program creation support system.

  According to the present invention, a program can be created by a simple method.

FIG. 1 is a diagram illustrating a configuration of a program creation support system according to a first embodiment. It is a figure showing the example of composition of a personal digital assistant. It is a figure showing an example of a program sheet. FIG. 3 is a diagram illustrating an example of a chip used for creating a program. FIG. 4 is a diagram illustrating an example of a program instruction. FIG. 4 is a diagram illustrating an example of a program instruction. It is a figure showing the example of arrangement of a chip in program creation. It is a figure showing the example of arrangement of a chip in program creation. It is a figure showing the example of arrangement of a chip in program creation. It is a figure showing the example of composition of a curriculum management table. FIG. 3 is a diagram illustrating a configuration example of a user management table. It is a figure showing the example of composition of a teacher management table. FIG. 4 is a diagram illustrating a configuration example of a program management table. 9 is a flowchart illustrating a schematic operation of creating a program. 9 is a flowchart illustrating a processing operation of program creation. 9 is a flowchart illustrating a processing operation of program creation. It is a figure showing an example of a screen display of a personal digital assistant. FIG. 2 is a diagram illustrating a connection configuration of a program creation support system. 13 is a flowchart illustrating a schematic operation of creating a program according to a third embodiment. FIG. 19 is a diagram illustrating an example of a task sheet used in a seventh embodiment. FIG. 19 is a diagram illustrating an example of a program sheet used in a seventh embodiment. FIG. 21 is a diagram illustrating an example of a chip used in an eighth embodiment. FIG. 21 is a diagram illustrating an example of a chip arrangement according to an eighth embodiment. FIG. 21 is a diagram illustrating an example of a chip arrangement according to an eighth embodiment.

  A preferred example of the present invention is realized by a program creation support system using a computer. A plurality of chips on which a pattern is drawn in which instructions are defined in advance and a predetermined sheet on which the chips are arranged are prepared. The user selectively arranges a plurality of chips on a sheet according to the purpose. The arrangement of the chips is photographed by a camera provided in a portable terminal such as a smartphone. A processing device (for example, a server) in the program creation support system recognizes an image of a pattern of each chip from an image of an array of chips acquired by a camera, specifies an instruction code constituting a program, and determines a program from the array of instruction codes. Create data. The created program data is transmitted to the mobile terminal and executed. The execution of the program is displayed, for example, as a moving image of the character on the screen of the display unit of the mobile terminal.

  According to a preferred example, in a school class in which a user has a large number of students, if there is one portable terminal owned by a teacher, a class for creating a program can be performed. That is, every time each student finishes arranging the chips, the arrangement of the chips is photographed by the camera of the portable terminal, the image is transmitted to the server, and the server creates the program. Then, each time the program is executed, it can be viewed as a moving image on the screen of the mobile terminal, so that the student can confirm the performance of the program.

  According to the preferred embodiment of the present invention, it is possible to create a program by a simple task of arranging chips on a sheet, as compared with a program creating task in which a user operates a PC screen alone while operating a PC screen. it can. Therefore, it is easy to learn the procedure for creating a program, and both teachers and students who teach the creation of the program have little burden. In addition, since it is not necessary to prepare a PC for each user, it is suitable for a situation where a large number of people study simultaneously. In addition, since it can be handled by preparing a set of chips and sheets for each user, it can be realized at low cost.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.
FIG. 1 shows an example of the overall configuration of a program creation support system.
The program creation support system is configured by connecting a server 1 that supports creation of a program and a plurality of mobile terminals 2 used by a user via a communication network 9.

  The server 1 is a computer that manages user information, performs data communication with a portable terminal, and performs various data processing such as creating and executing a program. Details of the function and the processing will be described later. Although the hardware configuration of the server 1 is not shown, the server 1 has hardware resources such as a processing device (processor) for executing a program, a memory, an external storage device such as a hard disk, an input device, and a display device.

  In order to support the creation of a program, the server 1 includes an information management unit 102 that registers and manages information of a user or an operator of the mobile terminal 2, a program creation processing unit 103 that creates a program, An image processing unit 104 for recognizing the image of the chip is provided. The database (DB) includes a management information DB 105 for registering user information and various management information related to the use of programming learning, and a program DB 106 for storing information related to program creation. The configurations and functions of these processing units and DB will be described later in detail. In the illustrated example, the management information DB 105 and the program DB 106 are configured as separate DBs, but they may be configured as a single DB.

The server 1 has a site for supporting program creation, and by connecting to this site from the mobile terminal 2, it is possible to receive program creation support.
The mobile terminal 2 is a terminal such as a smartphone (hereinafter simply referred to as a smartphone), for example. The hardware configuration of the mobile terminal 2 will be described later with reference to FIG.

FIG. 2 shows a hardware configuration of the mobile terminal 2.
The mobile terminal 2 is, for example, a mobile terminal such as a smartphone (hereinafter simply referred to as a smartphone), and includes a processor (CPU) 202 that executes various application programs and the like, a memory 203 that stores data and programs, and a screen touch type. An input unit 204, a display unit 205 that displays a screen, a camera 206 that is a photographing function, a barcode reader 207 that reads a two-dimensional barcode, and a network connection unit 208 that performs data communication with the server 1 through the network 9. Have. The smartphone can be connected to many sites via the Internet, and the CPU 202 executes an application desired by the user. In addition, the smartphone has various functions other than the above, such as a voice input / output function.

[Program sheet and chip]
FIG. 3 shows an example of the program sheet.
The program sheet (hereinafter simply referred to as a sheet) 30 is, for example, A4 size paper used for creating a program. In school lessons, the teacher distributes a pre-printed sheet 30 to each student. The sheet 30 is preferably made of plastic, rather than ordinary paper, so that the student can use it multiple times and withstand chip placement.

  A program area 302 is secured in a large space at the center of the seat 30. A title 301 is printed on an upper end of the sheet 30, and an identification unit 305 including a two-dimensional barcode is printed on an upper right end. The title 301 is, for example, the name of a curriculum. The two-dimensional barcode of the identification unit 305 includes identification information for identifying a curriculum.

  In the program area 302, a matrix ruled line is printed by a plurality of vertical lines and horizontal lines, and further, a "start" mark 303 is printed on the upper left end thereof, and a thick vertical line guideline 304 is drawn downward from there. Printed. The matrix lines and the guide lines 304 serve as guides for arranging the chips. The vertical and horizontal lines in the matrix form X / Y coordinates in the image processing of the chip pattern. The original information of the sheet 30 is stored in the program DB 106 as an image.

  The student who is the worker arranges the chips from the top to the bottom according to the guideline 304. At other times, chips are arranged from left to right along a matrix line. 7A to 7C show examples in which a plurality of chips 40 are arranged on the sheet 30. FIG.

FIG. 4 shows an example of a chip used for creating a program.
The chip 40 is an indicator in which a program instruction is defined. For example, it is a plastic rectangular piece of about 2 cm × 5 cm which expresses (prints) the operation of the command with a picture. Each picture is different for each command. It is preferable that a simple adhesive material is formed on the back surface of the chip 40 so that the chip 40 can be easily fixed on the sheet 30 and easily peeled off. The original information of the pattern of the chip 40 is stored in the program DB 106 as an image.

  FIG. 4 shows an example of 17 types of chips, but the number of chips can be further increased according to the type of instruction. The plurality of chips 40 for distribution are referred to as a chipset. The sheet 30 and the chipset 40 are sold and shipped to the user in response to a request from the user. Note that, in response to a request from the mobile terminal 2, the server 1 can provide a service for printing the sheet 30 or the chipset 40 on a designated printer.

[Example of program instruction]
FIG. 5 shows an example of a program instruction (instruction list).
The program commands include nine commands (operation commands) indicating display / movement, two commands (control commands) indicating control statements, four commands (input / output commands) indicating input / output, and parameters, that is, 1 to 9 It is composed of an instruction (parameter) representing a numerical value up to and four other instructions.

  Each chip and the command uniquely correspond to each other, and the relationship between the picture of the chip, the name of the command, the command operation, and the parameter is as shown in the figure. Remarks indicate a reference explanation. For example, in an operation command, a picture pointing right (a command “moving: with direction” at the top of FIG. 5) is a command representing “moving in a specified direction”, and when this arrow is pointing right. Indicates moving to the right, and moving to the left when facing to the left. The parameters represent the number, direction, number, etc. of the operation command. In relation to an instruction, a parameter can be set for an instruction for which a parameter can be specified. For example, the "moving: with direction" command can set the number of parameters, while the "pick up" command cannot set the parameters.

  As illustrated in FIG. 6, if the parameter is “3” in the rightward picture “moving: with direction” command, it means “turn right three times”. Here, the arrangement of one chip 401 representing a certain instruction is essential, and the arrangement of the parameters 402 is arbitrary. The parameter 402 changes according to the type of instruction and its execution level.

  Note that, among the other commands, the “START” command is not used when “start” is printed on the sheet 30. The instruction of “END” is placed at the end of the chip array. Although instructions for operators and conditional statements are provided, they may not be used depending on the contents of the curriculum.

  The relationship between the chip pattern (that is, the image of the pattern), the name indicating the operation, and the operation of these instructions and the operation is defined in an instruction table (indicated by reference numeral 50), which is a correspondence table, and stored in the program DB 106. . Here, an example of the screen display of the instruction table 50 is as shown in FIG. 5, but the instruction table 50 stored in the program DB 106 includes unique code data (instruction code) corresponding to the picture image.

  In one example, a plurality of instructions (referred to as an instruction set) are selected from the instruction table 50 according to the curriculum. When a new chip pattern or a new command is specified, or when a predetermined pattern is to be deleted or changed, the contents of the command table 50 can be changed. It can change the correspondence between the pattern of the chip and the command in the command table 50 by an input instruction (not shown) of the server 1 or an input instruction of the administrator from the portable terminal 2.

[Explanation of various tables]
Next, configurations of various tables used for supporting program creation will be described with reference to FIGS. Each of the tables 80 to 110 is stored in the management information DB 105.

FIG. 8 shows a configuration example of the curriculum management table.
The curriculum management table 80 is a table for managing a curriculum for creating a program to be provided to a user and instructions used in the curriculum. Here, the curriculum may be referred to as an issue or problem for programming by a user. The curriculum, the specific contents of the task corresponding to the curriculum, and the sheets used in the curriculum are associated with each other. This will be described later with reference to FIG.

  The curriculum management table 80 includes a curriculum number for identifying a curriculum, an address for executing an application according to the curriculum, a character set representing a character used in the application, and a curriculum selected from the instruction table 50 for use in the curriculum. The reference numbers of all the instructions (reference numbers of the instruction table 50) are registered. Here, the application is a program that performs a series of processes from the selection of the curriculum to the process of taking in images of sheets and chips arranged by the mobile terminal 2 and the process of creating a program. The character is a character used as a moving image in the execution of the program, and is, for example, an image of a rabbit or a turtle, or a famous animation image.

  The reason why the reference numbers of all the instructions used in the curriculum are registered in the instruction set is to speed up the program creation process. That is, at the time of program creation processing, processing of recognizing the image of each chip from the image of the chip array while referring to the instruction table 50 is performed. Takes a long time. On the other hand, if an instruction corresponding to the reference number registered in the instruction set is scanned, the time required for image recognition is significantly reduced.

FIG. 9 shows a configuration example of the user management table.
The user management table 90 is a table for managing information of a user who creates a program. The user management table 90 includes a curriculum management table 80 as identification information that is a user identification ID, a user name, a program data storage destination index (ID) indicating an address at which program data is stored, and curriculum identification information. The user registers a curriculum number selected and used, an update date and time, and an email address of a mobile terminal owned by the user as personal information. Curriculum numbers used in the past are sequentially registered as logs in the curriculum identification information. In this example, the program data storage destination ID indicates the address of the program management table 110 that manages the created program data or information that specifies the program management table 110.

  In the case of studying a program in a school class or group, data communication with the server 1 is performed using the portable terminal 2 possessed by the teacher, so the teacher management table 100 is mainly used. Therefore, the user does not need to register the information on the student including the ID for identifying the student in the user management table 90. On the other hand, when all the students have the mobile terminal 2 and each person independently creates a program, the user information of all the students is registered in the user management table 90.

FIG. 10 shows a configuration example of the teacher management table.
The teacher management table 100 is a table for managing information on teachers and students who make up a class when learning a program in a school class. The teacher management table 100 is selected from the curriculum management table as the teacher ID for identifying the teacher, the teacher name, the program data storage index (ID) indicating the address where the program data is stored, and the curriculum identification information. A curriculum number to be used, a student identification ID of a class as user identification information, a mail address of a portable terminal owned by a teacher as personal information, and the like are registered. In the user identification information, all student IDs constituting a class are registered. Curriculum numbers used in the past are sequentially registered as logs in the curriculum identification information.

FIG. 11 shows a configuration example of the program management table.
The program management table 110 is a table for managing information on the created program. The program management table 110 registers the user ID of the user who created the program, the curriculum number, the created program data, the registration date and time of the program, and the modification date and time. In this embodiment, the student ID is registered as the user ID. The program data is the created program itself. In the case of a program step having a plurality of lines, the number of lines is registered.

[Overview of program creation]
Next, a schematic operation of creating a program will be described with reference to FIG.
This example shows a flow in a case where a teacher holding the mobile terminal 2 gives a programming lesson to a plurality of students. In the figure, steps indicated by solid lines represent processing operations by the mobile terminal or the server, and steps indicated by dotted lines represent operations of a human (teacher or student).

  First, the teacher operates the mobile terminal 2 to input an account and a password to log in (S1201). Then, the mobile terminal 2 is connected to the server 1 via the network 9, and is connected to a site for creating the program of the present case. Then, a curriculum selection screen is displayed on the display unit 205 of the mobile terminal 2. The teacher selects a target curriculum from the displayed screen (S1202).

Here, an operation from selection of a curriculum to preparation of the sheet 30 will be described. As for selection of a curriculum, a screen of a curriculum list as shown in FIG. 15A is displayed on the display unit 205 of the mobile terminal 2. The teacher selects a target curriculum (task) from the displayed curriculum list. Then, a screen showing the details of the selected task is displayed as shown in FIG. The teacher checks the details of the assignment and, if they are satisfied, selects “Sheet” at the bottom of the screen. Then, a sheet corresponding to the curriculum is printed as shown in FIG. Printing of the sheet can be performed using a printer designated in advance. When programming in a school class, it is necessary to understand the contents of the class in advance, so that the operations up to this point can be completed in advance and the seat can be prepared in advance.
The information on the screen as shown in FIGS. 15A to 15C is stored in the management information DB 105, and is transmitted to and displayed on the mobile terminal 2 in response to an input instruction of the mobile terminal 2.

  At the time of the actual programming lesson, the teacher distributes the prepared sheet 30 and chipset 40 to a plurality of students (S1203), and gives a programming question (S1204). The question is to explain the problem shown in FIG. For example, the title is "Let's get out of the room with the apples on the table" corresponding to the "Training 1" of the curriculum. As a slightly more advanced question (for example, "Introduction 3"), there may be a topic such as "athletic competition in which rabbits and turtles compete" without saying each action individually.

  The student performs programming, that is, an operation of arranging the chips 40 on the distributed sheets 30 (S1211). As a result of the operation of arranging the chips 40, the chips are arranged on the sheet 30 as shown in FIGS. 7A to 7C, for example. According to the experimental example, FIGS. 7A to 7C are examples in which the task “let's leave an apple on a table and get out of the room” is answered using a plurality of different chip arrangements.

  When the work of arranging the chips 40 on the sheet 30 is completed, the teacher photographs the worked chip arrangement sheet 40 with the camera 206 of the portable terminal 2 and transmits the photographed image to the server 1 (S1205).

  The server 1 performs a program creation process based on the received image (S1206). This processing will be described later in detail. The program created by the server 1 is executed by the mobile terminal 2 (S1207).

[Program creation process]
Next, a program creation process will be described with reference to FIGS.
FIG. 13 shows an overall flowchart of the program creation processing.
Prior to this processing, a site managed by the server 1 is accessed from the teacher's mobile terminal 2, and personal information including the name of the user (student) is registered in the user management table 90. In the teacher management table 100, the name of the teacher, the mail address of the portable terminal 2, and the identification ID of the student (user) of the class related to the programming lesson are registered.

Further, in the curriculum selection process (S1202) in FIG. 12, a curriculum is selected using the curriculum selection screen (FIG. 15), and the curriculum number selected from the curriculum management table 80 is registered in the teacher management table 100. In the process of the present example, since a different curriculum is not selected for each student, there is no need to register a selected curriculum number in the user management table 90.
Also, as shown in FIG. 12, the sheet 30 and the chip set corresponding to the selected curriculum number are distributed to a plurality of students, and the students have completed the work of arranging the chips 40 on the sheet 30 in the programming class. And

Here, an example of a chip arrangement will be described with reference to FIGS. 7A to 7C.
This example of the chip arrangement is an example in which three students arrange different chip arrangements for the task “let's put the apples on the table and get out of the room”. 7A to 7C perform the same operation and are correct. Incidentally, the operation by the program instruction based on the arrangement of the illustrated chips is as follows.
・ Two steps to the right ・ Three steps down ・ Pick up ・ Two steps to the left ・ Place ・ Two steps down ・ Open the door.

  The description returns to FIG. The teacher operates the mobile terminal 2 to log in (S1301). In this case, the information management unit 102 of the server 1 checks the teacher identification ID with reference to the teacher management table 100. If the curriculum number is not registered, the curriculum information is displayed on the display unit of the mobile terminal 1. A screen for prompting selection is displayed, and the above-described processing is performed from the screen based on FIG. Then, the information management unit 102 refers to the curryum management table 80 based on the curryum number registered in the teacher management table 100, and activates an application registered in the curryum management table 80 (S1302). When the application is activated, information of the curriculum management table 80 in which the selected curriculum number is registered is taken into the memory of the portable terminal 2 and stored.

  The teacher causes the identification unit 305 of the sheet 2 to be read using the barcode reader 207 of the mobile terminal 2. Further, a sheet (chip arrangement sheet) 30 on which the chips 40 are arranged is photographed using the camera 206. The information of the identification unit 305 and the photographed image of the chip arrangement sheet (chip arrangement sheet image) are temporarily stored in the memory 203 (S1303). When registering the chip arrangement sheet image in the memory 203, the teacher inputs a user identification ID (in this case, a student identification ID) from the input unit 204 in order to display that the image has been created by a specific user (student). input. The chip arrangement sheet image is given a user identification ID and stored in the memory 203.

  The information from the identification unit 305 includes information for identifying the curriculum, and the CPU 202 compares the identification information with the curriculum number registered in the curriculum management table 80. As a result of the comparison, if they match, it is determined that the used sheet 30 is correct, and the subsequent processing is continued. On the other hand, when the CPU 202 determines that the result is not correct, the CPU 202 displays the fact on the display unit 205 and prompts confirmation of the sheet 30 and the curriculum number.

  When the regular sheet 30 corresponding to the curriculum number is used, the CPU 202 transmits the chip arrangement sheet image to the server 1 via the network connection unit 208 (S1303). The transmission of the chip arrangement sheet image to the server 1 may be performed each time a chip arrangement sheet image for each student is acquired, or may be transmitted when the chip arrangement sheet images of a plurality of students are stored in the memory 203. . A teacher identification ID, a curriculum number, and a user identification ID (student identification ID in this example) are assigned to the chip arrangement sheet image and transmitted to the server 1.

When the server 1 receives the chip arrangement sheet image, the information management unit 102 checks whether the source address is a mail address registered in the teacher management table 100. Further, a student ID and a teacher ID assigned to the received chip arrangement sheet image are acquired, and whether or not the student ID and the teacher ID are registered in the teacher management table 100 is confirmed. If the result of this check is correct, the process proceeds to image processing and program creation processing. (Note that, when an individual user transmits a chip array sheet image from his or her own mobile terminal to the server, the information management unit 102 refers to the user management table 90 to check whether the mail address is a legitimately registered mail address. become.)
At the time of the program creation process, first, the image processing unit 104 performs a process of recognizing a picture image of a chip included in the acquired image (S1304). Thereafter, the program creation processing unit 103 performs a program creation process based on the recognition result (S1305). These processes will be described later with reference to FIG.

  The program data created by the program creation processing unit 103 is stored in the program management table 110 according to the processing of the information management unit 102. That is, in the program management table 110, the “user ID” is the student ID of the user who created the program, the “curriculum number” is the curriculum number registered in the teacher management table 100, and the “program” is the created curriculum number. The registered program data and the date and time when the program was stored are registered in the “program registration date and time”.

  After that, the program registered in the program management table 110 can be executed (S1307). In one example, the execution of the program includes a process of testing the program and confirming the test at an earlier stage. This is because, in the arrangement of the chips 40, there are cases where the chips of the control statements and the chips of the parameters are not arranged according to a predetermined rule, or there is no "END". These must be errors in the execution of the program. It is. If such an error is found in the test and confirmation processing, the operation shifts to program data correction.

  That is, the program data stored in the program management table 110 is transmitted to the transmission source portable terminal 2 via the network 9 for the test and confirmation of the program, and is executed by the CPU 202. The execution of the program by the CPU 202 is displayed on the display unit 205, for example, as a moving image of a character registered in the curriculum management table 80. The teacher looks at the moving image displayed on the display unit 205 and determines whether the displayed moving image is correct based on the “assignment” initially set and the chip arrangement in the chip arrangement sheet image acquired by the camera. As a result, if it is determined that the program is not correct, the student who has created the program is instructed verbally to correct the programming. At the same time, when an instruction to modify the program is issued from the input unit 204, the instruction is transmitted to the server 1 and a flag (not shown) being modified is stored in the program management table 110. When the correction of the programming by the student is completed, the corrected chip array sheet image is transmitted to the server 1 in the same manner as the operation described above. In this case, similarly, the corrected (modified version) program data is stored in the program management table 110. At the same time, the modification date and time of the program management table 110 is registered.

The modified version program is executed on the portable terminal 2 owned by the teacher in the same manner as described above. As a result, if there is no error, the fact is transmitted to the server 1, and a flag (not shown) indicating the completion of the program is registered in the program management table 110.
An example of execution of the completed program will be described later with reference to FIG.

Next, the image processing (S1304) and the program creation processing (S1304) will be described in detail with reference to the flowchart in FIG.
The image processing (S1304) is a process of recognizing and cutting out an image of a picture drawn on each chip 40 from the chip arrangement sheet image. Since the image captured by the camera 206 may be tilted, first, in the process of image correction (S1401), the tilt of the image is corrected based on the image of the sheet 30. For example, if it is determined that the guide line 304 of the sheet 30 is inclined by a certain angle θ with respect to the vertical axis (Y axis), the entire acquired image is rotated by an angle θ to match the vertical axis with the guide line 304.

  Next, in the image putter matching (S1402), it is determined whether or not the image of the design of each chip 40 constituting the chip arrangement matches the design registered in the instruction table 50 with reference to the instruction table 50. By this process, code data corresponding to the picture image registered in the instruction table 50 is selected. If there is an eraser, dust, or the like on the sheet 30, those images are not selected (excluded). In the image pattern matching, the acquired chip arrangement image is not compared with all the images registered in the instruction table 50, and only the chip image corresponding to the instruction reference number initially registered in the curryum management table 80 is used. By comparing the data with the target, the processing time is shortened. Coordinate information (X / Y coordinate information on the sheet 30) of the place where the picture image is recognized is added to the code data (command code) output as a result of the image pattern matching.

  In the program creation processing (S1304), the instruction codes corresponding to the picture of the picture specified by the image processing are arranged (S1403). The reason for arranging the instruction codes is that the image of the pattern recognized by the pattern matching is converted into the instruction code, but the arrangement is still in the state where the chips 40 are arranged, so the instruction codes are rearranged. This is for aligning. This alignment is based on, for example, the Y coordinate based on the coordinate information added to the instruction code. Further, at the time of generating the program, it is checked whether the arrangement of the instruction codes is correct with reference to the instruction table 50. For example, as a result of the above image processing, it is correct that the instruction code of the parameter “number” is right next to the instruction code of “moving”, but the parameter “number” is right next to the instruction code of “pick up” and “put”. Are lined up, it is determined that they are not correct because they are not permitted in the instruction table 50. If the order is not correct, one example ignores the parameter. Also, even if the order of the parameters with respect to the instruction code is correct, if the instruction code of the parameter is shifted to the right beyond the allowable range, the instruction code is moved to the left, and for example, the “moving” instruction is executed. Align to the right of the code.

  When the instruction codes are arranged and confirmed, program codes are generated in the order of the arranged instruction codes to generate program data (S1404). The created program data is stored in the “program” area of the program management table 110. In the program management table 110, a user ID, a curriculum number, and a program registration date and time are also registered.

  With the above processing operation, a program based on the arrangement of the patterns of the chip 40 is created. For example, as shown in FIG. 7A to FIG. 7C, if the arrangement of the chips is different even though the title is the same, the arrangement of instruction codes is also different, so that the program is different. However, the action of the character displayed on the screen of the display unit 205 by executing the program becomes the same.

[Execute program]
In the first embodiment, the created program is executed by the CPU 202 of the portable terminal 2 owned by the teacher. The execution of the program is displayed on the screen of the display unit 205 as a moving image accompanied by the movement of the character. However, the present invention is not limited to this, and the program is executed by various devices.

  FIG. 16 shows devices (referred to as connected devices) connected to the server 1 in the program creation support system. For example, the server 1 is connected via the network 9 to devices including a projector for projecting a moving image or video on a screen, a large display device 151, an audio device 152, and an operation device 153 such as a robot or a minicar.

  The number of connected devices on which the program is executed is not limited to one, but may be a plurality of devices. For example, when “sound” is used from the input / output commands in the command list shown in FIG. 5, the action of the character is displayed on the display device 151, and a sound is generated from the audio device 152. As another example, when a robot that emits voice is used, if “sound” and “control the connected device” are used from the input / output commands of the command list shown in FIG. The robot operates according to the execution of the program, and a sound is emitted from a speaker provided in the robot.

  The connection device can be any device having an IP address that can connect to the Internet. For the management of connected devices, a connected device management table for registering the IP address or URL of a connectable device is prepared in the management information DB 105 of the server 1, and the connected device of the output destination is referred to with reference to the connected device management table. By selecting, it is possible to connect to the device on which the program is executed. The selection of the connection device may be determined in advance, or may be selected from the portable terminal 2 or another portable terminal owned by the teacher after the program is completed.

[Program creation support system for the visually impaired]
The first embodiment is based on the premise that a program is created by a person with normal vision, but the present invention is also useful when a visually impaired person creates a program. For example, the sheet 30 and each chip 40 are braille for a visually impaired person. That is, the matrix line and the guide line 304 of the sheet 30, the title 301 and the "start" mark 303 are formed in Braille in addition to the printing described above. In addition to the above-described patterns, Braille representing the “name” of the chip is applied to a predetermined position of each chip 40. Further, in the instruction table 50, note data is registered corresponding to the "name" of each chip in addition to the configuration shown in FIG.

  The user relies on the braille of the sheet 30 and each chip 40 to program the chips 40 arranged on the sheet 30. The operation from the acquisition of the chip array sheet image by the camera to the generation of the program data is the same as in the first embodiment. In the execution of the program, the display function and the sound output function of the mobile terminal 2 can be enabled, or the program can be executed by connecting to the audio device 152 shown in FIG. In the execution of the program, the state of the arrangement of the plurality of chips is output as a change in sound due to musical notes, so that the visually impaired can grasp the performance of the program based on the change in sound.

[Program creation support system using other examples]
In the program creation support system according to the first embodiment, the server 1 includes a program creation processing unit 103, an image processing unit 104, a management information DB 105 storing related tables and information, and a program DB 106. However, the program creation support system according to the second embodiment allows the mobile terminal 2 to have all or a part of these processing functions and DB.

  For example, when the mobile terminal 2 has all the processing functions and related tables and information, first access a site for providing a programming creation service (for example, a site operated by the server 1), and execute a related application (program creation). The mobile terminal 2 downloads the function and related management information). Thereafter, a program can be created in the same manner as in the above embodiment. In this case, the sheet 30 and the chip 40 can be created by printing with a printer designated by a print instruction from the mobile terminal 2. The processing illustrated in FIGS. 13 and 14 is executed by a program in the CPU 202 included in the mobile terminal 2.

  Further, as an example in which the mobile terminal 2 has some processing functions and DBs, for example, the server 1 has an instruction table 50, and the mobile terminal 2 has a curriculum management table 80, an image processing function, and program creation. Functions can be provided. In this case, a pair of a command and an image used according to the curriculum is acquired from the command table 50 and stored in the curriculum management table 80. The program creation function can refer to the curriculum management table 80 and perform a process of specifying an instruction corresponding to a chip image. Usually, the mobile terminal 2 of many users can be connected to the server 1. Therefore, all instruction and image pairs are managed as a population in the instruction table 50, and the instruction and image selected from the instruction table 50 are selected according to the curriculum specified by the request from the portable terminal 2 of the user. Providing only the pair to the portable terminal 2 is meaningful.

[Operation of creating a program using another example]
In the first embodiment, as shown in FIG. 12, the arrangement of the chips 40 on the sheet 30 created by the student is photographed using the portable terminal 2 possessed by the teacher. However, the learning of the program is not necessarily performed only in the school class, and the user can also perform the learning by himself / herself. According to the third embodiment, the user has a portable terminal and can perform basic operations such as a login operation by himself.

  As shown in FIG. 17, the user himself logs in using the portable terminal (S1201), selects a curriculum (S1202), prepares a sheet and a chipset, and performs programming (S1211 ′). In this case, the teacher management table 100 is not used, and the user management table 90 is used. Other main processing operations are the same as in the first embodiment.

  This program creation support system can be applied not only to learning of program creation, but also to game devices for creating programs, control devices by programs, and programs for controlling toys.

[Program creation support processing flow according to another example]
In the first embodiment, in the processing flow with reference to FIG. 13, it has been described that the acquisition of an image, transmission (S1303), program creation processing (S1305), and program execution (S1307) are performed as a series of processing. According to the fourth embodiment, it is also possible to divide these processing steps into a plurality of steps and perform them at different timings. For example, in the first class in a school lesson, the students learn until the chips 40 are arranged on the sheet 30, photograph the chip arrangements created by the plurality of students with the camera 206, and store the plurality of chip arrangement sheet images in the memory. In the second time, the chip arrangement sheet image stored in the memory 203 is transmitted to the server 1, the server performs program creation processing, and the created program is transmitted to the portable terminal 2. The program is stored in the storage unit 203, and the program for one student is executed until the test is executed. In the third time, the program created by the remaining students is executed for the test, and then the program is modified. It is possible to implement. Especially in school lessons, it is important to proceed while observing the progress of all students, so it is meaningful to divide the program creation process into several parts as described above.

[Management table by other examples]
In the first embodiment, it is assumed that reference numbers of all the instructions used in the curriculum (reference numbers of the instructions selected from the instruction table 50 in FIG. 5) are registered in the curriculum management table 80. In the fifth embodiment, data of a chip image, a name, an operation, a parameter, and an instruction code of an instruction selected from the instruction table 50 may be registered. Further, by downloading an application for supporting program creation from the server 1 to the mobile terminal 2, the CPU 202 of the mobile terminal 2 can perform a process of creating a program based on the chip array image.

  As another example of the fifth embodiment, a plurality of instructions selected from the instruction table 50, a sheet 30, and a chip 40 are provided according to a user's request, and finally, the creation of a program by the user is supported. Business is possible. In this case, the curriculum management table 80 is a contract management table for each user, and the curriculum number is a contract identification code unique to the user. For example, the information management unit 102 of the server 1 follows the other example described above, and stores a contract management table in which each data of a selected command, such as a chip image, a name, an operation, a parameter, and an instruction code, is registered. A management table, a program management table, and an application for supporting program creation are provided to the user's mobile terminal 2. In the portable terminal 2, a program can be created by the CPU 202 based on the acquired chip arrangement image by the processing shown in FIGS. 13 and 14.

[Sheet from other examples]
The sheet 30 is not limited to the one shown in FIG. In consideration of the easiness and simplicity of the arrangement of the chips 40, it is preferable that a “start” mark, ruled lines, and guidelines 304 be printed in the program area 302, but according to the alternative, they are not necessarily required. If the start position and the arrangement direction of the arrangement of the chips 40 are known, or if the user is somewhat proficient, the program area 302 may not have the ruled lines and the guide lines 304. The “start” mark 303 can be replaced with a “START” chip.

  According to another example, the sheet 30 is not necessarily required. In short, the start position, the arrangement direction, and the end position are clarified according to the arrangement rule of the chips 40, the chips 40 are arranged on a blank sheet of paper, a desk, or a table, and the arrangement is photographed by a camera. The same operation or effect can be obtained. The image acquired by the camera is a chip array image without a sheet. For example, when arranging chips on a desk, there is no problem even if there is a foreign matter such as an eraser or a pencil on the desk. This is because in the process of image recognition based on the image captured by the camera, the image of the eraser or pencil is excluded, and only the image unique to the chip can be recognized and extracted.

  As another example without using a sheet, for example, a chip 40 is made of a quadrangular cardboard card of about 1 to 2 m in length and width, and this card is programmed by arranging it in a schoolyard, and the arrangement of the card is It is also possible to obtain an image of the chip array by taking an image from a high place with a camera equipped with a wireless communication function mounted on the drone.

[Example of assignment sheet]
Example 7 is a specific example of the assignment (curriculum) sheet shown in FIG. As shown in FIG. 18, the assignment sheet 70 mainly includes an assignment sentence 702 and a picture, and has an assignment number 701 and an identification unit 705 for managing the assignment (or assignment sheet). The identification unit 705 is formed of a two-dimensional barcode including identification information (assignment identification information) for identifying an assignment. The assignment identification information is associated with a curriculum number registered in the curriculum management table 80.

  In light of the first embodiment, the teacher (or the user) distributes an assignment sheet 70 corresponding to the assignment to the student every time the assignment changes. Then, when the teacher (or the user) distributes (uses) the assignment sheet 70 (for example, at the time of S1204), the teacher (or the user) uses the barcode reader 207 of the portable terminal 2 to read the identification unit 705 of the assignment sheet 70. In the program creation process (FIG. 13), after the application is started (step S1302), the identification unit 305 of the sheet 3 (in the first embodiment) is read by the barcode reader 207, but the identification of the assignment sheet 70 is performed. The unit 705 is read by the barcode reader 207. Thereby, the assignment sheet is associated with the curriculum number registered in the curriculum management table 80. Other operations are the same as those of the first embodiment, and can be understood by replacing the identification unit 305 in FIG.

  When using the task sheet 70, the sheet on which the chips 40 are arranged may not have the identification unit 305. FIG. 19 shows an example of the sheet 30 '. That is, according to the first embodiment, the sheet 30 is changed every time the curriculum changes, but according to the seventh embodiment, the task sheet 70 may be changed when the task changes, and the sheet 30 without the identification unit 305 may be used. There is no need to change ´. Therefore, the sheet 30 ′ can be used as a dedicated sheet on which the chips 40 are arranged (for example, a desk mount).

  As an application example of the seventh embodiment, a booklet including a plurality of pages of the assignment sheet 70 is provided to the user with or without charge. In this case, the identification unit 705 preferably includes site information of the server 1 that performs the program creation service, in addition to the task identification information. The user causes the barcode reader 207 of the portable terminal 2 to read the identification unit 705 of the target task sheet 70, and accesses a program creation service site based on the read information to correspond to the task sheet 70. By acquiring the information registered in the curriculum management table 80, it is possible to receive a program creation service.

[Tips from other examples]
In the eighth embodiment, irregularities are provided on the outer peripheral portion of the chip 40 in order to easily arrange the chips 40. As shown in FIG. 20, the flat chip 40 has triangular concave portions 411 and 412 formed on the upper side and the left side, and triangular convex portions 421 and 422 formed on the right side and the lower side. The reason why the irregularities are provided on the chip 40 is to regulate the arrangement of the chips 401, in other words, to simplify the arrangement of the chips. As shown in FIG. 21, the user easily and easily arranges the plurality of chips 40 in order (or may be referred to as a combination) such that the protrusions of one chip are engaged with the recesses of another chip. Can be. As a specific example, as shown in FIG. 22, since the “moving: with direction” instruction can add a parameter (see FIG. 5), the chip 401 of the “moving: with direction” instruction has a convex portion 422 on the right side. The parameter chip 402 has a concave portion 412 only on the left side. Although not shown in FIG. 22, as another example of the unevenness of the chip with reference to FIG. 5, for example, since no parameter is added to the “pick up” instruction, a convex portion is provided on the right side of the chip of the “pick up” instruction. There is no. In addition, since all parameters are added to operation commands, control commands, and the like, only the left side of the parameter chip has the concave portion 412, and the other sides have no concave portion or convex portion. Further, as shown in FIG. 22, the chip 401 of the “end” command has the concave portion 411 only on the upper side.

  According to the eighth embodiment, by appropriately forming irregularities on the sides of the rectangular chip 40 and arranging the plurality of chips, the chip arrangement of commands and parameters can be managed. Thus, the arrangement of the chips can be uniformly managed, and the sheet 30 for arranging the chips can be omitted.

  In addition, since the arrangement of the chips can be managed, the time and load for executing the image correction function in image processing (S1401 (FIG. 14)) and the program creation processing code data alignment function (S1403) can be reduced. As a whole, the time for creating a program can be shortened. For example, when the chips 40 having no unevenness are arranged on the sheet 30 as in the first embodiment, even if the guideline 304 is present, the left and right sides of the plurality of chips are uneven, inclined, or inclined. Often arranged. In such a case, the image can be properly corrected by the image correction function (S1401), but a processing time or load is required for that. On the other hand, according to the eighth embodiment, since the arrangement of the chips is managed by the unevenness provided on the chips, it is possible to prevent the user from undulating or tilting the arrangement of the chips. Therefore, processing such as an image correction function (S1401) by the image processing program becomes almost unnecessary, and the program creation processing can be sped up.

  According to the eighth embodiment, the triangular irregularities are formed on the sides of the rectangular chip. However, the irregularities are not limited to the triangular shape, and various shapes such as a semicircle and a square can be applied. Further, when only a specific parameter is suitable for a specific command, irregularities of a specific shape can be applied to both chips. For example, since only a parameter of “direction, height” is added to a “jump” command, both chips have a specific relationship. Therefore, while triangular irregularities are applied to the chips of the majority of instructions, special irregularities (for example, halfway) are provided on the right side of the chip of the “jump” instruction and the left side of the chip of the parameter of “direction, height”. Circular irregularities) can be applied. In this way, it is possible to prevent the chip of the parameter of “direction, height” from being selected for the chip of another operation command.

[Tips from other examples]
As another example of the chip 40, the pattern, shape, and size applied to the chip 40 are not limited to those shown in FIGS. Speaking of pictures, the pictures are not limited to the abstract pictures and characters shown in FIG. 4, but may be, for example, concrete pictures such as a rabbit running, rotating, and picking up objects. It will be easier for the infant to understand the relationship between the picture and the meaning of the command. As another example, playing cards or carta may be used. The shape of the chip is not limited to a quadrilateral, but may be various shapes. For example, a shape in which a picture of a rabbit running, sleeping, or flying may be cut out may be used.

  Further, although the name of the chip 40 is referred to as the chip 40 in the first embodiment, the present invention is not limited to this. For example, a card, a part, a piece, a small piece, a piece of paper, an element, and the like may be collectively called a part or an article.

  The chips are preferably planar cards for convenience of arrangement and subsequent clearing and storage, but are not necessarily limited to planar members. In short, it can be realized as long as it is an article that can be arranged, and a characteristic of a picture or shape (referred to as a visual recognition property) of the article and a command are uniquely associated with each other. It should be noted that an article having visual recognition characteristics may be called a component having a unique display.

  In the above embodiment, the pattern of the chip 40 is associated with the instruction by recognizing the image, but the present invention is not limited to this. For example, it is also possible to attach a unique number or barcode to each chip 40 in addition to a picture and recognize the number or barcode to associate the chip 40 with an instruction. In this case, the relationship between the numbers or barcodes and the commands is registered in the command table shown in FIG.

  As another example of the chip 40, the chip can be created and used by the user himself. For example, the user can increase the number of chips 40 by creating chips 40 having the same shape and pattern as those in FIG. 4 by hand or by copying. In this case, if the pattern of the chip created by the user is the same as or predetermined within a predetermined range, the image of the chip 40 created by the user is recognized as a similar image in the image processing of the server 1. Absent.

[Other examples]
In the above embodiment, the identification unit 305 of the sheet 30 is read by the barcode reader 207 of the portable terminal 2. Alternatively, the identification unit 305 can be read by the camera 206 and the identification information of the identification unit 305 can be recognized by the image recognition function.

Further, in the above-described embodiment, the arrangement of the chips arranged on the sheet is photographed by the camera 206 of the portable terminal 2. According to the alternative example, not only the camera of the portable terminal but also a camera having a communication function or an image of a chip array taken by a normal digital camera is stored in a USB memory or an SD memory, and the memory is programmed. It is also possible to acquire an image of the chip arrangement by loading it into a server or terminal for use.
The present invention can be implemented with various modifications and applications other than the above-described embodiments and alternative examples.

1: Server 2: Mobile terminal 9: Network 102: Information management unit 103: Program creation processing unit 104: Image processing unit 105: Management information DB 106: Program DB
202: CPU 203: Memory 204: Input unit 205: Display unit 206: Camera 207: Barcode reader 208: Network connection unit 30: Sheet 301: Title 302: Program area 303: Start mark 304 Guidelines 305: Identification unit 40: Chip 50: instruction table 70: assignment sheet 80: curriculum management table 90: user management table 100: teacher management table 110: program management table

Claims (17)

A program creation support system that supports creation of a program using a computer,
A curriculum sheet having at least a curriculum and a display of curriculum identification information identifying the curriculum, presented to a user for programming;
A curriculum management table for managing the curriculum identification information for identifying a curriculum for programming, and viewing characteristics of a plurality of articles used for programming based on the curriculum and instructions of a program associated with the viewing characteristics; When,
A camera for photographing an array of a plurality of articles arranged by a user according to the curriculum of the curriculum sheet when creating the program;
From an image of the array of the articles acquired by the camera, an image processing unit that recognizes an image of the viewing characteristics related to each of the plurality of articles,
A command corresponding to the image of the visual recognition characteristic of the article recognized by the image processing unit is specified based on the relationship between the visual recognition characteristic and the command managed in the curriculum management table, and the specified A program creation processing unit that creates a program composed of a plurality of instructions;
A program creation support system comprising: A program creation support system that supports creation of a program using a computer,
A curriculum sheet having at least a curriculum and a display of curriculum identification information identifying the curriculum, presented to a user for programming;
An instruction table for registering the viewing characteristics of each of the plurality of articles and instructions of the program in association with each other,
A curriculum identification information for identifying a curriculum for programming; a curriculum management table for managing information on a plurality of instructions selected from the instruction table used for programming based on the curriculum;
A camera for photographing an array of a plurality of articles arranged by a user according to the curriculum when creating the program;
From an image of the array of the articles acquired by the camera, an image processing unit that recognizes an image of the viewing characteristics related to the plurality of articles,
Based on the curriculum management table specified by the terminal, an instruction corresponding to the image of the visual recognition characteristic of the article recognized by the image processing unit is specified, and the instruction is configured from the specified plurality of instructions. A program creation processing unit for generating a program,
A program creation support system comprising: The computer includes a server and a terminal,
The server has the instruction table, the curriculum management table, the image processing unit, and the program creation processing unit,
The terminal includes said camera, an input unit, a display unit, a processor for executing a program, and a storage unit, a network connection unit that connects to the network, and
The program created by the program creation processing unit in the server is transmitted to the terminal, the processor of the terminal executes the received program, and the display unit displays a state of the execution of the program. 3. The program creation support system according to claim 2, wherein: The computer includes a terminal,
The terminal includes said camera, an input unit, a display unit, a processor for executing a program, and a storage unit, a network connection unit that connects to the network, and
The processor has the image processing unit and the program creation processing unit,
The storage unit holds at least the curriculum management table,
3. The program creation support system according to claim 1, wherein the program created by the program creation processing unit is executed by the processor, and the state of the execution is displayed on the display unit. The curriculum sheet has an identification unit including the curriculum identification information,
The terminal has a reading unit that reads the identification unit included in the curriculum sheet,
A matching unit that matches the curriculum identification information read by the reading unit with the curriculum identification information held by the curriculum management table;
As a result of the collation by the collation unit, when the image data matches, the process by the image processing unit is permitted, and the program creation processing unit specifies an instruction corresponding to the image recognized by the image processing unit. 3. The program creation support system according to claim 2 , wherein 6. The program creation support system according to claim 1, wherein the curriculum management table registers information on a character set used for an application executed in the curriculum. The curriculum management table is used as a contract management table that is used in accordance with the curriculum and that allows the user to use the plurality of articles having the viewing characteristics and instructions corresponding to the plurality of articles. The program creation support system according to any one of claims 1 to 5, wherein In the instruction table, the correspondence between the viewing characteristics of the article and the instruction of the program can be changed by an input instruction to a computer.
3. The program creation support system according to claim 2, wherein: A program management table that manages data of the program created by the program creation processing unit, and a connected device management table that manages information on a plurality of devices connectable to the computer,
3. The apparatus according to claim 1, wherein the program creation processing unit executes the program registered in the program management table on the device selected with reference to the connection device management table. A program creation support system described in the section. A program creation support system that supports creation of a program using a computer,
A plurality of planar chips having irregularities on the outer periphery and having a pattern drawn thereon,
An instruction table for registering the image of the design and the instruction of the program associated with each of the plurality of chips in association with each other,
In creating a program, a camera that captures an array of a plurality of chips arranged by engaging and recessing the chips,
From the image of the array of the plurality of chips acquired by the camera, an image processing unit that recognizes the image of the pattern that each of the plurality of chips has,
A program creation processing unit that refers to the command table, specifies a command corresponding to the image of the pattern recognized by the image processing unit, and generates a program including the specified plurality of commands;
A program creation support system comprising: Consisting of guidelines serving as a guide for arranging the plurality of chips, a start mark provided as one of the pictures above the guidelines, a plurality of vertical lines along the guidelines, and a plurality of horizontal lines. A sheet provided with matrix lines,
The plurality of chips can be arranged on the sheet in the vertical direction along the guide line of the matrix line, and in the direction of the horizontal line,
The program creation support system according to claim 10, wherein the camera captures an image of the array of the plurality of chips arranged on the sheet. A program creation support method for supporting creation of a program using a computer,
Providing a curriculum sheet having at least a curriculum and a display of curriculum identification information identifying the curriculum, presented to a user for programming;
A curriculum management table for managing the curriculum identification information for identifying a curriculum for programming, and viewing characteristics of a plurality of articles used for programming based on the curriculum and instructions of a program associated with the viewing characteristics; Preparing in a storage means,
In creating a program, a camera takes an image of an array of a plurality of articles arranged by a user according to the curriculum of the curriculum sheet,
An image processing step of recognizing an image of the viewing characteristics related to each of the plurality of articles from an image of the array of articles obtained by the camera;
A command corresponding to the image of the visual recognition characteristic of the article recognized in the image processing step is specified based on a relationship between the visual recognition characteristic and the command managed in the curriculum management table, and the specified A program creation processing step for creating a program composed of a plurality of instructions;
A program creation support method, comprising: A program creation support method for supporting creation of a program using a computer,
Providing a curriculum sheet having at least a curriculum and a display of curriculum identification information identifying the curriculum, presented to a user for programming;
Preparing in the storage means an instruction table for registering the viewing characteristics of each of the plurality of articles and the instructions of the program in association with each other;
Providing in the storage means the curriculum identification information for identifying a curriculum for programming, and a curriculum management table for managing information on a plurality of instructions selected from the instruction table used for programming based on the curriculum; ,
In creating a program, a camera takes an image of an array of a plurality of articles arranged by a user according to the curriculum of the curriculum sheet,
An image processing step of recognizing an image of the visual recognition characteristics related to the plurality of articles from an image of the array of articles obtained by the camera;
A program configured to specify an instruction corresponding to the image of the visual recognition characteristic of the article recognized in the image processing step based on the curriculum management table specified by the terminal, and configured from the specified plurality of instructions; A program creation processing step for generating
A program creation support method, comprising: 14. The method according to claim 12, wherein the curriculum management table registers information on a character set used for an application executed in the curriculum. A program creation support method for supporting creation of a program using a computer,
Preparing in the storage means an instruction table for registering the image of the pattern and the instruction of the program associated with each of the plurality of planar chips on which the image is drawn,
In creating a program, a camera captures an array of a plurality of chips in which the irregularities of the chip having irregularities on an outer peripheral portion are aligned and arranged,
From the image of the array of the plurality of chips acquired by the camera, an image processing step of recognizing the image of the design of the plurality of chips,
A program creation processing step of referring to the instruction table, identifying an instruction corresponding to the image of the pattern recognized in the image processing step, and generating a program including the identified plurality of instructions;
A program creation support method, comprising: A program creation support program for causing a computer to execute a process for supporting creation of a program,
A step of referring to an instruction table stored in the storage unit, the instruction table registering the instructions of the program and the viewing characteristics of the plurality of articles in association with each other;
Refer to curriculum identification information for identifying a curriculum for programming stored in the storage means, and a curriculum management table for managing information on a plurality of instructions selected from the instruction table used for programming based on the curriculum. Steps to
In the creation of the program, the camera shoots an array of a plurality of articles arranged by the user according to a curriculum sheet having at least a curriculum and a display of curriculum identification information for identifying the curriculum, which is presented to the user for programming. An image processing step of recognizing an image of the visual recognition characteristic related to the plurality of articles from the obtained image;
Based on the curriculum management table specified by the terminal, a command corresponding to the image of the visual recognition characteristic of the article recognized in the image processing step is specified, and the command is configured from the specified commands. A program creation processing step for generating a program;
A program for supporting program creation, which causes a computer to execute a process including the following. A program creation support program for causing a computer to execute a process for supporting creation of a program,
A step of referring to an instruction table for registering the image of the pattern and the instruction of the program, which are stored in the storage means, in correspondence with the image of the pattern and the instruction of the program which are included in each of the plurality of planar chips on which the pattern is drawn;
At the time of creating the program, the arrangement of the plurality of chips in which the irregularities of the chip having irregularities on the outer peripheral portion are engaged and arranged is obtained from an image of the arrangement of the plurality of chips obtained by a camera, from the image of the arrangement of the plurality of chips. An image processing step of recognizing the image of the picture having
A program creation processing step of referring to the instruction table, identifying an instruction corresponding to the image of the pattern recognized in the image processing step, and generating a program including the identified plurality of instructions;
A program for supporting program creation, which causes a computer to execute a process including the following.

Images