JP2020079943A - Program creation assisting system, method therefore, and program therefor - Google Patents

Abstract

To enable program creation to be learned by a simple procedure.SOLUTION: When creating a program, there are prepared a start chip having visible characteristic and arranged at a start position and a plurality of operation chips that define operation. A user arranges the start chip and the plurality of operation chips in a row and form a chip array. A program creation assisting system comprises a table for managing instructions to the plurality of operation chips, an image processing unit for recognizing from the image of the chip array having been acquired by a camera, the images of the plurality of operation chips following the image of the start chip, and a program creation processing unit for specifying instructions on the basis of the table with respect to the images of the plurality of operation chips recognized by the image processing unit and creating a program composed of a plurality of specified instructions.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a program creation support system and method, and a program therefor, and more particularly to a program creation support technique suitable for programming learning.

  With the development of AI (artificial intelligence) and information technology (IT), a shortage of IT engineers is expected, and the importance of training human resources for programming is being emphasized. In Japan, the Ministry of Education, Culture, Sports, Science and Technology has advocated the importance of programming education for children as one of the measures for developing human resources for programming, and programming education became essential in elementary schools from 2020. Various programming education systems for children, educational jigs, toys, etc. have already been proposed, and some of them have been put to practical use.

  As one of them, support for programming education for beginners using computers and the Internet has been proposed. For example, in patent document 1, a client for a learner, a client for a learning manager, and a learning management server are connected through a network, and a process of answering a task by a learner is grasped online in real time to form a database, A programming education support system that can easily and accurately grasp the programming proficiency of each learner by reproducing the answering process on any time axis based on the recorded data and visualizing it with a graph is disclosed. ..

  Further, in Non-Patent Document 1, as a service for children called "programin" developed by the Ministry of Education, Culture, Sports, Science and Technology, a program is assembled by combining a plurality of pictures (blocks) while operating a mouse on the screen of a display device. , Programming for children using a computer is disclosed. Further, Non-Patent Document 2 discloses a technique of operating a robot by creating a program using image recognition by an AR marker. This is to automatically transfer the program to the robot by taking a picture of a tablet in which "Dosa card" and "Joken card" on which an image serving as an AR marker is written are alternately arranged.

JP, 2006-227218, A

Ministry of Education, Culture, Sports, Science and Technology "Programin" October 22, 2013 http://www.mext.go.jp/programin/ Toshiyuki Hara, “Study on introducing augmented reality into programming experience in science experiment classroom for children”, Proc. of the 75th IPSJ National Congress (4), IPSJ, March 6, 2013, pp. 385-386

  The technique described in the above-mentioned Patent Document 1 is intended for the learning management server to easily and accurately grasp the degree of programming proficiency of the learner, and a detailed description will be given on how the learner creates a program. It has not been.

In addition, since the programming introduced in Non-Patent Document 1 is operated on the screen, use of a personal computer (PC) or the like is a prerequisite. When programming learning is performed in a school class, a PC corresponding to the number of students is required, which requires a considerable amount of cost. Further, the student needs to learn a basic operation for operating the screen of the PC. Further, Non-Patent Document 2 discloses a concept of photographing a card on which an AR marker is described with a tablet and programming the card. However, there are specific problems and technical means for facilitating programming by children. There is no suggestion.
Therefore, there is a demand for a mechanism or teaching material that can be easily learned by children, at a low cost.

  An object of the present invention is to provide a program creation support system, a method therefor, and a program therefor capable of creating a program by a simple method.

The program creation support system according to the present invention is preferably a program creation support system for supporting the creation of a program using a computer,
A plurality of chips each including a start chip arranged at a start position and having a plurality of operation chips that define an operation, each chip having a visual characteristic;
A table for managing instructions corresponding to the plurality of operation chips;
An image acquisition unit that acquires an image of a chip array formed by the start chips and the plurality of operation chips that are arranged,
From the image of the chip array acquired by the image acquisition means, an image processing unit that recognizes images of the plurality of operation chips, which are subsequent to the image of the start chip,
A program creation processing unit that specifies an instruction with respect to the images of the plurality of operation chips recognized by the image processing unit and refers to the table, and generates a program including the plurality of specified instructions. It is understood as a program creation support system characterized by that.
The present invention is also understood as a program creation support method and a program creation support program realized by the above program creation support system.

  According to the present invention, it is possible to create a program by a simple method.

FIG. 1 is a diagram showing a configuration of a program creation support system according to a first embodiment. It is a figure which shows the structural example of a portable terminal. It is a figure which shows the example of a program sheet. It is a figure which shows the example of the chip used for creation of a program. It is a figure which shows the example of a program instruction. It is a figure which shows the example of a program instruction. It is a figure which shows the example of arrangement|positioning of the chip in program creation. It is a figure which shows the example of arrangement|positioning of the chip in program creation. It is a figure which shows the example of arrangement|positioning of the chip in program creation. It is a figure which shows the structural example of a curriculum management table. It is a figure which shows the structural example of a user management table. It is a figure which shows the structural example of a teacher management table. It is a figure which shows the structural example of a program management table. It is a flow chart which shows a rough operation of program creation. It is a flow chart which shows processing operation of program creation. It is a flow chart which shows processing operation of program creation. It is a figure which shows the example of a screen display of a portable terminal. It is a figure which shows the connection structure of a program creation assistance system. 9 is a flowchart showing a schematic operation of creating a program according to the third embodiment. FIG. 13 is a diagram showing an example of a task sheet used in Example 7. FIG. 16 is a diagram showing an example of a program sheet used in Example 7. FIG. 16 is a diagram showing an example of a chip used in Example 8. FIG. 16 is a diagram showing an example of the arrangement of chips in Example 8. FIG. 16 is a diagram showing an example of the arrangement of chips in Example 8.

  A preferred example of the present invention is realized by a program creation support system using a computer. A plurality of chips on which pictures are drawn, in which commands are defined in advance, and a predetermined sheet on which the chips are arranged are prepared. The user selectively arranges the plurality of chips on the sheet according to the purpose. The chip array is photographed by a camera provided in a mobile terminal such as a smartphone. A processing device (for example, a server) in the program creation support system recognizes an image of a picture of each chip from an image of an array of chips acquired by a camera, identifies an instruction code that constitutes the program, and the program from the array of instruction codes. Create the data. The created program data is transmitted to the mobile terminal and executed. The execution of the program is displayed as a moving image of the character on the screen of the display unit of the mobile terminal, for example.

  According to a preferred example, in a class at a school where the user is composed of a large number of students, if there is one mobile terminal possessed by the teacher, a class for creating a program becomes possible. That is, each time each student finishes the chip arrangement, the camera of the mobile terminal photographs the chip arrangement, the image is transmitted to the server, and the server creates the program. Each time the program is executed, it can be viewed as a video on the screen of the mobile terminal, so that the performance of the program can be confirmed for each student.

  According to a preferred example of the present invention, a program can be created by a simple operation of arranging chips on a sheet, as compared with a program creating operation in which a user creates a program while operating a screen of a PC alone. it can. Therefore, it is easy to learn the procedure for creating the program, and the teacher and the student who teach the program are not overloaded. Moreover, since it is not necessary to prepare a PC for each user, it is suitable for a situation in which a large number of people study at the same time. Further, since it is possible to deal with this by preparing a set of chips and sheets for each user, it is possible to realize at low cost.

An embodiment of the present invention will be described in detail below with reference to the drawings.
FIG. 1 shows an example of the overall configuration of a program creation support system.
The program creation support system is configured by connecting a server 1 that supports the creation of a program and a plurality of mobile terminals 2 used by a user via a communication network 9.

  The server 1 is a computer that manages user information, performs data communication with a mobile terminal, creates and executes programs, and performs various types of data processing. Details of the function and processing will be described later. Although the hardware configuration of the server 1 is not shown, the server 1 has hardware resources such as a processing device (processor) that executes a program, a memory, an external storage device such as a hard disk, an input device, and a display device.

  In order to support the creation of the program, the server 1 includes an information management unit 102 that registers and manages information about users and workers of the mobile terminal 2, a program creation processing unit 103 that creates the program, and a program creation process unit 103. It has an image processing unit 104 that recognizes an image of a chip. Further, as a database (DB), it has a management information DB 105 for registering user information and various management information regarding the use of programming learning, and a program DB 106 for storing information regarding program creation. The configurations and functions of these processing units and DBs will be described later in detail. Although the management information DB 105 and the program DB 106 are configured as separate DBs in the illustrated example, they may be configured as a single DB.

The server 1 has a site for supporting program creation, and by connecting to this site from the mobile terminal 2, it is possible to receive program creation support.
The mobile terminal 2 is a terminal such as a smartphone (hereinafter simply referred to as a smartphone). The hardware configuration of the mobile terminal 2 will be described later with reference to FIG.

FIG. 2 shows a hardware configuration of the mobile terminal 2.
The mobile terminal 2 is a mobile terminal such as a smartphone (hereinafter, simply referred to as a smartphone), and includes a processor (CPU) 202 that executes various application programs, a memory 203 that stores data and programs, and a screen touch type. An input unit 204, a display unit 205 that displays a screen, a camera 206 that is a photographing function, a barcode reader 207 that reads a two-dimensional barcode, and a network connection unit 208 that performs data communication with the server 1 through the network 9. Have. The smartphone can connect to many sites via the Internet, and the CPU 202 executes an application desired by the user. In addition to the above, the smartphone has various functions such as a voice input/output function.

[Program sheets and chips]
FIG. 3 shows an example of a program sheet.
The program sheet (hereinafter simply referred to as a sheet) 30 is, for example, an A4 size sheet used for creating a program. In school lessons, the teacher distributes the preprinted sheet 30 to each student. The sheet 30 is preferably made of plastic rather than plain paper so that it can be used multiple times by the student and can withstand the placement of chips.

  A program area 302 is secured in a large space in the center of the seat 30. A title 301 is printed on the upper end of the sheet 30, and an identification unit 305 including a two-dimensional barcode is printed on the upper right end. The title 301 is, for example, the name of a curriculum. The two-dimensional barcode of the identification unit 305 includes identification information for identifying the curriculum.

  In the program area 302, a matrix of ruled lines is printed by a plurality of vertical lines and horizontal lines, and a "start" mark 303 is printed at the upper left corner of the program line 302. It is printed. The matrix line and the guideline 304 serve as a guide for arranging the chips. The vertical and horizontal lines in a matrix form the X/Y coordinates in the image processing of the chip pattern. The original information of the sheet 30 is stored as an image in the program DB 106.

  The student who is the worker arranges the chips from the top to the bottom along the guideline 304. At other times, the chips are arranged from left to right along the matrix line. 7A to 7C show an example in which a plurality of chips 40 are arranged on the sheet 30.

FIG. 4 shows an example of a chip used for creating a program.
The chip 40 is an indicator in which the instructions of the program are defined. For example, it is a plastic rectangular piece measuring about 2 cm in length and 5 cm in width, which expresses (prints) the operation of the command by a pattern. Each picture differs for each command. The chip 40 is preferably formed with a simple adhesive material on its back surface so that it can be easily fixed on the sheet 30 and easily peeled off. The original information of the design of the chip 40 is stored in the program DB 106 as an image.

  Although FIG. 4 shows an example of 17 types of chips, the number of chips can be further increased according to the type of instruction. The plurality of chips 40 for distribution will be referred to as a chip set. The sheet 30 and the chip set 40 are sold and shipped to the user in response to the request from the user. It should be noted that the server 1 may be a service for printing the sheet 30 or the chipset 40 on a designated printer in response to a request from the mobile terminal 2.

[Example of program instruction]
FIG. 5 shows an example of program instructions (instruction list).
The program commands include nine commands (motion commands) that represent display/motion, two commands (control commands) that represent control statements, four commands (input/output commands) that represent input/output, and parameters, that is, 1 to 9 It is composed of commands (parameters) representing the numerical values up to and other four commands.

  Each chip uniquely corresponds to an instruction, and the relationship between the picture of the chip, the instruction name, the instruction operation, and the parameter is as shown in the drawing. Remarks represent reference explanations. For example, in the motion command, the picture pointing to the right (the “move: with direction” command at the first position in FIG. 5) is a command indicating “move in the specified direction”, and when this arrow points to the right Indicates moving to the right and moving to the left when facing left. The parameter represents the number, direction, number, etc. of operation commands. In relation to the instruction, the parameter can be set for the instruction for which the parameter can be specified. For example, the "move: with direction" command can set the number of parameters, but the "pick up" command cannot set the parameter.

  As illustrated in FIG. 6, a rightward picture “move: with direction” command means that “3 turns to the right” when the parameter is “3”. Here, the arrangement of one chip 401 representing a certain instruction is indispensable, and the arrangement of the parameter 402 is arbitrary. The parameter 402 changes depending on the type of instruction and its execution level.

  Note that, in the “other” command, the “START” command is not used when the “start” is printed on the sheet 30. The “END” instruction is placed at the end of the chip array. Instructions for operators and conditional statements are provided, but may not be used depending on the content of the curriculum.

  The relationship between the pattern of the chip (namely, the image of the pattern), the name indicating the motion, and the motion of these commands is defined in a command table (indicated by reference numeral 50) which is a correspondence table and stored in the program DB 106. .. Here, an example of the screen display of the command table 50 is as shown in FIG. 5, but the command table 50 stored in the program DB 106 includes unique code data (command code) corresponding to the image of the picture.

  In one example, a plurality of instructions (referred to as an instruction set) are selected from the instruction table 50 according to the curriculum. Further, the content of the instruction table 50 can be changed when a new pattern of a chip or a new command is specified, or when a predetermined pattern is to be deleted or changed. It is possible to change the correspondence relationship between the pattern of the chip and the command in the command table 50 by an input instruction (not shown) of the server 1 or an administrator's input instruction from the mobile terminal 2.

[Description of various tables]
Next, the configurations of various tables used for supporting the program creation will be described with reference to FIGS. The tables 80 to 110 are stored in the management information DB 105.

FIG. 8 shows a configuration example of the curriculum management table.
The curriculum management table 80 is a table that manages a curriculum for creating a program to be provided to the user and a command used for the curriculum. Here, the curriculum may be called a task or a problem for the user to program. The curriculum, the specific content of the tasks corresponding to the curriculum, and the sheets used in the curriculum are associated with each other. This will be described later with reference to FIG.

  The curriculum management table 80 is used in the curriculum selected from the instruction table 50, a curriculum number for identifying the curriculum, an address for executing an application according to the curriculum, a character set representing a character used in the application. The reference numbers (reference numbers of the instruction table 50) of all instructions are registered. Here, the application is a program that performs a series of processes starting from the selection of the curriculum, the process of capturing the image of the sheet and the chip array by the mobile terminal 2, and the process of creating the program. The character is a person who is used as a moving image in the execution of the program, and is, for example, an image of a rabbit or a turtle, or an image of a famous anime.

  The reason why the reference numbers of all the instructions used in the curriculum are registered in the instruction set is to speed up the program creation process. That is, in the program creation process, the image of each chip is recognized from the image of the chip array while referring to the instruction table 50. However, if all the chip images registered in the instruction table 50 are scanned at this time, it is very difficult. It takes a long time. On the other hand, if the instruction corresponding to the reference number registered in the instruction set is scanned, the time required for image recognition is significantly shortened.

FIG. 9 shows a configuration example of the user management table.
The user management table 90 is a table for managing information on users who create programs. The user management table 90 includes identification information which is an identification ID of the user, a name of the user, a program data storage index (ID) indicating an address storing program data, and a curriculum management table 80 as curriculum identification information. The curriculum number selected and used from, the update date and time, and the mail address of the mobile terminal owned by the user as personal information are registered. The curriculum number used in the past is sequentially registered as a log in the curriculum identification information. In this example, the program data storage destination ID represents the address of the program management table 110 that manages the created program data or information that specifies the program management table 110.

  When conducting a program study in a school class or in a group, the teacher management table 100 is mainly used because data communication is performed with the server 1 using the mobile terminal 2 owned by the teacher. Therefore, the user does not have to register the information about the student including the ID for identifying the student in the user management table 90. On the other hand, when all the students have the mobile terminal 2 and each person independently creates a program, the user information of all the students is registered in the user management table 90.

FIG. 10 shows a configuration example of the teacher management table.
The teacher management table 100 is a table for managing information about teachers and students who make up classes when conducting program learning in a school lesson. The teacher management table 100 is selected from the teacher ID for identifying the teacher, the teacher's name, the program data storage index (ID) indicating the address storing the program data, and the curriculum management table as the curriculum identification information. A curriculum number used as a user ID, a student identification ID of a class as user identification information, and an e-mail address of a mobile terminal owned by a teacher as personal information are registered. All the plurality of student IDs constituting the class are registered in the user identification information. The curriculum number used in the past is sequentially registered as a log in the curriculum identification information.

FIG. 11 shows a configuration example of the program management table.
The program management table 110 is a table that manages information about created programs. The program management table 110 registers the user identification ID of the program, the curriculum number, the created program data, the program registration date and time, and the modification date and time. In this embodiment, the student identification ID is registered as the user identification ID. The program data is the created program itself, and in the case of a program step of a plurality of lines, the number of lines is registered.

[Outline of program creation]
Next, with reference to FIG. 12, a schematic operation of creating a program will be described.
This example shows a flow in the case where a teacher who has the mobile terminal 2 gives a programming lesson to a plurality of students. In the figure, steps indicated by solid lines represent processing operations by the mobile terminal or the server, and steps indicated by dotted lines represent human (teacher or student) operations.

  First, the teacher operates the mobile terminal 2 to input an account and a password to log in (S1201). Then, the mobile terminal 2 is connected to the server 1 via the network 9 and is connected to the program creation site of the present case. Then, a screen for curriculum selection is displayed on the display unit 205 of the mobile terminal 2. The teacher selects a desired curriculum from the displayed screen (S1202).

Here, the operation from the selection of the curriculum to the preparation of the sheet 30 will be described. To select a curriculum, a screen of a curriculum list as shown in FIG. 15A is displayed on the display unit 205 of the mobile terminal 2. The teacher selects the desired curriculum (task) from the displayed curriculum list. Then, as shown in FIG. 15B, a screen showing details of the selected task is displayed. If the teacher confirms the detailed content of the assignment and is satisfied, he or she selects "Sheet" at the bottom of the screen. Then, a sheet corresponding to the curriculum as shown in FIG. 15C is printed. The printing of the sheet can be performed using a printer designated in advance. In addition, when programming is performed in a school class, it is necessary to understand the content of the class in advance. Therefore, the operation up to this point can be completed in advance and the seat can be prepared in advance.
Information on the screen as shown in FIGS. 15A to 15C is stored in the management information DB 105, and is transmitted to and displayed on the mobile terminal 2 in response to an input instruction from the mobile terminal 2.

  In the actual programming class, the teacher distributes the prepared sheet 30 and chipset 40 to a plurality of students (S1203) and gives a programming question (S1204). The question is to explain the problem shown in FIG. For example, a subject corresponding to “Training 1” of the curriculum, “put apples on the table and leave the room”. As a slightly more advanced question (for example, “Introduction 3”), there may be a topic such as “A sports meet where Rabbit and Turtle compete” without saying each action.

  The student performs programming, that is, the work of arranging the chips 40 on the distributed sheet 30 (S1211). As a result of the arrangement work of the chips 40, the chips are arranged on the sheet 30 as shown in FIGS. 7A to 7C, for example. According to the experimental example, FIGS. 7A to 7C are examples in which the problem “let's leave the apple on the table and leave the room” is solved by a plurality of different chip arrangements.

  When the work of arranging the chips 40 on the sheet 30 is completed, the teacher takes a picture of the worked chip arrangement sheet 40 with the camera 206 of the mobile terminal 2 and sends the taken image to the server 1 (S1205).

  The server 1 performs a program creation process based on the received image (S1206). This processing will be described later in detail. The program created by the server 1 is executed by the mobile terminal 2 (S1207).

[Program creation processing]
Next, a program creating process will be described with reference to FIGS. 13 and 14.
FIG. 13 shows an overall flowchart of the program creating process.
Prior to this processing, the teacher's mobile terminal 2 accesses the site operated by the server 1, and personal information including the name of the user (student) is registered in the user management table 90. Further, in the teacher management table 100, the name of the teacher, the mail address of the mobile terminal 2, and the identification ID of the student (user) of the class related to the programming class are registered.

Further, by the curriculum selection processing (S1202) of FIG. 12, the curriculum is selected using the curriculum selection screen (FIG. 15), and the curriculum number selected from the curriculum management table 80 is registered in the teacher management table 100. In the process of this example, since a different curriculum is not selected for each student, it is not necessary to register the selected curriculum number in the user management table 90.
Further, as shown in FIG. 12, the sheet 30 and the chip set corresponding to the selected curriculum number are distributed to a plurality of students, and the students have completed the work of arranging the chips 40 on the sheet 30 in the programming class. And

Here, an example of the chip arrangement will be described with reference to FIGS. 7A to 7C.
The example of this chip arrangement is an example in which three students perform different chip arrangements for the task “put apples on the table and leave the room”. The same operation is performed in all of FIGS. 7A to 7C, and the answer is correct. Incidentally, the operation by the program instruction based on the arrangement of the illustrated chips is as follows.
・Two steps to the right ・Three steps below ・Pickup ・Two steps to the left ・Place ・Two steps below ・Open the door.

  Description is returned to FIG. The teacher operates the mobile terminal 2 to log in (S1301). In this case, the information management unit 102 of the server 1 refers to the teacher management table 100, confirms the teacher identification ID, and if the curriculum number is not registered, the curriculum number is displayed on the display unit of the mobile terminal 1. A screen prompting selection is displayed, and the above-described processing is performed from the screen based on FIG. Then, the information management unit 102 refers to the curriculum management table 80 based on the curriculum number registered in the teacher management table 100 and activates the application registered in the curriculum management table 80 (S1302). When the application is activated, the information of the curriculum management table 80 in which the selected curriculum number is registered is captured and stored in the memory of the mobile terminal 2.

  The teacher uses the barcode reader 207 of the mobile terminal 2 to read the identification unit 305 of the sheet 2. Further, the sheet (chip array sheet) 30 on which the chips 40 are arrayed is photographed using the camera 206. The information of the identification unit 305 and the captured image of the chip arrangement sheet (chip arrangement sheet image) are temporarily stored in the memory 203 (S1303). When registering the chip array sheet image in the memory 203, the teacher inputs the user identification ID (in this case, the student identification ID) from the input unit 204 in order to display that the image is created by a specific user (student). input. A user identification ID is added to the chip array sheet image and stored in the memory 203.

  The information from the identification unit 305 includes information for identifying the curriculum, and the CPU 202 compares the identification information with the curriculum number registered in the curriculum management table 80. As a result of the comparison, if the two match, it is determined that the used sheet 30 is correct, and the subsequent processing is continued. On the other hand, if the CPU 202 determines that the result is not correct, the CPU 202 displays a message to that effect on the display unit 205 to prompt confirmation of the sheet 30 and the curriculum number.

  When the regular sheet 30 corresponding to the curriculum number is used, the CPU 202 transmits the chip array sheet image to the server 1 via the network connection unit 208 (S1303). The transmission of the chip arrangement sheet image to the server 1 may be performed each time the chip arrangement sheet image for each student is acquired, or may be transmitted when the chip arrangement sheet images of a plurality of students are accumulated in the memory 203. . A teacher identification ID, a curriculum number, and a user identification ID (student identification ID in this example) are added to the chip array sheet image and transmitted to the server 1.

When the server 1 receives the chip array sheet image, the information management unit 102 confirms whether the source address is a mail address registered in the teacher management table 100. Further, the student identification ID and the teacher identification ID given to the received chip array sheet image are acquired, and it is confirmed whether or not they are registered in the teacher management table 100. If the result of this confirmation is correct, the processing moves to image processing and program creation processing. (Note that when the user individually sends the chip array sheet image from his/her own mobile terminal to the server, the information management unit 102 refers to the user management table 90 and confirms whether the mail address is properly registered. become.)
In the program creation process, first, the image processing unit 104 performs a process of recognizing the image of the design of the chip from the acquired image (S1304). After that, the program creation processing unit 103 performs program generation processing based on the recognition result (S1305). These processes will be described later with reference to FIG.

  The program data created by the program creation processing unit 103 is stored in the program management table 110 according to the processing of the information management unit 102. That is, in the program management table 110, the “user ID” is the student ID of the user who created the program, the “curriculum number” is the curriculum number registered in the teacher management table 100, and the “program” is the created The date and time when the program is stored is registered in the “program registration date and time” of the created program data.

  After that, the program registered in the program management table 110 can be executed (S1307). In one example, the execution of a program includes the process of testing the program and its verification before it. In the arrangement of the chips 40, there are cases where the control statement chips and the parameter chips are not arranged according to a predetermined rule, or there is no "END", and these must be regarded as an error in the execution of the program. Is. When such an error is found in the test and confirmation process, the work of correcting the program data is started.

  That is, in order to test and confirm the program, the program data stored in the program management table 110 is transmitted to the mobile terminal 2 as the transmission source via the network 9 and executed by the CPU 202. The execution of the program by the CPU 202 is displayed on the display unit 205 as a moving image of the character registered in the curriculum management table 80, for example. The teacher looks at the moving image displayed on the display unit 205 and determines whether the displayed moving image is correct based on the “task” initially set and the chip arrangement in the chip arrangement sheet image acquired by the camera. As a result, when it is determined that the program is incorrect, the student who created the program is verbally instructed to correct the programming. At the same time, when an instruction to modify the program is issued from the input unit 204, the instruction is transmitted to the server 1 and a flag (not shown) being modified is stored in the program management table 110. When the student finishes modifying the programming, the modified chip array sheet image is transmitted to the server 1 in the same manner as the above-described operation. In this case, similarly, the modified (modified version) program data is stored in the program management table 110. At the same time, the modification date and time of the program management table 110 is registered.

The modified program is executed on the mobile terminal 2 owned by the teacher in the same manner as described above. As a result, if there is no error, a message to that effect is transmitted to the server 1, and a flag (not shown) indicating program completion is registered in the program management table 110.
An example of executing the program after completion will be described later with reference to FIG.

Next, the image processing (S1304) and the program creation processing (S1304) will be described in detail with reference to the flowchart in FIG.
The image processing (S1304) is processing for recognizing and cutting out the image of the pattern drawn on each chip 40 from the chip array sheet image. Since the image captured by the camera 206 may be tilted, first, in the image correction (S1401) process, the tilt of the image is corrected based on the image on the sheet 30. For example, when it is determined that the guideline 304 of the sheet 30 is inclined at an angle θ with respect to the vertical axis (Y axis), the entire acquired image is rotated by the angle θ and the vertical axis is aligned with the guideline 304.

  Next, in the image pattern matching (S1402), referring to the instruction table 50, it is determined whether or not the image of the pattern included in each chip 40 forming the chip array matches the pattern registered in the instruction table 50. By this processing, the code data corresponding to the image of the pattern registered in the command table 50 is selected. Even if there is an eraser or dust on the sheet 30, those images are not selected (excluded). In the image pattern matching, the acquired chip array image is not compared with all the images registered in the instruction table 50, but only the chip image corresponding to the instruction reference number originally registered in the calibration management table 80. The processing time is shortened by comparing the above items. The code information (command code) output as a result of the image pattern matching is added with the coordinate information (X/Y coordinate information on the sheet 30) of the place where the pattern image is recognized.

  In the program creating process (S1304), the instruction codes corresponding to the image of the picture specified by the image process are aligned (S1403). The reason for aligning the instruction codes is that the image of the pattern recognized by the pattern matching is converted into the instruction codes, but the arrangement is still in the state in which the chips 40 are arranged. Therefore, the instruction codes are rearranged. This is to align them. In this alignment, for example, the Y coordinate is used as a reference based on the coordinate information added to the instruction code. Further, when the program is generated, the instruction table 50 is referred to and it is confirmed whether the arrangement of the instruction codes is correct. For example, as a result of the image processing described above, it is correct when the instruction code of the parameter “number of times” is lined up to the right of the instruction code of “moving”, but the parameter “number of times” is placed to the right of the instruction code of “pick up” or “put”. In the case where "" is lined up, it is determined that it is not correct because it is not permitted in the instruction table 50. If the alignment is incorrect, the parameter is ignored in one example. Even if the parameters are arranged correctly with respect to the instruction code, if the instruction code of the parameter deviates to the right beyond the allowable range, the instruction code is moved to the left to Align to the right of the cord.

  When the alignment and confirmation of the instruction codes are completed, the aligned instruction codes are converted into program codes to generate program data (S1404). The data of the created program is stored in the “program” area of the program management table 110. The user identification ID, curriculum number, and program registration date and time are also registered in the program management table 110.

  A program based on the pattern arrangement of the chip 40 is created by the above processing operation. For example, as shown in FIGS. 7A to 7C, if the arrangement of chips is different while the subject is the same, the arrangement of instruction codes is also different, so that the program is different. However, the action of the character displayed on the screen of the display unit 205 becomes the same by executing the program.

[Run the program]
In the first embodiment, the created program is executed by the CPU 202 of the mobile terminal 2 owned by the teacher. The execution of the program is assumed to be displayed on the screen of the display unit 205 as a moving image accompanied by the motion of the character. However, the program is not limited to this, and is executed by various devices.

  FIG. 16 shows devices (referred to as connected devices) connected to the server 1 in the program creation support system. For example, the server 1 is connected via the network 9 with a device including a projector for projecting a moving image or video on a screen, a large display device 151, an audio device 152, and an operating device 153 such as a robot or a minicar.

  The number of connected devices on which the program is executed is not limited to one, and a plurality of devices can be used. For example, when “Make a sound” is used from the input/output commands of the command list shown in FIG. 5, the motion of the character is displayed on the display device 151, and the sound is generated from the audio device 152. As another example, when a robot that emits a voice is used, if “play a sound” and “control a connected device” are used from the input/output instructions of the instruction list shown in FIG. The robot operates according to the execution of the program, and a voice is emitted from a speaker included in the robot.

  The connected device can be any device that has an IP address and can be connected to the Internet. For management of the connected device, a connected device management table for registering the IP address or URL of the connectable device is prepared in the management information DB 105 of the server 1, and the connected device of the output destination is referred to by referring to the connected device management table. By selecting, it is possible to connect to the device on which the program is executed. The connection device may be selected in advance or can be selected from the mobile terminal 2 owned by the teacher or another mobile terminal after the program is completed.

[Program creation support system for the visually impaired]
Although the first embodiment is premised on the creation of a program by a visually impaired person, the present invention is also useful when a visually impaired person creates a program. For example, Braille is applied to the sheet 30 and each chip 40 for the visually impaired. That is, the matrix lines and guidelines 304 of the sheet 30, the title 301, and the "start" mark 303 are formed in Braille in addition to the above-described printing. In addition to the above-mentioned pattern, Braille representing the "name" of the chip is provided at a predetermined position of each chip 40. In addition to the configuration shown in FIG. 5, note data is registered in the instruction table 50 in correspondence with the “name” of each chip.

  The user relies on the braille of the sheet 30 and each chip 40 to arrange and program the chips 40 on the sheet 30. The operation from the acquisition of the chip array sheet image by the camera to the generation of the program data is the same as in the first embodiment. In executing the program, the display function and the voice output function of the mobile terminal 2 can be enabled, or the program can be executed by connecting to the audio device 152 shown in FIG. When the program is executed, the state of arrangement of a plurality of chips is output as a change in sound due to a note, so that a visually impaired person can grasp the performance of the program based on the change in the sound.

[Program creation support system by another example]
In the program creation support system according to the first embodiment, the server 1 includes a program creation processing unit 103, an image processing unit 104, a management information DB 105 that stores related tables and information, and a program DB 106. However, the program creation support system according to the second embodiment can allow the mobile terminal 2 to have all or part of these processing functions and DB.

  For example, in the case where the mobile terminal 2 has all the processing functions and related tables and information, first, access the site (for example, the site operated by the server 1) that provides the programming creation service, and execute the related application (program creation). Functions and related management information) are downloaded and stored in the mobile terminal 2. After that, the program can be created in the same manner as in the above embodiment. In this case, the sheet 30 and the chip 40 can be printed by the printer specified by the print instruction from the mobile terminal 2 and created. The processing shown in FIGS. 13 and 14 is executed by a program in the CPU 202 included in the mobile terminal 2.

  In addition, as an example in which the mobile terminal 2 has some processing functions and DB, for example, the server 1 holds an instruction table 50, and the mobile terminal 2 holds a curriculum management table 80, image processing functions, and program creation. It can have a function. In this case, a pair of an instruction and an image used according to the curriculum is acquired from the instruction table 50 and stored in the curriculum management table 80. The program creation function can refer to the curriculum management table 80 and perform a process of identifying a command corresponding to the image of the chip. Usually, the mobile terminals 2 of many users can be connected to the server 1. Therefore, all pairs of commands and images are managed in the command table 50 as a population, and the commands and images selected from the command table 50 according to the curriculum specified by the user's mobile terminal 2 are requested. It is meaningful to provide only the pair to the mobile terminal 2.

[Program creation operation by another example]
In the first embodiment, as shown in FIG. 12, it is assumed that the mobile terminal 2 carried by the teacher is used to photograph the array of the chips 40 on the sheet 30 created by the student. However, the learning of the program is not limited to the school lessons alone, and the user can perform the learning by himself/herself. According to the third embodiment, the user has the mobile terminal and can perform basic operations such as a login operation by himself.

  As shown in FIG. 17, the user logs in by using the mobile terminal (S1201), selects a curriculum (S1202), prepares a sheet and a chipset, and performs programming (S1211′). In this case, the teacher management table 100 is not used, but the user management table 90 is used. The other main processing operations are the same as in the first embodiment.

  Further, the program creation support system can be applied to a game device for creating a program, a program for controlling a control device and a toy by the program, and the like in addition to learning for creating the program.

[Program creation support processing flow according to another example]
In the first embodiment, in the process flow shown in FIG. 13, the process of capturing and transmitting an image (S1303) to creating a program (S1305) and executing the program (S1307) is performed as a series of processes. According to the fourth embodiment, it is possible to divide these processing steps into a plurality of steps and perform them at different timings. For example, in the first lesson in a school lesson, learning up to arranging the chips 40 on the sheet 30 is performed, the chip arrays created by a plurality of students are photographed by the camera 206, and a plurality of chip array sheet images are stored in the memory. Up to storing in 203, the chip array sheet image stored in the memory 203 in the second time is transmitted to the server 1, the server performs a program creation process, and the created program is transmitted to the mobile terminal 2 to be stored in the memory. It is stored in 203 and the program of one student is run as a test. The program created by the remaining students is run as a test for the third time, and then the program is modified. It is possible to carry out. Especially in school lessons, since it is important to proceed while watching the progress of all students, it is meaningful to divide the process of creating the program into several parts as described above.

[Management table according to another example]
In the first embodiment, the reference numbers of all the instructions used in the curriculum (the reference numbers of the instructions selected from the instruction table 50 in FIG. 5) are registered in the curriculum management table 80. In the fifth embodiment, each data of the image of the instruction, the name, the operation, the parameter, and the instruction code of the instruction selected from the instruction table 50 may be registered. Further, by downloading the application for supporting the program creation to the mobile terminal 2 from the server 1, the CPU 202 of the mobile terminal 2 can perform the process of creating the program based on the chip array image.

  As another example of the fifth embodiment, a plurality of instructions selected from the instruction table 50, a sheet 30, and a chip 40 are provided in response to a user's request, and finally a user can create a program. Business can be considered. In this case, the curriculum management table 80 becomes a contract management table for each user, and the curriculum number becomes a contract identification code unique to the user. For example, the information management unit 102 of the server 1 follows the above-described other examples, and a contract management table in which each data of the image, name, operation, parameter, and command code of the chip of the selected command is registered, and the user. A management table, a program management table, and an application for supporting program creation are provided to the user's mobile terminal 2. In the mobile terminal 2, the CPU 202 can create a program based on the acquired chip array image by the processing shown in FIGS. 13 and 14.

[Sheet according to another example]
The seat 30 is not limited to the one shown in FIG. Considering the easiness and simplicity of the arrangement of the chips 40, it is preferable that the "start" mark, ruled line, or guideline 304 is printed in the program area 302, but according to the alternative, they are not always necessary. If the start position of the arrangement of the chips 40 and the arrangement direction are known, or if the user is familiar with it to some extent, the program area 302 may not need the ruled lines or the guidelines 304. Further, the “start” mark 303 can be replaced with a “START” chip.

  Further, according to another example, the sheet 30 is not always necessary. In short, the start position, the arrangement direction, and the end position are clarified in accordance with the arrangement rule of the chips 40, the chips 40 are arranged on a blank sheet of paper, a desk, or a table, and the arrangement is photographed by a camera, so that the above-mentioned first embodiment is obtained. The same action or effect can be obtained. The image acquired by the camera is a chip array image without a sheet. For example, when arranging the chips on a desk, there is no problem even if foreign matter such as an eraser or a pencil is on the desk. This is because the eraser or pencil image is excluded in the process of image recognition based on the image captured by the camera, and only the image unique to the chip can be recognized and extracted.

  As another example of not using a sheet, for example, the chip 40 is made of a cardboard of a quadrilateral shape having a length and width of 1 to 2 m, and programming is performed by arranging this card in the school yard, and the arrangement of the card is It is also possible to acquire an image of the chip array by shooting from a high place with a camera equipped with a wireless communication function installed in the drone.

[Example of assignment sheet]
Example 7 is a specific example of the task (curriculum) sheet shown in FIG. As shown in FIG. 18, the assignment sheet 70 mainly includes assignment sentences 702 and pictorial diagrams, and has an assignment number 701 and an identification unit 705 for managing assignments (or assignment sheets). The identification unit 705 is formed of a two-dimensional barcode including identification information (issue identification information) for identifying an issue. The task identification information is associated with the curriculum number registered in the curriculum management table 80.

  According to the first embodiment, the teacher (or the user) distributes the task sheet 70 corresponding to the task to the students each time the task changes. Then, when the teacher (or the user) distributes (uses) the task sheet 70 (for example, in S1204), the teacher (or the user) uses the barcode reader 207 of the mobile terminal 2 to read the identification unit 705 of the task sheet 70. In the program creation process (FIG. 13), after the application is started (step S1302), the identification sheet 305 of the sheet 3 (in the first embodiment) is not read by the barcode reader 207, but the identification of the task sheet 70 is performed. The section 705 is read by the barcode reader 207. As a result, the assignment sheet 70 is associated with the curriculum number registered in the curriculum management table 80. Other operations are similar to those of the first embodiment, and it can be understood by replacing the identifying unit 305 in FIG. 13 with the identifying unit 705.

  When the task sheet 70 is used, the sheet on which the chips 40 are arranged may not have the identification unit 305. FIG. 19 shows an example of this sheet 30'. That is, according to the first embodiment, the sheet 30 is changed every time the curriculum changes, but according to the seventh embodiment, the problem sheet 70 may be changed when the problem changes, and the sheet 30 having no identification unit 305 may be changed. There is no need to change ´. Therefore, the sheet 30' can be used as a dedicated sheet (for example, a mount on a desk) on which the chips 40 are arranged.

  As an application example of the seventh embodiment, a booklet including the task sheet 70 extending over a plurality of pages is provided to the user for a fee or for free. In this case, the identification unit 705 may include site information of the server 1 that provides the program creation service, in addition to the assignment identification information. The user causes the barcode reader 207 of the mobile terminal 2 to read the identification unit 705 of the target task sheet 70, accesses the site of the program creation service based on the read information, and responds to the task sheet 70. It is possible to obtain the information registered in the curriculum management table 80 and receive the program creation service.

[Chip according to another example]
In the eighth embodiment, in order to facilitate the arrangement of the chips 40, unevenness is provided on the outer periphery of the chips 40. As shown in FIG. 20, the flat plate-shaped chip 40 has triangular concave portions 411 and 412 formed on the upper side and the left side, and triangular convex portions 421 and 422 formed on the right side and the lower side. The reason for providing the unevenness on the chip 40 is to regulate the array of the chips 401, in other words, to simplify the array of the chips. As shown in FIG. 21, a user can easily arrange a plurality of chips 40 in order (or may be called a combination) by engaging a convex portion of one chip with a concave portion of another chip. You can As a specific example, as shown in FIG. 22, since the “moving: with direction” instruction can add a parameter (see FIG. 5), the chip 401 of the “moving: with direction” instruction has a convex portion 422 on the right side. The parameter chip 402 has a recess 412 only on the left side. Although not shown in FIG. 22, as another example of the unevenness of the chip with reference to FIG. 5, for example, since a parameter is not added to the “pick up” command, a convex portion is formed on the right side of the chip of the “pick up” command. There is no. Further, since all parameters are added to operation commands, control commands, etc., the concave portion 412 is provided only on the left side of the parameter chip, and the concave portion or convex portion is not provided on the other sides. Further, as shown in FIG. 22, the chip 401 of the “end” command has the recess 411 only on the upper side.

  According to the eighth embodiment, irregularities are appropriately formed on the sides of the rectangular chip 40, and a plurality of these chips are arrayed, so that the array of commands and parameters can be managed. As a result, the arrangement of the chips can be managed uniformly, so that the sheet 30 for arranging the chips can be omitted.

  Further, since the chip arrangement can be managed, it is possible to reduce the time and load for executing the image correction function (S1401 (FIG. 14)) and the program creation processing code data alignment function (S1403) in the image processing, As a whole, the time required to create a program can be shortened. For example, when the chips 40 having no unevenness are arranged on the sheet 30 as in the first embodiment, even if the guideline 304 is provided, the left and right sides of the plurality of chips are uneven, uneven, or tilted. Often arranged. In such a case, the image correction function (S1401) can be used to make a correct correction, but the processing time or load is required for that. On the other hand, according to the eighth embodiment, since the chip array is managed by the unevenness provided on the chip, it is possible to prevent the chip array from being uneven or tilted by the user. Therefore, the processing such as the image correction function (S1401) by the image processing program is almost unnecessary, and the program creation processing can be speeded up.

  According to the eighth embodiment, triangular irregularities are formed on the sides of a rectangular chip, but the irregularities are not limited to triangular shapes, and various shapes such as semicircles and squares can be applied. Further, in the case where only specific parameters are adapted to a specific instruction, it is possible to apply irregularities of a specific shape to both chips. For example, since only the "direction, height" parameters are added to the "jump" command, both chips have a specific relationship. Therefore, while the triangle-shaped unevenness is applied to the majority of the instruction chips, special unevenness (for example, half Circular irregularities) can be applied. In this way, it is possible to prevent the chip of the "direction, height" parameter from being selected for another operation command chip.

[Chip according to another example]
As another example of the chip 40, the design, shape, and size of the chip 40 are not limited to those shown in FIGS. 4 to 5. Regarding the design, it is not limited to the abstract pictures and characters shown in FIG. 4, and for example, a concrete picture in which a rabbit runs, rotates, or picks up an object may be used. It will be easier for infants to understand the relationship between the picture and the meaning of the command. Other examples include playing cards and cartes. Further, the shape of the chip is not limited to the quadrilateral, and may be various shapes. For example, the shape in which a rabbit runs, sleeps, or flies may be cut out.

Although the chip 40 is called as the chip 40 in the first embodiment, the name is not limited to this. For example, a card, a part, a piece, a small piece, a paper piece, and an element may be collectively referred to as a part or an article.
The chip is preferably a flat card for the sake of convenience in that it is arranged and then put away and stored, but it is not necessarily limited to a flat member. In short, it is feasible as long as the articles can be arranged, and the characteristics of the pattern or shape of the articles (referred to as visual recognition characteristics) and the command are uniquely associated with each other. It should be noted that an article having visual recognition characteristics may be referred to as a component having a unique display.

  Further, in the above embodiment, the pattern of the chip 40 is associated with the command by image recognition, but the invention is not limited to this. For example, it is also possible to associate each chip 40 with a command by attaching a unique number or barcode to each chip 40 and recognizing the number or barcode. In that case, the relationship between numbers or barcodes and commands is registered in the command table shown in FIG.

  As another example of the chip 40, the chip can be created and used by the user. For example, the user can increase the number of chips by making the chips 40 having the same shape and pattern as those in FIG. 4 by hand or by copying. In this case, if the design of the chip produced by the user is the same as the predetermined one or within an allowable range, the design of the chip 40 produced by the user in the image processing of the server 1 is recognized as a similar image. Absent.

[Other examples]
In the above embodiment, the identification section 305 of the sheet 30 is read by the barcode reader 207 of the mobile terminal 2. Alternatively, the identification unit 305 can be read by the camera 206 and the identification information included in the identification unit 305 can be recognized by the image recognition function.

Further, in the above-described embodiment, it is assumed that the camera 206 of the portable terminal 2 photographs the array of chips arranged on the sheet. According to an alternative example, not only the camera of the mobile terminal but also a camera having a communication function or an image of a chip array taken by a normal digital camera is stored in a USB memory or an SD memory, and this memory is programmed. It is also possible to acquire an image of the chip array by loading it on a server or terminal for use in the game.
The present invention can be carried out by variously modifying and applying other than the above-mentioned embodiments or alternatives.

1: server 2: mobile terminal 9: network 102: information management unit 103: program creation processing unit 104: image processing unit 105: management information DB 106: program DB
202: CPU 203: Memory 204: Input unit 205: Display unit 206: Camera 207: Bar code reader 208: Network connection unit 30: Sheet 301: Title 302: Program area 303: Start mark 304 Guidelines 305: Identification unit 40: Chip 50: instruction table 70: assignment sheet 80: curriculum management table 90: user management table 100: teacher management table 110: program management table

Claims (13)

A program creation support system for supporting the creation of a program using a computer,
A plurality of chips each including a start chip arranged at a start position and having a plurality of operation chips that define an operation, each chip having a visual characteristic;
A table for managing instructions corresponding to the plurality of operation chips;
An image acquisition unit for acquiring an image of a chip array formed by the start chips and the plurality of operation chips that are arranged,
From the image of the chip array acquired by the image acquisition means, an image processing unit for recognizing images of the plurality of operating chips after the image of the start chip,
A program creation processing unit that identifies an instruction with respect to the images of the plurality of operation chips recognized by the image processing unit, refers to the table, and generates a program including the plurality of identified instructions.
A program creation support system having: The computer includes a server and a terminal,
The server includes the table, the image processing unit, and the program creation processing unit,
The terminal includes the image acquisition unit, an input unit, a display unit, a processor that executes a program, and a storage unit,
The program created by the program creation processing unit in the server is transmitted to the terminal, the processor of the terminal executes the received program, and the display unit displays a state of execution of the program. The program creation support system according to claim 1. The computer includes a terminal,
The terminal includes the image acquisition unit, an input unit, a display unit, a processor that executes a program, and a storage unit,
The processor has the image processing unit and the program creation processing unit,
The storage unit stores the table,
The program creation support system according to claim 1, wherein the program created by the program creation processing unit is executed by the processor, and a state of the execution is displayed on the display unit. A curriculum sheet having at least a curriculum presented to a user for programming and a display of curriculum identification information identifying the curriculum is used,
The table manages the curriculum identification information for identifying a curriculum for programming, the visual characteristic of each of the plurality of chips used for programming based on the curriculum, and the command of the program associated with the visual characteristic. Curriculum management table
The chip array is arranged by a user according to the curriculum of the curriculum sheet,
The program creation processing unit identifies a command corresponding to the image of the visual recognition property of the chip recognized by the image processing unit, based on the relationship between the visual recognition property managed by the curriculum management table and the command. The program creation support system according to claim 1. The program creation support system according to claim 4, wherein the curriculum management table registers information regarding a character set used for an application executed in the curriculum. A program creation support system for supporting the creation of a program using a computer,
A plurality of chips each having visual recognition characteristics,
A sheet in which the plurality of chips are arranged, having a specific mark at a predetermined position,
A table for managing commands corresponding to the visual recognition characteristics of the plurality of chips;
Image acquisition means for photographing the plurality of chips arranged on the sheet, starting from the mark,
An image processing unit that recognizes an image of the visual recognition characteristics of the plurality of chips from images of the plurality of chips acquired by the image acquiring unit;
A program creation processing unit that refers to the table, identifies a command corresponding to the image of the visual recognition characteristic recognized by the image processing unit, and generates a program composed of the plurality of identified commands; A program creation support system having: 7. The program creation support system according to claim 1, wherein the table is a management table for managing a command provided to a user and corresponding to the plurality of chips having the visual recognition characteristic. 7. The program creation support system according to claim 1, wherein the correspondence between the visual recognition characteristic of the chip and the command of the program in the table can be changed by an input instruction to a computer. A program management table that manages data of a program created by the program creation processing unit; and a connected device management table that manages information of a plurality of devices connectable to the computer,
The program creation processing unit causes the program registered in the program management table to be executed by the device selected by referring to the connected device management table,
The program creation support system according to claim 1 or 6. A program creation support method for supporting the creation of a program using a computer,
A step of preparing a plurality of chips each including a start chip arranged at a start position and having a plurality of operating chips that define an operation, each chip having a visual characteristic;
Managing a command corresponding to the plurality of operating chips in a table stored in a storage means;
A step in which the image acquisition means acquires an image of a chip array formed by the start chips and the plurality of operating chips that are arranged,
From the image of the chip array acquired by the image acquisition means, an image processing step of recognizing images of the plurality of operation chips, which are subsequent to the image of the start chip,
Program creation processing steps for specifying an instruction based on the table for the images of the plurality of operation chips recognized in the image processing step, and generating a program including the plurality of specified instructions.
A method for supporting the creation of a program. A program creation support method for supporting the creation of a program using a computer,
Managing a command corresponding to a plurality of operating chips in a table stored in a storage means;
From the image of the chip array formed by the start chips arranged in the starting position and having the respective visual recognition characteristics and the plurality of operation chips that define the operation, An image processing step for recognizing the image of the operating chip,
A program creation processing step for specifying an instruction based on the table for an image of the plurality of operation chips recognized in the image processing step, and generating a program including the plurality of specified instructions;
A method for supporting the creation of a program. A program creation support system for supporting the creation of a program using a computer,
A plurality of chips each having a visual recognition characteristic, a sheet having a specific mark at a predetermined position, the plurality of chips are arranged, is used,
Managing a command corresponding to the visual recognition characteristics of the plurality of chips in a table stored in a storage unit;
From the mark as a starting point, the image of the plurality of chips arranged on the sheet, a step of acquiring an image,
An image processing step of recognizing an image of the visual recognition characteristic of the plurality of chips from the images of the plurality of chips acquired by the image acquiring means;
A program creation processing step of referring to the table, specifying a command corresponding to the image of the visual recognition characteristic recognized in the image processing step, and generating a program composed of the plurality of specified commands; A method for supporting program creation, comprising: A program creation support program that causes a computer to execute processing for supporting the creation of a program,
Managing a command corresponding to a plurality of operating chips in a table stored in a storage means;
From the image of the chip array formed by the start chips arranged in the starting position and having the respective visual recognition characteristics and the plurality of operation chips that define the operation, the plurality of images that are after the image of the start chip An image processing step for recognizing the image of the operating chip of
A program creation processing step for specifying an instruction based on the table for an image of the plurality of operation chips recognized in the image processing step, and generating a program including the plurality of specified instructions;
A program creation support program that causes a computer to execute processing including.

Images