JP2018084966A - Information processing device and information processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing device and an information processing method that are capable of converting a numerical expression described by a normal common way to a program code by image inputting.SOLUTION: The information processing device comprises: an image data acquisition section for acquiring image data to which a numerical expression is transcribed; an image analysis section for extracting the numerical expression from the image data acquired by the image data acquisition section and for analyzing the extracted numerical expression; and a program generation section for automatically generating a program corresponding to the numerical expression on the basis of the analysis result by the image analysis section.SELECTED DRAWING: Figure 6

Description

  The present invention relates to an information processing apparatus and an information processing method for converting mathematical expressions into program codes.

  Conventionally, various ideas have been made to convert mathematical expressions into program codes.

  For example, in the technique disclosed in Patent Document 1, in creating a ladder code for controlling a programmable logic controller (PLC), a mathematical expression in a ladder diagram is analyzed and an address symbol in the mathematical expression is converted into a real address. Generated ladder code.

  Further, for example, in the technique of Patent Document 2, the input data is analyzed and decomposed into character constants, variables, mathematical formulas, rules, and screen images, the respective routines are created, and the source programs are integrated by integrating these routines. Have created.

JP 2002-140105 A Japanese Patent Laid-Open No. 04-141731

  However, in the technique of the above-mentioned patent document, when inputting a mathematical formula, the mathematical formula must be described in a special format, which is troublesome.

  In view of the circumstances as described above, an object of the present invention is to provide an information processing apparatus and an information processing method capable of inputting a mathematical expression described by a general general method and converting it into a program code.

  In order to achieve the above object, an information processing apparatus according to an aspect of the present invention includes an image data acquisition unit that acquires image data in which a mathematical formula is copied, and the mathematical formula from the image data acquired by the image data acquisition unit. And an image analysis unit that analyzes the extracted mathematical expression, and a program generation unit that automatically generates a program corresponding to the mathematical expression based on the result of the analysis by the image analysis unit.

  For this reason, mathematical expressions described in a general general method can be converted into program codes by inputting images.

  In order to achieve the above object, an information processing apparatus according to an aspect of the present invention includes an operation input unit, a display unit, and a region specification unit that receives a specification of a region in which the mathematical expression is reflected in the image data by a user. The image analysis unit may be configured to analyze the mathematical formula extracted and extracted from the region designated by the user when the manual extraction mode is designated.

  In order to achieve the above object, in an information processing method according to an aspect of the present invention, an image data acquisition unit acquires image data in which a mathematical expression is copied, and an image analysis unit is acquired by the image data acquisition unit. The mathematical expression is extracted from the image data, the extracted mathematical expression is analyzed, and the program generation unit automatically generates a program corresponding to the mathematical expression based on the analysis result by the image analysis unit.

  As described above, according to the present invention, mathematical expressions described in a normal general method can be converted into program codes by inputting images.

It is a block diagram in case the information processing apparatus 10 is comprised with a common computer. It is a figure for demonstrating the manual extraction mode performed in the area | region designation | designated part 11b. 6 is a diagram for explaining an example of processing in the information processing apparatus 1. FIG. 6 is a diagram for explaining an example of processing in the information processing apparatus 1. FIG. 6 is a diagram for explaining an example of processing in the information processing apparatus 1. FIG. 4 is a flowchart for explaining a flow of processing in the information processing apparatus 10.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[Configuration of information processing device]
First, the configuration of the information processing apparatus 10 according to an embodiment of the present invention will be described. The information processing apparatus 10 may be configured by dedicated hardware or software, or may be configured by a general computer. FIG. 1 shows a configuration diagram when the information processing apparatus 10 is configured by a general computer.

  As shown in the figure, the information processing apparatus 10 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, an operation input unit 14, a communication unit 15, a display unit 16, A storage unit 17 and an imaging unit 19 are included, and these blocks are connected via a bus 18.

  The ROM 12 stores a plurality of programs and data such as firmware for executing various processes. The RAM 13 is used as a work area for the CPU 11 and temporarily holds an OS (Operating System), various applications being executed, and various data being processed.

  The storage unit 17 is, for example, an HDD (Hard Disk Drive), a flash memory, or other nonvolatile memory. The storage unit 17 stores an OS, various applications, and various data.

  The communication unit 15 is connected to a network for exchanging information with other devices on the network.

  The CPU 11 develops a program corresponding to an instruction given from the operation input unit 14 among the plurality of programs stored in the ROM 12 or the storage unit 17 in the RAM 13, and the display unit 16 and the storage unit according to the expanded program. 17 is appropriately controlled.

  The operation input unit 14 is, for example, a pointing device such as a mouse, a keyboard, a touch panel, and other operation devices.

  The display unit 16 is, for example, a liquid crystal display, an EL (Electro-Luminescence) display, a plasma display, or the like.

  The imaging unit 19 is a camera or the like, images a mathematical formula written on paper or a mathematical formula displayed on a display unit of another device, and captures it as image data. Note that the imaging unit 19 is not an essential configuration, and image data can be acquired from the outside of the information processing apparatus 10 when the imaging unit 19 is not provided.

  Next, functional blocks realized by executing a program in the CPU 11 will be described.

  The functional blocks realized in the CPU 11 of the information processing apparatus 10 are an image data acquisition unit 11a, a region specification unit 11b, an image analysis unit 11c, and a program generation unit 11d.

  The image data acquisition unit 11a acquires a mathematical formula that is a basis of a program to be generated as image data. As an image acquisition method, an image of a mathematical expression created by the user in the information processing apparatus 10 may be acquired, the mathematical expression may be captured by the imaging unit 19, or stored in an external storage device. The acquired image data may be acquired via a network, or image data captured by an external camera or the like may be acquired.

  The region specifying unit 11b is manually extracted by the user when the image data acquired by the image data acquiring unit 11a includes a character string other than the mathematical formula and it is considered difficult to extract the mathematical formula portion. When the mode is designated, the formula area is determined based on the user's instruction.

  The image analysis unit 11c automatically extracts a mathematical expression from the image data or extracts a mathematical expression from an area designated by the user, and analyzes the image data to recognize the mathematical expression. The image analysis technique uses a known technique.

  The program generation unit 11d automatically generates a program based on the analysis result of the image data by the image analysis unit 11c. A known technique is used for program generation. The language of the program can be any language as long as there is a known technique for automatic program generation, such as C language or Java (registered trademark).

  The configuration of the information processing apparatus 10 has been described above.

[About manual extraction mode]
Next, the manual extraction mode executed in the area specifying unit 11b will be described. FIG. 2 is a diagram for explaining the manual extraction mode executed in the area designating unit 11b.

  As shown in this figure, if the image data contains a character string other than a mathematical expression, the user can specify the region by explicitly surrounding the mathematical expression portion in the image data by specifying the manual extraction mode. I can do it.

  As described above, by using the manual extraction mode, when image data including a character string other than a mathematical expression is processed, erroneous recognition due to automatic determination of a mathematical expression region can be prevented.

  The manual extraction mode executed in the region specifying unit 11b has been described above.

[Example of processing]
Next, an example of processing in the information processing apparatus 1 will be described. 3 to 5 are diagrams for explaining an example of processing in the information processing apparatus 1.

  First, it is assumed that the mathematical formula shown in FIG. 3 is given as image data.

  Next, the image analysis unit 11c analyzes mathematical formulas in the order shown in FIG. 4, for example. That is, the portions of sin θ and cos θ are recognized as a trigonometric function and θ is a variable as Equation 1.

  Next, the sum obtained by changing θ from 0 to 10 is recognized as Equation 2 in association with Equation 1.

  Next, the square of a is recognized as Equation 3.

  Next, the fraction obtained by dividing Equation 2 by Equation 3 is recognized as Equation 4.

  Next, the program generation unit 11d automatically generates the C language program shown in FIG. 5 based on the analysis result.

  Heretofore, an example of processing in the information processing apparatus 1 has been described.

[Process flow]
Next, the flow of processing in the information processing apparatus 10 will be described. FIG. 6 is a flowchart for explaining the flow of processing in the information processing apparatus 10.

  First, the image data acquisition unit 11a acquires image data in which a mathematical formula is copied from the inside or the outside of the information processing apparatus 10 (step S1).

  Next, the area specifying unit 11b determines whether or not the manual extraction mode is specified by the user (step S2).

  When the manual extraction mode is designated (Y in step S2), the area designation unit 11b accepts designation of an area in which the mathematical expression in the image data is reflected from the user, and the image analysis unit 11c starts from the designated area. A mathematical expression is extracted (step S3).

  When the manual extraction mode is not designated (N in Step S2), the image analysis unit 11c automatically determines the area where the mathematical expression is captured from the image data, and extracts the mathematical expression from the determined area (Step S4). .

  Next, the image analysis unit 11c analyzes the extracted mathematical formula (step S5).

  Next, the program generation unit 11d automatically generates a program corresponding to the mathematical expression based on the analysis result by the image analysis unit 11c (step S6).

  The flow of processing in the information processing apparatus 10 has been described above.

[Additional notes]
As described above, the information processing apparatus 10 according to the present invention extracts the mathematical formula from the image data acquisition unit 11a that acquires the image data in which the mathematical formula is copied, and the image data acquired by the image data acquisition unit 11a. And an image analysis unit 11c that analyzes the extracted mathematical formula, and a program generation unit 11d that automatically generates a program corresponding to the mathematical formula based on the result of the analysis by the image analysis unit 11c.

  For this reason, mathematical expressions described in a general general method can be converted into program codes by inputting images.

  In addition, this invention is not limited only to the above-mentioned embodiment, Of course, various changes can be added within the range which does not deviate from the summary of this invention.

10 ... Information processing device 11 ... CPU
11a ... Image data acquisition unit 11b ... Area designation unit 11c ... Image analysis unit 11d ... Program generation unit 12 ... ROM
13 ... RAM
DESCRIPTION OF SYMBOLS 14 ... Operation input part 15 ... Communication part 16 ... Display part 17 ... Memory | storage part 18 ... Bus 19 ... Imaging part

Claims (3)

An image data acquisition unit for acquiring image data in which a mathematical expression is copied;
An image analysis unit that extracts the mathematical expression from the image data acquired by the image data acquisition unit and analyzes the extracted mathematical expression;
An information processing apparatus comprising: a program generation unit that automatically generates a program corresponding to the mathematical expression based on a result of the analysis by the image analysis unit. The information processing apparatus according to claim 1,
An operation input section;
A display unit;
An area designating unit that accepts designation of an area in the image data by the user in which the mathematical expression is shown;
The image analysis unit
When manual extraction mode is specified,
An information processing apparatus that extracts the mathematical expression from the region designated by the user and analyzes the extracted mathematical expression. The image data acquisition unit acquires the image data in which the mathematical formula is copied,
The image analysis unit extracts the mathematical formula from the image data acquired by the image data acquisition unit, analyzes the extracted mathematical formula,
An information processing method in which a program generation unit automatically generates a program corresponding to the mathematical expression based on a result of the analysis by the image analysis unit.

Images