JP6491931B2 - Information processing apparatus and program - Google Patents

Description

  The present invention relates to a technique for recognizing a code representing information.

  For example, in Patent Document 1, when an input device having a plurality of conductive contact portions is placed on a multi-touch panel, the position of each contact portion is read and processing corresponding to the positional relationship (for example, corresponding to the input device) It is disclosed that processing for displaying a character image to be performed is performed.

JP 2014-29712 A

  By the way, when the input device as described above is placed in an arbitrary direction with respect to the multi-touch panel, how to specify the position and direction of the coordinate axis that determines the position of each contact portion becomes a problem. Such a problem occurs not only when the position of the conductive contact portion is electrically read on the multi-touch panel, but also when the two-dimensional code is optically read, for example. Therefore, in the case of a matrix type two-dimensional code such as a QR code (registered trademark), for example, as illustrated in FIG. 11, a reference code (referred to as a cutout symbol) for specifying the position and direction of the coordinate axes is respectively Information codes representing information to be transmitted are arranged in three corners one by one and in a coordinate plane defined by the reference code.

  Even in the multi-touch panel, the position and direction of the coordinate axes can be specified by using three reference codes corresponding to the cut-out symbols of the QR code. However, the number of contact portions that can be simultaneously detected in the multi-touch panel is limited to, for example, 11 pieces. Thus, in order to maximize the amount of information transmitted by the information code under strict restrictions compared to optical reading, the number of reference codes used only for specifying the coordinate axes is three. Is desirable.

  The present invention has been made in view of such circumstances, and an object of the present invention is to reduce the number of reference codes for specifying coordinate axes that determine the coordinates of an information code representing information.

In order to solve the above problems, the present invention holds two reference codes for specifying coordinate axes and one or more information codes arranged at coordinates identified by the coordinate axes, and is provided with a hole. When the medium is brought into contact with or close to the input surface on which the image is displayed, the two reference codes and the one or more information codes are read from the medium, and the positions and sizes of the two reference codes on the input surface are read. A reference code detecting unit for detecting the length, a coordinate axis specifying unit for specifying the coordinate axis on the input surface based on a result detected by the reference code detecting unit, and the coordinate axis specified by the coordinate axis specifying unit. to identify the coordinates, which information code is arranged, is information represented by the information code, brought into contact with or close to the input surface In the position of the hole provided in serial medium, to provide an information processing apparatus characterized by comprising an information acquiring unit that acquires information for displaying an image for the image displayed on the input surface.

Further, according to the present invention, a medium holding two reference codes for specifying coordinate axes and one or more information codes arranged at the coordinates identified by the coordinate axes is brought into contact with the input surface of the multi-touch panel. When the two reference codes and the one or more information codes are input from the medium, a reference code detection unit that detects the position and size of the two reference codes on the input surface, and the reference code detection Based on the result detected by the unit, the coordinate axis specifying unit that specifies the coordinate axis on the input surface, and each coordinate where the information code is arranged according to the coordinate axis specified by the coordinate axis specifying unit, An information acquisition unit that acquires information represented by an information code, wherein the coordinate axis specifying unit is a first reference code that is the two reference codes Among the second reference codes, the first reference code position or the second reference code position, and the measurement direction determined as the direction for measuring the size of the first reference code or the second reference code There is provided an information processing apparatus characterized by specifying an X axis and a Y axis, which are coordinate axes on the input surface, using a measurement direction determined as a direction in which the size of the input is measured .

The coordinate axis specifying unit uses the position of the first reference code as the origin and the axis passing through the position of the second reference code as the X axis, and the direction from the origin toward the second reference code as the X axis positive direction, Using the position of the first reference code as the origin, the axis corresponding to the measurement direction of the size of the first reference code is the Y axis, and the positive direction of the X axis is rotated 90 degrees counterclockwise and the positive direction of the Y axis You may make it.

The coordinate axis specifying unit uses the position of the first reference code as an origin, an axis passing through an end of the second reference code close to the origin in the measurement direction of the size of the second reference code as an X axis, The direction from the origin to the second reference code is the X axis positive direction, the position of the first reference code is the origin, the axis corresponding to the measurement direction of the size of the first reference code is the Y axis, and the X axis A direction obtained by rotating the positive direction by 90 degrees counterclockwise may be the Y-axis positive direction.

The coordinate axis specifying unit passes through the position of the first reference code through the position of the first reference code and the size of the second reference code through the position of the second reference code. The intersection point with the measurement direction line is the origin of the X and Y axes, the axis corresponding to the measurement direction of the size of the first reference code through the position of the first reference code is the Y axis, and The direction from the origin toward the first reference code may be the Y-axis positive direction, and the direction obtained by rotating the positive direction of the Y-axis 90 degrees clockwise may be the X-axis positive direction.

The coordinate axis specifying unit uses the position of the first reference code as an origin and an axis passing through the position of the second reference code as a Y axis, a direction from the origin toward the second reference code as a Y axis positive direction, The axis corresponding to the measurement direction of the size of the first reference code with the position of the first reference code as the origin is taken as the X axis, and the direction rotated 90 degrees clockwise from the positive direction of the Y axis is taken as the X axis positive direction. You may make it do.

According to the present invention, a computer holds two reference codes for specifying coordinate axes and one or more information codes arranged at coordinates identified by the coordinate axes, and a medium provided with holes is provided. When the image is displayed or touched on the input surface, the two reference codes and the one or more information codes are read from the medium, and the positions and sizes of the two reference codes on the input surface are read. A reference code detecting unit for detecting; a coordinate axis specifying unit for specifying the coordinate axis on the input surface based on a result detected by the reference code detecting unit; and the information code according to the coordinate axis specified by the coordinate axis specifying unit Is information that is identified by the information code and is represented by the information code before being brought into contact with or close to the input surface. In the position of the hole provided in the medium, to provide a program for functioning as an information acquiring unit that acquires information for displaying an image for the image displayed on the input surface.
Further, according to the present invention, a medium that holds two reference codes for specifying coordinate axes and one or more information codes arranged at coordinates identified by the coordinate axes is provided on the input surface of the multi-touch panel. When the two reference codes and the one or more information codes are input from the medium in contact with each other, a reference code detection unit that detects a position and a size of the two reference codes on the input surface; and Based on the result detected by the reference code detecting unit, the coordinate axis specifying unit for specifying the coordinate axis on the input surface, and the coordinates where the information code is arranged according to the coordinate axis specified by the coordinate axis specifying unit are identified. Functioning as an information acquisition unit that acquires information represented by the information code, and the coordinate axis specifying unit Among the first reference code and the second reference code, the measurement direction determined as the direction of measuring the position of the first reference code or the position of the second reference code and the size of the first reference code Alternatively, a program for specifying an X axis and a Y axis, which are coordinate axes on the input surface, using a measurement direction determined as a direction in which the size of the second reference code is measured is provided.
The coordinate axis specifying unit uses the position of the first reference code as the origin and the axis passing through the position of the second reference code as the X axis, and the direction from the origin toward the second reference code as the X axis positive direction, Using the position of the first reference code as the origin, the axis corresponding to the measurement direction of the size of the first reference code is the Y axis, and the positive direction of the X axis is rotated 90 degrees counterclockwise and the positive direction of the Y axis You may make it.
The coordinate axis specifying unit uses the position of the first reference code as an origin, an axis passing through an end of the second reference code close to the origin in the measurement direction of the size of the second reference code as an X axis, The direction from the origin to the second reference code is the X axis positive direction, the position of the first reference code is the origin, the axis corresponding to the measurement direction of the size of the first reference code is the Y axis, and the X axis A direction obtained by rotating the positive direction by 90 degrees counterclockwise may be the Y-axis positive direction.
The coordinate axis specifying unit passes through the position of the first reference code through the position of the first reference code and the size of the second reference code through the position of the second reference code. The intersection point with the measurement direction line is the origin of the X and Y axes, the axis corresponding to the measurement direction of the size of the first reference code through the position of the first reference code is the Y axis, and The direction from the origin toward the first reference code may be the Y-axis positive direction, and the direction obtained by rotating the positive direction of the Y-axis 90 degrees clockwise may be the X-axis positive direction.
The coordinate axis specifying unit uses the position of the first reference code as an origin and an axis passing through the position of the second reference code as a Y axis, a direction from the origin toward the second reference code as a Y axis positive direction, The axis corresponding to the measurement direction of the size of the first reference code with the position of the first reference code as the origin is taken as the X axis, and the direction rotated 90 degrees clockwise from the positive direction of the Y axis is taken as the X axis positive direction. You may make it do.

  According to the present invention, the number of reference codes for specifying coordinate axes that determine the position of an information code representing information is only two, which is smaller than the conventional number.

It is a block diagram which shows the structure of the whole communication system which concerns on one Embodiment of this invention. It is a block diagram which shows the hardware constitutions of information processing apparatus. It is a top view which shows the structure of an information holding medium, (A) is a figure which shows a mode when the information holding medium is seen from the surface, (B) shows a mode when the information holding medium is seen from the back surface. FIG. It is a block diagram which shows the function structure of information processing apparatus. It is a flowchart which shows the procedure of a process of information processing apparatus. It is a top view which shows a mode when an information holding medium is set | placed on the multi-touch panel of information processing apparatus, (A) is a state before the process by information processing apparatus is performed by having set the information holding medium as a trigger FIG. 8B is a diagram illustrating a state after processing by the information processing apparatus is triggered by the placement of the information holding medium. It is a figure explaining the detection of the ground plane by a multi-touch panel. (A)-(C) are figures which show a mode when one or several information holding | maintenance media are set | placed on the multi-touch panel in arbitrary directions. It is a figure which illustrates the variation of a reference code. It is a figure explaining how to take a coordinate axis in case there are two reference codes. It is a figure which illustrates QR code.

[Embodiment]
[Configuration of the embodiment]
FIG. 1 is a diagram showing a configuration of a communication system 1 according to an embodiment of the present invention. The communication system 1 includes an information processing device 10 and an information holding medium 20 that are used by a user, a server device 30, and a communication network 40 that connects the information processing device 10 and the server device 30 so that they can communicate with each other. The communication network 40 includes, for example, a mobile communication network such as LTE (Long Term Evolution) or WiFi (Wireless Fidelity), or a fixed communication network such as ISDN (Integrated Services Digital Network). The information processing apparatus 10 may be a network-type usage form in which processing is performed using information transmitted to and received from the server apparatus 30 via the communication network 40, or may be a stand-alone type usage form that does not use the communication network 40. Also good. That is, the server device 30 and the communication network 40 are not necessarily essential configurations. In FIG. 1, only one information processing apparatus 10 and one information holding medium 20 are shown, but there are actually a plurality of each.

  The information processing apparatus 10 may be an apparatus having a function of accepting an input by an operation in which the user brings the information holding medium 20 into contact with or close to the information holding medium 20. In addition, there is no limitation on the use of a telephone, a game machine, an electronic notebook terminal, a document browsing terminal, an electronic book terminal, or the like. In the present embodiment, the case where the information processing apparatus 10 is a tablet terminal that is a general-purpose computer capable of wireless data communication is illustrated.

  FIG. 2 is a diagram illustrating a hardware configuration of the information processing apparatus 10. As illustrated in FIG. 2, the information processing apparatus 10 includes hardware such as a control unit 11, a communication unit 12, a storage unit 13, an operation unit 14, and a display unit 15. The control unit 11 includes an arithmetic device such as a CPU (Central Processing Unit) and a storage device such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The ROM stores programs and various data used by the CPU. The storage unit 13 is a nonvolatile storage unit such as an EEPROM (Electronically Erasable and Programmable ROM), a flash memory, or a hard disk, and stores programs and various data used by the CPU. The CPU implements various functions (FIG. 4) to be described later by expanding programs and data stored in the ROM and the storage unit 13 in the RAM and performing processing in accordance with procedures described in the programs. The communication unit 12 includes, for example, an antenna and a communication circuit, and performs wireless communication with a wireless device such as a base station or an access point of the communication network 40.

  The operation unit 14 is a touch sensor, and the display unit 15 is a liquid crystal display. By laminating the operation unit 14 and the display unit 15, an image is displayed on the input surface, and a multi-touch panel 16 that can simultaneously detect a plurality of touched positions on the input surface is configured. The multi-touch panel 16 displays an image under the control of the control unit 11 and supplies an operation signal corresponding to a touch operation from the user to the multi-touch panel to the control unit 11. The control unit 11 performs processing according to the operation signal supplied from the multi-touch panel 16. The information holding medium 20 is used by being placed on the input surface of the multi-touch panel 16, and the size of the input surface is large enough to place the information holding medium 20.

  In general, the method of the multi-touch panel is, for example, a capacitance method, an optical sensor method, a resistive film method, an ultrasonic method, an infrared method, an electromagnetic induction method, or a combination of these. In particular, a description will be given by a method called a projection type capacitance method. When the user touches the input surface of the multi-touch panel 16 with a finger or the like, a high-frequency current due to the electrostatic capacitance of the finger or the like flows through the transparent electrode in the touched portion among the plurality of transparent electrodes arranged on the input surface. . The multi-touch panel 16 identifies which area of the input surface is touched by detecting the high-frequency current. The touched area is called a “ground plane”.

  FIG. 3A is a diagram illustrating a state when the information holding medium 20 is viewed from the front surface, and FIG. 3B is a diagram illustrating a state when the information holding medium 20 is viewed from the back surface. When the information holding medium 20 is placed on the multi-touch panel 16, the back surface of the information holding medium 20 contacts the input surface of the multi-touch panel 16. The information holding medium 20 has a rectangular card shape, and a rectangular hole 21 is opened in a part of the information holding medium 20. Therefore, when the information holding medium 20 is placed on the multi-touch panel 16, the image displayed at the position corresponding to the hole 21 among the images displayed on the multi-touch panel 16 is visible to the user through the hole 21. However, an image displayed at a position hidden by the information holding medium 20 other than the hole 21 cannot be seen.

  On the surface of the information holding medium 20, a message describing an event that occurs when the information holding medium 20 is placed on the multi-touch panel 16 of the information processing apparatus 10 is written. In the example of FIG. 3, when the information holding medium 20 is placed on the multi-touch panel 16 so that the character image displayed on the multi-touch panel 16 is visible to the user through the hole 21, The value is going to increase.

A code group C is provided on the back surface of the information holding medium 20. The term code as is that of the information sign-reduction or symbolized, in the example of this embodiment is that one single circular object shown in FIG. The code group C is arranged on the back surface of the information holding medium 20 by printing using a material such as electrostatic ink so that it can be detected by the multi-touch panel 16. Information transmitted from the information holding medium 20 to the information processing apparatus 10 is expressed by these code groups C. Here, the information to be transmitted is the content of the processing executed by the information processing apparatus 10 when the information holding medium 20 is placed on the multi-touch panel 16.

  The code group C includes two reference codes C11 and C12 and one or more (here, seven) information codes C21 to C27. The two reference codes C11 and C12 are codes for specifying coordinate axes. The information codes C21 to C27 are codes arranged at coordinates identified by the coordinate axes specified by the two reference codes C11 and C12. Information to be transmitted is represented by a combination of coordinates of the information codes C21 to C27. The two reference codes in the present invention need only define at least the position and direction of the coordinate axis, and may further define a coordinate area in which the information code is arranged. The coordinate area in which the information code is arranged is a range in which the coordinates of the information code can be taken on the coordinate axis, for example, a range that satisfies the condition of 0 ≦ X ≦ a certain number, 0 ≦ Y ≦ a certain number. In this embodiment, the two reference codes C11 and C12 define the positions and directions of the two coordinate axes that constitute the coordinate plane, and the coordinate area. In the present embodiment, specifying the position and direction of the coordinate axis, the coordinate area, and the unit length (described later) in the coordinate axis is referred to as specifying the coordinate axis.

  FIG. 4 is a diagram illustrating a functional configuration of the information processing apparatus 10 (the control unit 11). When the information holding medium 20 is placed on the input surface of the multi-touch panel 16 and the two reference codes C11 and C12 and the seven information codes C21 to C27 are input to the multi-touch panel 16, the reference code detection unit 101 inputs the information. The position, size and direction of the two reference codes C11 and C12 on the surface are detected.

  The coordinate axis specifying unit 102 specifies the coordinate axes on the input surface of the multi-touch panel 16 based on the positions, sizes, and directions of the two reference codes C11 and C12 detected by the reference code detection unit 101. More specifically, the coordinate axis specifying unit 102 stores a coordinate axis specifying algorithm for determining the position and direction of the coordinate axis and the coordinate area from the position, size and direction of the two reference codes C11 and C12. The position, size and direction of the two detected reference codes C11 and C12 are applied to the coordinate axis specifying algorithm to specify the position and direction of the coordinate axis and the coordinate area.

  The information acquisition unit 103 identifies each coordinate where the information codes C21 to C27 are arranged according to the coordinate axis specified by the coordinate axis specifying unit 102, and acquires information represented by the information codes C21 to C27. More specifically, the information acquisition unit 103 stores a code decoding algorithm for obtaining the content of processing executed by the information processing apparatus 10 from the combination of coordinates of the information codes C21 to C27. The coordinates of C27 are applied to the code decoding algorithm to decode these information codes C21 to C27, and the contents of processing to be executed (that is, information transmitted from the information holding medium 20 to the information processing apparatus 10) are specified. To do. And the process execution part 104 performs the process according to the information acquired by the information acquisition part 103. FIG.

[Operation of the embodiment]
FIG. 5 is a flowchart illustrating a processing procedure of the information processing apparatus 10. For example, as shown in FIG. 6A, when the fighting game screen is displayed on the multi-touch panel 16, the character image CR operated by the user can be seen from the hole 21, and the information holding medium 20 is The case where it puts on the touch panel 16 is assumed. When the information holding medium 20 is placed on the input surface of the multi-touch panel 16, sensing data as a result of sensing by the projected capacitive method is supplied from the multi-touch panel 16 to the control unit 11 (step S11; YES). ). The control unit 11 (reference code detection unit 101) analyzes this sensing data and determines whether or not two reference codes are detected (step S12).

  Here, with reference to FIG. 7, a protocol that is normally used for detecting a region (hereinafter referred to as a ground plane) where a finger or the like is touched on the touch panel will be described. As shown in FIG. 7, the ground plane A is approximated to an ellipse having a maximum width MA (ABS_MT_TOUCH_MAJOR) corresponding to the major axis and a minimum width MI (ABS_MT_TOUCH_MINOR) corresponding to the minor axis. The intersection of the long axis and the short axis is the ground contact surface center O. An angle formed by an axis connecting the measurement line having the maximum ground plane width MA through the ground plane center O and a coordinate axis (y axis) defined from the ground plane center O on the touch panel is referred to as a ground direction α. The grounding direction α takes a maximum positive value when it is 90 degrees clockwise from the y axis, and takes a maximum negative value when it is 90 degrees (−90 degrees) counterclockwise from the y axis. When the ground plane A has a point-symmetric shape, that is, when the ground plane maximum width MA = the ground plane minimum width MI and the ground plane is almost a perfect circle, the ground direction α is invalid.

  In the present embodiment, the ground plane maximum width MA / the ground plane minimum width MI are defined in advance so that the reference codes C11 and C12 and the information codes C21 to C27 can be identified. The ground plane maximum width MA / ground plane minimum width MI of the reference codes C11 and C12 is, for example, 4 or more and less than 7, and the shape thereof is a so-called elongated ellipse. On the other hand, the ground plane maximum width MA / ground plane minimum width MI of the information codes C21 to C27 is, for example, 1 or more and less than 1.5, and the shape is closer to a perfect circle than the reference codes C11 and C12. The two reference codes C11 and C12 are different in size so that they can be distinguished from each other. The smaller of the ground plane maximum width MA and the ground plane minimum width MI is the first reference code C11, and the ground plane maximum width MA and It is defined that the larger ground plane minimum width MI is the second reference code C12.

  In step S12 of FIG. 5, the control unit 11 (reference code detection unit 101) analyzes the sensing data, and determines the ground plane maximum width MA and the ground plane maximum defined for the first reference code C11 and the second reference code C12. When a ground plane satisfying the condition of the small width MI is detected, the position of the ground plane center O of each ground plane, the maximum ground plane width MA, the minimum ground plane width MI, and the grounding direction α are set to the first reference code C11 and The position, size and direction of the second reference code C12 are detected (Step S12; YES). Here, when the first reference code C11 and the second reference code C12 cannot be detected (step S12; NO), for example, the user touches a soft button displayed on the multi-touch panel 16, for example. Thus, the control unit 11 may perform a predetermined process according to the touch operation (step S16).

  When the first reference code C11 and the second reference code C12 are detected (step S12; YES), the control unit 11 (coordinate axis specifying unit 102) detects the positions of the detected first reference code C11 and second reference code C12. Based on the size and direction, the position and direction of the two coordinate axes and the coordinate area are specified (step S13). An example of the coordinate axis specifying algorithm for specifying this will be described with reference to FIG.

  In this coordinate axis identification algorithm, the ground plane center O1 of the ground plane A1 corresponding to the first reference code C11 is the origin, and the axis passing through the ground plane center O2 of the ground plane A2 corresponding to the second reference code C12 is the X axis. The direction from the origin toward the second reference code C12 is taken as the X-axis positive direction. Here, the ground plane center O1 and the ground plane center O2 are used as positions of the first reference code C11 and the second reference code C12, respectively. Further, in the identification of the first reference code C11 and the second reference code C12, the ground plane maximum width MA and the ground plane minimum width MI of the ground plane A1 and the ground plane A2 are the first reference code C11 and the second reference code, respectively. It is used as the size of C12.

  Then, with the ground plane center O1 of the ground plane A1 corresponding to the first reference code C11 as the origin, the axis connecting the ground plane maximum width MA of the ground plane A1 is defined as the Y axis, and the positive direction of the X axis is rotated counterclockwise. This direction is taken as the positive Y-axis direction. Here, the ground contact surface maximum width MA is used as the size of the first reference code C11, and the axial direction connecting the contact surface maximum width MA is used as the direction of the first reference code C11.

  For the coordinate area where the information codes C21 to C27 are arranged, the X coordinate of the ground contact surface center O2 of the ground contact surface A2 corresponding to 0 ≦ X ≦ second reference code C12, and − (corresponding to the second reference code C12). The maximum ground plane width MA of the ground plane A2 / 2/2 ≦ Y ≦ (the maximum ground plane width MA of the ground plane A2 corresponding to the second reference code C12) / 2. That is, it is a coordinate area indicated by hatching in FIG. Here, the X coordinate of the contact surface center O2 is used as the position of the first reference code C11, and the contact surface maximum width MA is used as the size of the second reference code C12.

  As described above, the positions and directions of the two coordinate axes and the coordinate area can be specified based on the positions, sizes, and directions of the first reference code C11 and the second reference code C12. By using not only the position of the first reference code C11 and the second reference code C12 but also the size and direction of the first reference code C11 and the second reference code C12 that can be detected by the multi-touch protocol as described above. By utilizing the fact that the amount of information that can be expressed by these two reference codes is remarkably increased, various conditions of the coordinate axes are expressed. When the various conditions of the coordinate axes are specified, the control unit 11 (information acquisition unit 103) decodes the information codes C21 to C27 according to the code decoding algorithm and acquires information (step S14 in FIG. 5). Specifically, the procedure is as follows.

  First, the control unit 11 (information acquisition unit 103) specifies a coordinate area where the information codes C21 to C27 should be arranged based on the position, direction, and length of the specified coordinate axis, and further, the coordinate area The ground plane satisfying the conditions of the ground plane maximum width MA and the ground plane minimum width MI defined for the information code is specified.

  Next, the control unit 11 (information acquisition unit 103) specifies the center of the ground plane of each ground plane as the coordinates of each information code. In order to specify the coordinates as absolute values, the control unit 11 (coordinate axis specifying unit 102) needs to specify the unit length in the coordinate axes (that is, the length of the coordinate axis corresponding to X = 1, Y = 1). There is. Therefore, for example, a value obtained by dividing the distance between the reference code C11 and the reference code C12 (that is, the distance between the ground plane center O1 and the ground plane center O2) by a predetermined constant is set as a unit length in the X axis and the Y axis. As described above, the unit length may be determined based on the position of the reference code. In addition, the unit length may be determined based on the size of the reference code, such as setting the minimum contact surface width MI of the reference code C11 (contact surface A1) to the unit length in the X axis and the Y axis. Thus, the control unit 11 (coordinate axis specifying unit 102) specifies the unit length in the coordinate axes based on the positions or sizes of the two reference codes, and the control unit 11 (information acquisition unit 103) determines the unit length. Is used to identify each coordinate where the information code is arranged.

In order to specify the coordinate as the relative value, it is not necessary to specify the unit length in the coordinate axis, and only specify the relative positional relationship of the center of the ground plane corresponding to the information codes C21 to C27. Good.

  The control unit 11 (information acquisition unit 103) refers to the code decoding algorithm and specifies the processing content represented by the combination of these coordinates. The processing content here is to increase the value of the power virtually given to the character image CR (FIG. 6) displayed at the position of the hole 21 of the information holding medium 20 on the multi-touch panel 16, and the character image. The effect is to display an effect image that conveys an image of increased power to the CR to the user.

  The control part 11 (process execution part 104) performs the process according to the process content specified by step S14. Specifically, referring to the example of FIG. 6, the control unit 11 (processing execution unit 104) is configured to set the ground plane centers O 1 and O 2 of the ground planes A 1 and A 2 corresponding to the reference codes C 11 and C 12 on the input surface of the multi-touch panel 16. Based on the coordinates, data indicating the shape of the information holding medium 20 and the arrangement position of the reference code on the information holding medium 20, and the image data of the image displayed on the multi-touch panel 16, the information is displayed at the position of the hole 21. A character image CR is identified. Then, the control unit 11 (processing execution unit 104) increases the power value of the character image CR stored in the storage unit 13 by a predetermined amount. Further, as shown in FIG. 6B, the control unit 11 (process execution unit 104) displays an effect image EF that imitates the light that travels from the character image CR to the surroundings, and the power value of the character image CR. Is increased by a predetermined amount and displayed. Thus, the user can cause the information processing apparatus 10 to execute a desired process simply by placing the information holding medium 20 on the multi-touch panel 16.

  According to this embodiment, the position and direction of the coordinate axis for identifying the coordinates of the information code by using the position, size, and direction of two reference codes that are fewer than those of the prior art such as QR codes, and the coordinate area And the unit length in the coordinate axes can be specified. When the position and direction of the coordinate axes are specified, for example, as shown in FIG. 8B, the information holding medium 20 is placed on the multi-touch panel 16 in an arbitrary direction different from that in FIG. However, information can be acquired by decoding the information code. In addition to the position and direction of the coordinate axes, when the coordinate area is specified, even if a plurality of information holding media 20 are placed on the multi-touch panel 16 as shown in FIG. The two coordinate areas corresponding to the information holding medium 20 (that is, the coordinate area determined by the ground planes A11 and A21 and the coordinate area determined by the ground planes A12 and A22) can be distinguished. Therefore, it is possible to acquire information by decoding the information code from each of the plurality of information holding media 20. Furthermore, when the unit length on the coordinate axis is specified, the absolute value of the coordinates of the information code can be detected. When there is an upper limit on the number of codes that can be detected simultaneously, if the number of reference codes decreases, the number of information codes can be increased by that amount, and the amount of information to be transmitted can be increased. .

  If there is one reference code, the coordinate axis cannot be specified. That is, when there is one reference code as shown in FIG. 9, for example, if the ground plane center O of the ground plane A corresponding to the reference code is defined as the origin of the XY coordinate plane, the position through which each coordinate axis passes is specified. It is possible. However, as can be seen by comparing FIG. 9A and FIG. 9B, the direction of each coordinate axis cannot be specified because there is room for interpretation in two ways. Therefore, in order to specify the coordinate axis only by the reference code, it is necessary and sufficient that there are two reference codes as described in the present embodiment.

[Modification]
The embodiment described above can be modified as follows. The following modifications may be implemented in combination with each other.
[Modification 1]
An algorithm for identifying the first reference code, the second reference code, and the information code based on the ground plane in the multi-touch panel 16 and further specifying the coordinate axis based on the first reference code and the second reference code is an example of the embodiment. Not exclusively. For example:
A method of distinguishing the first reference code and the second reference code from the attribute of the ground plane (in particular, the ground plane maximum width or the minimum ground plane width, and the attribute of the size of the ground plane such as the area of the ground plane) The embodiment is not limited to the example, and may be anything.
The method of distinguishing the reference code and the information code from the attributes of the ground plane (the position of the ground plane center, the maximum ground plane width, the minimum ground plane width, the ground plane area or the ground direction) is not limited to the example of the embodiment. It may be something like this.
The attributes (position, size or direction) of the first reference code and the second reference code from the attributes of the ground plane (the position of the ground plane center, the maximum ground plane width, the minimum ground plane width, the area of the ground plane or the ground direction) The specifying method is not limited to the example of the embodiment, and any method may be used.
The method for specifying the attribute (position, direction, coordinate area, or unit length) of the coordinate axis from the attributes (position, size, or direction) of the first reference code and the second reference code is not limited to the example of the embodiment. It may be anything.

  For example, as shown in FIG. 10A, the ground plane center O31 of the ground plane A31 corresponding to the first reference code is the origin, and the origin of the measurement line of the ground plane maximum width of the ground plane A32 corresponding to the second reference code is the origin. The axis passing through the end point D1 close to is defined as the X axis. The direction from the origin toward the ground plane A32 is taken as the positive X-axis direction. The axis connecting the ground contact surface maximum width of the ground contact surface A31 with the contact surface center O31 as the origin is defined as the Y axis. The direction in which the positive direction of the X axis is rotated counterclockwise is defined as the positive direction of the Y axis. For the coordinate area, 0 ≦ X ≦ the X coordinate of the ground plane center O32, and − (the maximum ground plane width of the ground plane A31 / 2) ≦ Y ≦ (the maximum ground plane width of the ground plane A31 / 2). That is, the range of XY coordinate values that can be taken by the information code is a region indicated by hatching in FIG.

  Further, for example, as shown in FIG. 10B, an extension line of the ground plane maximum width of the ground plane A41 corresponding to the first reference cord and an extension of the maximum ground plane width of the ground plane A42 corresponding to the second reference cord. The intersection with the line is the origin of the XY coordinates. The extended line of the measurement line of the ground contact surface maximum width of the ground contact surface A41 is defined as the Y axis, and the direction from the origin toward the ground contact surface A41 is defined as the Y axis positive direction. An axis obtained by rotating the Y axis by 90 degrees clockwise is defined as an X axis. As for the coordinate area, the Y coordinate of the end point D2 far from the origin in the measurement line with the maximum ground plane width of 0 ≦ Y ≦ the ground plane A42 is defined by the extension line toward the origin of the maximum ground plane width of the ground plane A42 and the Y axis. It is assumed that the region is sandwiched (where X ≧ 0). That is, the range of XY coordinate values that can be taken by the information code is a region indicated by hatching in FIG.

  For example, as shown in FIG. 10C, an axis passing through the ground plane center O52 of the ground plane A52 corresponding to the second reference code with the ground plane center O51 of the ground plane A51 corresponding to the first reference code as the origin. Is the X axis. The direction from the origin toward the ground plane A52 is taken as the positive X-axis direction. In the case of FIG. 10C, the ground plane that satisfies the condition that the maximum ground plane width = the minimum ground plane width is the ground plane corresponding to the first reference code. For distinguishing between the first reference code and the information code, the larger one of the maximum ground plane width or the minimum ground plane width is defined as the first standard code. An axis obtained by rotating the X axis counterclockwise is defined as a Y axis. Further, the coordinate area is inside the circular area (where X ≧ 0, Y ≧ 0) with the ground plane center O51 as the center and the X coordinate of the ground plane center O52 of the ground plane A52 as the radius. That is, the range of XY coordinate values that can be taken by the information code is a region indicated by hatching in FIG.

[Summary of the Present Invention Based on Contents of Modification 1]
In the present invention, it is essential to specify the position and direction of the coordinate axis, but it is not always necessary to specify the coordinate area. That is, as described with reference to FIG. 8, when it is not necessary to identify a plurality of information holding media placed on the multi-touch panel 16 at the same time, it is not necessary to specify the coordinate area. In this case, the coordinate area is not limited by the reference code of the information holding medium 20, and the control unit 11 (information acquisition unit 103) acquires information using the information code detected from the entire input surface of the multi-touch panel 16. do it.

  In the present invention, when specifying the position and direction of the coordinate axes that are essential, the position and size of the reference code are necessary, but the direction of the reference code is not necessarily essential. That is, in order to specify the positions of the two coordinate axes, the positions of the two reference codes are necessarily required. In order to specify the direction of the coordinate axis, it is necessary to distinguish which of these two reference codes is the first reference code and which is the second reference code. The size of the reference code is required.

  From the above, in the present invention, the reference code detection unit inputs two reference codes for specifying the coordinate axes and one or more information codes arranged at the coordinates identified by the coordinate axes to the input surface. Then, the positions and sizes of the two reference codes on the input surface are detected. Then, the coordinate axis specifying unit specifies the coordinate axis on the input surface based on the result (position and size of the two reference codes) detected by the reference code detection unit.

  Further, as described in the embodiment, the coordinate axis specifying unit specifies the position and direction of the coordinate axis based on the direction and / or size of the two reference codes, and at least one of the two reference codes. May be.

  The coordinate axis specifying unit specifies a coordinate area in which the information code is arranged based on at least one of the position, size, or direction of the two reference codes, and the information acquiring unit is specified by the coordinate axis specifying unit. In each region, each coordinate where the information code is arranged may be identified. For example, in FIG. 10C, the distance between two reference codes is calculated and the coordinate area is specified based on this distance. However, in order to obtain the distance between the two reference codes, Since the position of the code is used, this example is the same as specifying the coordinate area using the position of the reference code.

  Furthermore, as described in the embodiment, the coordinate axis specifying unit may specify the unit length in the coordinate axes based on the position or size of the two reference codes, or may not specify the unit length. .

[Modification 2]
The coordinate axis specifying unit 102 specifies coordinate axes by applying different coordinate axis specifying algorithms to a plurality of code groups each constituted by two reference codes and one or more information codes, and the information acquiring unit 103 Information represented by the information code may be acquired by applying different code decoding algorithms to the code group. Specifically, it is the following example.

  A plurality of coordinate axis specifying algorithms and code decoding algorithms are prepared in advance, and both are associated with each other on a one-to-one basis. For example, the coordinate axis specifying algorithm a and the code decoding algorithm a are associated with the application program a, and the coordinate axis specifying algorithm b and the code decoding algorithm b are associated with the application program b. When the information holding medium 20 is placed when an image is displayed on the multi-touch panel 16 by executing the application program a, the control unit 11 uses the coordinate axis specifying algorithm a and the code decoding algorithm a to store information. get.

When the ground plane is detected on the multi-touch panel 16, the control unit 11 tries to detect the reference code using a plurality of coordinate axis specifying algorithms, and the code decoding algorithm a corresponding to the coordinate axis specifying algorithm used when the control code is detected. You may make it acquire information using.
In this way, various types of information can be transmitted from the information holding medium 20 to the information processing apparatus 10 according to the shapes and positions of the reference code and information code.
In the embodiment, the information to be transmitted is represented by the coordinates of the information code. However, as in the reference code in the embodiment, the size and direction of the information code is also used for the information to be transmitted. May be represented.

[Modification 3]
In the embodiment, the input surface is the multi-touch panel 16, the reference code and the information code are formed of electrostatic ink detected by the multi-touch panel 16, and the process execution unit 104 is acquired by the information acquisition unit 103. A process corresponding to the information is executed, and an image corresponding to the result of the process is displayed on the multi-touch panel 16.
The material of the cord is not limited to the electrostatic ink exemplified in the embodiment, but may be any conductive material, for example, a conductive plastic such as metal or polyacetylene, or a plastic mixed with metal fibers.
The method of the multi-touch panel 16 is not limited to the projected capacitance method, and is a method using an electrical phenomenon such as voltage or current, or a method using physical vibration, sound, light, etc. other than electricity. Also good. In addition, the present invention can be applied to a case in which a code is read by an optical method such as image recognition instead of the multi-touch panel.

[Modification 4]
The process execution part 104 should just perform the process according to the information acquired by the information acquisition part 103, and the content of the process is not limited to the example of embodiment. Further, the structure and display image of the information holding medium 20 illustrated in FIGS. 3 and 6 are merely examples, and are not limited to the illustrated contents.
For example, regarding the processing executed by the processing execution unit 104, there is no hole 21 in the information holding medium 20, and when the information holding medium 20 is placed on the multi-touch panel 16, the image around the information holding medium 20 changes. It may be a process. In the information holding medium 20, a translucent plate-like member on which a predetermined picture is drawn is fitted instead of the hole 21, and when the information holding medium 20 is placed on the multi-touch panel 16, the information holding medium The display image under the 20 plate-like member is changed, and the display image and the picture drawn on the plate-like member influence each other so that the human eye can see a different image. May be.
Further, the process executed by the process execution unit 104 may be a process depending on an image displayed on the multi-touch panel 16 or a position where the information holding medium 20 is placed on the multi-touch panel 16 (the embodiment and the embodiment). The above modification example) may be a process that does not depend on the image displayed on the multi-touch panel 16 or the position where the information holding medium 20 is placed.

[Modification 5]
The device configuration, system configuration, and data configuration described in the embodiments are merely examples, and the implementation of the present invention is not limited to the illustrated contents. The information processing apparatus 10 may be configured to be distributed among a plurality of apparatuses. For example, the information acquisition unit 103 transmits a combination of coordinates of the information code to the server device 30, the server device 30 transmits information corresponding to the combination of the coordinates to the information processing device 10, and the information acquisition unit 103 You may make it acquire.

[Modification 6]
The present invention can be implemented not only in the information processing apparatus but also in the form of an information processing method equivalent to the method executed by the control unit of the information processing apparatus or a program for causing a computer to function as the information processing apparatus. is there. This program may be provided to the computer in a form recorded on a recording medium such as an optical disk, or may be provided to the computer via a network such as the Internet.

DESCRIPTION OF SYMBOLS 1 ... Communication system, 10 ... Information processing apparatus, 11 ... Control part, 12 ... Communication part, 13 ... Memory | storage part, 14 ... Operation part, 15 ... Display part, DESCRIPTION OF SYMBOLS 16 ... Multi touch panel, 101 ... Reference code detection part, 102 ... Coordinate axis specific part, 103 ... Information acquisition part, 104 ... Process execution part, C11, C12 ... Reference code, C21 -C27 ... Information code, 20 ... Information holding medium

Claims (12)

Two reference codes for specifying the coordinate axes and one or more information codes arranged at the coordinates identified by the coordinate axes are held, and a medium provided with holes is provided on the input surface on which the image is displayed. A reference code detector that reads the two reference codes and the one or more information codes from the medium and detects the position and size of the two reference codes on the input surface when contacted or brought close to each other;
Based on the result detected by the reference code detection unit, a coordinate axis specifying unit for specifying the coordinate axis on the input surface;
Identifying each coordinate where the information code is arranged according to the coordinate axis specified by the coordinate axis specifying unit, and information represented by the information code, the information being in contact with or close to the input surface An information processing apparatus comprising: an information acquisition unit that acquires information for performing image display on an image displayed on the input surface at the provided hole position . A medium holding two reference codes for specifying the coordinate axes and one or more information codes arranged at the coordinates identified by the coordinate axes is brought into contact with the input surface of the multi-touch panel, and the medium is moved from the medium. When two reference codes and the one or more information codes are input, a reference code detection unit that detects the position and size of the two reference codes on the input surface;
Based on the result detected by the reference code detection unit, a coordinate axis specifying unit for specifying the coordinate axis on the input surface;
An information acquisition unit that identifies each coordinate where the information code is arranged according to the coordinate axis specified by the coordinate axis specification unit, and acquires information represented by the information code;
With
The coordinate axis specifying unit includes a position of the first reference code or a position of the second reference code among the first reference code and the second reference code which are the two reference codes, and a size of the first reference code. The X axis and the Y axis which are coordinate axes on the input surface are specified using the measurement direction determined as the direction for measuring the height or the measurement direction determined as the direction for measuring the size of the second reference code.
An information processing apparatus characterized by that. The coordinate axis specifying unit is
The axis passing through the position of the second reference code with the position of the first reference code as the origin is the X axis, and the direction from the origin toward the second reference code is the X axis positive direction,
Using the position of the first reference code as the origin, the axis corresponding to the measurement direction of the size of the first reference code is the Y axis, and the positive direction of the X axis is rotated 90 degrees counterclockwise. The information processing apparatus according to claim 2, wherein the information processing apparatus is a direction . The coordinate axis specifying unit is
With the position of the first reference code as the origin, the axis passing through the end of the second reference code close to the origin in the measurement direction of the size of the second reference code is defined as the X axis, and the second reference from the origin The direction toward the cord is the X axis positive direction,
Using the position of the first reference code as the origin, the axis corresponding to the measurement direction of the size of the first reference code is the Y axis, and the positive direction of the X axis is rotated 90 degrees counterclockwise. The information processing apparatus according to claim 2, wherein the information processing apparatus is a direction . The coordinate axis specifying unit is
A line that passes through the position of the first reference code and becomes the measurement direction of the size of the first reference code, and a line that passes through the position of the second reference code and that measures the size of the second reference code The intersection of with the origin of the X and Y axes,
An axis corresponding to the measurement direction of the size of the first reference code through the position of the first reference code is defined as a Y axis, and a direction from the origin toward the first reference code is defined as a Y axis positive direction,
3. The information processing apparatus according to claim 2, wherein a direction obtained by rotating the positive direction of the Y axis by 90 degrees clockwise is defined as the positive direction of the X axis . The coordinate axis specifying unit is
The axis passing through the position of the second reference code with the position of the first reference code as the origin is defined as the Y axis, and the direction from the origin toward the second reference code is defined as the Y axis positive direction,
Using the position of the first reference code as the origin, the axis corresponding to the measurement direction of the size of the first reference code is the X axis, and the direction obtained by rotating the positive direction of the Y axis 90 degrees clockwise is the X axis positive direction. to an information processing apparatus according to claim 2, wherein. Computer
Two reference codes for specifying the coordinate axes and one or more information codes arranged at the coordinates identified by the coordinate axes are held, and a medium provided with holes is provided on the input surface on which the image is displayed. A reference code detector that reads the two reference codes and the one or more information codes from the medium and detects the position and size of the two reference codes on the input surface when contacted or brought close to each other;
Based on the result detected by the reference code detection unit, a coordinate axis specifying unit for specifying the coordinate axis on the input surface;
Identifying each coordinate where the information code is arranged according to the coordinate axis specified by the coordinate axis specifying unit, and information represented by the information code, the information being in contact with or close to the input surface An information acquisition unit for acquiring information for performing image display on the image displayed on the input surface at the position of the hole provided;
Program to make it function. Computer
A medium holding two reference codes for specifying the coordinate axes and one or more information codes arranged at the coordinates identified by the coordinate axes is brought into contact with the input surface of the multi-touch panel, and the medium is moved from the medium. When two reference codes and the one or more information codes are input, a reference code detection unit that detects the position and size of the two reference codes on the input surface;
Based on the result detected by the reference code detection unit, a coordinate axis specifying unit for specifying the coordinate axis on the input surface;
An information acquisition unit that identifies each coordinate where the information code is arranged according to the coordinate axis specified by the coordinate axis specification unit, and acquires information represented by the information code;
To function,
The coordinate axis specifying unit includes a position of the first reference code or a position of the second reference code among the first reference code and the second reference code which are the two reference codes, and a size of the first reference code. The X axis and the Y axis which are coordinate axes on the input surface are specified using the measurement direction determined as the direction for measuring the height or the measurement direction determined as the direction for measuring the size of the second reference code.
program. The coordinate axis specifying unit is
The axis passing through the position of the second reference code with the position of the first reference code as the origin is the X axis, and the direction from the origin toward the second reference code is the X axis positive direction,
Using the position of the first reference code as the origin, the axis corresponding to the measurement direction of the size of the first reference code is the Y axis, and the positive direction of the X axis is rotated 90 degrees counterclockwise. Direction
The program according to claim 8. The coordinate axis specifying unit is
With the position of the first reference code as the origin, the axis passing through the end of the second reference code close to the origin in the measurement direction of the size of the second reference code is defined as the X axis, and the second reference from the origin The direction toward the cord is the X axis positive direction,
Using the position of the first reference code as the origin, the axis corresponding to the measurement direction of the size of the first reference code is the Y axis, and the positive direction of the X axis is rotated 90 degrees counterclockwise. Direction
The program according to claim 8. The coordinate axis specifying unit is
A line that passes through the position of the first reference code and becomes the measurement direction of the size of the first reference code, and a line that passes through the position of the second reference code and that measures the size of the second reference code The intersection of with the origin of the X and Y axes,
An axis corresponding to the measurement direction of the size of the first reference code through the position of the first reference code is defined as a Y axis, and a direction from the origin toward the first reference code is defined as a Y axis positive direction,
A direction obtained by rotating the positive direction of the Y axis 90 degrees clockwise is defined as the positive direction of the X axis.
The program according to claim 8. The coordinate axis specifying unit is
The axis passing through the position of the second reference code with the position of the first reference code as the origin is defined as the Y axis, and the direction from the origin toward the second reference code is defined as the Y axis positive direction,
Using the position of the first reference code as the origin, the axis corresponding to the measurement direction of the size of the first reference code is the X axis, and the direction obtained by rotating the positive direction of the Y axis 90 degrees clockwise is the X axis positive direction. Be
The program according to claim 8.

Images