JP6257258B2 - Image projection system - Google Patents

Description

  The present invention relates to a technique for projecting an image from a projection device such as a projector onto a real object such as a card.

  An image processing technique has been proposed in which a two-dimensional code is picked up by a video camera and recognized, and a three-dimensional image corresponding to the two-dimensional code is displayed on a display device (for example, see Patent Document 1). Patent Document 1 discloses a rectangular card having a two-dimensional code including a reference cell, a code data portion, and a plurality of corner cells arranged so as to surround the code data portion.

WO2006 / 041149A1

  In recent years, trading card game machines have been widely used in game centers, toy stores, supermarkets, and the like. In a trading card game, a user collects cards and advances the game by playing cards with each other. Each card has various designs and characters such as original monsters and animated characters. For example, a characteristic value representing the ability and attribute of the character is set in the card, and the progress and win / loss of the game are determined according to the card issued by the user.

  The present inventor has paid attention to such a card game, and has found a possibility of enhancing the interest of the card game by giving an excellent visual effect to the cards arranged on the table or the like.

  An object of this invention is to provide the technique which provides the outstanding visual effect with respect to a card | curd.

  In order to solve the above problems, an image projection system according to an aspect of the present invention includes a card, a card with a marker for identifying the card, a projection device that projects an image on the card, A sensor for detecting a marker attached to the card, and a processing device that acquires a position where the card is arranged using a detection result of the sensor and controls image projection of the projection device. The processing device causes the projection device to project an image associated with the card onto the card based on the position where the card is arranged.

  Another aspect of the present invention is a card arranged in an imaging space of an imaging device having an infrared sensor. In this card, a picture or a character that can be visually recognized by the user is attached to the first surface, and a marker for identifying the card is attached to the first surface or the second surface. Imaged.

  It should be noted that any combination of the above-described constituent elements and a conversion of the expression of the present invention between a method, an apparatus, a system, a recording medium, a computer program, etc. are also effective as an aspect of the present invention.

  ADVANTAGE OF THE INVENTION According to this invention, the technique which provides the outstanding visual effect with respect to a card | curd can be provided.

It is a figure which shows the structure of the image projection system concerning the Example of this invention. It is a figure which shows the functional block of a processing apparatus. It is a figure which shows an example of a card | curd. It is a figure which shows an example of the marker attached | subjected to the card | curd back surface. It is a figure which shows an example of the combination of a card | curd, the sensor for card detection, and a projection apparatus. It is a figure which shows an example of the detection result of an infrared sensor. It is a figure which shows an example of the effect image projected on a card | curd. It is a figure which shows another example of a marker. It is a figure which shows another example of the combination of a card | curd, the sensor for card detection, and a projection apparatus. It is a figure which shows another example of the combination of a card | curd, the sensor for card detection, and a projection apparatus. It is a figure which shows another example of a card | curd. It is a figure which shows another example of the combination of a card | curd, the sensor for card detection, and a projection apparatus. It is a figure which shows another example of the combination of a card | curd, the sensor for card detection, and a projection apparatus. It is a figure which shows another example of the combination of a card | curd, the sensor for card detection, and a projection apparatus. It is a figure which shows another example of a card | curd. It is a figure which shows another example of the combination of a card | curd, the sensor for card detection, and a projection apparatus. It is a figure which shows the example of a card sleeve.

  The present invention provides a technique for projecting an image from a projection device such as a projector onto a real object placed on a table or the like. In this embodiment, the real object is a flat card having front and back surfaces, and a technique for projecting an image onto the flat card will be described. However, the real object may be an object having a three-dimensional shape. The card is provided with a marker for identifying the card. When the card detection sensor detects the marker, the processing device controls the irradiation light pattern of the projection device, and the projection device applies the card to the card. Then, an image associated with the card is projected. The marker is configured as a one-dimensional or two-dimensional pattern such as a code or a design. The image to be projected may be a still image, but a better visual effect can be realized by using a moving image for game production.

  FIG. 1 shows a configuration of an image projection system 1 according to an embodiment of the present invention. A card placement area 2 is formed in the image projection system 1, and a user places the card 10 in the card placement area 2. The card arrangement area 2 is an area surrounded by a frame line printed on the table, for example, and may be formed so that the user can visually recognize an area where the card 10 can be arranged. The user can place a plurality of cards 10 in the card placement area 2, and each of the plurality of users may place the cards 10 in the card placement area 2 in the case of a battle game.

  The card detection sensor 200 is a sensor for detecting the card 10 arranged in the card arrangement area 2. More specifically, the card detection sensor 200 detects a marker attached to the card 10 arranged in the card arrangement area 2. It is a sensor for. The card detection sensor 200 is preferably configured to detect the card 10 regardless of the position of the card 10 in the card placement area 2. As will be described later, the card detection sensor 200 may be, for example, a non-visible light sensor incorporated in an imaging device or a display device, or a touch sensor incorporated in a multi-touch compatible capacitive touch panel. Alternatively, an NFC (Near Field Communication) reader having a short-range wireless communication function may be used.

  An appropriate card detection sensor 200 is selected and used in accordance with the card 10 and / or marker to be detected. Although FIG. 1 shows a state where the card detection sensor 200 is provided above the card placement area 2, the card detection sensor 200 may be provided below the card placement area 2, It may be provided in the card arrangement area 2.

  Although it has been described that the card arrangement area 2 is an area surrounded by a frame line, the card arrangement area 2 defines an area in which the user can place the card 10. An area where the card 10 can be detected by the sensor 200 may be referred to as a card placement area 2.

  The projection device 300 is a device that projects an image onto the card 10. The projection device 300 is preferably configured to project an image on the entire card arrangement area 2. As will be described later, the projection device 300 may be a projector that projects image light onto the card arrangement area 2, or may be a display device that demarcates the card arrangement area 2 and displays an image. Although FIG. 1 shows a state in which the projection device 300 is provided above the card placement area 2, the projection device 300 may be provided below the card placement area 2, or the card placement area 2. It may form itself.

  The processing device 100 acquires the position coordinates where the card 10 is arranged using the detection result of the card detection sensor 200, and controls the image projection of the projection device 300 according to the acquired position coordinates. The processing device 100 is a computer, and has a function of receiving a marker detection result from the card detection sensor 200 and reflecting the detection result to the projection control of the projection device 300. In FIG. 1, the card detection sensor 200 detects a marker attached to the card 10 in the card arrangement area 2, and the processing device 100 performs an effect image 3 from the projection device 300 on the card 10 whose position coordinates are specified. Is shown.

  The card 10 is formed in a flat plate shape having a front surface and a back surface. The card 10 has a marker for identifying the card on the front surface, the back surface, or both surfaces. When markers are attached to both sides, both markers may be the same or different. If they are different, each marker includes information for identifying the card and information for identifying whether the marker is the front surface or the back surface.

  When the processing device 100 specifies the card 10 based on the detection result of the card detection sensor 200, the processing device 100 controls the projection device 300 to project the effect image 3 associated with the card 10 onto the card 10. To do. When markers are attached to both sides of the card 10, the processing device 100 projects each time when the front surface marker is detected and when the back surface marker is detected by making each marker different. It is possible to vary the effect image 3 to be performed.

  FIG. 2 shows functional blocks of the processing apparatus 100. The processing device 100 includes a detection unit 110, a processing unit 120, a marker storage unit 140, an effect storage unit 142, and an effect control unit 150. The detection unit 110 has a function of detecting a marker attached to the card 10. The processing unit 120 includes a card specifying unit 122, a card position acquisition unit 124, an edge position acquisition unit 126, and an inversion detection unit 128. Information on the card 10 having the marker based on the detected marker. And the status of the card 10 is acquired. The effect control unit 150 controls the effect on the card 10 based on the information provided from the processing unit 120, and specifically irradiates the effect image on the card 10 from the projection device 300.

  The processing function of the processing apparatus 100 in the present embodiment is realized by a CPU, a memory, a program loaded in the memory, and the like, and here, a configuration realized by their cooperation is illustrated. Accordingly, those skilled in the art will understand that these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof.

  The marker storage unit 140 stores a marker and identification information (hereinafter referred to as a card ID) of the card 10 having the marker in association with each other. The effect storage unit 142 stores the effect contents in association with the card ID. Here, the effect content may be a still image projected onto the card 10 or a moving image projected onto the card 10. When the function of the production control unit 150 is realized by a game program, the production storage unit 142 may store a program that expresses production contents according to the progress of the game. You may comprise as a recording medium (for example, ROM medium) which recorded the game program.

Hereinafter, a specific example of a combination of the card 10, the card detection sensor 200, and the projection device 300 will be described.
FIG. 3 shows an example of a card, FIG. 3 (a) shows the front surface of the card 10a, and FIG. 3 (b) shows the back surface of the card 10a. On the surface of the card 10a, a character's design and characters for explaining the character are attached so as to be visible to the user. The user can recognize the type of the card 10a by looking at the patterns and characters printed on the surface. In FIG. 3A, an illustration of the character “Tyrannosaurus” and an explanation of the character are printed on the surface of the card 10a.

  On the back surface of the card 10a, a pattern and characters that can be visually confirmed by the user are not printed. As will be described later, an image by the projector is projected on the back surface of the card 10a. Therefore, the back surface of the card 10a is given one color with high brightness so that the irradiation light from the projector can be reflected by the user so as to be visible. By unifying the back surface into one color, it becomes possible to uniformly reflect the light emitted from the projector. The added color is preferably a color that does not get in the way when the user views the image projected on the back side of the card 10a, that is, a color that allows the user to easily recognize the projected image. Ideally, the back surface of the card 10a is preferably white that effectively reflects the projected image from the projector.

  Note that the back surface of the card 10a is not printed with a pattern or characters visible to the user, but is provided with a marker that can be detected by a non-visible light sensor (for example, an infrared sensor). The marker is preferably printed with a non-visible light reflecting material or a non-visible light absorbing material such as a paint that can be accurately detected by the non-visible light sensor, but depending on the reflecting material or the absorbing material, The user may be able to visually recognize the marker. Even in this case, the marker is not attached to the back surface so that the user can visually recognize it positively, but it is attached only to be detected by the invisible light sensor. Keep it.

  The marker is for identifying the card 10a, and may be a two-dimensional code or a one-dimensional code. A typical example of the marker of the one-dimensional code is a bar code, and a typical example of the marker of the two-dimensional code is a QR code (registered trademark), but any marker can be used as long as it can uniquely identify the card 10a. If the example shown to Fig.3 (a) is used, the illustration of Tyrannosaurus may be sufficient.

  FIG. 4 shows an example of a marker attached to the back surface of the card 10a. The marker 20a is configured as, for example, a two-dimensional code disclosed in Patent Document 1, and includes a plurality of rectangular cells 23 that constitute code data by arranging reference cells 21 having a predetermined shape and two-dimensional arrangement, and a plurality of rectangular cells. A plurality of corner cells 22 arranged so as to surround the cell 23 are provided. In the marker 20a, the positional relationship between the reference cell 21 and the corner cell 22 is fixed, and the card type is identified by the arrangement of the plurality of rectangular cells 23. On the back surface of the card 10a, the marker 20a composed of the reference cell 21, the corner cell 22 and the rectangular cell 23 has a higher infrared reflectance than that of the portion where the marker 20a is not printed. It is printed with a reflective material or an infrared absorbing material having a high infrared absorption rate. Therefore, the infrared sensor that receives infrared rays can detect the marker 20a by the reflected light from the card 10a. For example, when the marker 20a is formed of an infrared absorbing material, infrared rays are absorbed by the marker 20a, and thus the infrared sensor detects the marker 20a as a black region. As described above, the back surface of the card 10a is uniformly coated with one color of visible light material. Therefore, the user recognizes the back surface of the card 10a as a surface coated with one color.

  FIG. 5 shows an example of a combination of the card 10, the card detection sensor 200, and the projection device 300. In FIG. 5, the illustration of the processing apparatus 100 is omitted. Here, the card 10 a is arranged on the table 4, and the card arrangement area 2 is the entire upper surface of the table 4. The card detection sensor 200 is arranged above the card arrangement area 2 and detects the card 10 a arranged in the card arrangement area 2. Projection device 300 is arranged above card arrangement area 2 and projects an effect image on card 10a. In the card placement area 2, the card 10a is placed on the table 4 with the surface on which the illustration of the visible character is printed facing the upper surface of the table 4, and therefore the card 10a is provided with the invisible marker 20a. It is arranged so that the back surface is the upper surface. Here, the card detection sensor 200 is an infrared sensor built in the infrared camera 200a, and the projection device 300 is a projector 300a that projects image light.

Returning to FIG. 2, the image projection processing using the card 10a will be described.
The infrared camera 200a and the projector 300a are arranged above the card arrangement area 2. In the infrared camera 200a, the light source irradiates the card placement area 2 with infrared light, and the infrared sensor detects reflected light from the card 10a including the marker 20a. In the processing apparatus 100, the detection unit 110 acquires the detection result of the infrared sensor, and detects the marker 20a. Since the marker 20a is printed with an infrared reflecting material or an infrared absorbing material, the infrared sensor can suitably detect the marker 20a.

  FIG. 6 shows an example of the detection result of the infrared sensor. In this way, the infrared camera 200a acquires an infrared reflection image and passes it to the detection unit 110. The infrared camera 200a may periodically capture an infrared reflected image, and provide one infrared reflected image to the detection unit 110, for example, at 1/60 second. Hereinafter, an algorithm in which the detection unit 110 detects the marker 20a illustrated in FIG. 6 will be described.

  First, the detection unit 110 detects the reference cell 21 extending in a straight line in the captured image, and confirms the presence of the triangular corner cell 22 in the vertical direction at both ends of the detected reference cell 21. Here, when the presence of two corner cells 22 is confirmed in the vertical direction at each end, the detection unit 110 extracts an array of a plurality of rectangular cells 23 from the area surrounded by the four corner cells 22. . The marker 20a of the card 10a is detected by the above algorithm. The detection unit 110 notifies the processing unit 120 of the detection result of the marker 20a. Here, the detection result includes at least the array of the rectangular cells 23 extracted in the marker 20a and the position coordinates of the marker 20a in the card placement area 2. In FIG. 2, the detection unit 110 is shown as a functional block different from the processing unit 120, but the function of the detection unit 110 may be incorporated in the processing unit 120. The function of the detection unit 110 may be incorporated in the card detection sensor 200 instead of the processing unit 120.

  The marker storage unit 140 stores all the markers 20a prepared in the card game and the identification information (card ID) of the card 10a in association with each other. When the marker 20a is the two-dimensional code shown in FIG. 4, the marker storage unit 140 may store an array of a plurality of rectangular cells 23 of the marker 20a and a card ID in association with each other.

  The processing unit 120 performs various processes using the detection result in the detection unit 110. First, the card specifying unit 122 compares the array of the rectangular cells 23 detected by the detecting unit 110 with the array of the square cells 23 stored in the marker storage unit 140, and specifies the card IDs of the matching arrays. When the marker storage unit 140 holds the marker 20a as image information, the card specifying unit 122 performs pattern matching processing on the detected image of the marker 20a with the image information held in the marker storage unit 140. The image information that matches the detected marker 20a image is specified, and the associated card ID is specified. In the pattern matching process, the detected array image of the square cells 23 may be compared with the array image of the square cells 23 held in the marker storage unit 140. When the marker storage unit 140 holds the bit pattern of the square cell 23, the card specifying unit 122 uses the detected bit pattern of the square cell 23 as the bit pattern of the square cell 23 held in the marker storage unit 140. Compared with the above, a bit pattern that matches the bit pattern of the detected arrangement of the rectangular cells 23 is specified, and the associated card ID is specified. The card identification unit 122 passes the identified card ID to the card position acquisition unit 124 and the edge position acquisition unit 126.

  The card position acquisition unit 124 acquires the position coordinates of the card 10 a in the card placement area 2 from the position coordinates of the marker 20 a detected by the detection unit 110. When the card 10a has a rectangular shape, the position coordinates to be acquired may be the four vertex coordinates of the card 10a in the card placement area 2. The card position acquisition unit 124 also acquires angle information indicating the posture of the card 10a in the card arrangement area 2, that is, the inclination of the card arrangement area 2 in the two-dimensional coordinate system. This angle information is expressed as an inclination from the lower side to the upper side of the card 10a. Accordingly, the angle information is set to positive or negative depending on the top and bottom of the card 10a.

  In the image projection system 1 using the card 10a, the real world coordinate system in the card placement area 2, the camera coordinate system in the infrared camera 200a, and the projector coordinate system in the projector 300a exist independently. The processing unit 120 has a coordinate adjustment function that automatically adjusts these coordinate systems, whereby the position coordinate of the marker 20a detected by the infrared camera 200a is converted into the position coordinate in the card placement area 2 in the processing unit 120. The position coordinates in the card arrangement area 2 are converted into position coordinates in the projector coordinate system of the projector 300a by the processing unit 120 and provided to the projector 300a. In the following description, it is assumed that the processing unit 120 has this coordinate adjustment function, and for convenience of explanation, various position coordinates are described as being the same as the position coordinates of the two-dimensional coordinate system in the card placement area 2. To do.

  The card position acquisition unit 124 holds the positional relationship between the reference cell 21 and the corner cell 22 of the card 10a in advance. Therefore, when the detection unit 110 detects the marker 20a, the card position acquisition unit 124 acquires four vertex coordinates and angle information in the two-dimensional coordinate system of the card 10a from the position coordinates of the reference cell 21 and the corner cell 22 of the marker 20a. it can.

  The above shows the case where the marker 20a is the two-dimensional code shown in FIG. 4. However, for example, the marker 20a may be a pattern printed on the entire back surface of the card 10a. (Or drawn with an infrared reflective or infrared absorbing material). In this case, when the detection unit 110 detects the marker 20a, the card position acquisition unit 124 can acquire four vertex coordinates and angle information in the two-dimensional coordinate system of the card 10a by specifying the contour of the pattern.

  The card position acquisition unit 124 passes the four vertex coordinates and angle information of the card 10a to the effect control unit 150 together with the card ID. As the position coordinates of the card 10a, the card position acquisition unit 124 may derive the center of gravity coordinates of the card 10a and pass the center of gravity coordinates and angle information to the effect control unit 150 together with the card ID.

  The edge position acquisition unit 126 acquires edge position coordinates of the card 10a. When the card 10 a has a rectangular shape, the edge position acquisition unit 126 can acquire the position coordinates of the outer edge of the card 10 a from the four vertex coordinates acquired by the card position acquisition unit 124. In this case, the position coordinate of the outer edge of the card 10a is acquired by specifying a line connecting two adjacent vertex coordinates.

  Note that the card 10a does not have to be rectangular, and may be circular, for example. In this case, the card position acquisition unit 124 holds the radius of the circular card 10a in advance. At this time, the marker 20a includes at least a predetermined mark at the center of the back surface of the circular card 10a, and a two-dimensional code or the like is arranged around the mark. Therefore, the card position acquisition unit 124 acquires the position coordinates of the predetermined mark as the center position coordinates of the card 10a, and passes the center position coordinates and radius of the card 10a to the edge position acquisition unit 126, so that the edge position acquisition unit 126 The position coordinates of the outer edge of the card 10a can be acquired. The radius of the card 10a may be held by the edge position acquisition unit 126.

  As described above, the edge position acquisition unit 126 has a function of specifying the outer edge of the card 10 a placed in the card placement area 2. As will be described later, since the outer edge of the card 10a serves as a reference when the projector 300a projects image light, the edge position acquisition unit 126 passes the outer edge position coordinates of the card 10a to the effect control unit 150 together with the card ID. The function of the edge position acquisition unit 126 may be incorporated in the card position acquisition unit 124. In this case, the card position acquisition unit 124 sends the outer edge position coordinates of the card 10a to the effect control unit 150 together with the card ID. Will pass. The function of the card position acquisition unit 124 may be incorporated in the effect control unit 150.

  The card 10a arranged in the card arrangement area 2 may be moved by the user during the game progress. Therefore, the processing unit 120 has a function of tracking the card 10a once detected, and the card position acquisition unit 124 acquires the position coordinates and angle information of the card 10a for each captured image, and acquires the edge position. The unit 126 acquires the edge position coordinates of the card 10a for each captured image.

  The effect control unit 150 is, for example, a game engine, and executes effect control for the card 10a according to the card ID provided from the processing unit 120. The effect storage unit 142 stores a card ID and an effect pattern in association with each other, and the effect pattern may be a still image or a moving image. As described above, the effect pattern may be configured by a game program or the like, and in any case, the effect storage unit 142 is configured to store the effect pattern associated with the card ID.

  The effect control unit 150 controls the image projection of the projector 300 a according to the effect pattern stored in the effect storage unit 142. Specifically, the effect control unit 150 reads the effect image associated with the card ID provided from the processing unit 120 from the effect storage unit 142 or the effect image according to the effect pattern read from the effect storage unit 142. And the effect image is projected on the projector 10a to the card 10a based on the position information where the card 10a is arranged. More specifically, the effect control unit 150 causes the projector 300a to project an effect image associated with the card 10a based on the edge position coordinates of the card 10a. Thereby, the user can visually observe the effect image projected on the card 10a, and can enjoy the effect of the game.

  FIG. 7 shows an example of the effect image projected on the card 10a. The card 10a is arranged in the card arrangement area 2 with the back side as the upper surface, and the projector 300a projects the effect image 3 on the card 10a. As described above, the image projection of the projector 300a is controlled by the effect control unit 150, and the effect control unit 150 generates an effect image to project and irradiates the card 10a from the projector 300a. Since the back surface of the card 10a is colored with high brightness, the irradiation light from the projector 300a is favorably reflected on the back surface of the card 10a, and the user can visually observe the clear effect image 3.

  The effect control unit 150 projects the effect image 3 on the entire back surface of the card 10a based on the edge position coordinates of the card 10a provided from the edge position acquisition unit 126. At this time, as shown in FIG. 7, the effect control unit 150 preferably projects the effect image 3 on the card 10a so as to be larger than the card 10a. That is, the projector 300a projects the effect image 3 to a position beyond the outer edge of the card 10a. Although the projector 300a irradiates the entire card arrangement area 2 with the game image including the effect image, the effect image 3 is not projected onto a part of the card 10a because the card 10a has a slight thickness. If there is a place, the edge of the card 10a at that place may be visually recognized by the user. If the effect image 3 is the same size as the card 10a and can be projected in line with the edge of the card 10a, the edge of the card 10a is inconspicuous. There is also. Therefore, by previously projecting the effect image 3 larger than the card 10a, it is possible to maintain the state in which the effect image 3 is still projected on the entire back surface of the card 10a even if the effect image 3 is slightly deviated from the position to be irradiated. Therefore, the edge of the card 10a can be made inconspicuous.

  Fig.8 (a) shows another example of the marker provided in the card | curd 10a back surface. Here, the back surface of the card 10a is vertically divided into two and horizontally divided into two, so that a total of four marker areas are provided. The same marker 20a is attached to each marker area, and the direction (top and bottom) of each marker 20a is also the same.

  FIG.8 (b) shows another example of the marker provided in the card | curd 10a back surface. Here, the back surface of the card 10a is vertically divided into three and horizontally divided into three, so that a total of nine marker areas are provided. The same marker 20a is attached to each marker area, and the direction (top and bottom) of each marker 20a is also the same.

  In the card placement area 2, the card 10a is moved by the user's finger during the game play, so the user's finger overlaps a part of the back surface of the card 10a while the card 10a is moving. Therefore, as shown in FIGS. 8 (a) and 8 (b), by attaching the same marker 20a to different areas on the back surface of the card 10a in the same direction, even in a state where a finger overlaps a part of the back surface, At least one marker 20a can be detected by the infrared camera 200a in an area where fingers do not overlap. Since it is impossible to predict where the user touches the back side of the card 10a, for example, as shown in FIG. 8B, by arranging many markers 20a on the back side, the detection accuracy of the marker 20a by the infrared camera 200a can be improved. Can be enhanced.

  In addition, although it demonstrated that the effect control part 150 projected the effect image 3 matched with the card | curd 10a from the projector 300a, the effect control part 150 projects the effect image 3 according to the motion of the card | curd 10a, for example. Also good. The effect control unit 150 derives the speed and the traveling direction of the card 10a from the change in the position coordinates of the card 10a, and causes the projector 10a to irradiate the card 10a with the effect image 3 associated with the derived speed and the traveling direction. May be. When the infrared camera 200a detects the user's finger, the effect control unit 150 may irradiate the effect image 3 corresponding to the detected finger from the projector 300a. These effect images 3 may be, for example, images that move the tyrannosaurus shown in FIG. 7. If there is an opponent user in the battle game, the effect image 3 on the opponent user's card 10 a is The video may be an action video. These effect images 3 are appropriately determined depending on the game, and the fun of the game can be enhanced by performing such effects.

  In addition, if the information regarding the detected card 10a is no longer provided from the processing unit 120, the effect control unit 150 maintains the effect image 3 in the last state in which the information was provided. For example, when the hand covers the entire back surface of the card 10a, or when shooting with the infrared camera 200a is unsatisfactory, the detection unit 110 does not detect the marker 20a, and the processing unit 120 provides information about the card 10a. Is stopped. At this time, the effect control unit 150 may project the effect image 3 in a gray scale by the projector 300a, or increase the transmittance of the effect image 3, so that a different projection mode may be used. Thus, the user can know that the card 10a is not properly detected by the infrared camera 200a.

  3 (a) and 3 (b), an example of the front and back surfaces of the card 10a is shown, and it has been described that a marker that can be photographed by the infrared camera is attached to the back surface. Also on the surface, a marker that can be photographed by the infrared camera may be attached. In this case, although a pattern that can be visually confirmed by the user is attached to the surface of the card 10a, the pattern is preferably printed in a color with high brightness, that is, the projector 300a is printed on the surface of the card 10a. It is preferable that the image is printed in a color that does not interfere with the user's recognition of the projected image when the image is projected.

  Hereinafter, the marker attached to the back surface of the card 10a is referred to as a marker 20a, and the marker attached to the front surface is referred to as a marker 20b. The detection processing related to the markers 20a and 20b in the detection unit 110 and the processing unit 120 is as described above. The marker storage unit 140 stores the marker and the card ID in association with each other, but when the marker is attached to both sides of the card 10a, the marker storage unit 140 stores the marker, the card ID, and the card surface ( (Front or back) in association with each other. Therefore, when receiving the detection result from the detection unit 110, the card identification unit 122 can identify the card ID and the card surface by performing the marker matching determination.

  For example, when the detection unit 110 detects the marker 20a of the card 10a (that is, the back surface is the top surface) and the user turns over the card 10a, the detection unit 110 detects the marker 20b. The inversion detection unit 128 detects that the marker 20a is not detected from the state in which the marker 20a has been detected, and then the card 10a is inverted when the marker 20b is detected. The inversion detection unit 128 may detect the inversion of the card 10a on the condition that the time until the marker 20b is detected after the marker 20a is not detected is within a predetermined time. When the inversion detection unit 128 detects the inversion of the card 10a, the inversion detection unit 128 notifies the effect control unit 150 of the detection result. After the marker 20a is not detected, the effect control unit 150 determines the projection mode to be different from normal by changing the effect image 3 to gray scale or increasing the transmittance, and then the marker 20b is detected. Then, a predetermined effect is executed.

  In this modification, the effect storage unit 142 stores the effect contents in association with the card ID and the card surface. Therefore, the effect control unit 150 irradiates the effect image 3 associated with the back surface of the card 10a from the projector 300a while the marker 20a is detected, and the card 10a while the marker 20b is detected. The effect image 3 associated with the surface is irradiated from the projector 300a. When the reversal detection unit 128 is notified of the reversal detection result, the effect storage unit 142 does not simply switch from the effect image associated with the back surface of the card 10a to the effect image associated with the front surface. It is preferable to irradiate a predetermined effect image from the projector 300a before switching. For example, when notified of the inversion detection result, the effect control unit 150 performs an effect that causes the effect image 3 on the back surface of the card 10a to explode, and then causes the effect image 3 on the surface of the card 10a to be projected. As a result, the user can recognize that the card 10a has been properly detected to be turned over.

  FIG. 9 shows another example of the combination of the card 10 and the card detection sensor 200 and the projection device 300. In FIG. 9, the illustration of the processing apparatus 100 is omitted. In the examples shown in FIG. 9 and subsequent figures, the processing functions of the processing apparatus 100 are as described above, and redundant descriptions are omitted as appropriate.

The card 10c shown in FIG. 9 has a front surface shown in FIG. 3A and a back surface shown in FIG.
In the combination example shown in FIG. 9, the top plate of the table 4 is configured by a translucent plate such as acrylic, and the infrared camera 200 a is disposed below the table 4. That is, in the combination example shown in FIG. 9, the infrared camera 200 a detects the marker on the card 10 c arranged on the upper surface of the table 4 from below the table 4.

  Conventionally, a technique called DI (Diffused Illumination) for detecting multi-touch input is known, and in the example shown in FIG. 9, this technique is used. When the infrared camera 200a emits infrared rays from below the table 4 toward the top plate, the infrared rays are emitted to the top plate surface, and if the card 10c is arranged on the top plate surface, the infrared rays are reflected by the card 10c, Observed by an infrared sensor. Thereby, the infrared camera 200a can detect the marker attached to the card 10c. Similarly, a technique called FTIR (Frustrated Total Internal Reflection) for detecting multi-touch input is also known. In this technique, it is necessary to irradiate the inside of the acrylic plate with infrared rays. By reflecting downward, the infrared camera 200a can detect the marker attached to the card 10c.

  Therefore, in the card 10c, the rear surface, which is the projection surface of the projector, is arranged so as to face the projector 300a provided above the table 4, so that the marker is attached to the front surface on which the character design or the like is printed. Therefore, although it has the front and back surfaces shown in FIGS. 3A and 3B in terms of the user, the difference from the card 10a shown in FIG. 3 is that the marker on the card 10c is not the back surface, It differs in that it is attached to the surface. As described above, the card 10c may also have markers on both sides.

FIG. 10 shows another example of a combination of the card 10 and the card detection sensor 200 and the projection device 300. In FIG. 10, the illustration of the processing apparatus 100 is omitted. Here, the card 10d has a front surface shown in FIG. 3A and a back surface shown in FIG. 3B when viewed by the user, but the front and back surfaces are not marked.
In the example shown in FIG. 10, a plurality of NFC (Near Field Communication) readers 200 b are embedded in the table 4. The card 10d has a short-range wireless communication function and communicates its own card ID to the NFC reader 200b. Each NFC reader 200b is set with a reader ID, and the card position acquisition unit 124 in the processing apparatus 100 holds the reader ID and the embedded position of the NFC reader 200b on the card placement area 2 in association with each other. ing. When the card ID is transmitted from the card 10d, the NFC reader 200b notifies the detection unit 110 of the card ID and the reader ID of the NFC reader 200b. Accordingly, the detection unit 110 detects the presence of the card 10d and notifies the processing unit 120 of the card ID and the reader ID. As a result, the card specifying unit 122 specifies the card ID, and the card position acquisition unit 124 acquires the position of the NFC reader 200b that detected the card 10d, that is, the position information of the card 10d in the card placement area 2 from the reader ID. . The card ID and the position information of the card 10d are provided to the effect control unit 150, and the effect control unit 150 projects the effect image 3 associated with the card 10d from the projector 300a to the card 10d.

  FIG. 11 shows another example of the card. FIG. 11A shows the front surface of the card 10e, and FIG. 3B shows the back surface of the card 10e. Character descriptions and the like are printed on the surface of the card 10e. The user can identify the type of the card 10e by looking at the description printed on the surface. In FIG. 11A, explanation of “Tyrannosaurus” is shown on the surface of the card 10e.

  As shown in FIGS. 11A and 11B, a transparent window 12 is formed on the card 10e. In the card 10 a shown in FIG. 3, the effect image 3 is projected on the back surface, but in the card 10 e, the effect image 3 is projected on the window 12. As will be described later, the effect image 3 is projected from the card arrangement area 2 on the card 10e, and the effect image 3 is projected on the window 12 so as to be visible to the user. The card 10e is provided with a marker 20a as shown in FIG. 4 on the back surface, the front surface, or both surfaces. The card 10e is used in the card placement area 2 so that the surface on which the description is described is visible to the user, and the effect image 3 is projected on the window 12. Since the effect image 3 is projected onto the window 12, for example, character information may be printed in an area other than the window 12 on the back surface shown in FIG.

FIG. 12 shows another example of the combination of the card 10, the card detection sensor 200, and the projection device 300. In FIG. 12, the processing apparatus 100 is not shown.
In the example shown in FIG. 12, the top plate of the table 4 is made of a translucent plate such as acrylic, and the infrared camera 200 a and the projector 300 a are arranged below the table 4. That is, in the example shown in FIG. 12, the infrared camera 200a detects the marker of the card 10e arranged on the upper surface of the table 4 from the lower side of the table 4, and the projector 300a receives the image light from the lower side of the table 4 to the window 12 of the card 10e. Irradiate.

  As described with reference to FIG. 9, when the infrared camera 200a irradiates infrared rays from below the table 4 toward the top plate using DI or FTIR technology, the infrared rays are emitted to the top plate surface, and the card is placed on the top plate surface. If 10e is arranged, infrared rays are reflected by the card 10e and observed by an infrared sensor. Thereby, the infrared camera 200a can detect the marker 20a attached to the card 10e.

  The card 10e is arranged in the card arrangement area 2 so that the front surface is the upper surface, and therefore the marker 20a is attached at least on the back surface. The projector 300a irradiates the effect image 3 to the card 10e from below the card 10e, so that the effect image 3 is displayed on the window 12. Regarding the card 10e, the edge position acquisition unit 126 holds the positional relationship between the four vertex coordinates in the card 10e and the window 12 in advance, and is provided with the position information and angle information of the card 10e from the card position acquisition unit 124. The edge position (window frame position) of the window 12 is acquired and provided to the effect control unit 150. It is preferable that the effect control unit 150 projects the effect image 3 onto the card 10e within the window frame and smaller than the window frame.

  That is, the projector 300a projects the effect image 3 smaller than the window 12 of the card 10e onto the window 12. If the effect image 3 is the same size as the window 12, there is no problem as long as the projector 300 a can project the effect image 3 so that it fits the edge of the window 12. It may protrude from the screen and part of the effect image 3 may not be displayed on the window 12. Therefore, by projecting the effect image 3 smaller than the window 12 in advance, even if the effect image 3 slightly deviates from the position where it should originally be irradiated, the entire effect image 3 is still displayed on the window 12. Can do.

  In the above, it is assumed that the tyrannosaurus is projected to the full extent in the rectangular effect image 3 and projected on the entire window 12, but the projected tyrannosaurus is made somewhat smaller than the window 12. Thus, even if the effect image 3 larger than the window 12 is projected, the tyrannosaurus can be projected in the window 12. In this case, by projecting the effect image 3 larger than the window 12 in advance, even if the effect image 3 slightly deviates from the position where the effect image 3 should originally be irradiated, the boundary line of the effect image 3 is not projected on the window 12. Since the tyrannosaurus image is smaller than the window 12, the tyrannosaurus image can be stored in the window 12.

FIG. 13 shows another example of the combination of the card 10, the card detection sensor 200 and the projection device 300. In FIG. 13, the illustration of the processing apparatus 100 is omitted.
In the configuration example illustrated in FIG. 13, a display device 300 b such as a liquid crystal panel functions as the projection device 300. The display device 300b projects the effect image 3 on the window 12 of the card 10e. The infrared camera 200a is disposed above the display device 300b and detects the marker 20a attached to the surface of the card 10e. The effect control unit 150 performs display control of the display device 300b, and projects the effect image 3 smaller than the window frame of the window 12 onto the card 10e, so that the user suitably uses the effect image 3 displayed on the window 12. Visible to.

FIG. 14 shows another example of a combination of the card 10 and the card detection sensor 200 and the projection device 300. In FIG. 14, the processing apparatus 100 is not shown.
In the example illustrated in FIG. 14, a display device 300 b such as a liquid crystal panel functions as the projection device 300. Further, the display device 300b shown in FIG. 14 includes an infrared sensor 200c, and therefore the infrared sensor 200c detects the card 10a attached to the back surface of the card 10e. The effect control unit 150 performs display control of the display device 300b, and projects the effect image 3 smaller than the window frame of the window 12 onto the card 10e, so that the user suitably uses the effect image 3 displayed on the window 12. Visible to.

  FIG. 15 shows another example of the card. The card 10f is common to the card 10e shown in FIG. 11 in that it has a window 12, but has an electrostatic marker instead of an infrared marker. Here, the electrostatic marker includes a plurality of markers 20c, and when the user touches one of the markers 20c, a voltage is supplied to each marker 20c. In the card 10f, the arrangement of the plurality of markers 20c is uniquely set for each type of card, and thus the card specifying unit 122 can specify the card by the arrangement pattern of the markers 20c.

FIG. 16 shows another example of a combination of the card 10 and the card detection sensor 200 and the projection device 300. In FIG. 16, the processing apparatus 100 is not shown.
In the configuration example shown in FIG. 16, a display device 300 b such as a liquid crystal panel functions as the projection device 300. A display device 300b shown in FIG. 16 has a built-in electrostatic touch sensor 200d and is configured as a multi-touch compatible display device. Therefore, when the user touches the marker 20c of the card 10f, the electrostatic touch sensor 200d detects the arrangement pattern of the marker 20c. The card specifying unit 122 specifies the card ID of the card 10f by the arrangement pattern of the markers 20c. Further, the card position acquisition unit 124 acquires the position coordinates and angle information of the card 10f, and the edge position acquisition unit 126 acquires the position coordinates of the window 12 of the card 10f. The effect control unit 150 performs display control of the display device 300b, and projects the effect image 3 smaller than the window frame of the window 12 onto the card 10f, so that the user suitably uses the effect image 3 displayed on the window 12. Visible to.

  In the above, this invention was demonstrated based on the Example. This embodiment is an exemplification, and it will be understood by those skilled in the art that various modifications can be made to the combination of each component and each processing process, and such modifications are also within the scope of the present invention. .

  For example, in FIG. 3, an illustration and description of a character that can be visually confirmed by the user are printed on the front surface, and a card is printed on the back surface with a non-visible light reflecting material or a non-visible light absorbing material. Explained that the designs and characters that the user can visually confirm are not printed. For example, in the modification, the card 10 is printed with a pattern and characters that can be visually confirmed by the user on both sides, and a marker is printed on at least one side with a non-visible light reflecting material or a non-visible light absorbing material. An example using the card 10 will be described.

  FIG. 17A shows the card sleeve 14. The card sleeve 14 is a film case having a bag shape for inserting the card 10, and the user can put the card 10 in the card sleeve 14 to protect the card 10. One surface of the card sleeve 14 is formed of a transparent sheet that transmits visible light, and the other surface is formed of a non-transparent sheet that does not transmit visible light. This non-transparent sheet has one color with high brightness like the back surface of the card 10a, and may be formed of, for example, a white non-transparent material.

  FIG. 17B shows a state in which the card 10 is inserted in the card sleeve 14. The user inserts the card 10 into the card sleeve 14 so that the surface of the card 10 on which the marker is formed faces the non-transparent sheet of the card sleeve 14. Here, the non-transparent material forming the non-transparent sheet is a material that transmits infrared rays. Note that the user can visually confirm the pattern and characters on the card surface facing the transparent sheet. Therefore, as described with respect to the card 10a, when the non-transparent sheet of the card sleeve 14 is arranged on the upper surface in the card arrangement area 2, the infrared camera 200a can detect the marker of the card 10 and the projector 300a The image light can be projected onto the non-transparent surface. Thus, even when illustrations or the like are printed on both sides of the card 10, the card surface with the marker is made of a material that does not transmit visible light but transmits invisible light. By covering with the non-transparent sheet, the infrared camera 200a can detect the marker from the infrared reflected light of the card surface facing the non-transparent sheet, and the projector 300a can suitably project the image light that is visible light on the non-transparent sheet. become.

  In the embodiment, the effect image 3 is projected on the card 10, but the effect control unit 150 can project various images based on the movement of the finger with respect to the effect image 3.

  For example, when a plurality of button images are projected on the card 10 and the user touches a position where any one of the button images is displayed, an image (for example, a menu image) associated with the button image is projected to the side of the card 10. You may make it do. At this time, the detection unit 110 detects the finger position of the user in the card arrangement area 2, and when the finger position is overlapped with the projection position of the button image, the effect control unit 150 is associated with the button image. You may make it project an image from the projection apparatus 300. FIG. The effect control unit 150 may project an image of a computer or the like as the effect image 3 and project an image indicating a predetermined processing result according to the finger movement detected by the detection unit 110. Further, the effect control unit 150 may project a stopwatch image as the effect image 3.

  In the embodiment, it has been described that the projection device 300 projects the effect image 3 based on the outer frame or the window frame of the card 10. However, the effect image 3 in which a character crawls out of the card 10 is projected. Is also possible.

  Moreover, in the Example, when the inversion detection part 128 detected the inversion of the card | curd 10, it demonstrated that the effect accompanying the inversion was performed. There are various effects depending on the movement of the card, such as placing the card in a predetermined position or moving it quickly, in any case, depending on such movement, The effect control unit 150 can perform a predetermined effect.

  As an example of the use case of this technology, an example is shown in which shogi is performed via a network with a partner. A virtual shogi board is projected onto the card placement area 2, and an image of a shogi piece is projected onto the card that he places on the shogi board. The opponent's piece is projected on the shogi board as if a virtual card exists. Since shogi can use the picked pieces as their own hand pieces, the picked pieces are projected on a virtual piece place. The user can point to the shogi by moving the card for the piece projected on the card, and for the piece projected without the card by touching the projected position of the virtual piece with the finger and moving the finger. it can. The above processing is realized by the effect control unit 150.

DESCRIPTION OF SYMBOLS 1 ... Image projection system, 2 ... Card arrangement area, 3 ... Production image, 4 ... Table, 10 ... Card, 12 ... Window, 20a, 20b, 20c ... Marker , 21 ... Reference cell, 100 ... Processing device, 110 ... Detection unit, 120 ... Processing unit, 122 ... Card identification unit, 124 ... Card position acquisition unit, 126 ... Edge position acquisition unit, 128... Reversal detection unit, 140... Marker storage unit, 142 .. production storage unit, 150 ... production control unit, 200. Infrared camera, 200b ... NFC reader, 200c ... infrared sensor, 200d ... electrostatic touch sensor, 300 ... projection device, 300a ... projector, 300b ... display device.

Claims (3)

A card that reflects the irradiated light, and a card with a marker for identifying the card;
A projection device for projecting an image from an upper side where the user views the card with respect to the card;
A sensor for detecting a marker attached to the card;
A processing device that acquires a position where the card is arranged using a detection result of the sensor and controls image projection of the projection device, and an image projection system comprising:
The processing device has a processing unit, and based on the position where the card is arranged, the projection device has an effect image associated with a card ID provided by the processing unit on the card. Overlapping and projecting larger than the card , or
The processing device includes a processing unit, and an effect storage unit that stores the card ID and the effect pattern in association with each other. The projection device is connected to the projection device based on the position where the card is arranged. An effect pattern associated with the provided card ID, wherein an effect image according to the effect pattern read from the effect storage unit is projected on the card and larger than the card;
An image projection system characterized by that.   The image projection system according to claim 1, wherein a plurality of the same markers are attached to the card.   3. The image according to claim 1, wherein the surface of the card to which the marker is attached is given one color that reflects the image projected by the projection device so that a user can visually recognize the image. Projection system.

Images