JP4746074B2 - Image processing system - Google Patents

Description

The present invention captures an image of a card placed on a desk, table, etc., and variously arranges an image display system for displaying a 3D image of an object corresponding to identification information affixed to the card together with the captured image. about the image processing system for the recognition of the card.

  Recently, a card with an identification image (such as a two-dimensional barcode) attached to the front or back surface is imaged by, for example, a CCD camera, and the image data of the identification image attached to the card is detected from the image data of the captured image. Patent Document 1 discloses a method for detecting the identification information of the card from the image data of the detected identification image.

  Then, this method is developed to display a captured image including an image of the card from the CCD camera on a monitor, and the detected identification on the image of the card displayed on the monitor An example in which a three-dimensional image of an object corresponding to information is superimposed and displayed is disclosed in Patent Document 2. According to this method, it is possible to express a visual effect that fuses real space and virtual space.

JP 2000-82108 A JP 2000-322602 A

The present invention is to further develop the method of Patent Document 2 described above, various video can be easily applied to a game, the video game category enlarging, images processing system where Ru can be reduced to diversify the The purpose is to provide.

  In addition, the present invention obtains the camera coordinate system of the entire captured image from the position of the identification image attached to the first card existing in the captured image, and identifies the first card based on the identification image. Detect information. Based on the camera coordinates of the first card, the arrangement position of the other card is predicted, the identification image attached to the other card is detected from the image at the predicted arrangement position, and the identification information of the other card is detected. Is detected.

  As this processing, for example, the image data of the identification image of the first card is affine transformed to detect the identification information of the first card, and the image data of the identification image of the other card is affine transformed. The identification information of the card is detected.

  For example, when two users each arrange a plurality of cards, for example, in the horizontal direction, and each user places the first card on one diagonal line, among the captured images, The positions of the images of the two cards arranged on the diagonal line are detected, and the rectangular area including the diagonal line is specified from the detected positions of the two cards. Then, the identification information of the remaining cards may be detected from the image data in the specified rectangular area.

  Thereby, it is possible to reduce the load of recognition processing for a plurality of cards, leading to an increase in processing speed.

  In the above-described invention, a plurality of pieces of identification information may be assigned to the same object, and parameters relating to the same object may be made different in each of the plurality of pieces of identification information. As a result, even if the same object, for example, when it changes to another object with the progress of the subsequent scenario or time, or when it does not change, or when the experience value increases rapidly or slowly, various It is possible to freely set various parameter differences. Therefore, for example, when applied to a video game, it is possible to enjoy the growth process for each character and enjoy card ranking and the like.

  In addition, a removable storage medium connected to the computer may be provided, and information corresponding to the identification information may be managed by the storage medium, or the computer may be connected to a network server via a network. The information corresponding to the identification information may be managed by the network server.

  In this case, for example, when information corresponding to the identification information is stored in the user's video game system, the object, parameter, and the like corresponding to the card are different for each user. Therefore, even if the card is transferred, there is little meaning if the contents of the information corresponding to the identification information are different. However, if information corresponding to the identification information can be collectively managed by a removable storage medium or a network server, the information corresponding to the identification information becomes unique information and can be shared by all users. Therefore, it is possible to transfer the card.

  Furthermore, in the present invention, the card identification image may be constituted by a two-dimensional barcode in which a large number of cells are arranged. In this case, the identification information can be freely changed by painting the cell with a black oil-based pen or water-based pen or by erasing the cell with a white oil-based pen or water-based pen. It is possible to enjoy what kind of object image appears and what kind of form it will change as the experience value increases, and it is possible to add more interest to the video game.

As described above, according to the engagement Ru images processing system according to the present invention, can be easily applied to a variety of video games, expansion of the category of video games, it is possible to diversify.

Hereinafter, an embodiment of the embodiment of the engagement Ru images processing system according to the present invention is applied to a video game system will be described with reference to FIGS. 1 to 29.

  As shown in FIG. 1, the video game system 10 according to the present embodiment includes a video game machine 12 and various external devices 14.

  The video game machine 12 exchanges data with a CPU 16 that executes various programs, a main memory 18 that stores various programs and data, an image memory 20 that records (draws) image data, and various external devices 14. And an input / output port 22 for performing the difference calculation, and first and second difference memories 24 and 26 for performing the difference calculation described later.

  Various external devices 14 connected to the input / output port 22 include a monitor 30 connected via a display interface (I / F) 28 and an optical disk (DVD-ROM, DVD-RW, DVD-RAM, CD-ROM). Etc.) An optical disk drive 34 for reproducing / recording to / from 32, a memory card 38 connected via a memory card interface (I / F) 36, and a connection via an imaging interface (I / F) 40 A CCD camera 42, a hard disk drive (HDD) 46 that performs reproduction / recording on the hard disk 44, and a speaker 50 connected via an audio interface 48. Of course, the input / output port 22 may be connected to the Internet (not shown) via a router (not shown).

  Data input / output to / from the external device 14 and data processing in the video game machine 12 are performed through the CPU 16 and the main memory 18, and in particular, imaging data and image data are recorded (drawn) in the image memory 20.

  Next, the characteristic functions of the video game system 10 according to the present embodiment, that is, a randomly accessible recording medium such as the optical disk 32, the memory card 38, and the hard disk 44, or the Internet or an intranet, for example. Functions realized by a program provided to the video game machine 12 via the network will be described with reference to FIGS.

  First, the card 54 used in the video game system 10 will be described. This card 54 generally has the same size and thickness as a card used in a card game. As shown in FIG. 2A, a pattern indicating a character corresponding to the card 54 is printed on the front surface, and on the back surface, As shown in FIG. 2B, an identification image 56 is printed. Of course, you can use a transparent card. In this case, only the identification image 56 is printed.

  The identification image 56 is configured by a pattern of a two-dimensional barcode (hereinafter abbreviated as 2D code) as shown in FIG. 2B. In the identification image 56, one block is one unit, the length of the vertical direction is 9.5 blocks, and the length of the horizontal direction is 7 blocks. The blocks are separated. The logo part 58 is a 2D code for notifying the reference position of the code part 60 and the direction of the card 54, and the vertical direction is 1.5 blocks long and the horizontal direction is 7 blocks long. A rectangular black reference cell 62 is arranged. The logo portion 58 may be printed with, for example, a character name or a mark (logo) for advertising.

  The code unit 60 includes, for example, black square corner cells 64 for recognition information recognition corresponding to each corner portion in a square range having a length of 7 blocks in both the vertical direction and the horizontal direction. For example, black rectangular identification cells 66 for recognizing identification information are two-dimensionally patterned and arranged in an area surrounded by four corner cells 64.

  The method for detecting the position of the identification image 56 from the captured image data, the method for detecting the image of the corner cell 64, and the method for detecting the two-dimensional pattern of the identification cell 66 are disclosed in, for example, Patent Document 1 described above (Japanese Patent Laid-Open No. 2000-2000). No. 82108) is described in detail.

  In the present embodiment, the correspondence table between the various patterns of the two-dimensional pattern of the identification cell 66 and the identification numbers corresponding to each pattern is a hard disk 44 as a database 68 (2D code database: see FIGS. 6 and 7), for example. Or the optical disc 32 or the like. Therefore, the identification number of the card 54 can be easily detected by comparing the detected two-dimensional pattern of the identification cell 66 with the correspondence table in the database 68.

  As shown in FIGS. 3A and 3B, the functions realized by the video game system include, for example, six cards 541, 542, 543, 544, 545, and 546 placed on a desk or table 52, etc. And the images of the cards 541, 542, 543, 544, 545 and 546 displayed on the screen of the monitor 30, for example, the cards 541, 542, 543, 544, 545 and the like. On the identification images 561, 562, 563, 564, 565 and 566 affixed to 546, images (701, 702, 703, 704) of objects (characters) corresponding to the identification images 561-566 of the cards 541-546, etc. , 705 and 706 are displayed in a superimposed manner so that the game and the video game are fused. Is that to realize. The character refers to a human or animal or a hero who appears in a TV program or an animated movie among objects.

  As shown in FIG. 3A, the CCD camera 42 is attached to a stand 72 fixed on a desk or table 52. At this time, for example, the imaging surface of the CCD camera 42 is placed on the cards 541 to 546 by the user. It is adjusted so as to face the part. Of course, as shown in FIG. 4A, when the user 74 captures an image of holding one card 542 and displays it on the monitor 30, the screen of the monitor 30 is displayed on the screen of the user 74 as shown in FIG. 4B. An image, an identification image 562 of the card 542, and a character image 702 are displayed, and a scene where a character is on the card 542 held by the user 74 can also be displayed.

  The above-described functions of the present embodiment are achieved by the CPU 16 executing an application program for realizing the functions among various programs installed in the hard disk 44, for example.

  As shown in FIG. 5, the application program 80 includes a card recognition program 82, a character appearance display program 84, a character action display program 86, a first card position prediction program 88, a second card position prediction program 90, an image motion, A detection program 92, a card motion detection program 94, a card re-recognition program 96, a character change program 98, and an information table reference program 100;

  Here, the function of the application program 80 will be described with reference to FIGS.

  First, the card recognition program 82 recognizes an identification image 561 of a card (for example, the card 541 in FIG. 3A) placed on a desk, table 52, or the like, and displays an image of a character (for example, a character to be displayed on the identification image 561). 3B, the image 701) is specified. As shown in FIG. 6, the captured image rendering function 102, the reference cell detection function 104, the identification information detection function 106, the camera coordinate detection function 108, And a character image search function 110. Here, “recognition” indicates that the identification number or direction of the card 541 is detected from the identification image 561 of the card 541 detected from the captured image data drawn in the image memory 20.

  The captured image rendering function 102 sets and renders the captured image of the subject as a background image in the image memory 20. One of the processes to be set as the background image includes setting a Z value for Z buffering.

  As described above, the reference cell detection function 104 detects the image data of the reference cell 62 of the logo portion 58 from the image data (captured image data) drawn in the image memory 20, and the position of the image data of the reference cell 62. Is detected. The position of the image data in the reference cell 62 is detected as screen coordinates.

  As shown in FIG. 7, the identification information detection function 106 detects the image data of the corner cell 64 based on the detected position of the image data of the reference cell 62, and an area formed by the reference cell 62 and the corner cell 64. The image data of 112 is affine transformed to make the identification image 561 of the card 541 equivalent to the image 114 seen from above, and the two-dimensional pattern of the code part 60, that is, the corner cell 64 and the identification cell are obtained from the image data. A code 116 composed of 66 two-dimensional patterns is extracted, and an identification number or the like is detected from the code 116. As described above, the identification number is detected by collating the extracted code 116 with the 2D code database 68.

  As shown in FIG. 8, the camera coordinate detection function 108 is a camera coordinate system (6-axis directions: x, y, z, θx) with the camera viewpoint C0 as the origin based on the detected screen coordinates and the focal length of the CCD camera. , Θy and θz), and the camera coordinates of the identification image 561 in the card 541 are obtained. At this time, the camera coordinates of the center of the logo portion 58 and the camera coordinates of the center of the code portion 60 in the card 541 are obtained.

  Note that the method of obtaining the camera coordinates of the image from the screen coordinates of the image drawn in the image memory 20 and the method of obtaining the screen coordinates on the image memory 20 from the camera coordinates of a certain image are described in Patent Document 2 described above. Since it is described in detail in Japanese Patent Laid-Open No. 2000-322602, please refer to Patent Document 2.

  The character image search function 110 searches the object information table 118 for a character image (eg, a character image 701 shown in FIG. 3B) based on the detected identification number.

  The breakdown of the object information table 118 includes, for example, a large number of records arranged as shown in FIG. 9, and each record includes an identification number, basic parameters (experience values, levels), and character image data (level 1). ) Storage head address, level 1 parameters (physical strength, attack power, defense power, etc.), character image data (level 2) storage head address, level 2 parameters (physical strength, attack power, defense power, etc.), character The storage start address of the image data (level 3), level 3 parameters (physical strength, attack power, defense power, etc.), and valid / invalid bits are registered.

  As the image data, image data corresponding to a level that is one of the basic parameters is read out. That is, if the level is 1, the image data is read from the storage head address corresponding to the level 1, and further the level 1 parameters are read. The same applies to level 2 and level 3. The valid / invalid bit is a bit for determining whether or not the record is valid. The case where “invalid” is set is, for example, the case where the image of the character is not set at the current stage, or the case where the character is defeated and died in the battle set in the video game, for example.

  The character image search function 110 searches the object information table 118 for a record corresponding to the identification number. If the searched record is “valid”, the character image search function 110 includes a plurality of storage head addresses registered in the record. Then, the image data 120 is read from the storage head address corresponding to the current level. For example, the image data 120 corresponding to the character is read from the storage head address in the data file 122 recorded on the hard disk 44, the optical disk 32, etc. and registered with a large number of image data 120. In the case of “invalid”, the image data 120 is not read.

  Accordingly, when one card 541 is placed on the desk, table 52 or the like, the card recognition program 82 is activated, and the identification number and level (hereinafter referred to as an identification number or the like) specified by the identification image 561 of the placed card 541. The character image 701 corresponding to the above is specified. If the character image is not changed according to the level, only one storage head address for the image data 120 is registered in each record of the object information table 118. In this case, the card 541 The character image 701 corresponding to the identification number identified by the identification image 561 is identified.

  With this card recognition program 82, it is possible to express visual effects that fuse real space and virtual space. Control is transferred from the card recognition program 82 to various application programs (character appearance display program 84, character action display program 86, first card position prediction program 88, second card position prediction program 90, etc.). become.

  Next, the character appearance display program 84 superimposes the character image 701 corresponding to the identification number specified in the identification image 561 of the detected card (for example, the card 541) on the identification image 561 of the card 541 to appear. As shown in FIG. 10, it has an operation data string search function 124, an appearance posture setting function 126, a 3D image setting function 128, an image drawing function 130, an image display function 132, and a repetition function 134.

  The action data string search function 124 searches for the action data string for displaying the scene in which the character appears from the appearance action information table 136 based on the identification number or the like. Specifically, first, for example, a record corresponding to an identification number or the like is searched from the appearance action information table 136 recorded on the hard disk 44, the optical disk 32, etc., and the storage head address of the action data string is registered in each record. . Then, for example, the image 701 of the character appears from the storage head address registered in the searched record in the data file 140 recorded on the hard disk 44, the optical disk 32, etc. and registered with a large number of motion data strings 138. The operation data string 138 indicating the operation to be performed is read.

  The appearance posture setting function 126 sets one posture in the process in which the character image 701 appears. For example, based on the motion data of the i-th frame (i = 1, 2, 3,...) Of the read motion data sequence 138, the vertex data of the character image 701 is moved in the camera coordinate system to change one posture. Set.

  Based on the detected camera coordinates of the identification image 561 of the card 541, the three-dimensional image setting function 128 generates a three-dimensional image of one posture in the process of the appearance of the character image 701 on the identification image 561 of the card 541. Set.

  The image drawing function 130 perspectively converts a three-dimensional image of one posture in the process of appearance of the character image 701 into an image in the screen coordinate system and draws it in the image memory 20 (including hidden surface processing). At this time, in Z buffering, a scene in which the character image 701 gradually appears from below the identification image 561 of the card 541 is expressed by resetting the Z value of the character image 701 in units of frames. be able to.

  The image display function 132 outputs an image drawn in the image memory 20 to the monitor 30 via the input / output port 22 in units of one frame, and displays the image on the screen of the monitor 30.

  The repeat function 134 sequentially repeats the processing by the appearance posture setting function 126 → the processing by the three-dimensional image setting function 128 → the processing by the image drawing function 130 → the processing by the image display function 132. As a result, a scene in which the character image 701 corresponding to the identification number of the card 541 appears on the identification image 561 of the card 541 is displayed.

  Next, the character action display program 86 displays a scene where the character is waiting, an attacking scene, a magical scene, a scene scolding other characters, and the like, as shown in FIG. In almost the same manner as the character appearance display program 84, the motion data string search function 142, the posture setting function 144, the 3D image setting function 146, the image drawing function 148, the image display function 150, and the repeat function 152 are provided.

  The motion data string search function 142 searches a motion data string for displaying a scene where a character waits, an attacking scene, a magical scene, and a scene scolding another character from various motion information tables 154 corresponding to the scene. . Specifically, first, an operation information table corresponding to an operation to be displayed from various operation information tables 154 recorded on, for example, the hard disk 44, the optical disk 32, etc., and the storage head address of the operation data string is registered in each record. 154 is specified, and a record corresponding to the identification number or the like is searched from the specified operation information table 154. For example, among the data file 158 recorded on the hard disk 44, the optical disk 32, etc., and registered with a large number of motion data strings 156, the motion (character is to be displayed) from the head address registered in the retrieved record. A motion data string 156 corresponding to a standby motion, an attacking motion, a magical motion, a motion of scolding other characters, and the like.

  For example, if the character is related to the card 541, the posture setting function 144 sings one posture in the process of waiting for the character image 701, one posture in the attacking process, one posture in the process of applying magic, and scolding another character. Set one posture for the process. For example, based on the motion data of the i-th frame (i = 1, 2, 3,...) Of the read motion data sequence 156, the vertex data of the character image 701 is moved in the camera coordinate system to change one posture. Set.

  The three-dimensional image setting function 146 is one of the processes in which the character image 701 stands by on the identification image 561 of the card 541 based on the detected camera coordinates of the identification image 561 of the card 541, the process of attacking A three-dimensional image of one posture, one posture in the process of applying magic, and one posture in the process of scolding another character is set.

  The image drawing function 148 is a three-dimensional image of one posture in the process of waiting for the character image 701, one posture in the attacking process, one posture in the process of applying magic, and one posture in the process of scolding another character. Is perspective-transformed into an image in the screen coordinate system and rendered in the image memory 20 (including hidden surface processing).

  The image display function 150 outputs an image drawn in the image memory 20 to the monitor 30 via the input / output port 22 in units of one frame, and displays the image on the screen of the monitor 30.

  The repeat function 152 sequentially repeats processing by the posture setting function 144 → processing by the three-dimensional image setting function 146 → processing by the image drawing function 148 → processing by the image display function 150. As a result, a scene where the character image 701 waits, an attacking scene, a magical scene, and a scene scolding another character are displayed.

  By using the card recognition program 82, the character appearance display program 84, and the character action display program 86, a card game character can appear in a video game scenario and various actions can be performed. That is, the card game that can only be enjoyed in the real space can be expanded to the virtual space, and a new game in which the card game and the video game are fused can be provided.

  Next, the first card position prediction program 88 will be described. This program 88 assumes a case where three cards are arranged in the horizontal direction, for example, as shown in FIG.

  Then, as shown in FIG. 13A, the first card position prediction program 88, for example, when the position of the identification image 561 of one card 541 is detected by the card recognition program 82 described above, Based on the position, the positions of the other cards 542 and 543 (see FIG. 12) are predicted. As shown in FIG. 14, the detection area setting function 162, the reference cell detection function 164, and the identification information detection A function 166 and a character image search function 168;

  Here, the processing operation of the first card position prediction program 88, particularly the operation after the camera coordinates of the identification image 561 of one card 541 are detected by the card recognition program 82, for example, as shown in FIG. 13A. This will be described with reference to FIG.

  First, in step S1 of FIG. 15, the detection area setting function 162, based on the detected camera coordinates of one identification image 561, detects a certain area of the detection area 170 including the identification image 561 as shown in FIG. 13A. Find camera coordinates. The detection area 170 is a rectangular area if a plurality of cards are arranged in the horizontal direction.

  Thereafter, in step S2, a drawing range 172 of the detection area 170 on the image memory 20 is obtained from the camera coordinates of the detection area 170 obtained.

  Thereafter, in step S <b> 3, the reference cell detection function 164 determines whether or not the image data of the reference cell 62 exists in the drawing range 172 of the detection area 170 in the image memory 20.

  When the image data of the reference cell 62 exists, for example, as shown in FIG. 12A, assuming that two cards 542 and 543 are arranged in the horizontal direction next to the card 541, the steps of FIG. In step S4, the identification information detection function 166 affine-transforms the image data of the area formed by the detected reference cell 62 and corner cell 64. Then, identification numbers corresponding to the cards 542 and 543 are detected from the identification images 562 and 563 of the cards 542 and 543. As described above, the identification number is detected by collating the code extracted from the identification images 562 and 563 with the 2D code database 68.

  Thereafter, in step S 5, the character image search function 168 searches the object information table 118 for the character image data 120 based on the identification numbers of the cards 542 and 543. For example, the record corresponding to the identification number is searched from the object information table 118. If the searched record is “valid”, the storage head corresponding to the current level among the plurality of storage head addresses registered in each record. The image data 120 is read from each address.

  On the other hand, if it is determined in step S3 that the image data of the reference cell 62 does not exist, the reference cell detection function 164 proceeds to step S6 and prompts to place all the cards on the screen of the monitor 30. Output an error message. Thereafter, in step S7, after waiting for a predetermined time (for example, 3 seconds), the process returns to step S3 and the above-described processing is repeated.

  Then, when the character images 701 to 703 are determined for all the cards existing in the detection area, the above-described processing operation ends.

  Also in this case, for example, when the character appearance display program 84 is activated, as shown in FIG. 12B, characters of the characters corresponding to the identification numbers of the cards 541 to 543 are displayed on the identification images 561 to 563 of the cards 541 to 543, respectively. A scene in which the images 701 to 703 appear is displayed.

  In the first card position prediction program 88, recognition for the plurality of cards 542 and 543 is performed on the detection area 170 set based on the position of the identification image 561 of one card 541 already detected. Therefore, it is not necessary to detect the entire image memory 20 again in order to recognize the plurality of cards 542 and 543, and the load of recognition processing on the plurality of cards 542 and 543 can be reduced. This leads to an increase in processing speed.

  Next, the second card position prediction program 90 will be described. In this program 82, as shown in FIG. 3A, two people each arrange three cards in a horizontal direction, for example, and each person first places the first card 541 and 544 on the left side, for example. In other words, it is assumed that two cards 541 and 544 are placed on the diagonal line.

  The second card position prediction program 90 predicts the positions of other cards when two cards are placed on a diagonal line. As shown in FIG. 174, a reference cell detection function 176, an identification information detection function 178, and a character image search function 180.

  Here, the processing operation of the second card position prediction program 90, particularly the camera coordinates of the identification images 561 and 564 of the two cards 541 and 544 placed on the diagonal line Lm as shown in FIG. The operation after being detected by the recognition program 82 will be described with reference to FIG.

  First, in step S101 of FIG. 18, the rectangular area setting function 174, as shown in FIG. 17A, based on the camera coordinates of the identification images 561 and 564 of the two cards 541 and 544 placed on the diagonal line Lm. The camera coordinates of the rectangular area 182 including the diagonal line Lm are obtained.

  Thereafter, in step S102, the drawing range 184 of the rectangular area 182 on the image memory 20 is obtained from the camera coordinates of the obtained rectangular area 182 as shown in FIG. 17B. Thereafter, in step S <b> 103, the reference cell detection function 176 determines whether or not the image data of the reference cell 62 exists in the drawing range 184 of the rectangular area 182 in the image memory 20.

  When image data of the reference cell 62 exists, for example, as shown in FIG. 3A, two cards 542 and 543 are arranged side by side next to the card 541, and two cards 545 are next to the card 544. And 546 are arranged in the horizontal direction, the process proceeds to step S104 in FIG. 18, and the identification information detection function 178 affineates the image data of the area formed by the detected reference cell 62 and corner cell 64. Convert. Then, the identification numbers corresponding to the cards 542, 543, 545, and 546 are detected from the identification images 562, 563, 565, and 566 of the remaining cards 542, 543, 545, and 546. As described above, the identification number is detected by collating the codes extracted from the identification images 562, 563, 565, and 566 with the 2D code database 68.

  Thereafter, in step S105, the character image search function 180 searches the object information table 118 for the character image data 120 based on the identification numbers of the cards 542, 543, 545, and 546. For example, the record corresponding to the identification number is searched from the object information table 118. If the searched record is “valid”, the storage head corresponding to the current level among the plurality of storage head addresses registered in each record. The image data 120 is read from each address.

  On the other hand, if it is determined in step S3 that the identification images 562, 563, 565, and 566 of the remaining cards 542, 543, 545, and 546 do not exist, the reference cell detection function 176 proceeds to step S106. Then, an error message prompting to place all the remaining cards 542, 543, 545 and 546 on the screen of the monitor 30 is output, and after waiting for a predetermined time (for example, 3 seconds) in step S107, the process proceeds to step S103. Return and repeat the process.

  Then, when the character images 701 to 706 have been determined for all the cards 541 to 546 existing in the rectangular area 182, the processing operation described above ends.

  Also in this case, for example, when the character appearance display program 84 is activated, character images 701 to 706 corresponding to the identification numbers of the cards 541 to 546 appear on the identification images 561 to 566 of the cards 541 to 546, respectively. The scene to be displayed is displayed.

  In the second card position prediction program 90, recognition of the plurality of cards 542, 543, 545, and 546 is performed on the rectangular area 182 formed by the two cards 541 and 544 placed on the diagonal line Lm. Therefore, after recognizing the two cards 541 and 544 placed on the diagonal Lm, it is necessary to detect the entire image memory 20 again in order to recognize the other cards 542, 543, 545 and 546. And the load of recognition processing for a plurality of cards 542, 543, 545, and 546 can be reduced.

  In the first and second card position prediction programs 88 and 90 described above, a plurality of information tables (card arrangement information tables: not shown) indicating the arrangement of the cards 541 to 546 are prepared corresponding to a plurality of opponents. Each time the camera coordinates of the identification images 561 to 566 of the cards 541 to 546 and the identification numbers of the cards 541 to 546 are detected, they may be registered in the corresponding card arrangement information table. In this case, at the stage where all the camera coordinates of all the cards 541 to 546 placed on the desk, the table 52, etc. are registered in the card arrangement information table, thereafter, based on the camera coordinates registered in the card arrangement information table. The cards 541 to 546 may be recognized (re-recognized).

  When the opponent arranges three cards, for example, in the horizontal direction, the processing procedure for each opponent is specified as one by changing the direction of the three cards. Good.

  For example, among the three cards 541 to 543, a character that performs an action is specified according to the arrangement direction of the left card 541, an opponent character that should be influenced by the action is specified according to the arrangement direction of the center card 542, and the right card The operation is specified according to the arrangement direction of.

  That is, when a character performing an action is specified according to the arrangement direction of the left card 541, if the card 541 is in the left direction, the character image 701 corresponding to the card 541 is selected, and if it is in the upward direction, The character image 702 corresponding to the center card 542 is selected. If it is rightward, the character image 703 corresponding to the right card 543 is selected. If it is downward, it corresponds to the three cards 541 to 543. Three character images 701 to 703 are selected.

  When an opponent character is specified by the arrangement direction of the center card 542, if the card 542 is leftward, the character image 704 corresponding to the opponent's card 544 is selected, and if it is upward, the opponent The character image 705 corresponding to the center card 545 is selected. If it is in the right direction, the character image 706 corresponding to the opponent's right card 546 is selected. An image of the character selected in the arrangement direction of the card 541 is selected.

  When the action is specified by the arrangement direction of the card 543 on the right side, if the card 543 is in the left direction, “attack” is selected. If the card 543 is in the upward direction, “apply magic” is selected. “Defend” is selected, and “down” is selected if the direction is down.

  If processing according to the arrangement direction of the card is performed, various operations may be performed depending on combinations of orientations of the plurality of cards 541 to 543 without using an operation device (device for inputting a command by key operation). Processing can be instructed.

  Next, the image motion detection program 92 will be described. The program 92 takes a difference between image data captured at a predetermined timing and image data captured at a timing different from the predetermined timing, identifies an image that has moved based on the data after the difference, It is determined whether or not the specified image (such as an image of a user's hand) is in contact with the character image, and if it is determined that the image is in contact, the parameter corresponding to the character is changed. .

  As shown in FIG. 19, the program 92 includes a first memory function 188, a second memory function 190, a difference calculation function 192, an image specifying function 194, a contact determination function 196, and a repeat function 198. And a parameter changing function 200.

  The operation of the program 92, for example, as shown in FIG. 20A, when the user 74 holds one card 542 in one hand 202, the card is displayed on the identification image 562 of the card 542 on the screen of the monitor 30. Operations after the appearance of the character image 702 corresponding to the identification number 542 and the like will be described with reference to FIGS.

  First, the first memory function 188 takes the captured image data 204 from the CCD camera 42 based on the input timing of the first difference signal S1 and stores it in the first difference memory 24. The input timing of the first difference signal S1 can be arbitrarily set.

  The second memory function 190 captures the captured image data 206 from the CCD camera 42 based on the input timing of the second difference signal S2, and stores it in the second difference memory 26. The input timing of the second difference signal S2 can also be set arbitrarily. For example, after the first frame of the first difference signal S1, the second frame, the fifth frame, and the like.

  As shown in FIG. 21, the difference calculation function 192 calculates a difference between the captured image data 204 stored in the first difference memory 24 and the captured image data 206 stored in the second difference memory 26. For example, processing such as subtracting the captured image data 204 stored in the first difference memory 24 from the captured image data 206 stored in the second difference memory 26 may be performed.

  The image specifying function 194 specifies an image that has moved from the data 208 after the difference. As the data 208 after the difference, data dispersed in an island shape in units of one pixel or several pixels is assumed. Here, for the data 208 after the difference, data indicating a large cluster of 100 pixels or more is extracted. Then, the extracted data is specified as a moving image. In the example of FIG. 21, a case where three images 208a to 208c are specified as images having movement is shown. “Specify” indicates that the recording range of the extracted data 208a to 208c is detected as screen coordinates.

  For one or more images 208 a to 208 c that have moved, the contact determination function 196 is based on the screen coordinates of the images 208 a to 208 c that have moved and the screen coordinates of the character image 702 drawn in the image memory 20. It is determined whether or not there is an image 208c touching the character image 702. This determination is made as long as a part of the screen coordinates of the images (208a to 208c) that have moved and a part of the screen coordinates of the character image 702 (screen coordinates on the image memory 20) are the same. It is determined that there is an image touching the image 702. In the example of FIG. 21, the image 208c corresponds.

  If there is one moving image (for example, the image 208c), the contact determination function 196 determines whether or not the moving image 208c touches the character image 702, and the movement If the screen coordinates of a part of the image 208c and the screen coordinates of a part of the character image 702 are the same, it is determined that there is an image touching the character image 702. It is determined that the rest is not touched.

  The repeat function 198 sequentially repeats the process by the first memory function 188 → the process by the second memory function 190 → the process by the difference calculation function 192 → the process by the image specifying function 194 → the process by the contact determination function 196.

  The parameter change function 200 determines the number of times that the contact determination function 196 determines that the moving image is in contact with the character image 702 while the processing by the various functions described above is repeated by the repetition function 198. If the number of times is equal to or greater than a predetermined number (for example, an arbitrary integer of 5 or more can be selected), parameters registered in the record corresponding to the identification number of the card 542 in the object information table 118, such as experience values, Increases health, attack power, etc.

  This is because, of the images 208 a to 208 c specified by the image specifying function 194, the image 208 c determined to be in contact with the character image 702 by the contact determination function 196 is a pseudo-hand of the user's hand 210. It is estimated that the user is petting the character.

  Therefore, in addition to a battle game, for example, the present invention can be preferably applied to a training game in which, for example, a user raises a specific character to increase an attack power or a defense power.

  When the user pets the character with his / her hand, the character image 702 is hidden by the image of the user's hand 210, and the character image 702 does not appear even if the action that the character is pleased is rendered in the image memory 20. It may be almost invisible. Therefore, when drawing the captured image in the image memory 20, by setting the Z value of Z buffering to, for example, the highest value (a value indicating the farthest from the camera viewpoint, which is the origin in the camera coordinate system), Even if the image that the user strokes the character with the hand 210 is displayed, the character image 702 is not hidden by the image of the user's hand 210. Therefore, the user can pet the character while watching the action that the character is pleased, and can add interest to the breeding game and the like.

  By the way, as the video game progresses, a card placed on a desk or table 52 may be moved by the user's hand. For example, the position of one or more cards may be shifted, the arrangement of cards may be changed, or a new card may be exchanged. Thus, when a card | curd has moved, it is necessary to recognize again about the card | curd which moved.

  In order to solve this, the card recognition program 82, the first card position prediction program 88, and the second card position prediction program 90 may be activated in units of several frames or several tens of frames. Of course, when a new card (for example, the card 541) is recognized, the character appearance display program 84 is activated and the character image corresponding to the identification number of the new card 541 is displayed on the identification image 561 of the new card 541. If the image 701 appears and the position of the card 541 is shifted or the position of the card 541 is changed, the character action display program 86 may be activated to display, for example, a “standby” action.

  In the card re-recognition, as described above, the card recognition program 82, the first card position prediction program 88, and the second card position prediction program 90 may be started in units of several frames or several tens of frames. However, the card may be re-recognized only when the card moves. The method, that is, the processing of the card motion detection program 94 and the card re-recognition program 96 will be described below.

  First, the card motion detection program 94 takes a difference between image data captured at a predetermined timing and image data captured at a timing different from the predetermined timing, and a card that has moved based on the data after the difference. Is to specify.

  That is, for example, the three cards 541 to 543 placed on the desk, the table 52, or the like are, as shown in FIG. 22A, one of the three cards 541 to 543 is left or right by the user's hand. 22B, one card 541 is shifted in one direction as shown in FIG. 22B, or the arrangement of a plurality of cards 542 and 543 placed together as shown in FIG. 22C is changed (arrangement). 23A, for example, one card 541 is replaced with a new card 544, or three cards 541 to 543 placed together are stacked as shown in FIG. 23B. The program detects these movements and identifies the cards that have moved.

  As shown in FIG. 24, the program 94 includes a first memory function 212, a second memory function 214, and a difference calculation function 216 similar to the image motion detection program 92 described above, and a card specifying function. 218 and a repeat function 220.

  The first and second memory functions 212 and 214 and the difference calculation function 216 perform the same processing as the first and second memory functions 188 and 190 and the difference calculation function 192 in the image motion detection program 92 described above. Here, the duplicate description is omitted. The repeat function 220 sequentially repeats the process by the first memory function 212 → the process by the second memory function 214 → the process by the difference calculation function 216 → the process by the card specifying function 218.

  The card specifying function 218 detects the range in which the card (for example, the card 541) is placed in the data after the difference, and detects whether the identification image 561 of the card 541 exists. Here, the identification image 561 of the card 541 includes an identification image (positive image) of a new card 541 that has appeared due to movement, and an identification image (negative image) of the card 541 that has disappeared due to movement. If the identification image 561 of the card 541 exists, the recording range of the image 561 of the card 541 is detected as the screen coordinates on the assumption that the card 541 has moved.

  Specifically, when there is an operation of shifting or shaking one card 541, the screen coordinates of the image 561 of the one card 541 are detected, and two or more cards (for example, cards 541 to 543) are shifted or If there is a shaking motion, the screen coordinates of the identification images 561 to 563 of two or more cards 541 to 543 that have been shifted or shaken are detected. For example, as shown in FIG. 22C, when the card 542 and the card 543 are exchanged, the screen coordinates of the identification images 562 and 563 of the cards 542 and 543 that have been exchanged are detected. For example, as shown in FIG. 23A, when the card 543 is replaced with another card 544, the screen coordinates of the identification images 563 and 564 of the cards 543 and 544 that have been replaced are detected. For example, as shown in FIG. 23B, when three cards 541 to 543 are overlapped, the screen coordinates of the identification image 561 of the top card (for example, the card 541) among the three overlapped cards 541 to 543 are the same. Will be detected.

  In this manner, a card that has moved is identified at the stage where the screen coordinates for the identification image of a certain card are detected. The detected screen coordinates are supplied to a card re-recognition program 96 that is subsequently activated.

  Next, the card re-recognition program 96 will be described. The program 96 is activated when a card that has moved is specified by the card specifying function 218 in the card movement detection program 94, and the identification information is recognized again for the card that has moved. As shown in FIG. 25, the card re-recognition program 96 has a camera coordinate detection function 222, an identification information detection function 224, and a character image search function 226 similar to the card recognition program 82 described above. Since the processing by the card re-recognition program 96 is substantially the same as the above-described card recognition program 82, duplicate description thereof is omitted here.

  Through the processing by the card re-recognition program 96, the character image corresponding to the identification number of the card that has moved is specified. Therefore, when a new card is recognized, the character appearance display program 84 is activated, and a character image corresponding to the identification number of the new card appears on the new card image. If the position of the card is shifted or the position of the card is changed, the character action display program 86 is activated to display an image of the character corresponding to the identification number of the card on the moved card image. At the same time, operations such as “attack”, “make magic”, “defend”, and “crawl” are performed according to how the card is moved.

  When a plurality of cards are stacked, a character image corresponding to the identification number or the like of the card at the top may appear. Alternatively, by storing the identification numbers of two or more stacked cards, new characters corresponding to the combination of these two or more identification numbers, for example, two or more characters corresponding to the stacked cards can be combined. Alternatively, an image of a huge character may appear. For example, a record corresponding to a combination of two or more pieces of identification information is searched from a combination information table (not shown), and character image data corresponding to the combination is read from the head address of the image data registered in the searched record. Etc. may be performed.

  In addition, as shown in FIG. 26, when two transparent cards 547 and 548 are overlapped, a new identification image in which the identification image 567 of the transparent card 547 and the identification image 568 of the transparent card 548 are combined. 569 is formed. Therefore, this new identification image 569 is recognized by the card recognition program 82, and then, for example, the character appearance display program 84 is started so that the new identification image 569 is displayed on the screen of the monitor 30. A display in which an image of a new character corresponding to the identification number specified in the image 569 appears is performed.

  Next, the character change program 98 will be described. The program 98 changes the character image to an image corresponding to the level when the character level is raised, and has a level-up function 228 as shown in FIG.

  This program 98 is activated each time the various application programs 80 described above perform writing to the object information table 118, particularly writing to experience values. The level-up function 228 determines whether or not the experience value stored in the record exceeds a certain numerical value for the record in which the experience value is written, and if it exceeds, the record is stored in the record. Update the current level by +1.

  As described above, the card recognition program 82 and the card re-recognition program 96 search for image data corresponding to the card identification number and level, and the character appearance display program 84 and the character action display program 86 Since the motion data string corresponding to the identification number and the level is searched, the character image corresponding to the card identification number and the level is superimposed and displayed on the card identification image.

  Therefore, for example, as shown in FIG. 28, when there are three identification numbers (first to third identification numbers 601 to 603), at level 1, images 711 of the same character (first character) are respectively displayed. Even at level 2, the first identification number 601 is the image 712 of the second character, the second and third identification numbers 602 and 603 are the same third character image 713, and at level 3, , Images 714 to 716 of different characters (fourth to sixth characters) can be obtained.

  Of course, for example, for one identification number, the same character image can be obtained from level 1 to level 2, or when the level 1 changes to level 2, the image changes to another character image. The image of the same character can also be used over three. Moreover, it can also be set as the image of the same character over level 1-level 3 about one identification number.

  As a result, it is possible to give the user an image that various evolutions can be made depending on the level even if the same type of card appears with the same character, and the fun of the card game can be further improved.

  Next, the information table reference program 100 will be described. This program 100, as shown in FIG. 29, accesses the memory card 38 and the network server 230 when the object information table 118 and the like are managed by the memory card 38 and the network server 230. And a table access function 232. The network server 230 is connected to the video game system 10 according to the present embodiment through the network 234.

  For example, when the object information table 118 is stored in, for example, the hard disk 44, characters, parameters, etc. corresponding to the cards are different for each user. Therefore, even if the card is transferred, there is little meaning if the contents of the object information table 118 are different.

  Therefore, the information table reference program 100 enables transfer of a card, and if the access destination is the memory card 38, the table access function 232 registers the information of the user to be played and the memory card. The use of the object information table 118 registered in the memory card 38 is limited to only the user registered in the memory card 38. As a result, the card can be transferred between users registered in the memory card 38.

  In addition, when the access destination is the network server 230, the table access function 232 uses the object information table 118 managed by the network server 230 by registering information on the user who competes through the browser with the network server 230. Is allowed. In this case, the object information table 118 managed by the network server 230 is unique information among users registered in the network server 230, and can be common to all registered users. Therefore, the card can be transferred between users registered in the network server 230.

  If the object information table 118 is managed by the network server 230, new character image registration and parameters are set for a record for which “invalid” is set after the elapse of a predetermined period or by version upgrade of the video game. Processing such as setting and resetting to “valid” can be performed. In this case, the addition of a new character in accordance with the production of a new card, the restoration of a dead character, etc. can be smoothly performed along with the advertisement on the homepage, and the card can be used effectively.

  Further, as shown in FIG. 2B, since the two-dimensional pattern of the code portion 60 in the card identification image 56 is configured by arranging a plurality of identification cells 66, the identification cell 66 is made of a black oil-based pen or water-based one. The two-dimensional pattern of the code portion 60 can be freely changed by painting with a pen or erasing the identification cell 66 with a white oil-based pen or a water-based pen. You can enjoy what character images will appear and how they will change as you level up, and you can add even more fun to video games with card games. .

Incidentally, engagement Ru images processing system in the present invention is not limited to the above embodiments without departing from the gist of the present invention, it is should be understood that various configurations.

It is a block diagram which shows the structure of the video game system which concerns on this Embodiment. FIG. 2A is a plan view showing the front surface of the card, and FIG. 2B is a rear view showing the back surface of the card. 3A and 3B are explanatory diagrams showing an example of a usage pattern of the video game system according to the present embodiment. 4A and 4B are explanatory diagrams showing another example of usage of the video game system according to the present embodiment. It is a block diagram which shows the application program performed with the video game system which concerns on this Embodiment. It is a block diagram which shows the function of a card recognition program. It is explanatory drawing which shows the process until it detects the identification number of a card | curd from the identification image of the imaged card | curd. It is explanatory drawing which shows the process of calculating | requiring the camera coordinate of a captured image from the captured captured image. It is explanatory drawing which shows the breakdown of an object information table. It is a block diagram which shows the function of a character appearance display program. It is a block diagram which shows the function of a character action display program. 12A and 12B are diagrams showing an example of a usage pattern for explaining the function of the first card position prediction program. 13A and 13B are explanatory diagrams showing a process of obtaining a detection area from one card placed on a desk or table. It is a block diagram which shows the function of a 1st card position prediction program. It is a flowchart which shows the process of a 1st card position prediction program. It is a block diagram which shows the function of a 2nd card position prediction program. 17A and 17B are explanatory diagrams showing a process of obtaining a rectangular area from two cards placed on a diagonal line. It is a flowchart which shows the process of a 2nd card position prediction program. It is a block diagram which shows the function of an image motion detection program. FIG. 20A and FIG. 20B are explanatory diagrams showing a state in which a state when the user holds the card in his / her hand and a character image is displayed on the monitor together with the captured video. It is explanatory drawing which shows the process in which an image with a motion is detected based on the difference calculation of captured image data. 22A is an explanatory view showing a state where one card is shaken, FIG. 22B is an explanatory view showing a state where one card is shifted, and FIG. 22C is an explanatory view showing a state where the arrangement of two cards is exchanged. is there. FIG. 23A is an explanatory view showing a state where one card is exchanged for a new card, and FIG. 23B is an explanatory view showing a state where three cards are stacked. It is a block diagram which shows the function of a card motion detection program. It is a block diagram which shows the function of a card re-recognition program. It is explanatory drawing which shows the example which superimposes a transparent card | curd and synthesize | combines two 2D codes. It is a block diagram which shows the function of a character change program. It is explanatory drawing which shows the example from which the image of a character changes according to an identification number and a level. It is a block diagram which shows the function of an information table reference program.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Video game system 12 ... Video game machine 16 ... CPU 18 ... Main memory 20 ... Image memory 24 ... 1st difference memory 26 ... 2nd difference memory 30 ... Monitor 32 ... Optical disk 38 ... Memory card 42 ... CCD Camera 44 ... Hard disk 54, 541-548 ... Card 56, 561-569 ... Identification image 58 ... Logo part 60 ... Code part 62 ... Reference cell 64 ... Corner cell 66 ... Identification cell 82 ... Card recognition program 84 ... Character appearance display program 86 ... Character motion display program 88 ... First card position prediction program 90 ... Second card position prediction program 92 ... Image motion detection program 94 ... Card motion detection program 96 ... Card re-recognition program 98 ... Character change program 100 ... Information table Irradiation program 230 ... network server 701～706,711～716 ... image of the character

Claims (3)

A computer,
An image processing system connected to the computer and having imaging means for imaging a plurality of cards each having an identification image attached thereto;
First detection means for detecting image data of an identification image attached to a first card from image data of a captured image from the imaging means;
First identification information detection means for detecting identification information of the first card from image data of the identification image detected by the first detection means;
Coordinate system conversion means for obtaining a camera coordinate system of the entire captured image from the position of the image data of the identification image detected by the first detection means;
An arrangement position predicting means for predicting an arrangement position of image data of another card based on camera coordinates of image data of the first card;
Second detection means for detecting image data of an identification image affixed to the other card from image data at the predicted arrangement position;
An image processing system comprising: second identification information detection means for detecting identification information of the other card from image data of the identification image detected by the second detection means. The image processing system according to claim 1,
The first identification information detecting means includes
Affine transforming the image data of the identification image of the first card detected by the first detection means to detect the identification information of the first card;
The second identification information detecting means is
An image processing system for detecting the identification information of the other card by performing affine transformation on the image data of the identification image of the other card detected by the second detection means. The image processing system according to claim 1 or 2,
An area formed by the arrangement of a plurality of cards arranged in the horizontal direction by two users respectively presents a rectangular area as a whole,
The arrangement position predicting means includes:
Among the captured images, it detects the position of the image data of the two cards arranged on a diagonal of the rectangular region, drawing the position of the image data of said detected two cards of the rectangular area including the diagonal Identify the range ,
The second identification information detecting means is
An image processing system, wherein identification information of remaining cards is detected from image data in the specified drawing range .

Images