JP2012080950A - Game device and game system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a game device that reflects information on photographs, animation, music, texts, etc., transmitted from a player by use of a portable communication terminal or an information terminal, on a display in accordance with the contents, and allows the player to directly operate the display with a plurality of special devices or indirectly operate it using the portable communication terminal or the information terminal.SOLUTION: A projector 105 is installed on a ceiling 123 in front of a screen 201 by means of a support frame 115, and a camera 4 is installed above the screen 201. Infrared cameras 109a, 109b are disposed in the upper corners of the screen 201 to face a direction for covering the area of the screen 201, and an infrared irradiation part is disposed in a part of the front face of the mirror frame of the lens. Thus, an image or a text prepared in advance can be displayed on the screen, or music prepared in advance can be played as BGM. By selecting a desired background picture, patterns and letters for example can be drawn on the background picture.

Description

  The present invention transmits data such as video, music, images, and text to a game device, selects the data transmitted at the start of the game and displays it on the screen, and can display graffiti, and without displaying the transmitted data on the screen A game device capable of selecting a background image set by a game and displaying it on a screen to draw a picture, text, etc., and operating a transmitted data or a graffiti picture by a player's operation The present invention relates to a game system capable of sending a picture drawn on each game device to an opponent game device for display.

The present applicant has proposed a graffiti system in which a user writes a picture of a character or the like on a screen using a pen-type controller or a hand, and the drawn picture moves around in a background picture displayed on the screen. (Japanese Patent Application No. 2010-114696).
This allows the user to freely write and create his / her favorite character or picture on a 3D display or the like, and the creation starts to move freely, so that an unprecedented taste can be obtained.

There is a demand for the realization of an apparatus that can be freely manipulated and interactively manipulated on the screen while watching the situation on the screen from the user side while freely writing images on the screen from such a background or sending images from other devices. .
Patent Document 1 is a system in which a user uses a home game machine or a TV remote controller, sees information displayed on a TV monitor, operates the remote controller, transmits the result, and reflects the result on the monitor.

JP 2008-113659 A

In the above-mentioned Patent Document 1, information is unilaterally displayed on a display, a remote controller or the like is operated on the information, content selected by a selective expression from certain restricted information is transmitted, and the result is displayed on the display. Although interactive only by checking, the user operates in a passive state.
This device is not intended to be freely operated by the user operating on the display the pictures, images, sounds, etc. that the user has written or sent from other devices.

An object of the present invention is to meet the above-described demand. When a user (player) uses a mobile communication terminal or an information terminal (PC terminal, PDA, etc.) and transmits a photograph, a video, music, text, etc., it is displayed on the display. It is an object of the present invention to provide a game device in which the information is reflected in accordance with the content, and the display can be directly operated by a plurality of special devices, or indirectly operated using a mobile communication terminal or an information terminal.
Another object of the present invention is to provide a game system capable of playing a graffiti game in which pictures or the like drawn by a plurality of the game devices are also displayed on display devices of other game devices.

In order to achieve the above object, claim 1 according to the present invention provides a game device body, a display device composed of a screen or a display, and touches the display device to write a symbol or a character or display it on the display device. In order to select an area, the game apparatus main body includes a device including an infrared reflector at a contact portion, and a portable communication terminal or an information terminal having a transmission function for transmitting data including images, music, or text. Data acquisition control means for receiving and acquiring data including images, music or text from a mobile communication terminal or information terminal, two or more infrared cameras provided on the side of the display device, and a display device for the device When there is contact with the surface, the infrared camera analyzes by obtaining an infrared image including reflection by the infrared reflector, Recognizing the contact position of the device, and recognizing the symbol and the character drawn when tracing the display device, and displaying the symbol and the character obtained by recognizing the symbol or the like on the display device, Further, among images, music or text which is data acquired by the data acquisition control means, the image or text is displayed on the display device, or data display / playback means for playing music, and game display on the display device. A background image selection control means for allowing the player to select a background image to be displayed, and the mobile communication terminal receives the image, music or text data from the mobile line; A transmission unit that transmits the image, music, or text data that has been performed to the game apparatus main body wirelessly or in a wired manner, the game apparatus main body being a player When the data acquisition control means acquires image, music or text data from the portable communication terminal or information terminal and the background picture selection control means selects the background picture, the background picture and the image or text are selected. Display or operate to play the music by displaying the background image, and when a pattern or a character is drawn on the display device by the device, it is displayed on the screen. Alternatively, control means for controlling the characters or the image or text so as to move on the screen is provided.
According to the second aspect of the present invention, a game device main body, a display device composed of a screen or a display, and a symbol or a character are written in contact with the display device, or an area displayed on the display device is selected. And a device having a reflector at the contact portion, and a portable communication terminal or information terminal having a transmission function for transmitting data including image, music or text, wherein the game apparatus body is from the portable communication terminal or the information terminal. Data acquisition control means for receiving and acquiring data including image, music, and text, two or more color cameras provided on the side of the display device, and when the device touches the display device surface The color camera obtains an image including reflection by the reflector and analyzes it to recognize the contact position of the device and trace the display device. Recognizing means for recognizing a symbol or character drawn on occasion, and an image which is a data acquired by the data acquisition control means, displaying the symbol or character obtained by recognizing by the recognizing means or the like on a display device , Of music or text, an image or text is displayed on the display device, or data display / playback means for playing music, and a background image for the player to select a background image to be displayed on the display device in game play The mobile communication terminal includes a receiving unit that receives image, music, or text data from a mobile line; and the image, music, or text data received by the receiving unit wirelessly or by wire. A transmission unit for transmitting to the game apparatus body, wherein the game apparatus body is configured such that a player uses the data acquisition control means to control the portable communication terminal or the information. When image, music or text data is obtained from the terminal and a background image is selected by the background image selection control means, the background image and the image or text are displayed, or the background image is displayed. It operates to play the music, and when a design or character is drawn on the display device by the device, it is displayed on the screen, and the drawn design or character or the image or text is displayed on the screen. Control means for controlling to move or move on the spot is provided.
According to a third aspect of the present invention, in the first or second aspect of the invention, the portable communication terminal has a camera that captures an image, and transmits the image captured by the camera to the game apparatus body wirelessly or by wire. It is characterized by.
According to a fourth aspect of the present invention, in the first, second, or third aspect of the invention, the control means according to the first or second aspect is characterized in that the player draws a graphic or character drawn on the display device by the device or an acquired image. Or it has the function to move a design, a character, an image, or a text by contacting the text with the device.
According to a fifth aspect of the present invention, in the first, second, third, or fourth aspect of the present invention, there is provided a means for setting to perform a display other than the campus in which symbols and characters can be written on a part of the display device. The control means according to claim 1 or 2, wherein when the display other than the campus is set, an image, a pattern or a text for displaying an advertisement or news is displayed on a part of the screen of the display device. A loop display is performed, and when the player touches or drags the image, symbol, or text with the device, the image, symbol, or text is moved to the campus portion of the screen of the display device.
According to a sixth aspect of the present invention, in the first, second, third, fourth, or fifth aspect of the present invention, a camera is provided on an upper part of the display device, and an image captured by the camera is displayed on the display device. It is characterized by.
According to claim 7 of the present invention, when the player draws a symbol or character on the display device with the device in the invention of claim 1, 2, 3, 4, 5 or 6, the symbol drawn after a predetermined time disappears. It has a function.
According to an eighth aspect of the present invention, the information terminal according to the first, second, third, fourth, sixth, or seventh aspect includes a PDA or a personal computer terminal, and images, music, or text are received from the PDA or the personal computer terminal. The data including the data is sent to the game apparatus main body, and the data acquisition control means acquires the transmitted data.
According to a ninth aspect of the present invention, in the invention according to any one of the first to eighth aspects, the device is used for a part of an image, music or text sent from the mobile communication terminal or personal computer terminal to the game apparatus body. It is characterized by having an editing function that changes the shape or function of a part of the touched image, music, or text.
According to a tenth aspect of the present invention, in the invention according to any one of the first to ninth aspects, the mobile communication terminal is a mobile phone having an infrared transmission / reception function, the infrared camera is composed of two units, and the screen Each of the devices is a touch pen provided with an infrared reflector at the pen tip.
According to an eleventh aspect of the present invention, in the invention according to any one of the first to tenth aspects, the mobile communication terminal is a mobile phone having an infrared transmission / reception function, the color camera includes two units, and the screen Each of the devices is a touch pen provided with a reflector at the pen tip.
According to a twelfth aspect of the present invention, in the invention according to any one of the first to eleventh aspects, when the device has two or more and two or more devices simultaneously contact the display device and draw a pattern or a character, Two or more symbols and characters are recognized, and the recognized symbols and characters are respectively displayed on a display device.
According to a thirteenth aspect of the present invention, in the invention according to any one of the first to twelfth aspects, the server apparatus is provided, and data including images, music, or text is transmitted from the portable communication terminal or the information terminal to the server apparatus in advance. In addition, the image, music, or text stored in the database of the server device is transmitted in response to a transmission request from the game device main body.
A game system according to a fourteenth aspect of the present invention includes the two game apparatuses according to the thirteenth aspect, displays a background image selected on each game apparatus side on a display apparatus of each game apparatus, and each game apparatus The display device of this game device transmits the symbols and characters drawn by the device to the display device of another game device, and displays them on the display device of the transmitted game device.

  According to the above configuration, it is possible to transmit and display a moving image, an image, a sentence, or the like created by the user (player), and to operate a display object including the content transmitted by the user directly on the display. Moreover, since a graffiti can be made by touching the screen with a touch pen, anyone can easily participate and a large number of people can participate.

It is the schematic for demonstrating the external appearance of the game device by this invention. It is a figure for demonstrating the system containing the game device by this invention. It is a block diagram which shows embodiment of the circuit of the game device by this invention. It is a block diagram which shows the detail of the circuit of a mobile telephone. It is a block diagram which shows the detail of the circuit of a personal computer terminal. It is a block diagram which shows the detail of the circuit of a game server apparatus. It is a figure for demonstrating arrangement | positioning of the infrared camera, imaging | photography camera, and projector which are equipped around a screen, and is a side view which shows the state in which the player is scrambling with a touch pen. It is a front view for demonstrating arrangement | positioning of the infrared camera, imaging | photography camera, and projector with which a screen periphery is equipped. It is a flowchart which shows the flow of operation and a process when an administrator changes initial setting. It is a flowchart which shows the operation | movement of data transmission from a mobile telephone to a game server apparatus, and the flow of a process. It is a flowchart which shows the operation | movement of data transmission from a PC terminal to a game server apparatus, and the flow of a process. It is a flowchart which shows the process with respect to the game operation of the player in the game device by this invention. It is a flowchart which shows the flow which a game device acquires transmission data and selects the acquired transmission data. It is a flowchart which shows the flow which selects a communication mode and a background image. It is a flowchart for demonstrating the flow of a game when each acquired transmission data (music, a text, an image) is reproduced | regenerated when a white campus is selected as a background image. It is a flowchart for demonstrating the flow of a game when reproducing each transmission data (music, text, image) acquired when the sea is selected as a background image. It is a flowchart for demonstrating the flow of a game when reproducing each transmission data (music, text, image) acquired when fireworks launch is selected as a background image. It is a flowchart for demonstrating the flow of a game when each transmitted data (music, text, image) is reproduced | regenerated when disco is selected as a background image. It is a flowchart for demonstrating the flow of a game when reproducing each transmission data (music, text, image) acquired when the local picked-up image is selected as a background image. It is a flowchart for demonstrating the flow of a game when reproducing each transmission data (music, text, image) acquired when a monster is selected as a background image. It is a flowchart for demonstrating the flow of a game when each transmission data (music, text, image) acquired is reproduced | regenerated when a time trial is selected as a background image. It is a figure which shows an example of the setting item of the screen in test mode. It is a figure which shows an example of an attract demonstration display. It is a figure which shows an example of the screen which selects whether data transmission is performed or not. It is a figure which shows an example of the screen which selects a coin addition. It is a figure which shows an example of the screen which selects the image etc. which were read from the list. It is a figure which shows an example of the screen which selects the kind of data. It is a figure which shows an example of the screen which confirms an image. It is a figure which shows an example of the screen which selects communication mode or offline. It is a figure which shows an example of the screen which selects an opponent. It is a figure which shows an example of the screen which selects a background image. It is a figure which shows the example by which the bar for arrangement is displayed on the upper part of the screen. It is a figure which shows an example of the screen where the telop is flowing on the upper part of the screen. It is a figure which shows an example of the image transmitted from the portable communication terminal. It is a figure which shows the example in which the image is displayed on the frame of the upper part of a screen, and a part of image has fallen. It is a figure which shows the state in which the player is drawing the fish and the heart. It is a figure which shows an example of the screen on which the drawn fish and the heart are moving. It is a figure which shows an example of the screen where the fish drawn on the background of the sea is swimming. It is a figure which shows the state in which the player is drawing a picture against the night sky and a launch pad. It is a figure which shows an example of the screen where the drawn picture was sucked into the launch stand and the fireworks were launched. It is a figure which shows an example of the screen which the person drawn on the standing base is dancing. It is a figure which shows the state which image | photographs the gallery gathered in front of the screen. It is a figure which shows an example of the screen which image | photographed the gallery gathered in front of the screen. It is a figure which shows the state in which the player is writing the symbol in the gallery of the image | photographed screen. It is a figure which shows an example of the screen on which the bullet of a cannon is displayed on the background of a monster. It is a figure which shows the state which what the player drew on the screen hits a monster. It is a figure which shows an example of the screen where the drawn heart shape has begun to disappear.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a schematic view for explaining the appearance of a game device according to the present invention.
A projector 105 is installed on a ceiling 123 in front of the screen 201 with a support frame 115. The projector 105 is an ultra-short focus projector 105 that projects an image on the screen 201 with an ultra-wide angle. In addition, the camera 4 is installed on the support frame 116 at the top of the screen 201. This is because a gallery or the like (not shown) is photographed, and the photographed image is projected onto the screen 201 by the ultra-short focus projector 105. Infrared cameras 109 a and 109 b are provided at the upper corners of the screen 201 in a direction covering the range of the screen 201. An infrared irradiation unit is provided on a part of the front surface of the lens frame of the lenses of the infrared cameras 109a and 109b so as to irradiate infrared rays on the staline.

The player 10 can display images and text created in advance on the screen, and can play music created in advance as BGM. In addition, it is possible to select a favorite background image and draw a pattern (including a picture, a symbol, etc.) or a character on the background image. It can also be drawn as a background with a white campus. The drawn object moves on the screen or falls. Furthermore, a telop such as an advertisement set in advance by the administrator can be sent in a special frame displayed on the screen.
FIG. 1 shows a state where a heart mark 141 and a sunday illustration 142 are drawn on the screen 201 by the player 10. After drawing, they move or are drawn into special positions displayed on the screen.

FIG. 2 is a diagram for explaining a system including a game apparatus according to the present invention.
In this embodiment, the parts constituting the game apparatus 11 include a game apparatus main body 1, a display device such as a screen 2, a device such as a touch pen 3, a mobile communication terminal 5 such as a mobile phone, and a camera 4. Data input by operating a device 3 such as a touch pen, image data taken by the camera 4, and data such as images, music, and text transmitted by infrared transmission by a portable communication terminal (hereinafter referred to as "transmission data") Is sent to the game apparatus main body 1 via a wireless, wired or network line.

Transmission data can also be sent from the information terminal 6 to the game apparatus body 1 via a wired or network line. Here, the mobile communication terminal includes a mobile phone, a PHS, a mobile terminal having a telephone function, a mobile terminal having a telephone function capable of transmitting / receiving data to / from a site through a mobile phone line, and the like. Information terminals include netbooks, notebooks and stationary PC terminals, PDAs, portable terminals that do not have a telephone function but can reproduce data with a wireless LAN function.
The game apparatus body 1 can access the game server apparatus 7 to exchange data. The transmission data of the mobile communication terminal 5 and the information terminal 6 can be sent to the game server device 7 and can also be sent to the game device main body 1 via the game server device 7. Instead of the game opportunity place where the game apparatus 11 is installed, transmission data to be a part of the display of the display device 2 is sent to the game server apparatus 7 in advance at home or elsewhere, and the game apparatus 11 is installed. The transmitted data can be received from the game server device 7 at a game center or the like and displayed on the display device as a background or the like.
Further, when a game is played jointly between the game devices 11 installed at two game venues, the game server device 7 is used to send transmission data to the opponent game device 11.

FIG. 3 is a block diagram showing an embodiment of the circuit of the game device according to the present invention.
The game device includes CPU 101, ROM 102, RAM 103, image processing unit 104, projector 105, infrared camera control unit 108, two infrared cameras 109a and 109b, infrared light 107, camera control unit 114, camera 4, infrared receiver 110, operation Unit 111, coin insertion unit 119, coin-related device 120, backup memory 121, input / output control unit 112, communication unit 113, audio processing circuit 118, and speaker 122.
The operation unit 111 includes switches such as buttons, and operation information of the operation unit 111 is sent to the CPU 101 via the input / output control unit 112. When the administrator of the game machine performs initial setting of the game machine, an initial setting test switch included in the operation unit 111 is used.

When a coin is inserted from the coin insertion unit 119, the coin is detected, and the information is transmitted to the CPU 101 via the coin related device 120 and the input / output control unit 112. Setting values such as the number of coins inserted, that is, the number of coins and the number of plays are stored in the backup memory 121. When the administrator sets the coin insertion at the start of the game in the initial setting of the game machine, the game starts when the player inserts a coin into the coin insertion unit 119.
In the ROM 102, a control program for controlling the entire game device, a data acquisition control program for controlling transmission data transmitted from a mobile phone, etc., a background image selection for performing control for selecting a communication mode and a background image, etc. Data display / reproduction for displaying / reproducing the control program, the symbols (pictures, symbols, etc.) drawn on the screen, the symbols recognition program for processing to recognize characters, etc., and the transmitted data to be transmitted Programs, software for executing each game (white campus, sea background, fireworks launch background, disco background, local background, monster background, software executed by time trial background selection) and games The necessary data is stored.
The CPU 101 implements the function of the game control unit 101 a by reading the control program in the ROM 102. The game control unit 101a controls the entire game device. For example, a standby screen (demonstration display) is displayed on the screen 201 in a game standby state, and standby music or the like is output from the speaker 122 via the audio processing circuit 118. In addition, the administrator performs control for initial setting of the game device.

The data acquisition control unit 101b stores the transmission data sent from the mobile phone or the PC terminal to the game server device when there is transmission data sent from a mobile phone or a portable type PC terminal at the location where the player is currently located. If so, control is performed so that the transmission data is sent to the game device and the player is allowed to select the transmission data to be sent.
The background image selection control unit 101c performs control for allowing the player to select whether or not to play a game jointly with the opponent game device in the communication mode, and to select a background image.
The symbol recognition unit 101d obtains the position (coordinates) on the screen by analyzing the infrared image obtained from the infrared camera when the symbol or character is drawn on the screen with the touch pen, and the symbol or character to be drawn is obtained. Perform recognition control. It is also possible to determine the color of the touch pen drawn by displaying a color palette on the screen 201 and causing the player to select it.
The data display / playback unit 101e displays a symbol or character obtained by recognition by the symbol recognition unit 101d on a screen, and further displays or reproduces an image, music, or text as received transmission data on the screen. Take control. It also controls the display of the selected background image.
The game execution unit 101f activates each piece of software corresponding to the selected background image and executes a play for the player's operation. When the player performs a touch operation on a pattern or the like drawn with a touch pen, control is performed to move the pattern or convert to another display according to the operation.

The image processing unit 104 processes image data sent in accordance with an instruction from the CPU 101 and causes the projector 105 to project, for example, a drawing image. The drawing image projected by the projector 105 is displayed on the screen 201.
The CPU 101 draws his / her favorite picture on the screen using the touch pen 301 on the standby screen, and displays that the drawn picture can be operated. In addition, music for standby is played from the speaker 122, and a voice indicating that a picture can be drawn by the touch pen 301 is played.
The infrared camera control unit 108 controls the two infrared cameras 109a and 109b, and each infrared camera captures an image so as to cover the entire screen 201 from the upper corner of the screen 201. The infrared light 107 is controlled by the infrared camera control unit 108 and irradiates the screen 201 in synchronization with the operation of the infrared cameras 109a and 109b. For example, the infrared light 107 is provided integrally with a lens frame of the lenses of the infrared cameras 109a and 109b to cover the entire imaging direction. The infrared light 107 can be installed on the frame of the screen 201 independently of the infrared cameras 109a and 109b.

The camera control unit 114 controls the camera 4, and the camera 4 captures the front of the screen by the user's operation, and the gallery gathered in front of the screen is displayed on the screen 201.
The infrared receiver 110 receives an infrared signal (a signal modulated with image, music, and text transmission data) transmitted from a mobile phone that is the mobile communication terminal 5, and the infrared signal is transmitted to the CPU 101 via the input / output control unit 112. To be demodulated. The demodulated image, music, and text transmission data is stored in the RAM 103 and projected on the entire screen 201 or a part thereof.
The communication unit 113 is connected to the Internet line and can receive transmission data from the game server device 7.

[Configuration of mobile phone used as mobile communication terminal]
FIG. 4 is a block diagram showing details of the circuit of the mobile phone used in the present invention.
The mobile phone 50 includes a memory unit 502, a key input unit 503, a communication unit 504, an image processing unit 506, a liquid crystal display unit 507, a control unit 501, a camera 509, a camera control unit 510, an infrared transmission / reception unit 511, an infrared transmission / reception control unit 512, and the like. A ROM 513 and a telephone function unit 508 are included.
The control unit 501 is a functional unit that allows the CPU to read and implement a telephone function processing program, a data communication processing program, an Internet access processing program, an image display processing program, and the like stored in the ROM 513. The ROM 513 stores application software such as a game program, an image acquisition program that takes in an image from a camera, and an infrared transmission / reception program that transmits transmission data such as images, music, and text by the infrared transmission / reception unit 511.

The telephone function is processed by the telephone function processing program, the data transmission / reception process is performed by the data communication processing program, the website access process is registered by the Internet access processing program, the image display process is performed by the image display processing program, and the image acquisition program is performed. The process of capturing and acquiring an image with the camera is performed by the infrared transmission / reception program 511 to transmit / receive transmission data such as an image, sound, and text by the infrared transmission / reception program.
The user ID registration access unit 501a is activated by the Internet access process.

  When the user operates the key input unit 503 to activate the camera 509, an image acquisition program starts up and displays an image captured by the camera 509 on the liquid crystal display unit 507. When the user operates the key input unit 503 to capture an image, the captured image is stored in the memory unit 502. In addition, a media card such as an SD card storing already processed images, music, text, etc. can be loaded into the slot portion (not shown) of the mobile phone 50 and taken into the memory portion 502. Images, music, text, and the like can be taken into the memory unit 502 from a specific site through a mobile phone line. In this way, the user can prepare transmission data to be transmitted to the game apparatus body 1 and displayed.

  When the infrared transmission / reception program is started by operating the key input unit 503 to transmit transmission data prepared for the infrared receiver 110 of the game apparatus main body 1, images, music, and text to be transmitted to the liquid crystal display unit 507 are selected. A screen to do so is displayed. When an image desired to be transmitted is selected, the screen of the liquid crystal display unit 507 is changed to a screen that can be transmitted. When the user performs a transmission operation with the infrared transmission / reception unit 511 directed toward the infrared receiver 110 of the game apparatus body 1, the transmission is executed.

Further, the case where the transmission data is transmitted to the game server device 7 and transmitted to the game device main body 1 via the game server device 7 is as follows.
Since the user accesses the game server device 7 and transmits an image or the like, when a predetermined operation is performed by the key input unit 503, a screen for inputting an ID and a password for identifying the user is displayed. When the user inputs the ID and password, a screen for selecting an image to be transmitted and a screen for inputting address information for specifying the game apparatus main body 1 to be transmitted are displayed. When transmission data such as an image and address information are input and operated in accordance with instructions on the screen, the transmission data and address information are sent to the game server device 7 and stored in the database 702 (FIG. 6) of the game server device 7.
When the game server body 1 is accessed from the game apparatus body 1, transmission data such as images, music, and text corresponding to the address information of the accessed game apparatus body 1 is stored in the transmission data storage area 702 a of the database 702. If so, the game server device distributes stored images and the like.

[Configuration of personal computer terminal used as information terminal]
FIG. 5 is a block diagram showing an embodiment of a circuit of a personal computer terminal used in the game device according to the present invention.
The personal computer terminal 60 includes a LAN input / output interface unit 610, a peripheral device control unit 606, a bus, a CPU 601, a RAM 602, a graphic circuit 604, and an HDD 603. The LAN input / output interface unit 610 has a router 611 connected to a telephone line via an ADSL modem 612 and is connected to an Internet line.
A speaker 609, a keyboard 607, and a mouse 608 are connected to the peripheral device control unit 606.

The personal computer terminal 60 is activated by the user, and when the CPU 601 reads the OS, the OS is activated and an initial screen is displayed on the display 605 via the graphic circuit 604. The user can create an image he / she desires by starting up image creation software and operating the keyboard 607 and mouse 608. The created image is temporarily stored in the RAM 602, and is stored in the HDD 603 when it is stored. When editing music or the like, a music editing software is started, and a desired song can be created in the same manner. In addition, text and other text can be created using text creation software. Furthermore, it can store in HDD603 by reading the image imaged with the camera which is not shown in figure. In addition, transmission data such as images, music, and text can be acquired via the Internet line.
These transmission data can be transmitted to the game apparatus main body 1 via the game server device 7, and the personal computer terminal 60 can communicate directly with the game apparatus main body 1 (for example, wireless LAN function installed, the game apparatus side is also wireless in the same manner). If the LAN function is installed, transmission data can be sent to the game apparatus body 1 using this function.

  When the user sends transmission data to the game apparatus main body 1, the personal computer terminal 60 accesses the server apparatus 7 to register an ID and password for identifying the user. When sending transmission data prepared as described above, the user accesses the game server device 7 using an ID and a password, and sends a prepared image or the like to the game server device 7.

[Configuration of game server device]
FIG. 6 is a block diagram showing an embodiment of a circuit of the game server device used in the game device according to the present invention.
The game server device 7 includes a CPU 701, a database 702, a communication unit 704, a ROM 703, and a bus connecting them.
The ROM 703 stores a control program for controlling the game server device, a transmission data registration / delivery processing program, data necessary for executing the control program, and the like. The CPU 701 implements the functions of the transmission data transmission / reception control unit 701a and the transmission data registration / distribution unit 701b by reading the program in the ROM 703.

The transmission data transmission / reception control unit 701a is connected to the Internet line via the communication unit 704, and can communicate with the game apparatus body 1, the personal computer terminal 60, and the mobile phone 50.
The transmission data registration / distribution unit 701b accepts registration of an ID and a password for identifying a player from a mobile phone as the mobile communication terminal 5 and a personal computer terminal as the information terminal 6, and receives images, music, and text corresponding to the registered ID. When the transmission data such as the address information of the game apparatus main body to be distributed is transmitted, the transmission data and the address information are stored in the ID corresponding transmission data storage area 702a of the database 702.

  When the game server body 1 is accessed from the game apparatus body 1, transmission data such as images, sounds, and text corresponding to the address information of the accessed game apparatus body 1 is stored in the transmission data storage area 702 a of the database 702. Then, the game server apparatus 7 transmits the transmission data to the game apparatus main body 1 having the address information associated with the transmission data.

FIG. 7A is a diagram for explaining a method of recognizing the position and locus of the touch pen that has touched the screen with an infrared camera, as viewed from the side. FIG. 7B is a view from the front.
On the screen 201, an image projected from the projector 105 at a super wide angle is displayed. The touch pen 301 held by the player 10 is picked up when it enters the image pickup range of the infrared cameras 109a and 109b, and the picked-up image can be analyzed to recognize the position (coordinates) of the screen 201 that the touch pen 301 touches. As will be described later, a color palette is displayed at the bottom of the screen 201, the color touched by the touch pen 301 is recognized, and the drawn line is displayed in the recognized color.
The touch pen 301 used by the player has an infrared reflector (reflector) 302 attached to the tip thereof.

For example, when the touch pen 301 comes into contact with a position on the screen 201 as shown in FIG. 7B, the infrared cameras 109 a and 109 b capture reflected infrared rays by the infrared reflector 302 of the touch pen 301. The infrared images captured by the infrared cameras 109a and 109b are analyzed, and the contact position (coordinates on the screen) of the touch pen 301 is determined from the respective reflection directions. If the determined coordinate position is, for example, a graffiti that displays a black contact point, an image displaying the contact point is projected on the screen 201 from the projector 105. If the contact point is dragged, a line is drawn on the screen 201 and a picture desired by the user can be drawn.
If the selected area is displayed on the screen, the touched position is selected as the selected area.

Next, how to play this game apparatus will be described.
(1) Drawing a design on the free campus When “Free campus” is selected on the background selection screen, a color palette appears for selecting the color to be drawn on the bottom of the white background screen. For example, when the touch pen 301 is brought into contact with the “blue” palette, the color drawn with the touch pen 301 can be drawn with “blue”.
If there is data transmitted to the game device, for example, if it is text or image, the image is displayed on the campus. If it is music, that music becomes BGM. It can also be drawn on top of the image, and when the drawing is finished, the image starts moving. Music can be edited by changing the length of the rhythm.
(2) Draw a picture with the selected background image (sea, fireworks launch, disco, local, etc.) as the background When you select one of the screens of the sea, fireworks launch, disco, local, time trial as the background image on the selection screen, The player can draw a picture on it. For example, in the case of a background image in the “sea”, a fish picture is drawn, and the drawn fish picture starts to move like a fish.
Also, if you draw a picture with a firework launch background, the picture is drawn to the fireworks launch pad and you can display an image that fires like fireworks. Fireworks are launched with various effects added to the picture. In the background of the disco, the picture you drew starts on a stand. Furthermore, the environment in front of the screen can be photographed with a camera, and the photographed image can be combined with the transmitted image and displayed. In addition, a picture can be drawn on the displayed captured image itself.
(3) Overlaying and displaying the image transmitted by the player using a mobile phone or the like on the background image Projecting a unique image, music, text or other data created by the player on the screen 201 and drawing a picture on the screen 201 be able to. If a simple picture is written in advance on a part of the image, it can be drawn on it with a touch pen, and the part of the image and the drawn part can be synthesized. If you touch the touch pen with the picture drawn on the screen and drag the touch pen, the picture moves according to the direction of operation of the touch pen.

(4) Playing a game with a picture drawn in 3D When selecting “Monster Background” on the selection screen, a monster appears on the screen. A screen that prompts the user to draw a picture is displayed. If, for example, a picture of ○ is drawn according to the instruction, it is displayed in 3D and flies to the monster, and hits the monster. If you draw ○, it will be processed to fly toward the monster, and it will also restore the monster. The degree of blow or recovery will depend on the size and color of the picture being drawn. For example, if you draw a large circle, the damage to the monster will increase. If the color is “blue” and the hit is large, and “yellow” is a small hit, writing a blue circle with a touch pen increases the hit on the monster.
(5) A game for drawing a pattern in cooperation with other game devices A graffiti game is played with other game devices. The image, music, and text that you send are displayed on the screen, the selected background image is displayed on the screen, and the graphic drawn with the touch pen is sent to the other game device to the display device of the other game device. Can be displayed. Symbols drawn with a touch pen on other game devices can also be displayed on the display device of the game device.
(6) Sends text related to advertisements, message boards, etc., input by the administrator at the initial setting, and displays advertisement banners etc. on the screen 201 Advertisement telops flow on part of the display device of the game device. In addition, the displayed advertisement banner is shaken, or when the player touches with a touch pen, it falls on the screen (campus) screen. The campus is a part that can be drawn other than the part that plays advertisements on the screen.

FIG. 8 is a flowchart showing the flow of operations and processes when the administrator changes the initial setting of the game device (test mode).
Predetermined values are set for the charge setting, play time setting, screen setting, and progress setting by default. The setting can be changed by a test switch provided in the game machine body.
A screen for changing the setting is displayed on the screen (or a display unit provided in the vicinity of the test switch) by pressing a specific button of the test switch of the operation unit 111 with respect to the game apparatus 11 that has been turned on. (Step (hereinafter referred to as “S”) 001).
FIG. 14A shows an example of each item whose initial setting can be changed. On the screen, a display 148 of “main menu”, “monitor test”, “switch test”, “lamp test”, “charge setting”, “play time setting”, “screen setting”, and “progress setting” is shown as a test mode.
When “Price Setting” is clicked, the selection screen (S002) for changing the fee setting is changed. Similarly, when “Play Time Setting”, “Screen Setting”, and “Progression Setting” are clicked, the play time setting is changed respectively. A selection screen (S004) is displayed, a selection screen (S006) for changing how to use the screen is selected, and a selection screen (S008) for changing the progress method setting of the play stage is displayed.
In the charge change (S003), m coins (n, m: 0, 1, 2,...) Are input for the game per n times. For example, if “1” is input as the number of coins per game “1”, one game can be performed if the player inserts one coin. If the number of coins is “0”, it is free. If you set the price, the game will start with a demonstration demo display that says “When you insert coins, the game will start”. Such a display is not displayed when there is no charge. In the attract demo display, an area “I will start the game” is displayed.

In the play time setting change (S005), the play time is input. For example, if “5 minutes” is entered, the play time is limited to 5 minutes.
In the screen setting change (S007), a part of the screen can be displayed separately from the graffiti. For example, when characters such as an advertisement, a message board, and a rhythm display are input, the input characters are displayed in a loop (S606 and S614 in FIG. 13A).
The campus display reflects the setting of S414 in FIG. 11 after transmission data is selected.
In addition, if a display other than graffiti is provided on a part of the screen, an image (advertising etc.) is displayed together with the graffiti campus. Move or drop.
“Display all” in the screen setting is reflected when “display the entire screen” is selected in the display position determination process after the transmission data is selected.
In the progress setting change (S009), it is an input whether the player selects the stage himself or proceeds at random. For example, if “at random” is input, the stage becomes the stage of the background image that the game apparatus displays as appropriate. If it is “player itself”, it becomes the stage of the background image selected by the player. For example, in the setting of “player itself”, the player selects background screen selection (white, default, monster, time trial). In “At random”, what the game device selects as appropriate is the background screen.
In addition, by changing the progress setting, “perform sample display / display” can be set.
With this setting, display / performance is performed immediately after selection of data to be transmitted (when a new image / music is added). Samples are not displayed after selecting the default background when selecting the mode.
In addition, by changing the progress setting, you can set the number of stages that can be selected for the background image at a time.
When a plurality of stages are set, the transmitted data (new image / music) is carried over. The same data is displayed on different default backgrounds. For example, a new image (data sent by the player) that was swimming like a fish in the default background “sea” is sucked into the “fireworks” launch board and launched after a certain period of time. If the transmission data is set so that a plurality of stages can be selected once per play, the data cannot be transmitted again unless all of the plurality of stages are completed.

FIG. 9A is a flowchart showing a flow of operations and processes for data transmission from the mobile phone to the game server device.
The operation of sending data (music, text, images) to be executed on the screen to the game server device in advance so as to be sent by the mobile phone is as follows.
The user who becomes a player activates an application for accessing and sending the game server device 7 by operating a key of the mobile phone 50 (S101). The user ID registration access unit 501a displays a screen for inputting the user ID and password on the liquid crystal display unit 507 of the mobile phone 50 (S102). The user can play a game using screens previously captured by the camera 509 of the mobile phone 50, data (music, text, images) obtained via the mobile line or the communication unit 504, and data stored in the attached media. It can be sent as data for display on the screen of the device.

The control unit 501 monitors this input screen (S103), and when the user operates the key input unit 503 to input and transmits his / her ID and password, the control unit 501 is a screen for inputting data to be transmitted. Is displayed (S104). Then, it is monitored whether data is input and transmitted (S105). When the user selects and transmits data to be transmitted, the transmission data transmission / reception control unit 701a of the game server device 7 stores the transmitted data in the database 702 (S106). When the storage in the database 702 is completed, a reception completion signal is returned to the mobile phone 50. The mobile phone 50 monitors whether or not a reception completion signal has been received from the game server device 7 (S107), and when the reception is completed, the transmission operation ends.
Since the data sent to the database 702 is stored in the transmission data storage area 702a with the ID information added, the game device that makes an inquiry as to whether there is data to be sent selects the target data. Can be sent.

FIG. 9B is a flowchart showing the flow of data transmission operation and processing from the PC terminal to the game server device. When transmitting data from a PC terminal, the operation and processing steps are substantially the same as in FIG. 9A, except that the transmitting terminal is a PC terminal.
In the case of the PC terminal 60, the browser is activated to access the game server device 7 on the Internet via the ADSL modem 612. S201 to S207 in FIG. 9B correspond to the operations and processes of S101 to S107 in FIG. 9A.
Data sent from the PC terminal includes images taken by a camera (not shown in FIG. 5) connected to the PC terminal 60, music and images acquired from the Internet, music edited and created by the PC terminal 60, text, and images. Is the target.

FIG. 10 is a flowchart showing processing for a game operation of a player in the game device according to the present invention.
An attract demo standby screen is displayed on the screen 201 of the game apparatus 11, and BGM is flowing from the speaker 122 (S301).
An example of the attract demo is shown in FIG. 14B. A fish 144 is swimming in the center of the screen, and a character display 145 of “Start by touching with a pen!” Is displayed in the lower right. The game apparatus 11 monitors whether or not the start area is touched with the touch pen (S302).
Here, a case where the game start is set by coin insertion will be described. In such a case, instead of “Start by touching with a pen!” On the screen 201, for example, “When you insert a coin, the game starts!” Is displayed. When a coin is inserted, an area for instructing the start is displayed. When the player touches the start area with the touch pen, a selection screen for instructing whether or not to transmit data is displayed on the screen 201, thereby causing the game apparatus 11 to execute an operation and process for data acquisition (S303). ).
FIG. 14C shows an example of a screen for selecting whether or not to transmit data. A selection area 149 of “Yes” or “No?” Regarding data transmission is displayed on the screen. If there is data to be transmitted as a result of the execution of S303, the transmission data from the mobile phone, PDA, or PC terminal is stored in the RAM 103 of the game device and displayed on the screen from the stored transmission data. Transmission data is selected.

Next, a screen as to whether or not to select a mode is displayed (S304). If the mode is not selected, a number of background images such as a white campus, a default sea background, and other monster backgrounds are randomly set and displayed at the start of graffiti play (S307).
When selecting a mode, a screen for selecting a communication mode and a background image is further displayed (S305). Then, on the communication mode selection / background image selection screen, the player selects the monster background of the mini game such as the white campus, the default sea background, etc., and the selected background image is displayed on the screen (S306).
On the screen 201, the selected background image added with the selected transmission data is displayed (composite screen), and the player can play (S308).
During the play, it is monitored whether or not the end notification is made according to the set play time (S309). The play can be continued in a state where the end notification is not made. If the end notification is made, the game ends, but it is then determined whether or not additional coins have been inserted (S310).
FIG. 14D shows an example of a screen when coins are added. The current coin insertion content “Coin 01” 147 is displayed at the lower left of the screen, and the coin insertion content “+20” 146 to be added is displayed at the upper right.
If the player inserts coins according to the above display, the play can be continued. If no coin is inserted, the game ends.
Even when a plurality of background images are selected or when “At random” is set as the initial setting, the graffiti time can be extended by inserting coins. Also, even if the game has progressed for free without inserting coins, the graffiti time can be extended by adding coins.

FIG. 11 is a flowchart showing a flow in which the game device acquires transmission data and selects the acquired transmission data. This figure explains the details of S303 in FIG.
After touching the start area with the touch pen, a selection screen for instructing whether to transmit data (music, text, image) from the mobile phone or the game server device is displayed.
The data acquisition control unit 101b of the game apparatus 11 monitors whether or not the player performs an operation for transmitting data (S401). When the player touches “transmit data” with the touch pen, the data acquisition control unit 101b activates the infrared receiver 110 to receive data from the mobile phone or the information terminal (PDA, PC terminal).

In the transmission from the mobile phone, the player performs an operation of transmitting data to be transmitted to the infrared receiver 110 of the game apparatus 11 from the infrared transmission / reception unit 511 (S403, S404-2). Similarly, in the transmission from the PDA, an operation of transmitting the infrared transmission / reception unit of the PDA to the infrared receiver 110 of the game apparatus 11 is performed (S404, S404-2).
In addition, when the information terminal such as a mobile phone, PDA, or personal computer and the game device are structured to be cable-connected, transmission data can be transmitted by the cable.
On the other hand, when “do not send data” is touched with the touch pen, the data acquisition control unit 101b displays a screen for instructing whether or not to read from the list (S402).
FIG. 14E shows an example of a selection screen from the list. “Sky” 150a, “Sea” 150b, “White” 150c, “Forest” 150d... Are shown. This displays what is stored in the ROM 102 at the time of shipment of the game device (default) and what is previously transmitted from the mobile communication terminal or information terminal (transmission data transmitted to the game server device).
From this screen, one of “default”, “data transmission from the game server device” and “not read from list” can be instructed. “Default” is an image, music, and text provided in the game device as described above. If “default” is indicated, the default image stored in the ROM 102 of the game device 11 is read (S405). If “data transmission from the game server device” is instructed, the data acquisition control unit 101b inquires of the game server device 7 whether there is data (music, text, image) to be transmitted.
FIG. 14F shows an example of the type of data to be selected at that time. One of “send music” 151, “send text” 152, and “send image” 153.
When there is data to be transmitted, the transmission data transmission / reception control unit 701 a of the game server device 7 transmits a list of transmission data stored in the transmission data storage area 702 a of the database 702 to the game device 11. The data acquisition control unit 101b displays the list on the screen 201. The player can use the touch pen to select data that he has sent to the game server device 7 in advance. When the player selects transmission data sent by himself / herself from the transmission data displayed on the screen 201, the transmission data is sent from the game server device 7 to the game device 11 (S406).

If “not read from list” is designated, data is not sent from the other device to the game device 11, and the data acquisition control unit 101b proceeds to the mode selection screen.
The transmission data acquired from the mobile phone, information terminal (PDA, PC terminal), default or game server device is stored in the RAM 103 of the game device 11 (S407). The data acquisition control unit 101b reads the data stored in the RAM 103 and displays a screen for selecting the transmitted transmission data on the screen 201 (S408). The player selects transmission data (S409).
Depending on whether the selected transmission data is music, text, or image, the method of processing instructed by the player differs depending on the screen display in FIG. 13A to FIG.

If music is selected, the selected music is played back in place of BGM (S410), and then a question is displayed as to whether or not a function for changing the tempo, scale, etc. of this BGM is provided (S411). If “YES” is selected, a frame for designating where on the screen the operation part of the arrangement function is displayed appears (S412). When this frame is dragged with a touch pen, an up / down arrow for changing the scale and a display for selecting whether to speed up or slow down the tempo appear. By attaching management data to the music data in this way, the game device (game program) performs arrangement processing and the like according to the management data, and performs sample music performance (S413).
If “NO” is selected in S411, the sample music performance is performed without providing an editing function (S413).
Note that the sample music flows when the music is set to flow when the player input is determined after data transmission as described in the administrator setting. Otherwise, it will not be played until the start of graffiti play.
On the other hand, when an image or text is selected and determined, the display location is selected. It will be specified with a touch pen. The screen is displayed as “display on the whole”, and if “display on the whole” is touched with the touch pen, it is displayed as a background (new background). As for “part”, when a part of the screen is surrounded by the touch pen, it is displayed at the position (new image / object) (S414). If the image or text is set to “sample display” by the administrator, it is displayed when data is determined (S415). However, if the sample is omitted in the administrator's settings, images and text will not be displayed until the graffiti game starts.
FIG. 14G shows an example of a screen for selecting an image. For the displayed image 154, “YES” and “NO” areas 156 for selecting “OK in this image?” Are displayed.

FIG. 12 is a flowchart showing a flow of selecting a communication mode and a background image. This figure is a detailed step of S305 in FIG.
After the sample music performance in S413 in FIG. 11 or the sample display in S415, the game control unit 101a displays a screen for instructing the player whether or not to select a mode on the screen 201 (S304 and S501 in FIG. 10). ).
When the mode is selected, the game control unit 101a passes control to the background image selection control unit 101c. The background image selection control unit 101c displays a screen for selecting whether or not to advance the game in the communication mode (S502).
FIG. 14H shows an example of a selection screen for selecting communication mode or offline.
An area 157 for selecting a communication mode and an area 158 for selecting an offline mode are displayed. When the player touches the communication mode selection with the touch pen, a screen for selecting an opponent is displayed (S503). The opponent is selected in order to display the drawn symbols and characters on the display device of the opponent game device.
FIG. 14I shows an example of a screen for selecting an opponent. In this figure, there are a large number of opponents, and one of a large number of opponents can be selected in accordance with a display 159 of “Select an opponent!”. That is, there is an opponent game device, and it can be selected to play a game together with the game device.
On the other hand, if the communication mode is not selected, the game is played on this game device, and the process proceeds to the same step as S504 to which the process proceeds after selecting the opponent game apparatus, that is, the screen for selecting the background image.

After the player's operation / game device processing as described above, the background image selection control unit 101c displays a screen for selecting a background image on the screen 201. Screen 201 displays a selection screen of “white campus”, “background of sea”, “background for fireworks”, “background of disco”, “local background”, “monster background”, “background of time trial”, either Can be selected (S504).
FIG. 14J shows an example of a screen for selecting a background image. An area 161a for selecting "white", an area 161b for selecting "sea", an area 161c for selecting "fireworks", an area 161d for selecting "monster", and the like are displayed together with an instruction 160 for "Please select!" ing.

The game content of “White Campus” can be a normal graffiti with a touch pen. A color palette is displayed at the bottom of the screen 201. By touching one of the color palettes with a touch pen, graffiti can be made with the touched color.
The game content of “Sea Background” displays a picture of the sea, and if you draw a picture of a fish in it, it will swim like a fish.
As for the game content of “background for fireworks launch”, for example, when a heart-shaped picture is drawn on the screen, the drawn heart is sucked into the launch pad and fireworks are launched. Fireworks have an effective shape as if they were decorated in a heart shape.
As for the game content of “Disco Background”, for example, a picture of a person drawn on a stand stands out. In addition, if there is a picture of a person or a picture of a person sent, the picture or picture is also danced on a stand.

The game content of “local background” is obtained by photographing an environment where people gathered in front of the screen with the camera 4 provided on the game apparatus, and for example, if there is a transmitted image, the image is combined with the image and displayed on the screen.
The game content of “monster background” has a plurality of monsters in the background. For example, when a circle is drawn, the circle hits the monster. The damage to the monster varies depending on the size and color of the drawing. Depending on the shape drawn, the monster will be restored. Also, the sent ones hit the monster. In addition, the drawn objects can be displayed in 3D and hit the monster.
The game content of “Time Trial Background” is that when a picture or line is drawn with a touch pen, the picture gradually disappears from the beginning of drawing when a predetermined time has elapsed from the time of drawing.
In each of the above game contents, a clock and a bomb are displayed to indicate the remaining time limit at the same time as the graffiti starts.

It should be noted that depending on the type of data to be sent, selection can be made to cause each action on the background image.
In the case of music, the music is played as BGM in each background image. When music editing is selected, a bar or the like is displayed on a part of the screen, and the length of the music rhythm can be changed by moving the bar with a touch pen. For example, the rhythm can be increased by increasing the distance that the bar for adjusting the music of the player is moved.
In the case of text, in each background image, the sent text is displayed on a part of the screen, for example. In addition, as text information sent by the administrator, telop display such as advertisement and coupon information is displayed in a partial area of the screen. There is no graffiti on this part. The advertisement is switched at regular intervals, for example.
In the case of an image, a still image and a moving image are included, and these images are combined with a background image or displayed on the background image. The displayed still image and moving image are moved on the background image or transformed into a predetermined shape by the player's touch pen operation, similar to those drawn with graffiti.

FIG. 13A is a flowchart for explaining a game flow when each acquired transmission data (music, text, image) is reproduced when a white campus is selected as a background image. When the selection of the background image is completed, the background image selection control unit 101c passes control to the game execution unit 101f. The following processing is processing by the game execution unit 101f.
When the transmitted and selected data is music The music selected instead of the music being played in the demo is changed as BGM (S601). Next, if “YES” is selected in “Do you have an editing function?” In S411 of FIG. 11, the determination as to whether or not to change the rhythm (S602) is “YES”, and the rhythm length is displayed on the upper part of the screen 201. A bar for adjusting is displayed (S603).
FIG. 14K shows an example in which an arrangement bar is displayed at the top of the screen. A heart 163b and a fish 162b are displayed, and an editing function portion 164 is displayed on the upper right of the screen 201. It has a part to adjust the length of playback, pause, stop and tempo. For example, it is possible to change the rhythm by touching the touch pen with the bar and dragging left and right while listening to the music selected by the player (S604).
On the other hand, when the rhythm is not changed, the music selected as it is becomes BGM.

-If the sent and selected data is text If the default setting of the administrator is to set a display other than graffiti on part of the screen, the text telop entered in the initial setting Flows to the part and is repeatedly displayed as a loop (S605, S606).
FIG. 14L shows a state in which a telop 165 of “Yeah! Advanced to Japan!” Is flowing on the screen.
In the case of campus display, the setting of S414 in FIG. 11 is reflected (S607). It is determined whether or not there is a corresponding picture (S608), and in the case of this text character, data that this picture is displayed is provided in advance, and if applicable, for example, if the text of a dog is sent, A picture of the dog is called and displayed on the campus as a screen (S610, S611). On the other hand, if not applicable, the text is displayed as it is on the campus (S609, S611).
When the transmitted and selected data is an image If the “display all images” is selected in S414 of FIG. 11, the entire display is reflected and displayed on the campus (S612, S611).
FIG. 14M shows an example of an image sent from the mobile communication terminal 169. A dog image 168 is displayed on the screen.
If it is set in the initial setting of the administrator that a display other than graffiti is provided on a part of the screen, a partial display of an image (such as an advertisement) is displayed together with the campus for graffiti and displayed in a loop (S613). , S614). The image in this portion moves or falls to the graffiti campus by touching or dragging with the touch pen (S615, S616). If there is no contact, the display is as it is. The partial display may be a symbol or text.
FIG. 14N shows an example in which an image is displayed in the upper frame of the screen. When the player touches the hamburger 167 in the frame 166 with the touch pen 301, the hamburger falls to the campus.

The game apparatus 11 performs the above-described processing and advances the player to the step of graffiti.
The player draws various symbols on the screen using the touch pen (S617). Since the color palette is displayed at the bottom of the screen, you can draw a picture with the touched color by touching the favorite color. Here, the symbol recognition unit 101d monitors whether a picture is drawn on the screen (S618). When the player starts to draw a symbol on the screen, the symbol recognition unit 101d obtains and analyzes the infrared image of the touch pen with the infrared cameras 109a and 109b, thereby obtaining the locus of the touch pen. The data display reproduction unit 101e projects a picture drawn on the projector according to the locus.

When the player draws a picture and completes the operation, or when the pen that has started drawing is moved away from the screen for a predetermined time, the drawn picture starts to move in various directions (S619). Next, if you draw another picture, that picture will also move. The direction of movement and the behavior of the movement are determined according to a method predetermined by the game device.
During the graffiti game execution, the game execution unit 101f monitors whether or not the set time is over. The player can continue drawing until notified that the set time is over. When it is notified that the set time is over (S620), it is next monitored whether or not a coin is inserted (S621). When the player inserts additional coins, the game time corresponding to the number of coins inserted can be extended. If no coin is inserted, the game ends.
Note that when a white campus is selected as the background image and there is no data that has already been transmitted, the graffiti operation and processing are the same as the operations and processing of S617 to S621. In such a case, an example of an image when the player makes a graffiti is shown in FIG.
In FIG. 14O, a fish 163 and a heart 162 are drawn by the player 10.
FIG. 14P shows a state where the fish 163a and the heart 162a depicted in FIG. 14O are moving.

FIG. 13B is a flowchart for explaining the flow of a game when each acquired transmission data (music, text, image) is reproduced when the sea is selected as the background image.
Steps S701 to S716 are the same as steps S601 to S616 in FIG. The player can grab with the touch pen (S717).
When the player draws a picture (S718), the game execution unit 101f can move the drawn fish picture to swim (S719).
FIG. 14Q shows a state where the fishes 171a and 171b drawn on the sea background 170 are moving.
The subsequent operations and processes in S720 and S721 are the same as those in S620 and S621.

FIG. 13C is a flowchart for explaining the flow of the game when each of the acquired transmission data (music, text, image) is reproduced when fireworks launch is selected as the background image.
Steps S801 to S816 are the same as steps S601 to S616 in FIG. The player can grab with the touch pen (S817).
When the player draws a picture (S818), the game execution unit 101f draws the drawn and displayed object into the launch pad and launches it like fireworks (S819).
FIG. 14R shows an example in which a launch pad 174 is displayed on the background 172 of the night sky as a background image, and the player 10 is drawing a picture 173 that is a source of fireworks.
As shown in FIG. 14S, the picture 173a sucked into the launch board 174 is launched, and the state where the fireworks 175 are open in the night sky is shown.
The subsequent operations and processes in S820 and S821 are the same as those in S620 and S621.

FIG. 13D is a flowchart for explaining the flow of the game when each transmitted data (music, text, image) is reproduced when disco is selected as the background image.
Steps S901 to S916 are the same as steps S601 to S616 in FIG. 13A, and the player can grab with the touch pen (S917).
When the player draws a picture on the stand of the background image of the disco (S918), the game execution unit 101f shows the drawn thing to dance (S919).
In FIG. 14T, a mirror ball 176 is displayed, and a state in which a person 177 drawn by the player is dancing on the stand 178 is shown.
The subsequent operations and processes in S920 and S921 are the same as those in S620 and S621.

FIG. 13E is a flowchart for explaining a game flow when each acquired transmission data (music, text, image) is reproduced when a local captured image is selected as a background image.
The processes from S1001 to S1016 are the same as S601 to S616 in FIG. 13A.
The game execution unit 101f monitors whether or not the player has photographed in front of the screen with the camera 4 (S1018). When the image is shot, the game execution unit 101f combines the image acquired from the camera 4 and the transmission data, and displays the combined image on the screen 201 (S1019).
In this state, the player can grab with the touch pen (S1017). Next, it is monitored whether or not a picture is drawn (S1020). When a picture is drawn, the subsequent operations and processes in steps S1021 and S1022 are the same as those in steps S620 and S621.
FIG. 14U shows an example of a screen when shooting. Galleries 181, 182, and 183 before being photographed by the camera 4 are displayed on the screen 201 as 181 a, 182 a, and 183 a, respectively, and a wording 180 “I will shoot!” Is displayed.
FIG. 14V shows the pose of FIG. 14U taken and displayed on the screen.
FIG. 14W shows a state in which the player 10 writes symbols 184, 185, and 186 in the galleries 181b, 182b, and 183b photographed in this way, respectively.

FIG. 13F is a flowchart for explaining a game flow when each acquired transmission data (music, text, image) is reproduced when a monster is selected as a background image.
S1101 to S1116 are the same processes as S601 to S616 in FIG. 13A.
In this way, the image and text processed and transmitted in S1101 to S1116 and the display screen of the monster selected as the background image are displayed as an initial screen (S1117). FIG. 14X shows an example of a screen when a monster background is selected.
This figure shows a state where a monster 187 is displayed and a cannon bullet 188 is displayed as transmission data.
The player can grab with the touch pen (S1118). The game execution unit 101f monitors whether a picture is drawn (S1119). If a cannon bullet 188 or the like is already displayed as transmission data as shown in FIG. 14X, the cannon bullet 188 hits the monster (S1120).

On the other hand, if the player draws on the screen, the drawn one hits the monster (S1121).
FIG. 14Y shows an example in which what the player draws on the screen hits the monster. In FIG. 14Y, the player 10a draws a star 189, the star 189 is flying toward the monster 187a, and the player 10b is drawing the disk 190.
The game execution unit 101f monitors whether or not the end of the set time has been notified while performing this game process (S1122). If the end of the set time is not notified, the game process is continued. When the end of the set time is notified, it is next monitored whether or not a coin has been inserted (S1123). When the player inserts additional coins, the game time corresponding to the number of coins inserted can be extended. If no coin is inserted, the game ends.

FIG. 13G is a flowchart for explaining the flow of a game when each acquired transmission data (music, text, image) is reproduced when a time trial is selected as a background image.
Steps S1201 to S1216 are the same as steps S601 to S616 in FIG. The player can grab with the touch pen (S1217).
The game execution unit 101f determines whether or not the player has drawn a picture (S1218). When the player starts to draw a picture, the game execution unit 101f performs processing so that the drawn picture gradually disappears from the part where the picture started to draw after a certain period of time has elapsed (S1218). S1219).
FIG. 14Z shows an example in which the drawn picture disappears, and shows a state in which a predetermined time has elapsed while the heart shape 191 is being drawn and has started to disappear from the part where the drawing has started.
The subsequent operations and processes in S1220 and S1221 are the same as those in S1122 and S1123.

  Although the above embodiment has shown an example in which two infrared cameras are provided at the upper and left corners of the screen, two or more infrared cameras may be provided. For example, two infrared cameras may be provided on the left and right corners of the screen, and a total of four infrared cameras may be installed. The number may be 5 units, 6 units, etc. The reason for the increase in the number of cameras is that even when two or more touch pens touching on the screen touch at the same time, each position and locus (symbol) can be easily detected at the same time, and the position and locus can be obtained with high accuracy.

In addition, an infrared image is captured by an infrared camera and analyzed to obtain the position and locus (symbol) of a touch pen that touches the screen. The position and locus (symbol) of the tip of the touch pen on the screen can also be obtained by capturing and analyzing the image. When configured with a color camera in this manner, the captured image can be analyzed by comparing the image projected on the screen with the projector and the image captured with the color camera to obtain its position and locus (symbol). The color to be drawn is changed in advance to the color that the user wants to draw the tip of the touch pen (LED such as black, red, blue, yellow, green, etc.), and the color camera captures the image to recognize the color of the pen tip. The machine can draw the picture drawn on the screen in that color. The color identification is performed by switching and displaying the tip of the touch pen to a color desired by the player, and the color is identified by imaging and analyzing the displayed color.
When using an infrared camera, all of the colors are noise sources, as compared to less disturbance. For this reason, the captured video is converted from the acquired RGB color space to the HSV color space, and a circuit that performs evaluation based on hue, saturation, and brightness is provided so that a specific range is handled as a pen tip. The color is determined as follows: (1) When the brightness is lower than a certain value, it is determined as black. (2) When the saturation is higher than a certain value, it is determined as white. (3) Otherwise, each color is determined if the hue is within the allowable range.
Therefore, when drawing in each color for a game device using an infrared camera, a color palette can be displayed at the bottom of the screen to recognize the color touched by the player and draw in the touched color. Can directly recognize the color of the nib, so there is no need to display a color palette at the bottom of the screen. In addition, since each color can be recognized, when a plurality of touch pens are drawn on the screen at the same time (a plurality of people draw with the touch pens), the touches of the plurality of touch pens can be simultaneously recognized and displayed on the screen.

In this embodiment, a still image is handled as an image, but a moving image including a CG animation calculated in real time can be similarly processed, reproduced, and displayed.
An example of inserting coins and displaying an area portion such as “If you touch the touch pen, the game will start!” As a means to start a game of drawing a picture or other pattern to encourage the player to touch However, the game start can be configured to start the game by attaching a card or the like.
Moreover, although the example which uses a mobile telephone as a mobile communication terminal was demonstrated, the portable game machine in which infrared communication is possible can also be utilized. Moreover, although the example of the infrared communication was shown as a means to communicate, the portable communication terminal carrying the radio | wireless communication function by an electromagnetic wave can also be used. In such a case, it is necessary for the game apparatus to be equipped with a wireless communication function instead of an infrared receiver. If the information terminal is not limited to a PC terminal or PDA, but is an information terminal having an Internet communication function, data can also be sent from the information terminal having the Internet communication function.
An example of a touch pen is given as a device for a user to draw a picture by touching the screen. However, if the device is similar to a touch pen (the tip can touch the screen and has a gripping portion), the touch pen is limited. There is no. It is also possible to use a touch pen with a similar shape or a fingertip.
Further, although the case of drawing with one touch pen on the screen has been described, the game can be similarly played even when a plurality of players draw with two or more touch pens simultaneously.

  Game device and game capable of playing games such as graffiti for children installed in dead spaces at rest centers such as game centers, shopping malls, department stores, kids corners, stores, communication passages, station premises, parking lots, etc. System.

DESCRIPTION OF SYMBOLS 1 Game apparatus main body 2 Display apparatus 3 Device 4 Camera 5 Mobile communication terminal (mobile phone etc.)
6 Information terminals (PC terminals, PDAs, etc.)
7 game server device 10 player 11 game device 101, 601, 701 CPU
102,703 ROM
103,602 RAM
104,506 Image processing unit 105 Projector 107 Infrared light 108 Infrared camera control unit 109a, 109b Infrared camera 110 Infrared receiver 111 Operation unit 112 Input / output control unit 113,504,704 Communication unit 114 Camera control unit 201 Screen 301 Touch pen 302 Infrared ray Reflector 502 Memory unit 503 Key input unit 505 Antenna 507 Liquid crystal display unit 508 Telephone function unit 603 HDD
604 Graphic circuit 605 Display 606 Peripheral device control unit 607 Keyboard 608 Mouse 609 Speaker 610 LAN input / output interface unit 611 Router 612 ADSL modem 702 Database

Claims (14)

A game device body;
A display device comprising a screen or a display;
A device having an infrared reflector at the contact portion for touching the display device to write a pattern or character, or to select an area displayed on the display device;
A mobile communication terminal or an information terminal having a transmission function for transmitting data including images, music or text,
The game apparatus body is
Data acquisition control means for receiving and acquiring data including images, music or text from a mobile communication terminal or information terminal;
Two or more infrared cameras provided on the side of the display device;
When there was contact with the surface of the display device of the device, the infrared camera analyzed by obtaining an infrared image including reflection by the infrared reflector, recognized the contact position of the device, and traced the display device Recognizing means for recognizing symbols and characters drawn when
The symbol or the character obtained by the recognition by the symbol recognition unit is displayed on the display device, and the image or the text among the images, music or text that is the data acquired by the data acquisition control unit is displayed on the display device. Data display / playback means for displaying or playing music;
A background image selection control means for the player to select a background image to be displayed on the display device in game play,
The mobile communication terminal is
A receiver for receiving image, music or text data from a mobile line;
A transmission unit that transmits the image, music, or text data received by the reception unit to the game apparatus body wirelessly or in a wired manner;
When the game apparatus main body acquires image, music or text data from the mobile communication terminal or information terminal by the data acquisition control means and selects a background image by the background image selection control means, this background Display the image or text, or display the background image to play the music, and when the device draws a symbol or character on the display device, displays it on the screen And a control means for controlling the drawn symbol or character or the image or text to move on the screen. A game device body;
A display device comprising a screen or a display;
A device having a reflector at the contact portion for touching the display device to write a pattern or character, or to select an area displayed on the display device;
A mobile communication terminal or an information terminal having a transmission function for transmitting data including images, music or text,
The game apparatus body is
Data acquisition control means for receiving and acquiring data including images, music, and text from a portable communication terminal or information terminal;
Two or more color cameras provided on the side of the display device;
When the device touches the surface of the display device, the color camera analyzes by obtaining an image including reflection by the reflector, recognizes the contact position of the device, and is drawn when the display device is traced Recognizing means for recognizing symbols and characters,
The symbol or the character obtained by the recognition by the symbol recognition unit is displayed on the display device, and the image or the text among the images, music or text that is the data acquired by the data acquisition control unit is displayed on the display device. Data display / playback means for displaying or playing music;
A background image selection control means for the player to select a background image to be displayed on the display device in game play,
The mobile communication terminal is
A receiver for receiving image, music or text data from a mobile line;
A transmission unit that transmits the image, music, or text data received by the reception unit to the game apparatus body wirelessly or in a wired manner;
When the game apparatus main body acquires image, music or text data from the mobile communication terminal or information terminal by the data acquisition control means and selects a background image by the background image selection control means, this background Display the image or text, or display the background image to play the music, and when the device draws a symbol or character on the display device, displays it on the screen And a control means for controlling the drawn design or character or the image or text to move on the screen or to move on the spot. The mobile communication terminal is
Have a camera to capture images,
3. The game apparatus according to claim 1, wherein an image captured by the camera is transmitted to the game apparatus body wirelessly or by wire. The control means according to claim 1 or 2,
The player has a function of moving a symbol, a character, an image, or a text by contacting the symbol, character, or an acquired image or text drawn on the display device by the device with the device. Item 4. The game device according to item 1, 2 or 3. A means for setting to perform display other than the campus that can write symbols and characters on a part of the display device,
The control means according to claim 1 or 2,
When the display other than the campus is set, an image, a pattern, or a text for displaying an advertisement or news is displayed in a loop on a part of the screen of the display device, and the player displays the image, the pattern, or the text. 5. The game apparatus according to claim 1, 2, 3 or 4, wherein the image, the design, or the text is moved to a campus portion of a screen of the display device when touching or dragging with the device.   6. The game apparatus according to claim 1, wherein a camera is provided on an upper part of the display device and has a function of displaying an image photographed by the camera on the display device.   7. The game apparatus according to claim 1, wherein when the player draws a symbol or a character on the display device by the device, the symbol drawn after a predetermined time disappears. .   A PDA or a personal computer terminal is provided as the information terminal, and data including images, music, or text is sent from the PDA or personal computer terminal to the game apparatus body, and the data acquisition control means acquires the transmitted data. The game device according to claim 1, 2, 3, 4, 5, 6 or 7.   A part of an image, music, or text sent from the mobile communication terminal or personal computer terminal to the game apparatus main body is touched, and the shape or function of a part of the touched image, music, or text is changed. The game device according to claim 1, further comprising an editing function. The mobile communication terminal is a mobile phone having an infrared transmission / reception function,
The infrared camera is composed of two units, each provided at the upper corner of the screen, and imaging each on the screen,
The game device according to claim 1, wherein the device is a touch pen provided with an infrared reflector at a pen tip. The mobile communication terminal is a mobile phone having an infrared transmission / reception function,
The color camera is composed of two units, each provided at the upper corner of the screen, and images each on the screen,
The game device according to claim 1, wherein the device is a touch pen provided with a reflector at a pen tip.   The device has two or more devices, and when two or more devices touch the display device at the same time and draws a symbol or character, the two or more symbols or characters are recognized, and the recognized symbol or character is displayed on the display device. The game apparatus according to claim 1, wherein the game apparatus is displayed.   A server device, wherein data including an image, music, or text is transmitted in advance from the mobile communication terminal or information terminal to the server device, and the image, music, or text stored in the database of the server device is stored in the game The game apparatus according to claim 1, wherein the game apparatus transmits a request for transmission from the apparatus main body. Two game devices according to claim 13,
Display the background image selected on each game device side on the display device of each game device,
A game system, wherein a symbol or a character drawn by a device is transmitted to a display device of another game device and displayed on the display device of the transmitted game device.

Images