MXPA00006398A - System for inserting auxiliary data in a video stream - Google Patents

Abstract

According to the present invention, it is possible to, when an already available data communication system is used, transmit digital data other than data that is the main communication object of the data communication system. A data broadcast station (2) of this invention has a digital data encoder (7), which changes, each unit time, the color of part of a moving image based on digital data that is input and generates image data. A data reception terminal (4) has a moving image display device (10), which displays a moving image based on image data, a light sensing device (12), which senses the light of part of the moving image displayed on the moving image display device (10), and a digital data decoder (13), which detects the change, each unit time, in the color of part of the moving image whose light is sensed by the light sensing device (12) and generates the digital data.

Description

SYSTEM FOR INSERTING AUXILIARY DATA IN A VIDEO CURRENT BACKGROUND OF THE INVENTION FIELD OF THE INVENTION This invention relates to a data generation device and a method of generating data that generates digital data, to a data receiver and method of receiving data that receives digital data, and to a data communication system. and method of communication of data that transmit and receive digital data. More specifically, the present invention relates to a data generation device and method of data generation, to a data receiver and method of data reception, and to a data communication system and data communication method that are suitable for information terminals, computers, portable gaming machines, etc.

BACKGROUND OF THE INVENTION Digital data communication systems have shown rapid growth in recent years. General digital data communication systems include those that receive data from data receiving terminals such as personal computers, in which a dedicated modem is connected to a public telephone line. In the same way, digital data communication has begun in recent years with so-called portable telephones, that is, telephone devices that are convenient to be carried out of a closed installation. The construction of a data communication system usually requires the availability of a large communication infrastructure. If a communication infrastructure is used that adopts communication of audio data such as the public telephone lines mentioned above, the specialized device known as a modem is required to receive data from the data communication network in a data reception terminal. For example, if a video game device can receive data from the presented image on a visual presentation medium such as a monitor, the functions of the video game devices will be expanded, and the fun of a person will be increased by making use of those functions.

BRIEF DESCRIPTION OF THE INVENTION One objective of this invention, which was envisioned considering the situation mentioned above, is to provide a data generation device and a method of data generation, a data receiver and method of data reception and a data communication system and method of communicating data that can transmit digital data other than moving image data, which is the main objective of the equipment for transmitting and receiving moving images that makes use of a transmitter-receiver of moving images already available, means of transmitting moving images, etc. These and other objects are obtained by means of a data generating device in accordance with the present invention that includes a means of generating coded image data that generates image data by changing the color of part or all of a moving image by time unit based on digital data that are entered. With the data generating device of the present invention, digital data can be encoded in the moving image by changing the color of the moving image. To solve the problems mentioned above, the data generation method of this invention generates image data in which the color of part or whole moving image is changed by unit time based on digital data. With the data generation method of the present invention, digital data can be encoded with respect to this moving image by changing the color of the moving image. Another objective of the present invention is to provide a data receiver that includes a light detecting means that detects the light of part or all of the moving image presented on the display medium, and a data generating means that detects the change each unit time in the color of part or all of the moving image detected by the light detecting means, and decodes and generates digital data. The data receiver having said configuration detects the change by unit time in the part color or the entire moving image that is detected by the light detecting means, decodes the digital data and generates them by the data generating means. . In this way the data receiver is able to detect changes in the color of the moving image and decode the digital data. A further objective of the present invention is to provide a method of data reception that detects the light of part or all of the moving image presented on the visual presentation medium, detect the change each unit time in the color of part or the whole image in motion whose light is detected, and generate digital data. This method of receiving data of the present invention makes it possible to detect changes in the color of the moving image and to decode the digital data. The objectives of the present invention are also obtained by means of a data communication system having in its data transmitter a means of generating coded image data that changes the color per unit time of part or all of the image based on digital data that is entered and generates image data, and a transmission medium that transmits image data, and has in its data receiver a receiving means that receives image data, a visual presentation means that presents a moving image based on the image data, a means of detecting light that detects the light of part or all of the moving image presented on the display medium, and a means of decoding digital data that detects the change each unit time in the color of part or all of the moving image detected by the light detection means and decodes and generates the digital data. The data communication system having said configuration generates, by the means of generating coded image data of the data transmitter, image data in which the color of part or the whole image is changed by unit time based on data digital inputs, and transmit the image data by the transmission medium. It also presents the moving image by means of visual presentation of the data receiver based on image data received by the reception means and detects by the light detecting means the light of part or all of this presented moving image. The data receiver detects the change each unit time in the color of part or all of the moving image whose light is detected by the light detecting means, and decodes the digital data and generates them by its means of data decoding. This data communication system makes it possible to transmit a moving image in which the digital data is encoded by color cables, and to decode the digital data by detecting the color changes in this transmitted moving image. Yet another objective of the present invention is achieved by means of a data communication method that generates image data in which part color or a whole moving image is changed by unit time based on digital data, presents the image in motion on the visual presentation medium based on the image data, it detects the light of part or the whole moving image presented on the visual presentation means, detects the change each unit time in the color of part or the whole image in motion whose light is detected, and decodes and generates the digital data. This method of data communication makes it possible to transmit a moving image in which the digital data is encoded by changes in color, and to decode the digital data by detecting the color changes in this transmitted moving image.

BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a block diagram showing the configuration of a mode of a data communication system of the invention; Fig. 2 is a diagram for explaining how digital data is encoded in part (the encoded region of digital data) of the image transmission by a data transmission station of the data communication system of Fig. 1; Figures 3A and 3B are diagrams to explain how the digital data is encoded by changing the color of part of the image; Figures 4A and 4B are diagrams showing the image that is received and presented on the moving image display device of a data receiving terminal of the data communication system of the present invention; Figures 5A to 5F are diagrams showing a specific example obtained when transmitting digital data by changing the color of part of the image; Figure 6 is a schematic view of an example obtained when the present invention is applied to an entertainment system; Figure 7 is a schematic view of another example obtained when the invention is applied to an entertainment system; Fig. 8 is a plan view showing the configuration of an entertainment system including a portable electronic device and a video game device; Fig. 9 is a perspective view showing the configuration of an entertainment system to which applies the present invention; Figures 10A to 10C schematically show a configuration of the portable electronic device; Fig. 11 is a block diagram showing the circuitry configuration of a video game device and Figs. 12A and 12B are block diagrams showing the circuitry of the portable electronic device.

DETAILED DESCRIPTION OF THE PREFERRED MODALITY A mode of this invention will now be described in detail with reference to the drawings.

Data communication system A data communication system of this mode is a system in which a moving image is transmitted and received between a moving image transmitter and a moving image receiver. The data communication system is, for example, a terrestrial television transmission system that carries out television transmission by means of a signal from the NTSC. For example, in a terrestrial television transmission system operating by means of an NTSC signal, the image transmission rate is normally 60 fields (30 frames) per second. As shown in Figure 1, the data communication system of this mode comprises a data transmission station 2, which transmits a motion image and other data, and a data receiving terminal 4, which receives the transmission of the data transmission station 2 by moving image transmission means 3 which will be explained in detail below. The data transmission station 2 has a digital data encoder 7, which encodes digital data, to be transmitted, to the image data stored in memories 5 and 6, respectively, and a moving image transmitter 8, which transmits the image data generated with a digital data encoder 7. The data receiving terminal 4 has a moving image receiver 9, which receives the transmission that comes from the data transmission station 2, a device display of moving image 10, which presents a moving image, and a portable terminal 11, which can receive image data coming from the data transmission station 2 by the moving image display device 10. The portable terminal 11 has a light detection device 12, a digital data decoder 13, which decodes the digital data based on the light received by the light detecting device 12, and a memory 14 which stores the decoded digital data. The data communication system 1 having such configuration, the data transmission station 2 has the digital data encoder 7, which is a means of generating image data that generates image data by changing the color of part of the moving image per unit time based on the digital data that is input to it, and a moving image transmitter 8, which is a transmission medium that transmits image data. The data receiving terminal 4 has a moving image receiver 9, which is a receiving means that receives image data, a moving image display device 10, which is a visual presentation means that presents images in movement based on the image data, light detecting device 12, which is a means of detecting light that detects light from part of the moving image presented on the moving image display device 10, and decoder of digital data 13, which is a means of generating data that detects changes in each unitary time of the color of part of the moving image whose light received by the light detecting device 12 and generates digital data. Next, each of the parts forming this data communication system 1 will be described in detail.

Data transmission station The memories 5 and 6 are memory means that store image data or digital data that will be transmitted (hereinafter referred to as digital transmission data). For example, memories 5 and 6 are disk drives or tape recording devices, etc. The digital data encoder 7 generates image data in which the color of part of the moving image is changed each unit time based on the digital transmission data that is inputted. Specifically, the digital data encoder 7 suitably interposes digital transmission data in the moving image, changing the color in each image for a prescribed region of the image, in accordance with the digital transmission data. The interleaving of the digital transmission data in the image that is made here is done by superimposition, etc. In this way, the digital data encoder 7 transforms the digital transmission data into a form that can be transmitted using the moving image. That is, the digital transmission data is constituted as the totality of each image, that is, as an article of data in the moving image. The interval in which the data is inserted is one with respect to each field of the moving image. That is, in this case, that "each unit time" mentioned above means each time interval between fields. In the same way, "color" means taking the dye, brightness and chromatic element. That is, the digital data decoder 7 encodes the digital transmission data in the moving image by modifying one of the three dye, brightness and color elements. Referring to FIGS. 2 and 3A, 3B, the processing by means of which the digital data encoder 7 encodes the digital transmission data with respect to the image will now be explained.

As shown in Figure 2, the digital data encoder 7 encodes the digital transmission data in a partial image region (hereinafter referred to as the digital data coding region) 101a of the image 101 in an image region 100 that is emitted to the moving image display device 10. That is, the digital data encoder 7 encodes the digital transmission data by changing the color of the digital data coding region 101a, which is part of the image 101. The figure 3 shows the image 101 in which the color of the digital data coding region 101a has been changed. The digital data encoder 7 changes the color of the digital data coding region 101a to black as shown in Figure 3A, or changes the color of the digital data coding region 101a to white as shown in Figure 3B . For example, by making black correspond to "0" and that white corresponds to "1", it can be done in a binary value; that is, visual presentation using bits is possible. In this way, the data of one bit can be assigned to a field, and the digital transmission data can be encoded to the image 101 one bit per field. In this way, if it is applied to terrestrial wave television transmission by means of an NTSC signal as in this mode, the image transmission speed is 60 fields per second, so data transmission can be done at 60 bits / second. As desired, a data bit can be encoded every several fields, that is, the intermittent coding can be carried out with respect to the image field, instead of the coding of the transmission digital data in the image of all the fields. Here the explanation assumes that the color of the digital data coding region 101a is changed to black or white, but this is for reasons of convenience of description and is therefore not limited thereto. Other colors may be used as desired. In addition, they can occur not only with visible light but with light outside the visible scale, such as infrared. That is, the visual presentation can be done with light rays having a predetermined frequency. Likewise, the explanation is made with a digital data coding region 101a, which is part of the moving image, but is not necessarily limited to that part. For example, if it is presented with non-visible light, the entire moving image can be used as a digital data coding region 101a without affecting the appearance of the moving image. The image data in which the digital transmission data is encoded by this digital data encoder 7 as described above is input to the moving image transmitter 8. The moving image transmitter 8 performs processing to transmit data of image via moving image transmission means 3. For example, the moving image transmitter 8 consists of a transmitter having a modulation means and an antenna, carries out modulation processing by the modulation means, and transmits image data to moving image transmission means 3. The data receiving terminal 4 receives the transmission of image data from this moving image transmitter 8. Here, the moving image transmission means 3 is a means of signal transmission for land waves. The moving image transmission means 3 can also be a signal transmission medium that is part of a satellite transmission system. The data transmission station 2, which has such a configuration, carries out the coding of the digital transmission data with respect to the image data by means of the digital data encoder 7. A data transmission station 2 transmits to the means for transmitting moving image 3, by means of the moving image transmitter 8, the image data in which the digital transmission data is encoded.

Data receiving terminal The moving image receiver 9 of the data receiving terminal 4 is a means that performs processing to receive the image data that is transmitted to it by the moving image transmission means 3. For example, the moving image receiver 9 consists of an antenna and a receiver having a modulation means, and by means of this modulation means modulates the image data that is transmitted thereto by the image transmission means in movement 3. The image data received by this moving image receiver 9 is input to the moving image display device 10. The moving image display device 10 is a device that displays images. The moving image display device 10 is, for example, a monitor. The moving images are emitted on the visual display screen of this moving image display device 10 based on the image data that is received. The digital transmission data is encoded in the moving images presented on the visual presentation screen as described above. Figures 4A and 4B show an image 101 that is emitted to a display screen 10a of the moving image display device 10. Figure 4A shows the emission of the image 101 corresponding to Figure 3A above; that is, Figure 4A shows the image 101 that is emitted to the display screen 10a in which the digital data coding region 101a is blacked. Figure 4B shows the emission of the image 101 corresponding to Figure 3B above; that is, it shows the image 101 that is emitted to the display 10a in which the digital data coding region 101a is blank.

Portable terminal The portable terminal 11 detects the light of part of the image emission on the display screen 10a of this moving image display device 10, i.e. the digital data coding region 101a by the detection device of light 12. The light detection device 12 is constituted to detect the light of the digital data coding region 101a, which is part of the motion image emission on the display 10a. For example, the light detecting device 12 has a directional light detection element and by means of this it detects the light of part of the moving image. In this way, the light of the image emission from a predetermined region can be detected on the display 10a. For example, to detect color change of the digital data coding region 101a, the light detecting device 12 has a sensor that can detect the frequency of the color, such as a light detecting element such as, for example. , a photodiode. In addition, the light detecting device 12 is capable of detecting light by placing the light detecting part of the light detecting device 12 in direct contact with the display screen. In this way, the light detecting device 12 can detect light even if it has no directionality. The light detecting device 12, having such a composition, detects the color, either white or black, of the digital data coding region 101a of the image 101 shown in Fig. 4. A digital data decoder 13 is entered. with the signal that is emitted based on the light detected from this light detection device 12. The digital data decoder 13 decodes the digital transmission data based on the signal emission of the light detection device 12. In other words , the digital data decoder 13 sets the data to "0" if the signal emission coming from the light detection device is black, and "1" if it is white. The digital transmission data decoded in this way is stored in the memory 14. The memory 14 is, for example, a memory medium such as a hard disk or a computer memory. The data reception terminal 4, which has the composition mentioned above, receives via the moving image receiver 9 the image data that is transmitted to it by the moving image transmission medium 3. The receiving terminal Data 4 outputs a moving image to the moving image display device 10 based on this received image data. The portable terminal 11, by means of the light detection device 12, detects the light of the digital data coding region 101a, which is part of the emission of the moving image on this moving image display device 10. The portable terminal 1 1 decodes the digital transmission data by means of the digital data decoder 13 based on the results of the light detection and stores the digital transmission data decoded in the memory 14.

The parts of the data communication system 1 are composed as described above. In this data communication system 1, the data communication system 1 transmits image data in which the digital transmission data is encoded in the data transmission station 2. The data reception terminal 4 receives the data from image that is transmitted to it and emits the moving image by means of the moving image display device 10, in the same way as with a normal television transmission. Meanwhile, the portable terminal 11 decodes and obtains the digital transmission data of the image 101, which is output to the moving image display device 10. The case in which a moving image consisting of images is specifically described. multiple as shown in Figures 5A to 5F is transmitted and received. Here the color of the digital data coding region 101a for each field changes to, in sequence, black, white, white, black, black, white. If the image 101 is transmitted from the data transmission station 2 while the color of the digital data coding region 101 a is varied with each field, the portable terminal 11 can decode 6 bits of digital data as "0", "1". "," 1"," 0"," 0"," 1". In this way, the digital data received becomes data that can be put to use by the user as, for example, various information. Similarly, the portable terminal 11, which finally serves as a terminal that receives digital transmission data, consists for example of a portable information terminal, a so-called PDA (personal digital assistant). Also, the portable terminal 11 functions as a portable gaming device, and the digital data that is received as described above can be used in the data execution. For example, in the portable terminal 11, the received digital data is used to play a game. In the same way, according to the digital data received, the images in which said digital data are encoded can be used as game characters. As described below, the image 101 is generated as a character based on the digital transmission data and used as a game. As described above, in the data communication system 1 it is possible to build a digital data communication system in which the digital data is transmitted using the infrastructure already available from the NTSC terrestrial signal television reception system. That is, this invention makes it possible to build a digital communication system that transfers digital data in a simple and inexpensive manner. In this way, digital data can be transmitted in real time to multiple terminals all at once. A specific example will be described with reference to figures 6 and 7. Figure 6 shows an entertainment system that carries out the collection of insects presented on screen on the display 10a. That is, this allows a user to collect insects in the image of a television broadcast. Here, the entertainment system consists of the terminal or portable device 11, which can be freely carried, and a video game device 31. The video game device 31 has a control 33 and also a mounting unit 32, in which portable terminal 11 can be assembled and from which it can be disassembled. In this entertainment system, if the detector of the light detection device has directionality, the user points the portable terminal 11 to the insect 110 on the display 10a to obtain the insect whose image is being presented. If the sensor is not directional, the user puts it near or on the monitor screen. Here, the portable terminal 11 begins to decode the digital transmission data by detecting, by means of the light detection device 12, the light of the digital data coding region 110a forming part of the insect 110a. Then the terminal or portable device 11 sends the decoded digital transmission data to the video game device 31. The transmission of the digital transmission data from the portable terminal 11 to the video game device 31 is done by mounting the portable terminal 11 in the mounting unit 32 of the video game device 31. The transmission of the data from the portable terminal 11 to the video game device 31 can be done by means of wireless communication using, for example, infrared rays. With the video game device 31, the erasure, etc., of the insect 110 is made based on the input of digital transmission data from the portable terminal 11. For example, processing is carried out in which the conclusion of the capture of the data referring to the image, and the image of the insect 110 is erased. Meanwhile, the digital data that is obtained is also stored in the portable terminal 11. For example, the portable terminal 11 presents a captured insect 110 on the display unit 12. In this way, the user is able to keep captured insects. in the portable terminal 11. Thus, an insect collection game can be obtained in the entertainment system. In the same way, the characters are not limited to insects; one may also have as a character a bird 111 having a digital data coding region 111a. Figure 7 shows an entertainment system in which the desired article can be obtained from multiple items presented on the display 10a. In this way the user can obtain from among the images of a television transmission the article that he will use in a video game. Figure 7 shows article A, article B and article C as a triangle, square and circle, respectively, but this is only for convenience; what would be presented in practice is, for example, forms that correspond to the names of the articles.

In this entertainment system, in order to obtain the desired article A from among the articles A, B and C, the user points the portable terminal 11 to the issuance of the article 120 on the display 10a. Here, the decoding of the digital transmission data is initiated by detecting, by means of the light detection device 12 of the portable terminal 11, the light received from a digital data coding region 120a forming part of the article 120. Then the The portable terminal 11 sends the decoded digital transmission data to the video game device 31. The transmission of the digital transmission data from the portable terminal 11 to the video game device 31 is done by mounting the portable terminal 11 in the assembly unit 32 the video game device 31. The transmission of the data from the portable terminal 11 to the video game device 31 can be done wirelessly. A user can obtain a desired article A by such operations and make the progress of the video game using article A. In this way, it becomes possible to decode the digital transmission data that is encoded in the moving image and use it as data for the purposes of a game. In the mode, the digital data encoder 7 is made to transmit one bit of digital data per frame using the digital data coding region, but of course signals that have more bits can be transmitted by changing the luminance of the display in the Vertical or horizontal direction of the scan lines of the image, or changing the chromatic ones. Similarly, a visual presentation similar to a so-called bar code can be made in the digital data coding region. For example, in this case, by means of a visual presentation similar to that of a bar code, images can be distinguished to which this visual presentation is attached. In the embodiment described above, the digital data is encoded having a coding region of digital data in part of the moving image, but the digital data can also be encoded by changing the color of the entire image. That is, the digital transmission data can be encoded by changing the color of the complete image 101 as described above. The portable terminal 11 can encode the digital transmission data based on the received light in both the visible and infrared scales. For example, in this case, the light detecting device 12 has a means for changing the received light between visible light and infrared rays. In this way, digital transmission data can be encoded by changing the color of the coding region of digital data such as visible light or infrared rays. Next, a specific example of the above entertainment system will be described. As shown in Figure 8, the entertainment system includes a video game device 301 and a portable electronic device 400. The video game device 301 corresponds to the video game device 31 mentioned above, and the portable electronic device 400 corresponds to the portable terminal 11 mentioned above. As shown in Figures 8 and 9, the portable electronic device 400 can be mounted and dismounted from the video game device 301 and carries out data communication with said video game device 301. In this entertainment system, the device of video games 301 forms the so-called base machine, while the portable electronic device 400 forms the so-called terminal machine. For example, in this entertainment system, the video game device 301 is constituted as a means that executes game programs stored on a CD-ROM or other storage medium. As shown in figures 8 and 9, the video game device 301 is for reading an application program stored in the storage medium and executing it according to instructions of the user (player). For example, by running the game, it mainly performs game progress, visual presentation and sound control. A main unit 302 of the video game device 301, which is housed in an almost square-shaped housing, has in its middle part a disk mounting unit 303 on which a CD-ROM or other disk is mounted. optical which is a storage medium for providing a video game and other application programs, as well as a reset switch 304 for arbitrarily restarting the video game, ignition switch 305, disk operation switch 306 for operating the an optical disk, and two slots 307A and 307B. Similarly, the video game device 301 can be constituted in such a way that application programs are provided by means of a communication circuit, not only from a storage medium. For example, it can be constituted in such a way that data can be received from a transmission circuit or other communication circuit. The portable electronic device 400 or control 320 may be connected to the slots 307A and 307B. Here, the control 320 corresponds to the control 33 mentioned above. The slots 307A and 307B correspond to the connection unit 32 mentioned above. The control 320 has first and second operation parts 321 and 322, a left button 323L, a right button 323R, a start button 324, a selection button 325, operation parts operable in analogous fashion 331 and 332, a power switch model selection 333 by which the mode of operation of these operating parts 331 and 332 is selected, and a display unit 334 for displaying the selected mode of operation. Although not shown, a mechanism causing vibration is provided within the control 320. The mechanism causing vibration causes said control 320 to vibrate according to, for example, the progress of the video game. This control 320 is electrically connected to the slot 307B of the main unit 302 by means of the connection part 326. For example, by connecting two controls 320 to the slots 307A and 307B two users can share this entertainment system; that is, for example, they can play a competitive game against each other. Slots 307A and 307B are not limited to two systems like this. As shown in Figures 10A to 10C, the portable electronic device 400 has a housing 401 and is equipped with an operation unit 420 for the input of various information; a display unit 430, which consists of a liquid crystal display (LCD), etc., and a window unit 440 for carrying out wireless communication by a wireless communication means, such as by infrared rays. Housed in the housing 401, which consists of an upper shell 401a and a lower shell 401 b, is a substrate on which there are memory elements, etc. The housing 401 is shaped such that it can be inserted into slots 307A and 307B of the main unit 302 of the video game device 301. A window unit 440 having an almost semicircular shape is provided at the other end of the housing 401. A visual display unit 430 covers almost half the area of the upper shell 401a constituting the housing 401, and is positioned near the window 440.

An operation unit 420, which has one or more operation buttons 421, 422 for carrying out the input of events and making various selections, etc., is formed in the upper shell 401a in the same manner as the window unit 440 is on the opposite side of said window unit 440, and covers almost half of its area. The operating unit 420 is formed on the upper part of the cover 410, which is rotatably supported with respect to the housing 401. Here, the operation buttons 421, 422 are arranged from the side of the upper surface to the side of the bottom surface of this cover 410 and pass through this cover 410. These operation buttons 421, 422 are made such that they can move in or out with respect to the upper surface of the cover 410 and are supported by said cover 410. The device portable electronic 400 has a substrate that is inside the housing 401 and is positioned corresponding to the position of arrangement of the cover 410, and has also breaker oppression units on this substrate. The breaker oppression units are provided in positions corresponding to the positions of the operation buttons 421, 422, in the state with the cover 410 closed. In this way, when the operation buttons 421, 422 are pressed, the switch oppression unit presses a pressure switch, such as a diaphragm switch. As shown in Figure 9, the portable electronic device 400, in which the operating unit 420 is thus formed in the cover 410, is mounted on the main unit 302 of the video game device 301 with its cover 410 open The appearance of the video game device 301 and the portable electronic device 400 is shown in figures 8 to 10 as shown above. Figures 11 and 12 show the composition of the circuitry of the video game device 301 and the portable electronic device 400. As shown in Figure 11, the video game device 301 has a control system 350 consisting of a central processing unit (CPU) 351 and its peripheral devices, etc .; a graphics system 360, which consists of a graphics processing unit (GPU) 362, which draws a frame buffer 363, etc .; a sound system 370, which consists of a sound processing unit (SPU), etc., which produces musical tones and sound effects; an optical disk controller 380, which controls the optical disk on which the application programs are recorded; a communication controller 390 that controls the input and output of signals from the controller 320, in which user instructions are input, and data from a memory card 500, on which the game schedules, etc. are recorded, and of the portable electronic device 400, a connection 395, to which the previous parts are connected, a parallel input-output interface (PlO) 396, consisting of an interface with other devices, a serial input-output interface. (SIO) 397, and a communication data processing unit 398, which performs transmission data reception processing, etc. The control system 350 has the CPU 351, a peripheral device driver 352, which carries out direct memory access control (DMA) interrupt control transfers, etc., a main memory 353, which consists of a random access memory (RAM), and a read-only memory (ROM) 354. Here, the CPU 351, the main memory 353, the graphics system 360 and the sound system 370, the optical disk controller 380 and the communication data processing unit 398 of this video game device 301 correspond, respectively, to the CPU 3, main memory 4, sound and video processor 7, packaging means demodulator 6 and communication data decoder 3 of the video game device 1. The main memory 353 is constituted as a means of memory in which various data are stored. For example, programs and data, etc., read from packaging means are stored in this main memory 353. The ROM 354 is constituted as a memory means in which several programs, including the so-called operating system, are stored, which handle the main memory 353, graphics system 360 and sound system 370, etc. The CPU 351 controls all of this video game device 301 by running the operating system stored in the ROM 354.

When the power is turned on, this CPU 351 executes the operating system stored in the ROM 354 according to the start sequence and starts the control of the graphics system 360, sound system 370, etc. For example, when the operating system is executed, the CPU 351 performs the initialization of the complete video game device 301, including confirmation of the operation, then controls the optical disk controller 380 and executes the application program stored in the Optical disc. By executing this application program, the CPU 351, according to the input of the users, controls the graphics system 360, sound system 370, etc., and controls the visual presentation of images and the generation of effects of sound and music The graphics system 360 includes a geometry transfer machine (GTE) 361, which performs processing such as coordinate transformations, a GPU 362 that draws images according to drawing instructions of the CPU 351, a frame buffer 363 which stores the images drawn by this GPU 362 and an image decoder 364 that decodes the image data compressed and encoded by orthogonal transformations such as individual cosine transformations or the like. GTE 361 has, for example, a parallel calculation mechanism that executes multiple operations in parallel, and is capable of carrying out at high speed calculations such as coordinate transformations, light source calculations, and matrix or vector calculations. in response to CPU calculation requests 351. Specifically, in the case of operations in which plane shading is carried out, in which, for example, a polygon in the form of a triangle is drawn with the same color, this GTE 361 is capable of carrying out coordinate calculations for up to about 1.5 million polygons per second, thereby reducing both the problem in the CPU 351 and carrying out high-speed coordinate operations by this video game device 301. The GPU 362 draws polygons, etc., to the frame buffer 363 according to the drawing commands of the CPU 351. This GPU 362 is able to draw up to about 3 60,000 polygons per second. The frame buffer 363, which consists of a so-called double port RAM, is capable of simultaneously carrying out the drawing from the GPU 362 or transfers from the main memory 353, and reading with visual presentation motifs. This frame buffer 363 has a capacity of, for example, 1 megabyte, and can handle a matrix consisting of 1024 pixels horizontally and 512 pixels vertically, each pixel being 16 bits. The frame buffer 363 has, apart from a visual display reaction that is output as a video output, a CLUT region in which a color observation table (CLUT) is stored which is referenced when the GPU 362 draw polygons, etc., and a texture reaction in which the texture that is transformed by coordinates and mapped to polygons, etc., is stored by the GPU 362 when the drawing is made. The CLUT and the texture regions change dynamically by changing the region of visual presentation, etc. The image decoder 364 decodes the image data of still images or moving images stored in the main memory 353 and stores the decoded data in the main memory 353, under control of the CPU 351. The image data generated here can be used as background for images drawn by the GPU 362, storing them in the frame buffer 363 by means of the GPU 362. The sound system 370 includes a SPU 371 that generates music and sound effects based on instructions from the CPU 351, a sound buffer 372, in which data in wave form, etc., is stored by this SPU 371 and a speaker 373, which emits the music and sound effects generated by the SPU 371. The SPU 371 has, for example, an ADPCM (Adaptive Differential PCM) decoding function that generates sound data in which 16-bit sound data is adaptively encoded by the ADPCM as 4-b difference signals its; a reproduction function that reproduces sound effects, etc., by reproducing the waveform data stored in the sound buffer 372; and a modulation function that modulates and reproduces the waveform data stored in the sound buffer 372. The sound system 370 can be used as a so-called sampling source, which generates music and sound effects based on in waveform data stored in the sound buffer 372 under the instructions from the CPU 351. The optical disk controller 380 has an optical disk device 381, which reproduces the application and data programs, etc., stored in a CD-ROM or other optical disc, a decoder 382 that decodes programs and data, etc., which have been stored, for example, with an added error correction code (ECC) and a buffer 383, which accelerates reading data from the optical disc by temporarily storing the data from the optical disc device 381. A sub-CPU 384 is connected to the decoder 382. As sound data stored in the optical disk and read by the optical disc device 381, there are, apart from the ADPCM data described above, the so-called PCM data, in which an analog / digital transformation in sound signals is carried out. Here, as an example of ADPCM data, the sound data in which the 16-bit digital data differences are expressed in 4 bits and recorded are decoded by the decoder 382, then supplied to the SPU 371, and then carried performed in these processing such as digital / analog transformation by the SPU 371, then used to activate the speaker 373. As an example of PCM data, the sound data recorded as 16-bit digital data is decoded by the decoder 382 and they are then used to activate the speaker 373. The communication controller 390 includes a communication controller 391, which controls communication with the CPU 351 via the connection 395. The communication controller 391 carries out the communication control of the communication. a controller connection unit 309, to which a control 320 is connected, which inputs user instructions and memory card insertion units 308A and 308B also shown in Figure 9, to which the memory card 500 and the portable electronic device 400 are connected as auxiliary memory devices that store game programming data, etc. The communication data processor 398 has the function of carrying out the reception processing of the information that is received by an antenna, etc., specifically it is constituted to have the function of communication data demodulator of the video game device 1. That is, the communication data processor 398 conducts modulation processing, etc., and receives transmission of transmission data from a transmitting station. The portable electronic device 400 shown in Figure 12A includes a control unit or means 441, a connector 442, an input unit or means 443; a visual presenter 444, a time function unit 445, a non-volatile memory 446, a speaker 447, wireless communication means 448 and wireless reception means 449 as data reception and transmission means, a battery 450, a terminal battery 451 and a diode 452, which form an energy storage medium. The control unit or means 441 is constituted using, for example, a microprocessor (marked as such in the diagram). The control unit 441 has within it a program memory unit 441a, which is a program storage medium. The connector 442 is constituted as a connection means for connecting to a slot in another information device, etc. For example, the connector 442 is constituted to have the data communication function of transmitting and receiving data with the video game device 301. The input unit or means 443 consists of operation buttons, etc., for operating a program. stored. The visual presenter 444 consists of a liquid crystal display (LCD), etc., which is a visual presentation medium that presents diverse information. The 445 time function unit is built to present the time; for example, it presents the time on the display means 444. The non-volatile memory 441 is an element for storing various data. For example, the non-volatile memory 446 may use a semiconductor memory element, such as a flash memory, in which the stored state remains even if the power is turned off. The non-volatile memory 446 functions as the memory device 14 mentioned above. Because the portable electronic device 400 has a battery 450, a static random access memory (SRAM) can be used as nonvolatile memory 446, which allows data to be entered and output at high speed. Due to the battery 450, the portable electronic device 400 can operate independently even when it is detached from the slots 307A and 307B of the main unit 302 of the video game device 301. The battery 450 is, for example, a rechargeable secondary battery. With the portable electronic device 400 inserted in the slots 307A and 307B of the video game device 301, a power source is supplied to this battery 450 from the video game device 301. In this case, the power source terminal 451 is connected to the connecting end of the battery 450 by means of the diode 452 to prevent reverse current, and power is supplied when the main unit 302 of the video game device 301 is turned on. The wireless communication means 448 is constituted as a part that carries out data communication with other memory cards, etc., by means of infrared rays, etc. Similarly, the wireless communication means 448 has the function of the light detection device 12 mentioned above. The wireless reception means 449 is a part that is constituted to have an antenna and demodulation circuit; that is, it is constituted as a part that receives various data transmitted by wireless transmission. The horn 447 is constituted as a means of emitting sounds that emit sounds according to a program, etc. The parts described above are all connected to the control means 441 and operate under the control of the control means 441. The control items of the control means 441 are shown in Figure 12B. As shown in FIG. 12B, the control means 441 has a connection interface of the main unit to information devices, a memory interface for entering and transmitting data from and to the memory, a visual presentation interface, a operating input interface, a sound interface, a wireless communication interface, a time control and a program download interface. The entertainment system consists of the video game device 301 and the portable electronic device 400 described above. Set up as described above, the video game device 301 can execute video games based on game programs stored on an optical disk mounted on the optical disk controller 380. Likewise, this portable electronic device 400 has the function of downloading an application program from the video game device 301 and storing it in the program memory part 441a in the microprocessor 441, thereby making it easy to modify the application programs or various programs operating in said portable electronic device 400. The portable electronic device 400 can, as described above, decode the digital transmission data in the transmission of moving images that comes from the data transmission station 2. For example, the video game device 301 executes video games using decoded digital transmission data. The data generating device of this invention, having a means of generating image data that generates image data by changing the color of part or whole moving image per unit time based on digital data that is entered, makes possible encode digital data in this moving image by changing the color of the moving image. In this way it is possible to transmit digital data using television transmission, in which a moving image is transmitted. The method of generating data of this invention, by generating image data in which part color or a whole moving image is changed by unit time based on digital data makes it possible to encode digital data in this moving image by changing the color of the moving image.

In this way it is possible to transmit digital data using television transmission, in which a moving image is transmitted. The data receiver of this invention, having a light detecting means that detects the light of part or all of the moving image presented on a visual presentation means and a data generation means that detects the change each unit time in the color of part or all of the moving image detected by the light detecting means and generating digital data, makes it possible to detect the change by unit time in the color or part of the entire moving image that is detected by the detection means of light, and generate the digital data by means of data generation. That is, the data receiver is able to detect changes in the color of the moving image and decode the digital data. In this way, it is possible to transmit digital data using a television transmission for the transmission of moving images. The data reception method of this invention, upon detecting the light of part or all of the moving image presented on the visual presentation medium, upon detecting the change each unit time in the color of part or all of the moving image whose light it is detected, and when generating digital data, it makes it possible to detect changes in the color of the moving image and to decode the digital data. In this way it is possible to transmit digital data using television transmission, in which a moving image is transmitted.

The data communication system of this invention, having in its data transmitter a means of generating image data that changes the color by unit time of part or all of the image based on digital data that is entered and generates data of image and a transmission medium that transmits image data, and having in its data receiver a receiving means that receives image data, a visual presentation means that presents a moving image based on the image data, a means of detecting light that detects the light of part or all of the moving image presented on the visual presentation means, and a means of generating data that detects the change each unit time in the color of part or the entire moving image detected by the light detection means and generates the digital data, it makes it possible to generate, by means of generating image data of the data transmitter, image data in which the color of the part or the whole image is changed by unit time based on the entered digital data, transmit the image data by means of transmission thereof, present the moving image by means of visual presentation of the data receiver based on data of images received by the receiving means thereof, detect by means of light detection means thereof the light of part or all of this presented moving image, detect the change each unit time in the part color or the whole moving image whose light is detected by the light detecting means, and generating digital data by its data generating means.

This data communication system makes it possible to transmit a moving image in which digital data is encoded based on changes in color, and decode the digital data by detecting the changes in color in this transmitted moving image. In this way it is possible to transmit digital data using television transmission, in which a moving image is transmitted. The data communication method of this invention, by generating image data in which part color or an entire moving image is changed by unit time based on digital data, by presenting the moving image on a presentation medium visual on the basis of the image data, on detecting the part light or the entire moving image presented on the visual presentation medium, upon detecting the change each unit time in the part color or the whole moving image whose light is detected, and when generating the digital data, it makes it possible to transmit a moving image in which the digital data is encoded based on changes in color, and to decode the digital data by detecting the changes in color in this transmitted moving image. In this way it is possible to transmit digital data using television transmission, in which a moving image is transmitted. The present invention makes it possible to provide a data generation device and a method of data generation, a data receiver and a method of receiving data, and a data communication system and data communication method that can transmit digital data. other than the moving image data which is the main transmission target of the moving image transmission and receiving equipment which makes use of already available moving image transmitter-receivers, moving image transmission means, etc. .

Claims (12)

NOVELTY OF THE INVENTION CLAIMS

1. - A data generating device comprising: a means of generating image data that generates image data by changing, each unit time, the color of part or all of the moving image based on digital data that is input thereto.

2. The data generation device according to claim 1, further characterized in that said color change is one of the changes in the dye, brightness and chromatic elements.

3. A data generation method comprising the steps of: generating image data by changing each unit time, the part color or an entire moving image, based on digital data.

4. The data generation method according to claim 3, further characterized in that said color change is one of the changes in the dye, brightness and chromatic elements.

5. A data receiver comprising: a light detecting means that detects the light of part or all of the moving image presented on a visual presentation medium; and a digital data decoding means that detects the change in each unit time in the color of part or all of the moving image detected by said light detecting means and decodes and generates digital data.

6. - The data receiver according to claim 5, further characterized in that said color change is one of the changes in the dye, brightness and chromatic elements.

7. A method of receiving data comprising the steps of: detecting the light of part or all of an image in motion presented on a visual presentation medium; and detecting a change in each unit time in the color of part or all of the moving image whose light is detected, and decoding the digital data.

8. The data reception method according to claim 7, further characterized in that said color change is one of the changes in the dye, brightness and chromatic elements.

9. A data communication system that transmits a moving image from a data transmitter to a data receiver, comprising: said data transmitter that includes: a coding means of image data, each unit time , the part color or an entire moving image based on digital data that is entered and generates image data, and a transmission medium that transmits said image data; and said data receiver includes: a receiving means that receives image data, a display means that presents a moving image based on image data, a light detecting means that detects a part or the entire image in movement presented on said visual presentation means, a digital data decoding means that detects the change every unit time in the color of part or all of the moving image detected by said light detecting means and decodes and generates the digital data.

10. The data communication system according to claim 9, further characterized in that said color change is one of the changes in the dye, brightness and chromatic elements.

11. A method of data communication comprising the steps of: generating encoded image data in which the part color or an entire moving image is changed in each unit time based on digital data; presenting the moving image on a visual presentation medium based on said image data; detecting the light of part or all of the moving image presented on said visual presentation means, and detecting a change in each unit time in the color of part or all of the moving image whose light is detected, and decoding the digital data.

12. The data communication method according to claim 11, further characterized in that said color change is one of the changes in the dye, brightness and chromatic elements.