JP2012044273A - Image processing system, image processing apparatus, image processing method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing system that, in the presence of two information processing apparatuses each having a camera and a monitor, displays images captured by the cameras on the monitors such that users can view them stereoscopically.SOLUTION: A message reception section 201 receives a message. An image reception section 202 receives a right eye image of first stereo pair images 401 from one game apparatus and receives a left eye image from the other game apparatus. An image generation section 203 generates second stereo pair images 402 providing a stereoscopically emerging view of the received message. An image synthesis section 204 synthesizes the first stereo pair images 401 and the second stereo pair images 402 to produce third stereo pair images 403. A display section 205 displays a right eye image of the third stereo pair images 403 on a screen of one game apparatus and displays a left eye image on a screen of the other game apparatus.

Description

  The present invention relates to an image processing system, an image processing apparatus, and an image processing method for displaying on a monitor so that a user can stereoscopically view an image captured by these cameras when two information processing apparatuses having a camera and a monitor are prepared. As well as programs.

  In recent years, a technique capable of viewing a two-dimensional image stereoscopically has been known. For example, Patent Document 1 discloses an image display device that can adjust the perspective between a background image and a stereoscopic image using a microlens.

JP 2004-77937 A

  The technology capable of stereoscopic viewing as described above is generally applied to one information processing device or game device. However, there is a demand for performing an effect that enhances the fun of the game by performing stereoscopic viewing using a plurality of game devices.

  The present invention solves the above-described problems, and when two information processing apparatuses having a camera and a monitor are prepared, an image photographed by these cameras is displayed on the monitor so that the user can view stereoscopically. An object is to provide an image processing system, an image processing apparatus, an image processing method, and a program.

An image processing system according to a first aspect of the present invention is an image processing system having two game devices each including a camera and a screen, and includes a message reception unit, an image reception unit, an image generation unit, and an image composition And a display unit, which are configured as follows.
Here, it is assumed that the message reception unit, the image reception unit, the image generation unit, the image composition unit, and the display unit are realized by a server device that can communicate with two game devices included in the image system, for example. The server device stores and manages the progress of the game executed by the two game devices, the user's personal information, the battle results, and the like.

  The message accepting unit accepts a message to be presented in common to the users of the two game devices.

  For example, the message receiving unit reads a message related to the progress of the game executed by the two game devices from the storage area of the server device or the like according to the program executed by the server device. Or a message reception part receives the message input from the user of the said game device from one or both of two game devices.

  The image receiving unit receives the first stereo pair image from the two game devices, and the right eye image and the left eye image of the first stereo pair images are one of the two game devices. This is an image taken by the other camera and the other camera.

Here, the stereo pair image is an image in which two images that cause parallax are arranged side by side. When a stereo pair image is viewed with the focus of the eye deliberately shifted, the image can be viewed stereoscopically.
For example, it is assumed that two game devices can communicate with each other and can capture a stereo pair image by performing communication to correct each other's shooting position and the like. Assume that two game devices are arranged side by side and communicate with each other to photograph a real space. Hereinafter, the game device disposed on the right side is referred to as a “right game device”, and the game device disposed on the left side is referred to as a “left game device”.
The image receiving unit uses, as an image for the right eye, an image taken by a camera of the right game device (hereinafter referred to as “right camera”) based on an operation of a user of the right game device (hereinafter referred to as “right user”). An image captured by the camera of the left game device (hereinafter referred to as “left camera”) based on the operation of the user of the left game device (hereinafter referred to as “left user”) is received as an image for the left eye.

  The image generation unit generates a second stereo pair image composed of a random dot pattern in which the received message appears to emerge in stereoscopic view.

  For example, the image generation unit generates a stereo pair image of a random dot pattern that allows the message received by the message reception unit to be viewed three-dimensionally on the screen of the game device.

  The image synthesis unit obtains a third stereo pair image by synthesizing the first stereo pair image and the second stereo pair image for each image for the right eye and each image for the left eye.

  For example, the image composition unit converts the right-eye image captured by the right game device and the right-eye image of the message stereo pair image generated by the image generation unit into the third stereo pair image. Is synthesized as an image for the right eye. Similarly, the image composition unit synthesizes the image for the left eye taken by the left game device and the image for the left eye of the stereo pair image of the message as the image for the left eye of the third stereo pair image. To do.

  The display unit displays the right-eye image of the third stereo pair image on the screen of one game device, and displays the left-eye image of the third stereo pair image on the screen of the other game device. Let

  For example, two game devices are arranged side by side, and the display unit displays the right-eye image of the third stereo pair image synthesized by the image synthesis unit on the screen of the right game device, and the third stereo An image for the left eye of the pair image is displayed on the screen of the left game device. Accordingly, the user can stereoscopically view the image represented by the third stereo pair image.

  According to the present invention, since one game device displays only one image of the stereo pair image, the image can be stereoscopically viewed only when two game devices are prepared.

  In addition, the display unit displays the first stereo pair image on the respective screens of the two game devices so that stereoscopic viewing is possible, and when the user of one game device performs a predetermined operation, The image for the left eye in the first stereo pair image displayed on the screen of the device is changed to the image for the right eye in the third stereo pair image, and the user of the other game device performs a predetermined operation. Then, the image for the right eye of the first stereo pair image displayed on the screen of the other game device is changed to the image for the left eye of the third stereo pair image.

  For example, the display unit causes the right game device to accept an image for the left eye of the stereo pair image captured by the left camera based on the operation of the left user by communication. Then, the display unit displays the right-eye image of the stereo pair image captured by the right camera based on the operation of the right user on the right game device screen on the right side of the screen. Is displayed on the left side of the screen so that stereoscopic viewing is possible. Similarly, the display unit causes the left game device to receive the right-eye image of the stereo pair image captured by the right camera based on the operation of the right user. The display unit displays the left-eye image of the stereo pair image captured by the left camera on the screen of the left game device based on the operation of the left user on the left side of the screen. Is displayed on the right side of the screen so that stereoscopic viewing is possible.

  Then, for example, when the right user presses a predetermined button, the display unit displays, on the left side of the screen of the right game device, an image for the right eye captured by the right game device based on the operation of the right user, and the right eye An image synthesized with a random dot pattern image is displayed. For example, when the left user presses a predetermined button, the display unit displays, on the right side of the screen of the left game device, an image for the left eye taken by the left game device based on the operation of the left user, and the left eye An image synthesized with a random dot pattern image is displayed.

  According to the present invention, it is possible to view a message to be presented to the user only when the users of the two game devices perform predetermined operations and these game devices are arranged side by side.

  An image processing apparatus according to a second aspect of the present invention includes a message reception unit, an image reception unit, an image generation unit, and an image composition unit, and is configured as follows. Here, it is assumed that the image processing apparatus is a server apparatus that can communicate with the game apparatus, for example.

  The message reception unit receives a message.

  For example, the message receiving unit receives a message from a game device with which the server device can communicate.

  The image receiving unit receives the first stereo pair image.

  For example, the image receiving unit receives a stereo pair image obtained by photographing a real space from a game device with which the server device can communicate.

  The image generation unit generates a second stereo pair image composed of a random dot pattern in which the received message appears to emerge in stereoscopic view.

  For example, the image generation unit generates a stereo pair image of a random dot pattern that allows a message received from the game device to be viewed three-dimensionally on the screen of the game device.

  The image synthesis unit obtains a third stereo pair image by synthesizing the first stereo pair image and the second stereo pair image for each image for the right eye and each image for the left eye.

  For example, the image composition unit synthesizes the right-eye image of the stereo pair image received from the right game device and the right-eye image of the random dot pattern generated by the image generation unit, and creates a new stereo pair image The right eye image. Similarly, the image synthesis unit synthesizes the left-eye image of the stereo pair image received from the left game device and the left-eye image of the random dot pattern generated by the image generation unit, and creates a new stereo pair. The image is for the left eye of the image.

  According to the present invention, a new stereo pair image in which a predetermined stereo pair image and a message can be stereoscopically viewed can be generated.

  An image processing method according to a third aspect of the present invention includes two game devices each including a camera and a screen, and includes a message reception unit, an image reception unit, an image generation unit, an image composition unit, and a display unit. And an image processing method executed by the image processing system, comprising a message reception process, an image reception process, an image generation process, an image composition process, and a display process, and is configured as follows.

  In the message accepting step, the message accepting unit accepts a message to be presented in common to the users of the two game devices.

  In the image receiving process, the image receiving unit receives first stereo pair images from two game devices, and right eye images and left eye images of the first stereo pair images are two. It is an image taken by one camera and the other camera of the game device.

  In the image generation step, the image generation unit generates a second stereo pair image including a random dot pattern in which the received message appears to appear in stereoscopic view.

  In the image synthesizing step, the image synthesizing unit synthesizes the first stereo pair image and the second stereo pair image for each image for the right eye and each image for the left eye, so that the third stereo pair image is obtained. Get.

  In the display step, the display unit displays the right-eye image of the third stereo pair image on the screen of one game device, and the left-eye image of the third stereo pair image is the other game device. On the screen.

  An image processing method according to a fourth aspect of the present invention is an image processing method executed by an image processing apparatus including a message reception unit, an image reception unit, an image generation unit, and an image synthesis unit. A reception process, an image reception process, an image generation process, and an image composition process are provided and configured as follows.

  In the message receiving step, the message receiving unit receives a message.

  In the image receiving step, the image receiving unit receives the first stereo pair image.

  In the image generation step, the image generation unit generates a second stereo pair image including a random dot pattern in which the received message appears to be three-dimensionally viewed.

  In the image synthesizing step, the image synthesizing unit synthesizes the first stereo pair image and the second stereo pair image for each image for the right eye and each image for the left eye, so that the third stereo pair image is obtained. Get.

The program according to the fifth aspect of the present invention is a computer connected to two cameras and two screens.
A message receiving unit for receiving a message to be presented in common to users of the two game devices;
An image receiving unit that receives a first stereo pair image from two game devices, wherein a right-eye image and a left-eye image of the first stereo pair images are out of two game devices. An image reception unit that is an image taken by one camera and the other camera,
An image generation unit that generates a second stereo pair image including a random dot pattern in which the received message appears to be raised by stereoscopic vision;
An image synthesis unit that obtains a third stereo pair image by synthesizing the first stereo pair image and the second stereo pair image for each image for the right eye and each image for the left eye;
A display unit that displays an image for the right eye of the third stereo pair image on the screen of one game device, and displays an image for the left eye of the third stereo pair image on the screen of the other game device;
To function as.

A program according to a sixth aspect of the present invention provides a computer,
A message reception unit for receiving messages,
An image receiving unit for receiving the first stereo pair image;
An image generation unit that generates a second stereo pair image including a random dot pattern in which the received message appears to be raised by stereoscopic vision;
An image synthesis unit that obtains a third stereo pair image by synthesizing the first stereo pair image and the second stereo pair image for each image for the right eye and each image for the left eye;
To function as.

  The program of the present invention can be recorded on a computer-readable information recording medium such as a compact disk, flexible disk, hard disk, magneto-optical disk, digital video disk, magnetic tape, and semiconductor memory.

  The above program can be distributed and sold via a computer communication network independently of the computer on which the program is executed. The information recording medium can be distributed and sold independently of the computer.

  According to the present invention, when two information processing apparatuses each having a camera and a monitor are prepared, an image processing system, an image processing apparatus, and an image are displayed on a monitor so that a user can stereoscopically view images captured by these cameras. A processing method and a program can be provided.

1 is a diagram showing a schematic configuration of an image processing system of the present invention. 1 is a schematic diagram illustrating a schematic configuration of a typical portable information processing device in which an image processing device and a game device according to an embodiment of the present invention are realized. It is a figure which shows the external appearance of a portable information processing apparatus. It is a figure which shows a mode that a stereo pair image is image | photographed with two portable information processing apparatuses. (A) It is a figure for demonstrating a 1st stereo pair image. (B) It is a figure for demonstrating a 2nd stereo pair image. (C) It is a figure for demonstrating a 3rd stereo pair image. It is a figure for demonstrating arrangement | positioning of the game device in the case of performing stereoscopic vision with two game devices. It is a figure for demonstrating the image seen stereoscopically. 4 is a flowchart for explaining image processing performed by each unit of the image processing apparatus according to the first embodiment. It is a figure for demonstrating the image displayed when performing a stereoscopic vision with one game device. It is a figure for demonstrating the image displayed on the screen of two game devices. It is a figure for demonstrating arrangement | positioning of the game device in the case of performing stereoscopic vision with two game devices. 10 is a flowchart for explaining image processing performed by each unit of the image processing apparatus according to the second embodiment.

  The image processing system of the present invention controls display of images taken by two game devices so that the user can view the images stereoscopically. There are a plurality of methods for controlling the display of an image, and an image processing system employing each method will be described as Embodiment 1 or 2.

The image processing system according to the first embodiment employs a technique that allows an image to be stereoscopically viewed when two game devices are prepared.
The image processing system according to the second embodiment employs a technique that allows a predetermined image to be stereoscopically viewed when two game devices are prepared and a user of each game device performs a predetermined operation.

As shown in FIG. 1, the image processing system 100 according to each embodiment includes an image processing device 200, a first game device 301, and a second game device 302. The first game device 301 and the second game device 302 are connected to the image processing device 200. Also, the first game device 301 and the second game device 302 are connected to each other. The connection method between the first game device 301 and the second game device 302 and the image processing device 200 and the connection method between the first game device 301 and the second game device 302 are arbitrary.
For example, the image processing apparatus 200 may be connected to each of the first game apparatus 301 and the second game apparatus 302 by peer-to-peer communication, or the first game apparatus 301 and the second game apparatus. 302 may be able to communicate peer to peer with each other. Alternatively, the image processing apparatus 200 may be connected to each of the first game apparatus 301 and the second game apparatus 302 by communication via the Internet, or the first game apparatus 301 and the second game apparatus 302 may be connected to each other. The game devices 302 may be able to communicate with each other via the Internet.

In the embodiment described below, the image processing device 200 is realized by a server device capable of communicating with the first game device 301 and the second game device 302 via the Internet. The server device stores and manages the progress status of the game executed on the first game device 301 and the second game device 302, the battle result of the user of the game device, and the like. Further, it is assumed that the first game device 301 and the second game device 302 can also communicate with each other via the Internet.
However, the image processing system 100 of the present invention is not limited to such a form. For example, the image processing device 200 may be implemented by either the first game device 301 or the second game device 302. Alternatively, assuming that the first game device 301 and the second game device 302 are portable game devices, the image processing device 200 is implemented by a game device installed in a home that can communicate with the portable game device. May be. Alternatively, the image processing device 200 may be another portable game device that can communicate with the portable game device.

Hereinafter, a typical portable information processing apparatus in which the image processing apparatus 200, the first game apparatus 301, and the second game apparatus 302 according to the first or second embodiment are realized will be described.
In the following, for ease of understanding, an embodiment in which the present invention is applied to a portable information processing device will be described. However, the present invention is similarly applied to various computers, PDAs, mobile phones, music players, and the like. can do. That is, the embodiment described below is for explanation, and does not limit the scope of the present invention. Accordingly, those skilled in the art can employ embodiments in which each or all of these elements are replaced with equivalent ones, and these embodiments are also included in the scope of the present invention.

(Outline configuration of portable information processing device)
FIG. 2 is a schematic diagram showing a schematic configuration of a typical portable information processing device in which the image processing device 200, the first game device 301, and the second game device 302 according to each embodiment of the present invention are realized. It is. FIG. 3 shows an external view of the portable information processing apparatus. Hereinafter, description will be given with reference to these drawings.

  The portable information processing apparatus 1 includes a processing control unit 10, a connector 11, a cartridge 12, a wireless communication unit 13, a communication controller 14, a sound amplifier 15, a speaker 16, a microphone 17, and operation keys 18. The 1st display part 19, the 2nd display part 20, the touch panel 21, and the camera 22 are provided.

  The processing control unit 10 includes a CPU (Central Processing Unit) core 10a, an image processing unit 10b, a VRAM (Video Random Access Memory) 10c, a WRAM (Work RAM) 10d, an LCD (Liquid Crystal Display) controller 10e, A touch panel controller 10f.

  The CPU core 10a controls the operation of the entire portable information processing apparatus 1 and is connected to each component to exchange control signals and data. Specifically, a program and data stored in a ROM (Read Only Memory) 12a in the cartridge 12 are read out with the cartridge 12 mounted in the connector 11, and predetermined processing is executed.

  The image processing unit 10b processes the data read from the ROM 12a in the cartridge 12, the data of the image taken by the camera 22, or the data processed by the CPU core 10a, and then processes the processed data into the VRAM 10c. To store.

  The VRAM 10c is a frame memory that stores information for display, and stores image information processed by the image processing unit 10b and the like.

  The WRAM 10d stores work data and the like necessary for the CPU core 10a to execute various processes according to the program.

  The LCD controller 10e controls the first display unit 19 and the second display unit 20 to display a predetermined display image. For example, the LCD controller 10 e converts the image information stored in the VRAM 10 c into a display signal at a predetermined synchronization timing and outputs the display signal to the first display unit 19. The LCD controller 10e displays a predetermined instruction icon or the like on the second display unit 20.

  The touch panel controller 10f detects a touch (touch) on the touch panel 21 by the touch pen 23 or a user's finger. For example, in the state where a predetermined instruction icon or the like is displayed on the second display unit 20, a contact on the touch panel 21 and its position are detected.

  The connector 11 is a terminal that can be detachably connected to the cartridge 12, and transmits / receives predetermined data to / from the cartridge 12 when the cartridge 12 is connected.

The cartridge 12 includes a ROM 12a and a RAM (Random Access Memory) 12b.
The ROM 12a stores a program for realizing the game, image data and sound data associated with the game, and the like.
The RAM 12b stores various data indicating the progress of the game.

The wireless communication unit 13 is a unit that performs wireless communication with the wireless communication unit 13 of another portable information processing apparatus 1 and transmits / receives predetermined data via an antenna (not shown) (not shown). .
The wireless communication unit 13 can also perform wireless LAN communication with a predetermined access point. The wireless communication unit 13 is assigned a unique MAC (Media Access Control) address.

  The communication controller 14 controls the wireless communication unit 13 and mediates communication performed between the processing control unit 10 and the processing control unit 10 of another portable information processing device 1 according to a predetermined protocol.

  The sound amplifier 15 amplifies the audio signal generated by the processing control unit 10 and supplies it to the speaker 16.

  The speaker 16 is composed of, for example, a stereo speaker, and outputs predetermined music sound, sound effect, and the like according to the audio signal amplified by the sound amplifier 15.

  The microphone 17 receives an analog signal such as a user's voice, and the received signal is processed by the processing control unit 10 such as mixing.

  The operation key 18 includes a direction key 18a, a button 18b, and the like that are appropriately arranged in the portable information processing apparatus 1, and receives a predetermined instruction input according to a user operation. The operation key 18 includes a button for adjusting the volume, a knob, and the like.

  The 1st display part 19 and the 2nd display part 20 consist of LCD etc., are controlled by LCD controller 10e, and display a game image etc. suitably.

  The touch panel 21 is disposed so as to be superimposed on the front surface of the second display unit 20 and receives an input by touching the touch pen 23 or the user's finger. The touch panel 21 includes, for example, a pressure-sensitive touch sensor panel and the like, detects the pressure of the user's finger and the like, and detects the contact state, the transition from the contact state to the non-contact state, and the like. In addition, the touch panel 21 may detect contact with a user's finger or the like from a change in capacitance or the like.

  The camera 22 captures a surrounding space or the like according to a user instruction, and converts the captured image into an electrical signal. The camera 22 is composed of, for example, a CMOS (Complimentary MOS) sensor.

  Note that the image processing device 200, the first game device 301, and the second game device 302 according to each embodiment are realized on the above-described typical portable information processing device 1, but a general computer It can also be realized on a game device, and these embodiments are also included in the scope of the present invention. A general computer or game device includes a CPU core, a VRAM, and a WRAM similarly to the portable information processing device 1. In addition, as a communication unit, for example, a NIC (Network Interface Controller) conforming to a standard such as 10BASE-T / 100BASE-T used when configuring a LAN (Local Area Network), a hard disk as a storage device, and a DVD -ROM, magneto-optical disk, etc. can be used. In addition, a keyboard or a mouse is used instead of the touch panel. Then, after the program is installed, when the program is executed, it can function as an information processing apparatus.

  The technique employed by the image processing system 100 of each embodiment is executed by the image processing apparatus 200 included in the image processing system 100. Hereinafter, functions of the image processing apparatus 200 according to the first or second embodiment realized by the portable information processing apparatus 1 will be described with reference to FIGS. 1 to 12. The cartridge 12 storing the game program and data is attached to the connector 11 and the portable information processing apparatus 1 is turned on to execute the program, and the image processing apparatus 200 according to the first or second embodiment is executed. Is realized. Alternatively, when the image processing apparatus 200 is realized by a general computer or the like, the DVD-ROM storing the program and data is mounted on the DVD-ROM drive, and the computer is turned on, thereby The program is executed to realize the image processing apparatus 200 according to the first or second embodiment.

(Embodiment 1)
The image processing apparatus 200 according to the first embodiment executes a technique that allows an image to be stereoscopically viewed when two game apparatuses are prepared.
As illustrated in FIG. 1, the image processing apparatus 200 according to the present embodiment includes a message reception unit 201, an image reception unit 202, an image generation unit 203, an image composition unit 204, and a display unit 205.

The message reception unit 201 is commonly presented to the user of the first game device 301 (hereinafter referred to as “first user”) and the user of the second game device 302 (hereinafter referred to as “second user”). A message 404 to be received is accepted. For example, the message accepting unit 201 accepts a message that one of the first user and the second user has entered in the first game device 301 or the second game device 302 with the touch pen 23 or the like by communication. Alternatively, the two game devices play a common game, and the image processing device 200 (a server device that can communicate with the first game device 301 and the second game device 302 via the Internet) progresses of the game. Is received, the message reception unit 201 reads a common message to be presented to each game device from the WRAM 10d of the image processing device 200 according to a program executed by the image processing device 200.
Therefore, the CPU core 10a, the WRAM 10d, the wireless communication unit 13, and the communication controller 14 cooperate to function as the message receiving unit 201.

The image receiving unit 202 receives the first stereo pair image 401 from the first game device 301 and the second game device 302, and among the first stereo pair image 401, an image for the right eye (hereinafter referred to as “first”). The right eye image 401R ”and the left eye image (hereinafter referred to as“ first left eye image 401L ”) are based on the operations of the first user and the second user. It is an image taken by either the camera 301b of the game device 301 or the camera 302b of the second game device 302.
Therefore, the CPU core 10a, the wireless communication unit 13, and the communication controller 14 cooperate to function as the image receiving unit 202.
In addition, the camera 22 of the portable information processing device 1 in which the first game device 301 and the second game device 302 are realized functions as the cameras 301b and 302b.

FIG. 4 shows a state in which the first game device 301 and the second game device 302 take a stereo pair image by the operations of the first user and the second user.
The first game device 301 and the second game device 302 photograph the subject 405 based on the operations of the first user and the second user. At this time, the first game device 301 and the second game device 302 perform predetermined processing so as to satisfy a condition for generating a stereo pairgram image in which the subject 405 can be viewed stereoscopically while communicating with each other. For example, the first game device 301 receives an image captured by the second game device 302 based on the operation of the second user. Next, the first game device 301 has a feature point in the image captured by the first game device 301 based on an operation of the first user and a feature point in the image received from the second game device 302. And compare. Then, when the first game device 301 and the second game device 302 can shoot an image (stereogram image) in which parallax enabling stereoscopic viewing is enabled, the first game device 301 The user and the second user are notified by voice or text that a stereogram image can be taken.

  When a stereo pair image is captured as shown in FIG. 4, the image receiving unit 202 includes a first game device 301 arranged on the right side of the two game devices as shown in FIG. The captured image is accepted as the first right-eye image 401R, and the image captured by the second game device 302 arranged on the left side is accepted as the first left-eye image 401L.

The image generation unit 203 generates a second stereo pair image 402 having a random dot pattern in which the received message 404 appears to appear in a stereoscopic view. For example, as shown in FIG. 5B, the received message 404 appears to appear as a random dot pattern for the right eye (hereinafter referred to as “second right eye image 402R”) and for the left eye. (Hereinafter referred to as “second left-eye image 402L”).
Therefore, the CPU core 10a, the image processing unit 10b, and the VRAM 10c cooperate to function as the image generation unit 203.

The image synthesizing unit 204 synthesizes the first stereo pair image 401 and the second stereo pair image 402 for each image for the right eye and each image for the left eye, thereby obtaining the third stereo pair image 403. obtain. For example, as illustrated in FIG. 5C, the image composition unit 204 synthesizes the first right-eye image 401R and the second right-eye image 402R to the right of the third stereo pair image 403. An eye image (hereinafter, referred to as a “third right eye image 403R”) is created, and the first left eye image 401L and the second left eye image 402L are combined to form a third stereo. An image for the left eye of the pair image 403 (hereinafter referred to as “third left-eye image 403L”) is created.
Therefore, the CPU core 10a, the image processing unit 10b, and the VRAM 10c cooperate to function as the image composition unit 204.

The display unit 205 displays the third right-eye image 403R on the screen of one game device, and displays the third left-eye image 403L on the screen of the other game device. For example, as shown in FIG. 6, when the first game device 301 and the second game device 302 are arranged, the display unit 205 displays the third right eye on the first game device 301 arranged on the right side. The image 403R for use is transmitted and displayed on the screen 301a, and the third left-eye image 403L is transmitted to the second game device 302 arranged on the left side and displayed on the screen 302a. By displaying in this way, the first user and the second user can visually recognize the message 404 and the subject 405 in a three-dimensional manner as shown in FIG.
Therefore, the CPU core 10a, the image processing unit 10b, and the VRAM 10c cooperate to function as the display unit 203.

(Operation of image processing device)
Hereinafter, operations performed by each unit of the image processing apparatus 200 according to the present embodiment will be described. When the image processing apparatus 200 is turned on and the image processing apparatus 200 receives a message and an instruction to stereoscopically view the captured image from the first game apparatus 301 or the second game apparatus 302, the CPU core 10a The image processing shown in the flowchart of FIG.

  First, the image receiving unit 202 determines whether or not the first stereo pair image 401 has been received (step S101). If the image receiving unit 202 determines that the first stereo pair image 401 has been received (step S101; Yes), then the message receiving unit 201 determines whether or not the message 404 has been received (step S102). On the other hand, when the image reception unit 202 does not determine that the first stereo pair image has been received (step S101; No), the image reception unit 202 waits as it is.

  For example, the image receiving unit 202 receives the first right-eye image 401R (FIG. 5A) from the first game device 301, and the first left-eye image 401L (FIG. 5) from the second game device 302. 5 (a)), the message receiving unit 201 determines whether the message 404 has been received from the first game device 301 or the second game device 302, or whether the message 404 has been read from the WRAM 10d or the like. To do. On the other hand, when the image reception unit 202 has not received any of the first right-eye image 401R and the first left-eye image 401L, or has received only one of the images, the image reception unit 202 waits as it is.

  When the message reception unit 201 determines that the message 404 has been received (step S102; Yes), the image generation unit 203 generates a random dot stereo pair image (second stereo pair image) that allows the received message 404 to be viewed stereoscopically. Generate (step S103). On the other hand, when the message reception unit 201 does not determine that the message 404 has been received (step S102; No), the process returns to step S101 and waits as it is.

  For example, it is assumed that the first user inputs the message 404 to the first game device 301 using the touch pen 23 or the like, and the image generation unit 203 receives the message 404. The image generation unit 203 generates a second stereo pair image of random dots (for example, FIG. 5B) such that the received message 404 can be viewed stereoscopically.

  Next, the image composition unit 204 composes the first stereo pair image 401 and the second stereo pair image 402 to create a third stereo pair image 403 (step S104). For example, the image composition unit 204 composes the first right-eye image 401R and the second right-eye image 402R to create a third right-eye image 403R (FIG. 5C). The first left-eye image 401L and the second left-eye image 402L are combined to create a third left-eye image 403L (FIG. 5C).

  Then, the display unit 205 displays the third right-eye image 403R in the third stereo pair 403 on one game device, and displays the third left-eye image 403L on the other game device (step S3). S105). For example, as shown in FIG. 6, the display unit 205 displays the third right-eye image 403R on the first game device 301 arranged on the right side, and the second game device 302 arranged on the left side. The third left-eye image 403L is displayed.

  According to the present embodiment, since only one image of the stereo pair image is displayed on one game device, the image can be stereoscopically viewed only when two game devices are prepared.

(Embodiment 2)
The image processing apparatus 200 according to the second embodiment executes a technique for allowing a predetermined image to be stereoscopically viewed when two game apparatuses are prepared and a user of each game apparatus performs a predetermined operation.
As illustrated in FIG. 1, the image processing apparatus 200 according to the present embodiment includes a message reception unit 201, an image reception unit 202, an image generation unit 203, an image composition unit 204, and a display unit 205. The message reception unit 201, the image reception unit 202, the image generation unit 203, and the image composition unit 204 of the present embodiment have the same functions as those of the first embodiment. Hereinafter, the display unit 205 having different functions will be described.

The display unit 205 transmits the first left-eye image 401L to the first game device 301 that has captured the first right-eye image 401R, and the second game in which the first left-eye image 401L is captured. The first right-eye image 401R is transmitted to the device 302. Then, as shown in FIG. 9, the display unit 205 displays the first stereo pair image 401 on the screen 301 a of the first game device 301 and the screen 302 a of the second game device 302.
When the first user performs a predetermined operation, the display unit 205 transmits the third right-eye image 403 </ b> R synthesized by the image synthesis unit 204 to the first game device 301. Then, the display unit 205 changes the first left-eye image 401L displayed on the screen 301a to the third right-eye image 403R. On the other hand, when the second user performs a predetermined operation, the display unit 205 transmits the third left-eye image 403L synthesized by the image synthesis unit 204 to the second game device 302. Then, the display unit 205 changes the first right eye image 401R displayed on the screen 302a to the third left eye image 403L. That is, when the image processing apparatus 200 receives an instruction to display the first stereo pair image 401 by the first and second users, the display unit 205 displays each screen 301a, as shown in FIG. The first stereo pair image 401 is displayed on 302a. Then, when the first and second users perform a predetermined operation (for example, pressing the operation key 18) on the first and second game devices 301 and 302, the screen is displayed as shown in FIG. A part of the current image is changed to one image of the third stereo pair image 403. For example, the first game device 301 and the second game device 302 are arranged as shown in FIG. 11, and the first left eye image 401L displayed on the left side of the screen 301a of the first game device 301 is displayed. When the image is changed to the third right-eye image 403R, and the first right-eye image 401R displayed on the right side of the screen 302a of the second game device 302 is changed to the third left-eye image 403L. The message 404 and the subject 405 can be stereoscopically viewed as shown in FIG.
Therefore, the CPU core 10a, the image processing unit 10b, and the VRAM 10c cooperate to function as the display unit 203.

(Operation of image processing device)
Hereinafter, operations performed by each unit of the image processing apparatus 200 according to the present embodiment will be described. When the image processing apparatus 200 is turned on and the image processing apparatus 200 receives an instruction to stereoscopically view the image taken from the first game apparatus 301 or the second game apparatus 302, the CPU core 10a The image processing shown in the flowchart is started. In the flowchart of FIG. 12, steps having the same step numbers as in FIG. 8 perform the same processing as the processing in the flowchart of FIG.

  When the image receiving unit 202 determines that the first stereo pair image has been received (step S101; Yes), one image of the first stereo pair image is transmitted to the game device that has captured the other image (step S201). . For example, the display unit 205 transmits the first left-eye image 401L to the first game device 301 that has captured the first right-eye image 401R, and the second left-side image 401L is captured. The first right-eye image 401R is transmitted to the game device 302.

  Then, the display unit 205 displays the first stereo pair image 401 on the first and second game devices 301 and 302 (step S202). For example, as shown in FIG. 9, the display unit 205 displays the first stereo pair image 401 (for the first right eye) on each of the screen 301 a of the first game device 301 and the screen 302 a of the second game device 302. The image 401R and the first left eye image 401L) are displayed. Thereafter, the image processing apparatus 200 performs the processes shown in step 102 to step S104.

  When the image composition unit 204 creates the third stereo pair image 403 (step S104), the display unit 205 then determines whether or not a predetermined operation has been performed on the first game device 301 and the second game device 302. Judgment is made (step S203). When the display unit 205 determines that a predetermined operation has been performed (step S203; Yes), the display unit 205 changes the first left-eye image 401L displayed on the screen 301a to the third right-eye image 403R. Then, the first right-eye image 401R displayed on the screen 302a is changed to the third left-eye image 403L (step S204). On the other hand, when the display unit 205 determines that the predetermined operation has not been performed (step S203; No), the process returns to step S101.

  For example, a predetermined operation is performed by pressing one of the operation keys 18 provided in the first and second game devices 301 and 302. If the first user presses the button 18b of the first game device 301 and the second user presses the direction key 18a of the second game device 302, the display unit 205 is displayed as shown in FIG. As shown, the image (first left-eye image 401L) displayed on the left side of the screen 301a of the first game device 301 is changed to the third right-eye image 403R, and the second game device 302 The image (first right-eye image 401R) displayed on the right side of the screen 302a is changed to the third left-eye image 403L. When the first and second users arrange the first and second game devices 301 and 302 as shown in FIG. 11, the message 404 and the subject 405 can be stereoscopically viewed as shown in FIG. .

  The predetermined operation is not limited to pressing the operation key 18, and for example, the first game device 301 and the second game device 302 may be brought close to a communicable distance. In addition, when a predetermined operation is performed on the first game device 301, the second game device 302 detects that the predetermined operation is performed on the first game device 301 through communication, and the detection results in the first A predetermined operation may be performed on the second game device 302.

  According to the present embodiment, a message to be presented to the user can be viewed only when the users of the two game devices perform predetermined operations respectively and these game devices are arranged side by side.

  According to the present invention, when two information processing apparatuses each having a camera and a monitor are prepared, an image processing system, an image processing apparatus, and an image are displayed on a monitor so that a user can stereoscopically view images captured by these cameras. A processing method and a program can be provided.

DESCRIPTION OF SYMBOLS 1 Portable information processing apparatus 10 Processing control part 10a CPU core 10b Image processing part 10c VRAM
10d WRAM
10e LCD controller 10f Touch panel controller 11 Connector 12 Cartridge 12a ROM
12b RAM
DESCRIPTION OF SYMBOLS 13 Wireless communication part 14 Communication controller 15 Sound amplifier 16 Speaker 17 Microphone 18 Operation key 18a Direction key 18b Button 19 1st display part 20 2nd display part 21 Touch panel 22 Camera 23 Touch pen 100 Image processing system 200 Image processing apparatus 201 Message Reception unit 202 Image reception unit 203 Image generation unit 204 Image composition unit 205 Display unit 301 First game device 302 Second game device 301a, 302a Screen 301b, 302b Camera 401 First stereo pair image 401R First right eye Image 401L First left eye image 402 Second stereo pair image 402R Second right eye image 402L Second left eye image 403 Third stereo pair image 403R Third right eye image 403L First 3 Left eye image 404 Message 405 subjects

Claims (7)

An image processing system having two game devices each having a camera and a screen,
A message receiving unit for receiving a message to be presented in common to each of the users of the two game devices;
An image receiving unit that receives a first stereo pair image from the two game devices, wherein the right eye image and the left eye image of the first stereo pair image are the two game devices. An image receiving unit that is an image taken by one camera and the other camera,
An image generating unit that generates a second stereo pair image including a random dot pattern in which the received message appears to emerge in stereoscopic view;
An image synthesis unit that obtains a third stereo pair image by synthesizing the first stereo pair image and the second stereo pair image for each image for the right eye and each image for the left eye;
The right-eye image of the third stereo pair image is displayed on the screen of the one game device, and the left-eye image of the third stereo pair image is displayed on the screen of the other game device. A display unit to be
An image processing system comprising: The image processing system according to claim 1,
The display unit
Displaying the first stereo pair image on the respective screens of the two game devices so as to enable stereoscopic viewing;
When the user of the one game device performs a predetermined operation, the left-eye image of the first stereo pair image displayed on the screen of the one game device is changed to the right of the third stereo pair image. When the image is changed to an eye image and the user of the other game device performs a predetermined operation, the right eye image of the first stereo pair image displayed on the screen of the other game device is changed to the third image. An image processing system, wherein the stereo pair image is changed to an image for the left eye. A message reception unit for receiving messages;
An image receiving unit for receiving a first stereo pair image;
An image generating unit that generates a second stereo pair image including a random dot pattern in which the received message appears to emerge in stereoscopic view;
An image synthesis unit that obtains a third stereo pair image by synthesizing the first stereo pair image and the second stereo pair image for each image for the right eye and each image for the left eye;
An image processing apparatus comprising: An image processing method executed by an image processing system having two game devices each including a camera and a screen, and including a message reception unit, an image reception unit, an image generation unit, an image synthesis unit, and a display unit There,
A message accepting step in which the message accepting unit accepts a message to be presented in common to each user of the two game devices;
The image receiving unit receives a first stereo pair image from the two game devices, and a right eye image and a left eye image of the first stereo pair image are the two game devices. An image reception process that is an image taken by one camera and the other camera,
An image generating step in which the image generating unit generates a second stereo pair image composed of a random dot pattern in which the received message appears to emerge in stereoscopic view;
The image synthesizing unit synthesizes the first stereo pair image and the second stereo pair image for each image for the right eye and each image for the left eye, thereby obtaining a third stereo pair image. An image synthesis process;
The display unit displays a right-eye image of the third stereo pair image on the screen of the one game device, and a left-eye image of the third stereo pair image is displayed on the other game. A display process to be displayed on the screen of the device;
An image processing method comprising: An image processing method executed by an image processing apparatus including a message reception unit, an image reception unit, an image generation unit, and an image synthesis unit,
A message receiving step in which the message receiving unit receives a message; and
An image receiving step in which the image receiving unit receives a first stereo pair image;
An image generating step in which the image generating unit generates a second stereo pair image composed of a random dot pattern in which the received message appears to emerge in stereoscopic view;
The image synthesizing unit synthesizes the first stereo pair image and the second stereo pair image for each image for the right eye and each image for the left eye, thereby obtaining a third stereo pair image. An image synthesis process;
An image processing method comprising: A computer connected to two cameras and two screens.
A message receiving unit for receiving a message to be presented in common to each of the users of the two game devices;
An image receiving unit that receives a first stereo pair image from the two game devices, wherein the right eye image and the left eye image of the first stereo pair image are the two game devices. An image receiving unit that is an image taken by one camera and the other camera,
An image generating unit that generates a second stereo pair image including a random dot pattern in which the received message appears to be raised by stereoscopic viewing;
An image synthesis unit that obtains a third stereo pair image by synthesizing the first stereo pair image and the second stereo pair image for each image for the right eye and each image for the left eye;
The right-eye image of the third stereo pair image is displayed on the screen of the one game device, and the left-eye image of the third stereo pair image is displayed on the screen of the other game device. Display section,
A program characterized by functioning as Computer
A message reception unit for receiving messages,
An image receiving unit for receiving the first stereo pair image;
An image generating unit that generates a second stereo pair image including a random dot pattern in which the received message appears to be raised by stereoscopic viewing;
An image synthesis unit that obtains a third stereo pair image by synthesizing the first stereo pair image and the second stereo pair image for each image for the right eye and each image for the left eye;
A program characterized by functioning as

Images