JP5846075B2 - Image data providing device, photography game device, image data providing system, and image generation method - Google Patents

Description

  The present invention relates to an image processing device, an image data providing device, a photography game device, an image data providing system, an image display method, and an image display program.

  2. Description of the Related Art Conventionally, there has been known a photography game device that captures a user with a camera and outputs the photographed image as a photo sticker or a photo card. Since such a photo-playing game device is highly playable or entertaining, an image to be combined with the shot image is selected from a variety of background images and foreground images prepared in advance according to the user's preference. Or a user can freely draw with a touch pen. Such an image generation operation is called graffiti.

  In recent years, the photographed game device directly transmits the image to the portable terminal or the image is once transferred to the server so that the photographed and doodled image can be used on a portable terminal such as a cellular phone. There are some that can be downloaded later on a portable terminal (see, for example, Patent Document 1).

JP 2008-109580 A

  However, when a photographed and doodled image (or a photographed image) is downloaded from a server to a mobile terminal, playability cannot be obtained simply by displaying a list of images or thumbnails on the mobile terminal. This does not change even if the list is displayed (in ascending order or descending order) after sorting by shooting date or the like.

  In view of this, the present invention displays a display in a mode in which playability is sufficiently obtained when a photographed and doodled image (or photographed image) is downloaded from a server to a portable terminal or when an already downloaded image is displayed. It is an object of the present invention to provide a portable terminal, an image data providing device, a photography game device, an image data providing system, an image display method, and an image display program that can be performed.

  The portable terminal of the present invention acquires and displays primary image data generated by a photography game device. The portable terminal includes a receiving unit that receives the primary image data transmitted from the photography game device, a storage unit that stores the primary image data acquired by the receiving unit, a shooting unit, and a display unit. Display processing means for generating a composite image in which the synthesis target image based on the secondary image data based on the primary image data and the photographed image photographed by the photographing means are combined, and displaying the composite image on the display means And.

  According to this configuration, it is possible to generate a composite image in combination with a photographic image photographed by the photographing means on the composition target image related to the secondary image data for composition based on the primary image data in the storage means. Playability can be greatly improved. In addition, since most of the captured image taken by the photography game device is a single color other than the subject, the photographed image data relating to the photographed image uses a chroma key process or a chroma key mask indicating the subject. Thus, an area other than the subject can be accurately deleted or made transparent from the captured image. As a result, it is possible to easily create secondary image data in which only the subject portion is clearly extracted from the captured image, and it is possible to easily create the above-described composite image having a good appearance.

  In the present invention, in the portable terminal, the image data for the compositing target image for creating the composite image is referred to as secondary image data, and the source for creating the secondary image data is the primary data. This is referred to as image data, and is generated by a photography game device or an image data providing device described later. The secondary image data is image data that has been subjected to various processes such as chroma key processing in order to create a composite image. For example, when the image data is created by a photography game device or an image data providing device, The primary image data and the secondary image data are the same. Moreover, the primary image data transmitted from the photography game device may be transmitted directly from the photography game device, or may be transmitted indirectly through another device.

  An image processing apparatus according to the present invention is an image processing apparatus that acquires and displays primary image data generated by a photography game device, and that receives the primary image data transmitted from the photography game device. Receiving means for receiving; storage means for storing the primary image data acquired by the receiving means; and preparation image data relating to a prepared image prepared by a user; a display means; and for combining based on the primary image data. Display processing means for generating a composite image combining the synthesis target image related to the secondary image data and the preparation image, and displaying the composite image on the display means.

  Note that the image processing apparatus according to the present invention can be applied to various apparatuses as long as the primary image data is transmitted from the photography game apparatus and processes the primary image data. Therefore, the “image processing apparatus” includes not only a terminal device such as a personal computer and a portable terminal, but also a server device that transmits and receives data to and from the terminal device. In this image processing apparatus, the “prepared image prepared by the user” is stored in the storage unit of the image processing apparatus from an external storage unit such as a flash memory in addition to the image stored in advance in the image processing apparatus. Images, images downloaded via a network, images transmitted from other terminals, images shot by an image processing apparatus having a shooting function, or images processed by the user are included. Further, the meaning of the primary image data and the secondary image data described above is the same as that of the invention related to the mobile terminal described above.

  The image data providing apparatus of the present invention transmits primary image data to the portable terminal. The image providing apparatus includes server storage means for storing the primary image data, and server transmission means for transmitting the primary image data stored in the server storage means to the portable terminal. In addition, the portable terminal in this invention may be comprised by the image processing apparatus mentioned above.

  Moreover, the photography game device of this invention transmits primary image data to the said portable terminal. The photography game device shoots a photograph including a subject, generates a captured image data based on the photograph, an editing unit generates primary image data for transmission based on the captured image data, and Transmitting means for transmitting primary image data to the portable terminal. Note that the primary image data transmitted from the photography game device may be transmitted directly from the photography game device to the portable terminal, or may be transmitted indirectly through another device. Moreover, the portable terminal in this invention may be comprised by the image processing apparatus mentioned above.

  An image data providing system according to the present invention includes the above-described photography game device, the image data provision device, and the portable terminal, and an output unit of the photography game device provides the primary image data as the above-described primary image data. The image data providing device stores the primary image data transmitted from the photography game device in the server storage means, and the photography game device, the image data providing device, or the The portable terminal generates the primary image data in which at least a subject in the captured image data is left and at least a part of a region other than the subject is deleted or made transparent.

  An image data providing system according to the present invention includes the above-described photography game device and the above-described portable terminal, wherein the photography game device or the portable terminal leaves at least a subject in the photographed image data, and the subject The primary image data in which at least a part of the other area is deleted or made transparent is generated.

  In each of the image data providing systems described above, primary image data created by the photography game device, the image data providing device, or the mobile terminal may be used as secondary image data as it is. In some cases, secondary image data is created. Moreover, the portable terminal in each image data providing system may be configured by the above-described image processing device.

  Further, a first image display method of the present invention includes a photographing unit, a display unit, a receiving unit, and a storage unit, and displays an image on a portable terminal that acquires and displays primary image data generated by a photography game device. Is the method. The image display method includes a step of receiving the primary image data transmitted from the photography game device by a receiving unit, a step of storing the primary image data acquired by the receiving unit in a storage unit, and the shooting A step of photographing an object to be photographed by means, and generating a composite image combining a composition target image related to the secondary image data for composition based on the primary image data and a photographed image photographed by the photographing means, And a step of displaying a composite image on the display means.

  The second image display method of the present invention is an image display method in an image processing apparatus that includes a display means, a reception means, and a storage means, and that acquires and displays primary image data generated by a photography game device. Receiving the primary image data transmitted from the photography game device by a receiving means; storing the primary image data acquired by the receiving means and preparation image data relating to a preparation image prepared by a user; A step of storing in the means, and a step of generating a composite image in which the synthesis target image related to the secondary image data for synthesis based on the primary image data and the preparation image are combined and displaying the composite image on the display means And.

  Further, a first image display program according to the present invention includes a photographing device, a display device, a receiving device, and a storage device, and is a portable terminal computer that acquires and displays primary image data generated by a photography game machine. Receiving the primary image data transmitted from the photography game device by a receiving means; storing the primary image data acquired by the receiving means in a storage means; and taking a picture by the photographing means A step of photographing an object, generating a composite image combining a composite target image related to secondary image data for composition based on the image data and a photographed image photographed by the photographing unit, and displaying the composite image in the display And causing the means to display.

  A second image display program according to the present invention comprises a display means, a reception means, and a storage means, and obtains the primary image data generated by the photography game device and displays it on a computer of an image processing apparatus. The step of receiving the primary image data transmitted from the photography game device by the receiving means, the primary image data acquired by the receiving means, and the preparation image data relating to the preparation image prepared by the user are stored in the storage means. And a step of generating a composite image combining the synthesis target image related to the secondary image data for synthesis based on the image data and the preparation image, and displaying the composite image on the display means. .

  According to the present invention, it is possible to display an image in a mode in which sufficient playability is obtained.

1 is a schematic configuration diagram of an image data providing system according to an embodiment of the present invention. It is a block diagram which shows the physical structure of a web server. It is a block diagram which shows schematic structure of a portable terminal. It is a flowchart which shows the process of an image browsing application. It is a screen displayed on the display of a portable terminal. It is a screen displayed on the display of a portable terminal. It is a screen displayed on the display of a portable terminal. It is a flowchart which shows the process of an image processing application and a compositing process application. It is a screen displayed on the display of a portable terminal. It is a screen displayed on the display of a portable terminal. It is a screen displayed on the display of a portable terminal. It is a screen displayed on the display of a portable terminal. It is a flowchart which shows the other process of a synthetic | combination process application. It is a screen displayed on the display of a portable terminal. It is a screen displayed on the display of a portable terminal. It is a screen displayed on the display of a portable terminal. It is a screen displayed on the display of a portable terminal. It is a screen displayed on the display of a portable terminal. It is a screen displayed on the display of a portable terminal. It is a screen displayed on the display of a portable terminal. It is a screen displayed on the display of a portable terminal. It is a screen displayed on the display of a portable terminal.

  Hereinafter, an embodiment of an image data providing system according to the present invention will be described with reference to the drawings. FIG. 1 is a schematic configuration diagram of an image data providing system according to the present embodiment.

<1. Overall system configuration and operation>
As shown in FIG. 1, the image data providing system includes a photography game device 100 (and a plurality of photography game devices installed in various places) used by a user, and images from the photography game device 100. The image data providing apparatus 200 that transmits data and the mobile terminal 300 used by the user are configured. In this system, an image captured by the photographic game device 100 is transmitted to the image data providing device 200 via a network NW such as a mobile communication network or the Internet that employs a 3G wireless communication system. The information is transmitted from the providing device 200 to the mobile terminal 300. Note that the portable terminal 300 here is not particularly limited as long as it is a portable terminal that can receive and display image data and the like and has a camera function. A personal computer device or the like can also be used.

<2. Photo shooting device>
The photographic game device 100 includes a photographic room 101 in which a user enters, and a photographic unit 102 that shoots the user and acquires a photographic image is attached to the photographing room 101. An editing unit 103 is provided outside the imaging room 101 adjacent to the imaging unit 102. The editing unit 103 receives a user's editing operation such as graffiti on a captured image, and generates a primary edited image obtained by editing the captured image. The editing unit 103 is adjacent to an output unit 104 that outputs an edited image. An imaging unit 102 is disposed inside the imaging room 101. More specifically, the camera of the photographing unit 102 is arranged on the front surface as viewed from the user entering the inside of the photographing room 101. In addition, a single color (for example, blue or green) for chroma key processing is attached to the rear surface, which is the rear surface as viewed from the user who enters the photographing room 101. That is, the user (subject) is photographed with a single color as the background. In this way, an image that is captured so as to include the background of the imaging room 101 and has a single color in which the image area other than the subject is the background of the imaging room is hereinafter referred to as a captured image.

  The shot image shot by the shooting unit 102 is edited by the editing unit 103. For example, a so-called graffiti such as a character, pattern, or figure is input with an input device such as a touch pen, and a primary image superimposed on the captured image is generated. In addition, a primary image can be generated by superimposing previously prepared background images. In addition to the generation of the primary image, the editing unit 103 may also generate a primary image by selecting a background or the like at the shooting unit 102 at the time of shooting and overlaying the selected background images. Then, based on the user's operation, the output unit 104 prints a photograph from the primary image data based on the primary image. In addition, other image data is added to the primary image data described above, and these may be collectively referred to as primary image data.

By the way, the primary image data is transmitted to the image data providing apparatus 200 in the following manner. Further, it may be transmitted directly to the mobile terminal 300. However, these are merely examples, and other embodiments are possible.
(1) A background-integrated photographed image in which a subject image (subject image) and a background image are integrated is transmitted as primary image data.
(2) First, chroma key processing is performed on the above-described captured image. That is, the process of making the single color on the back of the photographing room 101 transparent is performed, and a subject image in which only the subject of the user appears is extracted. Then, in addition to the subject image, primary image data including the selected background image is transmitted.
(3) In addition to the image (subject image) showing only the subject generated by the chroma key process, primary image data including the ID of the selected background image is transmitted. The background image ID is an ID assigned to each selected background image, and does not transmit image data related to the actual background image, but transmits only the ID to the image data providing apparatus 200.
(4) Generate a chroma key mask indicating the subject part during shooting. Then, the primary image data including the chroma key mask in the captured image and / or the background integrated captured image is transmitted to the image data providing apparatus 200.
(5) In addition to the background integrated captured image in which the subject image and the background image are integrated, primary image data including the ID of the background image related to the background integrated captured image is transmitted to the image data providing apparatus 200.

  On the mount on which the photograph is printed, data indicating a play date (that is, year, month, day, and time when the photograph was taken) and an identification number for identifying the primary image data are printed. The primary image data generated from the output unit 104 is transmitted to the image data providing apparatus 200 together with the identification number. Note that the output unit 104 includes a known upload router so that image data can be transmitted through the network NW.

  The identification number is typically a unique serial number (for example, 5 digits) given to each photographic game machine 100 at the time of manufacture, and one transmission within the apparatus (from the first operation after manufacture). It includes a unique number (for example, 7 digits) assigned in order to each time and a checksum (for example, 2 digits). Further, the data indicating the play date is typically written in the primary image data when the primary image data is created with reference to the timekeeping unit in the photographic game machine 100.

<3. Image data providing device>
As shown in FIG. 1, the image data providing apparatus 200 receives the image data from the above-described photography game apparatus 100 and transmits the image data to the portable terminal 300 in response to a request from the portable terminal 300. is there. The image data providing apparatus 200 includes an upload processing server 210, at least one web server 220, and a database server 230. These devices are connected to each other via a predetermined local network (LAN) that conforms to, for example, IEEE 802.3. Note that some or all of these apparatuses may be dedicated hardware, or may be a computer in which software for realizing these functions is installed. In addition, a plurality or all of these functions may be realized by one computer. In the following description, it is assumed that the processing is performed by one web server 220. For example, when a plurality of web servers 220 are used, a processing request from a user using a known load balancer is used. Can be distributed and allocated as appropriate.

  The upload processing server 210 associates the primary image data received from the photography game apparatus 100 with the identification number, and gives it to the database server 230. The database server 230 stores the primary image data received from the upload processing server 210 in association with the identification number. The above-described background image ID and background image data corresponding to each ID can also be stored in the database server 230.

  The portable terminal 300 makes a request for downloading image data with the above identification number. This request is made by an application to be described later. When such a request is made, the web server 220 of the image data providing apparatus 200 reads out the corresponding primary image data from the database server 230 and reduces the reduced image. Data (data related to the thumbnail image) is generated and transmitted to the mobile terminal 300.

The web server 220 transmits the primary image data acquired from the photography game device 100 to the mobile terminal 300 as follows. Here, description will be made in accordance with the numbers (1) to (5) of the primary image data modes described for the photography game apparatus 100.
(1) Primary image data (image data including a background integrated photographed image) acquired from the photographic game device 100 is stored in the database server 230, and this is directly stored in the portable terminal 300 in response to a request from the portable terminal 300. Send. When the background image included in the primary image data is a single color, by making this color transparent, it is possible to extract a subject image in which only the subject in the background integrated photograph image related to the primary image data appears. In this case, the extracted subject image may be further included in the primary image data and transmitted to the mobile terminal 300.
(2) The primary image data (image data including the subject image and the background image) subjected to the chroma key processing in the photography game device 100 is stored in the database server 230, and this is directly received in response to a request from the mobile terminal 300. It transmits to the portable terminal 300.
(3) Since the primary image data transmitted from the photography game device 100 includes the ID of the background image, the following processing is performed. In other words, when receiving a data transmission request from the mobile terminal 300, the web server 220 reads the corresponding primary image data from the database server 230, and reads the stored background image data with reference to the ID. Then, data including the read background image data and the subject image data included in the primary image data transmitted from the photography game device 100 is transmitted to the mobile terminal 300 as primary image data. At this time, the primary image data including the ID of the background image can be transmitted to the portable terminal 300.
(4) The primary image data (the captured image and / or the background-integrated captured image and the image data including the chroma key mask) acquired from the photographic game device 100 is transmitted to the mobile terminal as it is. Alternatively, the image data providing apparatus 200 generates an image obtained by extracting only the subject image from the captured image and / or the background integrated captured image using the chroma key mask included in the primary image data, and transmits the generated image to the mobile terminal 300. can do. In the former case, by using the same method as the latter, it is possible to generate an image in which only the subject image is extracted on the mobile terminal 300 side.
(5) Although the primary image data including the background image ID is transmitted from the photography game device 100, the image data providing device 200 reads the background image data corresponding to the background image ID from the database server 230. In the web server 220, a process for subtracting the read background image from the background integrated photographed image is performed. Thus, when the background image is subtracted from the background integrated photographed image, only the subject image is extracted and the subject image data is generated. Then, primary image data including subject image data is transmitted to the mobile terminal 300. If the web server 220 does not extract the subject image, the read background image and the background integrated photograph image including the read background image are transmitted to the mobile terminal 300 as primary image data. The subject image can be extracted from the background integrated image.

  Note that the image processing shown in the above-described modes (3) to (5) can also be performed by the mobile terminal 300. In the above-described modes (2) to (5), only the subject image can be transmitted to the mobile terminal 300. In this case, the data related to the subject image is secondary image data described later.

  Next, the configuration of the web server 220 will be described with reference to FIG. FIG. 2 is a block diagram showing a physical configuration of the web server 220. As shown in FIG. 2, the web server 220 includes a control unit 222 connected by a bus 221, a memory unit 223 such as a RAM and a ROM, a storage unit 224 including a hard disk drive (HDD), a network interface unit 225, and the like. (Network I / F), a display unit 226 including a liquid crystal panel or CRT, an input unit 227 including a keyboard and a mouse, and a DVD drive unit 228 are provided. The control unit 222 includes a CPU (Central Processing Unit) that performs various calculations and implements various functions. In the memory unit 223, a program executed by the control unit 222 in order to implement these various functions is expanded. . The storage unit 224 stores various types of information such as a program to be described later executed by the control unit 222 and image data. The background image ID and the background image data corresponding to each ID can be stored in the storage unit 224 in addition to the database server 230. The network I / F unit 225 transmits / receives data to / from other servers via the LAN. The configuration of the web server 220 shown in FIG. 2 is the same as that of a general computer and is the same as that of the other web server 220 and database server 230, and thus detailed description thereof is omitted.

  The functions of these components shown in FIG. 2 are typically realized by the control unit 222 executing a predetermined program expanded in the memory unit 223. Here, the program is provided by, for example, a DVD-ROM that is a recording medium on which the program is recorded. That is, a DVD-ROM as a recording medium for the program is mounted on a DVD-ROM driving device 228 built in as an auxiliary storage device, and the program is read from the DVD-ROM to store the storage unit 224 (or other storage). Device) (typically installed). The program may be provided via a recording medium other than a DVD-ROM or a communication line. For example, when a predetermined operation for starting the web server 220 is performed, the predetermined program installed in the storage unit 224 is transferred to the memory unit 223 and expanded (temporarily stored) there. This is executed by the unit 222. Thereby, the control processing of the web server 220 and the database server 230 described above is realized.

<4. Mobile device>
Next, the mobile terminal 300 will be described. FIG. 3 is a block diagram showing a schematic configuration of the portable terminal.

  As shown in FIG. 3, the mobile terminal 300 includes a short-range wireless communication unit 310, a control unit 320, a communication circuit 330, a display unit 340, an input unit 350, a memory unit 360, a non-connection, which are electrically connected via a bus 301. A contact communication unit 370, a camera unit 380, and a sensor unit 390 are provided. Hereinafter, each part will be described.

  The control unit 320 is configured by a CPU (Central Processing Unit) and the like, and mainly performs control of each part and execution of various programs described below. In addition, as the functional block, a display processing unit that mainly combines a synthesis target image, which will be described later, and a captured image captured by the camera unit 380 and displays the combined image or a display method such as a position of the synthesis target image. And image acquisition means for acquiring a still image of the composite image as composite image data, and image processing means for generating secondary image data in which unnecessary areas are deleted or made transparent from the primary image data.

  The memory unit 360 includes a ROM (Read Only Memory) and a RAM (Random Access Memory) as built-in memories. The ROM stores an OS (Operating System), a control program for the control unit 320 to control each unit, an application program, and the like. In addition, this ROM includes a rewritable ROM such as NAND-type flash memory (NAND-type flash memory) or EEPROM (Electrically Erasable Programmable Read-Only Memory), content data handled by various application programs, Information related to each content data is stored. For example, it is possible to store a telephone number, an e-mail address, image data or moving image data transmitted from a camera or the outside, music, and the like. For image data, more specifically, downloaded primary image data (including thumbnail images) and secondary image data subjected to image processing are stored. In addition, as will be described later, an application for downloading primary image data from the image data providing apparatus 200, an application for synthesizing a captured image captured by the camera and the downloaded synthesis target image, and the like are also stored. On the other hand, the RAM functions as a temporary work area for each program and data executed by the control unit 320.

  A communication antenna is connected to the communication circuit 330 and transmits and receives signal radio waves for data communication such as a telephone call and an e-mail. The communication circuit 330 performs frequency conversion, modulation, demodulation, and the like of transmission / reception signals.

  The display unit 340 includes a display device such as a liquid crystal display and a display driving circuit for the display, and displays, for example, characters and images on the display by an image signal from the control unit 320. In addition, a moving image and a still image captured by a camera unit 380 described later can be displayed in real time.

  The input unit 350 includes a capacitive or resistive touch panel, a touch pen, various button keys, and the like. A shutter of the camera unit 380 described later is also included here. In the case of a normal personal computer, a mouse and a keyboard are also included. Hereinafter, an example in which the input unit 350 is configured by a touch panel will be mainly described.

  The short-range wireless communication unit 310 uses a short-range wireless communication antenna (not shown), for example, a short-range wireless communication using a so-called Bluetooth (registered trademark) method, a UWB (Ultra Wide Band) method, a wireless LAN (Local Area Network), or the like. Communicate. The short-range wireless communication unit 310 performs general control of short-range wireless communication and exchanges data with the control unit 320. An infrared communication unit for performing infrared communication can also be incorporated.

  The non-contact communication unit 370 performs non-contact communication used in, for example, a so-called RFID (Radio Frequency-Identification), a non-contact type IC card, or the like through a non-contact communication antenna (not shown).

  The camera unit 380 is a built-in camera for taking a still image or a moving image, and includes an optical lens and an imaging device, a lens driving mechanism for driving the optical lens for focusing and changing zoom magnification, a driving circuit for the lens driving mechanism, and an imaging circuit. The image processing circuit includes an image processing circuit that performs image processing on an image pickup signal from the element. The captured image data obtained by the camera unit 380 is accumulated in the memory unit 330 by the control unit 320.

  The sensor unit 390 is configured by an acceleration sensor, a gyro sensor, or the like. And the inclination of the display of the display part 340 is detected, and the control part 320 changes the inclination of the image displayed on the display part 340 according to the detected inclination. It is also used to detect an impact received by the mobile terminal 300.

  In addition, although not illustrated, the mobile terminal 300 includes a speaker, a microphone, an external interface, a battery, and the like provided in a general mobile phone.

<5. Mobile terminal applications>
Next, an image processing application stored in the mobile phone 300 will be described. Here, an image browsing application that downloads and browses image data from the image data providing apparatus 200, an image processing application that performs chroma key processing of the downloaded primary image data, and a captured image and chroma key processing that are captured by the camera of the mobile terminal 300 are used. A composition processing application that synthesizes and displays the secondary image data performed will be described.

<6. Image viewing application and its operation>
Hereinafter, the image browsing application will be described with reference to FIGS. FIG. 4 is a flowchart showing the processing of the image browsing application, and FIGS. 5 to 7 are screens displayed on the display 340 of the mobile terminal 300. When the download application is activated in the portable terminal 300, the screen of FIG. 5 is displayed (S410). On this screen, the user is prompted to enter an identification number. As described above, the identification number is a number written on the mount of the photograph printed by the photography game apparatus 100. When this identification number is input and the “OK button” is pressed (S420), the portable terminal 300 accesses the image data providing apparatus 200 and requests download of the corresponding primary image data (S430). The image data providing apparatus 200 receives this request (S510), and determines whether or not the identification number is correct (S520). If the identification number is not correct (NO in S520), a message to that effect is transmitted to the portable terminal 200, and the user is prompted to input the identification number again (S420). If the identification number is correct, the request is accepted (YES in S520), a thumbnail image of the corresponding primary image data is created and transmitted to the mobile terminal 300 (S530). As a result, a list of downloaded primary image data is displayed as a thumbnail image A on the display 340 of the mobile terminal 300 as shown in FIG. 6 (S440). When the thumbnail image A desired to be browsed is pressed (S450), a request is transmitted from the portable terminal 300 to the image data providing apparatus 200, which is accepted by the image data providing apparatus 200 (S540). Thereby, the image data providing apparatus 200 reads the corresponding primary image data from the database server 230 and transmits it to the mobile terminal 300 (S550). As a result, on the mobile terminal 300, an image as shown in FIG. 7 is displayed and can be browsed (S460). The downloaded primary image data (including thumbnail images) is stored in the memory unit 360.

<7. Image processing application and its operation>
Next, an application for performing chroma key processing on primary image data will be described with reference to FIGS. FIG. 8 is a flowchart showing processing of the image processing application, and FIGS. 9 and 10 are screens displayed on the display 340 of the mobile terminal 300. The primary image data processed here corresponds to the image data including the background integrated photographed image or the photographed image shown in the aspect (1) among the five aspects described above. First, as shown in FIG. 8, an image to be processed is displayed from the image browsing application described above (S610). That is, the primary image related to the primary image data is opened by the above-described procedure as shown in FIG. When the image processing icon B at the bottom of the screen is pressed, the image processing application is activated as shown in FIG. 9 (S620). Next, the background is made transparent by chroma key processing (processing for converting pixels of a predetermined color to transparent) (S630). In the example of FIG. 9, the background D of the subject of the primary image is a single color, the color of the background D is automatically recognized, and the color portion is made transparent. At this time, if the button 351 at the bottom of the display 350 is touched with a finger and slid to the right, the chroma key process is performed, and the background D changes to transparent as shown in FIG. 10 (S640). At this time, when the slide amount of the button 351 is increased, the color similar to the background D is made transparent in addition to the color of the background D, so that the user can slide the button 351 while watching the degree of transparency. Do. According to this, for example, even if the background portion in the background integrated photographed image is not a complete single color as in the background D, but is composed of a plurality of similar colors, only the subject image can be extracted cleanly. .

  As the chroma key processing performed here, a known one can be used. As described above, the mobile terminal 300 automatically recognizes the background D and performs semi-automatic chroma key processing such that the degree of transparency is manually input. Yes. In addition, the user can arbitrarily select a location where chroma key processing is performed. Thereby, even when the background image constituting the background integrated photograph image is not a single color like the background D, the subject image can be extracted by removing the background portion. Hereinafter, image data that has been subjected to chroma key processing is referred to as secondary image data, and an image other than a transparent background is referred to as a synthesis target image. The transparent area becomes an unnecessary area of the present invention. Here, the image to be processed is read from the image browsing application. However, the image processing application is started to read the primary image data stored in the mobile terminal 300 or the image data providing apparatus 200. To download primary image data. The procedure in that case is the same as that of the image browsing application. Such processing is mainly performed by image processing means in the functional block. When primary image data other than the above-described aspect (1) is transmitted, it is not necessary to perform chroma key processing in the portable terminal 300. That is, since the primary image data in a mode in which only the subject image can be extracted is transmitted to the mobile terminal 300, the mobile terminal 300 extracts only the subject image data from the primary image data, and uses this as the secondary image data. And At this time, the subject image is the above-described composition target image. Although not shown, the image processing application identifies the received primary image data, and generates secondary image data automatically or after receiving a user's instruction if it is other than mode (1). It can also be configured to.

<8. Composition processing application and its operation>
Next, the synthesis processing application will be described with reference to FIGS. The flowchart continues to use that shown in FIG. 11 and 12 are screens displayed on the display 340 of the mobile terminal 300. FIG. Here, a composition processing application is started from the image processing application, and an image is composed. When the lower button E is pressed on the operation screen of the image processing application shown in FIG. 10, the composition processing application is activated (S650). At the same time, the camera unit 380 of the mobile terminal 300 is also activated, and as shown in FIG. 11, the captured image Y captured by the camera unit 380 is displayed in real time on the background of the compositing target image X that has been subjected to chroma key processing. . As a result, a synthesized image obtained by synthesizing the synthesis target image X and the captured image Y is displayed on the display (S660). In this state, while moving the housing of the mobile terminal 300, when an object to be used as a background is selected and the shutter 350 is pressed (YES in S670), the composite image is stored as composite image data that is a still image. The information is stored in the unit 360 (S680). Since the captured image is displayed in real time, when the mobile terminal 300 is moved without the shutter 350 being pressed (NO in S670), the captured image is displayed on the display 340 like a moving image. Thereby, the virtual world which combined the real world and the photograph can be enjoyed.

  In this example, the compositing target image X is displayed at the bottom of the display 340. However, the display position and the like can be arbitrarily changed. For example, at least one of the position, size, and rotation angle of the compositing target image X can be freely set by operating the input unit 350. In particular, when the input unit 350 is configured by a touch panel, such an operation can be simplified using a finger or a touch pen. Such an operation can also be performed by giving an impact to the housing of the mobile terminal 300. For example, as shown in FIG. 12, when the right side of the casing of the portable terminal 300 is tapped with a finger, this is detected by the sensor unit 390, and the control unit 320 detects that the compositing target image X is on the opposite side, that is, the casing. Display to move to the left side of the body. That is, the composition target image X can be configured to move to the side opposite to the hit side.

  When the surface of the display 340 is hit, the compositing target image X is reduced so as to indicate that the display 340 moves toward the rear side of the housing. On the other hand, when the back side of the casing is hit, the compositing target image X is enlarged. Further, the above setting can be performed either before or after the generation of a still image. Furthermore, it is also possible to detect the strength of hitting the casing (impact level) and determine the distance that the compositing target image X moves based on this. Such processing is mainly performed by display processing means and image acquisition means in the functional block.

  Further, the composition processing application can also perform the following processing. This process will be described with reference to FIGS. FIG. 13 is a flowchart showing processing of the image processing application, and FIGS. 14 to 16 are screens displayed on the display 340 of the mobile terminal 300. First, as shown in FIG. 14, an image to be processed is displayed on the display (S710). At this time, the primary image not subjected to the chroma key process is displayed, but the secondary image described above may be used. There are various display procedures. For example, as shown in FIG. 7, in the state where the primary image is displayed by the image browsing application, a method of starting the composition processing application by pressing the lower icon F is available. is there. Thus, when the composition processing application is activated (S720) and an image to be processed is displayed, an area to be deleted is selected in the image. For example, an area to be deleted is selected by tracing a part of the image with a touch pen or a finger. Thereby, as shown in FIG. 15, a part of image is deleted and displayed (S730). Thereafter, when the icon G at the bottom of the display 340 is pressed, in the deleted area Z, as shown in FIG. 16, the captured image captured by the camera unit 380 is displayed in real time, and a composite image is generated ( S740). In this state, when the subject to be adopted is selected while moving the housing of the mobile terminal 300 and the shutter 350 is pressed (YES in S750), the memory unit 360 is used as composite image data in which the composite image is a still image. (S760). Such processing is mainly performed by the image processing means, display processing means, and image acquisition means in the functional block. Further, the deleted area Z described above becomes an unnecessary area of the present invention. When the composite image is stored in the memory unit 360, as described above, the composite image can be fixed by pressing the shutter to generate a still image, or after the composite image is generated, a predetermined image can be generated. A still image can be automatically generated when time elapses.

  In addition, when the mobile terminal 300 is tilted while the composition processing application as described above is activated, the sensor unit 390 detects this and displays on the display 340 according to the tilt. For example, in the example of FIG. 11, an image is displayed on the vertically long display 340, but the extending direction of the display 340 is detected as the vertical direction, and the image is displayed in accordance with the vertically long display 340. When the mobile terminal 300 is tilted 90 degrees from here, the sensor unit 390 detects this, and the composite image is tilted 90 degrees and displayed on the display 340 as shown in FIG. At this time, the position of the compositing target image X is moved from the lower part of the display 340 to the center, but the position of the compositing target image X can be arbitrarily set.

  The synthesized image synthesized as described above can be stored in the memory unit 360 in various modes. That is, in addition to the mode in which the synthesis target image and the captured image are integrated, the captured image can be stored in a mode that enables separation.

<9. Effect>
As described above, in the image data providing system in the present embodiment, the primary image photographed and scribbled in the photography game apparatus is transmitted from the photography game apparatus 100 to the image data provision apparatus 200 and stored. Thereafter, after the mobile terminal 300 downloads, a composite image can be generated in combination with the captured image Y captured by the camera unit 380 of the mobile terminal 300. Therefore, it is possible not only to download image data shot with the photo shooting game device 100 but also to combine freely downloaded images and downloaded images in different environments, so that playability can be greatly improved. . In addition, since most of the captured image captured by the photographic game device 100 is a single color other than the subject, the captured image data relating to the captured image uses chroma key processing, a chroma key mask indicating the subject, or the like. Thus, the area other than the subject can be accurately deleted or made transparent from the captured image. Therefore, as described above, primary image data that can easily extract the subject as in the modes (1) to (5) can be generated. As a result, it is possible to easily create secondary image data in which only the subject portion is clearly extracted from the captured image, and it is possible to easily create the above-described composite image having a good appearance.

<10. Modification>
As mentioned above, although one Embodiment of this invention was described, this invention is not limited to the said embodiment, A various change is possible unless it deviates from the meaning.

<10-1>
In the above embodiment, the image data is transmitted from the photography game device 100 to the portable terminal 300 via the image data providing device 200. However, the image data is transmitted directly from the photography game device 100 to the portable terminal 300. You can also In this case, image data can be transmitted by infrared communication or short-range wireless communication. In addition, when the user inputs an e-mail address to the photographic game machine 100, a mail with image data attached can be transmitted to the address.

<10-2>
In the above embodiment, the thumbnail image shown in FIG. 6 has been described as being created by the web server 220 from the primary image stored in the database server 230 and transmitted to the mobile terminal 300. However, the image data providing apparatus 200 The primary image may be transmitted without transmitting such reduced image data. In this configuration, since the data transmission amount becomes large, it takes a transmission time, and since the image reduction processing is performed in the mobile terminal 300, it takes a processing time and further needs to be temporarily stored in the mobile terminal 300. Squeeze 300 memory capacity. However, when the user selects the thumbnail image by pressing the thumbnail image to see the primary image, it is not necessary to download the primary image from the database server 230, so the primary image can be displayed instantaneously. It is preferable in that it can be performed. In addition, the load of image reduction processing in the web server 220 can be reduced.

<10-3>
In the above-described embodiment, image data is downloaded, viewed, and edited by a dedicated application program. However, a control language for displaying various operation screens such as operation screens in the web server 220 is created to create a portable terminal. The mobile terminal 300 may be configured to display the various operation screens on the mobile screen by using a display application such as a web browser for interpreting and displaying these control languages. Further, as a method for acquiring image data, for example, a URL corresponding to the image data providing apparatus 200 can be accessed from the mobile terminal 300. For example, this URL includes a URL portion corresponding to the image data providing apparatus 200 and a URL portion corresponding to the primary image data constituting the primary image to be downloaded. For example, “http: // decopika. jp / ~ / select.aspx? did = 012345678901 ". In this notation example, the numeric part is a URL part corresponding to primary image data constituting the primary image to be downloaded, and is a unique identification number associated with the primary image data constituting the primary image. Since the URL portion corresponding to the image data providing apparatus 200 is determined in advance and the identification number is given by the photography game apparatus 100, the photography game apparatus 100 easily creates this URL and transmits it to the portable terminal 300. can do. Instead of the identification number, identification data that can be distinguished from other image data such as a file name and a folder name may be used.

<10-4>
In the above embodiment, the primary image, which is an image before thumbnail image reduction, is created in the photography game apparatus 100 and transmitted from the photography game apparatus 100 to the image data providing apparatus 200. The image data may be captured by the mobile terminal 300 or another mobile terminal and transmitted to the image data providing apparatus 200, or primary image data stored in various computer devices other than the mobile terminal may be stored in the image data providing apparatus 200. It may be configured to be transmitted. Furthermore, it is also possible to synthesize an image with a composition processing application using image data stored in advance on the portable terminal, photographed image data shot with the portable terminal, or primary image data created with the portable terminal. . In order to create primary image data with a portable terminal, for example, as shown in FIG. 18, a primary image can be created by arbitrarily inputting characters, graphics, and the like from an input device. The primary image data can be subjected to chroma key processing by an image processing application to obtain secondary image data, and the compositing target image that is the image can be combined with the captured image by the combining processing application.

<10-5>
In the composition processing application, secondary image data that has been subjected to chroma key processing or the like in the image processing application is used. However, the primary edited image data is used by the editing unit 102 of the photography game device 100 or the web server 220 of the image data providing device 200. Can be made into secondary image data by performing chroma key processing or the like in advance and then transmitted to the portable terminal 300. Thereby, it is not necessary to perform chroma key processing in the mobile terminal 300, and the load can be reduced. Moreover, when transmitting secondary image data from the photography game device 100 or the image data providing device 200, it can be transmitted together with the primary image data, and the transmitted secondary image data is directly used in the composition processing application. You can also.

<10-6>
In the above embodiment, the chroma key process is performed. In the photographic game device 100, a chroma key mask indicating the captured image and the subject portion is generated, and the chroma key mask is used to generate the chroma key mask from the captured image (primary image). A subject (composition target image) can also be extracted. This extraction process can be performed by the photography game device 100, the image data providing device 200, or the portable terminal 300. However, when the extraction process is performed by the image data providing apparatus 200 or the portable terminal 300, it is necessary to obtain a chroma key mask indicating the subject portion of the photographed image (primary image) to be extracted from the photography game apparatus 100. . Therefore, the primary image data in this case further includes a chroma key mask corresponding to the primary image data described above.
<10-7>
Note that the secondary image data is not limited to data obtained by making a background other than the subject transparent or deleted (for example, see FIGS. 7 to 10), for example, a graffiti given by a photography game device or a portable terminal, etc. The additional image can be left together with the subject. In this case, as described above, chroma key processing corresponding to the color of the background of the primary image (the region other than the subject and the additional image in the primary image) is performed, or a chroma key mask indicating the subject and the additional image (chroma key mask indicating the additional image). In this case, the background (the area other than the subject and the additional image in the primary image) may be made transparent or deleted by image processing using a device that generates a graffiti for generating the additional image.

<10-8>
In the above embodiment, one image is combined with a captured image captured by the camera unit 380, but two or more images can be combined. For example, it is possible to select two or more images from the image browsing application and display them on the display 340 during execution of the composition processing application. At this time, at least one of a position, a size, and a rotation angle at which two or more images are displayed can be arbitrarily designated. Further, both the image selected by the browsing application and the sentence graphic selected as shown in FIG. 18 can be displayed on the display 340 during execution of the composition processing application.

<10-9>
By the way, in the said embodiment, in the synthetic | combination processing application, a photograph is image | photographed and this is combined with a synthetic | combination object image, and the synthetic | combination image is produced | generated. Hereinafter, this example will be described with reference to FIGS. 19 to 22 are screens of the composition processing application displayed on the display of the portable terminal. First, a composition processing application configured as shown in FIG. 19 is launched to display a desired image. The processing up to this point is the same as the processing until the synthesis processing application shown in FIG. 9 is started and is not shown in the figure. For example, when an arbitrary button is pressed from the viewing software shown in FIG. The composition processing application starts.

  In this application, subject image data is extracted from primary image data transmitted from the image data providing apparatus 200 automatically or by inputting an instruction and displayed on the display 340. As shown in FIG. 19, the display 340 is partitioned into a rectangular image display unit 340 a and a graffiti icon unit 340 b below it. The image display unit 340a displays only the extracted subject image, and the background D displays an arbitrary color or pattern. In the graffiti icon portion 340b, icons for performing a fine pen P1, a bold pen P2, UNDO (return) P3, REDO (forward) P4, background color selection P5, and background image selection P6 are arranged from the left side of FIG. Has been. However, these are only examples, and various graffiti icons can be appropriately arranged.

  For example, when a fine pen icon P1 is touched, as shown in FIG. 20, a palette M1 for selecting a pen color is displayed on the image display unit 340a, and an image is displayed after touching any color icon. Graffiti can be performed on the part 340a. When the background image icon P6 is touched, a plurality of background image candidates are displayed as shown in FIG. This background image is an image stored in advance in the mobile terminal 300, an image stored in the storage means of the mobile terminal 300 from an external storage means such as a flash memory, an image downloaded via a network, another terminal , Images taken by the mobile terminal 300, or those processed by the user (these may be referred to as preparation images). When a desired background image is touched, the selected background image is displayed on the background portion D of the image display unit 340a as shown in FIG. That is, a combined image obtained by combining the subject image and the background image is displayed on the image display unit 340a. The synthesized image synthesized in this way can be saved as image data in which the background image and the subject image are integrated, or can be saved in a state where the background image and the subject image can be separated.

  Further, the background of the synthesized image synthesized in this way can be further changed. In particular, when the subject image and the background image in the composite image are integrated, the subject image can be extracted from the composite image by using the chroma key mask related to the subject image of the composite image. Is possible.

  Further, on the screen on which the composition processing application shown in FIGS. 19 to 22 is executed, a button 351 for chroma key processing as shown in FIG. 9 and a button E for starting the camera can be further arranged. When the button 351 is slid in a state where the composite image is displayed on the image display unit 340a, only the subject image related to the composite image is extracted from the displayed composite image by the method described above. When the button E is pressed, as shown in FIG. 11, the captured image Y captured by the camera unit 380 is displayed in real time as the background image of the extracted subject image (hereinafter referred to as “background real time display”), and thereafter Each processing described in FIG. 11 is performed. When only the subject image is displayed on the image display unit 340a, each processing shown in FIG. 11 is performed using the subject image as it is. When the icon P1 is touched during the background real-time display, the image display area 340a can be doodled with a pen while the background real-time display is continued. Similar graffiti can be performed when the captured image Y is a still image.

  However, when the primary image data is generated in the above-described modes (2) to (5), it is not necessary to press the button 351 for chroma key processing, but only by pressing the button E for starting the camera. Thus, only the subject image is extracted, and real-time background display as shown in FIG. 11 can be performed.

  In the above example, since only the subject image can be extracted and displayed based on the image data transmitted to the mobile terminal 300, the user can freely select or switch the background of the subject image. In this way, if the background image can be changed as appropriate by the user, even if the subject image is the same, the impression of the entire image can be greatly changed, so that playability can be greatly improved. In addition to the background image, graffiti can be performed, so that playability can be further improved.

  The selection / change of the background image and the graffiti process can be performed on the application of the portable terminal 300 as described above, or can be performed on the image data providing apparatus 200. In other words, a composite image can be generated by combining any background image and subject image stored in the image data providing apparatus 200 by an operation from the mobile terminal 300. These processes are performed on the image data providing apparatus 200, and the composite image can be downloaded and viewed or stored in the mobile terminal 300. Further, processing such as movement, rotation, enlargement, and reduction of the subject image can be performed by the same method as described with reference to FIGS. Furthermore, a background image can be arbitrarily set for the primary image created by the mobile terminal 300 as shown in FIG.

  Moreover, although the description according to FIGS. 19 to 22 described above describes the image processing in the portable terminal 300, such image processing is not limited to the portable terminal, and data is transmitted / received to / from the portable terminal. It can also be done on the server that performs In other words, the composition processing of the subject image and the background image can be performed on the server in accordance with a command from the portable terminal. Alternatively, image processing for automatically selecting an arbitrary background image or the like on the server and compositing them can be performed.

DESCRIPTION OF SYMBOLS 100 ... Photographing game device 102 ... Shooting part 103 ... Editing part 104 ... Output part 200 ... Image data provision apparatus 220 ... Web server (server transmission means)
230 ... Database server (server storage means)
300 ... mobile terminal 320 ... control unit (display processing means, image processing means, image acquisition means)
350 ... input unit (input means)
360 ... Memory unit (storage means)

Claims (4)

From the photographic game device that generates a photographic image in which the subject is photographed and a mask indicating the subject portion in the photographic image, the photographic image and a mask corresponding to the subject in the photographic image are received, and from the mobile terminal An image data providing apparatus that transmits data related to an image based on the captured image and the mask to the portable terminal according to an instruction,
Receiving the captured image and the mask transmitted from the photography game device;
An image data providing apparatus configured to perform processing for extracting an image related to a subject from the captured image corresponding to the mask using the received mask. A photography game device for transmitting image data to the image data providing device according to claim 1,
A part for photographing a subject and obtaining a photographed image;
Based on the captured image, a part for generating a mask indicating a subject portion in the captured image;
A portion for transmitting the captured image and the mask corresponding to the captured image to the image data providing device;
A photography game device equipped with. The image data providing device according to claim 1;
A photography game device according to claim 2;
Instructing the image data providing apparatus to transmit data related to the image based on the captured image and the mask, and a portable terminal having display means;
With
The said portable terminal is an image data provision system which displays on the said display means the synthesized image which synthesize | combined the image for predetermined | prescribed synthesis | combination and the image concerning the said object. In the photographic game device, based on a photographed image obtained by photographing the subject, generating a mask indicating the subject portion in the photographed image;
Transmitting the captured image and the mask corresponding to the captured image from the photographic game device to an image data providing device;
In the image data providing device, using the received mask, performing a process of extracting an image related to a subject from the captured image corresponding to the mask;
Synthesizes a predetermined image for synthesis with the extracted image related to the subject in response to a request from the mobile terminal by a user operation;
An image generation method comprising: