JP2010160595A - Three-dimensional image providing device, three-dimensional image providing program, three-dimensional image creating method, and terminal device, terminal control program, terminal control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To quickly and easily create a three-dimensional image with high precision. <P>SOLUTION: As shown in (1) (a), when a user of a cellular phone presses a shutter key 1a halfway toward an object person F, as shown (1) (b), a distance of each part of an object person F is measured, after this, when the user fully presses the shutter key 1a, the plane image of the object person F is stored as a face image. When the face image and the distance data showing the distance of the each part of the face image are transmitted to a management server from the cellular phone, the management server, as shown in (2), creates the distance data measured for each part and a three-dimensional face image F1 corresponding to the photographed face image F. The created three-dimensional face image F1 is transmitted to the cellular phone. Therefore, even if the image of the object person F is a plane image, only by a simple operation such that the object is photographed with the cellular phone, it is possible to quickly and easily display the three-dimensional face image F1 corresponding to the object. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a stereoscopic image providing device, a stereoscopic image providing program, a stereoscopic image creating method, a terminal device, a terminal control program, and a terminal control method.

  Conventionally, for example, a technique described in Patent Document 1 is known as a three-dimensional (three-dimensional) face image creation device that creates a three-dimensional face image. This three-dimensional face image creation device inputs face image data of a planar (two-dimensional) side face and front face, and inputs feature points such as contours. Then, the conversion program extracts a facial feature parameter based on the difference between the feature point data and the feature data of the 3D standard face data, and uses this to convert the 3D standard face data to 3D facial data. And output to the image display device (see, for example, Patent Document 1).

Japanese Patent Application Laid-Open No. 11-30952

  However, in the prior art, planar (two-dimensional) face image data is used and converted into three-dimensional facial data by a conversion program to create a three-dimensional (three-dimensional) face image. For this reason, not only processing such as conversion by the conversion program takes time, but also a highly accurate three-dimensional face due to a conversion error that unavoidably occurs when converting 2D face image data to 3D face image data. It was difficult to create an image.

  The present invention has been made in view of such conventional problems, and provides a stereoscopic image providing apparatus, a stereoscopic image providing program, a stereoscopic image creating method, and a method capable of quickly and easily creating a highly accurate stereoscopic (three-dimensional) image, and It aims at a terminal device, a terminal control program, and a terminal control method.

  In order to solve the above-described problem, in the stereoscopic image providing apparatus according to the first aspect of the present invention, a receiving unit that receives a planar image and imaging distance data for each part in the planar image, and the receiving unit receives the planar image. And a creation unit that creates a stereoscopic image from the planar image using the imaging distance data for each part, and a transmission unit that transmits the stereoscopic image created by the creation unit to the outside. To do.

  In the stereoscopic image providing apparatus according to the second aspect of the present invention, the first receiving means for receiving the planar image and the photographing distance data for each part in the planar image, and the first receiving means Using the received imaging distance data for each of the parts, a creating unit that creates a stereoscopic image from the planar image, a second receiving unit that receives desired deformation content in the stereoscopic image, and a second receiving unit The deformation processing means for partially deforming the stereoscopic image created by the creating means based on the desired deformation content received by the transmission means, and the transmission means for transmitting the stereoscopic image deformed by the deformation processing means to the outside And.

  Further, in the stereoscopic image providing apparatus according to the invention of claim 3, the creating means detects the unevenness of the planar image based on the difference in the photographing distance data with respect to each part, and the detected unevenness The stereoscopic image is created based on the above.

  In the stereoscopic image providing apparatus according to claim 4, the planar image received by the receiving unit is a face image, and the shooting distance data indicates a shooting distance for each part of the face image. It is characterized by being data.

  Further, in the stereoscopic image providing apparatus according to the invention of claim 5, the second receiving means receives the desired deformation content in the face image, and the deformation processing means is the second receiving means. The three-dimensional face image created by the creating means is partially deformed based on the desired deformation content in the face image received by.

  In the stereoscopic image providing apparatus according to claim 6, the planar image received by the receiving means is a plurality of subject images in which a plurality of subjects exist, and the shooting distance data is the plurality of subjects. Data indicating the shooting distance for each subject.

  In the stereoscopic image providing apparatus according to claim 7, the second receiving unit receives desired deformation content in the plurality of subject images, and the deformation processing unit is the second receiving unit. The position of the subject in the stereoscopic image created by the creating means is changed based on the desired deformation content in the plurality of subject images received by the means.

  In the stereoscopic image providing program according to the eighth aspect of the present invention, the computer included in the stereoscopic image providing apparatus receives a planar image and imaging distance data for each part in the planar image, A creation means for creating a stereoscopic image from the planar image using the photographing distance data for each part received by the reception means, and a transmission means for transmitting the stereoscopic image created by the creation means to the outside It is made to function.

  In the three-dimensional image providing program according to the ninth aspect of the present invention, the computer having the three-dimensional image providing device receives the plane image and the photographing distance data for each part in the plane image. And creating means for creating a stereoscopic image from the planar image using the imaging distance data for each part received by the first receiving means, and second reception for receiving the desired deformation content in the stereoscopic image. Means, a deformation processing means for partially deforming the stereoscopic image created by the creating means based on the desired deformation content received by the second receiving means, and the deformation processing performed by the deformation processing means It is characterized by functioning as transmission means for transmitting a stereoscopic image to the outside.

  In the stereoscopic image creating method according to the invention of claim 10, a receiving step for receiving a planar image and photographing distance data for each part in the planar image, and each part received by the receiving step. Using the shooting distance data, a creation step for creating a stereoscopic image from the planar image, and a transmission step for transmitting the stereoscopic image created by the creation step to the outside.

  In the three-dimensional image creation method according to the invention described in claim 11, the first receiving step of receiving the planar image and the photographing distance data for each part in the planar image, and the first receiving step Using the received imaging distance data for each of the parts, a creation step for creating a stereoscopic image from the planar image, a second reception step for receiving desired deformation content in the stereoscopic image, and a second reception step A deformation processing step for partially deforming the stereoscopic image created by the creation step based on the desired deformation content received by the transmission step, and a transmission step for transmitting the stereoscopic image deformed by the deformation processing step to the outside It is characterized by including these.

  Further, in the terminal device according to the invention of claim 12, the imaging means, the distance measuring means for measuring the photographing distance for each part of the image taken by the imaging means, and the image taken by the imaging means A transmission unit that transmits an image and imaging distance data for each part measured by the distance measuring unit, and a stereoscopic image that is transmitted from the outside and created from the planar image using the imaging distance data for each part Receiving means, and display means for displaying the stereoscopic image received by the receiving means.

  In the terminal device according to the thirteenth aspect of the present invention, the image pickup means, the distance measurement means for measuring the shooting distance for each part of the image picked up by the image pickup means, and the image pickup means A first transmission means for transmitting the image and the imaging distance data for each part measured by the distance measurement means, a second transmission means for transmitting the desired deformation content in the stereoscopic image, and an external transmission. Receiving means for receiving a stereoscopic image created from the planar image using the photographing distance data for each part and then partially deformed based on the desired deformation content, and the stereoscopic image received by the receiving means Display means for displaying.

  In the terminal device according to the fourteenth aspect of the present invention, the image picked up by the image pickup means is a face image, and the distance measuring means measures the photographing distance for each part of the face image. It is characterized by.

  In the terminal device according to the invention described in claim 15, the second transmission means transmits the desired deformation content in the face image.

  In the terminal device according to the sixteenth aspect of the present invention, the image picked up by the image pickup means is a plurality of subject images in which a plurality of subjects are present, and the distance measuring means is a subject in the plurality of subjects. It is characterized by measuring the shooting distance for each.

  In the terminal device according to the invention as set forth in claim 17, the second transmission means transmits desired deformation contents in the plurality of subject images.

  In the terminal control program according to the invention described in claim 18, the distance measuring means for measuring the photographing distance for each part of the image picked up by the image pick-up means using the computer included in the terminal device having the image pick-up means. And transmission means for transmitting the image captured by the imaging means and the imaging distance data for each part measured by the distance measuring means, and using the imaging distance data for each part transmitted from the outside. The receiving unit is configured to function as a receiving unit that receives a stereoscopic image created from the planar image and a display control unit that displays the stereoscopic image received by the receiving unit.

  In the terminal control program according to the invention as set forth in claim 19, the distance measuring means for measuring the photographing distance for each part of the image picked up by the image pick-up means by using the computer included in the terminal device having the image pick-up means. A first transmission unit that transmits the image captured by the imaging unit and the imaging distance data for each region measured by the ranging unit; and a second transmission unit that transmits the desired deformation content in the stereoscopic image. A transmission means, a reception means for receiving a stereoscopic image which is transmitted from the outside and is created from the planar image using the imaging distance data for each part and then partially deformed based on the desired deformation content; and It is made to function as a display control means for displaying the stereoscopic image received by the receiving means.

  In the terminal control method according to the twentieth aspect of the invention, the imaging step, the distance measuring step for measuring the imaging distance for each part of the image captured by the imaging step, and the imaging step are used. A transmission step for transmitting the image and the imaging distance data for each part measured in the distance measuring step; and a three-dimensional image generated from the planar image using the imaging distance data for each part transmitted from the outside. A receiving step for receiving an image; and a display step for displaying the stereoscopic image received by the receiving step.

  In the terminal control method according to the invention described in claim 21, the imaging step, the distance measuring step for measuring the imaging distance for each part of the image captured by the imaging step, and the imaging step are used. A first transmission step for transmitting the image and the imaging distance data for each part measured in the distance measurement step, a second transmission step for transmitting the desired deformation content in the stereoscopic image, and an external transmission. A reception step of receiving a stereoscopic image created from the planar image using the imaging distance data for each part and then partially deformed based on the desired deformation content; and the stereoscopic image received by the reception step And a display step for displaying an image.

  According to the stereoscopic image providing apparatus, the stereoscopic image providing program, and the stereoscopic image creating method according to the present invention, it is possible to quickly and easily create a highly accurate stereoscopic (three-dimensional) image. In addition, it is possible to quickly and easily create a stereoscopic image in which each part of the face is deformed according to the user's wishes.

  Further, according to the terminal device, the terminal control program, and the terminal control method according to the present invention, it is possible to quickly and easily obtain a highly accurate three-dimensional (three-dimensional) image from the captured image. In addition, it is possible to quickly and easily obtain a stereoscopic image obtained by adding a desired change to a captured image.

It is a block diagram which shows the structure of the image transmission / reception system which concerns on the 1st Embodiment of this invention. It is a block diagram which shows the detail of the management server in the image transmission / reception system of FIG. It is a block diagram which shows the structure of the mobile telephone in the image transmission / reception system of FIG. It is a flowchart which shows the process sequence of the mobile telephone and management server in the 1st Embodiment of this invention. It is explanatory drawing which shows the process outline | summary of the process of a mobile telephone and the management server in the embodiment. It is a figure which shows the memory | storage state of RAM of the mobile telephone in FIG. It is a flowchart which shows the process sequence of the mobile telephone and management server in the 2nd Embodiment of this invention. It is a figure which shows the deformation | transformation request screen with respect to the site | part in the embodiment. It is explanatory drawing which shows the process outline | summary of the process of a mobile telephone and the management server in the embodiment. It is a flowchart which shows the process sequence of the mobile telephone and management server in the 3rd Embodiment of this invention. It is explanatory drawing which shows the process outline | summary of the process of a mobile telephone and the management server in the embodiment. It is a figure which shows the arrangement | positioning change desired screen with respect to the to-be-photographed object in the embodiment.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of an image transmission / reception system according to the present embodiment.
In the figure, a mobile phone 1 that functions as a terminal device of the present invention has a call function, a photographing function, and an image transmission / reception function. The radio base station 2 connects the mobile phone 1 to a communication service provider (including an Internet provider) 4 to which the mobile phone 1 subscribes.

  A communication service provider (including an Internet provider) 4 is connected to a WWW (Internet) 5 (to be described later) in addition to a communication circuit processing unit 41 required for a mobile phone service provided as a main service ( Web server 43) and a mail system (mail server 42). In addition, a function for connecting the mobile phone 1 to the WWW 5 with the wireless base station 2 as an AP (access point) is also provided. The image providing service company 6 includes a system (Web server 61) for connecting to the WWW 5 and a management server 63.

  FIG. 2 is a block diagram showing details of the management server 63, and the Web server 61 is connected to the management server 63 via a hub 64. In the management server 63, an input operation unit (keyboard, mouse, etc.) 631, a control unit (main frame) 632, a system program storage unit 633, an image data management table 62, a display unit 635, and a communication control unit 636 are mutually connected by a system bus. Connected to the system. The control unit 632 includes a work RAM 634. The mobile phone 1 operated by the registrant performs a service such as distributing data (image information) or downloading it for a fee. The system program storage unit 633 stores a program and the like shown by a flowchart described later.

FIG. 3 is a block diagram showing the configuration of the mobile phone 1 used in this embodiment.
The wireless unit 121 is connected to the antenna 103, and performs communication processing including modulation / demodulation based on the PSK method and terminal authentication processing based on the CDMA method. The control unit 122 controls the device and performs WWW connection control. The control unit 122 includes a communication data processing unit 1221, a system ROM 1222, and an audio interface 1223. The communication data processing unit 1221 includes a CELP vocoder & speech decoding processing circuit, a packet data generation circuit, and a packet data restoration circuit, and performs data processing according to the communication protocol.

  The system ROM 1222 stores a basic system such as an OS and is provided with a subscriber information storage unit 1224. The subscriber information storage unit 1224 stores a terminal ID and subscriber ID information, which are IDs specific to the mobile phone 1 that are necessary for negotiation with the base station 2. The audio interface 1223 inputs and outputs audio signals processed by the communication data processing unit 1221. The speaker 101, the microphone 114, and the recording microphone 115 are connected to the audio interface 1223. The input unit 104 includes a shutter key 1a, a numeric keypad 1b, and the like.

  The address / data bus processing unit 123 controls / manages data input / output timing and the like between the control unit 122 and peripheral circuits (circuits within a broken line frame). The RAM 124 stores various data generated in the mobile phone 1 such as address book data and mail data. A program ROM (NAND Flash) 125 includes a program shown in a flowchart to be described later, a mail processing program, a web processing system program for storing a browser, an image compression / decompression processing program compliant with the JPEG, MPEG (-2, -4) system, Utility (environment software) programs and other application programs are stored, and these programs are selected and loaded into the control unit 122 in accordance with user operations. The sound source IC 126 stores and outputs the waveform of the notification sound. The amplifier 127 amplifies the output from the sound source IC 126, and the notification speaker 120 reproduces it.

  The display module system driver 128 drives the main display unit 102, the sub display unit 116, the notification LED 117, and the flash LED 119. The imaging device 130 includes a CCD or the like on which a subject image is formed by an imaging lens 118 having an AF function, and the DSP 129 processes an image signal from the imaging device 130 in accordance with the operation of the shutter key 1a or the like. Is. The distance measuring sensor 131 is a distance between the mobile phone 1 and each part of the subject's face (see FIG. 5B (see FIG. 9B)) or from the mobile phone 1 to a plurality of subjects (subjects). This is a known sensor that detects a distance (see FIG. 11B).

(First embodiment)
Next, the operation of the first embodiment according to the above configuration will be described with reference to FIG.
The management server 63 connected to the mobile phone 1 shown in FIG. 4A executes processing as shown in FIG. 4B based on the program stored in the system program storage unit 633 shown in FIG. .
First, a composite image creation service providing HP (homepage) is displayed on the display unit 635 (step B1).

On the other hand, the mobile phone 1 connected to the management server 63 executes processing as shown in FIG. 3A based on the program stored in the program ROM 125 shown in FIG.
That is, the management server 63 is accessed via the base station 2, WWW 5 and the like according to the operation of the input unit 104 by the user (step A1).

  Then, the management server 63 determines whether or not this access has been received (step B2). If it is determined that the access has been received, the management server 63 transmits an HP (homepage) screen or the like to the mobile phone 1 (step B3). The cellular phone 1 receives the HP screen transmitted from the management server 63 and displays it on the main display unit 102, and stores the received program or the like in the RAM 124 (step A2).

  Next, the cellular phone 1 determines whether or not the shutter key 1a provided in the input unit 104 has been half-pressed (step A3). If it is determined that the shutter key 1a is half-pressed, the imaging lens 118 is controlled to execute AF (autofocus) control (step A4) to focus the subject. Therefore, when the user presses the shutter key 1a halfway with the imaging lens 118 facing the face of the subject person, the face image F of the subject person is in focus as shown in FIG. A state is formed.

  Next, the image recognition is performed for each part “eyes”, “nose”, “mouth”,... Of the face image F (step A5). In addition, what is necessary is just to employ | adopt a well-known image recognition technique suitably regarding this image recognition. Subsequently, the distance measuring sensor 131 is operated to measure the distances L1, L2, L3... From the mobile phone 1 for each part of the face image F recognized in step A5 (step A6).

  When measuring the distances L1, L2, L3... For each part in the face image F, a plurality of distance measuring sensors 131a to 131c are provided as indicated by solid lines in FIG. The distance sensors 131a to 131c may be operated to measure the distance for each part, or as shown by the dotted line, only a single distance sensor 131a is provided, and the distance sensor 131a is provided. The distance for each part may be measured by operating over time.

  Thereafter, it is determined whether or not the shutter key 1a is fully pressed (step A7). If the shutter key 1a is fully pressed, the photographing process is performed, and an image formed on the imaging device 130 by the imaging lens 118, that is, the face image F is captured (step A8).

  Further, distances L1, L2, L3 (see FIG. 5B) to each part of the face image F taken in step A8 and the face image F measured in step A6 are stored in a predetermined storage area of the RAM 124. (Step A9). As a result, as shown in FIG. 6, the captured image area 124 a and the distance area 124 b of the RAM 124 of the mobile phone 1 include a captured face image F and a distance Lm to “eyes” that are each part of the face image F. The distance Lh to the “nose”, the distance Lk to the “mouth”, etc. are stored.

  When the face image F and the distance data to each part of the face image F are stored in the RAM 124 in this way, the face image F and the distance data stored in the RAM 124 are transmitted to the management server 63 (step A10). .

  When these face image F and distance data are transmitted from the mobile phone 1, the management server 63 determines whether or not they have been received (step B4). If it is determined that the face image F and the distance data from the mobile phone 1 have been received, the management server 63 executes a process of creating a stereoscopic image using the received face image and distance data for each part. (Step B5).

That is, as described above, the management server 63 determines the face image F, the distance Lm to each “eye” that is each part of the face image F, the distance Lh to the “nose”, the distance Lk to the “mouth”.・ Acquired etc. Therefore, the uneven shape of each part in the face can be specified from the size of the distances Lm, Lh, Lk.
For example, as shown in FIG. 5 (2), the height ΔH of the nose H in the face image F is a distance Lh to the “nose” and a distance from the surrounding region, for example, a distance Lm to the “eye”, or Difference from distance Lk to “mouth”,
ΔH = Lh-Lm
Or
ΔH = Lh-Lk
It becomes.

  A three-dimensional face image F1 corresponding to the planar face image F reflecting the difference in distance between the specific part and the surrounding part is created for each part. That is, a three-dimensional face image F1 that is the same as or similar to the planar face image F is created.

  As described above, using the distance data to each part of the face actually measured and the planar image including the photographed subject F, a high-precision solid (three-dimensional) corresponding to the distance to each part is obtained. A face image can be created quickly and easily.

  When the creation of the stereoscopic image F1 corresponding to the face image F is completed, the created stereoscopic face image F1 is transmitted to the mobile phone 1 (step B6). Then, the mobile phone 1 determines whether or not the stereoscopic image F1 has been received (step A11). If it is determined that the stereoscopic image F1 has been received, the mobile phone 1 displays the stereoscopic face image F1 on the main display unit 102 (step A12). .

  Therefore, on the mobile phone 1 side, the three-dimensional face image F1 corresponding to the photographed planar face image F can be viewed and viewed on the main display unit 102 by a simple key operation of half-pressing and fully pressing the shutter key 1a. it can.

(Second Embodiment)
FIG. 7 is a flowchart showing a processing procedure in the second embodiment of the present invention.
Similarly, the management server 63 connected to the mobile phone 1 shown in FIG. 7A executes processing as shown in FIG. 7B based on the program stored in the system program storage unit 633.
That is, in the processing on the mobile phone 1 side shown in FIG. 7A, the processing in steps A101 to A110 is the same as the processing in steps A1 to A10 in FIG.
When the face image F and the distance data to each part of the face image F are stored in the RAM 124 in this way, the face image F and the distance data stored in the RAM 124 are transmitted to the management server 63 (step A110). . When these face image F and distance data are transmitted from the mobile phone 1, the management server 63 determines whether or not they have been received (step B104). If it is determined that the face image F and distance data from the mobile phone 1 have been received, the management server 63 executes a process of creating a stereoscopic image F2 using the received face image and distance data for each part. (Step B105).

Then, in step A111 following step A110, the desired part / content for deformation is transmitted. In the process at step A111, the cellular phone 1 causes the main display unit 102 to display desired deformation screens 102a for a plurality of parts as shown in FIG. This desired deformation screen 102a displays desired options “Large, Small”, “High, Low”, etc. for each part of the face “eyes”, “nose”, “mouth”,.
When the user selects an option desired to be deformed for each part of the face by an operation on the input unit 104, the selection is completed by adding a circle to the selected option of the part.
In the example of FIG. 8, “high” in which the part “nose” is desired to be raised is marked with a circle. The cellular phone 1 transmits the selection data of the desired deformation screen 102a to which the desired selection for the part has been added with the circle to the management server 63 as the desired part content.

  Then, the management server 63 determines whether or not the selection data for the desired deformation screen 102a has been received (step B106). If it is determined that the selected data has been received, the management server 63 responds to the received contents of the desired deformation portion. Then, the previously created stereoscopic image F1 is deformed (step B107).

That is, as shown in (a) and (b) of FIG. 9 (1), if a face image F having distances L1, L2, L3,. As described above, the height ΔH of the nose H is
ΔH = Lh-Lm
Or
ΔH = Lh-Lk
It is.

  However, in the deformation request screen 102a transmitted from the mobile phone 1, “high” for increasing the region “nose” is marked with “高 く”. Therefore, in the management server 63, as shown in FIG. 9 (2), “α” is added to the original nose height ΔH in the stereoscopic face image F1 created as described above. Then, a process of transforming the original nose height ΔH in the three-dimensional face image F1 to a desired nose height LH obtained by adding “α”, that is, LH = ΔH + α is executed. As a result, the three-dimensional face image F2 deformed to the height desired by the nose LH = ΔH + α is created.

  Therefore, it is possible to quickly and easily create a three-dimensional face image F2 in which each part of the face is deformed according to the user's desire.

  When the creation of the 3D face image F2 corresponding to the face image F whose part has been deformed as desired is completed, the created 3D face image is transmitted to the mobile phone 1 (step B108). Then, the mobile phone 1 determines whether or not this stereoscopic face image F2 has been received (step A112). If it is determined that it has been received, the mobile phone 1 displays the stereoscopic face image F2 on the main display unit 102 (step A113). .

  Therefore, on the mobile phone 1 side, even if the photographed face image is a planar face image by an extremely simple operation of photographing the image by pressing the shutter key 1a halfway and fully, then selecting a desired deformation option for the part. A three-dimensional face image obtained by deforming a desired part can be visually recognized and viewed on the main display unit 102.

(Third embodiment)
FIG. 10 is a flowchart showing a processing procedure in the third embodiment of the present invention.
Similarly, the management server 63 connected to the mobile phone 1 shown in FIG. 10A executes processing as shown in FIG. 10B based on the program stored in the system program storage unit 633.
That is, in the processing on the mobile phone 1 side shown in FIG. 10A, the processing in steps A201 to A204 is the same as the processing in steps A1 to A4 in FIG. Accordingly, when the user presses the shutter key 1a halfway with the imaging lens 118 facing a plurality of subject persons, an image including the subject persons A, B, and C is obtained as shown in FIG. As a result, an image is formed on the imaging device 130.

  Next, a plurality of subject images formed on the imaging device 130 are identified and recognized (step A205). Subsequently, as shown in FIG. 11 (1), the distance measuring sensor 131 is operated, and the distance from the mobile phone 1 for each of the plurality of subjects (subjects A, B, C) recognized in step A205. La, Lb, Lc... Are measured (step A206).

  When measuring the distances La, Lb, Lc... For each of these subjects (subject persons A, B, C), as described above, as shown by the solid line in FIG. To 131c and each distance sensor 131a to 131c may be operated to measure the distance for each part, or only a single distance sensor 131a is provided as shown by the dotted line, The distance sensor 131a may be operated over time to measure the distance for each part.

  Thereafter, it is determined whether or not the shutter key 1a has been fully pressed (step A207). If the shutter key 1a is fully pressed, the photographing process is performed, and an image formed on the imaging device 130 by the imaging lens 118 is captured (step A208).

  Further, the plurality of subject images taken in step A208 and the distances La, Lb, Lc... To the subject persons A, B, C measured in step A206 are stored in a predetermined storage area of the RAM 124 (step A209). ). Thus, if the image including the subject persons A, B, and C and the distance data to the subject persons A, B, and C are stored in the RAM 124, a plurality of subject images and shooting distance data stored in the RAM 124 are stored. Are transmitted to the management server 63 (step A210).

  When the plurality of subject images and shooting distance data are transmitted from the mobile phone 1, the management server 63 determines whether or not these are received (step B204). If it is determined that a plurality of subject images and photographing distance data from the mobile phone 1 have been received, the management server 63 executes a process of creating a stereoscopic image using the received images and distance data for each part. (Step B205).

  That is, as described above, the management server 63 acquires the images including the subject persons A, B, and C and the distances La, Lb, and Lc to the subject persons A, B, and C. Therefore, the front-rear positional relationship of the subject persons A, B, and C is clarified by the differences in the distances La, Lb, and Lc for each part of the face. Then, a stereoscopic face image including subject persons A1, B1, and C1 corresponding to images including the subject persons A, B, and C is created by reflecting the relative front-rear positional relationship of the subject persons A, B, and C.

  In this stereoscopic image, since the front-rear positional relationship is determined using the distances La, Lb, and Lc to the actually measured subject persons A, B, and C, a highly accurate stereoscopic (3 (Dimensional) image and a highly accurate stereoscopic image can be created quickly and easily.

On the other hand, in step A211 following step A210, the position / content of the subject whose arrangement is desired to be changed with respect to each subject is transmitted. At the time of the processing in step A2111, the cellular phone 1 causes the main display unit 102 to display an arrangement change request screen 102b for the subject as shown in FIG.
The desired choices “+ α” and “−α” are displayed for each recognized subject person A, B, C,. “+ Α” means moving the subject away, and “−α” means moving the subject closer. When the user selects an option whose arrangement is desired to be changed for each subject person through an operation on the input unit 104, the selected option is marked with a circle and the selection is completed. When a numerical value is input for “α”, the numerical value is set as a value of “+ α” or “−α”. The mobile phone 1 transmits to the management server 63 as selection data of the layout change request screen 102b in which “+ α” or “−α” is set.

  Then, the management server 63 determines whether or not the selection data for the layout change request screen 102b has been received (step B206). The image is rearranged (step B207).

  That is, as shown in FIG. 11 (1), if the subject persons A, B, and C having the distances La, Lb, and Lc are photographed, the original positional relationship in the image including the subject persons A, B, and C is taken. Is in the state of (a) of FIG. However, if “+ α” or “−α” is set for the subject person in the layout change request screen 102b transmitted from the mobile phone 1, the subject person is displayed as shown in FIG. Is a stereoscopic image moved in the front-rear direction according to the value of “+ α” or “−α”. Therefore, by appropriately setting “+ α” or “−α”, as shown in FIG. 11B, it is possible to form a stereoscopic image in which the subject persons A, B, and C are linearly arranged in rows.

  Therefore, it is possible to quickly and easily create a stereoscopic image in which each subject is rearranged according to the user's desire.

  When the creation of the stereoscopic image of the image including the subject persons A, B, and C whose positions have been changed as desired is completed, the created stereoscopic image is transmitted to the mobile phone 1 (step B208). Then, the cellular phone 1 determines whether or not this stereoscopic image has been received (step A212), and if received, displays the stereoscopic image on the main display unit 102 (step A213).

  Therefore, on the mobile phone 1 side, after shooting by half-pressing and fully pressing the shutter key 1a, a three-dimensional image in which the subject included in the photographed image is rearranged by a simple operation of selecting a desired option. Can be visually recognized and viewed on the main display unit 102.

  In this embodiment, the subject is a person, but the subject is not limited to this. Other types of subjects such as animals, buildings, and home appliances may be used.

  In this embodiment, a mobile phone is used. However, the present invention is not limited to this, and a digital camera may be used.

DESCRIPTION OF SYMBOLS 1 Cellular phone 63 Management server 102 Main display part 102a Deformation desired screen 102b Arrangement change desired screen 118 Imaging lens 124 RAM
125 program ROM
128 Display Module Driver 129 DSP
DESCRIPTION OF SYMBOLS 130 Imaging device 131 Distance sensor 632 Control part 633 System program memory | storage part 634 RAM
635 Display unit 636 Communication control unit F Face image

Claims (21)

Receiving means for receiving a planar image including a subject and photographing distance data for each part of the subject;
Creating means for creating a stereoscopic image from the planar image received by the receiving means, using the imaging distance data for each part received by the receiving means;
Transmitting means for transmitting the stereoscopic image created by the creating means to the outside;
A stereoscopic image providing device comprising: First receiving means for receiving a planar image including a subject and imaging distance data for each part of the subject;
Creating means for creating a stereoscopic image from the planar image received by the first receiving means, using the imaging distance data for each part received by the first receiving means;
Second receiving means for receiving desired deformation contents in the stereoscopic image created by the creating means;
Deformation processing means for partially deforming the stereoscopic image created by the creation means based on the desired deformation content received by the second receiving means;
Transmitting means for transmitting the stereoscopic image deformed by the deformation processing means to the outside;
A stereoscopic image providing device comprising: The stereoscopic image providing apparatus according to claim 1, wherein the creating unit creates a stereoscopic image having unevenness corresponding to the size of the photographing distance data for each part from the planar image. The stereoscopic image providing apparatus according to claim 1, wherein the planar image is a face image, and the shooting distance data is data indicating a shooting distance for each part of the face image. The second receiving means receives the desired deformation content in the face image,
The deformation processing means partially deforms the stereoscopic face image created by the creation means based on the desired deformation content in the face image received by the second receiving means. The three-dimensional image providing device described. 4. The stereoscopic image providing apparatus according to claim 1, wherein the subject is a plurality of subjects, and the shooting distance data is distance data indicating a shooting distance for each of the plurality of subjects. The second receiving means receives desired deformation contents in the plurality of subjects,
The deformation processing unit changes the positions of the plurality of subjects in the stereoscopic image created by the creating unit based on the desired deformation contents of the plurality of subjects received by the second receiving unit. The stereoscopic image providing apparatus according to claim 6. A computer included in the stereoscopic image providing apparatus,
Receiving means for receiving a planar image including a subject and photographing distance data for each part of the subject;
Creating means for creating a stereoscopic image from the planar image received by the receiving means, using the imaging distance data for each part received by the receiving means;
Transmitting means for transmitting the stereoscopic image created by the creating means to the outside;
3D image providing program characterized in that the program is made to function. A computer included in the stereoscopic image providing apparatus,
First receiving means for receiving a planar image including a subject and imaging distance data for each part of the subject;
Creating means for creating a stereoscopic image from the planar image received by the first receiving means, using the imaging distance data for each part received by the first receiving means;
Second receiving means for receiving desired deformation contents in the stereoscopic image created by the creating means;
Deformation processing means for partially deforming the stereoscopic image created by the creation means based on the desired deformation content received by the second receiving means;
Transmitting means for transmitting the stereoscopic image deformed by the deformation processing means to the outside;
3D image providing program characterized in that the program is made to function. A receiving step for receiving a planar image including the subject and photographing distance data for each part of the subject;
A creation step for creating a stereoscopic image from the planar image received by the reception step using the imaging distance data for each part received by the reception step;
A transmission step of transmitting the stereoscopic image created by this creation step to the outside;
A method of creating a stereoscopic image, comprising: A first receiving step of receiving a planar image including a subject and imaging distance data for each part of the subject;
A creation step of creating a stereoscopic image from the planar image received by the first reception step using the imaging distance data for each part received by the first reception step;
A second receiving step of receiving the desired deformation content in the stereoscopic image created by the creating step;
A deformation processing step for partially deforming the stereoscopic image created by the creation step based on the desired deformation content received by the second reception step;
A transmission step for transmitting the stereoscopic image transformed by the transformation processing step to the outside;
A method of creating a stereoscopic image, comprising: In a terminal device having a display unit for displaying an image,
Imaging means for imaging a subject;
Ranging means for measuring the photographing distance for each part of the subject imaged by the imaging means;
Transmitting means for transmitting a planar image including a subject imaged by the imaging means and photographing distance data indicating a photographing distance measured by the distance measuring means;
Receiving means for receiving a stereoscopic image created from the planar image using the planar image transmitted by the transmitting means and the imaging distance data for each region;
Display control means for displaying the stereoscopic image received by the receiving means on the display unit;
A terminal device comprising: In a terminal device having a display unit for displaying an image,
Imaging means for imaging a subject;
Ranging means for measuring the photographing distance for each part of the subject imaged by the imaging means;
First transmission means for transmitting a planar image including a subject imaged by the imaging means and imaging distance data indicating an imaging distance for each part measured by the distance measuring means;
Second transmission means for transmitting the desired deformation content in the stereoscopic image;
Of the first stereoscopic image created from the planar image using the planar image transmitted by the first transmitting unit and the imaging distance data for each part, transmitted by the second transmitting unit. Receiving means for receiving a second stereoscopic image after being partially deformed based on the desired deformation content;
Display control means for displaying the second stereoscopic image received by the receiving means on the display unit;
A terminal device comprising: The planar image is a face image;
The terminal device according to claim 12, wherein the distance measuring unit measures an imaging distance for each part in the face image. The terminal device according to claim 14, wherein the second transmission unit transmits desired deformation content in the face image. The planar image is a plurality of subject images representing a plurality of subjects,
The terminal device according to claim 12 or 13, wherein the distance measuring unit measures a shooting distance for each subject in the plurality of subject images. The terminal device according to claim 16, wherein the second transmission unit transmits desired deformation contents in the plurality of subject images. A computer included in a terminal device including an imaging unit,
Ranging means for measuring the photographing distance for each part of the subject imaged by the imaging means;
Transmitting means for transmitting a planar image including a subject imaged by the imaging means and photographing distance data indicating a photographing distance measured by the distance measuring means;
Receiving means for receiving a stereoscopic image created from the planar image using the planar image transmitted by the transmitting means and the imaging distance data for each region;
Display control means for displaying the stereoscopic image received by the receiving means on the display unit;
Terminal control program characterized in that it is made to function. A computer included in a terminal device including a display unit for displaying an image and an imaging unit,
Ranging means for measuring the photographing distance for each part of the subject imaged by the imaging means;
First transmission means for transmitting a planar image including a subject imaged by the imaging means and imaging distance data indicating an imaging distance for each part measured by the distance measuring means;
Second transmission means for transmitting the desired deformation content in the stereoscopic image;
Of the first stereoscopic image created from the planar image using the planar image transmitted by the first transmitting unit and the imaging distance data for each part, transmitted by the second transmitting unit. Receiving means for receiving a second stereoscopic image after being partially deformed based on the desired deformation content;
Display control means for displaying the second stereoscopic image received by the receiving means on the display unit;
Terminal control program characterized in that it is made to function. An imaging step for imaging a subject;
A distance measuring step for measuring an imaging distance for each part of the subject imaged by the imaging step;
A transmission step of transmitting a planar image including the subject imaged in the imaging step and shooting distance data indicating a shooting distance measured in the distance measuring step;
A receiving step of receiving a stereoscopic image created from the planar image using the planar image transmitted by the transmitting step and the imaging distance data for each part;
A display control step for causing the display unit to display the stereoscopic image received by the reception step;
The terminal control method characterized by including. An imaging step for imaging a subject;
A distance measuring step for measuring an imaging distance for each part of the subject imaged by the imaging step;
A first transmission step of transmitting a planar image including the subject imaged in the imaging step and imaging distance data indicating an imaging distance for each part measured in the ranging step;
A second transmission step of transmitting the desired deformation content in the stereoscopic image;
Of the first stereoscopic image created from the planar image using the planar image transmitted in the first transmission step and the imaging distance data for each region, the first stereoscopic image is transmitted in the second transmission step. A receiving step of receiving a second stereoscopic image after being partially deformed based on the desired deformation content;
A display control step of causing the display unit to display the second stereoscopic image received in the reception step;
The terminal control method characterized by including.

Images