JP2012227740A - Stereoscopic image photography system, portable communication terminal, stereoscopic image photography method of stereoscopic image photography system, stereoscopic image photography program of portable communication terminal, and stereoscopic image photography method of portable communication terminal - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a user to easily photograph stereoscopic images by controlling photography of the stereoscopic images on the basis of a preview image before execution of photography processing.SOLUTION: A stereoscopic image photography system 100 includes two portable telephones 10a and 10b connected by short-range radio communication. In each portable telephone 10, an edge image is prepared from a preview image and the prepared edge image is exchanged. At the time, in the portable telephone 10 operated as a master, an overlapping rate of the two edge images is calculated, and whether or not the overlapping rate is equal to or higher than a threshold is determined. Also, as a result of adjusting a position of the portable telephone 10 on the basis of the preview image by a user, when the overlapping rate becomes equal to or higher than the threshold, photography processing is executed by the respective portable telephones 10, and photographed images are exchanged similarly to the edge images. Then, the stereoscopic image is prepared from the two photographed images.

Description

  The present invention relates to a stereoscopic image capturing system, a mobile communication terminal, a stereoscopic image capturing method for a stereoscopic image capturing system, a stereoscopic image capturing program for a mobile communication terminal, and a stereoscopic image capturing method for a mobile communication terminal, and in particular, a stereoscopic image of an arbitrary subject. The present invention relates to a stereoscopic image capturing system, a portable communication terminal, a stereoscopic image capturing method of a stereoscopic image capturing system, a stereoscopic image capturing program of a mobile communication terminal, and a stereoscopic image capturing method of a mobile communication terminal capable of capturing images.

An example of a portable communication terminal that can capture an arbitrary subject as a stereoscopic image is disclosed in Patent Document 1. In Patent Document 1, three-dimensional image data is created using two camera-equipped mobile phones.
JP 2004-129027 A [H04N 13/02, G06T 3/00, G06T 17/40, H04M 1/00, H04M 1/725]

  However, in Patent Document 1, a stereoscopic image cannot be taken unless two camera-equipped mobile phones are properly arranged. Further, in Patent Document 1, in order to solve this problem, it is disclosed that two mobile phones are fixed using a fixing jig, but in order to take a three-dimensional image, the user must Two mobile phones and a fixed jig must always be carried, which is inconvenient.

  Therefore, a main object of the present invention is to provide a novel stereoscopic image capturing system, portable communication terminal, stereoscopic image capturing method for stereoscopic image capturing system, stereoscopic image capturing program for portable communication terminal, and stereoscopic image capturing method for portable communication terminal. Is to provide.

  Another object of the present invention is to provide a three-dimensional image photographing system, a portable communication terminal, a three-dimensional image photographing method for a three-dimensional image photographing system, a three-dimensional image photographing program for a portable communication terminal, and a portable communication terminal capable of easily photographing a three-dimensional image. 3D image photographing method.

  The present invention employs the following configuration in order to solve the above problems. The reference numerals in parentheses, supplementary explanations, and the like indicate the corresponding relationship with the embodiments described in order to help understanding of the present invention, and do not limit the present invention.

  A first invention is a stereoscopic image capturing system having two mobile communication terminals connected by short-range wireless communication, each mobile communication terminal being output from a camera module and a camera module that output an image The creation unit that creates the first edge image from the preview image, the transmission unit that transmits the first edge image created by the creation unit to the partner mobile communication terminal, and the first unit that is transmitted by the transmission unit of the partner mobile communication terminal A receiving unit that receives a two-edge image, a calculating unit that calculates an overlapping rate between the first edge image and the second edge image, and when the overlapping rate calculated by the calculating unit is equal to or greater than a threshold value, from one mobile communication terminal A command issuing unit that issues a shooting command to the other mobile communication terminal, and after the shooting command is issued by the command issuing unit, the camera module of one mobile communication terminal A first execution unit that executes the shooting process, a second execution unit that executes the shooting process by the camera module of the other portable communication terminal based on the shooting command issued by the command issuing unit, and a first execution unit A stereoscopic image capturing system including a stereoscopic image creating unit that creates a stereoscopic image from a first captured image captured by the performed capturing process and a second captured image captured by the capturing process performed by the second executing unit. is there.

  In the first invention, each of the mobile communication terminals (10a, 10b) of the stereoscopic image capturing system (100: reference numerals exemplifying corresponding parts in the embodiment, hereinafter the same) is, for example, in the Bluetooth (registered trademark) format. Connected by near field communication. The camera module (36-40) of each mobile communication terminal includes an image sensor (36) and outputs an image. The creation unit (24, S53, S111) creates a first edge image by performing wavelet transform or the like on the preview image. In addition, each mobile communication terminal transmits the first edge image by the transmission unit (24, S55, S113), and receives the second edge image by the reception unit (24, S57, S115). Exchange images.

  The calculation unit (24, S59) calculates the overlap rate by weighting the comparison result of the image areas and the ratio of the corresponding pixels in the first edge image and the second edge image. If the calculated overlap rate is equal to or greater than a threshold (for example, 90%), the command issuing unit (24, S65) issues a shooting command from one mobile communication terminal to the other mobile communication terminal. When the command is issued, the first execution unit (24, S67) executes the shooting process by the camera module of one mobile communication terminal, and the second execution unit (24, S121) The photographing process is executed by the camera module of the portable communication terminal. Then, the stereoscopic image creation unit (24, S73, S127) creates a stereoscopic image from the first captured image and the second captured image thus captured.

  According to the first aspect, since the shooting of the stereoscopic image is controlled based on the preview image before the shooting process is performed, the user can easily take the stereoscopic image.

  A second invention is according to the first invention, further comprising a time information output unit that outputs time information, wherein the first execution unit and the second execution unit continuously execute the imaging process, and the first imaging The image and the second photographed image include a plurality of photographed images associated with the photographing times based on the time information output by the time information, and the stereoscopic image creation unit includes each of the first photographed image and the second photographed image A first captured image and a second captured image with the shortest capturing time are selected from a plurality of captured images included in the image to create a stereoscopic image.

  In the second invention, the time information output unit (24a) is an RTC built in the processor, for example, and outputs the time information. For example, the first execution unit executes shooting processing every 300 msec, and the second execution unit executes shooting processing every 450 msec. In addition, a shooting time is associated with each of the first and second shot images shot in this way. In the stereoscopic image creation process, the first captured image and the second captured image with the shortest shooting time are selected from the plurality of first captured images and the plurality of second captured images to create a stereoscopic image.

  According to the second aspect of the present invention, a stereoscopic image can be created using two photographed images photographed at substantially the same time without synchronizing each mobile communication terminal.

  A third invention is a portable communication terminal having a camera module for outputting an image and performing short-range wireless communication having a relationship between a master and a slave, wherein the first edge is output from a preview image output from the camera module. A mobile communication terminal that includes a creation unit that creates an image and operates as a master includes: a first reception unit that receives a second edge image transmitted by a mobile communication terminal that operates as a slave; a first edge image and a second edge image; When the duplication rate calculated by the calculation unit is equal to or greater than the threshold, a command issuing unit that issues a shooting command to the mobile communication terminal that operates as a slave, and a shooting command is issued by the command issuing unit Mobile communication that operates as a slave in response to a shooting command issued by a command execution unit, a first execution unit that executes shooting processing later by the camera module A second receiver that receives a first photographed image captured and transmitted by the end, a first photographed image received by the second receiver, and a second photograph taken by a photographing process executed by the first execution unit The mobile communication terminal that further includes a first stereoscopic image creation unit that creates a stereoscopic image from the image and that operates as a slave transmits the first edge image created by the creation unit to a mobile communication terminal that operates as a master A second execution unit that executes a shooting process by a camera module in response to a shooting command issued by a mobile communication terminal that operates as a master, and a third captured image that is shot and transmitted by a mobile communication terminal that operates as a master A third captured image received by the third receiver, the third captured image, and a fourth captured image captured by the imaging process performed by the second execution unit; Further comprising a second three-dimensional image creation section for creating Luo stereoscopic image, a mobile communication terminal.

  In the third invention, the mobile communication terminals (10a, 10b) perform short-range wireless communication in which there is a relationship between the master and the slave. Similarly to the first invention, the camera module (36-40) outputs an image, and the creation unit (24, S53, S111) creates a first edge image.

  In the mobile communication terminal that operates as the master, the first receiving unit (24, S57) receives the second edge image from the mobile communication terminal that operates as the slave. The calculation unit (24, S59) calculates the overlap rate from the first edge image and the second edge image, as in the first invention. If the calculated duplication rate is greater than or equal to the threshold, the command issuing unit (24, S65) issues a shooting command to the mobile communication terminal that operates as a slave. When the command is issued, the first execution unit (24, S67) executes the photographing process. The second receiving unit (24, S71) receives the first captured image captured and transmitted by the mobile communication terminal operating as a slave in response to the capturing command. Then, the first stereoscopic image creation unit (24, S73) creates a stereoscopic image from the received first captured image and the second captured image captured by itself.

  In the mobile communication terminal that operates as a slave, the transmission unit (24, S113) transmits the created first edge image to the mobile communication terminal that operates as a master. When the shooting command is issued, the second execution unit (24, S121) executes the shooting process with the camera module. The third receiving unit (24, S125) receives a third captured image created and transmitted by the mobile communication terminal operating as a master. Then, the second stereoscopic image creation unit (24, S127) creates a stereoscopic image from the received third captured image and the captured fourth captured image.

  In the third invention as well, similar to the first invention, since the shooting of the stereoscopic image is controlled based on the preview image before the shooting process is performed, the user can easily take the stereoscopic image.

  A fourth invention is according to the third invention, further comprising a time information output unit that outputs time information, and the image output from the camera module has an imaging time based on the time information output by the time information. In the associated mobile communication terminal that operates as a master, the first execution unit continuously performs shooting processing, and the second reception unit includes a plurality of images that are continuously captured by the mobile communication terminal that operates as a slave. The first captured image is received, and the first stereoscopic image creating unit captures from the plurality of first captured images and the plurality of second captured images captured by the capturing process continuously executed by the first execution unit. In the mobile communication terminal that operates as a slave by selecting the first captured image and the second captured image with the shortest time to create a stereoscopic image, the second execution unit continuously performs the imaging process and performs the third execution Department as a master A plurality of third captured images continuously captured by the mobile communication terminal to be produced are received, and the second stereoscopic image creating unit performs a plurality of third captured images and a capturing process continuously performed by the second execution unit A third captured image and a fourth captured image with the shortest capturing time are selected from the plurality of fourth captured images captured by the above to create a stereoscopic image.

  In the fourth invention, the time information output unit (24a) is an RTC built in the processor, as in the second invention, and outputs the time information. In addition, the captured time is associated with the captured image.

  In the 1st execution part of the portable communication terminal which operate | moves as a master, an imaging | photography process is performed continuously every 300 milliseconds, for example. The mobile communication terminal that operates as a slave continuously captures images every 450 msec, and the second receiving unit receives a plurality of first captured images thus captured. Then, the first stereoscopic image creation unit selects a first captured image and a second captured image captured at substantially the same time from a plurality of first captured images and a plurality of second captured images based on the captured time. Then, a three-dimensional image is created from the two selected photographed images.

  In the fourth invention as well, as in the second invention, a stereoscopic image can be created using two photographed images photographed at substantially the same time without synchronizing each mobile communication terminal. Become.

  The fifth invention is dependent on the third invention or the fourth invention, and further includes a display unit for displaying the second edge image received by the first receiving unit on the preview image output from the camera module. Prepare.

  In the fifth invention, the display unit (24, S63, S119) superimposes and displays the second edge image captured and transmitted by the partner on the preview image.

  According to the fifth aspect, the user can know the approximate position of the subject displayed on the other mobile communication terminal, and can easily adjust the position of the mobile communication terminal. As a result, the user can take a stereoscopic image more easily.

  A sixth invention is dependent on any one of the third to fifth inventions, further comprising a storage unit for storing first camera data indicating the specifications of the camera module, and a portable communication terminal operating as a master is The camera data receiving unit that receives the second camera data transmitted by the mobile communication terminal operating as a slave, the first camera data stored in the storage unit, and the second camera data received by the camera data receiving unit are collated When the shooting condition display section that can selectably set the shooting conditions that can be set based on the matching result of the matching section and the shooting conditions that are displayed as selectable by the shooting condition display section are selected, the camera module A first setting unit that sets shooting conditions, and a shooting condition that transmits the shooting conditions set by the first setting unit to a mobile communication terminal that operates as a slave. The mobile communication terminal that further includes a transmission unit and operates as a slave, the mobile data terminal that transmits the first camera data stored in the storage unit, and the mobile that operates as the master. A second setting unit is further provided for setting the shooting condition of the camera module when the shooting condition transmitted by the communication terminal is received.

  In the sixth aspect of the invention, the first camera data stored in the storage unit (34) includes, as data indicating the specifications of the camera module, the number of pixels, the adjustment range between the ISO sensitivity, the F value, and the shutter speed, and the focal length. Etc. are included.

  In the mobile communication terminal operating as the master, the second camera data transmitted by the mobile communication terminal operating as the slave is received by the camera data receiving unit (24, S33). A collation part (24, S35) collates own 1st camera data and the received 2nd camera data. The shooting condition display unit (24, S37) displays the shooting conditions that can be set in common in each mobile communication terminal based on the collation result. The first setting unit (24, S43) sets, for example, the shooting conditions selected by the user. Then, the imaging condition transmission unit (24, S49) transmits the imaging conditions set in the mobile communication terminal operating as the master to the mobile communication terminal operating as the slave.

  In the mobile communication terminal that operates as a slave, the first camera data is transmitted to the mobile communication terminal that operates as a master by the camera data transmission unit (24, S103). The second setting unit (24, S107) sets the same shooting conditions as those of the mobile communication terminal operating as a master.

  According to the sixth aspect of the invention, it is possible to shoot two images that are shot to create a stereoscopic image under the same shooting conditions.

  A seventh invention is dependent on the sixth invention, and the imaging condition includes the number of pixels.

  According to the seventh aspect, the stereoscopic effect of the stereoscopic image can be improved by matching the number of pixels of the two images.

  An eighth invention is according to any one of the third to seventh inventions, wherein the mobile communication terminal operating as a master includes a search unit for searching for a mobile communication terminal operating as a slave, and a mobile operating as a slave. When the communication terminal is found, the mobile phone further includes a first establishing unit that establishes short-range wireless communication with the mobile communication terminal, and the mobile communication terminal that operates as a slave is discovered by the mobile communication terminal that operates as a master. A second establishing unit for establishing short-range wireless communication with the portable communication terminal is further provided.

  In the eighth invention, the search unit (24, S21) of the mobile communication terminal operating as the master searches for the mobile communication terminal operating as the slave. When a mobile communication terminal that operates as a slave is found, the first establishing unit (24, S31) establishes short-range wireless communication with the mobile communication terminal.

  In addition, in the mobile communication terminal that operates as a slave, when it is discovered by searching for a mobile communication terminal that operates as a master, the second establishing unit (24, S101) performs near field communication with the mobile communication terminal that operates as a master. Establish.

  According to the eighth invention, a stereoscopic image can be taken by establishing short-range wireless communication with another mobile communication terminal located nearby. As a result, even if the user does not have two mobile communication terminals, he / she seeks cooperation from a nearby third party (for example, a friend) and uses the mobile communication terminal possessed by the third party to display a stereoscopic image. You will be able to shoot.

  A ninth invention is a mobile communication terminal having a camera module for outputting an image, operating as a master in short-range wireless communication, and establishing short-range wireless communication with a mobile communication terminal operating as a slave, A creation unit that creates a first edge image from a preview image output from the camera module, a first reception unit that receives a second edge image transmitted by a mobile communication terminal operating as a slave, a first edge image and a second edge image When the duplication rate calculated by the calculation unit is equal to or greater than the threshold, the command issue unit that issues a shooting command to the mobile communication terminal that operates as a slave, and the duplication rate calculated by the calculation unit When it is above the threshold, it operates as a slave according to the shooting command issued by the execution unit or command issuing unit that executes the shooting process by the camera module A second receiver that receives the first photographed image captured and transmitted by the mobile communication terminal, a first photographed image received by the second receiver, and a second photographed by the photographing process executed by the execution unit. It is a portable communication terminal provided with the stereo image creation part which produces a stereo image from a picked-up image.

  In the ninth invention, the mobile communication terminal (10a) operates as a master in the Bluetooth format, for example, and performs short-range wireless communication with the mobile communication terminal (10b) operating as a slave. The camera module (36-40) outputs an image, and the creation unit (24, S53) creates a first edge image. The first receiving unit (24, S57) receives the second edge image from the mobile communication terminal operating as a slave. The calculation unit (24, S59) calculates the overlapping rate of the first edge image and the second edge image. If the calculated duplication rate is greater than or equal to the threshold, the command issuing unit (24, S65) issues a shooting command to the mobile communication terminal that operates as a slave. When the command is issued, the execution unit (24, S67) executes the photographing process. The second receiver (24, S71) receives the first photographed image photographed and transmitted by the mobile communication terminal operating as a slave in response to the photographing command. Then, the stereoscopic image creation unit (24, S73) creates a stereoscopic image from the received first captured image and the second captured image captured by itself.

  In the ninth invention as well, similar to the third invention, since the shooting of the stereoscopic image is controlled based on the preview image before the shooting process is performed, the user can easily take the stereoscopic image.

  A tenth aspect of the present invention is a mobile communication terminal having a camera module that outputs an image, operating as a slave in short-range wireless communication, and establishing short-range wireless communication with a mobile communication terminal operating as a master, Issued by a creation unit that creates an edge image from a preview image output from a camera module, a transmission unit that transmits an edge image created by the creation unit to a mobile communication terminal that operates as a master, and a mobile communication terminal that operates as a master An execution unit that executes a shooting process by a camera module in response to a shooting command, a receiving unit that receives a first shot image shot and transmitted by a mobile communication terminal that operates as a master, and a first shot image received by the receiving unit And a stereoscopic image that creates a stereoscopic image from the second captured image captured by the capturing process executed by the execution unit Comprising a generating unit, a mobile communication terminal.

  In the tenth invention, the mobile communication terminal (10b) operates, for example, as a slave in the Bluetooth format, and performs short-range wireless communication with the mobile communication terminal (10a) operating as a master. The camera module outputs a preview image, for example. The creation unit (24, S111) creates an edge image from the preview image, and the transmission unit (24, S113) transmits it to the mobile communication terminal that operates as the created edge image master. When the execution unit (24, S121) receives the shooting command, the camera module executes the shooting process. The receiving unit (24, S125) receives the first captured image created and transmitted by the mobile communication terminal that operates as a master. Then, the stereoscopic image creation unit (24, S127) creates a stereoscopic image from the received first captured image and the captured second captured image.

  In the tenth invention, similarly to the third invention, since the shooting of the stereoscopic image is controlled based on the preview image before the shooting process is performed, the user can easily take the stereoscopic image.

  An eleventh aspect of the invention is a stereoscopic image capturing method of a stereoscopic image capturing system (100) having two mobile communication terminals (10a, 10b) connected by short-range wireless communication, and each mobile communication terminal A camera module (36-40) for outputting an image, a creation unit (24, S53, S111) for creating a first edge image from a preview image output from the camera module, and a first edge image created by the creation unit, A transmission unit (24, S55, S113) that transmits to the other mobile communication terminal, and a reception unit (24, S57, S115) that receives the second edge image transmitted by the transmission unit of the other mobile communication terminal, The overlap ratio between the first edge image and the second edge image is calculated (24, S59). A shooting command is issued to the mobile communication terminal (24, S65), and after the shooting command is issued, a shooting process is executed by the camera module of one of the mobile communication terminals (24, S67). On the other hand, the camera module of the other portable communication terminal executes the shooting process (24, S121), and the first shot image shot by the shooting process executed by one of the portable communication terminals and the other portable communication This is a stereoscopic image capturing method in which a stereoscopic image is created from the second captured image captured by the capturing process executed at the terminal (24, S73, S127).

  In the eleventh invention, as in the first invention, since the shooting of a stereoscopic image is controlled based on the preview image before the shooting process is performed, the user can easily take a stereoscopic image.

  The twelfth invention comprises a processor (24) of a portable communication terminal (10a, 10b) having a camera module (36-40) for outputting an image and performing short-range wireless communication having a relationship between a master and a slave. The mobile communication terminal operating as a slave transmits the processor of the mobile communication terminal operating as a master, functioning as a generation unit (S53, S111) for generating the first edge image from the preview image output from the camera module. A first receiving unit (S57) that receives a two-edge image, a calculating unit (S59) that calculates an overlapping rate between the first edge image and the second edge image, and an overlapping rate calculated by the calculating unit is equal to or greater than a threshold value, A command issuing unit (S65) that issues a shooting command to a mobile communication terminal that operates as a slave, and a camera command is issued after the shooting command is issued by the command issuing unit. A first execution unit (S67) that executes a photographing process by the module, and a second reception that receives a first photographed image photographed and transmitted by a mobile communication terminal that operates as a slave, in accordance with a photographing command issued by the command issuing unit. Unit (S71) and a first stereoscopic image creating unit that creates a stereoscopic image from the first captured image received by the second receiving unit and the second captured image captured by the capturing process executed by the first execution unit (S73) further functions as a slave, and the processor of the mobile communication terminal that operates as a slave transmits the first edge image created by the creation unit to the mobile communication terminal that operates as a master, and operates as a master. As a master, a second execution unit (S121) that executes a shooting process by the camera module in response to a shooting command issued by the mobile communication terminal The third receiving unit (S125) that receives the third captured image captured and transmitted by the mobile communication terminal to be created, the third captured image received by the third receiving unit, and the imaging process executed by the second execution unit This is a stereoscopic image capturing program that further functions as a second stereoscopic image creating unit (S127) that creates a stereoscopic image from the fourth captured image captured by the above.

  In the twelfth invention, similarly to the second invention, since the shooting of the stereoscopic image is controlled based on the preview image before the shooting process is performed, the user can easily take the stereoscopic image. .

  A thirteenth aspect of the present invention is a stereoscopic image capturing method for mobile communication terminals (10a, 10b) having a camera module (36-40) for outputting an image and performing short-range wireless communication in which a master and a slave have a relationship. Then, the first edge image is created from the preview image output from the camera module (S53, S111), and the mobile communication terminal operating as the master uses the second edge image transmitted by the mobile communication terminal operating as the slave. Receive (S57), calculate the overlap rate between the first edge image and the second edge image (S59), and issue a shooting command to the mobile communication terminal operating as a slave when the calculated overlap rate is equal to or greater than a threshold value (S65) After the shooting command is issued, the camera module executes shooting processing (S67), and operates as a slave according to the issued shooting command. The first captured image captured and transmitted by the portable communication terminal is received (S71), and a stereoscopic image is created from the received first captured image and the second captured image captured by the capturing process ( S73) In the mobile communication terminal operating as a slave, the generated first edge image is transmitted to the mobile communication terminal operating as the master (S113), and the shooting command issued by the mobile communication terminal operating as the master In response, the camera module executes a shooting process (S121), receives a third shot image shot and transmitted by the mobile communication terminal operating as a master (S125), and receives the received third shot image and the shooting process. This is a stereoscopic image capturing method in which a stereoscopic image is created from the fourth captured image captured by (S127).

  In the thirteenth invention, similarly to the second invention, since the shooting of the stereoscopic image is controlled based on the preview image before the shooting process is performed, the user can easily take the stereoscopic image. .

  According to the present invention, the user can easily take a stereoscopic image using the preview image.

  The above object, other objects, features, and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

FIG. 1 is an illustrative view showing an electrical configuration of a mobile phone according to an embodiment of the present invention. FIG. 2 is an illustrative view showing one example of an appearance of the mobile phone shown in FIG. FIG. 3 is an illustrative view showing an example of a state in which a stereoscopic image is taken by the two mobile phones shown in FIG. FIG. 4 is an illustrative view showing one example of a flow of processing executed by the two mobile phones shown in FIG. FIG. 5 is an illustrative view showing one example of a memory map of the RAM shown in FIG. FIG. 6 is a flowchart showing an example of the stereoscopic image photographing process shown in FIG. FIG. 7 is a flowchart showing a part of master processing of the processor shown in FIG. FIG. 8 is a part of the master process of the processor shown in FIG. 1, and is a flowchart subsequent to FIG. FIG. 9 is a flowchart showing a part of slave processing of the processor shown in FIG. FIG. 10 is a part of slave processing of the processor shown in FIG. 1, and is a flowchart subsequent to FIG.

  Referring to FIG. 1, a stereoscopic image capturing system 100 of this embodiment includes a mobile phone 10a and a mobile phone 10b that are connected to each other by, for example, a Bluetooth short-range wireless communication. Note that the configurations of the mobile phones 10a and 10b are substantially the same, and therefore, when the two are not distinguished, they will be referred to as “mobile phone 10”.

  The mobile phone 10 is a type of mobile communication terminal, and includes a processor 24 called a computer or CPU. The processor 24 includes a wireless communication circuit 14, an A / D converter 16, a D / A converter 20, a key input device 26, a display driver 28, a flash memory 32, a RAM 34, a camera control circuit 36, and a short-range wireless communication circuit. 42 and the like are connected. An antenna 12 is connected to the wireless communication circuit 14. A microphone 18 is connected to the A / D converter 16, and a speaker 22 is connected to the D / A converter 20. A 3D display 30 is connected to the display driver 28. A control motor (not shown) for controlling the lens positions of the image sensor 38 and the focus lens 40 is connected to the camera control circuit 36. A near field communication antenna 44 is connected to the near field communication circuit 42.

  The processor 24 includes an RTC 24 a that outputs time information, and controls the entire mobile phone 10. The RAM 34 functions as a storage unit and is used as a work area (including a drawing area) or a buffer area of the processor 24. Application data is recorded in the flash memory 32.

  The A / D converter 16 converts an analog audio signal for audio or sound input through the microphone 18 into a digital audio signal. The D / A converter 20 converts (decodes) the digital audio signal into an analog audio signal, and supplies the analog audio signal to the speaker 22 via an amplifier (not shown). Therefore, sound or sound corresponding to the analog sound signal is output from the speaker 22. The processor 24 can adjust the volume of the sound output from the speaker 22 by controlling the amplification factor of the amplifier.

  The key input device 26 functions as an operation unit, and includes a call key, a call end key, a numeric keypad, and the like. In addition, information (key data) on keys operated by the user is input to the processor 24.

  The display driver 28 controls display on the 3D display 30 connected to the display driver 28 under the instruction of the processor 24. The display driver 28 also includes a video memory (not shown) that temporarily stores image data to be displayed.

  The 3D display 30 employs a parallax barrier method, also called a parallax barrier method. Therefore, the 3D display 30 is also called an autostereoscopic display, and can display an image three-dimensionally even if the user is not wearing special glasses. Further, the 3D display 30 can switch the display between a stereoscopic image (3D image) and a planar image (2D image). For example, depending on the function to be executed, the 3D display 30 may display a planar image (2D image).

  The camera control circuit 36 is a circuit for taking a still image or a moving image with the mobile phone 10. For example, when an operation for executing a camera function is performed on the key input device 26, the processor 24 executes the camera function and activates the camera control circuit 36. The camera control circuit 36, the image sensor 38, and the focus lens 40 collectively function as a camera module.

  For example, an optical image of a subject is irradiated to the image sensor 38, and a light receiving element corresponding to, for example, SXGA (1280 × 1024 pixels) is disposed in the imaging area of the image sensor 38. In the imaging area, photoelectric conversion is performed. A charge corresponding to the optical image of the subject, that is, a SXGA raw image signal is generated. The user can change the size (number of pixels) of the image data to XGA (1024 × 768 pixels), VGA (640 × 480 pixels), and the like in addition to SXGA.

  When the camera function is executed, the processor 24 activates an image sensor driver built in the camera control circuit 36 in order to display a real-time moving image of the subject, that is, a preview image (through image) on the 3D display 30. The image sensor driver is instructed to perform an exposure operation and a charge readout operation corresponding to the designated readout region.

  The image sensor driver performs exposure of the imaging surface of the image sensor 38 and reading of electric charges generated by the exposure. As a result, a raw image signal is output from the image sensor 38. The output raw image signal is input to the camera control circuit 36. The camera control circuit 36 performs processing such as color separation, white balance adjustment, and YUV conversion on the input raw image signal, and the YUV format. Generate image data. Then, the YUV format image data is input to the processor 24. At this time, the camera control circuit 36 controls the focus lens 40 to focus on the subject.

  The YUV format image data input to the processor 24 is stored (temporarily stored) in the RAM 34 by the processor 24. Further, the stored image data in the YUV format is converted into RGB data by the processor 24 and then given from the RAM 34 to the display driver 28. Then, RGB format image data is output to the 3D display 30. As a result, a preview image of low pixels (eg, 320 × 240 pixels) representing the subject is displayed on the 3D display 30.

  Here, when a still image shooting operation is performed on the key input device 26, the processor 24 executes a still image main shooting process. That is, the processor 24 subjects the SXGA raw image signal output from the image sensor 38 to signal processing, temporarily stores it in the RAM 34, and executes recording processing on the flash memory 32. When the recording process is executed, image data is read from the RAM 34 through the processor 24. Then, the processor 24 associates the meta information with the read image data and records it in the flash memory 32 as one file. Further, the processor 24 outputs a sound for notifying that the main photographing process is being executed from a speaker (not shown).

  The meta information includes time information output from the RTC 24a, an image size, a model name of the mobile phone 10, and the like.

  When a memory card is connected to the mobile phone 10, the image data may be stored in the memory card. Meta information associated with image data is stored in the Exif format. The RAM 34 stores camera data indicating the specifications of the camera module. This camera data includes the number of pixels, the adjustment range between the ISO sensitivity, the F value, and the shutter speed, the focal length, and the like.

  The short-range wireless communication circuit 42 of the mobile phone 10a establishes short-range wireless communication such as Bluetooth format with the short-range wireless communication circuit 42 of the mobile phone 10b. Further, there is a master-slave relationship between the two mobile phones 10 that perform the Bluetooth short-range wireless communication.

  For example, when the mobile phone 10a that operates as a master performs short-range wireless communication, it searches for a communication device that operates as a slave. At this time, if the mobile phone 10b is set to operate as a slave and transitions to a “connection standby state” in response to a connection request from the master terminal, the mobile phone 10a that operates as a master is a mobile that operates as a slave. It can be found in the telephone 10b. When the mobile phone 10a finds the mobile phone 10b, it prompts the user to input a passcode (PIN) set in the mobile phone 10b. When the user inputs a correct PIN, short-range wireless communication between the mobile phone 10a and the mobile phone 10b is established. When communication is established, address book data, image data, and the like can be transmitted and received.

  However, if a predetermined time (for example, 30 seconds) has elapsed since the master terminal started the search, the search process ends if it cannot be found. Similarly, if there is no connection request even after a predetermined time has elapsed since the slave terminal transitioned to the connection standby state, the slave terminal returns to the normal state.

  In short-range wireless communication such as the Bluetooth format, an operation for establishing short-range wireless communication in the above-described procedure is referred to as “pairing”. If pairing has been performed in the past, short-range wireless communication between the mobile phone 10a and the mobile phone 10b can be established without inputting a passcode from the next time.

  The wireless communication circuit 14 is a circuit for performing wireless communication by the CDMA method. For example, when the user instructs a telephone call (calling) using the key input device 26, the wireless communication circuit 14 executes a telephone call process under the instruction of the processor 24, and sends a telephone call signal via the antenna 12. Is output. The telephone call signal is transmitted to the other party's telephone through a base station and a communication network (not shown). Then, when an incoming call process is performed at the other party's telephone, a communicable state is established, and the processor 24 executes a call process.

  The normal call processing will be described in detail. The modulated audio signal transmitted from the other party's telephone is received by the antenna 12. The received modulated audio signal is demodulated and decoded by the wireless communication circuit 14. The received voice signal obtained by these processes is converted into an analog voice signal by the D / A converter 20 and then output from the speaker 22. On the other hand, the transmission voice signal captured through the microphone 18 is converted into a digital voice signal by the A / D converter 16 and then given to the processor 24. The transmission signal converted into the digital audio signal is subjected to encoding processing and modulation processing by the wireless communication circuit 14 under the instruction of the processor 24, and is output via the antenna 12. Therefore, the modulated voice signal is transmitted to the other party's telephone through the base station and the communication network.

  When a telephone call signal from the other party's telephone is received by the antenna 12, the radio communication circuit 14 notifies the processor 24 of an incoming call (incoming call). In response to this, the processor 24 controls the display driver 28 to display the caller information (telephone number and the like) described in the incoming call notification on the 3D display 30. At substantially the same time, the processor 24 outputs a ring tone (sometimes called a ringing melody or a ringing voice) from a speaker (not shown).

  When the user performs a response operation using the call key, the wireless communication circuit 14 executes a telephone call incoming process under the instruction of the processor 24. Further, the communicable state is established, and the processor 24 executes the normal call process described above.

  Further, when a call end operation is performed with the call end key after shifting to the call ready state, the processor 24 controls the wireless communication circuit 14 to transmit a call end signal to the other party. Then, after transmitting the call end signal, the processor 24 ends the call process. The processor 24 also ends the call process when a call end signal is received from the other party first. Furthermore, the processor 24 also ends the call process when a call end signal is received from the mobile communication network regardless of the call partner.

  2A is an external view showing the appearance of the surface of a straight type mobile phone, and FIG. 2B is an external view showing the appearance of the back side of the straight type mobile phone. Referring to FIGS. 2A and 2B, the mobile phone 10 includes a rectangular housing C1 and a second housing C2.

  The microphone 18 (not shown) is built in the second housing C2, and the opening OP2 that communicates with the built-in microphone 18 is provided on the upper surface of the second housing C2 in the vertical direction. Similarly, the speaker 22 (not shown) is built in the housing C, and the opening OP1 leading to the built-in speaker 22 is provided on one surface in the longitudinal direction of the housing C. Further, an opening OP2 that communicates with the speaker 22 (not shown) is provided on the other surface in the longitudinal direction of the housing C.

  The key input device 26 includes, for example, a direction key, a call key, an end key, a menu and confirmation key, a numeric keypad, and the like, and is provided on the surface of the casing C. The 3D display 30 is attached such that the monitor screen is exposed on the surface of the housing C.

  The camera module is built in the housing C, and the opening OP3 leading to the focus lens 40 of the camera module is provided on the other back surface in the longitudinal direction of the housing C. The opening OP3 may be blocked with a colorless and transparent plastic.

  For example, while confirming the 3D display 30, the user inputs a telephone number by operating a numeric keypad, performs a call operation using the call key, and performs a call end operation using the call end key. Further, the user can display a menu screen by operating the menu key, and can select an arbitrary menu using the direction key or the like. Further, the user can confirm the selected menu by operating the confirmation key. Then, the user turns on / off the power of the mobile phone 10 by pressing and holding the end call key.

  When the mobile phone 10 performs the camera function, the user can confirm the preview image displayed on the 3D display 30 by pointing the opening OP3 provided on the back surface of the housing C toward the subject. At this time, the user can photograph an arbitrary subject by determining the composition based on the preview image and operating the confirmation key (shutter key).

  The antenna 12, the wireless communication circuit 14, the processor 24, the display driver 28, the flash memory 32, the RAM 34, the camera module short-range wireless communication circuit 42, the short-range wireless communication antenna 44, and the like are built in the housing C. It is not shown in FIGS. 2 (A) and 2 (B).

  Here, in this embodiment, as shown in FIG. 3, the same subject is photographed by each of the cellular phone 10a and the partner cellular phone 10b, and two images photographed by each cellular phone 10 are taken. A three-dimensional image can be created by synthesizing. That is, the user of each mobile phone 10 can take a stereoscopic image by using the other mobile phone 10.

  Specifically, when software for capturing a stereoscopic image is executed by the mobile phone 10, a GUI for selecting a master or a slave in short-range wireless communication is displayed on the 3D display 30. When the master is selected by the mobile phone 10a, the mobile phone 10a starts searching for a communication device that operates as a slave. On the other hand, when the slave is selected by the mobile phone 10b, the mobile phone 10b transitions to a communication standby state. At this time, if the mobile phone 10a and the mobile phone 10b are within a predetermined distance (for example, 10 m), Bluetooth short-range wireless communication is established between the mobile phone 10a and the mobile phone 10b. Thus, in this embodiment, a stereoscopic image can be taken by establishing short-range wireless communication with another mobile phone 10 located nearby. As a result, even if the user does not have two mobile phones 10, the user seeks cooperation from a nearby third party (for example, a friend) and uses the mobile phone possessed by the third party to display a stereoscopic image. You can also shoot.

  When the short-range wireless communication is established, the mobile phone 10b that operates as a slave transmits camera data to the mobile phone 10a that operates as a master. In the mobile phone 10a, by collating the camera data of the mobile phone 10b with its own camera data, shooting conditions that can be set in common between the mobile phone 10a and the mobile phone 10b are extracted. Thereby, the settable photographing conditions are displayed on the 3D display 30 of the mobile phone 10a so as to be selectable. In the following description, the mobile phone 10a that operates as a master may be referred to as a “master terminal”, and the mobile phone 10b that operates as a slave may be referred to as a “slave terminal”.

  When the shooting condition is selected by the user, the selected shooting condition is set in the mobile phone 10a and transmitted to the mobile phone 10b. When the mobile phone 10b receives the data indicating the shooting conditions, the mobile phone 10b sets the shooting conditions. That is, the photographing conditions selected by the user are set in both the cellular phone 10a and the cellular phone 10b. Thereby, it is possible to shoot two images shot to create a stereoscopic image under the same shooting conditions. Here, the photographing conditions that can be set in common are extracted so that the image size (number of pixels) is always the same. That is, in this embodiment, the stereoscopic effect of the stereoscopic image is improved by matching the number of pixels of the two images.

  Referring to FIG. 4, when shooting conditions are set, each mobile phone 10 starts shooting a preview image. At the same time, an edge image is created from the photographed preview image. Note that the edge image is an image drawn by detecting a boundary (edge) where the brightness changes abruptly in the original image. The edge detection is performed widely and generally, and detailed description thereof is omitted. However, for example, the edge can be easily detected by using wavelet transform, the Canny method, or the like.

  When the creation of the edge image is completed, the edge image created by the cellular phone 10a is transmitted to the cellular phone 10b, and the edge image created by the cellular phone 10b is transmitted to the cellular phone 10a. Then, each edge image transmitted to the partner mobile phone 10 is displayed on the 3D display 30 of the partner mobile phone 10 so as to be superimposed on the preview image. In the following description, sending an image to a partner and receiving an image from the partner instead is referred to as “exchange images”.

  Thereby, the user of each mobile phone 10 can grasp the positional relationship between the subject photographed by the mobile phone 10 and the subject photographed by the other party. Therefore, each user can easily adjust the position of the mobile phone 10 so that the preview image taken by the user overlaps the edge image of the other party. For example, in order to adjust the position of the mobile phone 10, the user moves the mobile phone 10 left and right or up and down, or changes the distance between the mobile phone 10 and the subject.

  Further, the master terminal calculates the duplication rate by weighting the comparison result of the image areas and the ratio of the corresponding pixels in the two edge images. Then, as a result of the adjustment of the position of the mobile phone 10, when the overlapping rate of the two edge images exceeds a threshold (for example, 90%), the master terminal issues a shooting command to the slave terminal. Thereafter, the photographing process is executed in the master terminal, and the photographing process is also executed in the slave terminal at substantially the same timing. That is, two images that cause parallax necessary for creating a stereoscopic image are captured. The two images are exchanged in the same manner as the edge image. Each mobile phone 10 creates a three-dimensional image using the captured image captured by itself and the captured image transmitted by the other party. That is, a stereoscopic image is created by the master terminal and the slave terminal.

  As described above, in this embodiment, the user can easily capture a stereoscopic image using the preview image.

  FIG. 5 is a diagram showing a memory map of the RAM 34. The memory map of the RAM 34 includes a program storage area 302 and a data storage area 304. A part of the program and data is read from the flash memory 32 all at once or partly and sequentially as necessary, stored in the RAM 34, and then processed by the processor 24.

  The program storage area 302 stores a program for operating the mobile phone 10. For example, programs for operating the mobile phone 10 include a stereoscopic image shooting program 310, a master program 312, a slave program 314, a stereoscopic image creation program 316, and the like.

  The stereoscopic image shooting program 310 is a program for controlling the operation of each mobile phone 10 when shooting a stereoscopic image using the two mobile phones 10. The master program 312 and the slave program 314 are subroutines of the stereoscopic image shooting program 310. The master program 312 is a program for controlling the operation of the mobile phone 10 that operates as a master when taking a stereoscopic image, and the slave program 314 is a program for controlling the operation of the mobile phone 10 that operates as a slave. It is. The stereoscopic image creation program 316 is a program for creating a stereoscopic image from two photographed images.

  Although illustration is omitted, the program for operating the mobile phone 10 includes a program for notifying a voice incoming state and a program for communicating with the outside.

  Subsequently, in the data storage area 304, a preview image buffer 330, a shooting condition buffer 332, a first edge image buffer 334, a second edge image buffer 336, a first shot image buffer 338, and a second shot image buffer 340 are provided. At the same time, camera data 342 is stored. The data storage area 304 is provided with a search counter 344, a selection counter 346, and a master flag 348.

  The preview image buffer 330 temporarily stores image data to be displayed on the 3D display 30 as a preview image. The shooting condition buffer 332 temporarily stores shooting conditions selected by the user or shooting conditions instructed from the master terminal. The first edge image buffer 338 temporarily stores an edge image created based on the preview image data. In the second edge image buffer 340, the edge image transmitted from the counterpart mobile phone 10 is temporarily stored. The first captured image buffer 338 temporarily stores captured images. Second photographed image buffer 340 temporarily stores an image photographed and transmitted by partner mobile phone 10.

  The camera data 342 is composed of data indicating the specifications of the camera module, and includes, for example, the number of pixels of an image that can be taken, the adjustment range between the ISO sensitivity, the F value, and the shutter speed, the focal length, and the like. .

  The search counter 344 is a counter for measuring a predetermined time when performing pairing, and starts counting when initialized. The search counter 344 is initialized in response to a search for a slave or a transition to a connection standby state, and thus is used as a search timer during execution of the master program 312 or the slave program 314.

  The selection counter 346 is a counter for measuring a specific time (for example, 20 seconds) when selecting an imaging condition, and starts counting when initialized. Since the selection counter 346 is initialized when the photographing conditions are displayed so as to be selectable, the selection counter 346 is used as a selection timer during execution of the master program 312.

  The master flag 348 is a flag for determining whether or not the master flag 348 is set as a master when establishing short-range wireless communication. For example, the master flag 348 is composed of a 1-bit register. When the master flag 348 is turned on (established), a data value “1” is set in the register. On the other hand, when the master flag 348 is turned off (not established), a data value “0” is set in the register. For example, the master flag 348 is turned on when setting to operate as a master is performed in short-range wireless communication for capturing a stereoscopic image, and is turned off when setting to operate as a slave is performed.

  Although not shown, the data storage area 304 stores image data displayed in a standby state, character string data, and the like, and is provided with counters and flags necessary for the operation of the mobile phone 10. It is done.

  The processor 24 operates under the control of the Linux (registered trademark) base such as Android (registered trademark) and REX, and other OSs, the stereoscopic image shooting process shown in FIG. 6, the master process shown in FIGS. A plurality of tasks including the slave processing shown in FIGS. 9 and 10 are processed in parallel.

  These processes can be executed by each mobile phone 10, but in the following description, it is assumed that the master process is executed by the mobile phone 10a and the slave process is executed by the mobile phone 10b.

  FIG. 6 is a flowchart of the stereoscopic image shooting process. For example, when an operation for photographing a stereoscopic image is performed by the user, the processor 24 determines whether or not to operate as a master in step S1. For example, when the process of step S <b> 1 is executed, a GUI for confirming whether to operate as a master or a slave in short-range wireless communication is displayed on the 3D display 30. If “YES” in the step S1, for example, if the user selects to operate as a master, a master process is executed in a step S3. On the other hand, if “NO” in the step S1, for example, if it is selected to operate as a slave, a slave process is executed in a step S5.

  When step S3 is executed, the master flag 348 is turned on, and when step S5 is executed, the master flag 348 is turned off. And if the process of step S3 or step S5 is complete | finished, a stereo image process will also be complete | finished.

  Since the master process in step S3 and the slave process in step S5 will be described later, detailed description thereof will be omitted here.

  FIG. 7 is a flowchart of the master process. When the process of step S3 is executed in the stereoscopic image capturing process shown in FIG. 6, the processor 24 searches for a slave in step S21. That is, a communication device (mobile phone 10b) that operates as a slave is searched. The processor 24 that executes the process of step S21 functions as a search unit. Subsequently, in step S23, the search timer is reset. That is, the search counter 344 is initialized. Subsequently, in step S25, it is determined whether or not it has been found. That is, it is determined whether a slave terminal in a communication standby state has been found. If “NO” in the step S25, that is, if a slave terminal in a communication standby state cannot be found, it is determined whether or not the search timer has expired in a step S27. That is, it is determined whether a predetermined time has elapsed since the search was started. If “NO” in the step S27, that is, if a predetermined time has not elapsed since the search was started, the process returns to the step S25. On the other hand, if “YES” in the step S27, that is, if a predetermined time has elapsed since the search was started, a search failure is notified in a step S29. For example, a message such as “Could not find a slave terminal” is displayed on the 3D display 30. Then, when the process of step S29 ends, the processor 24 ends the master process and returns to the stereoscopic image shooting process.

  If “YES” in the step S25, if a slave terminal in a communication standby state can be found, the short-range wireless communication is established in a step S31. That is, near field communication is established between the master terminal and the slave terminal. In step S33, slave camera data is received. For example, the master terminal requests the slave terminal to transmit camera data. Then, the camera data of the slave terminal transmitted in response to the request is received. The processor 24 that executes the process of step S31 functions as a first establishing unit, and the processor 24 that executes the process of step S33 functions as a camera data receiving unit.

  Subsequently, in step S35, the respective camera data are collated. That is, the master terminal extracts photographing conditions that can be set in common from its own camera data 342 and camera data of the slave terminal. In step S37, selectable shooting conditions are displayed. For example, on the 3D display 30, shooting conditions including the number of pixels that can be shot in common (VGA, XGA, etc.) are displayed in a selectable manner. Subsequently, in step S39, the selection timer is reset. That is, the selection counter 346 is initialized. The processor 24 that executes the process of step S35 functions as a collation unit, and the processor 24 that executes the process of step S37 functions as an imaging condition display unit.

  Subsequently, in step S41, it is determined whether or not it has been selected. That is, it is determined whether or not an operation for selecting the displayed photographing condition has been performed. If “YES” in the step S41, for example, when VGA (640 × 480 pixels) is selected, the selected photographing condition is set in a step S43. For example, the shooting condition buffer 332 stores shooting conditions with an image size (number of pixels) of VGA as shooting conditions. Then, when the process of step S43 ends, the process proceeds to step S49 shown in FIG. The processor 24 that executes the process of step S43 functions as a first setting unit.

  If “NO” in the step S41, that is, if an operation for selecting the photographing condition is not performed, it is determined whether or not the selection timer has expired in a step S45. That is, it is determined whether a specific time has elapsed since the selectable shooting conditions are displayed. If “NO” in the step S45, that is, if a specific time has not elapsed since the photographing condition was displayed, the process returns to the step S41. On the other hand, if “YES” in the step S45, that is, if a specific time has elapsed since the photographing condition was displayed, the default photographing condition is set in a step S47. Here, the default shooting conditions in the present embodiment are shooting conditions that maximize the image size (number of pixels). For example, here, a shooting condition in which the image size is XGA is set as the default shooting condition. When the shooting condition is set, the shooting condition with the image size of XGA is stored in the shooting condition buffer 332 as in the process of step S43.

  Subsequently, in step S49 of FIG. 8, the set shooting conditions are transmitted to the slave. For example, data indicating the shooting conditions stored in the shooting condition buffer 332 is transmitted from the master terminal to the slave terminal. The processor 24 that executes the process of step S49 functions as an imaging condition transmission unit. Subsequently, in step S51, a preview image is acquired. That is, the image data output from the camera module is subjected to predetermined processing and stored in the preview image buffer 330. Subsequently, in step S53, an edge image is created. That is, an edge image is created from the image data stored in the preview image buffer 330. Then, the created edge image is stored in the first edge image buffer 334. The processor 24 that executes the process of step S53 functions as a creation unit.

  Subsequently, in step S55, the edge image is transmitted to the slave. For example, an edge image stored in the first edge image buffer 334 is transmitted from a master terminal that is a master to a slave terminal that is a slave. In step S57, a slave edge image is received. For example, the master terminal receives the edge image created and transmitted by the slave terminal. The received edge image is stored in the second edge image buffer 336. The processor 24 that executes the process of step S55 functions as a transmission unit, and the processor 24 that executes the process of step S57 functions as a reception unit or a first reception unit.

  Subsequently, in step S59, the overlapping rate of the edge images is calculated. That is, the overlapping rate of two edge images stored in the first edge image buffer 334 and the second edge image buffer 336 is calculated. The processor 24 that executes the process of step S59 functions as a calculation unit. Subsequently, in step S61, it is determined whether or not the duplication rate is equal to or greater than a threshold value. That is, it is determined whether or not it is possible to capture a stereoscopic image. If “NO” in the step S61, that is, if the overlapping rate is less than the threshold value, a preview image in which the slave edge image is superimposed is displayed in a step S63. For example, as shown in FIG. 4, the processor 24 of the master terminal displays a preview image on the 3D display 30 in which the edge image transmitted from the slave terminal is superimposed on the captured image. Then, when the process of step S63 ends, the process returns to step S51. That is, the processing of steps S51 to S63 is repeated until a state where a stereoscopic image can be captured from an image captured by the master terminal and an image captured by the slave terminal. Note that the processor 24 that executes the process of step S63 functions as a display unit.

  If “YES” in the step S61, that is, if the duplication rate is equal to or higher than the threshold value, an imaging command is issued to the slave in a step S65. For example, a shooting command is issued from the master terminal to the slave terminal. Subsequently, photographing processing is executed in step S67. That is, the imaging process is executed at the master terminal. Also, the captured image is stored in the first captured image buffer 338. Note that, as described above, the slave terminal that has received the shooting command also executes the shooting process at substantially the same timing. The processor 24 that executes the process of step S65 functions as an instruction issuing unit, and the processor 24 that executes the process of step S67 functions as a first execution unit or an execution unit.

  Subsequently, the photographed image is transmitted to the slave in step S69, and the photographed image is received from the slave in step S71. That is, in order to create a stereoscopic image, the master terminal and the slave terminal exchange images captured by each. In each mobile phone 10, the captured image received from the other party is stored in the second captured image buffer 340. Further, the processor 24 that executes the process of step S71 functions as a second receiving unit.

  Subsequently, a stereoscopic image creation process is executed in step S73, and the stereoscopic image is stored in step S75. That is, in step S73, a stereoscopic image is created from the two captured images stored in the first captured image buffer 338 and the second captured image buffer 340. In step S75, the created stereoscopic image is stored in the flash memory 32. Then, when the created stereoscopic image is stored, the master process ends.

  In another embodiment, a 3D image may be displayed on the 3D display 30 and confirmed with the user before the process of step S75 is executed. The processor 24 that executes the process of step S73 functions as a stereoscopic image creation unit or a first stereoscopic image creation unit.

  FIG. 9 is a flowchart of slave processing. When the process of step S5 is executed in the stereoscopic image capturing process shown in FIG. 6, the processor 24 transitions to a communication standby state in step S91. That is, the slave terminal transits to the communication standby state so that it can respond to the connection request from the master terminal. Subsequently, in step S93, the search timer is reset. That is, the search counter 344 is initialized in order to measure the time since the transition to the communication connection standby state.

  Subsequently, in step S95, it is determined whether or not it has been found. For example, it is determined whether the connection request has been received by the master terminal. If “NO” in the step S95, that is, if there is no connection request from the master terminal, it is determined whether or not the search timer has expired in a step S97. That is, it is determined whether or not a predetermined time has elapsed since the transition to the communication standby state. If “NO” in the step S97, that is, if a predetermined time has not elapsed since the transition to the communication standby state, the process returns to the step S95. On the other hand, if “YES” in the step S97, that is, if a predetermined time has elapsed since the transition to the communication standby state, the time-up is notified in a step S99. That is, if the short-range wireless communication with the master is not established even after a predetermined time has elapsed since the transition to the communication standby state, the user is notified of time-up (time-out). Then, when the process of step S99 ends, the processor 24 ends the slave process and returns to the stereoscopic image shooting process.

  On the other hand, if “YES” in the step S95, for example, if there is a connection request from the master terminal, the short-range wireless communication is established in a step S101. That is, short-range wireless communication with the master terminal is established. The processor 24 that executes the process of step S101 functions as a second establishment unit. Subsequently, in step S103, the camera data is transmitted to the master. For example, the slave terminal transmits camera data 342 to the master terminal in response to a request for transmission of camera data by the master terminal. Note that the processor 24 that executes the process of step S103 functions as a camera data transmission unit. Subsequently, in step S105, it is determined whether or not imaging conditions have been received. That is, it is determined whether or not data indicating the imaging condition selected by the master terminal has been received. If “NO” in the step S105, that is, if the photographing condition is not received, the process of the step S105 is repeated. On the other hand, if “YES” in the step S105, for example, if the photographing condition transmitted from the master terminal is received, the photographing condition received in the step S107 is set. For example, when the imaging condition with the pixel number VGA is set at the master terminal, the imaging condition with the pixel number VGA is also set at the slave terminal. The processor 24 that executes the process of step S107 functions as a second setting unit.

  Subsequently, a preview image is acquired in step S109 in FIG. 10, and an edge image is created in step S111. That is, as in steps S51 and S53 of the master process, a preview image is acquired from the camera module and an edge image is created. At this time, the created edge image is stored in the first edge image buffer 334. The processor 24 that executes the process of step S111 functions as a creation unit.

  In step S113, the edge image is transmitted to the master, and in step S115, the master edge image is received. That is, as shown in FIG. 4, edge images are exchanged between the master terminal and the slave terminal. The processor 24 that executes the process of step S113 functions as a transmission unit, and the processor 24 that executes the process of step S115 functions as a transmission unit.

  Subsequently, in step S117, it is determined whether or not a shooting command has been received. As described in the description of the master processing, the master terminal issues a shooting command when the overlapping rate of two edge images exceeds a threshold value. Therefore, the slave terminal determines whether or not the imaging command issued in this way has been received. If “NO” in the step S117, for example, if a photographing command issued by the master terminal is not received, a preview image on which the master edge image is superimposed is displayed in a step S119. That is, the preview image obtained by superimposing the edge image transmitted from the master on the photographed image is displayed on the 3D display 30 as in step S63 of the master process. When the process of step S119 ends, the process returns to step S109. That is, the mobile phone 1b operating as a slave repeats the processes of steps S109 to S119 until the imaging command is received. Note that the processor 24 that executes the process of step S119 functions as a display unit.

  On the other hand, if “YES” in the step S117, that is, if a shooting command is received, the shooting process is executed in a step S121. Thereby, the slave terminal also executes the photographing process at substantially the same timing as the master terminal. The captured image is stored in the first captured image buffer 338. The processor 24 that executes the process of step S121 functions as a second execution unit or an execution unit.

  Subsequently, in step S123, the captured image is transmitted to the master, and in step S125, the captured image is received from the master. That is, steps S123 and S125 correspond to steps S69 and S71 of the master process, and the image captured by itself and the image captured by the other party are exchanged. Further, the slave terminal stores the captured image received from the master terminal in the second captured image buffer 340. The processor 24 that executes the process of step S125 functions as a third receiving unit or a receiving unit.

  Subsequently, a stereoscopic image photographing process is executed in step S127, and the stereoscopic image is stored in step S129. That is, as in steps S73 and S75 of the master process, a stereoscopic image is created from the two images taken by each mobile phone 10 and stored in the flash memory 32. Then, when the created stereoscopic image is stored, the processor 24 ends the slave processing. In addition, the processor 24 that executes the process of step S127 functions as a stereoscopic image creation unit or a second stereoscopic image creation unit.

  In the present embodiment, the photographing process of each mobile phone 10 is not synchronized. This is because if a time lag of several hundred ms is provided in order to match the shooting timing, the subject may move during that time, and shooting may not be performed correctly. However, in another embodiment, the time of each mobile phone 10 is matched at the time of pairing, and after the shooting command is issued from the mobile phone 10 operating as a master, each mobile phone 10 performs an extremely short time interval. You may shoot continuously. Thereby, in another Example, even if it does not synchronize each mobile phone 10, it becomes possible to create a three-dimensional image using two photographed images photographed at substantially the same time (timing). .

  For example, the master terminal captures four images every 300 milliseconds, the slave terminal captures three images every 450 milliseconds, and the communication delay is 200 milliseconds. At this time, if the time when the first picture was taken at the master terminal was 11: 00: 00: 000 msec, the time taken at the first picture at the slave terminal would be 11:00:00 200 msec. In this case, the difference between the third captured image captured at 11:00:00 600 msec on the master terminal and the second captured image captured at 11:00:00 650 msec on the slave terminal. Is the shortest. Therefore, a stereoscopic image is created from the captured image captured at the third image by the master terminal and the captured image captured at the second image by the slave terminal.

  Further, when creating a stereoscopic image as described above, in step S67 of the master process, a photographing process for photographing four images every 300 milliseconds is executed. Subsequently, in step S69 of the master process, a plurality of captured images are transmitted to the slave terminal, and in step S71, a plurality of captured images are received from the slave terminal. Subsequently, in step S73, first, based on the meta information of the image captured by itself and the meta information of the image captured by the slave terminal, processing for selecting two captured images captured at substantially the same time. Is done. In step S73, when two shot images are selected, a three-dimensional image is created from the two shot images.

  On the other hand, in step S121 of the slave process, a process of taking three images every 450 milliseconds is executed. Then, in steps S123, S125, and S127 corresponding to steps S69, S71, and S73 of the master process, a three-dimensional image is created from the two captured images captured at substantially the same time.

  In another embodiment, the mobile phone 10a may operate as a slave and the mobile phone 10b may operate as a master.

  In this embodiment, when the overlapping rate of two edge images is equal to or greater than the threshold value, the photographing process is automatically executed. However, in another embodiment, the overlapping of two edge images is performed. If the rate is equal to or higher than the threshold, the user may be instructed to take a picture.

  In another embodiment, a normal display may be provided instead of the 3D display 30.

  In another embodiment, software for capturing a stereoscopic image may be executed with a plurality of slave terminals connected to the master terminal.

  The communication system of the mobile phone 10 is a CDMA system, but an LTE (Long Term Evolution) system, a W-CDMA system, a GSM system, a TDMA system, an FDMA system, a PHS system, and the like may be employed.

  Further, the plurality of programs used in this embodiment may be stored in the HDD of the data distribution server and distributed to the mobile phone 10 via the network. Further, the storage medium may be sold or distributed in a state where a plurality of programs are stored in a storage medium such as an optical disk such as a CD, DVD, or BD (Blu-ray Disc), a USB memory, or a memory card. When a plurality of programs downloaded through the above-described server or storage medium are installed in a mobile phone having the same configuration as that of this embodiment, the same effect as that of this embodiment can be obtained.

  In another embodiment, the mobile phone 10 may have installation data for a plurality of programs described above. As a result, when the above-described plurality of programs are not installed on the other party's mobile phone, the user transmits installation data of the plurality of programs by short-range wireless communication, and causes the other party's mobile phone to install the above-described program. be able to. When the installation of the above-described program is completed on the other party's mobile phone, the user can take a stereoscopic image using the other party's mobile phone.

  Furthermore, the present embodiment is not limited to the mobile phone 10 but may be applied to so-called smartphones and PDAs (Personal Digital Assistants).

  The specific numerical values such as the predetermined distance, delay time, shooting interval, predetermined time, specific time, and threshold given in this specification are merely examples, and are necessary for product specifications and the like. It can be changed as appropriate.

10a, 10b ... mobile phone 24 ... processor 26 ... key input device 32 ... flash memory 34 ... RAM
36 ... Camera control circuit 38 ... Image sensor 40 ... Focus lens 42 ... Short-range wireless communication circuit 44 ... Short-range wireless communication antenna

Claims (13)

A stereoscopic image capturing system having two portable communication terminals connected by short-range wireless communication,
Each mobile communication terminal
A camera module that outputs images,
A creation unit for creating a first edge image from a preview image output from the camera module;
A transmission unit that transmits the first edge image created by the creation unit to the other mobile communication terminal; and a reception unit that receives the second edge image transmitted by the transmission unit of the other mobile communication terminal;
A calculation unit for calculating an overlapping rate between the first edge image and the second edge image;
A command issuing unit that issues a shooting command from one mobile communication terminal to the other mobile communication terminal when the duplication rate calculated by the calculation unit is equal to or greater than a threshold;
A first execution unit that executes a shooting process by a camera module of the one mobile communication terminal after a shooting command is issued by the command issuing unit;
A second execution unit that executes a shooting process by a camera module of the other mobile communication terminal based on a shooting command issued by the command issuing unit; and a second shot that is shot by a shooting process that is executed by the first execution unit A stereoscopic image capturing system comprising a stereoscopic image creating unit that creates a stereoscopic image from one captured image and a second captured image captured by a capturing process executed by the second execution unit. A time information output unit for outputting time information;
The first execution unit and the second execution unit continuously perform shooting processing,
The first photographed image and the second photographed image include a plurality of photographed images associated with photographing times based on time information output by the time information,
The stereoscopic image creation unit selects a first captured image and a second captured image with the shortest capturing time from a plurality of captured images included in each of the first captured image and the second captured image, and generates a stereoscopic image. The stereoscopic image capturing system according to claim 1, which is created. A mobile communication terminal that has a camera module that outputs an image and performs short-range wireless communication with a master and a slave,
A creation unit for creating a first edge image from a preview image output from the camera module;
The mobile communication terminal that operates as a master
A first receiver for receiving a second edge image transmitted by a mobile communication terminal operating as a slave;
A calculation unit for calculating an overlapping rate between the first edge image and the second edge image;
When the duplication rate calculated by the calculation unit is equal to or greater than a threshold, a command issuing unit that issues a shooting command to the mobile communication terminal that operates as the slave;
A first execution unit that executes a shooting process by the camera module after a shooting command is issued by the command issuing unit;
In response to a shooting command issued by the command issuing unit, a second receiving unit that receives a first shot image shot and transmitted by the mobile communication terminal operating as the slave, and a second received by the second receiving unit A first stereoscopic image creation unit that creates a stereoscopic image from one captured image and a second captured image captured by the imaging process executed by the first execution unit;
Mobile communication terminals that operate as slaves
A transmission unit for transmitting the first edge image created by the creation unit to a mobile communication terminal operating as a master;
A second execution unit that executes a shooting process by the camera module in response to a shooting command issued by the mobile communication terminal operating as the master;
A third receiver that receives a third captured image captured and transmitted by the mobile communication terminal operating as the master; a third captured image that is received by the third receiver; and the second execution unit A mobile communication terminal further comprising a second stereoscopic image creation unit that creates a stereoscopic image from a fourth captured image captured by the imaging process. A time information output unit for outputting time information;
The image output from the camera module is associated with the shooting time based on the time information output by the time information,
In a mobile communication terminal that operates as a master,
The first execution unit continuously performs shooting processing,
The second receiving unit receives a plurality of first captured images continuously captured by the mobile communication terminal operating as the slave,
The first stereoscopic image creating unit has the shortest shooting time from the plurality of first photographed images and the plurality of second photographed images photographed by the photographing process continuously executed by the first execution unit. Create a 3D image by selecting the 1st image and the 2nd image,
In the mobile communication terminal that operates as the slave,
The second execution unit continuously performs photographing processing,
The third execution unit receives a plurality of third captured images continuously captured by the mobile communication terminal operating as the master;
The second stereoscopic image creation unit has the shortest shooting time from the plurality of third photographed images and the plurality of fourth photographed images photographed by the photographing process continuously executed by the second execution unit. The mobile communication terminal according to claim 3, wherein a three-shot image and a fourth shot image are selected to create a stereoscopic image.   5. The mobile communication terminal according to claim 3, further comprising a display unit that displays the second edge image received by the first receiving unit on the preview image output from the camera module. A storage unit for storing first camera data indicating specifications of the camera module;
The mobile communication terminal that operates as a master
A camera data receiving unit for receiving second camera data transmitted by the mobile communication terminal operating as a slave;
A collation unit that collates the first camera data stored in the storage unit and the second camera data received by the camera data reception unit;
An imaging condition display unit that displays selectable imaging conditions based on the verification result of the verification unit,
When a shooting condition displayed so as to be selectable by the shooting condition display unit is selected, a first setting unit for setting a shooting condition of the camera module, and a shooting condition set by the first setting unit as the slave It further includes an imaging condition transmitter that transmits to the mobile communication terminal that operates,
Mobile communication terminals that operate as slaves
When the mobile communication terminal that operates as the master receives the camera data transmission unit that transmits the first camera data stored in the storage unit, and the shooting conditions transmitted by the mobile communication terminal that operates as the master, The mobile communication terminal according to claim 3, further comprising a second setting unit that sets a shooting condition of the camera module.   The mobile communication terminal according to claim 6, wherein the photographing condition includes a number of pixels. The mobile communication terminal that operates as a master
A search unit that searches for a mobile communication terminal that operates as a slave, and a first establishment unit that establishes short-range wireless communication with the mobile communication terminal when a mobile communication terminal that operates as a slave is found;
Mobile communication terminals that operate as slaves
The mobile communication terminal according to any one of claims 3 to 7, further comprising a second establishment unit that establishes short-range wireless communication with the mobile communication terminal when discovered by the mobile communication terminal operating as a master. A mobile communication terminal that has a camera module that outputs an image, operates as a master in short-range wireless communication, and establishes short-range wireless communication with a mobile communication terminal that operates as a slave,
A creation unit for creating a first edge image from a preview image output from the camera module;
A first receiver for receiving a second edge image transmitted by the mobile communication terminal operating as the slave;
A calculation unit for calculating an overlapping rate between the first edge image and the second edge image;
When the duplication rate calculated by the calculation unit is equal to or greater than a threshold, a command issuing unit that issues a shooting command to the mobile communication terminal that operates as the slave;
When the duplication rate calculated by the calculation unit is equal to or greater than a threshold value, an execution unit that executes shooting processing by the camera module;
In response to a shooting command issued by the command issuing unit, a second receiving unit that receives a first shot image shot and transmitted by the mobile communication terminal that operates as the slave, and a second receiving unit that is received by the second receiving unit. A mobile communication terminal comprising a stereoscopic image creation unit that creates a stereoscopic image from one captured image and a second captured image captured by a capturing process executed by the execution unit. A mobile communication terminal having a camera module for outputting an image, operating as a slave in short-range wireless communication, and establishing short-range wireless communication with a mobile communication terminal operating as a master,
A creation unit for creating an edge image from a preview image output from the camera module;
A transmission unit that transmits the edge image created by the creation unit to a mobile communication terminal that operates as the master;
An execution unit that executes a shooting process by the camera module in accordance with a shooting command issued by the mobile communication terminal operating as the master;
A receiving unit that receives a first captured image that is captured and transmitted by the mobile communication terminal that operates as the master, a first captured image that is received by the receiving unit, and an image that is captured by a capturing process executed by the execution unit A mobile communication terminal comprising a stereoscopic image creation unit that creates a stereoscopic image from a second captured image. A stereoscopic image capturing method of a stereoscopic image capturing system having two mobile communication terminals connected by short-range wireless communication,
Each mobile communication terminal
A camera module that outputs images,
A creation unit for creating a first edge image from a preview image output from the camera module;
A transmission unit that transmits the first edge image created by the creation unit to the other mobile communication terminal; and a reception unit that receives the second edge image transmitted by the transmission unit of the other mobile communication terminal;
Calculating an overlap rate between the first edge image and the second edge image;
When the calculated overlap rate is equal to or greater than the threshold, issue a shooting command from one mobile communication terminal to the other mobile communication terminal,
After the shooting command is issued, the shooting process is executed by the camera module of the one mobile communication terminal,
Based on the issued shooting command, a shooting process is executed by the camera module of the other portable communication terminal, and the first shot image shot by the shooting process executed by the one portable communication terminal, and the other A stereoscopic image photographing method for creating a stereoscopic image from a second photographed image photographed by a photographing process executed by the mobile communication terminal. A processor of a portable communication terminal that has a camera module that outputs an image and performs short-range wireless communication with a master and a slave,
Function as a creation unit for creating a first edge image from a preview image output from the camera module;
A processor of a mobile communication terminal that operates as a master,
A first receiver for receiving a second edge image transmitted by a mobile communication terminal operating as a slave;
A calculation unit for calculating an overlapping rate between the first edge image and the second edge image;
When the duplication rate calculated by the calculation unit is equal to or greater than a threshold, a command issuing unit that issues a shooting command to the mobile communication terminal that operates as the slave;
A first execution unit that executes a shooting process by the camera module after a shooting command is issued by the command issuing unit;
In response to a shooting command issued by the command issuing unit, a second receiving unit that receives a first shot image shot and transmitted by the mobile communication terminal operating as the slave, and a second received by the second receiving unit Further functioning as a first stereoscopic image creation unit that creates a stereoscopic image from one captured image and a second captured image captured by the imaging process performed by the first execution unit;
The processor of the mobile communication terminal that operates as a slave
A transmission unit for transmitting the first edge image created by the creation unit to a mobile communication terminal operating as a master;
A second execution unit that executes a shooting process by the camera module in response to a shooting command issued by the mobile communication terminal operating as the master;
A third receiver that receives a third captured image captured and transmitted by the mobile communication terminal operating as the master; a third captured image that is received by the third receiver; and the second execution unit A stereoscopic image capturing program that further functions as a second stereoscopic image creating unit that creates a stereoscopic image from a fourth captured image captured by the capturing process. A method for taking a three-dimensional image of a mobile communication terminal having a camera module for outputting an image and performing short-range wireless communication with a master and a slave,
Create a first edge image from the preview image output from the camera module,
In a mobile communication terminal that operates as a master,
Receiving the second edge image transmitted by the mobile communication terminal operating as a slave;
Calculating an overlap rate between the first edge image and the second edge image;
When the calculated duplication rate is greater than or equal to a threshold, issue a shooting command to the mobile communication terminal that operates as the slave,
After the shooting command is issued, the camera module performs shooting processing,
In response to the issued shooting command, the mobile communication terminal operating as the slave captures and receives the transmitted first captured image, and the received first captured image and the second captured image captured by the capturing process. Create a 3D image from
In mobile communication terminals that operate as slaves,
A transmission unit that transmits the created first edge image to a mobile communication terminal that operates as a master;
In accordance with a shooting command issued by the mobile communication terminal operating as the master, the camera module executes shooting processing,
Receiving a third captured image captured and transmitted by the mobile communication terminal operating as the master, and creating a stereoscopic image from the received third captured image and the fourth captured image captured by the capturing process; Stereo image shooting method.

Images