JP2012120016A - Terminal device, and processing method and program of the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a terminal device enabling stress-free selection operation using an intuitive user interface.SOLUTION: The terminal device detects the inclination or acceleration of the terminal device in a three-dimensional real space. When the inclination or acceleration of the terminal device exceeds a threshold, the terminal device selects one of the plural different imaging mechanisms on the basis of the inclination or acceleration. In a case where an imaging instruction is received, the terminal device performs imaging processing using the selected imaging mechanism.

Description

  The present invention relates to a terminal device that generates a 3D (three-dimensional) image obtained by photographing a subject, a processing method thereof, and a program.

  In recent years, due to the trend of 3D movies, there is an increasing demand for terminal devices (such as mobile phone terminals) capable of shooting 3D moving images and 3D still images. Thus, in order to perform 3D shooting, a mobile phone terminal equipped with two shooting mechanisms (cameras) for shooting left-eye and right-eye images is considered. Here, when shooting 2D (two-dimensional) moving images and still images with a mobile phone terminal equipped with two shooting mechanisms, it is expected that shooting will be performed with a monocular camera, and 3D moving images and still images will be shot. Therefore, it is necessary to prepare a function that can determine which one of the two cameras equipped for the purpose. In addition, the technique of the camera which is a technique relevant to this technique and switches a process according to the displacement of an apparatus main body is disclosed by patent document 1. FIG.

JP 2010-045681 A

  As described above, when shooting 2D images with a terminal for 3D image shooting equipped with two shooting mechanisms, still image shooting is performed using either one of the left-eye and right-eye cameras. Will be done. At this time, for example, when the two shooting mechanisms operate with different functions (left-eye shooting mechanism: for sepia image shooting, right-eye shooting mechanism: for normal image shooting), the user uses which camera to perform shooting. It is necessary to prepare a user interface that can select either. However, although a general user operation method may be a key operation from a menu, the key operation from the menu is not intuitive, and thus a function that is difficult for the user to use.

  Accordingly, an object of the present invention is to provide a terminal device, a processing method thereof, and a program that can solve the above-described problems.

  In order to achieve the above object, the present invention provides a terminal device having a plurality of different photographing mechanisms, a state detection unit for detecting the tilt or acceleration of the own device in a three-dimensional real space, and the tilt of the own device. Alternatively, when the acceleration exceeds a threshold value, the imaging mechanism selection unit that selects one of the plurality of different imaging mechanisms based on the tilt or acceleration and the imaging instruction are received And a photographing processing unit that performs photographing processing using the selected photographing mechanism.

  The present invention is also a processing method for a terminal device having a plurality of different imaging mechanisms, wherein the state detection unit detects the tilt or acceleration of the own device in a three-dimensional real space, and the imaging mechanism selection unit When the tilt or acceleration exceeds a threshold, one of the plurality of different shooting mechanisms is selected based on the tilt or acceleration, and the shooting processing unit issues the shooting instruction. When received, the processing method is characterized in that a shooting process is performed using the selected shooting mechanism.

  The present invention also provides a state detection means for detecting the tilt or acceleration of the own device in a three-dimensional real space, the computer of the terminal device having a plurality of different photographing mechanisms, and the tilt or acceleration of the own device exceeds a threshold value. A photographing mechanism selecting means for selecting one of the plurality of different photographing mechanisms based on the inclination or acceleration, and the selected photographing mechanism when receiving the photographing instruction. A program that functions as a photographing processing unit that performs photographing processing using the program.

  According to the present invention, a user of a terminal device selects an image capturing mechanism necessary for generating a 2D image, out of two image capturing mechanisms provided for generating a 3D image, using an intuitive user interface without stress. The operation can be performed.

It is a block diagram which shows the structure of a terminal device. It is a figure which shows the change of the state of a terminal device. It is a figure which shows the processing flow of a terminal device.

Hereinafter, a terminal device according to an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a terminal device according to the embodiment.
In this figure, reference numeral 1 denotes a terminal device. The terminal device 1 is, for example, a mobile phone, a PDA, a smartphone, or the like.
In this embodiment, the terminal device 1 includes the first photographing mechanism 11, the second photographing mechanism 12, the state detecting unit 13, the memory 14, the photographing mechanism selecting unit 15, the photographing start designation receiving unit 16, and the image type determining unit 17. The image processing unit 18 and the display unit 19 are provided.

Here, the 1st imaging mechanism 11 is the 1st camera of the two cameras provided in the terminal device 1 used for the production | generation of 3D image by imaging | photography of imaging | photography object.
The second imaging mechanism 12 is a second camera of the two cameras provided in the terminal device 1.
When one of these cameras is selected for photographing, the selected one performs photographing processing, thereby generating a 2D image.
In the present embodiment, two photographing mechanisms are provided, but two or more photographing mechanisms may be provided.

The state detection unit 13 is a processing unit that detects the inclination of the terminal device 1 in the three-dimensional real space. Alternatively, acceleration may be detected instead of the tilt of the terminal device 1.
The memory 14 is a storage unit that stores information such as results obtained by each processing unit and a generated image.
In addition, when the tilt or acceleration of the terminal device 1 exceeds a threshold value, the shooting mechanism selection unit 15 selects one of a plurality of different shooting mechanisms based on the tilt or acceleration. It is.
The shooting start designation receiving unit 16 is a processing unit that receives a shooting start designation input from the selected shooting mechanism from the user.
The image type determining unit 17 is a processing unit that determines an image type to be shot by the selected shooting mechanism every time the shooting mechanism selection unit 15 repeats the process of selecting the first shooting mechanism 11 or the second shooting mechanism 12. It is.
The imaging processing unit 18 is a processing unit that performs imaging using the first imaging mechanism 11 or the second imaging mechanism.
The display unit 19 is a processing unit that displays an image recorded in the memory 14 on a liquid crystal screen or the like.

In the present embodiment, the terminal device 1 detects the tilt or acceleration of the own device in the three-dimensional real space, and when the tilt or acceleration of the own device exceeds a threshold, 2 When one of the two different photographing mechanisms is selected and a photographing instruction is received, photographing processing is performed using the selected photographing mechanism.
At this time, before accepting the shooting start designation, the terminal device 1 repeats the process of selecting one of a plurality of different shooting mechanisms based on the tilt or acceleration of the own device, An imaging start designation by any selected imaging mechanism is accepted.
In addition, each time the terminal device 1 repeats the process of selecting a shooting mechanism, the terminal device 1 determines an image type to be shot by the selected shooting mechanism, and takes an image of the determined image type using the selected shooting mechanism. To do.
With such a process, the user's trouble of selecting a shooting mechanism when shooting a shooting target with a 2D image is reduced in a terminal device having a plurality of shooting mechanisms.

FIG. 2 is a diagram illustrating a change in the state of the terminal device.
FIG. 3 is a diagram illustrating a processing flow of the terminal device.
Hereinafter, the details of the processing of the terminal device will be described in order with reference to FIGS.
In the terminal device 1 according to the present embodiment, when the user tilts the terminal device 1, the tilt sensor provided in the state detection unit 13 detects the tilt, and when the tilt exceeds a threshold, the first photographing mechanism 11 or the second imaging mechanism 12 is selected as the imaging mechanism used for the imaging process.
More specifically, first, when the state detection unit 13 detects an inclination (step S101), data of the inclination is recorded in the memory 14. The state detection unit 13 updates the inclination data recorded in a predetermined storage area of the memory 14 to, for example, current inclination data at predetermined intervals or whenever a change in inclination is detected.
Then, the photographing mechanism selection unit 15 reads the tilt data recorded in the memory 14. Next, the imaging mechanism selection unit 15 selects either the first imaging mechanism 11 or the second imaging mechanism 12 based on the tilt data read from the memory 14 (step S102).

  Here, the state detection unit 13 of the terminal device 1 uses the horizontal direction in which the horizontal direction perpendicular to the vertex direction set in the terminal device 1 in advance coincides with the horizontal direction in the three-dimensional space as a reference. It is assumed that the angle when the camera is rotated to the left or right with the first imaging mechanism 11 or the second imaging mechanism 12 as a rotation axis is detected. Then, the state detection unit 13 records in the memory 14 inclination data including rotation direction information indicating the rotation in the left and right direction with respect to the memory 14 and the angle. Further, it is assumed that the imaging mechanism selection unit 15 stores the threshold values for the rotation in the left direction and the rotation in the right direction in advance in association with the rotation direction information.

  Then, the imaging mechanism selection unit 15 acquires the rotation direction information and the angle from the inclination data read from the memory 14, and compares the angle and the threshold value for the same rotation direction information. Then, when the angle is equal to or larger than the threshold value, the shooting mechanism selection unit 15 selects the shooting mechanism corresponding to the rotation direction as the shooting mechanism used at the time of shooting. For example, the imaging mechanism selection unit 15 stores information indicating that the first imaging mechanism 11 is selected when the rotation direction information is the right direction, and the second imaging mechanism 12 is selected when the rotation information is the left direction. When the angle of the terminal device 1 is equal to or greater than the threshold value, information on the imaging mechanism corresponding to the rotation direction indicated by the tilt data is read, and thereby the imaging mechanism is selected. The imaging mechanism selection unit 15 inputs information indicating inclination change from the state detection unit 13 that has detected an inclination change equal to or greater than a threshold value, reads the inclination data from the memory 14 each time, and selects an imaging mechanism used for imaging. Perform processing to select.

  Then, after the photographing mechanism selection unit 15 selects a photographing mechanism to be used for photographing processing, the photographing start designation receiving unit 16 performs photographing based on, for example, an operation of pressing a photographing start button provided in the terminal device 1 by the user. A start designation signal is input (step S103), and an imaging start designation is output to the imaging mechanism selection unit 15. Then, the photographing mechanism selection unit 15 inputs a photographing start designation from the photographing start designation receiving unit 16. As a result, the imaging mechanism selection unit 15 outputs the identification information of the selected imaging mechanism indicating either the first imaging mechanism 11 or the second imaging mechanism to the imaging processing unit 18. At this time, when the shooting start designation is input from the shooting start designation receiving unit 16, the shooting mechanism selection unit 15 stops the shooting mechanism selection process (step S104), and is selected immediately before the shooting start designation is input. The identification information of the imaging mechanism is output to the imaging processing unit 18. Thereby, the terminal device 1 is controlled so that a photographing mechanism is not changed once a photographing start designation operation is performed by a user. Then, the imaging processing unit 18 performs imaging processing using an imaging mechanism (either the first imaging mechanism 11 or the second imaging mechanism 12) corresponding to the input identification information (Step S105).

  When a 2D image is generated by shooting a subject, if the first shooting mechanism 11 is set to perform normal shooting, the second shooting mechanism 12 performs sepia image shooting, the first shooting mechanism 11 performs shooting processing. When the second imaging mechanism 12 is used for imaging processing, the first imaging mechanism 11 performs normal image generation based on imaging processing. When the second imaging mechanism 12 is used for imaging processing, the second imaging mechanism 12 is based on imaging processing. Generate a sepia image. Then, the first photographing mechanism 11 or the second photographing mechanism used for the photographing process records the image generated by the photographing process in the memory 14. The display unit 13 displays the captured image recorded in the memory 14 on a liquid crystal screen or the like.

  Note that the image type determination unit 17 may select the type of image captured by the imaging mechanism every time the imaging mechanism selection unit 15 selects the imaging mechanism used for the imaging process by the above-described processing. For example, it is assumed that the image type determination unit 17 stores in advance the types of images that can be generated as a result of the shooting process by the first shooting mechanism 11 and the second shooting mechanism. The first imaging mechanism 11 can generate a normal image and a monochrome image, and the second imaging mechanism 12 can generate a sepia image and a special image (mosaic processed image). In such a case, the image type determination unit 17 inputs the identification information of the selected imaging mechanism from the imaging mechanism selection unit 15, specifies the registered image type in association with the identification information, and performs the imaging process. To the unit 18. Further, when the tilt data is changed, the identification information of the imaging mechanism output from the imaging mechanism selection unit 15 changes. In this case, the image type registered in association with the identification information of the next selected imaging mechanism is specified. And output to the imaging processing unit 18. Each time the identification information is input in the order of the first shooting mechanism → second shooting mechanism → first shooting mechanism → second shooting mechanism, the image type is specified in the order of normal image → sepia image → black and white image → special image. And output to the imaging processing unit 16. Then, the imaging processing unit 16 instructs the imaging mechanism to generate an image according to the image type input from the image type determining unit 17, and the image generation according to the image type input by the first imaging mechanism 11 or the second imaging mechanism is performed. May be performed.

In FIG. 3, (1) shows that the first imaging mechanism 11 is selected by the imaging mechanism selection unit 15 and the image type determination unit 17 generates a normal image as a result of the terminal device 1 being tilted to the right. An example of the case is shown.
In FIG. 3, (2) is determined that the second imaging mechanism 12 is selected by the imaging mechanism selection unit 15 and the image type determination unit 17 generates a sepia image as a result of the terminal device 1 being tilted leftward. An example is shown.
In FIG. 3, (3) is determined as a result of the terminal device 1 being tilted to the right, so that the first shooting mechanism 11 is selected by the shooting mechanism selection unit 15 and the image type determination unit 17 generates a monochrome image. An example is shown.
In FIG. 3, (4) is determined as a result of the terminal device 1 being tilted to the left, so that the second imaging mechanism 12 is selected by the imaging mechanism selection unit 15 and the image type determination unit 17 generates a special image. An example is shown.

  As mentioned above, although embodiment of this invention was described, according to the process of the above-mentioned terminal device 1, the user of the terminal device 1 produces | generates a 2D image among the two imaging mechanisms provided for 3D image generation. Therefore, it is possible to perform an operation for selecting a photographing mechanism necessary for this purpose without stress by an intuitive user interface. In addition, since the user of the terminal device 1 does not need to provide a dedicated button as a mechanism for selecting a photographing mechanism necessary for generating a 2D image among the two photographing mechanisms provided for generating the 3D image. Thus, it is possible to obtain effects such as a simple configuration and cost reduction by reducing the number of parts.

  In the above-described processing, the example in which the photographing mechanism selection unit 15 selects the photographing mechanism used for photographing based on the tilt data has been described. However, the state detection unit 13 detects the acceleration, and the photographing mechanism based on the acceleration data. The selection unit 15 may select an imaging mechanism used for imaging. Specifically, the state detection unit 13 of the terminal device 1 captures the shooting direction with reference to the horizontal state in which the horizontal direction perpendicular to the vertex direction set in the terminal device 1 coincides with the horizontal direction in the three-dimensional space. It is assumed that the acceleration when moving left and right about (the focal direction of the camera of the first imaging mechanism 11 or the second imaging mechanism 12) is detected.

  Then, the state detection unit 13 records acceleration data including acceleration direction information indicating acceleration in the left or right direction with respect to the memory 14 and acceleration in the memory 14. In addition, it is assumed that the imaging mechanism selection unit 15 stores the threshold values for the acceleration in the left direction and the acceleration in the right direction in advance in association with the acceleration direction information. Then, the imaging mechanism selection unit 15 acquires acceleration direction information and acceleration from the acceleration data read from the memory 14, and compares the acceleration and threshold value for the same acceleration direction information. Then, when the acceleration is equal to or greater than the threshold value, the shooting mechanism selection unit 15 selects the shooting mechanism corresponding to the acceleration direction as the shooting mechanism used at the time of shooting. For example, the shooting mechanism selection unit 15 stores information indicating that the first shooting mechanism 11 is selected when the acceleration direction information is the right direction, and the second shooting mechanism 12 is selected when the acceleration information is the left direction. When the acceleration of the terminal device 1 is equal to or greater than the threshold value, information on the imaging mechanism corresponding to the acceleration direction indicated by the acceleration data is read, and thereby the imaging mechanism is selected.

  The terminal device 1 described above has a computer system inside. Each process described above is stored in a computer-readable recording medium in the form of a program, and the above process is performed by the computer reading and executing the program. Here, the computer-readable recording medium means a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, or the like. Alternatively, the computer program may be distributed to the computer via a communication line, and the computer that has received the distribution may execute the program.

  The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

DESCRIPTION OF SYMBOLS 1 ... Terminal device, 11 ... 1st imaging | photography mechanism, 12 ... 2nd imaging | photography mechanism, 13 ... State detection part, 14 ... Memory, 15 ... Imaging | photography mechanism selection part, 16. ..Shooting start designation receiving unit, 17 ... Image type determining unit, 18 ... Shooting processing unit, 19 ... Display unit

Claims (10)

A terminal device having a plurality of different shooting mechanisms,
A state detector that detects the tilt or acceleration of the device in a three-dimensional real space;
An imaging mechanism selection unit that selects one of the plurality of different imaging mechanisms based on the inclination or acceleration when the tilt or acceleration of the device exceeds a threshold;
A photographing processing unit that performs a photographing process using the selected photographing mechanism when receiving the photographing instruction;
A terminal device comprising: A shooting start designation receiving unit for receiving a shooting start designation by the selected shooting mechanism,
The imaging mechanism selection unit repeats the process of selecting one of the plurality of different imaging mechanisms based on the tilt or acceleration of the own device before accepting the imaging start designation. The terminal device according to claim 1. An image type determination unit that determines an image type to be captured by the selected shooting mechanism each time the shooting mechanism selection unit repeats the process of selecting the previous shooting mechanism.
The terminal device according to claim 1, wherein the photographing processing unit photographs an image of the determined image type using the selected photographing mechanism. The terminal device according to any one of claims 1 to 3, wherein the plurality of different shooting mechanisms are two shooting mechanisms necessary for generating a 3D image by shooting a subject. A processing method of a terminal device having a plurality of different photographing mechanisms,
The state detection unit detects the tilt or acceleration of its own device in the three-dimensional real space,
When the tilt or acceleration of the own apparatus exceeds a threshold value, the shooting mechanism selection unit selects one of the plurality of different shooting mechanisms based on the tilt or acceleration,
A processing method comprising: performing a shooting process using the selected shooting mechanism when a shooting processing unit receives the shooting instruction. The shooting start designation receiving unit receives a shooting start designation by the selected shooting mechanism,
The imaging mechanism selection unit repeats the process of selecting one of the plurality of different imaging mechanisms based on the tilt or acceleration of the own device before accepting the imaging start designation. The processing method according to claim 5. The image type determination unit determines an image type to be shot by the selected shooting mechanism every time the shooting mechanism selection unit repeats the process of selecting the shooting mechanism in the previous period,
The processing method according to claim 5 or 6, wherein the photographing processing unit photographs an image of the determined image type using the selected photographing mechanism. A terminal computer equipped with a plurality of different photographing mechanisms,
State detection means for detecting the tilt or acceleration of the device in a three-dimensional real space;
An imaging mechanism selection means for selecting one of the plurality of different imaging mechanisms based on the inclination or acceleration when the tilt or acceleration of the apparatus exceeds a threshold;
Photographing processing means for performing photographing processing using the selected photographing mechanism when receiving the photographing instruction;
A program characterized by functioning as The terminal device;
Functioning as a photographing start designation receiving means for accepting a photographing start designation by the selected photographing mechanism;
The photographing mechanism selecting means repeats a process of selecting any one of the plurality of different photographing mechanisms based on the tilt or acceleration of the own device before accepting the photographing start designation. The program according to claim 8, wherein the terminal device is made to function as: Each time the shooting mechanism selection unit repeats the process of selecting the shooting mechanism in the previous period, the previous period terminal device functions as an image type determination unit that determines an image type to be shot by the selected shooting mechanism,
The said imaging | photography process means makes the said terminal device function as a means to image | photograph the image of the determined image type using the selected imaging | photography mechanism. program.

Images