JP2015231178A - Image selection device, stereoscopic image display system, image selection method, and image selection program - Google Patents

Image selection device, stereoscopic image display system, image selection method, and image selection program Download PDF

Info

Publication number
JP2015231178A
JP2015231178A JP2014117288A JP2014117288A JP2015231178A JP 2015231178 A JP2015231178 A JP 2015231178A JP 2014117288 A JP2014117288 A JP 2014117288A JP 2014117288 A JP2014117288 A JP 2014117288A JP 2015231178 A JP2015231178 A JP 2015231178A
Authority
JP
Japan
Prior art keywords
image
set
distance
image selection
angle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2014117288A
Other languages
Japanese (ja)
Inventor
忠彦 小松
Tadahiko Komatsu
忠彦 小松
山田 智広
Tomohiro Yamada
智広 山田
Original Assignee
日本電信電話株式会社
Nippon Telegr & Teleph Corp <Ntt>
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電信電話株式会社, Nippon Telegr & Teleph Corp <Ntt> filed Critical 日本電信電話株式会社
Priority to JP2014117288A priority Critical patent/JP2015231178A/en
Publication of JP2015231178A publication Critical patent/JP2015231178A/en
Pending legal-status Critical Current

Links

Images

Abstract

A three-dimensional image group is generated from a group of images photographed at different angles from around the subject.
A left-eye image and a right-eye image for obtaining a stereoscopic view are selected based on a rotation angle θ and a convergence angle φ at the time of photographing from a 360-degree rotated photograph group obtained by photographing a subject all around. This makes it possible to generate a 360-degree stereoscopic image group that can stereoscopically view the subject all around.
[Selection] Figure 3

Description

  The present invention relates to a technique for generating a stereoscopic image.

  In a conventional electronic commerce site, a method has been used in which one or a plurality of product images are displayed and a purchaser views the images and selects a product. However, the method of purchasing a product by looking only at the product image lacks information for selecting a product as compared with a method of purchasing a product with an actual product in hand.

  A technique is known in which a product is photographed by rotating 360 degrees from the surroundings, and the obtained image group is continuously displayed in order according to the user's operation to make it appear as if the actual product is rotated (Non-Patent Document). 1).

  However, the technique of Non-Patent Document 1 merely displays a two-dimensional image sequentially, and there is a problem in that it has to feel unnaturalness due to a sense of depth, etc., compared with a stereoscopic image that can be stereoscopically viewed. .

  The present invention has been made in view of the above, and an object of the present invention is to generate a stereoscopic image group from a group of images photographed at different angles from around the subject.

  The image selection device according to the first aspect of the present invention includes an image set obtained by shooting an object a plurality of times at different angles without changing the shooting distance, a rotation angle when the image set is shot at different angles, and a shooting distance. Alternatively, an input means for inputting a convergence angle obtained from the photographing distance and the binocular distance, and a stereoscopic view from the set of images based on the rotation angle, the convergence angle obtained from the photographing distance and the binocular distance or the inputted convergence angle. And an image selection unit that selects an image pair of a left-eye image and a right-eye image to be obtained, and an output unit that outputs a set of the image pairs selected by the image selection unit.

  In the image selection device, the image selection unit determines an image interval based on a value obtained by dividing the convergence angle by the rotation angle, selects an image from the image set every image interval, and selects the image pair. It is characterized by doing.

  In the image selection device, the image selection apparatus includes a synthesis unit that generates a composite image in which the left-eye image and the right-eye image are alternately arranged line by line, and the output unit outputs the set of the composite images. Features.

  A stereoscopic image display system according to a second aspect of the present invention includes an image selection device that selects an image pair for obtaining a stereoscopic view from an image set obtained by photographing an object a plurality of times while changing an angle without changing an imaging distance, and a desired angle. A stereoscopic image display system comprising: a server device that transmits the image pair from which the stereoscopic view of the subject viewed from a user terminal operated by a user is operated, wherein the image selection device includes the image set; Input means for inputting a rotation angle when shooting a set of images at a different angle and a convergence angle obtained from the shooting distance or shooting distance and binocular distance; and a convergence obtained from the rotation angle and shooting distance and binocular distance. An image selection unit that selects an image pair of a left-eye image and a right-eye image for obtaining a stereoscopic view from the image set based on a corner or the input convergence angle, and the image selection unit selects Output means for outputting a set of image pairs, wherein the server device receives information about an angle at which the subject is viewed from the user terminal, and an image for acquiring the image pair corresponding to the angle. It has an acquisition means and a transmission means for transmitting the image pair to the user terminal.

  An image selection method according to a third aspect of the present invention is an image selection method executed by a computer, wherein an image set obtained by shooting an object a plurality of times while changing an angle without changing a shooting distance, and the image set being set at an angle. A step of inputting a rotation angle when shooting with a different angle and a convergence angle obtained from a photographing distance or a photographing distance and a binocular distance; a convergence angle obtained from the rotational angle, the photographing distance and a binocular distance or the inputted convergence Selecting an image pair of a left-eye image and a right-eye image for obtaining a stereoscopic view from the image set based on a corner; and outputting the set of image pairs selected in the step of selecting the image pair It is characterized by having.

  According to a fourth aspect of the present invention, there is provided an image selection program for operating a computer as each unit of the image selection apparatus.

  According to the present invention, it is possible to generate a three-dimensional image group from an image group photographed at different angles from around the subject.

It is a figure which shows a mode that a 360 degree | times rotation photograph is image | photographed. It is a figure which shows a mode that the stereo image which can view the to-be-photographed object is imaged. It is a functional block diagram which shows the structure of the image selection apparatus in 1st Embodiment. It is a flowchart which shows the flow of a process of the image selection apparatus in 1st Embodiment. It is a figure which shows a mode that the image pair which can be viewed stereoscopically is selected from a 360 degree | times rotation photograph. It is a whole lineblock diagram showing an example including an image selection device in a 1st embodiment. It is a functional block diagram which shows the structure of the image selection apparatus in 2nd Embodiment. It is a figure which shows the example of the synthesized image which the image selection apparatus in 2nd Embodiment produces | generates. It is a whole block diagram which shows the Example containing the image selection apparatus in 2nd Embodiment.

  First, a method for obtaining a 360-degree rotated photograph by changing the angle from around the subject will be described.

  FIG. 1 is a diagram illustrating a state where a 360-degree rotated photograph is taken. A subject 8 is set on a rotary table 9 and a camera 7 is fixedly arranged. The subject 8 is photographed by the camera 7 while rotating the rotary table 9 by a minute angle θ. It is assumed that the small angle θ satisfies the condition of the following expression (1) with respect to the number of shots n.

θ = 2π / n (1)
By photographing the subject 8 n times while rotating the rotary table 9 by a small angle θ, a total of 360 360-degree rotated photographs obtained by changing the angle from 360 degrees all around the subject 8 are obtained. As θ becomes smaller, smoother rotation display becomes possible. Note that the subject 8 may be fixed, and the camera 7 may be rotated around the subject 8 to obtain a 360-degree rotated photograph.

  Next, a mechanism for obtaining a stereoscopic image from a 360-degree rotated photograph will be described.

  FIG. 2 is a diagram illustrating a state in which a stereoscopic image that allows stereoscopic viewing of the subject 8 is captured. When the subject 8 on the rotary table 9 is photographed at the photographing distance l by the two cameras 7A and 7B installed at the distance b between the eyes, a stereoscopic image in which the convergence angle φ of the cameras 7A and 7B is combined with the subject 8 is obtained. can get. If the subject 8 is a stationary object that does not move, a stereoscopic image can be obtained by photographing twice by rotating the rotary table 9 by φ with one camera 7. That is, a stereoscopic image can be obtained by selecting two images rotated by φ from a 360-degree rotated photograph taken by the method of FIG. In FIG. 1, it is assumed that the minute angle θ for rotating the turntable 9 is smaller than the convergence angle φ obtained by the following equation (2).

2lsin (φ / 2) = e
φ = 2arcsin (e / 2l) (2)

[First Embodiment]
FIG. 3 is a functional block diagram illustrating a configuration of the image selection device 1 according to the first embodiment. The image selection device 1 shown in FIG. 1 includes an input unit 11, an image selection unit 12, and an output unit 13. The image selection device 1 is connected to a 360-degree rotated photo storage device 2 in which 360-degree rotated photos are stored. Each unit included in the image selection device 1 may be configured by a computer including an arithmetic processing device, a storage device, and the like, and the processing of each unit may be executed by a program. This program is stored in a storage device included in the image selection device 1, and can be recorded on a recording medium such as a magnetic disk, an optical disk, or a semiconductor memory, or provided through a network.

  The input unit 11 inputs shooting information when a 360-degree rotated photograph is taken. The shooting information includes a rotation angle θ and a shooting distance l. A convergence angle φ is obtained from the photographing distance l and a preset binocular interval e. Alternatively, the shooting information may include a convergence angle φ instead of the shooting distance l.

  The image selection unit 12 obtains a selection interval for selecting a left-eye image and a right-eye image for obtaining a stereoscopic view based on the rotation angle θ and the convergence angle φ.

  The output unit 13 acquires and outputs a pair of a left-eye image and a right-eye image from the 360-degree rotated photo storage device 2 at the selection interval obtained by the image selection unit 12.

  Next, the operation of the image selection device 1 in the present embodiment will be described.

  FIG. 4 is a flowchart showing the flow of processing of the image selection apparatus 1 in the present embodiment.

  First, the input unit 11 inputs the rotation angle θ and the convergence angle φ (step S11).

  Then, the image selection unit 12 determines an image selection interval Btw using the following equation (3) based on the rotation angle θ and the convergence angle φ (step S12).

Btw = ROUND (φ / θ) −1 (3)
Here, ROUND is a function that rounds off decimals. In the case of θ <φ <1.5θ, Btw = 0, and adjacent images of the 360-degree rotated photograph are selected as a set of stereoscopic images. When 1.5θ ≦ φ <1.5θ, Btw = 1, and every other 360-degree rotated image is selected as a set of stereoscopic images. By setting in this way, it is possible to bring the binocular parallax of stereoscopic display as close as possible to reality.

  Then, the output unit 13 reads a pair of images separated by the selection interval Btw determined by the image selection unit 12 from the 360-degree rotated photo storage device 2, and outputs the read image pair as a stereoscopic image (step S13). By repeating the process of step S13 for the number of 360-degree rotated photographs, a stereoscopic image group that allows stereoscopic viewing of the subject from a 360-degree direction is obtained.

  FIG. 5 is a diagram illustrating a state in which the output unit 13 selects a stereoscopically viewable image pair from the 360-degree rotated photograph storage device 2. The 360-degree rotated photo storage device 2 stores n images 51, 52,..., 59 obtained by shifting the subject from the entire 360-degree circumference by the rotation angle θ. Images 51 and 52 are images obtained by photographing the subject from the direction shifted by the rotation angle θ. Similarly, the images 52 and 53 are images obtained by photographing the subject from the direction shifted by the rotation angle θ. Hereinafter, an image obtained by photographing the subject from the direction shifted by the rotation angle θ continues.

  When the image selection unit 12 determines that Btw = 2, the output unit 13 skips the images 51, 52,..., 59 by two and selects the left-eye image and the right-eye image. Specifically, when the image 51 is an image for the left eye, the two images 52 and 53 are skipped and the image 54 is selected as the image for the right eye. Subsequently, the image 52 is selected as the left eye image, and the image 55 is selected as the right eye image. The output unit 13 finally outputs a total of n image pairs.

  Next, an example using a stereoscopic image output by the image selection device 1 according to the first embodiment will be described.

  FIG. 6 is an overall configuration diagram illustrating an example including the image selection device 1 according to the first embodiment. In the embodiment shown in FIG. 6, an image selection device 1, a content server 31, and an intermediate server 32 are connected on a network. The user terminal 41 acquires a stereoscopic image via a network and causes the HMD (head mounted display) 42 to display the stereoscopic image.

  The content server 31 stores the stereoscopic image group output by the image selection device 1. The intermediate server 32 receives a request including information on the angle at which the subject is viewed from the user terminal 41, acquires a set of stereoscopic images corresponding to the angle from the content server 31, and transmits it to the user terminal 41.

  When the user terminal 41 receives a set of stereoscopic images from the intermediate server 32, the left and right eye images of the stereoscopic image are displayed on the left and right eye display panels of the HMD 42. Further, when the user terminal 41 inputs an operation for rotating the subject displayed on the HMD 42 from the user, the user terminal 41 requests the intermediate server 32 for a stereoscopic image taken from an angle corresponding to the input operation. When the user terminal 41 receives the stereoscopic image transmitted from the intermediate server 32 and updates the image of the HMD 42, the subject displayed on the HMD 42 can be rotated by a user operation.

  In this embodiment, the user terminal 41 obtains a stereoscopic image corresponding to the user's operation from the content server 31. However, the image selection device 1 includes a user interface, and the image selection device 1 inputs the user's operation to select the image. The apparatus 1 may select and display a stereoscopic image according to the user's operation. Further, the image selection device 1 may include a storage device that stores the stereoscopic image group, and the intermediate server 32 may acquire a desired stereoscopic image from the image selection device 1. Alternatively, the intermediate server 32 requests the image selection device 1 for a stereoscopic image in which the subject is viewed from a desired angle, and the image selection device 1 that has received the request selects an image pair corresponding to the angle and transmits it to the intermediate server 32. May be.

  As described above, according to the present embodiment, for the left eye for obtaining a stereoscopic view based on the rotation angle θ and the convergence angle φ at the time of shooting from the 360-degree rotated photo group in which the subject is shot over the entire circumference. By selecting an image and an image for the right eye, it is possible to generate a 360-degree stereoscopic image group capable of stereoscopically viewing the subject all around. As a result, the subject can be freely rotated and stereoscopically displayed by the user's operation, and a more realistic product display is possible.

  In the present embodiment, a 360-degree rotated photograph group in which the subject is photographed over the entire 360 ° circumference is used, but it is not always necessary to prepare a photograph for the entire circumference, for example, 180 degrees or other angles. A three-dimensional image can be obtained by using a minute photo.

[Second Embodiment]
FIG. 7 is a functional block diagram illustrating a configuration of the image selection device 1 according to the second embodiment. The image selection device 1 according to the second embodiment is different from the image selection device 1 according to the first embodiment in that an image composition unit 14 is provided instead of the output unit 13.

  The image composition unit 14 acquires a pair of left-eye images and right-eye images from the 360-degree rotated photo storage device 2 at the selection interval obtained by the image selection unit 12, and can display the image pairs on the 3D display device. After the resolution conversion is performed, a composite image of the horizontal interleave method is generated in which the left-eye image and the right-eye image are alternately arranged one line at a time in the vertical direction. FIG. 8 shows an example of a composite image. A composite image 61 shown in FIG. 8 is a composite of images 51 and 54, and a composite image 62 is a composite of images 52 and 55. When n images are stored in the 360-degree rotated photo storage device 2, n composite images 61 and 62 are generated.

  Next, an example using the composite image output by the image selection device 1 in the second embodiment will be described.

  FIG. 9 is an overall configuration diagram illustrating an example including the image selection device 1 according to the second embodiment. In the embodiment shown in FIG. 9, the image selection device 1 and the content server 31 are connected on the network. The user terminal 41 acquires a composite image via the network and causes the 3D television 43 to display a stereoscopic image.

  The content server 31 stores the composite image group output from the image selection device 1. A polarization type 3D television 43 is connected to the user terminal 41. When the user terminal 41 transmits the composite image acquired from the content server 31 to the 3D television 43, the stereoscopic image is displayed on the 3D television 43.

  When the user terminal 41 inputs an operation for rotating the subject displayed on the 3D television 43 from the user, the user terminal 41 acquires a composite image corresponding to an angle corresponding to the input operation from the content server 31 and transmits the composite image to the 3D television 43. Thereby, the subject displayed on the 3D television 43 can be rotated by a user operation.

  As described above, according to the present embodiment, for the left eye for obtaining a stereoscopic view based on the rotation angle θ and the convergence angle φ at the time of shooting from the 360-degree rotated photo group in which the subject is shot over the entire circumference. By selecting an image and an image for the right eye and generating a horizontal interleaved composite image, a stereoscopic image of the subject can be displayed on the polarization-type 3D television 43.

DESCRIPTION OF SYMBOLS 1 ... Image selection apparatus 11 ... Input part 12 ... Image selection part 13 ... Output part 14 ... Image composition part 2 ... 360 degree rotation photograph storage device 31 ... Content server 32 ... Intermediate server 41 ... User terminal 42 ... HMD
43 ... 3D TV 7, 7A, 7B ... Camera 8 ... Subject 9 ... Turntable

Claims (6)

  1. The set of images obtained by shooting the subject multiple times at different angles without changing the shooting distance, the rotation angle when shooting the set of images at different angles, and the convergence angle obtained from the shooting distance or shooting distance and binocular distance Input means for inputting;
    An image for selecting an image pair of a left eye image and a right eye image for obtaining a stereoscopic view from the image set based on the rotation angle and the convergence angle obtained from the photographing distance and the binocular distance or the input convergence angle. A selection means;
    Output means for outputting the set of image pairs selected by the image selection means;
    An image selection device comprising:
  2.   The image selection means determines an image interval based on a value obtained by dividing the convergence angle by the rotation angle, and selects an image from the image set every image interval to form the image pair. The image selection device according to claim 1.
  3. Combining means for generating a combined image in which the left-eye image and the right-eye image are alternately arranged line by line;
    The image selection apparatus according to claim 1, wherein the output unit outputs the set of the composite images.
  4. An image selection device for selecting an image pair for obtaining a stereoscopic view from a set of images obtained by photographing the subject a plurality of times while changing the angle without changing the shooting distance, and the image for obtaining a stereoscopic view of the subject viewed from a desired angle A stereoscopic image display system comprising a server device that transmits a pair to a user terminal operated by a user,
    The image selection device includes:
    An input means for inputting the image set, a rotation angle when the image set is shot at a different angle, and a convergence angle obtained from a shooting distance or a shooting distance and a binocular distance;
    An image for selecting an image pair of a left eye image and a right eye image for obtaining a stereoscopic view from the image set based on the rotation angle and the convergence angle obtained from the photographing distance and the binocular distance or the input convergence angle. A selection means;
    Output means for outputting the set of image pairs selected by the image selection means,
    The server device
    Receiving means for receiving information on an angle at which the subject is viewed from the user terminal;
    Image acquisition means for acquiring the image pair corresponding to the angle;
    A stereoscopic image display system comprising: a transmission unit configured to transmit the image pair to the user terminal.
  5. An image selection method executed by a computer,
    The set of images obtained by shooting the subject multiple times at different angles without changing the shooting distance, the rotation angle when shooting the set of images at different angles, and the convergence angle obtained from the shooting distance or shooting distance and binocular distance Step to enter,
    A step of selecting an image pair of a left eye image and a right eye image for obtaining a stereoscopic view from the image set based on the rotation angle and the convergence angle obtained from the photographing distance and the binocular distance or the input convergence angle. When,
    Outputting the set of image pairs selected in the step of selecting the image pairs;
    An image selection method characterized by comprising:
  6.   An image selection program for causing a computer to operate as each unit of the image selection apparatus according to claim 1.
JP2014117288A 2014-06-06 2014-06-06 Image selection device, stereoscopic image display system, image selection method, and image selection program Pending JP2015231178A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2014117288A JP2015231178A (en) 2014-06-06 2014-06-06 Image selection device, stereoscopic image display system, image selection method, and image selection program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2014117288A JP2015231178A (en) 2014-06-06 2014-06-06 Image selection device, stereoscopic image display system, image selection method, and image selection program

Publications (1)

Publication Number Publication Date
JP2015231178A true JP2015231178A (en) 2015-12-21

Family

ID=54887753

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2014117288A Pending JP2015231178A (en) 2014-06-06 2014-06-06 Image selection device, stereoscopic image display system, image selection method, and image selection program

Country Status (1)

Country Link
JP (1) JP2015231178A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02210434A (en) * 1989-02-10 1990-08-21 Sharp Corp Stereoscopic photographing device
JP2002077948A (en) * 2000-09-05 2002-03-15 Canon Inc Apparatus and method for displaying stereoscopic image as well as storage medium
JP2008294530A (en) * 2007-05-22 2008-12-04 Fujifilm Corp Imaging apparatus, image reproducing device, imaging method, image reproducing method, and program
JP2010113159A (en) * 2008-11-06 2010-05-20 Sharp Corp Stereoscopic image display apparatus and method
JP2013070153A (en) * 2011-09-21 2013-04-18 Nikon Corp Imaging apparatus

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH02210434A (en) * 1989-02-10 1990-08-21 Sharp Corp Stereoscopic photographing device
JP2002077948A (en) * 2000-09-05 2002-03-15 Canon Inc Apparatus and method for displaying stereoscopic image as well as storage medium
JP2008294530A (en) * 2007-05-22 2008-12-04 Fujifilm Corp Imaging apparatus, image reproducing device, imaging method, image reproducing method, and program
JP2010113159A (en) * 2008-11-06 2010-05-20 Sharp Corp Stereoscopic image display apparatus and method
JP2013070153A (en) * 2011-09-21 2013-04-18 Nikon Corp Imaging apparatus

Similar Documents

Publication Publication Date Title
JP2018507650A (en) Method and apparatus for supporting content generation, transmission, and / or playback
US9185288B2 (en) Apparatus and method for generating and consuming three-dimensional (3D) data format to generate realistic panoramic image
US8581961B2 (en) Stereoscopic panoramic video capture system using surface identification and distance registration technique
JP5887267B2 (en) 3D image interpolation apparatus, 3D imaging apparatus, and 3D image interpolation method
JP5917017B2 (en) Image processing apparatus, control method therefor, and program
JP5312676B2 (en) Stereo camera with automatic control of interpupillary distance
KR102013978B1 (en) Method and apparatus for fusion of images
Ideses et al. Real-time 2D to 3D video conversion
EP2357841B1 (en) Method and apparatus for processing three-dimensional images
EP2328125B1 (en) Image splicing method and device
US7605776B2 (en) Stereoscopic-vision image processing apparatus, stereoscopic-vision image providing method, and image display method
US8694922B2 (en) Method for displaying a setting menu and corresponding device
US9049423B2 (en) Zero disparity plane for feedback-based three-dimensional video
US7180536B2 (en) Method for producing stereoscopic images from monoscopic images
Birklbauer et al. Panorama light‐field imaging
Yamanoue et al. Geometrical analysis of puppet-theater and cardboard effects in stereoscopic HDTV images
JP5977752B2 (en) Video conversion apparatus and display apparatus and method using the same
US6747610B1 (en) Stereoscopic image display apparatus capable of selectively displaying desired stereoscopic image
CN1934874B (en) Three dimensional acquisition and visualization system for personal electronic devices
US8780111B2 (en) 3D display apparatus and method for processing image using the same
US8655163B2 (en) Consolidated 2D/3D camera
WO2011114683A1 (en) Stereovision-image position matching apparatus, stereovision-image position matching method, and program therefor
Matusik et al. 3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes
JP5426785B2 (en) Image processing apparatus and image processing method
KR20150068299A (en) Method and system of generating images for multi-surface display

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20160913

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20170515

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20170620

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20180130