WO2018024503A1

WO2018024503A1 - Production of a panoramic image provided for a stereoscopic reproduction and such a reproduction

Info

Publication number: WO2018024503A1
Application number: PCT/EP2017/068443
Authority: WO
Inventors: Michael Haas
Original assignee: Innaq Gmbh
Priority date: 2016-08-02
Filing date: 2017-07-21
Publication date: 2018-02-08
Also published as: AT518256B1; AT518256A4

Abstract

The invention relates to a computer-implemented method for producing a panoramic image provided for a stereoscopic reproduction. According to the invention, the method comprises the following steps: a) recording at least one pair of images with a camera arrangement (1), each pair of images consisting of a first image and a second image, and a recording position (7a) of the first image being moved and/or rotated in relation to a recording position (7b) of the second image; b) rotating the camera arrangement (1) in relation to a first axis of rotation (3) by an increment (Δ) of an angle of rotation from an angle of rotation position (4a) to a next angle of rotation position (4b); and c) repeating steps a) and b) until a preferably pre-determinable first region (6) of the angle of rotation is covered, in order to produce a sequence of recordings of at least one pair of images for the successive angle of rotation positions (4a, 4b, 4c,..., 4n).

Description

GENERATING A PANORAMIC IMPOSITION FOR STEREOSCOPIC REPRODUCTION AND SUCH A PLAYBACK

FIELD OF THE INVENTION

The present invention relates to a computer-implemented method for generating a stereoscopic one

Play panoramic image provided.

Moreover, the present invention relates to a

Computer-implemented method for stereoscopic

Playback of a with an inventive

computer-implemented panoramic image by means of a stereoscopic display device.

STATE OF THE ART

Panoramic photographs have been made for a long time in order to capture scenes such as Landscapes or

To capture real estate as a panoramic view. A user or viewer of the panoramic image should in the episode one

View angles can be freely selected, with the angle of view directed to a specific part of the scene.

Today, panorama pictures are created by combining (also known as "stitching") individual pictures into a complete picture

typically made in a horizontal rotation angle range of 360 ° and in an elevation angle range of 180 °. The This resulting view is then by appropriate projection methods (eg, spherical or cubic) so

shown that the viewer to the desired

Line of sight matching picture and matching

Image section gets. The panoramic images thus generated are used for monoscopic, but also for stereoscopic representations, which is associated with a number of disadvantages.

The main drawback is that when the angle is changed, the motion parallax visible in reality is not

can be played. Such changes of the

View angles are particularly useful in applications in the

virtual reality where the user can turn and expects to see a corresponding rotation of the viewed panoramic image from the first-person perspective. The lack of motion parallax causes an unnatural impression, which usually significantly reduces the immersion and the spatial impression of the user.

In particular, in a stereoscopic - but also in a monoscopic - presentation, this has a negative effect. Another disadvantage of known manufacturing methods of

Panoramic images is the susceptibility to changes in the scene. A typical example of such a change would be a vehicle that drives through the scene during the shoot, so that different parts (or parts of the footage) on different shots do not

Vehicle can be seen. This leads to the consequence that the recordings can not be combined or only with very limited quality. OBJECT OF THE INVENTION

The present invention has set itself the task of a method for generating stereoscopic

Play provided panoramic images and a

To provide stereoscopic reproduction process for these panoramic images, which avoid the disadvantages mentioned above.

In particular, it should be possible to reproduce a motion parallax. Preferably, the method of generating the panoramic images shall be robust to dynamic changes, e.g. be opposed to moving vehicles, in scenes to be recorded.

PRESENTATION OF THE INVENTION

To achieve the object mentioned, a computer-implemented method for generating a panoramic image intended for stereoscopic reproduction is provided according to the invention

provided, the method comprising the following steps: a) taking at least one pair of images with a

Camera assembly, each pair of images consisting of a first image and a second image, and wherein a recording position of the first image is shifted and / or rotated relative to a recording position of the second image;

b) rotating the camera assembly with respect to a first axis of rotation by a Drehwinkelinkrement from a rotational angular position to a next rotational angular position;

c) repeating steps a) and b) until a, preferably predeterminable, first rotation angle range is swept over in order to produce a sequence of recordings of the at least one pair of images for the successive rotational angle positions. It is in a preferred embodiment of the computer-implemented method according to the invention

provided that the procedure the following further step includes:

d) generating at least one video file from the images of the sequence, preferably a first video file from the first images of the sequence and a second video file from the second images of the sequence. This serves above all the

Compression of the individual images and reduces the

Storage requirements accordingly. In principle, however, this can also be dispensed with and the generated sequence of image pairs can be used as such for the panoramic image. Of course, the two video files or the pair of video files can be packed into a single video file to better handle the panoramic image. Respectively. It is also possible to create a single video file directly from the pictures in the sequence. The captured panoramic picture is suitable for the

stereoscopic rendering, especially in virtual reality (VR) applications or augmented reality (AR) applications, e.g. by means of a so-called Head Mounted

Display (HMD), which depending on the design as well

Video glasses, helmet display, VR helmet or data helmet is called.

The recordings are made at certain times

Rotation angle positions in the first rotation angle range.

By recording a plurality of pairs of images per rotational angle position, a partial sequence of image pairs, in particular a pair of video sequences, can be produced at each rotational angular position

be recorded.

Of course it can only be one pair of pictures per

Be recorded angular position. Accordingly, it is provided in a preferred embodiment of the computer-implemented method according to the invention that exactly one pair of images is taken for each rotational angular position, which Among other things, a particularly rapid recording of the panoramic image allows.

The two images of each pair of images are taken from different recording positions, wherein the relative arrangement of the recording positions to each other is preferably the same at all rotational angle positions. This creates the prerequisite for the generation of

Motion parallax. The playback does not have to

inevitably stereoscopic, but can in principle also be monoscopic. The inventive method always provides a panoramic image with motion parallax.

By choosing this relative arrangement to be similar to the relative arrangement of a user's eyes, the first image of each image pair can be basically assigned to one user's eye and the second image of each image pair to the other user's eye. This creates the prerequisite for stereoscopic vision.

From the sequence of individual pairs of images following each other according to the successive rotational angle positions, each pair of images consisting of a first and a second image, two video files can result, namely a video file for the sequence of the first images and a video image. File for the sequence of second images. If per

Rotation angle position are recorded multiple pairs of images, there are at each rotation angle position a subsequence of a plurality of first images and a subsequence of several second images. Again, ultimately two video files can be obtained. One of these video files results from the sequence of the partial sequences of the first images, that is, again from a sequence of the first images. The other of these video files follows from the sequence of

Subsequences of the second images, so again from a

Sequence of the second pictures. In the simplest case, none made further rotations about other axes of rotation, so that the generated panoramic image from the sequence of image pairs or from at least one video file, preferably from the said two video files consists. The video files can basically be stored in known video formats and known per se

Tools or programs edited and reproduced.

Basically, this method is for generating

Panoramic images in monoscopic playback tolerate changes in the scenery, since no stitching must be done and each eye sees the same picture.

Preferably, the first rotation axis is parallel to the vertical, so that a horizontal first rotation angle range results. The first rotation angle range preferably extends from a rotation angle start position to a

Angle of rotation end position.

The first rotation angle range may be e.g. 360 °. Typical values for the rotational angle increment are in the range from 0.01 ° to 20 °, preferably from 0.1 ° to 5 °, particularly preferably from 0.5 ° to 3 °.

Preferably, the Drehwinkelinkrement is chosen to be constant. In this case, the rotational angle positions can be determined as the sum of the rotational start angle position and an integer one

Multiples of the rotation angle increment.

In order to be able to ensure the two receiving positions with as little constructive effort as possible, in particular as inexpensively as possible, at each rotational angle position, it is provided in a preferred embodiment of the computer-implemented method according to the invention that the

Camera assembly includes a camera that between the Recording position of the first image and the recording position of the second image is movable back and forth. Of course, this is to be understood that the two shooting positions also

actually be taken by the camera. It follows that the panoramic image according to the invention can also be generated with only a single camera.

The movement of the camera between the shooting positions can be done in different ways. In a preferred embodiment of the computer-implemented method according to the invention, it is provided that the movement of the camera between the receiving position of the first image and the

Recording position of the second image by a linear

Shift occurs. For this purpose, the camera may be guided on a linear rail, for example, and e.g. be moved by means of an electric motor or by means of an electric, pneumatic or hydraulic cylinder. The linear

In turn, rail can be rotated about the first axis of rotation to transfer the camera assembly from one rotational position to the next. To the movement of the camera between the shooting positions technically particularly simple, especially special

cost-effective to be able to realize, it is in a preferred embodiment of the invention

computer implemented method provided that the

Movement of the camera between the recording position of the first image and the recording position of the second image by rotation, preferably about the first axis of rotation takes place.

In particular, when the rotation about the first axis of rotation takes place, the same technical means can be used to on the one hand to transfer the camera assembly from one rotational position to the next and on the other hand to move the camera between the two pickup positions. To account for the spaced apart arrangement of human eyes carry two parts of the picture or "picture halves" at each angle of rotation position

used, which may preferably overlap. For example, the first image part can extend over 0% to 70% of a width of the image and the second image part over 30% to 100% of the width of the image. Furthermore, to generate the image pair at a certain rotational angle position, images of

Taken rotational positions that come before and after the specific rotational angle position. For example, to generate the image pair at the particular rotational angle position

on the one hand, the image, which is recorded at two rotational angle positions previously, and on the other hand, the image, which is recorded at two rotational angle positions afterwards,

used. Preferably, to generate the pair of images at the determined rotational angle position, on the one hand, the image which is recorded at the immediately preceding rotational angle positions and, on the other hand, the image which is recorded at the immediately following rotational angular positions,

used. The following will be an example of this

Special case, the explanation applies

course analogous to the aforementioned general case (angular positions before and after the particular

Rotation angle position): The one image part of the image, which at the rotational angle position immediately before

is detected at a certain rotational angle position, the first image of the image pair is at the determined rotational angular position. The recording position of the first image is thus set by the camera arrangement at the rotational angle position immediately before the determined rotational angular position. The other image part of the image, which is taken at the rotational angle position immediately after the determined rotational angular position, is the second image of the image pair at the particular one

Rotational angle position. The recording position of the second picture is thus determined by the camera arrangement at the rotational angle position immediately after the specific rotational angular position.

In other words, the camera takes on one

Rotation angle position with its "left" image section on the image that would have seen the right eye of a user at a previous position, and in the "right" section is the image for the left eye, which would have seen it at a later position.

In accordance with the above, step b) can also be carried out at least partially simultaneously with step a), which in turn saves time

Panoramic image allowed.

In a preferred embodiment of the computer-implemented method according to the invention, the images are taken with a wide-angle objective, preferably with a

Fisheye lens, made to cover the largest possible area with each image.

In order to provide an even faster and structurally more stable possibility for the recordings, it is provided in a preferred embodiment of the computer-implemented method according to the invention that the camera arrangement has a first camera and a camera shifted relative to it and / or

twisted second camera, wherein the first image is taken with the first camera and the second image with the second camera. Preferably, the first camera takes all first images and the second camera takes all second images.

Preferably, the triggering of the two cameras takes place

at the same time, ie the first picture and the second picture are recorded simultaneously. From the sequence of first images taken with the first camera, the first video file can be generated and from the sequence of second images taken with the second camera, the second video file.

The two cameras can for this purpose e.g. be mounted on a holder, with the position of the two cameras

is preferably adjustable to each other on the holder. The holder may then be rotated about the first axis of rotation to transfer the camera assembly from one rotational position to the next. During the implementation of the method according to the invention, the relative arrangement of the two cameras - and thus in particular their distance from one another - preferably remains fixed.

The version with two cameras is also included

stereoscopic rendering tolerant of changes in scenery. For example, if a car moves through the scene during recording, it is usually captured by both cameras at the same time. In the

stereoscopic playback, therefore, the car is also displayed to each eye, i. e. it does not occur that e.g. the left eye sees a part of the car and the right eye sees no part of the car.

If the images are taken slowly at the successive rotational positions with the corresponding rotation, it can only happen that in one rotational position the car is visible and in an adjacent one

Angle position not, but the immersion or the

Room impression does not bother significantly. If the recordings are made quickly at the successive rotational positions with the corresponding rotation, the movement of the car may be traced to some extent. That the user sees the panorama when looking at the different

Turning angle positions the car at different positions in the scenery and perceives this as movement of the car, which can additionally enhance the immersion or the impression of space.

In other words, the rapid recording with two cameras even enables the recording of changes in the scene and stereoscopic reproduction.

As already said, the arrangement of the two

Recording positions relative to each other are chosen so that a certain similarity to the relative arrangement of the eyes of a user for the particular scene is given. It should be noted that a line that the two eyes of the

User connects with each other, during a rotation of the

Generally, the user will not intersect the axis of rotation about an axis of rotation, but will be spaced therefrom. To take this circumstance into account when taking the panoramic image, it is in a preferred embodiment of the

The computer-implemented method according to the invention

provided that the camera assembly from the first axis of rotation has a first distance. In other words, the camera assembly is rotated eccentrically about the first axis of rotation. Preferably, the first distance on the one hand and the relative arrangement of the two receiving positions to each other on the other hand are matched. The so produced

Panoramic picture allows a particularly realistic-looking

Reproduction. In the case of VR applications, it is thus possible to achieve a particularly high quality immersion of the user.

To the largest possible area with the panoramic picture

cover that of a rotation about a second axis of rotation

corresponding to which second axis of rotation with the first axis of rotation a non-zero angle, preferably an angle of 90 °, includes, when shooting a fisheye lens can be used. In this way, with each shot practically a range of 180 ° can be recorded around the second axis of rotation. In particular, it is this way it is possible to cover a vertical area without requiring actual pivoting of the camera assembly about the second axis of rotation which would then be horizontal. Of course, but also when using a

Fisheye lens rotation about the second axis to cover an even larger area around the second axis. Preferably, however, a rotation about the second axis is used when using lenses that are not

Fisheye lenses are.

In a preferred embodiment of the computer-implemented method according to the invention, it is provided that the steps a) to c) are repeated after the

Camera assembly has been rotated about a second axis of rotation, wherein the second axis of rotation with the first axis of rotation at an angle not equal to zero, preferably an angle of 90 °, includes. It is preferably provided that the steps a) to d) are repeated after the camera arrangement has been rotated about the second axis of rotation. Due to the rotation or possibly the rotations about the second axis of rotation, a sequence of second angular positions (with respect to the second axis of rotation) is obtained

Axis of rotation), preferably a sequence of elevation angles, set or generated.

That at a plurality of second rotational angle positions about the second axis of rotation is in each case a sequence of image pairs or

Preferably, each of the first and second video file are recorded. In other words, the recorded

Panoramic image consisting of several sequences or pairs of video files, the number of these sequences or of these pairs being equal to the number of occupied second ones

Rotation positions and wherein each of the pairs consists of one of the first video files and the associated second video file. In particular, in this way, a vertical component of the scene to be captured can be taken into account by the panorama image not only a horizontal

Rotation angle range covered, but also one

Elevation angle range. The elevation angle range is thus one

Special case of a second rotation angle range in which the second rotation angle positions are located. This extends from a second angle of rotation starting position to a second angle of rotation end position. At least one elevation angle

(sometimes just as height or elevation called) or a second angular position is always present anyway.

Of course, there may be several iterations, so not just two (i.e., not just the second

Rotation angle start position and the second

Rotation angle end position), but more than two second

Rotation angle positions are taken, which are in the second rotation angle range.

The second rotation angle range or its size may be e.g. in the range of 45 ° to 180 °, preferably from 45 ° to 90 °. But there are also larger areas conceivable.

Successive second rotational angle positions may differ by one, preferably constant, second rotational angle element. Typical values for the second

Rotation angle increment are in the range of 0.01 ° to 20 °,

preferably from 0.1 ° to 5 °, more preferably from 0.5 ° to 3 °.

As mentioned, the inventively produced are

Panoramic images ideal for stereoscopic playback.

Accordingly, according to the invention is a computer-implemented method for stereoscopic reproduction of a computer-implemented method according to the invention

recorded panoramic image by means of a stereoscopic display device, the method comprising the following steps:

aa) determining a viewing angle under which the panoramic image is to be reproduced;

bb) calculating a display rotation angle position, wherein the display rotation angle position is the rotation angle position corresponding to the view angle with respect to the first rotation axis;

cc) determining the rotational angular position in the sequence closest to the rotational latent position;

dd) use of the at least one pair of images of these

Rotation angle position for creating at least one

Display picture pair;

ee) reproducing the at least one first image of the

at least one display image pair by means of a first display of the stereoscopic display device and the

at least one second image of the at least one

Display picture pair by means of a second display of the stereoscopic display device.

A user sees with one eye the first display of the stereoscopic display device and with the other eye the second display. When changing the angle, the

Motion parallax fully reproduced, resulting in a particularly realistic viewing experience for the user. The use of the at least one image pair, which was taken for the rotational angle position in the sequence that comes closest to the representation rotational angle position, for the creation of the at least one representation image pair can be done differently. In a particularly easy to be realized embodiment of the invention

computer-implemented method, it is provided that at step dd), the at least one pair of images this

Angular position than the at least one

Display image pair is adopted. In particular, when the rotational angle positions around the first axis of rotation are not very close, so if that

Drehwinkelinkrement has been relatively large in the images, a continuous as possible of the

Panoramic image or the most correct representation of the panoramic image at the desired

Display rotational position can be interpolated or computationally achieved. For this it is at a preferred

Embodiment of the computer-implemented method according to the invention provided that the following steps are performed in step dd):

Determining a deviation of this rotational angular position from the representation rotational angular position;

if the deviation is greater than a predefinable threshold value, calculating the at least one representation image pair from the at least one image pair of that rotation angle position which occurs in the sequence immediately before

Representation rotational position is, and the at least one pair of images that rotational angle position, which is in the sequence immediately after the presentation rotational position; otherwise: Apply the at least one image pair of this rotational angle position as the at least one

View images pair. The latter corresponds to the above

mentioned particularly easy to be realized

Embodiment.

In the event that the panorama image is in the form of at least one video file, preferably in the form of at least one pair of video files, it should be noted that the sequence of image pairs is of course directly derived from the

at least one video file, preferably from the at least one pair of video files, can be extracted, and thus available anyway, to perform the above steps. The calculation of the at least one representation image pair can be done in a manner known per se, for example by blending the first images of the at least one

Pair of images at the rotational angle position which is immediately before the display rotational angular position in the sequence, and the at least one image pair at the rotational angular position which occurs in the sequence immediately after

Display rotational position is. However, known methods can also be used in which the images are projected onto a projection body (usually a sphere or a cube), wherein the projection body rotates and / or

is translated. Respectively. Of course, combinations of such methods are also applicable.

The determination of the angle of view can be done in different ways. To be technically very easy too

In a preferred embodiment of the invention, it is possible to make this determination possible

computer implemented method provided that the

Determination of the angle of view by means of a

Input device made choice. That the user can e.g. by means of a keyboard, a mouse, one

Touchscreens or the like, enter or select the desired angle.

In particular, to the user in VR applications a

In order to enable high-quality immersion, it is provided in a preferred embodiment of the computer-implemented method according to the invention that the

Determination of the viewing angle based on sensor signals. That A conscious input of the user is not absolutely necessary. Instead, movements of the user are detected by sensors and are the

corresponding sensor signals evaluated. Such sensor systems are known per se from today's VR applications. For example, at least one so-called eye tracker can be used to To follow movement of an eye or the eyes of the user and to determine thereon based on the current angle of view. Or, for example, a so-called head tracker can be used to register movements of the user's head and, based on this, to determine the current viewing angle. Furthermore, for example, the orientation of other body parts or the entire body of the

User can be determined continuously by means of the sensors to determine based on the current angle of view.

In the event that the panoramic picture, which with the

According to a preferred embodiment of the computer-implemented method according to the invention, it is provided that, in addition, a second display rotational angle position is determined, which is the angle of view relative to the second The rotation axis corresponds to that sequence which can be assigned to a second rotation angle position with respect to the second rotation axis, which second rotation angle position comes closest to the second representation rotation angle position, and the image pairs of this sequence are used for the creation of the at least one representation image pair. In the simplest case, only the image pairs of this sequence for the creation of at least one

Used image pair of images.

However, it is also possible to use image pairs from "adjacent" sequences (related to the second rotational angle positions) for producing the at least one display image pair, in particular if the second rotational angular positions around the second rotational axis are not very dense, ie if the second rotational angle increment has been relatively large , can one As continuous as possible course of the panoramic image or as correct as possible representation of the panoramic image at the desired second representation rotational position

be achieved interpolated or mathematically. For this purpose, it is provided in a preferred embodiment of the computer-implemented method according to the invention that when using the image pairs of this sequence for the creation of the at least one display image pair the following steps are provided:

Determining a deviation of said second rotational angular position from the second rotational latent position;

if the deviation is greater than a predefinable second threshold: calculating the at least one

Representation image pair of the at least one pair of images of the sequence at that second rotational angular position, the

is immediately before the second display rotation angle position, and the at least one pair of images of the sequence at that second rotation angle position, which is immediately after the second display rotation angle position; otherwise: Apply the image pairs of the sequence at this second rotation angle position to create the at least one representation image pair. The latter corresponds to the above

mentioned particularly easy to be realized

Design variant. The calculation of the at least one representation image pair can be carried out in a manner known per se, for example by blending the image pairs of the sequences which are at the second rotation angle positions, the second

Adjacent display rotation position. But there are also known methods applicable in which the images on a

Projection (usually a ball or a cube) are projected, the projection body rotates and / or

is translated. Respectively. Of course, combinations of such methods are also applicable. BRIEF DESCRIPTION OF THE FIGURES

The invention will now be explained in more detail with reference to exemplary embodiments. The drawings are exemplary and are intended to illustrate the inventive idea, but in no way restrict it or even reproduce it.

Showing:

1 shows a schematic illustration of a camera arrangement when carrying out a method according to the invention, the camera arrangement having a camera

2 shows a schematic illustration of a camera arrangement when carrying out a method according to the invention, the camera arrangement having a first camera and a second camera

WAYS FOR CARRYING OUT THE INVENTION

In Fig. 1, a camera assembly 1 is illustrated, as in the implementation of an inventive

computer-implemented method for generating a panoramic image intended for a stereoscopic reproduction is used. In this case, the inventive

computer-implemented method basically the following steps:

a) taking at least one pair of images with the

Camera assembly 1, wherein each pair of images consists of a first image and a second image and wherein a

Recording position 7a of the first image relative to a

Receiving position 7b of the second image is shifted and / or rotated; b) rotating the camera assembly 1 with respect to a first

Rotary axis 3 by a Drehwinkelinkrement Δ of one

Rotation angle position 4a to a next rotation angle position 4b; c) repeating steps a) and b) until a, preferably predefinable, first rotation angle range 6 is swept over in order to produce a sequence of recordings of the at least one pair of images for the successive rotational angle positions 4a, 4b, 4c, ..., 4n.

For reasons of space, the following step is also preferably performed: d) generating at least one video file from the pictures of the sequence, preferably a first video file from the first pictures of the sequence and a second video file from the second pictures of the sequence.

This will in particular the reproduction of a

Motion parallax possible.

To reproduce the thus captured panoramic image by means of a stereoscopic display device, such as a video recorder. by means of a head mounted display (not shown)

According to the invention, a computer-implemented method

It includes the following steps:

bb) calculating a display rotation angle position, wherein the display rotation angle position is the rotation angle position corresponding to the view angle with respect to the first rotation axis 3;

dd) use of the at least one pair of images of these

Rotation angle position for creating at least one

Display picture pair;

ee) reproducing the at least one first image of the

at least one display image pair by means of a first display of the stereoscopic display device and the at least one second image of the at least one display image pair by means of a second display of the stereoscopic display device. A user sees with one eye the first display of the stereoscopic

Playback device and with the other eye the second display. When changing the viewing angle, e.g. when the user turns and the rotation is registered by means of sensors or when the user selects a different angle by means of an input device, the motion parallax becomes full

what a particularly realistic

Viewing experience for the user.

In the exemplary embodiment of FIG. 1, the camera arrangement 1 comprises a camera 9.

The camera assembly 1 is about the first axis of rotation 3,

for example by means of an electric motor (not

shown), rotatable. The first rotation axis 3 may-but need not of course-be parallel to the vertical, so that in this case the first rotation angle range 6 is a horizontal first rotation angle range 6. The first rotation angle range 6 is approximately 305 ° in FIG. 1, but can in principle also be up to and including 360 °.

The rotation is eccentric to the first axis of rotation 3, i. the camera arrangement 1 has a first distance 5 greater than zero from the first axis of rotation 3. For example, the first distance 5 can be in the range from 1 cm to 100 cm, preferably from 5 cm to 15 cm. Typically, the distance becomes similar to the radius of a human head, e.g. about 8 cm, chosen to the user's perspective as possible

to capture reality. However, it is possible to take pictures in a way that looks like a dwarf or a giant, for which more extreme distances are chosen, which may be in the ranges given above. In Fig. 1, the camera 9 is drawn with solid lines at the rotational angle position 4a, wherein the rotational angle position 4a corresponds to a rotational angle start position. The

Angular position 4n thus corresponds to one

Drehwinkelendposition, wherein the first rotation angle range from the rotation angle start position to the

Angle of rotation end position extends. At the rotational angle positions 4b, 4c, 4n, the camera 9 is indicated only by dashed lines.

The Drehwinkelinkrement Δ is chosen constant in the embodiment of FIG. 1 and is about 12.5 °.

At each rotation angle position 4a, 4n, a picture is taken. In order to take into account the spaced apart arrangement of the human eyes, this is the

taken picture at each rotational angle position 4a, 4n divided into two image parts that can overlap each other.

Furthermore, to create the pair of images s.einer

certain rotational angle position taken pictures of rotational angle positions that come before and after the specific rotational angle position. For example, to generate the pair of images at the specific rotational angle position, on the one hand, the image which is previously recorded at two rotational angle positions and, on the other hand, the image which is recorded at two rotational angle positions are used. Preferably, to generate the pair of images at the determined rotational angle position, on the one hand, the image which is recorded at the immediately preceding rotational angle positions and, on the other hand, the image which immediately follows

Rotation angle positions is added, used.

With reference to FIG. 1, this can be illustrated as follows, wherein the two thick bars in the camera 9, the two

Symbolize parts of the picture taken. For illustrative purposes, the two thick lines are spaced apart, but it should be emphasized again that the Image parts may actually overlap and generally overlap. The rotational angle position 4b is the specific rotational angular position. The one (shown in

Example right) Picture part of the picture, which at the

Rotation angle position 4a is received immediately before the rotational angular position 4b, the first image of the pair of images to the rotational angle position 4b. The recording position 7a of the first image of the pair of images for the rotational angle position 4b is therefore set by the camera arrangement 1 at the rotational angle position 4a immediately before the rotational angular position 4b. The other (left-hand in the illustrated example) image part of the image, which is taken at the rotation angle position 4c immediately after the rotation angle position 4b, is the second image of the image pair to the rotation angle position 4b. The recording position 7b of the second image of the pair of images for the rotational angle position 4b is thus set by the camera arrangement at the rotational angle position 4c immediately after the rotational angular position 4b.

For the generation of the other pairs of images to the other rotational angle positions is proceeded completely analog. The camera 9 is thus rotated by rotation of the camera assembly 1 about the first axis of rotation 3 at the same time between the

Recording positions 7a, 7b reciprocated. This therefore represents a technically particularly simple solution to be realized. According to the above, a rotation angle α results around the first rotation axis 3, which is 1.5 times the rotation angle increment Δ, between the reception positions 7a, 7b.

In the camera assembly 1, the camera 9 is further rotatably mounted about a second axis of rotation 8 and can be rotated about this in a conventional manner, for example with a

Electric motor (not shown). The second axis of rotation 8 is in the illustrated embodiment normal to the first axis of rotation 3. The second axis of rotation 8 may - but of course not - be parallel to the horizontal, so that by rotation of the camera assembly 1 about the second axis of rotation 8 a

Elevation angle range or a second rotation angle range

is swept, which is typically in the range of 45 ° to 180 °.

It should be noted that the elevation angle range is also through

Use of a fisheye lens could be covered, if necessary to dispense with a rotation of the camera assembly 1 to the second axis of rotation 8 can. Specifically, in the illustrated embodiment, the recording of the panoramic image done so that at several second

Rotation angle positions about the second axis of rotation 8 respectively the sequence of image pairs or the first and second video file are recorded, as described above. In this case, the first rotation angle range 6 is preferably completely swept over at every second rotational angular position. That The pair of images or images are then recorded at the rotational angle positions 4a, 4n at a specific second rotational angle position, then the rotation about the second rotational axis 8 is effected by a second rotational angle increment, whereupon the image pairs or images are recorded at the rotational angle positions 4a, 4n and immediately. The panoramic image therefore includes every other rotational angular position or for every second

Rotation angle position a sequence of image pairs or a first and a second video file.

In the event that the panoramic image shoots at more than one elevation angle or more than a second

Contains angular position, during playback, a second representation of rotational angle position can be determined, which corresponds to the angle of view relative to the second axis of rotation 8. Then, that sequence is determined which can be assigned to that second rotational angular position which comes closest to the second rotational representation angular position. The Image pairs of this sequence are finally used to create the at least one display image pair.

Fig. 2 shows a further embodiment of the

Camera assembly 1, as in the implementation of a

The computer implemented method according to the invention for

Generation of one for a stereoscopic reproduction

provided panoramic image is used. In contrast to FIG. 1, the camera arrangement 1 in FIG. 2 has a first camera 2a and a second camera 2b, which is particularly rapid

Recording the panorama picture allowed. The first camera 2a and the second camera 2b are mounted on a linear mount 10 so that they have a preferably adjustable, fixed offset arrangement to each other. Typically, the two cameras 2a, 2b have a distance 11 in the range from 1 cm to 100 cm, preferably from 3 cm to 16 cm

to each other. Typically, the distance will be similar to the distance of the human eyes, e.g. approx. 6.4 cm, chosen to capture the user's perspective as realistically as possible. However, it is possible to take pictures in a way that looks like a dwarf or a giant, for which more extreme distances are chosen, which may be in the ranges given above. It should be noted that theoretically it would also be conceivable that the cameras 2a, 2b can also be rotated relative to each other.

The first camera 2 a serves to receive the first images and is located at the recording position 7 a at each rotational angle position 4 a, 4 n. The second camera 2b is for taking the second images and is at each

Rotation angle position 4a, 4n at the receiving position 7b.

Due to the relatively shifted arrangement of the cameras 2a, 2b, the receiving positions 7a, 7b are shifted relative to each other accordingly. From the sequence of first images taken with the first camera 2a, and the sequence of second images taken with the second camera 2b, the sequence of image pairs can be generated. Respectively. For example, from the sequence of first images taken with the first camera 2a, the first video file can finally be generated and from the sequence of second ones

Pictures taken with the second camera 2b, the second video file.

During rotation about the first axis of rotation 3, the two cameras 2 a, 2 b are rotated together with the linear holder 10. The linear holder 10 is arranged at the first distance 5 from the first axis of rotation 3. The first distance 5 is also in the embodiment of FIG. 2 in the range of 1 cm to 100 cm, preferably from 5 cm to 15 cm.

The first rotation angle range 6 in FIG. 2 is 360 °, with the camera arrangement 1 being shown only in the case of the rotation angle position 4b with solid lines and in the case of

Rotation angle positions 4a, 4c with dashed lines

is indicated. The rotational angle increment Δ is selected to be very large in FIG. 2 and is approximately 39 °. In the embodiment of FIG. 2 extends through the linear support 10, the second axis of rotation 8, which is also normal in this case on the first axis of rotation 3. In this case, the second axis of rotation 8 - as in the embodiment of FIG. 1 - at each rotational position 4a, 4n a tangent to an imaginary circle 12 whose radius is the first distance 5 and whose center lies on the first axis of rotation 3.

That Also, the camera assembly 1 of FIG. 2 allows the

Covering the first rotation angle range 6 around the first

Rotary axis 3 and the second rotation angle range about the second axis of rotation 8. As already described above, is in the

Recording typically proceeded so that at every second rotational angular position of the first rotation angle range 6 completely is swept over. That is, at a certain second rotational angle position, the image pairs are recorded at the rotational angle positions 4a, 4n, then the rotation about the second rotational axis 8 takes place by a second rotational angle increment, whereupon the image pairs are taken up again at the rotational angle positions 4a, 4n and so on. The panoramic image therefore comprises a sequence of image pairs or a first and a second video file at every second rotational angle position or for every second rotational angular position, wherein each first video file was recorded with the first camera 2a and every second video file with the second camera 2b.

LIST OF REFERENCE NUMBERS

I Camera arrangement 2a First camera

2b Second camera 3 First axis of rotation

4a, 4b, 4c, 4n rotational position

5 First distance

6 First rotation angle range

7a, 7b recording position of the first / second image

8 second axis of rotation

9 camera

10 Linear bracket

II Distance between the first and the second camera 12 Thought circle

Δ Drehwinkelinkrement α rotation angle between the recording positions of the first and second image

Claims

Computer-implemented method for generating a stereoscopic reproduction

Panoramic image, the method comprising the following

Steps :

a) taking at least one pair of images with a

A camera assembly (1), wherein each pair of images consists of a first image and a second image, and wherein a photographing position (7a) of the first image is shifted relative to a photographing position (7b) of the second image

and / or twisted;

b) rotating the camera assembly (1) relative to a first axis of rotation (3) by a Drehwinkelinkrement (Δ) from one rotational angular position (4a) to a next

Rotation angle position (4b);

c) repeating steps a) and b) to a,

preferably predefinable, first rotation angle range (6) is swept over to produce a sequence of recordings of the at least one pair of images for the successive rotational angular positions (4a, 4b, 4c, ..., 4n).

A computer-implemented method according to claim 1, characterized in that the method comprises the following further step:

d) Generate at least one video file from the

Pictures of the sequence, preferably a first video file from the first pictures of the sequence and a second video file from the second pictures of the sequence.

Computer-implemented method according to one of claims 1 to 2, characterized in that the camera arrangement (1) comprises a camera (9), which between the

Recording position (7a) of the first image and the

Recording position (7b) of the second image is movable back and forth. A computer-implemented method according to claim 3, characterized in that the movement of the camera (9) between the receiving position (7a) of the first image and the

Recording position (7b) of the second image by a

linear shift takes place.

A computer-implemented method according to claim 3, characterized in that the movement of the camera (9) between the receiving position (7a) of the first image and the

Recording position (7b) of the second image by a

Rotation, preferably about the first axis of rotation (3),

he follows .

Computer-implemented method according to one of Claims 1 to 2, characterized in that the camera arrangement (1) has a first camera (2a) and a second camera (2b) displaced and / or rotated relative thereto.

wherein the first image is taken with the first camera (2a) and the second image with the second

Camera (2b).

Computer-implemented method according to one of claims 1 to 6, characterized in that for each

Rotation angle position (4a, 4b, 4c, ..., 4n) exactly

Picture pair is taken.

Computer-implemented method according to one of claims 1 to 7, characterized in that the camera arrangement (1) of the first axis of rotation (3) has a first distance (5).

Computer-implemented method according to one of claims 1 to 8, characterized in that the steps a) to c) are repeated after the camera assembly (1) has been rotated about a second axis of rotation (8), wherein the second axis of rotation (8) with the first axis of rotation (3) a Angle not equal to zero, preferably an angle of 90 °, includes.

Computer-implemented method for stereoscopic reproduction of a computer-implemented

Method according to one of claims 1 to 9 recorded panoramic image by means of a stereoscopic

Reproduction device, the method comprising the following steps:

aa) determining a viewing angle under which the

Panoramic image to be played;

bb) calculating a display rotation angle position, wherein the display rotation angle position is that

Is rotational angle position, which corresponds to the viewing angle with respect to the first axis of rotation (3);

dd) using the at least one pair of images of this rotational angle position for the creation of at least one display image pair;

ee) reproducing the at least one first image of the at least one display image pair by means of a first display of the stereoscopic display device and the at least one second image of the at least one display image pair by means of a second display of the stereoscopic display device.

Computer-implemented method according to claim 10, characterized in that at step dd) the

at least one pair of images of this rotational angle position is adopted as the at least one representation image pair.

12. A computer-implemented method according to claim 10,

characterized in that at step dd) the following Steps to be performed:

- if the deviation is greater than a predefinable

Threshold is: Calculate the at least one

Display image pair from the at least one

Pair of images of that angular position, which lies in the sequence immediately before the representation rotational position, and the at least one pair of images that

Rotation angle position that is in the sequence immediately after the display rotation angle position; otherwise: Apply the at least one pair of images of this

Angular position than the at least one

Display picture pair.

Computer-implemented method according to one of claims 10 to 12, characterized in that the determination of the angle of view due to a means of a

Input device made choice.

Computer-implemented method according to one of claims 10 to 13, characterized in that the determination of the angle of view is based on sensor signals.

Computer-implemented method according to one of Claims 10 to 14, characterized in that, in addition, a second representation rotational angle position is determined, which corresponds to the viewing angle with respect to the second rotational axis (8), that sequence is determined which corresponds to a second rotational angular position with respect to the second rotational axis (Fig. 8) can be assigned, which second

Angular position of the second

The display rotation position comes closest, and the image pairs of that sequence are used to create the at least one display image pair. Computer-implemented method according to claim 15, characterized in that when using the image pairs of this sequence for creating the at least one display image pair following

Steps are provided:

- Determining a deviation of this second

Angular position of the second

Presentation rotational angle position;

Display image pair from the at least one

Picture pair of the sequence at the second

Angular position immediately before the second

Display rotational position is, and the at least one pair of images of the sequence at that second

Rotation angle position that is immediately after the second display rotation angle position; otherwise:

Applying the image pairs of the sequence at this second rotational angle position for the creation of the at least one display image pair.