DE102008015527A1 - Augmented reality image producing method for manufacturing motor vehicle i.e. land vehicle, involves recording real image by camera, and combining selected and/or aligned image component with part of real image to augmented reality image - Google Patents

Abstract

The method involves recording a real image (RB) by a camera (3), and assigning a rotation angle (alpha) of the camera to the real image. A virtual image component is selected and/or aligned depending upon the rotation angle. The selected and/or aligned image component is combined with a part of the real image to an augmented reality image (ARB). Another rotation angle (beta) that is orthogonal to the former rotational angle is assigned to the real image. A distance between a camera and an object to be recorded by the camera is measured. An independent claim is also included for a device for producing an augmented reality image.

Description

The The invention relates to a method and a device for combining a real image with a virtual image component or Create an augmented reality image.

The aforementioned The object is achieved by a method of combining a real image with a virtual image component or for generating an augmented reality image solved, wherein a real image is taken by means of a camera, wherein the real image associated with at least a first angle of rotation of the camera being, depending on the first rotation angle, a virtual image component selected and / or is aligned, and wherein the selected and / or aligned virtual image component with at least a part of the real image (to an augmented reality image) is combined. An augmented reality image is in the sense of the invention in particular a combination or superimposition a real image with a virtual image component. An augmented reality image is in the sense of the invention in particular a combination or superimposition a real image with a virtual image component, wherein the real image and the virtual image component content, spatial, explanatory and / or complementary interact. An augmented reality image is in the sense of the invention in particular a combination or superimposition of a real image with a virtual image component, where the real Image and the virtual image component with graphical means or figurative content, spatial, illustrative and / or complementary interact.

One according to the invention generated augmented reality image is particularly suitable for the target-actual comparison of real equipment and digital data for robot simulation in real environments, support of maintenance and service work on equipment and vehicles and the control of furnishings.

In Furthermore, an advantageous embodiment of the invention is the real Image assigned a second rotation angle of the camera, with the second Angle of rotation an orthogonal to the first angle of orientation component is orthogonal to the first rotation angle is or different from the first angle of rotation. In a further advantageous embodiment According to the invention, the virtual image component is dependent the first angle of rotation and the second angle of rotation selected and / or aligned.

In Furthermore advantageous embodiment of the invention is a distance between the camera and an object captured by the camera measured. in a further advantageous embodiment of the invention The virtual image component is also dependent on the distance between the camera and the object recorded by the camera selected and / or aligned. In a further advantageous embodiment of the invention is the distance between the camera and the camera recorded object a combination of the first rotation angle and associated with the second angle of rotation.

The aforementioned Task becomes - in particular in conjunction with the aforementioned features - also by a method for combining a real image with a virtual image component or for generating an augmented reality image, wherein (in a setup phase) a combination of a first Angle of rotation of the camera and one different from the first rotation angle second angle of rotation of the camera associated distance between the Camera and measured by the camera object measured becomes, whereby (in a utilization phase) a real picture by means of a Camera is taken, wherein the real image, at least the first Rotational angle of the camera and the second rotation angle of the camera assigned being, depending on the first rotation angle and the second rotation angle a virtual Image component selected and / or aligned, and wherein the selected and / or aligned virtual image component with at least a part of the real image (to an augmented reality image) is combined. It is special provided that a set-up phase a plurality of usage phases can follow.

The aforementioned Methods are advantageously used for producing a motor vehicle Use, wherein the motor vehicle by means of a the aforementioned methods designed Augmented Reality image and / or manufactured.

The aforementioned Task becomes - in particular in conjunction with the aforementioned features - also by a device for combining a real image with a virtual image component or for generating an augmented reality image, wherein the device comprises a first rotation angle sensor for measuring a first Rotation angle, a second rotation angle sensor for measuring one of the first rotation angle different second rotation angle, one fixed with connected to the first rotation angle sensor and the second rotation angle sensor Camera of a real image and an evaluation device to choose from and / or orientation of a virtual image component depending on of the first rotation angle and the second rotation angle and to the combination of the selected and / or aligned virtual image component with at least a part of the real image (to an augmented reality image).

In Furthermore, an advantageous embodiment of the invention comprises Set up a rangefinder to measure a distance between the camera and an object captured by the camera. In Furthermore, an advantageous embodiment of the invention is the virtual Picture component also in dependence the distance between the camera and that recorded by the camera Object selectable and / or alignable.

It may also provide a method for generating an augmented reality image be provided according to the one real image with at least a first marker by means of a camera is taken, and wherein a virtual image component with at least a part of the real image depending on the first marker is combined into an augmented reality image, and wherein the first Marker in dependence at least one angle of rotation between the first marker and a second marker (in particular with respect to a measuring device) and / or positioned a distance between the first marker and a meter becomes.

motor vehicle in the context of the invention is in particular an individual on the road usable land vehicle. Motor vehicles in the context of the invention especially not on land vehicles with internal combustion engine limited.

Further Advantages and details will become apparent from the following description of exemplary embodiments. Showing:

1 an embodiment of an apparatus for generating an augmented reality image,

2 an embodiment of a method for generating an augmented reality image,

3 an embodiment of a real image,

4 an embodiment of a virtual image component and

5 an embodiment of an augmented reality image as a combination of the real image according to 3 and the virtual image component according to 4 ,

1 shows an embodiment of a device for generating an augmented reality image whose function is based on a in 2 explained process flow is explained. The referring to 1 described device for generating an augmented reality image comprises a rotation angle sensor 1 for measuring a rotation angle α and a rotation angle sensor 2 for measuring a rotation angle α orthogonal to the rotation angle α. The two rotation angle sensors 1 and 2 are stuck with a camera 3 connected to receive a real image RB, so that the rotation angle α and β, the orientation of the camera 3 specify. In addition, the device for generating an augmented reality image comprises a laser rangefinder 4 who is also stuck with the camera 3 is connected and by means of which the distance Δ between the camera 3 and one by means of the camera 3 recorded object can be determined. The device for generating an augmented reality image can be designed as a theodolite, wherein z. B. instead of a binoculars the camera 3 is used. In addition, it can be provided that the device for generating an augmented reality image is a tripod 5 comprises, by means of which the device is fixable on the floor.

The device for generating an augmented reality image additionally comprises an evaluation device 10 whose operation is described with reference to the procedure according to 2 is explained. It is first - as by the query block 21 in 2 indicated - to distinguish whether the device for generating an augmented reality image is already set up or not. If it is not set up, the angle of rotation α, the angle of rotation β and the distance Δ are measured. The step 22 follows a step 23 in which the combination of the angles of rotation α and β the distance Δ is assigned. The steps 22 and 23 take place for all relevant solid angles, ie combinations of the rotation angles α and β. The steps 22 and 23 define a setup phase.

The setup phase is followed by the steps described below 24 . 25 and 26 defined useful phase, wherein it is provided in particular that a set-up phase can follow a plurality of usage phases. It will be in one step 24 the angles of rotation α and β measured. In addition, by means of the camera 3 a real picture RB, as exemplified in 3 is shown, recorded. The step 24 follows a step 25 in which - as in 1 through the function block 11 the evaluation device 10 represented as a function of the rotation angle α and β and possibly their associated distance Δ a virtual image component VB, as it is exemplified in 4 is shown, selected and / or aligned. For example, this may be done manually using a human-machine interface, not shown, which may include, for example, a screen, a mouse, and / or a keyboard. In this case, the function block represents 11 in 1 a development environment for creating, selecting and / or aligning virtual image components.

The step 25 follows a step 26 , by doing - as through the function block 12 the evaluation device 10 in 1 indicated and / or aligned virtual image component VB with at least a portion of the real image RB to an augmented reality image RB, as exemplified in 5 is shown combined. In the in 5 In the example shown, the virtual image component VB is used to explain the installation of a window lifter in a vehicle door.

The For example, prescribed methods can be advantageously used for Manufacture of a motor vehicle can be used, wherein the motor vehicle according to the above A method for generating an augmented reality image is designed and / or manufactured.

1, 2

Rotation angle sensor

3

camera

4

Laser rangefinders

5

tripod

10

evaluation

11 12

function block

21

query block

22 23, 24, 25, 26

step

ARB

Augmented reality image

RB

Reales image

VB

virtual Image component

α, β

angle of rotation

Δ

distance

Claims (13)

Method for generating an augmented reality image (ARB), wherein a real image (RB) is generated by means of a camera ( 3 ), characterized in that the real image (RB) at least a first rotation angle (α) of the camera ( 3 ), wherein a virtual image component (VR) is selected and / or aligned depending on the first rotation angle (α), and wherein the selected and / or aligned virtual image component (VR) is associated with at least a portion of the real image (RB) an augmented reality image (ARB) is combined. A method according to claim 1, characterized in that the real image (RB) a second angle of rotation (β) of the camera ( 3 ), wherein the second rotation angle (β) comprises an alignment component orthogonal to the first rotation angle (α). Method according to claim 2, characterized in that that the second angle of rotation (β) orthogonal to the first rotation angle (α). Method according to claim 2 or 3, characterized that the virtual image component (VR) depending on the first rotation angle (α) and the second angle of rotation (β) selected and / or aligned. Method according to one of the preceding claims, characterized in that a distance (Δ) between the camera ( 3 ) and one by means of the camera ( 3 ) is measured. A method according to claim 5, characterized in that the virtual image component (VR) also in dependence of the distance (Δ) between the camera ( 3 ) and by means of the camera ( 3 ) is selected and / or aligned. Method according to claim 5 or 6, characterized in that the distance (Δ) between the camera ( 3 ) and by means of the camera ( 3 ) is assigned a combination of the first rotation angle (α) and the second rotation angle (β). Method for producing an augmented reality image (ARB), characterized in that a combination of a first rotation angle (α) of the camera ( 3 ) and one of the first rotation angle (α) different second rotation angle (β) of the camera ( 3 ) assigned distance between the camera ( 3 ) and one by means of the camera ( 3 ), whereby a real image (RB) is measured by means of a camera ( 3 ), wherein the real image (RB) at least the first rotation angle (α) of the camera ( 3 ) and the second rotation angle (β) of the camera ( 3 ), wherein a virtual image component (VR) is selected and / or aligned in dependence on the first rotation angle (α) and the second rotation angle (β), and wherein the selected and / or aligned virtual image component (VR) with at least one part of the real image (RB) to an augmented reality image (ARB) is combined. Method for producing a motor vehicle, characterized characterized in that the motor vehicle by means of a according to a Method according to one of the preceding claims, generated augmented reality image (ARB) is designed and / or manufactured. Device for generating an augmented reality image (ARB), characterized in that the device comprises a first rotation angle sensor (ARB) 1 ) for measuring a first angle of rotation (α), a second angle of rotation sensor ( 2 ) for measuring a second rotation angle (β) different from the first rotation angle (α), one fixed to the first rotation angle sensor ( 1 ) and the second rotation angle sensor ( 2 connected camera ( 3 ) to record a real Image (RB) and an evaluation device for selecting and / or aligning a virtual image component (VR) in dependence on the first rotation angle (α) and the second rotation angle (β) and for combining the selected and / or aligned virtual image component (VR) with at least a part of the real image (RB) to an augmented reality image (ARB). Device according to claim 10, characterized in that the device comprises a rangefinder ( 4 ) for measuring a distance (Δ) between the camera ( 3 ) and one by means of the camera ( 3 ) recorded object. A method according to claim 11, characterized in that the virtual image component (VR) also in dependence of the distance (Δ) between the camera ( 3 ) and by means of the camera ( 3 ) is selectable and / or alignable. A method for generating an augmented reality image (ARB), wherein a real image (RB) with at least one first marker by means of a camera ( 3 ), and wherein a virtual image component (VR) is combined with at least a part of the real image (RB) as a function of the first marker to an augmented reality image (ARB), characterized in that the first marker depending on at least a rotation angle between the first marker and a second marker and / or a distance between the first marker and a measuring device is positioned.