WO2015070881A1

WO2015070881A1 - Display arranged for combining a physical object with one or more digital images

Info

Publication number: WO2015070881A1
Application number: PCT/DK2014/050391
Authority: WO
Inventors: Peter Simonsen
Original assignee: Realfiction Aps
Priority date: 2013-11-14
Filing date: 2014-11-14
Publication date: 2015-05-21
Also published as: DK201370683A1

Abstract

The present invention relates to a display (1) for presenting products or objects in combination with digital images in the form of free-floating video elements. Said display (1) comprises at least three semi-transparent mirrors (2, 3, 4) combined into a part of a pentahedron (5), and at least three image sources in the form of monitor devices (6,7,8). Each monitor device is arranged for projecting the digital images via each their subjacent semi-transparent mirror onto a physical object placed on a base (9) of the pentahedron (5). The monitor devices are placed in different planes, thereby ensuring that the dimensions of the image sources is not no longer an restriction. It is accordingly possible to use retail monitor devices without having to alter or adjust the dimensions of said devices. This not only provides a less expensive display, but also ensures that the maintenance of the display is reduced.

Description

Display arranged for combining a physical object with one or more digital images .

The present invention relates to a display arranged for combining a physical object with one or more digital images.

Mixed-reality displays designed to present products or objects in combination with free floating video elements are known in the art. One example is the Dreamoc® XL system obtainable from Realfiction ApS, Denmark; in which it is possible to combine physical objects with video and computer graphics, thereby transforming an otherwise trivial product into an entertaining and immersive experience for potential customers.

In these known displays, different image sources are arranged for projecting digital content, e.g. video elements, onto angled semi-transparent mirrors forming at least a part of a pyramid, thereby ensuring that the video elements are superimposed on an actual physical object.

One essential requirement in this respect is that in order to ensure a convincing appearance of the mixed-reality, it has commercially been necessary to use projectors as the choice of image source, as these are capable of rendering images on a wide range of surfaces. However, in order to ensure that the images meet in the display pyramid all image sources have to be placed in the same plane. Thus, if projectors were not used, the image sources, e.g. LCDs preferably had to be custom made in order to ensure that the image sources could fit into a single plane, i.e. ensure that the digital images are adequately projected in the correct location without distortion, and without providing restrictions on the form and size of the display. Custom-made LCDs and similar image devices are very expensive and therefore not desirable from a production perspective. Furthermore, large LCDs projecting digital images have a tendency to curve unintentionally, due to the weight of the display.

In comparison projectors place very few constraints in terms of display location, material, shape, or size, e.g. it has not been necessary to provide custom made image sources. However, with this versatility comes the responsibility of positioning, calibrating and orienting the projector in a manner that is appropriate for the intended use, i.e. ensuring that the projected image is placed very precisely on the physical object, otherwise the mixed reality will not be perceived convincingly by the viewer.

This responsibility becomes more demanding and time-consuming if several projectors are used in order to project the images on the physical object, e.g. if images are displayed on more than one side of the object as in the Dreamoc®XL system. Such applications require a very precise knowledge of the physical objects location relative to the projected images, and since the quality of the digital images combined with the physical object is significant for the users experience of mixed reality, it is extremely important that the components of the display are correctly and accurately mounted. Accordingly the displays have to be assembled at the displays final location, as even minor displacements of the projectors will result in an unrealistic appearance when combined with the physical object. Such manual assembling is not only time consuming but also very expensive, as highly qualified persons are necessary in order to ensure the precise alignment of the physical object and the respective image sources.

Furthermore, even once the assembling process is complete, constant calibration and maintenance is required in order to ensure the stability of the display. This is among others due to the fact that a projector's functionality and longevity is depending on the environment in which it is situated. For example dusty or humid environments can cause unseen damage to the projectors if not regularly maintained and serviced. Dust can e.g. settle both on the lamp and within the projector itself and cause these to overheat and thereby reduce their lifetimes. Thus, in order to reduce the risk of overheating, cooling systems are incorporated in order to keep the projector at an optimal temperature during and after use. This not only takes op a lot of space, but the noise from the systems will negatively influence the users experience, especially if the display is located in an otherwise quite area, such as a museum. Furthermore, dust will reduce the effectiveness of the lamps luminescence causing projected images to appear washed out or blurred, which also negatively will affect the users perception of the mixed reality.

Since the physical object's actual location in relation to the projected images are very important, an assembled conventional display is arranged for adding digital images to only a very few physical object. Thus, if e.g. a different object has to be shown in the display, changes in the configuration have to be performed by specialized personal, again adding to the costs and inflexibility of the conventional systems.

Thus, it is a first aspect of the present invention to provide a display having components of simple and relatively inexpensive character, which can be easily and economically mass-produced and readily assembled by anyone without requiring skill or training. It is a second aspect of the present invention to provide a display, which requires less maintenance than the conventional displays .

It is a third aspect of the present invention to provide a display which can provide a high quality impression of digital content superimposed on an actual physical object. It is a fourth aspect of the present invention to provide a display, which easily can be customized and altered in relation to a new product and simultaneously, be removed and stored.

It is a fifth aspect of the present invention to provide a display, which is easy and simple to operate.

It is a sixth aspect of the present invention to provide a display having image sources with a longer lifetime than the conventional displays.

These and further aspects are achieved according to the present invention by providing a display which is arranged for combining a physical object with digital images, said display comprises at least three semi-transparent mirrors combined into a part of a pentahedron, at least three image sources in the form of monitor devices, each monitor device is placed vertically above a semi-transparent mirror and arranged for projecting digital images via each their subjacent semi- transparent mirror onto a physical object placed on a base of the pentahedron, and wherein at least one of the monitor devices is placed in a first plane parallel to the base plane of the pentahedron and at least two of the monitor devices are placed in a second plane parallel to the base plane of the pentahedron, and wherein the first and the second plane are displaced in relation to each other.

By placing at least one of the monitor devices in a higher vertical location than the other monitor devices, seen in the vertical direction and in relation to the horizontal base plane of the pentahedron, i.e. each monitor device is located in a horizontal plane such that the display surface is facing downwards, it is ensured that the digital images easily can be projected accurately on the physical object inside the pentahedron, a projection which will be possible independently of the dimensions of the monitor devices and of the pentahedron .

This is an important improvement in relation to the conventional technology were the image sources e.g. projectors, had to be placed in the same plane in order to ensure that the images would meet in the centre of the pyramid.

By using a displacement of the monitor devices as in the present invention, the dimensions of the image sources is not no longer an restriction, and it is accordingly possible to use retail monitor devices without having to alter or adjust the dimensions of said devices. This not only provides a less expensive display, but also ensures that the maintenance of the product is almost completely eliminated.

Furthermore, using flat monitor devices such as LCD monitors, LED monitors or similar image display devices, ensures that a slimmer and more compact display structure can be obtained. From an economical perspective it is preferred to use LCD- monitors, as these monitors in addition to being very compact, light and inexpensive, also has high quality characteristics such as low power consumption, high luminance, and a low response time. Furthermore, very little heat is emitted during operation, due to the low power consumption, thus the need for cooling systems are completely eliminated. Furthermore, the lifetime of such screens is very long compared to projectors, and they have a high display surface. Accordingly the need for regular maintenance and/or calibration is therefore eliminated.

In order to reduce cost it is preferred that the monitors used in the present invention are conventional retail monitors. Accordingly it is preferred to use monitors having an aspect ratio of 16:9, which presently is the most common aspect ratio for sold televisions and computer monitors and is also the international standard format for monitors, e.g. HDTV, and analog widescreen television. Thus, such monitors are low- priced and readily accessible reducing the overall cost for the display according to the invention. Since the monitor devices used in the present application, i.e. retail monitor devices, does not requires calibration, or regular maintenance, it is possible to place the monitor devices in their respective mutual locations and planes at a central site, e.g. at the manufacture, such that the final assemble and/or placement of the display can be readily assembled by anyone without requiring skill or training.

The conventional technology, in which the image sources had to be placed in a single plane, could not use retail LCDs. This is due to the fact, that when the LCDs are placed in a single plane the pyramid for displaying the mixed reality have to match the size of the LCDs, and accordingly the assembled display would become unintentionally large in comparison to the "small" physical object. Thus, the conventional technology not only places a number of restrictions on the image sources but also on the mutual relationship of the semi-transparent mirrors, i.e. on the form and size of the display for viewing the mixed reality. Since the monitor devices used in the display according to the invention are placed in different planes parallel to the base plane of the pentahedron, the present invention allows flexibility of lengths and angles between the semi-transparent mirrors of the pentahedron. The lengths of the sides and angles between said mirrors can easily be changed so as to accommodate the physical object, and also to ensure that the display can have any size, without compromising the clarity and/or overlay of the digital images and accordingly the users perception of the mixed reality. Within the context of the present invention the term "pentahedron" refers to a polyhedron with five faces, and wherein one of said faces is a quadrangular base. The remaining four faces can have a substantially, quadrangular, triangular and/or trapezoidal shape depending on the shape of the pentahedron. Said faces are angled in relation to each other to meet in a top section. Said top section can be an apex, an elongated apex or a flat surface. Thus, the term pentahedron also relates to pentahedrons in which e.g. the apex is removed in order to provide a substantially flat top, a top which could be considered a sixth face of the pentahedron. The only requirement is that the pentahedron enables visualization of the digital images from the monitor devices inside the pentahedron in accordance with the pepper's ghost principle, and the top section where the four faces of the pentahedron meets is of less importance. It is however preferred that the pentahedron is not a square pyramid in which the apex is perpendicularly above the center of the square. It is preferred that all semi-transparent mirrors of the pentahedron form the same angle with respect to the base plane of the pentahedron, as this enables an easy visualization of the digital images inside the pentahedron in accordance with the pepper's ghost principle. It is further preferred that said angle is 45 degrees, as this provides a simple embodiment in which the semi-transparent mirrors easily can be combined into a pentahedron used in a simple but effect full display. Other angles can of course be used; the only difference being that the geometry and placement of the digital images inside the pentahedron will be different.

A unique property of the display according to the invention is that the digital image projected by the monitor devices are not visible by looking at the image source itself, but rather by looking at the light that is reflected and diffused off the surface of the semi-transparent mirrors and onto the surface (s) of the physical objected placed inside the pentahedron.

It is preferred that the physical object is placed at the same co-ordinates inside the pentahedron as the co-ordinates were the digital images will appear, as this will provide the most realistic appearance of the mixed reality. However, the placement of the physical object in relation to one or more of the digital images from the monitor devices will depend on the desired visual effect.

The semi-transparent mirrors allow a viewer to look inside the pentahedron. Viewers observing a display according to the invention will see the physical object placed inside the pentahedron and at the same time see the reflection of the digital image displayed in the monitor device that lies above that respective semi-transparent mirror. Because the digital image on the monitor device is combined with a physical object, a viewer will have a strong tendency to perceive the digital image as being part of the physical object placed inside the pentahedron .

The display according to the invention thus takes the two- dimensional images provided by the two-dimensional monitor devices e.g. LCD-screens, and transforms the images into what may be called a quasi-three-dimensional ("quasi-3D") picture. This is an important feature in any setting wherein the "look and feel" of an object is an important aspect, for instance in a demonstration, presentation or promotion setting.

Each screen will project one or more digital images onto the semi-transparent mirror, which will be reflected via the respective semi-transparent mirrors onto the physical object placed inside the pentahedron. The images projected from the at least three monitor devices can be the same or different. If the images are different a viewer will view different images on the different sides of the pentahedron, e.g. can different advertising material relating to the same physical object be shown on the different sides of the pentahedron. This allows the same object to be viewed by more people at the same time and e.g. also for the same actual object to be seen with different over-layers. A viewer walking around the display device will experience a quasi-3D experience of digital images on top of the physical object, thus a physical object, e.g. a shoe can be seen having e.g. a floral print, dots and fur surface depending on what side of the display the shoe is viewed from.

However, if identical pictures are projected onto the physical object via adjacent semi-transparent mirrors the images can be combined in a rather smooth fashion when viewed from a direction along a diagonal of the pentahedrons base plane. This can be an advantage when a person is viewing the display while moving about, because it provides an improve transition between the semi-transparent mirrors.

The digital images projected from the monitor devices may be still or moving images, however in a preferred embodiment the digital images are moving pictures which presents free floating video elements, which is combined with the actual object in order to provide the mixed reality. The digital images can e.g. be used to change the layer of an actual physical object. This is a smart and effective way of e.g. illustrating the effect of different choices for the outer accessories on a car or the changes over time of the surface of the earth or the earth's atmosphere. Alternatively, different advertising movies can be displayed on the different sides of the pentahedron, in order to provide different information of the object. It is preferred that the images projected from the monitors are isolated by their outline, whereby the quasi-3D perception of said images in combination with the physical object will be further enhanced. This technology is well known in the art, but as an example can be mentioned that the images can be isolated using a cut-out technology or be recorded against a single- coloured background. In postproduction, the background can be removed, for instance by computer processing, and be replaced with black. On the monitor device, the background will be black and only the image can be seen, thereby significantly adding to the sense that the image is physical connected with the actual object placed inside the pentahedron, since no interference is displayed .

The term "semi-transparent mirror" within the present document are meant to encompass any kind of reflective and semi- transparent screen capable of reflecting an image via the respective semi-transparent mirrors onto the physical objected placed inside the pentahedron. Thus the term not only covers glass, but also comprises reflective and semi-transparent membranes and foils made of e.g. a polymeric composite. The choice of the extent of transparency of the semi-transparent mirror depends on the intended application of the display according to the invention.

In a first preferred embodiment the pentahedron consist of three semi-transparent mirrors, a base and a black or dark backside. This backside provides an enhanced visibility area and emphasized clarity of the physical object in combination with the images reflected onto said object from all three sides, i.e. from the three semi-transparent mirrors. The dark backside can be any dark colour e.g. a black non-reflective surface. The backside is preferably placed at a right angle on the base, such that the display e.g. can be placed against a wall, and said backside can e.g. comprise a hatch for an easy placement of the physical object on the base of the pentahedron. A light source may be is provided to project light on the physical object placed on the pentahedron base. In a second preferred embodiment the display according to the invention comprises four semi-transparent mirrors, which together with a base forms the pentahedron, preferably in the form of an elongated pyramid. In this embodiment a fourth monitor device is also arranged for projecting images onto the physical object via the fourth transparent mirror. This embodiment ensures that the object can be viewed from all four sides of the pentahedron, but otherwise the advantages and construction are the same as for the embodiment with the three semi-transparent mirrors.

When the pentahedron is symmetrically designed about one or both of the center axis in the base plane, i.e. the longitudinal axis and the transverse center axis, the monitor devices placed opposite each other on each side of a symmetrical center axis, will preferably be related in pairs. If the display has four semi-transparent mirrors arranged in an elongated, symmetrically pyramid, then two opposing monitor devices are located in the first plane and the remaining two opposing monitor devices are located in the second plane. The planes are parallel to the base of the pentahedron, and the planes are not identical, i.e. the two planes are displaced in relation to each other. By placing two of the monitor devices at a higher plane than the other monitor devices, the digital images can easily be placed directly and accurately on the physical object, independently on the dimensions of the monitor devices, while still providing an inexpensive, slim, and simple design. Furthermore, the dimensions of the displays matches the dimensions of the physical object, i.e. the display will not be perceived as large in relation to the physical object, a result which is obtained by the use of different planes for the respective monitor devices. The invention will be explained in greater detail below, describing only exemplary embodiments of the display with reference to the drawing, in which Fig. 1 is a schematic view of a display according to the invention having three semi-transparent mirrors and three monitor devices,

Fig 2, is a schematic view of the display shown in fig. 1 seen from the front, and

Fig. 3 is a schematic view of the display shown in fig. 1 seen from the side. The invention will be described below with the assumption that the display has three semi-transparent mirrors and three monitor devices. However, this assumption is not to be construed as limiting, and the display can just as easily comprise four mirrors and four monitor devices.

Fig. 1 schematically shows a preferred embodiment of a display 1 arranged for combining a physical object with a digital image. Said display 1 comprises three semi-transparent mirrors 2, 3, 4 combined into a section of a pentahedron 5, having an elongated apex 5' . The top of the display comprises three monitor devices 6, 7, 8 each vertically displaced above a respective semi-transparent mirror 2, 3, 4 in planes parallel to the horizontal base plane A of the pentahedron. In this way the display is arranged such that digital images from the monitor devices are projected from a monitor device 6, 7, 8 via the subjacent semi-transparent mirror 2, 3, 4 onto the surface of a physical object (not shown) placed inside the pentahedron 5 in accordance with the pepper's ghost principle, i.e. each monitor device is located in a horizontal plane such that the display surface is facing downwards. Said object is placed on the pentahedrons base 9 inside the pentahedron 5. Thus, images displayed by the monitor device 6, is projected via the semi-transparent mirror 2, etc. A dark backside 10, placed at a right angle on the base 9, completes the pentahedron. This dark backside provides an enhanced visibility area and emphasized clarity of the physical object in combination with the images reflected onto said object from the three sides of the display comprising the semi- transparent mirrors.

Fig. 2 and 3 is schematic views of the display 1 seen from the front and side, respectively. The first monitor device 8 is placed in a first plane I parallel to the base plane A of the pentahedron 5, and the two remaining monitor devices 6 and 7 are placed in a second plane II parallel to the same base plane A. As is evident from figure 2 and 3 the first and the second plane are displaced in relation to each other, such that the first plane I is placed above the second plane, in the vertical direction.

This specific construction not only ensures that retail monitor devices can be used directly in the display according to the invention, but also that semi-transparent mirrors having e.g. a trapezoidal shape, as the mirrors 2 and 3 in the embodiment shown, can be used in the pentahedron. Furthermore, a slimmer and more compact display structure can be obtained than with the conventional constructions, in which e.g. projectors are used. Furthermore, the restrictions on the form and size of the display are also eliminated.

The mutual relationship between the first and second plane depends on the construction of the respective mirrors, as will be explained in further details in relation to fig. 2 and 3. In the embodiment shown the semitransparent mirrors 2, 3 and 4 are all placed in relation to the base 9 with an angle of 45 degrees, and the monitor devices are accordingly also placed at an angle of 45 degrees relative to their subjacent semi- transparent mirror.

As is evident from fig. 2 the two opposing monitors 6 and 7 are placed a distance "a" above each their semi-transparent mirror 2 and 3. In accordance with the Pepper's ghost principals the images from monitors 6 and 7 in the second plane II, i.e. in the lower plane, will project images into the pentahedron in relation to the distance "a" between the respective monitor devices and their subjacent semi-transparent mirror, thus in the present case the images from the monitors 6 and 7, will appear inside the pentahedron between the two mirrors under the mutual center of the two monitors, i.e. in point X, i.e. inside the pentahedron a distance "a" from each of the respective semi-transparent mirrors 2 and 3. In a similar manner, as best seen in fig. 3, the monitor 8 in plane I, will project images into the pentahedron 5 in relation to the distance "b" between the monitor device and semi- transparent mirror. Thus, the mutual relationship between the first plane I and the second plane II can easily be calculated by a person with insight into geometry and optics, such that the actual location of the first plane I depends on the location of the second plane II, or vice versa, and the planes is preferably arranged such that the digital images from all three monitor devices meet in the same point i.e. point X.

When placing the monitor devices in different planes in relation to each other, it is possible to using semi- transparent mirrors that are not triangular, as e.g. the trapezoidal shape of mirrors 2 and 3 without having to customize the monitor devices. Thus, components of simple and relatively inexpensive character can be used in the display such that s displays according to the invention can be economically mass-produced.

It will be understood by a person skilled in the art that the top section of the display, i.e. the section accommodating the monitor devices, is constructed such that the monitor devices 6, 7, 8 are not visible. This also ensures that the images projected by said monitor devices are not visible by looking at the image source itself, but rather by looking at the light that is reflected and diffused off the surface of the semi- transparent mirrors 2,3,4 and onto the physical objected placed inside the pentahedron 5.

In a similar manner it is evident that different arrangements in said top section is provided in order to ensure that the monitor devices are secured in the appropriate planes.

Thus, appropriate housing; shielding (e.g. in order to prevent the images from overlapping on the mirrors); distance pieces, spacers, boxes and/or other appropriate elements can be used in order to ensure correct placement of the monitor devices and in order to prevent the user from viewing the actual construction of the top section of the display, such that the viewer only observes the mixed reality inside the pentahedron. The top section can be constructed in a number of different ways and accordingly only the principals of the present invention are discussed in this application. However, as an example can be mentioned that the appearance of the display according to the invention could resemble the appearance of the known displays for mixed reality provided by Realfiction ApS, Denmark, even though the components in the top section is different.

Since the monitor devices used in the present application, i.e. retail monitor devices, does not requires calibration, or regular maintenance, it is possible to construct the top section in the factory, such that the final assembling of the display can be readily performed by anyone without requiring skill or training.

The display according to the invention has a simple and inexpensive design, and can therefore be used everywhere where it is desirable to present products or objects in combination with free floating video elements, e.g. in retail shops or museums, since the mixed reality can transform an otherwise trivial object into an entertaining and immersive experience for the viewer.

Modifications and combinations of the above principles and designs are foreseen within the scope of the present invention.

Claims

A display (1) arranged for combining a physical object with digital images, said display comprises at least three semi-transparent mirrors (2,3,4) combined into at least a section of a pentahedron (5), at least three image sources in the form of monitor devices (6,7,8), each monitor device is placed vertically above a semi-transparent mirror and arranged for projecting digital images via each their subjacent semi-transparent mirror onto a physical object placed on a base (9) of the pentahedron (5), and wherein at least one of the monitor devices (8) is placed in a first plane (I) parallel to the base plane (A) of the pentahedron (5) and at least two of the monitor devices (6,7) are placed in a second plane (II) parallel to the base plane (9) of the pentahedron (5), and wherein the first plane (I) and the second plane (II) are displaced in relation to each other.

A display (1) according to claim 1, wherein the first plane (I) is located above the second plane (II) in the vertical direction.

A display (1) according to claim 1 or 2, wherein the pentahedron (5) is in the form of an elongated pyramid, or a section of an elongated pyramid.

A display (1) according to claim 1, 2 or 3, wherein the monitor devices (6,7,8) are LCD monitors, LED monitors or similar video display devices.

A display (1) according to any of the preceding claims, wherein the monitor devices (6,7,8) has an aspect ratio of 16:9 A display (1) according to any of the preceding claims, wherein all semi-transparent mirrors (2,3,4) of the pentahedron (5) forms the same angle with respect to the pentahedron base plane, said angle is preferably 45 degrees .

A display (1) according to any of the preceding claims, wherein the digital images projected from the monitor devices (6,7,8) are still or moving images.

A display (1) according to any of the preceding claims, wherein the pentahedron (5) comprises three semi- transparent mirrors (2,3,4), a dark backside (10) and a base ( 9 ) .

A display (1) according to any of the preceding claims, wherein the pentahedron (5) comprises four semi- transparent mirrors (2,3,4) and a base (9), and the display further comprises four monitor devices (6,7,8), and wherein the first two opposing monitor devices (8) are located in the first plane (I) and the remaining two opposition monitor devices (6,7) are located in the second plane (II) .

Use of the display (1) according to any of claim 1 - 9, for presenting products or objects in combination with digital images in the form of free-floating video elements .