WO2008059086A1

WO2008059086A1 - System and method for displaying an enhanced image by applying enhanced-reality techniques

Info

Publication number: WO2008059086A1
Application number: PCT/ES2007/000645
Authority: WO
Inventors: Jose Ignacio Torres Sancho; Maria Teresa LINAZA Saldaña
Original assignee: The Movie Virtual, S.L.
Priority date: 2006-11-16
Filing date: 2007-11-13
Publication date: 2008-05-22
Also published as: ES2300204A1; ES2300204B1

Abstract

Interactive display system (1) based on enhanced-reality technologies for tourism and leisure applications, which enables a user (13) to view a real image (6) that is enhanced with a certain amount of interesting information. The system (1) includes a real camera (2), a processing unit (3), a database (4), a display device (8) and a tracking system (9). The processing unit (3) converts three-dimensional graphic objects (5) stored in the database (4) into two-dimensional virtual representations (5') as a function of the position of the real camera (2) calculated by the tracking system (9). It then aligns the two-dimensional virtual representations (5') and the real image (6), generating the enhanced image (6'). The system (1) allows zooming onto the enhanced image (63), simultaneous and adjusted zooming onto the real image (6) and the two-dimensional virtual representations (5') being performed.

Description

SYSTEM AND METHOD FOR VISUALIZING AN INCREASED IMAGE APPLYING REALITY TECHNIQUES

INCREASED

DESCRIPTION

Technical sector

This invention relates to a method and a system for viewing an enlarged scene, which makes it possible to increase with real content a real scene or image that is within the viewpoint of a user. The invention is mainly oriented to apparatuses for the tourism and leisure sector of the type of binoculars for the observation of a sight, although it is also designed for other environments such as cultural institutions, fairs or nature tourism.

State of the art

Since the annals of modern science, visual observation has preceded knowledge. Visual observation, contemplation and knowledge are closely linked in Western society. It can even be said that modern society is a society based on the visual. The sense of sight has always been the dominant sense and the one that has played a leading role in communication between people.

The concept of binoculars placed on a hill for tourists to observe the surrounding area for a few minutes when introducing a coin is very widespread. These binoculars offer a panoramic view of the buildings and streets of an urban area, their natural and cultural resources. Additionally, in some cases, they allow you to zoom in on certain tourist attractions to see them closer. This view can arouse in tourists the interest of visiting these attractions later, helping them in identifying new points of interest for their subsequent visit. However, it is often difficult to find something in the field of vision of binoculars other than nearby forests or the sky itself. Even when a tourist attraction that may be interesting has been found, that interest is often lost due to the lack of images and information about that attraction. People are used to receiving information in a simple and entertaining way through different channels such as Internet or television, using hyperlinks to obtain multimedia content that responds to their request.

Most tourists learn about the world through different processes, which include features such as representation, imagination and observation. Increasingly, visual technologies (photographs, cinema, video, television, digital images, etc.) are part of the daily experience of many people and also have a direct influence on the way in which people experience new environments. These socially generated "visions" or "interpretations" that capture the world and its heritage in visual terms not only bring new research challenges, but also generate numerous opportunities to critically examine the role and function of tourism as a vehicle in communication of observation, being and knowledge.

Additionally, it can be said that there is a large amount of information in digital format, such as audiovisual content, electronic texts, multimedia applications or geographic information systems. Until now, this information has been used in a timely manner in electronic guides, remaining inaccessible to the visitor. In addition, existing multimedia presentations are physically away from real environments, which means that tourists must leave the tourist attraction to have additional information.

If tourism organizations want to access a wider audience, they must design multimedia content interesting enough to attract tourists. Therefore, new systems that allow these innovative applications and provide added value content are necessary. Brief Description of the Invention

The present invention satisfies the previously mentioned needs by means of a system and a method for displaying an enlarged image with additional multimedia content. For this, the invention detects the position of a display device comprised in the system, increases the user's view with graphic representations of graphic objects recovered from a database and allows the user to interact with the multimedia information provided.

Another aspect of the invention provides a system and method for zooming in on the enlarged image, detecting the position of the display device and fixing the relative position of the graphic objects when zooming on the view.

Brief description of the figures

The details of the invention can be seen in the accompanying figures, not intended to be limiting of the scope of the invention:

- Figure 1 shows a system according to an embodiment of the invention.

Figure 2 shows the functional scheme of the invention. - Figure 3 shows the operation of the system by an example of use of the invention.

- Figure 4 shows the preferred method according to the invention.

- Figure 5 shows an example of the method of the invention for zooming.

Detailed description of the invention

In this document, the technologies of Augmented Reality (RA) are defined as those technologies that increase a real scenario by adding virtual information, while an environment consisting primarily of augmented virtual information with some real objects is known as Augmented Virtuality (VA). In other words, RA technologies can generate an augmented environment by adding some virtual information about a completely real initial environment.

The invention is based on the application of Augmented Reality (RA) technologies to the traditional concept of binoculars in tourist environments, that is, the invention relates to a system that allows users to see a scene (for example, the view from a nearby hill) augmented by superimposing virtual information relative to the scene the user is observing using RA technologies. The increase of the scene increases the user's entertainment experience, since virtual information provides additional content to the scene (for example, the arrows that indicate buildings and show their name). The system also allows the user to interact with virtual information and obtain additional content (for example, access to text files, images or videos related to a specific tourist resource). The system allows you to customize the contents based on different user profiles.

Figure 1 shows a typical system (1) according to an embodiment of the invention. The system (1) basically comprises a real camera (2) that registers a real image (6) or real-time image from the user's point of view (13), and that sends this real image (6) to a unit of processing (3). The processing unit (3) includes a database (4) that stores three-dimensional graphic objects (5) - not represented - that will be superimposed on the real image (6) using RA methods. The RA methods convert the three-dimensional graphic objects (5) into two-dimensional virtual representations (5 '), and then the two-dimensional virtual representations (5') of said three-dimensional graphic objects (5) are superimposed on the real image (6), forming the enlarged image (6 '). Three-dimensional graphic objects (5) may include additional multimedia information (7) -not represented- capable of providing additional and more complex information about three-dimensional graphic objects (5). The system (1) also includes a display device (8) by which the user (13) can observe the enlarged image (6 '), that is, the real image (6) to which the representations have been added two-dimensional virtual (5 ') of the three-dimensional graphic objects (5). The system (1) includes a tracking system (9) to detect the current position of the display device (8) as a fundamental element in the augmentation process. As shown in Figure 1, the display device (8) and the real camera (2) are preferably mounted on the same mechanical axis so that they move in a solidary manner. In this way, the tracking system (9) calculates the position of the display device (8) and therefore, the position of the real camera (2).

Additionally, speakers (10) are included so that the user (13) can listen to the presentations or other content in the form of audio included in the additional multimedia content (7). The system (1) also includes interaction means (11) that fulfill the user interface function for the system (1). Finally, the system (1) may include a payment system (12) based on the insertion of coins or other means of payment.

The real camera (2) can be any type of camera that includes "autofocus" lenses for optical zoom, so that the user (13) can increase or decrease the zoom to observe small or distant objects more clearly. The real camera (2) must be able to be controlled from an external control device capable of accessing and modifying the zoom and other settings or control parameters of the camera, for example, by an RS-232C serial cable connection. There are many cameras of this type available commercially.

The tracking system (9) is preferably based on inertial sensors. However, there is a large number of alternative positioning systems that can be used effectively in other embodiments. Since the system (1) is supposed to be used primarily in two directions (right / left, up / down), the simplest tracking techniques provide sufficient accuracy. However, the invention can use any tracking system that is able to determine the position of the display device (8) robustly and send the coordinates to the processing unit (3).

The display device (8) by which the user (13) perceives the enlarged image (6 ') that includes the real image (6) and the two-dimensional virtual representations (5') of the three-dimensional graphic objects (5) together with the additional multimedia content (7) is preferably a metaphor for conventional binoculars. The display device (8) preferably comprises a display that is basically a non-transparent video display system, which can be non-stereoscopic, stereoscopic and autostereoscopic. The display device (8) can be one of the virtual binoculars or telescopes available in the market with stereoscopic capability. In future embodiments of the invention, semi-transparent and autostereoscopic devices may be used to visualize the enlarged image (6 ').

With regard to the interaction means (11), the preferred embodiment of the invention includes seven buttons for interacting with the system (1) in a simple and ergonomic manner. As Figure 1 shows, the buttons (11) have been distributed between the left side (19) and the right side (20) of the system (1). On the left side (19) of the system (1) there are two buttons that allow you to interact with the enlarged image (6 '). The user (13) can zoom to enlarge the image with one of the buttons and zoom to reduce it with the other. On the right side (20) of the system (1) there are five buttons: a central button (preferably one color) and four buttons around it (preferably a color different from the central button). The middle button is the "enter" button, which is used to click on the two-dimensional virtual representations (5 ') of the three-dimensional graphic objects (5) and also to choose between the menus of additional multimedia content (7). The buttons that surround it serve to move through the menus that allow the selection of additional multimedia content (7).

The system (1) preferably includes two different databases (4): a database for augmentation and a database of self-managed content. The database for the increase includes the three-dimensional graphic objects (5) associated with the points of interest for the user (13), including the name of the main tourist attractions and other graphic objects. The self-managed content database stores additional multimedia content (7), including videos, movie clips, interactive 3D panoramas or even three-dimensional models of existing and non-existent tourist attractions.

The preferred embodiment of the invention also includes an authoring tool to simplify the manipulation of three-dimensional graphic objects (5), their position in the enlarged image (6 ') and the additional multimedia content (7) that they can display. The program can work with XML files to change them or create new ones suitable for the main program. The preferred embodiment of the invention includes up to ten points of interest with a maximum of five sub-objects to choose from within the menu. These three-dimensional graphic objects (5) include the points of tourist interest and their corresponding markers in the enlarged image (6 '), while the sub-objects represent different types of additional multimedia content (7) that are shown when choosing the two-dimensional virtual representations ( 5 ') of the three-dimensional graphic objects (5).

Figure 2 shows a functional scheme of the system (1) of Figure 1. As explained, the real camera (2) captures the user's point of view (13), that is, records a video image in real time called real image (6). The tracking system (9) calculates and sends a position information (14) to the processing unit (3), informing about the current location and orientation of the display device (8). The processing unit (3) then performs a graphics adaptation process (15), which converts the three-dimensional graphic objects (5) stored in the two-dimensional virtual representations (5 ') based on an orientation vector that is obtained from of position information (14). That is, the processing unit (3) adapts a view of the three-dimensional graphic objects (5) to obtain a virtual scene, controlling a "virtual camera" that uses the same orientation vector than the real camera (2), that is, by orienting the virtual camera exactly the same as the real camera (2). Therefore, the real scene (6) and the two-dimensional virtual representations (5 ') of the three-dimensional graphic objects (5) are synchronized according to the real world. This synchronization allows composing the real and virtual scenes of the enlarged image (6 ').

Next, the processing unit (3) performs an augmentation process (16) in which the real scene (6) is augmented with the two-dimensional virtual representations (5 ') of the three-dimensional graphic objects (5) to obtain the image augmented (6 '), which is sent back to the display device (8). When the user (13) looks through the display device (8), he can see the enlarged image (6 '). If the user (13) rotates the system (1) or makes any movement that changes the position of the display device (8), the tracking system (9) reports the change to the processing unit (3). The graphics adaptation process (15) then updates the two-dimensional virtual representations (5 ') of the three-dimensional graphic objects (5), so that they coincide with the new real image (6). Therefore, when the user (13) turns the system (1) or changes its position, the enlarged image (6 ') changes in its entirety, that is, the real image (6) and the two-dimensional virtual representations (5') They adapt to that change.

Figure 3 shows the operation of the invention using an example of using the system (1). The graphic at the top shows an example of an enlarged image (6 ') displayed by the user (13). This enlarged image (6 ') is composed of the real image (6) of a town (17) and some mountains (18), in which one of the buildings and one of the mountains are indicated by the corresponding two-dimensional virtual representations ( 5'). When the user (13) discovers an interesting object on which he wishes to gather more information - for example, the high-rise building in the center of the screen marked with the text "objl" - acts with the means of interaction (11) until selecting the two-dimensional virtual representation (5 ') of said interesting object. Next, the system (1) displays the additional multimedia content (7) related to said two-dimensional virtual representation (5 '). For example, as shown In Figure 3, the system (1) can show a screen in which some interesting text and a video of a person explaining certain characteristics of the building are displayed, and / or offer new navigation options. The system (1) can also offer personalized information, so that different contents can be displayed to different user profiles, including aspects such as multilingualism. For example, an English-speaking tourist who has a cultural profile can be a type of user profile. This user will receive more complete additional information in English about the history of the selected building than the information received by other profiles.

Figure 4 shows the method according to the invention whereby three-dimensional graphic objects (5) are placed in the virtual world using a spherical environment. The registration information (24) that determines the placement of the three-dimensional graphic objects (5) in the enlarged image (6 ') is defined using the authoring tool. The processing unit (3) receives the registration information (24) of the different three-dimensional graphic objects (5) and the position information (14) of the display device (8), in order to carry out the process of adapting the graphics (fifteen). A virtual world (21) is constructed, that is, a three-dimensional model in which the three-dimensional graphic objects (5) are placed in their previously defined spatial position. In this virtual world (21), a virtual camera (22) is placed with respect to the three-dimensional graphic objects (5) based on the position information (14) of the real camera (2). In other words, three-dimensional graphic objects (5) are placed in virtual points that simulate the distance of real objects from the user's point of view (13).

The process of adapting graphics (15) of three-dimensional virtual objects (5) into two-dimensional virtual representations (5 ') is based on the information about the angle that three-dimensional graphic objects (5) differ from a Zero-reference value View- Vector, which represents the center point of a coordinate system. Next, the graphics adaptation process (15) converts the three-dimensional graphic objects (5) into their respective two-dimensional virtual representations (5 '). The result is the placement and adaptation of two-dimensional virtual representations (5 ') so that they provide a feeling of depth to the user (13).

Next, the magnification process (16) combines the two-dimensional virtual representations (5 ') with the real image (6) recorded by the real camera (2) to obtain the enlarged image (6'). By looking at this enlarged image (6 '), the user (13) can enjoy the landscape and the information provided by the two-dimensional virtual representations

(5'). This information is useful (since it contains the names of tourist attractions and any other interesting information) and clear (since it is presented in perspective, simulating objects in the environment).

The process of transforming the spatial coordinates defined by the three-dimensional graphic objects (5) into a real environment in two-dimensional coordinates that define the pixels that are displayed in a display device (8) is a key element in the present invention. As explained previously, this process is carried out by applying an innovative approach, building a "virtual world" and capturing an image of said "virtual world" in the same way that the real camera (2) records the real image (6). Next, the augmented image (6 ') superimposes the real world and the virtual world to achieve the effect of magnification, bringing both worlds into a new "augmented world."

Additionally, and as shown in Figure 4, the invention allows zooming in on the enlarged image (6 '). When zooming, the two-dimensional virtual representations (5 ') are not only rescaled, but also recovered, so that they continue to be placed on the increasing objects. This means that, by zooming in, the invention guarantees that the views of the real camera (2) and the virtual camera (22) are adjusted at all times.

The user (13) activates the zoom process by interacting with the two buttons on the left side (19) of the system (1). The buttons are connected to the processing unit (3), so that when the user (13) acts on them, the processing unit (3) modifies the zoom of the virtual camera (22) and sends a command to the camera real (2) to change its zoom control parameters synchronously.

The adjustment of the control parameters of the real camera (2) and the virtual camera (22) must be done dynamically in real time, while the system (1) is operating, in order to correctly align the real image (6) and two-dimensional virtual representations (5 '). Due to the mechanical zoom system of the real camera (2), there is a delay between the adjustment of the virtual camera zoom value (22) and the mechanical update of the real camera zoom (2). This delay in the change between two zoom positions is perceived by the user (13). Another mechanical limitation of the real camera system (2) is that the zoom speed of said real camera (2) is not linear, due to the acceleration and deceleration processes at the beginning and the end.

Theoretically, it would be necessary to have a connection and a continuous exchange of data between the virtual camera (22) and the real camera (2) so that there was a correspondence between the parameters of both cameras at any time. However, in practice, it is not possible to achieve continuous data exchange due to the mechanical limitations of the real camera (2). In addition, there is a time delay from when the processing unit (3) sends a command to know the status of the real camera (2) and until the real camera (2) returns its status to the processing unit (3) . This delay is increased due to the low refresh rate of the values of the zoom parameters of the real camera (2).

The invention proposes a method for updating and adjusting the zoom values of the real (2) and virtual (22) cameras, an example of which is shown in Figure 5, so that both values are coincident at all times despite the mechanical limitations and delays of the real camera (2). In Figure 5, the initial viewing angle of both real (2) and virtual (22) cameras is set at a value of 48 °. According to the preferred embodiment of the invention, when the user (13) interacts with one of the buttons on the left side (19) of the system (1) to zoom in, increasing the image, the virtual camera (22) and the real camera (2) begin to zoom in As previously mentioned, there are some delays in the real camera (2) to follow the zoom process, that is, the real camera (2) zooms slower than the virtual camera (22). To synchronize the zoom value of the real camera (2) with the instantaneous zoom value of the virtual camera (22), the processing unit (3) receives an adjustment command (25) from the virtual camera (22) indicating its instant zoom value. The processing unit (3) then sets the zoom of the real camera (2) with the zoom value of the virtual camera (22). However, if the user (13) continues to zoom, the zoom value of the virtual camera (22) continues to change. Therefore, this process is repeated until the user (13) stops the zoom (until a time t according to Figure 5 elapses). In other words, the adjustment between the zooms of the real camera (2) and the virtual camera (22) is performed in a discrete iterative manner, so that the relatively slower real camera (2) follows the instantaneous zoom of the virtual camera (22).

It should be mentioned that the zoom of the real camera (2) can usually only adopt a set of discrete values due to its mechanical configuration. As shown in Figure 5, when the processing unit (3) receives information of the specific zoom value of the virtual camera (22), for example, 45 °, the processing unit (3) tries to fix the zoom of the real camera (2) at the value of 45 °. However, the zoom of the real camera (2) reaches this specific value with an "e" error (positive or negative). Due to this error, at the end of the process, the processing unit (3) must read the final zoom value of the real camera (2), which will be slightly different from the final zoom value of the virtual camera (22) due to the error in". Next, the processing unit (3) sends a tuning command (26) to the virtual camera (22), so that the final value of the virtual camera (22) is updated with the final value of the camera zoom real (2).

The zoom control parameter of some real cameras (2) used in practice is encoded in hexadecimal format. Therefore, when the processing unit (3) receives an adjustment command (25) from the virtual camera (22) indicating the current value of the virtual camera zoom (22), the processing unit (3) transforms this value in a hexadecimal code before sending it to the real camera (2) and vice versa. The specifications of the actual cameras (2) existing in the market usually include a table that relates a set of view angles to the corresponding hexadecimal values of the control parameters. For example, in the preferred embodiment, the hexadecimal values of the zoom control parameters range from 0 to 4000, representing viewing angles between 4.8 ° (maximum zoom) and 48 ° (without any zoom). This means that the view angle values are known for these specific hexadecimal values. However, most of the hexadecimal values and their corresponding angles are not included in the table. In order to calculate any hexadecimal code for any angle of view and vice versa, the invention proposes the use of interpolation algorithms based on the specifications table of the real camera (2). For example, for the real camera (2) of the preferred embodiment of the invention, the following interpolation equations are proposed:

y = -0.2274x ³ + 22.593x ² - 949.94x + 18690, where y is the value of the zoom control parameter in hexadecimal and x is the current angle of view of the real camera (2). When you receive an adjustment command (25) that includes the viewing angle of the virtual camera (22), the processing unit (3) uses this equation to calculate the corresponding hexadecimal code that is sent to the real camera (2).

x ~ -2.87 * 10 ¹² y ³ + 1.99 * 10 ⁷ y ² * -0.00525077y + 48, where x is the angle of view of the real camera (2) and y is the hexadecimal value of the zoom control parameter. After reading the value of the zoom control parameter of the real camera (2) in hexadecimal format, the processing unit (3) uses this equation to calculate the corresponding view angle that will be sent to the virtual camera (22) as tuning command (26).

As explained previously, the invention applies to the cultural tourism sector, which is one of the key future areas for the creation and strengthening of cultural industries. The Augmented Reality techniques proposed to access and understand tourist and cultural content are highly visual and interactive forms of presentation. Therefore you are Technological approaches are an added value, which allows visitors to experience the history associated with a real environment in a personalized way.

As a first example of application of the invention, the reader can imagine the view of a city from a nearby hill. The invention is placed at the top of the hill to allow a "visit" to some of the tourist attractions and elements of the environment, and to receive information about each of these attractions. For example, you can choose a cathedral or an island in the middle of the bay to receive additional multimedia information.

However, the embodiments of the invention are not limited to tourist environments, but can be extended to a wide variety of recreational and cultural experiences. Similar scenarios can be described in situations such as cultural institutions, exhibition halls, nature tourism, fairs or any other scenario in which objects and resources appear that can be augmented by Computer Graphics or additional multimedia content.

As a second example, the application of the invention for cultural and artistic art pieces, monuments and unique pieces can be mentioned. The use of current restoration techniques such as infrared rays is becoming widespread among cultural institutions. Thus, information hidden behind the first layer of the pictures has been found. The visitor of a museum can use the invention in front of a painting to obtain additional invisible information and interact with the different parts of the canvas. Museums and cultural institutions can define a price for the content shown using the invention.

A third example may be the increase of objects shown at trade shows. The machine tool is usually shown at large fairs. One of the main problems of the manufacturers is that they cannot show all the functionalities of the machines at the fair. The invention can provide more information about the components and the actual operation of the machines. In a final example of the invention, the reader can consider the case of hikers who want to know more about landscapes, flora and fauna while walking through the countryside. The invention can provide additional information at the top of the mountains, such as the name of the different peaks of the environment, the way of access or the diversity of fauna and flora.

Although this invention has been presented and described in relation to its preferred embodiments, it is evident that some additional changes and modifications will be made to those previously mentioned on the basic features of the invention. Additionally, there is a great diversity of types of software and hardware that can be used when the invention is realized, and the invention is not limited to the previously described examples. Therefore, applicants protect all variations and modifications within the scope of the present invention. The invention is defined by the following claims, including all equivalents:

Claims

1. System (1) for displaying an enlarged image (6 ^! ) Comprising a real image (6) or image in the field of view of a user (13) augmented with certain interesting contents, characterized in that it comprises:

a real camera (2) to record the real image (6) from the user's point of view (13), - a database (4) with a set of three-dimensional graphic objects (5) that provide graphical information capable of increasing the real image (6), a tracking system (9) that calculates and records the position of the display device (8), - a processing unit (3), which converts the three-dimensional graphic objects (5) into two-dimensional virtual representations

(5 ') depending on the position of the display device (8) calculated by the tracking system (9), and which builds the enlarged image (6') by composing the two-dimensional virtual representations (5 ') of the graphic objects (5) and the real image (6), a display device (8) for displaying the enlarged image (6 '), interaction means (11) that provide a user interface.

2. System (1) according to claim 1, characterized in that the real camera (2) comprises zoom lenses, the interaction means (11) provide a user interface to vary the zoom of the enlarged image (6 ' ), and because when the user (13) acts on the interaction means (11), the processing unit (3) adjusts the zoom of the real camera (2) and appropriately converts the three-dimensional graphic objects (5) into virtual representations two-dimensional (5 ').

3. System (1) according to claim 1, characterized in that the system (1) includes at least one speaker (10) and because the database (4) includes a database for the increase of three-dimensional graphic objects (5) and a database of self-administered contents for additional multimedia information (7) that can be displayed on the display device (8) and heard thanks to the speaker (10).

4. System (1) according to claim 1, characterized in that the tracking system (9) comprises an inertial sensor.

5. System (1) according to claim 1, characterized in that the display device (8) is a device that allows the display of images near the user's eyes (13) in a manner similar to a conventional prismatic.

• 6. System (1), according to claim 1, characterized in that it comprises a payment system (12).

7. System (1), according to claim 1, characterized in that the system (1) is an apparatus oriented towards the tourism and leisure sectors.

8. Method for generating an enlarged image (6 ') comprising a real image (6) or image from the point of view of a user (13) augmented with some interesting contents, characterized in that it comprises the following steps :

provide a processing unit (3) with a database

(4) that includes a series of three-dimensional graphic objects (5) that provide interesting content capable of increasing the real image (6), - recording the real image (6) from the user's point of view (13) using a real camera (2), follow the position of a display device (8) by means of a tracking system (9), transform the three-dimensional graphic objects (5) into two-dimensional virtual representations (5 ') depending on the position of the display device (8) calculated by the tracking system (9), and generate the enlarged image (6 ') by aligning the two-dimensional virtual representations (5') and the real image (6), - visualizing the enlarged image ( 6 ') by means of a display device (8), adapt the enlarged image (6') depending on the changes in the position of the display device (8) or on the basis of user commands through the interaction means (11), allowing the user (13) to interact with areas of interest of the real image (6).

Method according to claim 8, characterized in that it includes the additional step of displaying, in the display device (8), additional multimedia information (7) stored in the database (4).

10. Method according to claim 8, characterized in that it further comprises the following steps:

- the user (13) interacts with the interaction means (11) to change the zoom degree of the enlarged image (6 '), the processing unit (3) changes the zoom value of the real camera (2) and properly change the two-dimensional virtual representations (5 ') of the three-dimensional graphic objects (5), the processing unit (3) recomposes the enlarged image (6') depending on the new zoom position.

Method according to claim 10, characterized in that when the user (13) acts on the interaction means (11) for a time t, the process of varying the zoom of the real camera (2) and readjusting the objects Three-dimensional graphics (5) in their corresponding two-dimensional virtual representations (5 ') is performed a certain number of times, at discrete intervals, during time t.

Method according to claim 10, characterized in that it comprises the step of reading the final zoom value of the real camera (2) and setting the virtual camera zoom value (22) to said final zoom value of the real camera (2).

13. Method according to claim 10, characterized in that the processing unit (3) reads the zoom value of the real camera (2) in the form of a hexadecimal value and, and converts the three-dimensional graphic objects (5) into their corresponding two-dimensional virtual representations (5 ') based on an angle of view x given by x = - 2.87 * 10 ¹² and ³ + 1.99 * 10 ⁷ and ² * -0.00525077y + 48.

14. Method according to claim 10, characterized in that the processing unit (3) converts the three-dimensional graphic objects (5) into their corresponding two-dimensional virtual representations (5 ') based on an angle of view x, and then, change the real camera (2) based on a zoom value encoded as a hexadecimal value and given by y = -0.2274x ³ + 22.593x ² - 949.94x + 18690.