KR100755187B1 - Digital apparatus capable of displaying imaginary object on real image and method thereof - Google Patents

Abstract

A digital device capable of displaying a virtual medium on an actual image is disclosed. The digital device according to the present invention can simultaneously display a virtual subject mapped within a visual range of a connected camera and a virtual medium mapped on an actual space within the corresponding range as a single image. To this end, the digital device generates its own position information and attitude information and provides it to a predetermined server. The server, based on the position information and attitude information received from the digital device, And transmits information about the virtual medium to the digital device.

Virtual image, real image, image synthesis, position information, attitude information

Description

TECHNICAL FIELD [0001] The present invention relates to a digital device capable of displaying a virtual medium on a real image,

1 is a configuration diagram of a system including a digital device according to an embodiment of the present invention;

2 is a block diagram illustrating an operation of a digital device according to an exemplary embodiment of the present invention.

FIG. 3 is a view showing an image in which a virtual medium is displayed together with FIG. 2,

4 is a block diagram of a digital device according to an embodiment of the present invention.

FIG. 5 is a diagram illustrating an operation of a digital device according to an exemplary embodiment of the present invention,

6A to 6E are diagrams provided for explanation of a process of generating virtual image data, and FIGS.

7 is a flowchart illustrating an operation of a digital device according to an exemplary embodiment of the present invention.

A virtual medium is mapped onto an actual space on the earth, and a virtual medium mapped to a corresponding range together with an actual object existing within a view range of the camera is displayed as one image at the same time, To a digital device capable of being displayed.

Techniques for realizing 3D virtual images have been applied in various ways, and they have been widely used to enhance realism and realism in the game field. Accordingly, a variety of three-dimensional virtual imaging technologies ranging from personal computers and networked computers to portable devices have been realized.

It is an object of the present invention to provide a method and apparatus for mapping a virtual medium on an actual space on the earth and simultaneously displaying a virtual medium mapped in the corresponding range together with an actual object existing in the field of view of the camera, And a digital device capable of displaying a virtual medium.

It is another object of the present invention to provide a digital device capable of displaying a virtual medium on an actual image while changing a display of a virtual medium in response to a change in camera viewing angle in displaying a virtual medium mapped in an actual space .

According to another aspect of the present invention, there is provided a method of displaying a virtual medium on a real image, the method comprising: And generating the attitude information, which is information on a direction in which the camera is facing in the coordinate, based on the position information and the attitude information, the at least one virtual object preset to exist within the visual range on the absolute coordinates of the camera Generating virtual image data; and displaying an image corresponding to the final image data obtained by synthesizing the virtual image data with the actual image data.

Here, it is preferable that the field-of-view on the absolute coordinates of the camera is mapped based on the position information and the attitude information of the camera in accordance with zooming in or zooming out of the camera.

According to the embodiment of the present invention, a method of displaying a virtual medium on an actual image may further include receiving absolute coordinates of the changed virtual object from a predetermined server when the absolute coordinates of the virtual object are changed.

The generating of the virtual image data may generate the virtual image data such that the virtual object is oriented in a predetermined direction based on predetermined attitude information assigned to the virtual object. The method may further include receiving posture information of the changed virtual object from a predetermined server when the posture information of the virtual object is changed.

The absolute coordinates of the camera are preferably coordinates generated by a predetermined GPS (Global Positioning System) receiver.

It is preferable that the attitude information is an angle formed by three axes including axes in at least one of a gravity direction and a magnetic north direction, and the camera is rotated with the axes orthogonal to each other.

According to another aspect of the present invention, there is provided a digital device capable of displaying a virtual medium on an actual image, comprising: a camera for generating actual image data of a subject; position information that is an absolute coordinate of the camera; A display unit which receives a predetermined video signal and displays it so as to be visually recognizable; a display unit which receives predetermined video data and converts the video signal into the video signal for display on the display unit, A calculation unit for extracting at least one virtual object preset to exist within the visual range on the absolute coordinate of the camera based on the positional information and the attitude information; A virtual object generation unit for generating virtual image data based on the virtual image data, To generate the final image data obtained by synthesizing the image data includes the image combination unit to output to the image processor.

The digital device of the present invention may further include a network processing unit capable of connecting to a predetermined server via a network, wherein the calculating unit calculates the absolute value of the changed virtual object to be transmitted as the absolute coordinates of the virtual object are changed Coordinates can be received through the network processing unit.

Preferably, the virtual object generation unit generates the virtual image data such that the virtual object is oriented in a predetermined direction based on predetermined attitude information assigned to the virtual object, The attitude information of the changed virtual object to be transmitted may be received through the network processing unit.

The sensor unit may include a GPS (Global Positioning System) receiver for generating absolute coordinates of the camera.

The sensor unit includes at least one rotation sensor together with one of a predetermined gravity sensor and a magnetic field sensor, and includes three axes including axes in at least one of a gravity direction and a magnetic north direction, By calculating the angle at which the camera rotates, the posture information can be generated.

Wherein the sensor unit includes at least one rotation sensor together with one of a predetermined gravity sensor and a magnetic field sensor and outputs the sensing value to the calculation unit, and the calculation unit calculates, based on the sensing value, at least one of gravity direction and magnetic north direction The attitude information can be generated by calculating the angle at which the camera rotates with respect to each of the three axes including axes in one direction and the axes orthogonal to each other.

In addition, the camera may be connected to the main body by a predetermined wired or wireless interface.

Hereinafter, the present invention will be described in detail with reference to the drawings.

FIG. 1 is a configuration diagram of a system including a digital device according to an embodiment of the present invention, and FIG. 2 is a diagram illustrating an operation of a digital device according to an exemplary embodiment of the present invention.

1 and 2, a digital device 101 of the present invention is connected to a server 105 through a predetermined network 103. [ The digital device 101 of the present invention includes a predetermined camera and generates an actual image of the subject r1 input through the camera and receives the 3D image from the server 105 connected via the network 103 Information can be received and a three-dimensional virtual image can be generated. The digital device 101 can display an image that can be recognized as if the virtual objects i1 and i2 exist in the actual space by synthesizing and displaying the generated real image and the 3D virtual image.

The 'virtual object' of the present invention is an image that can be expressed as being actually present through a screen, and includes a two-dimensional image or a three-dimensional image. A virtual object exists in a virtual space corresponding to a specific location on the real space that can be displayed by longitude and latitude. Therefore, the position of the virtual object can be displayed in latitude and longitude. For example, the virtual object i1 is located at the absolute coordinates (a2, b2), and the virtual object i2 is located at the absolute coordinates (a3, b3).

Accordingly, when the posture or the actual position (a position that can be displayed by the longitude and latitude, hereinafter referred to as an 'absolute position') of the digital device 101 is changed by movement, rotation, or the like, The relative position between the two. Accordingly, the digital device 101 displays the changed image.

Here, the 'posture' is a direction vector of a virtual object or a specific face of the camera of the digital device 101 or the digital device 101, and a magnetic north direction is used as a reference. The 'attitude information' described below is information on the posture of the virtual object or the digital device 101. In FIG. 2, the attitude information of the digital device 101 is information on the vector V. FIG.

For example, assuming that the digital device 101 rotates counterclockwise at the current absolute position a1, b1, the posture corresponding to the vector V is changed. With this rotation, the virtual object i2 gradually disappears from the image displayed on the digital device 101. [

The server 105 receives predetermined position information, attitude information and camera information from the digital device 101 and transmits predetermined object information to the digital device 101 in accordance with the received information.

Here, the camera information is information on the camera's field of view due to zooming in or zooming out of the camera. The field of view of the camera is obtained through a predetermined viewing angle and viewing distance according to zoom in or zoom out.

The object information includes positional information on the virtual object, attitude information, and a virtual object identifier (ID). The virtual object identifier corresponds to a two-dimensional or three-dimensional polygon, which is an image resource for a virtual object.

If the object information includes an identifier for the virtual object, the digital device 101 may already store a two-dimensional or three-dimensional polygon for the virtual object. In this case, the server 105 may add or update the two-dimensional or three-dimensional polygon to be stored in the digital device 101 periodically or aperiodically.

In addition, the server 105 may transmit the changed position information and attitude information of the virtual object to the digital device 101 periodically or non-periodically, on the assumption that the virtual object moves or moves.

In addition, according to the embodiment, the object information provided by the server 105 may include the polygon of the virtual object in place of the virtual object identifier, together with the position information and attitude information of the virtual object.

The location information is information on the absolute coordinates of the digital device 101 or the virtual object, and includes information on longitude, latitude and altitude on the earth. If there is the positional information and the attitude information, it is possible to know from which position on the earth the digital device 101 or the virtual object is pointing to.

Here, if the positional information and the attitude information for the digital device 101 are for the camera of the digital device 101, the camera may be incorporated into the digital device 101 or may be integrated with the digital device 101, And may exist separately.

In providing the object information on the virtual object to the digital device 101, the server 105 may provide object information on all virtual objects within a predetermined radius from the position of the digital device 101, Only the object information about the virtual objects existing within the field of view on the absolute coordinates of the current camera can be provided using the received camera information and attitude information.

The network 103 corresponds to a wired or wireless network, and a wireless network is preferred.

Fig. 3 is a view showing an image in which a virtual medium is displayed together in correspondence with Fig. 2, in which a digital device 101 having an attitude of a vector V displays virtual objects i1 and i2 together with an actual object r1 .

Hereinafter, a digital device 101 according to an embodiment of the present invention will be described with reference to FIGS. 4 and 5. FIG.

FIG. 4 is a block diagram of a digital device according to an embodiment of the present invention, and FIG. 5 is a diagram illustrating an operation of a digital device according to an embodiment of the present invention. The digital device 101 of FIG. 4 corresponds to and operates in the same manner as the digital device 101 of FIG.

The digital device 101 according to an embodiment of the present invention may have various forms. For example, the digital device 101 may be formed not only in the form of a general digital camera or a portable game machine, but also in a form that can be mounted on a human body.

The digital device 101 according to an embodiment of the present invention includes a camera 401, a sensor unit 403, a network processing unit 405, a memory 407, a storage medium 409, an image processing unit 411, 413, and a control unit 430, and receives predetermined object information from the server 105 to synthesize a virtual image and an actual image.

The camera 401 generates predetermined image data by using light that is reflected from a subject and is incident on a lens lenz (not shown), and outputs the image data to the controller 430. The image data generated by the camera 401 includes at least one of still image or moving image data. Hereinafter, image data generated by the camera 401 for an actual image is referred to as 'actual image data'. Unlike the actual image data, the image data of the virtual object corresponding to the object information is referred to as 'virtual image data'.

In addition, the camera 401 generates a zoomed-in image or a zoomed-out image by moving a lens (not shown) under the control of the controller 430, and transmits the zoomed-in image or the zoomed-out image to the controller 430 do.

4, the camera 401 is shown as being included in the digital device 101, but it is not necessarily limited to this. In some embodiments, the camera 401 may be located outside the sensor unit 403 and may be a wired / wireless interface (not shown) And may be connected to the digital device 101 via a network.

The sensor unit 403 includes a position unit 417 and a character detail 415 and outputs predetermined position information and rotation information to the control unit 430. [ The rotation information is the rotation angle of the digital device in which the ruler details 415 are sensed to generate attitude information.

Here, the position information and attitude information will be described in more detail with reference to Fig.

Referring to Fig. 5, there are X and Z axes which are located on the same horizontal plane and perpendicular to each other. When the Z axis is in the magnetic north direction, the plane formed by the Z axis and the X axis corresponds to the absolute coordinates, which is a global position on which the digital device 101 is located.

The camera 401 of the digital device 101 has the posture of the vector V at the position of the longitude a1 and the latitude b1. Therefore, the positional information of the digital device 101 becomes (a1, b1) on the absolute coordinate position where the digital device 101 is located.

The attitude information includes information on a vector V, which is based on a Z axis which is a magnetic north direction, and includes a pitch value, a roll value, and a yaw value. The pitch value is a value obtained by reading the angle of rotation of the digital device 101 with respect to the X axis on the basis of the XZ plane and the yaw value is a value obtained by reading the angle of rotation of the digital device 101 with reference to the Z axis with reference to the XZ plane . The roll value is a value obtained by reading the angle of rotation of the digital device 101 with respect to the Y-axis with reference to the XY plane. Hereinafter, the attitude information of the digital device 101 is referred to as (P _d , R _d , Y _d ). Where P _d is the pitch value, R _d is the roll value, and Y _d is the yaw value.

Referring to FIG. 5, the attitude information has a predetermined correlation with the absolute coordinates. For example, a predetermined reference relating to an absolute coordinate, such as magnetic north direction, gravity direction, longitudinal direction, or latitudinal direction. For example, the roll value should be determined based on the magnetic north, and the pitch value should be determined based on the gravity direction.

Hereinafter, each component will be described with reference to FIG.

The position unit 417 obtains positional information, which is the coordinate of the longitude and latitude in which the digital device 101 exists on the earth, and outputs the positional information to the control unit 430. The position unit 417 receives the predetermined signal corresponding to the position information from a GPS (Global Positioning System) satellite or a transmitter on the ground, and generates position information by processing the position signal.

Preferably, the position unit 417 corresponds to a GPS receiver that receives predetermined data from a GPS satellite and outputs coordinate values on the WGS-84 coordinate system. In this case, the position information corresponds to the WGS-84 coordinate system Lt; / RTI >

The controller 415 obtains rotation information of the digital device 101 based on a predetermined sensor and outputs the rotation information to the controller 430. [

In accordance with an embodiment, the ruler details 415 may use rotation sensors to determine rotation information using either a magneto sensor or a gravity sensor. In this case, the magnetic field sensor or the gravity sensor is used to compensate the angle obtained by the rotation sensor in correlation with the absolute coordinates. Here, the rotation information includes an output value of one of the magnetic sensor and the gravity sensor together with the output of the rotation sensor.

 In addition, rotation information can be obtained by using a plurality of magnetic field sensors (magneto sensors) and a plurality of gravity sensors.

The rotation sensor preferably includes three. The output of each of the three rotation sensors corresponds to a pitch value, a roll value and a yaw value. Therefore, each rotation sensor is installed in the digital device 101 to output the rotational displacement (angle) of the digital device 101 with respect to three axes orthogonal to each other, and a gyroscope is preferable.

The gyroscope can be an optical gyroscope, a mechanical gyroscope, a piezoelectric vibration gyroscope, or a micro-micro gyroscope using micro electro mechanical system (MEMS) technology.

The magnetic field sensor senses the direction of the magnetic north (N), thereby outputting the angle information between the predetermined installation direction and the magnetic north direction. The gravity sensor senses the gravity direction and outputs angle information between the predetermined installation direction and the gravity direction. Since the output of the rotation sensor is an angle rotated with respect to three axes orthogonal to each other (forming an individual coordinate system) in the current state of the digital device 101, the rotation angle is determined based on the magnetic north direction or gravity direction It is necessary to match the three axes of the rotation sensor to the magnetic north direction or the gravity direction as shown in FIG. Therefore, an output value of a magnetic field sensor or a gravity sensor is required. In other words, it is necessary to compensate for matching the individual coordinate system of the digital device 101 with the absolute coordinate system.

The character detail 415 outputs predetermined rotation information obtained by converting an analog signal output from one of the magnetic sensor and the gravity sensor into a digital signal, together with the output of the rotation sensor, to the controller 430. The character detail 101 can remove noise that may be included in the rotation information and output it. Accordingly, the control unit 430 compensates the correlation with the absolute coordinates of the output of the rotation sensor based on the output of one of the magnetic field sensor and the gravity sensor.

Also, according to the embodiment, the character details 415 may obtain the pitch value, the roll value, and the yaw value based on the rotation information, and output the obtained pitch value, roll value, and yaw value to the controller 430. In other words, the controller 430 can output the posture information in which the correlation between the character detail 415 and the absolute coordinates is compensated.

According to another embodiment, the character detail 415 can directly generate the posture information in which the correlation with the absolute coordinates is compensated, instead of the rotation sensor using a plurality of magnetic sensors and gravity sensors.

The network processing unit 405 can connect to the server 105 through the network 103 and transmits the data output by the control unit 430 to the server 105 by a wired or wireless communication method and transmits the data output from the server 105 And transmits the transmitted data to the control unit 430.

The memory 407 includes various active and inactive memories, and various programs and data of the digital device 101 can be stored.

The storage medium 409 corresponds to a flash memory, a hard disk, and the like, and stores various electronic documents such as various electronic documents processed by the digital device 101, and multimedia contents such as map information.

The polygon data corresponding to the virtual object identifier is stored in the memory 407 or the storage medium 409. [

The image processing unit 411 receives the image data output from the control unit 430, converts the image data into a video signal for the display unit 413, and outputs the video signal to the display unit 413.

The display unit 413 displays a video signal transmitted from the video processing unit 411 so that the user can visually recognize the video signal. The display unit 413 may be an LCD, an organic light emitting diode, a plasma display panel (PDP), or a cathode ray tube (CRT).

The control unit 430 controls the overall operation of the digital device 101 of the present invention.

The control unit 430 includes a camera control unit 431, a calculation unit 433, a virtual object generation unit 435 and an image synthesis unit 437. The control unit 430 receives the actual image input from the camera 401, Synthesizes the received virtual objects, and outputs the combined virtual objects to the display unit 413.

The camera control unit 431 controls various operations of the camera 401 under the control of the user through a user interface (not shown).

The operation of the camera 401 includes zoom in and zoom out.

The camera control unit 431 provides predetermined camera information to the calculation unit 433 at the request of the calculation unit 433. [ The camera information is information on the viewing angle of the camera 401 due to zooming in or zooming out of the camera 401 or the like.

The calculation unit 433 receives position information and rotation information from the sensor unit 403 and receives camera information from the camera control unit 431. [

The calculation unit 433 calculates the positional information of the digital device 101 by finally converting the coordinates into the coordinates on the coordinate system for the predetermined region based on the positional information received from the sensor unit 403. [

For example, when the calculation unit 433 receives the WGS-84 coordinates from the position unit 417, the calculation unit 433 calculates the final position information by converting the received WGS-84 coordinates into coordinates on the coordinate system applied to the corresponding region. For example, in Korea, because we use the longitude coordinate system, we convert WGS-84 coordinates to longitude coordinates. Also, in the case of using the WGS-84 coordinates as it is, the output of the position unit 417 can be directly used as the position information without any conversion process.

The calculation unit 433 calculates the posture information of the digital device 101 using the rotation information. The calculation unit 433 calculates the attitude information that compensates the correlation with the absolute coordinates by a method of converting the angle of the rotation sensor according to a predetermined conversion formula based on the output of the magnetic field sensor or the gravity sensor.

The calculation unit 433 transmits the camera information, the position information, and the attitude information to the server 105 through the network processing unit 405.

The calculation unit 433 receives the object information of at least one virtual object transmitted from the server 105 and transmits the object information to the virtual object generation unit 435.

4, because the object information transmitted by the server 105 is for a virtual object within the visual range on the absolute coordinate of the camera 401, the calculation unit 433 can directly generate the virtual object And the corresponding object information can be transmitted to the unit 435.

However, if the object information transmitted by the server 105 according to the embodiment is not for the absolute coordinate range of the camera 401 but for all virtual objects within a predetermined range from the absolute coordinates of the digital device 101, The object extraction unit 433 extracts only the object information within the camera's field of view and transmits the extracted object information to the virtual object generation unit 435. [ In this case, the calculation unit 433 does not need to transmit the camera information and the position information to the server 105. [

The virtual object generation unit 435 receives object information about at least one virtual object from the calculation unit 433. [ The virtual object generation unit 435 generates virtual image data including a virtual object existing within the field of view of the camera 401 based on the posture information and the position information of the virtual object included in the object information.

The generation of virtual image data will be briefly described with reference to Figs. 6A to 6B. 6A and 6B are diagrams for explaining a process of generating virtual image data.

6A shows a polygon that has undergone the view space expansion process. The virtual image data starts from a view space expansion process in which a polygon corresponding to an identifier of a virtual object received from the server 105 is arranged in one coordinate system.

The virtual object creation unit 435 arranges the virtual objects on the space corresponding to the actual image data generated by the camera 401 based on the position information and the attitude information of the virtual object.

The virtual object generation unit 435 performs a light source process as shown in FIG. 6B in order to realistically represent the three-dimensional image data subjected to the view space processing.

When the light source process ends, the image data for the two-dimensional screen is generated by mapping and mapping with the projection conversion process. The projection conversion process includes clipping (FIG. 6C) for cutting out a portion outside a predetermined space defined by a plane, Hidden Surface Removal for removing a hidden polygon based on the view according to attitude information (FIG. 6D ). By clipping, the part of the polygons for the virtual object that is outside the viewing angle of the camera 401 is removed, and the coordinates on the screen are found through the screen mapping (FIG. 6E) and converted into a two-dimensional screen.

The virtual object generation unit 435 performs predetermined rasterization and rendering processing on the image data subjected to the projection conversion processing to generate virtual image data.

The virtual image data generated by the virtual object creation unit 435 may include only virtual objects without a background.

The image synthesis unit 437 receives the virtual image data from the virtual object generation unit 435, receives the actual image data from the camera 401, and synthesizes the virtual image data and the actual image data to generate final image data . The image synthesis unit 437 outputs the generated final image data to the image processing unit 411. FIG.

In the above embodiments, it is assumed that a virtual object is inserted into an actual image, but the present invention is not necessarily limited to this. In other words, an actual image can be synthesized and displayed on a virtual reality centered on a virtual object.

For example, objects of actual images obtained through a camera in a game made up of a virtual object and a virtual background screen are synthesized and displayed. Only an image of a specific subject is extracted and synthesized from the actual image data input through the camera 401 using a chroma key technique or the like.

7 is a flowchart illustrating an operation of a digital device according to an exemplary embodiment of the present invention. Hereinafter, the operation of the digital device 101 according to an embodiment of the present invention will be described with reference to FIGS. 1 to 7. FIG.

The digital device 101 connected to the server 105 via the network 103 calculates the position information and attitude information of the digital device 101 using the calculation unit 433. [ The location information is referred to, and the position information is referred to _{(P d, R d, Y} d) (a1, b1) (S701).

The calculation unit 433 of the digital device 101 transmits the camera information together with the calculated position information and attitude information thereof to the server 105 through the network processing unit 405. [ The camera control unit 431 generates camera information (S703).

When the server 105 receives the positional information, the attitude information, and the camera information from the digital device 101, the server 105 determines a certain range of the vector V direction, that is, the absolute coordinate position of the camera 401 Object information of the virtual object existing in the range is extracted (S705), and the extracted object information is transmitted to the digital device 101 (S707).

The calculation unit 433 of the digital device 101 receives the object information from the server 105 and transmits the object information to the virtual object generation unit 435. The virtual object generation unit 435 calculates the position of the virtual object Virtual image data that is the image of the virtual object included in the viewing angle of the digital device 101 is generated based on the information and attitude information (S709).

The virtual object generating unit 435 of the digital device 101 transmits the generated virtual image data to the image combining unit 437. The image combining unit 437 combines the virtual image data and the actual image The data is synthesized to generate final image data (S711).

The digital device 101 displays the synthesized final image data to the user through the display unit 413 (S713). Accordingly, the digital device 101 according to an embodiment of the present invention can display a virtual object in a real world existing within a range of a viewing angle of the camera 401.

Although not shown in FIG. 7, the server 105 may transmit the changed attitude information and the position information to the digital device 101 when the position information and the attitude information of the virtual object are changed. Accordingly, the virtual object displayed on the digital device 101 can change the attitude according to the changed attitude information or change the position according to the changed position information.

The present invention can be applied in various ways. For example, it is possible to experience a virtual reality by introducing a plurality of virtual media on the actual space. This maps the virtual medium based on the actual space, unlike the normal virtual experience.

The present invention may be implemented in methods, devices, and systems. Also, when the present invention is implemented in computer software, the elements of the present invention may be replaced with code segments necessary for performing the necessary operations. The program or code segment may be stored on a medium that can be processed by the microprocessor and transmitted as computer data combined with carrier waves via a transmission medium or a communication network.

The medium that can be processed by the microprocessor may be any electronic device capable of transferring and storing information such as electronic circuitry, semiconductor memory devices, ROMs, flash memories, EEPROMs, floppy disks, optical disks, hard disks, optical fibers, . Computer data also includes data that can be transmitted over an electrical network channel, an optical fiber, an electromagnetic field, a wireless network, or the like.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the present invention.

As described above, the digital device according to the present invention can simultaneously display a virtual subject mapped within a visual range of a connected camera and a virtual medium mapped on an actual space within the corresponding range, as one image.

Since the virtual medium is mapped to the absolute coordinates on the actual space, the digital device can display and change the type and attitude of the virtual medium in response to the change of its position.

In addition, the digital device can display the virtual medium while changing the posture of the virtual medium to be displayed based on its own posture information without changing the position, and can display the virtual medium as if the virtual medium were realized in the actual space.

Claims (16)

delete delete delete delete delete delete A method of displaying a virtual medium on a real image by a digital device connected to a predetermined camera for generating actual image data on a subject, Generating position information, which is absolute coordinates of the camera, and attitude information, which is information on a direction of the camera in the absolute coordinates; Generating virtual image data based on the positional information and the attitude information, the virtual image data including at least one virtual object preset to exist within a visual range on an absolute coordinate of the camera; And And displaying an image corresponding to the final image data obtained by synthesizing the virtual image data with the actual image data, Wherein the attitude information includes three axes including axes in at least one of a gravitational direction and a magnetic north direction, and an angle at which the camera rotates with axes orthogonal to each other, Lt; / RTI > delete delete delete delete delete delete A camera for generating actual image data for a subject; A sensor unit for generating position information which is an absolute coordinate of the camera and attitude information which is information on a direction of the camera in the absolute coordinate; A display unit for receiving a predetermined video signal and displaying the received video signal so as to be visually recognizable; A video processor receiving predetermined video data and converting the video signal into a video signal for display on the display unit and outputting the video signal; A calculation unit for extracting at least one virtual object preset to exist within the visual range on the absolute coordinates of the camera based on the positional information and the attitude information; A virtual object generation unit for generating virtual image data including at least one virtual object extracted by the calculation unit; And And an image synthesis unit for generating final image data obtained by synthesizing the virtual image data with the actual image data and outputting the generated final image data to the image processing unit, Wherein the sensor unit includes at least one rotation sensor together with one of a predetermined gravity sensor and a magnetic field sensor, and is characterized in that each of three axes including axes in at least one of a gravity direction and a magnetic north direction, And generating the attitude information by calculating an angle of rotation of the camera. A camera for generating actual image data for a subject; A sensor unit for generating position information which is an absolute coordinate of the camera and including at least one rotation sensor together with one of a predetermined gravity sensor and a magnetic field sensor and outputting the sensed value; A display unit for receiving a predetermined video signal and displaying the received video signal so as to be visually recognizable; A video processor receiving predetermined video data and converting the video signal into a video signal for display on the display unit and outputting the video signal; A calculation unit for extracting at least one virtual object set to be within the visual range on the absolute coordinate of the camera based on the positional information and the attitude information generated using the sensed value of the sensor unit; A virtual object generation unit for generating virtual image data including at least one virtual object extracted by the calculation unit; And And an image synthesis unit for generating final image data obtained by synthesizing the virtual image data with the actual image data and outputting the generated final image data to the image processing unit, The calculation unit calculates the angle of rotation of the camera with respect to each of the three axes including axes in at least one of the gravity direction and the north direction on the basis of the sensing value, And displaying the virtual image on the virtual image. delete

Images