KR20190142586A - Real-time Real Motion Interface by Object Redefinition - Google Patents

Abstract

The present invention relates to an image display device which is virtualized and matched with a real image, comprising: a server communication unit interworking with a portable terminal; and a server control unit extracting pre-stored image information from image information received from the portable terminal and comparing the extracted image information with pre-stored location-based related information to transmit the information to the portable terminal. When the portable terminal transmits the image information to the server communication unit, only a part of the pre-stored image matching with the corresponding real image is transmitted as image information.

Description

Real-time Real Motion Interface by Object Redefinition

The present invention relates to a system and method for combining a virtual object with a real object in reality and delivering the virtual object to a receiver around the object. A new form that displays the user's field of view while still or moving a virtual object image related to or matched to the actual landscape within the line of sight, conveying a new feeling, advertising, or any other form of information exchange. The present invention relates to a system and an interface method for transmitting and receiving a virtual object image in real time.

By using the location and direction information to determine the approximate location, and by comparing the facility information such as surrounding building information and live image information input according to the camera movement, the system identifies the service desired by the user and provides related information. The technology is called Augmented Reality (AR) technology.

More specifically, augmented reality is a field of virtual reality (VR), a computer graphics technique that synthesizes virtual objects in a real environment and makes them look like objects in the original environment. Unlike existing virtual reality targeting only things, it is a technology that can reinforce and provide additional information that is difficult to obtain only by real world by synthesizing virtual objects on the basis of real world. Augmented reality technology is currently used in the fields of broadcasting, advertising, exhibitions, games, theme parks, military, education, and promotions, but has not yet spread to the public.

Such augmented reality technology is in the spotlight in the field of mobile AR technology used in communication terminals. Currently, applications of mobile AR technology are gradually appearing, and marker-based mobile AR technology or sensor-based mobile AR technology is emerging as an early stage technology. Marker-based mobile AR technology is a technology that recognizes a building by recognizing a specific symbol after photographing a specific symbol corresponding to a specific building when shooting a specific building, and a sensor-based mobile AR technology is mounted on a terminal. It is a technology that overlays POI (Point of Interests) information corresponding to an image in the inferred direction by inferring the current position of the terminal and the viewing direction using a GPS and a digital compass. All of these conventional technologies can use the GPS and electronic compass in the terminal to infer the current location and the direction the terminal is looking. However, although it recognizes the input image through the terminal, it merely takes the original image and provides it and cannot provide further technology.

[Previous Patent Document]

Korea Patent Registration No. 10-1423196 (July 18, 2014 registration)

It is an object of the present invention to transmit a virtual reality image related to a real image and receive the transmitted virtual reality image to display the received images in sequence from a long distance image to a user's field of view so as to match or match the actual image within a certain distance. The present invention provides a new type of virtual reality image transmission / reception system and method for transmitting a new feeling, advertising, or other information exchange by allowing a virtual reality image to be viewed while still or moving.

According to a preferred embodiment of the present invention for achieving the above object, a virtualized video display device matched with the actual image

In the virtualized video display device matched with the real image,

A server communication unit interworking with the portable terminal; And

And a server controller which extracts pre-stored image information from the image information received from the portable terminal, and compares the extracted image information with previously stored location-based related information to the portable terminal. When the information is transmitted to the server communication unit, only a part of a pre-stored image matching the corresponding actual image is transmitted as the image information.

In addition, the display unit for displaying the execution screen of the running application;

A terminal communication unit interworking with the augmented reality providing server;

A camera module for obtaining image information corresponding to a still image or a moving image;

The terminal controller transmits the acquired image information to the augmented reality providing server, receives local information data corresponding to the transmitted image information from the augmented reality providing server, and outputs the obtained image information through the display unit. Includes, the terminal control unit,

The obtained image information of the area information data including at least one or more of the name information, telephone number information, POI information, advertising information, promotion information, Internet link information and tagging information from the transmitted image information A portable terminal is provided which can be viewed together with information or optionally.

In addition, in the virtualized image display method matched with the actual image,

Acquiring image information corresponding to a still image or a moving image in a portable terminal and transmitting the obtained image information;

Extracting previously stored image information from the image information in an augmented reality providing server;

Comparing, by the augmented reality providing server, the extracted image information with pre-stored location-based related information, extracting and transmitting region information data and output desired to match the extracted image information; And

A virtualized video display method matched to an actual video is provided, comprising outputting the extracted information from the portable terminal.

According to the present invention as described above, by transmitting a virtual reality image and receiving the transmitted virtual reality image to display the received image sequentially from the far image to the user's field of view to or associated with the actual image within a certain distance or By allowing the matched virtual reality image to be viewed while stationary or moving, it is possible to convey a new feeling, to advertise, or to exchange other forms of information.

Through this, in the fixed object, an advertisement effect may be brought by outputting and transmitting an image capable of advertising itself through a virtual reality image.

In addition, in the case of a movable object, a user can create a profile, a resume, a preference, a favorite food, and a business information of the user through virtual reality images as desired, transmit a signal, request a response signal, and transmit an acceptance signal. It can be configured to make a third transaction between moving objects.

1 is a conceptual diagram schematically illustrating a virtualized video display system matched with a real video according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating an example of an image screen viewed at a specific area A when the user moves in FIG. 1.
FIG. 3 is a diagram illustrating an example of an image screen shown at a point in time of a specific region while the user moves in FIG. 1.
4 is a schematic diagram illustrating an example of an image processing process through a virtualized image display system matched with an actual image according to an embodiment of the present invention.
5 is a diagram illustrating a visual processing process of a user through the system of FIG. 4.
6 is a flowchart schematically illustrating a virtualized image display method matched with an actual image according to an embodiment of the present invention.

Hereinafter, a virtualized image display system and method matched with an actual image according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a conceptual diagram schematically showing a virtualized video display system matched with a real image according to an embodiment of the present invention, and FIG. 2 is an example of an image screen shown at a specific area A when the user moves in FIG. FIG. 3 is a diagram illustrating an example of an image screen shown at a point B of a specific region while a user moves in FIG. 1, and FIG. 4 is a virtualized image display matched with an actual image according to an embodiment of the present invention. 5 is a schematic diagram illustrating an example of an image processing process through a system, FIG. 5 is a view illustrating a visual processing process of a user through the system of FIG. 4, and FIG. 6 is matched with an actual image according to an embodiment of the present invention. A flowchart schematically illustrating a virtualized video display method.

1 to 6, in the virtualized image display system matched with the actual image according to the present invention,

A plurality of virtual reality image transmitter objects (11, 12, 13, 14, 15, 16) having a transmitting device 200 for transmitting a virtual reality image is provided,

The receiver is configured to receive and display a virtual reality image transmitted through the transmitter.

For example, the receiver 100 is in the form of a contact lens 100, but is not limited thereto, and the display means 40 in the form of a transparent film capable of displaying an image signal screen 42 therein is provided. When the lens is manufactured together with the lens bodies 10 and 20, they are manufactured together. The display means 40 includes a memory device and a controller. If necessary, a battery that can be used for a predetermined time may be built in. However, the present invention is not limited thereto, and may be operated through an electromagnetic field signal that receives an external transmission signal and generates an induced current through an electric signal. Since the electromagnetic induction phenomenon is already well known in the art, a detailed description thereof will be omitted.

In Fig. 1, a user having a receiving device 100 (not limited to this, but may be a built-in transmitting device and may be a transmitting / receiving device, which is the same with the transmitting device 200.) moves through the point A while moving. Move to point B. In this case, the plurality of virtual reality image transmitter objects 11, 12, 13, 14, 15, and 16 provided with the transmitter 200 for transmitting each virtual reality image transmit their virtual reality image signals. The receiving apparatus 100 processes and displays virtual reality image signals displayed in different forms. That is, the view A and view B are different from each other because the reception apparatus 100 processes and displays the adjacent virtual reality image signal first.

Referring to FIG. 4, a user having the receiving apparatus 100 may receive an image from an object located at a fixed point such as A, B, or C, and each received image is separately stored with header coordinates. The image signal is clearly displayed from a virtual reality image located at a close distance (based on the receiving apparatus 100).

In addition, a virtual reality video signal transmitted from a moving object (person M1) is also received. At this time, the video signal is displayed as a moving virtual reality video.

In the present invention, the virtual reality video signal displayed through the display means varies.

Also. The user wears the receiving apparatus 100 on both of his eyes and then uses the same.

Referring to FIG. 5, the image through the display means installed in the receiving apparatus 100 sees the displayed screen as shown on the screen 42.

Referring to FIG. 6, in the virtualized image display method matched with an actual image according to the present invention,

First, a virtual reality video signal is transmitted from a plurality of transmitters (or a transceiver). Thereafter, the receiving apparatus 100 (or a transmitting and receiving apparatus) may store the received virtual reality image signal by dividing the header coordinates. After that, the images are displayed in the order of proximity.

Thereafter, the receiving apparatus 100 may transmit a response signal to each transmitting apparatus 200. In addition, the transmitter 200 may transmit an acceptance signal in response to the response signal of the receiver 100. If the transmitting device 100 and the receiving device 200 are real people as moving objects, they may have a meeting with each other.

On the other hand, although not shown, the virtual reality video signal transmitted from the transmission device to be transmitted with the encrypted data, and if necessary, the transmission device can be encrypted so that it is impossible to delete or randomly change or duplicate the external data. It is possible. In addition, log data may be recorded so that user personal information or object information may be transmitted and recorded in a header part of a data set that is currently signaled by a remote device to a remote administrator server (not shown). This is to help prevent crime or prevent secondary victims.

11,12,13,14,15,16: virtual reality image transmitter object
40: display means
42: Video signal screen
100: lens
200: virtual reality image (avatar image) transmitter

Claims (7)

A lens for receiving and displaying a transmitted video signal,
An antenna for receiving the video signal;
A display unit for displaying an image,
And a chip having processing means for processing and displaying an image on the display unit. The method of claim 1,
And the processing means receives a close signal from a far distance signal and processes the received image to display the received image signal through the display unit. The method of claim 2,
And the processing means divides and stores the received video signal by header number in order by distance, and displays the closest video signal first and then displays the far-away image in order. Transmitting means for transmitting a video signal,
Storage means for storing virtualized images,
And control means for transmitting the logged-in user's own transmission through the transmission means. The method of claim 4, wherein
And a video signal transmitted through the transmission means is an avatar video signal of a corresponding user. Receiving means for receiving an image signal,
Storage means for storing virtualized images,
And a control means for receiving the logged-in user through the receiving means of the user himself. The method of claim 6,
And a video signal received through the receiving means is an avatar video signal of a corresponding user.

Images