KR20180023409A - Apparatus for generating image identifiable in long distance in augmented reality and operation method thereof - Google Patents

Abstract

The present invention relates to an apparatus for generating an image identifiable at a long distance in augmented reality and an operating method thereof and, more specifically, to an apparatus for generating an image identifiable at a long distance in augmented reality, capable of providing improved readability, and to an operating method thereof. According to an embodiment of the present invention, an operating method of the apparatus for generating an image identifiable at a long distance in augmented reality is provided. The operating method may comprise the steps of: providing a first image including at least one character; generating a second image in which the ratio of the first image is changed by reflecting viewpoint information on the first image, wherein the viewpoint information includes information on at least one of a viewing direction and a viewing angle with respect to the first image; extracting coordinates of a first reference point of the first image and coordinates of a second reference point of the second image, which corresponds to the first reference point; and converting the first image by comparing the coordinates of the first reference point and the coordinates of the second reference point.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus and method for generating a distant identification image in augmented reality,

The present invention relates to an apparatus and method for generating a remote identification image in an augmented reality, and more particularly, to an apparatus and method for generating a remote identification image in an augmented reality capable of providing enhanced readability.

Fig. 1 shows an example of obtaining information on the road surface by utilizing the conventional augmented reality technique.

Augmented Reality is a computer graphics technology that combines virtual information into a real space in three dimensions to make virtual information appear to exist in real time. In contrast to the fact that only limited information can be provided due to reasons such as the visual effect on the environment, the limitation of the spatial range, and the change in the condition over time, the augmented reality technology can provide more information in various forms It has the advantage of being able to provide it as. However, even if it is augmented reality, because it provides information based on the same three-dimensional space as the real space, the problem of image distortion due to the point of view occurs in the same way as in the real space.

In order to solve this problem, it is necessary to provide a consistent and easy image conversion method in constructing the visualization of the virtual information synthesized in three dimensions in the real space, An identification image generation apparatus and an operation method thereof are required.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an apparatus for generating a remote identification image in an augmented reality and an operation method thereof that can provide a consistent and easy image conversion method and provide improved readability, The purpose.

According to an embodiment of the present invention, an operation method of an apparatus for generating a remote identification image in an augmented reality is provided. The method comprising: providing a first image comprising at least one character; Generating a second image in which the ratio of the first image is changed by reflecting viewpoint information on the first image, the viewpoint information including information on at least one of a viewing direction and a viewing angle with respect to the first image; Included -; Extracting coordinates of a first reference point of the first image and coordinates of a second reference point of the second image corresponding to the first reference point; And transforming the first image by comparing the coordinates of the first reference point with the coordinates of the second reference point.

According to an embodiment of the present invention, there is provided a computer-readable recording medium on which a program for performing a method of operating an apparatus for generating a remote identification image in an augmented reality is recorded.

According to an embodiment of the present invention, an apparatus for generating a remote identification image in an augmented reality is provided. An apparatus for generating a remote identification image in the augmented reality includes an image providing unit for providing a first image including at least one character; An image converter unit for generating a second image in which a ratio of the first image is changed, reflecting a predetermined viewpoint, the viewpoint being defined by a viewing direction and a viewing angle; And a reference point extracting unit for extracting coordinates of the first reference point and coordinates of the second reference point corresponding to the first reference point, wherein the image transforming unit transforms the coordinates of the first reference point, By comparing the coordinates of the points, the first image can be transformed.

According to the present invention, when a remote identification image in the augmented reality is displayed on a target surface such as a road surface or a building wall by implementing a remote identification image in the augmented reality by modifying the original image using an inverse perspective method, It is possible to reduce the phenomenon in which the distant images in the augmented reality converge and to increase the readability because the thicknesses of the near side and far side of the image in the read distance range are similar in thickness.

According to the present invention, since the relative ratio is deformed only in one of the vertical direction and the horizontal direction of the original image according to the set visual direction, it is possible to maintain the identity of the applied font by preventing excessive deformation of the image, It is possible to provide a remote identification image in the augmented reality that can be harmonized with the image.

BRIEF DESCRIPTION OF THE DRAWINGS A brief description of each drawing is provided to more fully understand the drawings recited in the description of the invention.
FIG. 1 illustrates an example of a virtual reality in which a conventional augmented reality technology is utilized.
FIG. 2 is a conceptual diagram illustrating the principle of a remote identification image generation apparatus in an augmented reality according to an embodiment of the present invention.
3 shows an apparatus for generating a remote identification image in an augmented reality according to an embodiment of the present invention.
4 to 5 illustrate an operation method of an apparatus for generating a remote identification image in an augmented reality according to an embodiment of the present invention.
6 to 11 illustrate an exemplary operation of an apparatus for generating a remote identification image in an augmented reality according to an embodiment of the present invention.

Hereinafter, embodiments according to the present invention will be described with reference to the accompanying drawings. It should be noted that, in adding reference numerals to the constituent elements of the drawings, the same constituent elements are denoted by the same reference symbols as possible even if they are shown in different drawings. In the following description of the embodiments of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the difference that the embodiments of the present invention are not conclusive. In addition, embodiments of the present invention will be described below, but the technical idea of the present invention is not limited thereto and can be variously modified by those skilled in the art.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "indirectly connected" . Throughout the specification, when an element is referred to as "comprising ", it means that it can include other elements as well, without excluding other elements unless specifically stated otherwise.

FIG. 2 is a conceptual diagram illustrating the principle of a remote identification image generation apparatus in an augmented reality according to an embodiment of the present invention.

The apparatus 100 for generating a remote identification image in an augmented reality according to an exemplary embodiment of the present invention converts an original image by applying an inverse perspective method so that the augmented reality image having improved readability in a predetermined viewing direction and viewing angle A remote identification image can be generated. Specifically, the inverse perspective is applied in reverse to the perspective. Specifically, by enlarging a region far from the candidate's position with respect to the target and narrowing the region with a short distance, To reduce the distortion of the object.

2, assuming that the candidate looks at the image a displayed on the object surface such as the road surface or the building wall at a predetermined viewing angle S at a predetermined first viewing angle S, As the image moves from the lower end portion c1 to the upper end portion c2 of the image a, the image is distorted as if it is reduced in size and projected to the gaze of the candidate. In order to correct such a distortion, it is required that the image (a) is transformed from the lower end portion (c1) to the upper end portion (c2) in such a manner that the image is enlarged in consideration of the gaze angle In order to obtain such a deformed image, the above-described inverse perspective method can be applied.

That is, a virtual second viewpoint S 'is set at a position opposite to the first viewpoint S symmetrically with respect to the image a, and at the second viewpoint S' The image a is reduced in size from the upper end portion c2 to the lower end portion c1 of the image a in contrary to the first view point S, In other words, it will be projected onto the gaze of the candidate as if the size increases from the lower end portion c1 to the upper end portion c2. This image projected to the candidate at the imaginary second time point S 'in the reverse direction is obtained by moving the original image a from the lower end portion c1 to the upper end portion c1 in accordance with the same line- when the actual image to be displayed on the object surface such as a road surface or a building wall is constituted on the basis of this, the above-mentioned distortion phenomenon at the first point of sight S is minimized .

The specific operation of the remote identification image generating apparatus (100 in FIG. 3) in the augmented reality realizing the above-described inverse perspective method according to the embodiment of the present invention will be described in detail with reference to FIG.

3 shows an apparatus for generating a remote identification image in an augmented reality according to an embodiment of the present invention.

3, an apparatus 100 for generating a remote identification image in an augmented reality according to an exemplary embodiment of the present invention includes a user input unit 110, an image providing unit 120, a reference point extracting unit 130, (140).

The user input unit 110 includes a user input for setting a width w and height h for defining a display area of the first image, predetermined characters and / or symbols to be included in the first image, And deliver it to the image providing unit 120. In accordance with such user input, the image providing unit 120 may provide a first image on the display area that is a two-dimensional image including at least one character and / or symbol. In addition, the user input unit 110 may receive the viewpoint information and may transmit the received viewpoint information to the image conversion unit 140. The image converting unit 140 converts the first image into a predetermined second image by reflecting the received time point information. At this time, the viewpoint information may include information on at least one of a gaze direction, a gaze angle, and a reference distance. A specific description of the line of sight information will be described in detail with reference to Fig. The user input unit 110 may be implemented by various input means known in the art capable of receiving predetermined user inputs such as a touch screen, a mouse, and a keyboard.

The image providing unit 120 may provide a first image including at least one character and / or symbol. That is, the user inputs setting information of the width (w) and height (h) for defining the display area of the first image, predetermined characters and / or symbols to be included in the first image, ), The image providing unit 120 can generate the first image by arranging at least one character and / or symbol displayed in a predetermined font on the set display area.

9) and the second reference point of the second image corresponding to the first reference point (r1-r7 in Fig. 9), the reference point extracting unit 130 extracts the reference point (R1'-r7 'in FIG. 9), and can transmit the extracted coordinates to the image converting unit 140. [0064] That is, when the image conversion unit 140 generates the second image in which the ratio of at least one region of the first image is changed by reflecting the predetermined viewpoint information, the reference point extraction unit 130 extracts the first reference of the first image (R1-r7 in Fig. 9) and the second reference point (r1'-r7 'in Fig. 9) of the second image corresponding thereto and extracts the result of the extraction to the image transforming unit 140 . 9) by comparing the coordinates of the first reference point (r1-r7 in FIG. 9) with the coordinates of the second reference point (r1'-r7 'in FIG. 9) r7, thereby changing the size of the reference area on the first image to generate the remote identification image in the augmented reality.

The image conversion unit 140 may generate the second image in which the ratio of at least one region of the first image is changed by reflecting the predetermined viewpoint information. Specifically, the image converting unit 140 converts the first image into a three-dimensional image according to a predetermined method, reflects the viewpoint information, and displays the first image converted into the three- And then extracting a plane image of the first image viewed from the opposite side of the set viewing direction, thereby generating a second image to which the inverse perspective method is applied. At this time, the rotation angle of the first image may be determined according to the set viewing angle. 9) by comparing the coordinates of the first reference point (r1-r7 in Fig. 9) with the coordinates of the second reference point (r1-r7 in Fig. 9) It can be converted into an identification image. 9) corresponding to the first reference point (r1-r7) and the second reference point (Fig. 9 (b)) corresponding to the first reference point r1-r7), thereby enlarging or reducing at least a part of the reference area divided by the first reference point (r1-r7 in Fig. 9), thereby enlarging or reducing the first image in the augmented reality It is converted into an identification image.

3, the user input unit 110, the image providing unit 120, the reference point extracting unit 130, and the image converting unit 140 may be implemented by a plurality of physical devices, As will be appreciated by those skilled in the art. For example, each of the user input unit 110, the image providing unit 120, the reference point extracting unit 130, and the image converting unit 140 may use various methods such as using software or using firmware, . ≪ / RTI >

A more specific operation method of the remote identification image generating apparatus 100 in the augmented reality according to an embodiment of the present invention will be described in detail with reference to FIG.

4 and 5 illustrate an operation method of an apparatus for generating a remote identification image in an augmented reality according to an embodiment of the present invention. 6 illustrates an exemplary operation of an apparatus for generating a remote identification image in an augmented reality according to an embodiment of the present invention.

In step S410, the image providing unit 120 may provide a first image including at least one character and / or symbol. At this time, the first image may be a generated two-dimensional image based on a predetermined user input through the user input unit 110. [ That is, the user inputs setting information of the width (w) and height (h) for defining the display area of the first image, predetermined characters and / or symbols to be included in the first image, 6, the image providing unit 120 arranges at least one character and / or symbol displayed in a predetermined font on the display area set by the user, A first image that is an image can be generated. At this time, the set display area may correspond to a display area on a target surface such as a road surface or a building wall to which a remote identification image in the generated augmented reality is applied, for example. Meanwhile, according to the embodiment, the first image may be a two-dimensional image previously stored in a memory unit (not shown).

Subsequently, in step S420, the image conversion unit 140 may generate the second image in which the ratio of at least one area of the first image is changed by reflecting the predetermined viewpoint information. That is, the image conversion unit 140 generates the second image by changing the ratio of at least one region of the first image according to the inverse perspective method described above with reference to FIG. 2, based on the predetermined viewpoint information. Here, the viewpoint information is information for defining a point on a three-dimensional plane (i.e., a reference point of time) where the center of the virtual candidate's gaze for the first image is located. The viewpoint information includes a view direction for the first image, , And a reference distance. Here, the gaze direction and the gaze angle with respect to the first image may be respectively defined by the traveling direction of the imaginary extension line connecting the center (m) of the first image from the reference viewpoint and the angle formed by the extension line with the first image . At this time, the gaze direction is preferably set such that the extension line is perpendicular to the horizontal axis (u) or the vertical axis (v) passing the center (m) of the first image, (Direction F) of looking at the center m of the first image at the reference point outside the upper side, a direction (direction F) of viewing the center m of the first image at the reference point of the first image, May be selected according to the user input in one of a direction (G direction) in which the center (m) of the first image is viewed and a direction (I direction) in which the first image center m is viewed from the reference point in the right outer side. Further, the reference distance may be defined as a horizontal distance from the center of the first image to the reference point. At least one of the gaze direction, the gaze angle, and the reference distance may be set according to a user input through the user input unit 110. [

Referring to FIG. 5, in operation S420, a first image is converted into a three-dimensional image (S422), and a second image is generated by rotating the first image by a predetermined angle of rotation toward the eye direction, (Step S424).

First, in step S422, the image converting unit 140 may convert the first image into a three-dimensional image. Conversion of such a two-dimensional planar image into a three-dimensional image can be performed by various methods applicable in the art. As an example, the image transforming unit 140 transforms the xy plane defined by coordinate values of the x and y axes in a three-dimensional coordinate space defined by three axes perpendicular to each other, that is, x axis, y axis, The first image may be converted into a three-dimensional image by substituting the first image into the first image and setting the coordinate values of the z-axis to the same value (for example, 0).

In step S424, the image conversion unit 140 reflects the viewpoint information, rotates the first image converted into the three-dimensional image by a predetermined rotation angle about the predetermined rotation axis toward the visual line direction, By extracting the planar image looking at the first image from the opposite side, a second image can be generated. The rotation axis is preferably one of the horizontal axis (u) and the vertical axis (v) on the same plane with the first image which is perpendicular to the set viewing direction and passes through the center of the first image. Specifically, the axis of rotation is a horizontal axis (u) when the line of sight is in the E or F direction and the vertical axis (v) if the line of sight is in the G or I direction. Further, the rotation angle of the first image may be determined according to the set viewing angle. When the set viewing angle is represented by phi, the rotation angle may be an angle greater than 90 DEG -2 DEG and less than 90 DEG, and preferably an angle of 90 DEG -φ.

In step S424, the image conversion unit 140 first projects the rotated first image onto a plane including the first image before rotation, thereby obtaining a predetermined plane image from the first image viewed from the opposite side of the set eye direction Can be extracted. 7, when the set visual axis direction is the E-axis direction, the image transforming unit 140 transforms the first image into the 90-degree angle of sight angle with the horizontal axis u as the rotation axis, the plane image can be extracted in such a manner that the rotated first image is projected onto a plane (e.g., xy plane) including the first image before rotation. In this case, the extracted planar image becomes the same image as the image projected on the gaze of the candidate when the first image is viewed with the same gaze angle (?) In the F direction symmetrical with the gaze direction E direction.

Next, the image converting unit 140 enlarges the extracted plane image by a predetermined multiple in a predetermined direction, and modifies one of the height and width of the extracted plane image to correspond to the first image, And generate the applied second image. At this time, the direction in which the extracted plane image is enlarged can be determined according to the set gaze direction. That is, if the visual direction is the E or F direction, the plane image extracted in the vertical direction (or the height direction) is enlarged, and if the visual direction is the G or I direction, . Referring to FIG. 8, the generated second image can be confirmed by enlarging the plane image shown in FIG. 7 in the vertical direction (or the height direction) to be equal to the height of the first image. Since the second image shown in FIG. 8 is generated on the assumption that the line of sight is in the E direction, the width and length of the character are increased from the lower side to the upper side of the second image according to an inverse perspective method.

In step S424, it is described that the rotation of the first image, the extraction of the plane image in the rotated first image, and the enlargement of the extracted plane image are performed in sequence, but the present invention is not limited thereto. Accordingly, the processes may be performed in a batch by a predetermined application program.

In step S430, the reference point extraction unit 130 extracts the reference point r1-r7 of the first image from the coordinate of the first reference point r1-r7 and the second reference point r1 of the second image corresponding to the first reference point r1- '-r7') can be extracted. Here, the first reference point (r1-r7) means a point serving as a reference for dividing the first image into a plurality of reference regions, and the determination criterion of the first reference points (r1-r7) Which may vary depending on the embodiment being practiced. That is, although FIG. 9 shows that the first reference point r1-r7 is determined based on one character, this is an exemplary one. According to the embodiment, the first reference point r1-r7 is the first And may be configured to be determined based on one or more characters and / or symbols included in the image.

When the first reference points r1 to r7 are determined, the first image can be divided into a plurality of reference areas by the first reference points r1 to r7, as shown in Fig. At this time, the dividing directions of the plurality of regions by the first reference points r1-r7 can be determined according to the set gaze direction. That is, if the visual direction is the E or F direction, the reference area is horizontally divided with reference to the first reference point r1-r7. If the visual direction is the G or I direction, the first reference point r1- .

Thereafter, the image converting unit 140 compares the coordinates of the first reference point r1-r7 with the coordinates of the second reference point r1'-r7 'to enlarge or reduce the reference region, . ≪ / RTI >

The positions and the numbers of the first reference points r1-r7 and the second reference points r1-r7 shown in FIG. 9 are illustrative, and various configurations can be applied according to the embodiment to which the present invention is applied.

In step S440, the image conversion unit 140 converts the first image into the remote identification image in the augmented reality by comparing the coordinates of the first reference points r1-r7 with the coordinates of the second reference points r1-r7 can do. Specifically, the image conversion unit 140 converts at least one of the coordinates of the first reference point r1-r7 and the coordinates of the second reference point r1-r7 corresponding to the first reference point r1-r7 The first image can be converted by comparing at least one of the reference points r1-r7 by enlarging or reducing at least a part of the reference area divided by the first reference points r1-r7. For example, assuming that the eye direction in the E direction is applied, the coordinates of the first reference points r4 and r5 of the first image are (x4, y4), (x5, y5) Assuming that the coordinates of the points r4 'and r5' are (x4 ', y4') and (x5 ', y5'), the height of the reference area defined by the first reference points r4 and r5 is y5 - y4 ', the reference area defined by the first reference points r4 and r5 may be enlarged or reduced in the vertical direction, and this process may be performed by dividing the reference area defined by the reference points r1-r7 Area, it is possible to generate the remote identification image in the AR in Fig. 10 in which the first image of the original is corrected in the longitudinal direction. Referring to FIG. 10, it can be seen that the first image of FIG. 6, which is the original image on the remote identification image in the augmented reality, is modified to be longer in the vertical direction.

In Fig. 11, an image projected on the gaze of a candidate is exemplarily shown when the remote identification image in the augmented reality of Fig. 10 is viewed at a predetermined setting gaze angle in the gaze direction in the E direction. Referring to FIG. 11, an image to be projected to a candidate in a specific eye direction and a gaze angle through an augmented reality remote image generated by an apparatus for generating a remote identification image 100 in an augmented reality according to an exemplary embodiment of the present invention Is significantly improved.

Meanwhile, the various embodiments described herein may be implemented by hardware, middleware, microcode, software, and / or a combination thereof. For example, various embodiments may include one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ), Processors, controllers, microcontrollers, microprocessors, other electronic units designed to perform the functions described herein, or a combination thereof.

Also, for example, various embodiments may be stored or encoded in a computer-readable medium including instructions. The instructions stored or encoded in the computer-readable medium may cause a programmable processor or other processor to perform the method, for example, when the instructions are executed. The computer-readable medium includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. The storage medium may be any available media that can be accessed by a computer. By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage media, magnetic disk storage media or other magnetic storage devices, Or any other medium that can be used to carry or store data in the form of data structures.

Such hardware, software, firmware, etc. may be implemented within the same device or within separate devices to support the various operations and functions described herein. Additionally, components, units, modules, components, etc. described in the present invention as "parts" may be implemented separately or together as separate but interoperable logic devices. The description of different features for modules, units, etc. is intended to emphasize different functional embodiments and does not necessarily imply that they must be implemented by individual hardware or software components. Rather, the functionality associated with one or more modules or units may be performed by separate hardware or software components, or may be incorporated within common or separate hardware or software components.

Although acts in a particular order are shown in the figures, it should be understood that these acts are performed in the specific order shown, or in a sequential order, or that all illustrated acts need to be performed to achieve the desired result . In any environment, multitasking and parallel processing may be advantageous. Moreover, the division of various components in the above-described embodiments should not be understood as requiring such a distinction in all embodiments, and the components described may generally be integrated together into a single software product or packaged into multiple software products It should be understood.

As described above, an optimal embodiment has been disclosed in the drawings and specification. Although specific terms have been employed herein, they are used for purposes of illustration only and are not intended to limit the scope of the invention as defined in the claims or the claims. Therefore, those skilled in the art will appreciate that various modifications and equivalent embodiments are possible without departing from the scope of the present invention. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

Claims (11)

An operation method of a remote identification image generating apparatus in an augmented reality,
Providing a first image comprising at least one character;
Generating a second image in which the ratio of the first image is changed by reflecting viewpoint information on the first image, the viewpoint information including information on at least one of a viewing direction and a viewing angle with respect to the first image; Included -;
Extracting coordinates of a first reference point of the first image and coordinates of a second reference point of the second image corresponding to the first reference point; And
And converting the first image by comparing the coordinates of the first reference point with the coordinates of the second reference point. The method according to claim 1,
Wherein the generating the second image comprises:
Converting the first image into a three-dimensional image; And
The second image is generated by extracting a plane image by rotating the first image converted into the three-dimensional image by a predetermined rotation angle toward the visual axis around a predetermined rotation axis by reflecting the viewpoint information, ≪ / RTI > 3. The method according to claim 2,
Wherein the rotation axis is one of a horizontal axis and a vertical axis on the same plane as the first image converted into the three-
Wherein the angle of rotation is determined by the viewing angle. The method of claim 3,
Wherein the angle of rotation is greater than 90 ° -2φ and less than 90 ° when the viewing angle is φ. The method according to claim 1,
Wherein the converting the first image comprises:
At least one value among coordinates of the first reference point and coordinates of the second reference point corresponding to the first reference point are compared with each other and at least one of the reference areas divided by the first reference point And enlarging or reducing a portion of the image. A computer-readable recording medium on which a program for performing the method according to any one of claims 1 to 5 is recorded. An apparatus for generating a remote identification image in an augmented reality,
An image providing unit for providing a first image including at least one character;
An image converter for generating a second image in which a ratio of the first image is changed by reflecting predetermined viewpoint information, the viewpoint information including information about at least one of a gaze direction and a gaze angle for the first image -; And
And a reference point extracting unit for extracting coordinates of the first reference point and coordinates of the second reference point corresponding to the first reference point,
Wherein the image transforming unit transforms the first image by comparing the coordinates of the first reference point with the coordinates of the second reference point. 8. The method of claim 7,
Wherein the image conversion unit converts the first image into a three-dimensional image, reflects the viewpoint information, and converts the first image converted into the three-dimensional image into a predetermined rotation angle And the second image is generated by extracting the plane image. 9. The method of claim 8,
Wherein the rotation axis is one of a horizontal axis and a vertical axis on the same plane as the first image converted into the three-
Wherein the rotation angle is determined by the gaze angle. 10. The method of claim 9,
Wherein the angle of rotation is greater than 90 ° -2φ and smaller than 90 ° when the viewing angle is φ. 8. The method of claim 7,
Wherein the image conversion unit compares at least one value among the coordinates of the first reference point and the coordinates of the second reference point corresponding to the first reference point, Wherein the first image is transformed by enlarging or reducing at least a part of the reference region.

Images