KR102107340B1 - Method for displaying objects in display - Google Patents

Abstract

The present invention provides a method for displaying objects in a display, in a method for displaying a plurality of objects within a specified distance from a user terminal including a screen using an interface of augmented reality, which includes an image implementation unit which expresses an image on the terminal screen; a radar unit which displays a mark of the object by dividing an area displayed on the image implementation unit from an area not displayed; an object correspondence display unit correspondingly representing a plurality of objects located in the area displayed on the image implementation unit; and a control input to activate and control a list for the objects. When an activation switch of the control input unit is activated, an object display unit displaying the list of the plurality of objects is displayed.

Description

How to display objects in the display {METHOD FOR DISPLAYING OBJECTS IN DISPLAY}

The present invention relates to an object display method having a direction value or a position value based on a user terminal. In more detail, in augmented reality and virtual reality screens, a method is displayed on the screen facing the user in front of the user, but when the terminal position or direction is changed, the displayed objects can be recognized and manipulated without changing the screen direction. It is about.

Augmented reality (Augmented reality, AR) is a computer graphics technique that shows a virtual object or information on a real environment when viewed through a display device. Virtual reality (VR) is a technique in which everything, including the environment viewed through a terminal, is displayed with pre-made graphics.

 Displaying user information in virtual reality and augmented reality is characterized in that information objects are fused and expressed as real images on a real environment or virtual environment in a direction viewed by a user through a terminal.

In this case, the augmentation information appearing on the screen is forced to display only the object appearing in the direction the terminal is facing. If there is an object outside the screen and its position is recognized and manipulated, the direction of the terminal is rotated, or in the case of a direction that is not recognized only by the rotation of the terminal, the user rotates the body to change the orientation of the terminal to create the actual environment in the desired direction. There is a great inconvenience that it can only be put inside the screen. The inconvenience of object recognition and manipulation outside the terminal orientation is the same in augmented reality (AR) as well as in a virtual reality (VR) screen and a 360-degree VR video screen.

The present invention is to solve the above problems, and to provide an object display method capable of recognizing the number of augmented reality and virtual reality objects outside the terminal screen and each direction without changing the direction of the terminal.

To solve this problem, the object display method in the display provided by the present invention is a method of displaying a plurality of objects within a specified distance from a user terminal including a screen with an interface of augmented reality, and expressing an image on the terminal screen An image implementation unit to display, a radar unit to display the mark of the object by dividing an area displayed on the image implementation unit from an area not displayed, and an object corresponding to a plurality of objects located in an area displayed on the image implementation unit It includes a corresponding display unit and a control input unit for activating and controlling a list for the object, and when an activation switch of the control input unit is activated, a list display step of displaying an object list unit displaying a list for the plurality of objects is displayed. .

In one embodiment, in the list display step, the object list may be displayed according to a preset condition.

In one embodiment, the set condition is displayed on the radar unit, and the set condition is displayed on the radar unit may be characterized by displaying the mark of the object differently.

In one embodiment, the set condition is displayed on the radar unit, and the set condition is displayed on the radar unit may be characterized in that a region of the radar unit is displayed with different criteria.

In one embodiment, the preset condition may be characterized in that it is a group order according to actual distances for the plurality of objects based on the user terminal.

In one embodiment, the preset condition may be characterized in that it is a group order according to actual directions for the plurality of objects based on a direction facing the user terminal.

In one embodiment, the preset condition may be whether or not an object in an area displayed in the image implementation unit and an object in an area not displayed in the image implementation unit.

In one embodiment, the object list unit may be moved according to a user's input, and a condition displayed on the object list unit may be changed according to a location where the object list unit is moved.

In one embodiment, the moving position of the object list unit may be characterized by being divided into upper, lower, left, and right regions.

In one embodiment, when selecting an area of the radar, a list of objects corresponding to the area of the radar may be displayed.

In one embodiment, the area of the radar is divided into a plurality of areas, and each radar area is individually activated when selected, and only objects corresponding to the selected radar area are filtered to display a list of objects. It can be characterized as.

In one embodiment, the radar region may further include a location information layer including information capable of locating the object.

In one embodiment, the area of the radar may be characterized by including a road image and a map around the object.

In one embodiment, the area of the radar may further include at least two or more icons indicating the number of objects for each direction.

In one embodiment, the area of the radar may be characterized by being displayed with a mark of a specific object when the terminal is a standby screen.

According to the present invention as described above, by listing the object in conjunction with the radar unit and the object list unit, it is possible to provide information of an object that is not in the display area.

In addition, by listing objects in a group by distance in the object list, the user can easily select object information.

In addition, since it is possible to intuitively replace the conditions related to the direction while moving the object list unit by dragging and dropping, it is possible to intuitively replace the listing information of the object.

In addition, by applying regions-specific filters by touching regions represented on the radar unit, it is possible to intuitively apply data-specific filters.

In addition, by displaying road information by applying an additional layer on the radar unit, the user can more easily grasp the location information of the object.

Finally, by providing a function to display the radar unit on the standby screen, it is possible to immediately grasp the direction and position of the object in the standby state.

1 is a configuration diagram of a system to which an object display method in a display is applied according to an embodiment of the present invention.
2 to 13 are views showing an object display method in a display according to an embodiment of the present invention.

Hereinafter, exemplary embodiments disclosed herein will be described in detail with reference to the accompanying drawings, but the same or similar elements are assigned the same reference numbers regardless of the reference numerals, and overlapping descriptions thereof will be omitted. The suffixes "modules" and "parts" for the components used in the following description are given or mixed only considering the ease of writing the specification, and do not have meanings or roles distinguished from each other in themselves. In addition, in describing the embodiments disclosed in the present specification, when it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed herein, detailed descriptions thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical spirit disclosed in the specification is not limited by the accompanying drawings, and all modifications included in the spirit and technical scope of the present invention , It should be understood to include equivalents or substitutes.

When an element is said to be "connected" or "connected" to another component, it is understood that other components may be directly connected to or connected to the other component, but other components may exist in the middle. It should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that no other component exists in the middle.

Singular expressions include plural expressions unless the context clearly indicates otherwise.

In addition, in the present specification, when a part “includes” a certain component, it means that the component may further include other components, not to exclude other components, unless otherwise specified.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the essential features of the invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The same reference numerals in the drawings refer to the same elements.

Augmented reality object display system

1 is a configuration diagram of a system to which an object display method in a display is applied according to an embodiment of the present invention.

Referring to FIG. 1, in the augmented reality object display system according to an embodiment of the present invention, an image realization module 10 that implements a terminal image implementation unit, and an area that is displayed on an image implementation unit and an area that is not displayed are divided into objects. A radar module 20 for displaying a mark, an object-correspondence display module 30 for implementing an object-correspondence display for correspondingly representing a plurality of objects located in an area displayed on the image implementation unit, and a control input for activating a list of objects Includes module 40.

The image realization module 10 collects an image captured in the field from an external camera module 60 and implements it on the terminal screen 1. At this time, since various information must be connected and configured in the field image implemented in the image realization module 10, only limited information can be expressed in the general augmented reality module. In addition, in this case, in order to sense information outside the screen, the screen direction of the terminal must be rotated. In this case, when only the screen direction is rotated, the user may not be able to see the screen in an angle. In order to rotate the terminal while viewing the screen, the entire body must be rotated. For users in this difficult or uncomfortable environment, there are many difficulties in recognizing and manipulating information of objects outside the screen.

The radar module 20 distinguishes an area displayed from an image implementation unit from an area not displayed, and displays an object mark on the radar unit. Due to the existence of the radar module 20, it is possible to recognize objects that are within a radius and objects visible on a real terminal screen, but do not appear on the screen. In addition, the object-correspondence display module 30 displays the objects of a radius in the screen on the actual screen, the mark of the object expressed in augmented reality.

The radar module 20 and the object correspondence display module 30 are connected to an external data server 50 and a wireless communication network using a terminal, and receive and use data based on a point where the terminal is currently located.

The control input module 40 controls various user inputs for displaying augmented reality.

2 is a screen of a system to which an object display method in a display is applied according to an embodiment of the present invention.

Referring to FIG. 2, the image implementing unit 100 is displayed on the bottom layer, and on the radar unit 200, an area dividing line 201 separating an area currently displayed by the image implementing unit 100 from an area that is not. ) Is displayed. The object mark 205A displayed in the area dividing line 201 and the object mark 205B displayed in addition to the area dividing line 201 may be displayed separately.

The object target 300 displayed in the area dividing line 201 is displayed in the image implementation unit 100. The object target is displayed together with the external image 100 so that the user can recognize a specific location. The object target may display information related to the object, such as the object name and the distance of the object. As described above, since the contents of an object can be distinguished through such an object target, objects that are not displayed on the object target 300 together with the image by shouting in the image implementation unit 100 are recognized only within the radar unit 200. The user may not know what the specific contents are.

Activation switch 400 of the control input unit 40 When a user activates with a touch or the like, an object list unit displaying a list of a plurality of objects is displayed. The activation switch 400 may display the number of objects that can be actually represented in the icon.

Object Display Method Example 1: Basic Example

3 is a screen of a system to which an augmented reality object display method according to another embodiment of the present invention is applied.

Referring to FIG. 3, in the embodiment of FIG. 2, in the state in which the activation switch 400 is activated, it can be seen that the object list unit 500 is displayed.

In this embodiment, the objects appearing in the object list unit 500 are based on the conditions of the objects in the image implementation unit 100, but this can be applied in various ways according to the set conditions.

In terms of user utilization, various objects such as convenience stores, parking lots, gas stations, subway stations, banks, cultural facilities, public institutions, lodging, restaurants, cafes, hospitals, and pharmacies can be applied to list target objects existing within the terminal reference radius.

In addition, listing may be possible in the object list unit 500 by applying various conditions. In particular, listing in connection with the radar unit 200 will be described in a later embodiment.

Among the objects in the radar unit 200, objects currently displayed in the object list unit 500 may be displayed using a separate color. For example, objects represented by the black mark 210A may mean that they are currently listed in the object list unit 500. Objects represented by white or transparent color marks 210B may mean that they are not listed in the current object list unit 500.

In this embodiment, the closing switch 410 and the switching switch 420 are located on the object list 500, respectively. Due to the configuration of the user interface, the dentures of the close switch 410 and the changeover switch 420 may exist anywhere on the screen. The closing switch 410 serves to turn the object list unit 500 on and off. The switch 420 is responsible for switching conditions applied to the object list unit 500 in various ways.

For example, when the changeover switch 420 is activated, conditions applied to the object list unit 500 may be converted. Specifically, these are objects in the area displayed on the image implementation unit 100 and the image implementation unit. It may be whether or not the object is in an area not displayed in. Accordingly, the changeover switch 420 may alternately display a list of objects located in the area and a list of objects located outside the area, based on the area displayed on the image implementing unit 100, such as a toggle switch.

4 is a screen of a system to which an augmented reality object display method according to another embodiment of the present invention is applied. Referring to FIG. 4, it is represented by substantially the same function as in the embodiment of FIG. 3, but the active area of the radar 200 is not displayed based on the object mark, but is displayed as the radar 200 area The point is different.

The region 220A displayed in the image implementation unit 100 and the region 220B displayed outside the image implementation unit 100 are separated, and the radar unit determines the target area of the list currently displayed in the object list unit 500. 200).

The area may be expressed by applying a color of a transparent layer or a color of an opaque layer by applying a separate layer, and various methods of visually expressing the area may also be applied.

Object display method Example 2: Listing by distance

5A is a screen of a system to which an augmented reality object display method according to another embodiment of the present invention is applied.

Referring to FIG. 5A, it can be seen that in the embodiment of FIG. 3, the object list unit 500 and the radar unit 200 are represented differently. In this embodiment, the condition of listing applied in the object list unit 500 is a group order according to actual distances for the plurality of objects based on a user terminal.

For example, when the standard of the object included in the radar is within 300 m, the first group (231, 234), which is 0 to 50 m, and the second group (232, 235), which is 50 to 100 m, the third that is 100 to 300 m It can be divided into groups (233, 236). Even in this group, the groups 234, 235, and 236 in the image implementation unit 100 and the groups 231, 232, and 233 outside may be divided, and two conditions may be simultaneously applied.

When listing is performed in a group by distance, the object listing unit 500 may perform listing in a different way from the previous one. In particular, in arranging the icons corresponding to the objects in the listing, different sizes may be applied for each distance or multiple layers may be applied for each distance group. When multiple layers are applied, there is an advantage on the interface that can predict how many objects in the next group can exist.

5B and 5C are views illustrating a screen of an object list in the augmented reality object display method in the embodiment of FIG. 5A.

5B is a diagram illustrating a method of listing different sizes of icons for each distance group in the object list unit 500. The user can change the distance group of objects simply by scrolling up and down.

FIG. 5C is a diagram in which the icons in the next group are represented on the next layer by applying different layers for each distance group in the object list unit 500. This allows the user to guess the contents of the icons in the next group.

The applied embodiments of FIGS. 5B and 5C may be applied overlapping with other technologies, and the shape or color of an icon, the order of layers, or a user input method for converting to the next distance group may be changed in various ways at the level of those skilled in the art.

Object display method Example 3: Listing movement interface

6 and 7 are screens of a system to which an augmented reality object display method according to another embodiment of the present invention is applied.

6 and 7, in the embodiment of FIG. 3, the object list unit 500 is configured differently. In more detail, the conditions applied to the object list unit 500 may be intuitively changed while moving the position of the object list unit 500 according to the user's input.

In the embodiment of FIG. 6, the object list unit 500 is touched and moved to the left side of the screen using a drag and drop method. When the user moves the object list unit 500 in an arbitrary direction, conditions of objects expressed in the object list unit 500 are changed as conditions corresponding to the direction in which the object list unit 500 is moved.

In the present embodiment, the object list unit 500 is moved to the left side of the screen, and accordingly, the object list unit 500 is not represented on the screen and is changed to a list of objects corresponding to the left direction among objects that cannot be checked on the screen. These conditions can be divided in the up, down, left, and right directions, and only in the up and down directions according to the necessary conditions. In addition, the conditions can be changed by dividing the contents into various defenses.

In particular, as the listing conditions of the object list unit 500 are changed, the radar unit 200 also expresses the conditions of the objects currently being listed in the object list unit 500.

In the radar unit 200, an area that is not expressed is expressed as a shading area 242, and an area that is actually displayed is expressed as a display area 241. Marks 245 of objects listed in the object list unit 500 are indicated in a separate color. As described above, the display method may be changed in various ways according to the design of the user interface.

In particular, referring to FIG. 7, the object list unit 500 is moved by dragging and dropping in the downward direction. In this case, the entire object that is not expressed in the image implementation unit 100 may be listed, and accordingly, the entire front area is displayed as the shading area 252, and the entire area that is not expressed in the image implementation unit 100 is displayed. 251). The mark 255 of the object being listed in the object list unit 500 is displayed in a separate color, and the entire object that is not expressed in the image implementation unit 100 is listed in the moved object list unit 500B. If necessary, the object list unit 500B can display a large number of icons at the same time by arranging icons in a list of two or more columns.

In particular, this group setting by defense is applied in overlap with categories such as convenience store, parking lot, gas station, subway station, bank, cultural facility, public institution, lodging, restaurant, cafe, hospital, pharmacy, etc. When the object to be searched is a convenience store, it is possible to identify and check the object in a desired direction while moving the object list unit 500.

Object display method Example 4: Listing filter by area to be directly selected

8 to 10 are screens of a system to which an augmented reality object display method according to another embodiment of the present invention is applied.

Referring to FIG. 8, each area of the radar unit 200 may be divided into 12 areas by direction and distance group, and a user directly touches and selects each area of the radar unit 200, thereby Star filtering can be applied directly.

For example, when a user wants to search for an object target within 0 to 50 m in proximity regardless of the direction, if the corresponding area (AU3, AR3, AL3, AD3) is activated, only the objects within the area are listed in the object list 500 The condition can be changed as shown in.

The user directly applying the local filter by touching the allocation area of the radar unit 200 is a method of intuitively inputting the filtering conditions for the target object. In this embodiment, these areas are divided into 12 areas, but may be divided into areas according to distance or areas according to orientation. When road information is directly displayed on the radar unit 200, which will be described later, the road itself is activated by touching it, so that information on the road can be applied as a filter. Details will be described later.

9 is a screen of a system to which the augmented reality object display method according to the embodiment of FIG. 8 is applied. In particular, by touching the AL2 area, which is the 50m to 100m area on the left under the specified condition, an object can be listed by adding the regional condition in addition to other conditions. In this case, when different areas are touched separately, the filtering results extended to other areas in addition to the existing filtering conditions are displayed on the object list unit 500. The advantage of this method is that it is not recognized in the actual augmented reality screen, but by entering a specific condition and activating the area accordingly, information of a specific object can be confirmed through a listing of the object list unit 500.

10 is a screen of a system to which an augmented reality object display method according to the embodiment of FIG. 8 is applied. Particularly, as described above, in FIG. 10, the group for each distance is set to activate the area AC3 within 0 to 50 m and the area AC1 within 100 to 300 m according to a given condition. Objects are listed, and in this case, the object list unit 500 may apply icons representing the icons in a group for each area to iconify the information of the object along with information on the distance.

Object display method Example 5: Radar unit for expressing road information

11 to 13 are screens of a system to which an augmented reality object display method according to another embodiment of the present invention is applied.

Referring to FIGS. 11 and 12, in this embodiment, simple road information 250 may be included by applying an additional location information layer 250 on the radar unit 200. In particular, it is possible to provide intuitive movement information to a user moving on foot to a target location. In addition, in the present embodiment, in the option of applying a filter by directly touching the radar unit 200, by allowing a filter for each distance of the road to be applied, the user can obtain information on an object at a corresponding distance. There is this.

Referring back to FIG. 12, a filter is applied by touching a specific distance 255 on the road information 250 expressed on the radar unit 200. When the corresponding filter is applied, objects involved in road information are displayed again in the object list unit 500. Therefore, information of objects existing at a specific distance 255 may be filtered.

This condition can be utilized as various elements applied to the location information layer 250 as well as a specific distance 255. For example, selecting a specific building to identify objects in the building, medium-sized underground shopping malls, roads and roads meet naturally defined urban blocks, etc. can be applied as filters, and filters these conditions used By applying as without changing the screen in augmented reality, you can quickly search the target list information intuitively.

Referring to FIG. 13, in the road information 250 expressed on the radar unit 200, separate icons 162, 162, and 163 representing the number of objects for each direction are displayed. In this case, it is possible to intuitively grasp the number of objects in each direction, so that the user can grasp the objects more conveniently.

Object display method Example 6: standby screen

14 is a screen of a system to which an augmented reality object display method according to another embodiment of the present invention is applied.

Referring to FIG. 14, when the standby screen transmission of the radar unit 200 is activated, the screen of the radar unit 290 may be expressed on the standby screen. In this case, only the mark 710 of a specific object may be displayed, and in real time, the user can check the movement status on the standby screen. The standby screen can be released with a sliding bar 700 or the like, and can be implemented using various screens in addition to the method shown in the drawing.

Marks for one object are not necessarily displayed, and various options can be applied according to the user's setting. In addition, various layers may be applied to the radar unit 290 to express various information. For example, as illustrated in the embodiment of FIG. 11, a separate layer may be set to express road information. In this case, pedestrians can more easily find objects and understand their location.

The present invention is not limited by the above-described embodiments and the accompanying drawings. For those skilled in the art to which the present invention pertains, it will be apparent that components according to the present invention can be substituted, modified and changed without departing from the technical spirit of the present invention.

10: Video realization module
20: radar module
30: object-adaptive display module
40: control input module
50: data server
60: camera module
100: video implementation
200: radar section
300: object target
400: activation switch
500: object list

Claims (15)

In the method for displaying a plurality of objects on the user terminal including the screen with the interface of the augmented reality,
An image implementation unit for expressing an image on the terminal screen;
A radar unit that displays a mark of the object by dividing a region displayed from the image implementation unit from a region not displayed;
An object correspondence display unit correspondingly representing a plurality of objects located in an area displayed on the image implementation unit; And
A control input unit that activates and controls the list for the object;
Including,
When the activation switch of the control input unit is activated, including a list display step of displaying an object list unit for displaying a list of the plurality of objects,
When the activation switch of the control input unit is in an inactive state, the control input unit displays the number of the object list units to be displayed, and in the list display step, the object list unit is displayed according to a preset condition. How to display my object.
delete According to claim 1,
The set condition is displayed on the radar unit,
The method for displaying an object in a display is characterized in that the set condition is displayed on the radar unit by differently expressing the mark of the object.
According to claim 1,
The set condition is displayed on the radar unit,
When the set condition is displayed on the radar unit, an object display method in a display is characterized in that the radar unit region is displayed with different criteria.
According to claim 1,
The preset condition is an object display method in a display, characterized in that the group order by the actual distance for the plurality of objects based on the user terminal
According to claim 1,
The preset condition is an object display method in a display, characterized in that it is a group order for each of the plurality of objects based on a direction facing the user terminal.
According to claim 1,
The preset condition is whether an object in an area displayed on the image implementation unit and an object in an area not displayed on the image implementation unit is displayed.
According to claim 1,
A method of displaying objects in a display, wherein the object list unit is moved according to a user's input and a condition displayed on the object list unit is changed according to a location where the object list unit is moved.
The method of claim 8,
The moving position of the object list unit is divided into upper, lower, left, and right regions.
According to claim 1,
When selecting an area of the radar, a list of objects corresponding to the area of the radar is displayed.
According to claim 1,
The area of the radar is divided into a plurality of areas, and each radar area is individually activated when selected, and only objects corresponding to the selected area of the radar are filtered to display a list of objects. How to display.
According to claim 1,
The radar region further includes a location information layer including information capable of determining the location of the object.
The method of claim 12,
The method of displaying an object in a display, wherein the area of the radar includes a road image around the object.
The method of claim 13,
The radar area further includes at least two or more icons indicating the number of objects for each direction, and a method for displaying objects in a display.
According to claim 1,
The method of displaying an object in a display, wherein the area of the radar is displayed together with a mark of a specific object when the terminal is a standby screen.

Images