KR102409826B1 - Apparatus and method for displaying signage image using metaverse - Google Patents

Abstract

An apparatus according to an embodiment of the present invention includes: a camera module for capturing a building to which a sign is to be attached; a display in which the building is captured and displayed in real time according to a change in the lens incident angle of the camera module; and a signboard image display control module for controlling to display in real time a signboard image prepared in advance in a predetermined area of the building captured in real time on the display.

Description

Apparatus and method for displaying sign image using metaverse {APPARATUS AND METHOD FOR DISPLAYING SIGNAGE IMAGE USING METAVERSE}

The present invention relates to an AR (Augmented Reality) signboard image display apparatus and method.

In general, signboards such as billboards are manufactured in various forms as a means for displaying a trade name, sales product, industry, etc., or promoting brand image and sales of produced products, etc. It is installed by being hung, erected, or pasted at a specific place, such as a business store, an outdoor wall or an indoor wall of a building structure, an outdoor structure, an exhibition hall, a road, etc.

These signs can be classified into rooftop signs, wall signs, protruding signs, store signs, standing signs, billboards, etc. depending on the installation location, and depending on the structure, LED (light emitting diode) signs, channel and SCSI signs, neon signs, advertising towers , lighting advertisement signboard, picture signboard, plastic signboard, wooden signboard, metal (glass) signboard, cine sign, etc. The SCSI signboard is a non-illuminated signboard, and refers to a signboard constructed by cutting an aluminum or acrylic plate sheet or a sheet of aluminum or acrylic plate on a thick rubber plate, or cutting and painting in a character shape. On the other hand, the above 'Skasi' refers to a Japanese word meaning 'cutting out a plate'. In addition, the signboard can be seen in the field of traffic advertising, and there are in-vehicle billboards, out-of-vehicle billboards, and fixed billboards installed in stations.

The purpose of the above-mentioned signboard is to inform the name of the company by writing letters on a wide panel, but it is a bigger purpose to have a means of advertising so that people can remember it, rather than simply announcing the name. For such a signboard, a user can make a signboard directly by using a signboard application of a mobile terminal in recent years and request a quotation for the signboard.

However, there is a problem in that the professionalism of the signboard is deteriorated and a signboard that is not memorable is created when many users who do not have specialized knowledge or technology in the signboard manufacturing industry arbitrarily produce a signboard with a signboard application. In addition, there is a problem in that it is difficult to check whether the sign is suitable for the building before the sign is installed in the actual building.

An embodiment of the present invention provides an apparatus and method for preventing the professionalism of a sign from being deteriorated even if a sign is arbitrarily manufactured using a signboard application.

An embodiment of the present invention provides an apparatus and method for enabling confirmation of whether a signboard is suitable for a building before the signboard is installed in an actual building.

An embodiment of the present invention provides an apparatus and method for easily and arbitrarily producing a signboard using a signboard application.

An apparatus according to an embodiment of the present invention includes: a camera module for capturing a building to which a sign is to be attached; a display in which the building is captured and displayed in real time according to a change in the lens incident angle of the camera module; and a signboard image display control module for controlling to display in real time a signboard image prepared in advance in a predetermined area of the building captured in real time on the display.

A method according to an embodiment of the present invention includes, in a signboard image display control module, generating a predetermined area of a building captured in real time on a display; and displaying a signboard image prepared in advance in the generated predetermined area in real time.

In an embodiment of the present invention, even if a signboard is arbitrarily produced using a signboard application, the professionalism of the signboard is not deteriorated, and a memorable signboard can be produced.

In an embodiment of the present invention, it is possible to check whether the signboard is suitable for the building before the signboard is actually installed in the building by using the signboard application.

An embodiment of the present invention can easily produce a signboard arbitrarily using a signboard application.

1 is a structural diagram of an AR signboard image display system according to an embodiment of the present invention.
2 is a structural diagram of an AR signboard image display device according to an embodiment of the present invention.
3 is a flowchart illustrating an AR signboard image display method according to an embodiment of the present invention.
4 is an AR signage generation according to an embodiment of the present invention; A flowchart showing the method.
5 is an AR signage generation according to another embodiment of the present invention A flowchart showing the method.

Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. However, it is not intended to limit the technology described in the present invention to specific embodiments, and it should be understood that the present invention includes various modifications, equivalents, and/or alternatives of the embodiments of the present invention. . In connection with the description of the drawings, like reference numerals may be used for like components.

In the present invention, expressions such as “have”, “may have”, “include”, or “may include” indicate the presence of a corresponding characteristic (eg, a numerical value, function, operation, or component such as a part). and does not exclude the presence of additional features.

In the present invention, expressions such as “A or B”, “at least one of A or/and B”, or “one or more of A or/and B” may include all possible combinations of the items listed together. . For example, "A or B", "at least one of A and B", or "at least one of A or B" means (1) includes at least one A, (2) includes at least one B; Or (3) it may refer to all cases including both at least one A and at least one B.

Expressions such as "first", "second", "first", or "second" used in the present invention may modify various elements, regardless of order and/or importance, and may modify one element to another. It is used only to distinguish it from the components, and does not limit the components. For example, the first user equipment and the second user equipment may represent different user equipment regardless of order or importance. For example, without departing from the scope of the rights described in the present invention, the first component may be named as the second component, and similarly, the second component may also be renamed as the first component.

A component (eg, a first component) is "coupled with/to (operatively or communicatively)" to another component (eg, a second component) When referring to "connected to", it should be understood that any of the above-described components may be directly connected to the above-described other component or may be connected through another component (eg, a third component). On the other hand, when it is said that a component (eg, a first component) is "directly connected" or "directly connected" to another component (eg, a second component), a component different from a component It may be understood that no other component (eg, a third component) exists between the elements.

The expression "configured to (or configured to)" as used in the present invention, depending on the context, for example, "suitable for", "having the capacity to" It can be used interchangeably with "," "designed to", "adapted to", "made to", or "capable of". The term “configured (or configured to)” may not necessarily mean only “specifically designed to” in hardware. Instead, in some circumstances, the expression “a device configured to” may mean that the device is “capable of” with other devices or parts. For example, the phrase “a processor configured (or configured to perform) A, B, and C” refers to a dedicated processor (eg, an embedded processor) for performing the operations, or by executing one or more software programs stored in a memory device. , may mean a generic-purpose processor (eg, a CPU or an application processor (AP)) capable of performing corresponding operations.

Terms used in the present invention are only used to describe specific embodiments, and may not be intended to limit the scope of other embodiments. The singular expression may include the plural expression unless the context clearly dictates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by one of ordinary skill in the art described in the present invention. Among the terms used in the present invention, terms defined in a general dictionary may be interpreted with the same or similar meaning as the meaning in the context of the related art, and unless explicitly defined in the present invention, ideal or excessively formal meanings is not interpreted as In some cases, even terms defined in the present invention cannot be construed to exclude embodiments of the present invention.

The mobile terminal according to various embodiments of the present invention may be implemented as a device that can access a server or other terminal through a network, for example, a smartphone, a tablet personal computer, or a mobile phone. (mobile phone), videophone, e-book reader, desktop personal computer, laptop personal computer, netbook computer, workstation, server, PDA (personal digital assistant), PMP (portable multimedia player), MP3 player, mobile medical device, camera (camera), or a wearable device (wearable device), etc. include, but are not limited thereto. A mobile terminal is, for example, a wireless communication device that guarantees portability and mobility, and is not only a smart phone, a tablet PC, a wearable device, but also Bluetooth (Bluetooth Low Energy: BLE), NFC, RFID, Ultrasonic, Infrared, and Wi-Fi. (WiFi) and Li-Fi (LiFi) may include various devices equipped with a communication module. In addition, the "network" refers to a connection structure capable of exchanging information between each node, such as terminals and servers, and includes a local area network (LAN), a wide area network (WAN), It includes the Internet (WWW: World Wide Web), a wired/wireless data communication network, a telephone network, a wired/wireless television communication network, and the like. Examples of wireless data communication networks include 3G, 4G, 5G, 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), World Interoperability for Microwave Access (WIMAX), Wi-Fi, Bluetooth communication, infrared communication, and ultrasonic communication. , Visible Light Communication (VLC), LiFi, and the like, but are not limited thereto.

1 is a structural diagram of an AR signboard image display system according to an embodiment of the present invention.

1 , the AR signage image display system according to an embodiment of the present invention may be configured to include a mobile terminal 100 , a building 110 , a server 120 , a signboard manufacturer terminal 120 , and the like.

The building 110 may be equipped with a sign 112 to be manufactured according to an embodiment of the present invention.

The mobile terminal 100 may have an application or program installed for manufacturing the sign 112 . The user may simulate the sign 112 of the building 110 through an application or program installed in the mobile terminal 100 .

The mobile terminal 100 may be configured to generate and store a sample image related to a sign in advance. The sample image may include an image in which various types of signboard shapes are made in advance. As an additional possible embodiment, the mobile terminal 100 may be configured to generate and store a still cut image in advance.

Also, the mobile terminal 100 creates a display area of the building captured by photographing the building 110 . In this case, it goes without saying that the display area may be moved or generated by a user's touch input. Of course, the vertex of the display area may be moved or changed by a user's touch input. The location information of the vertices of the display area may be referred to as edge information.

In addition, the mobile terminal 100 generates an AR signboard by inserting and augmenting the sample image in the generated display area, correcting the generated AR signboard, simulating the corrected AR signboard, and sending the simulated AR signboard to the server ( 120) may be configured to be transmitted. Since the AR signboard according to an embodiment of the present invention increases a three-dimensional effect or a sense of reality, it can help determine the suitability of the signboard before actually installing the signboard. In addition, the user can more effectively determine the suitability of the signboard before installation and can receive help in manufacturing the signboard, and the user's satisfaction after installing the signboard can increase. In addition, it is possible to minimize the conflict between the user (signboard production requester) and the signboard manufacturer.

As an additional possible embodiment, the mobile terminal 100 inserts and augments the still-cut image in the generated display area to generate an AR sign, correct the generated AR sign, simulate the corrected AR sign, and simulate It may be configured to transmit the completed AR signage to the server 120 .

The AR signboard simulation uses the mobile terminal 100 to shoot the building where the signboard is to be installed, and then uses augmented reality to project (project) the AR signboard to the location where the signboard of the photographed building will be installed, thereby simulating the signboard installation. means you can Of course, the AR signboard simulation can also be implemented in the server 120 or the signboard manufacturer terminal 130 .

The server 120 receives the simulated AR signboard from the mobile terminal 100 , and transmits the received AR signboard to the corresponding signboard manufacturer terminal 130 .

The signboard manufacturer terminal 130 may be configured to receive an AR signboard from the server 120 and produce a signboard based on the received AR signboard.

2 is a structural diagram of an AR signboard image display device according to an embodiment of the present invention.

The AR signage image display apparatus according to an embodiment of the present invention may refer to the mobile terminal 100 of FIG. 1 . AR signage image display device according to an embodiment of the present invention includes a signboard image display control module 201, a camera module 203, a communication unit 205, a memory 207, a signboard display area creation module 209, and a signboard image display module 211 , still-cut image generation module 213 , real-time captured image correction module 215 , still-cut image correction module 217 , and the like. Although the input unit is not separately indicated in FIG. 2 , the AR signage image display device according to an embodiment of the present invention may further include an input unit. The input unit may be configured to receive various control commands and information, and may be implemented as, for example, a touch pad. It goes without saying that the input unit and the signboard image display module 211 may be implemented as one module such as a touch screen.

The signage image display control module 201 includes a camera module 203 , a communication unit 205 , a memory 207 , a signage display area generating module 209 , a signage image display module 211 , and a still cut image generating module 213 . ), the real-time captured image correction module 215 , and the still-cut image correction module 217 may be configured to control to perform the operation according to an embodiment of the present invention.

The camera module 203 may be configured to take a picture of a subject. For example, the camera module 203 may capture the building 110 to which the sign 112 is to be attached, and capture the building 110 to generate a building image.

The communication unit 205 may be configured to transmit/receive data to and from other devices through a communication network. The communication network is, for example, 3G (Generation), 4G, 5G, 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), WIMAX (World Interoperability for Microwave Access), Wi-Fi (Wi-Fi), Bluetooth communication, infrared communication, Ultrasonic communication, visible light communication (VLC: Visible Light Communication), LiFi (LiFi), etc. include, but are not limited thereto.

The memory 207 may be configured to store various commands (program codes) necessary for performing the AR signage image display method according to an embodiment of the present invention, various data derived from this process, and the like.

The signboard display area creation module 209 may be configured to generate a display area of the signboard image displayed in real time under the control of the signboard image display control module 201 by touch input. More specifically, the signboard display area generating module 209 may be configured to generate each vertex of the display area by the touch input.

The signboard image display module 211 may be configured to serve as a display for visually outputting various data. That is, the signboard image display module 211 may be configured to capture and display the building in real time according to a change in the lens incidence angle of the camera module 203 .

The signboard image display module 211 may be configured to generate each vertex of the display area by the touch input.

The still cut image generating module 213 generates a still cut image of a building captured in real time and a signboard image displayed in real time on the signboard image display module 211 according to the movement of the camera module 203 . can be configured to A still cut may mean a photo developed by selecting only one cut from a drama, movie, or advertisement film, or may mean a photo taken to promote or commemorate a drama or movie product. The information included in the still cut image according to an embodiment of the present invention includes the resolution information of the still cut, bit rate, frame rate, playback time, title information, content describing the still cut video on the web page, and the like. can be

The real-time captured image correction module 215 is configured to correct each size of a building captured in real time on the signboard image display module 211 and a signboard image displayed in real time on the signboard image display module 211 by touch input. can be configured. As an additional possible embodiment, the real-time captured image correction module 215 may be configured to perform screen correction while moving by a touch input by reflecting environmental factors including day and night, time zone, weather, sunlight, shadow, and the like.

The still-cut image correction module 217 may be configured to correct the size of the corresponding building and signboard images in the generated still-cut image. As an additional possible embodiment, the still-cut image correction module 217 may be configured to perform screen correction by reflecting environmental factors including day and night, time zone, weather, sunlight, shadow, and the like. As an additional possible embodiment, the still-cut image correction module 217 determines the shape of the corresponding building and signboard image on the still-cut image generated by the still-cut image generating module 213 according to the perspective of the camera module 203 . When configured to have a sense of perspective, it may be configured to correct the shape of the signboard image and the building to the front shape.

3 is a flowchart illustrating an AR signboard image display method according to an embodiment of the present invention.

The AR signboard image display device may be configured to generate a sample image for the signboard in advance by the user's request in step 301 . The sample image may include images prepared in advance before manufacturing various types of signboard shapes. The AR signboard image display device may be configured to further generate a signboard image after production of the signboard in addition to the sample image in step 301 .

The AR signage image display device may be configured to drive the signage application at the user's request in step 303 and capture the location of the signage to be attached to the building by photographing the building.

The AR signage image display device may be configured to generate AR signage by inserting and augmenting a pre-prepared sample image in the display area of the building captured in step 305 . In this case, it goes without saying that the display area may be moved or generated by a user's touch input. Of course, the vertex of the display area may be moved or changed by a user's touch input.

AR signage image display device may be configured to correct the AR signage in step 307 . The AR signboard correction process includes a process of correcting each size of a building captured on the display in real time and a signboard image displayed on the display in real time by a touch input, or day and night, time zone, weather, sunlight, shadow, etc. It may include a process of performing screen correction while moving by a touch input by reflecting environmental factors.

The AR signboard correction process, when the shape of the building and the signboard image on the still-cut image generated by the still-cut image generating module 213 is configured to have a perspective according to the perspective of the camera module 203, the signboard image and It may include a process of correcting the shape of the building to the front shape.

The AR signage image display device may simulate the AR signage in step 309 . For this reason, the embodiment of the present invention can check whether the signboard is suitable for the building before the signboard is installed in the actual building by using the signboard application.

AR signage image display device may be configured to transmit the AR signage to the server 120 in step 311 .

4 is an AR signage generation according to an embodiment of the present invention; A flowchart showing the method. That is, FIG. 4 is a flowchart illustrating a method in which step 305 of FIG. 3 is embodied.

The AR signage image display device may be configured to generate a display area of the building captured by the touch input in step 401 .

The AR signage image display device may be configured to change the vertex of the display area by a touch input in step 403 . The modified vertex may be, for example, a rectangle, a square, a circle, a star, and the like.

The AR signage image display apparatus may be configured to insert a sample image prepared in advance in the display area changed by the touch input in step 405 .

5 is an AR signage generation according to another embodiment of the present invention A flowchart showing the method. 5 is a detailed operation of step 305 of FIG. 3, and is a flowchart showing a method different from that of FIG.

The AR signage image display device may be configured to generate a still cut image of a building captured in real time on a display and a signboard image displayed in real time according to the movement of the camera module in step 501 .

The AR signage image display device may be configured to generate a display area of the building captured by the touch input in step 503 .

The AR signage image display device may be configured to change the vertex of the display area by a touch input in step 505 .

The AR signage image display apparatus may be configured to insert a pre-prepared still-cut image in the display area changed by the touch input in step 507 .

Those of ordinary skill in the art to which the present invention pertains to the above-described contents can be modified and modified without departing from the essential characteristics of the present invention. Therefore, the embodiments of the present invention are not intended to limit the technical idea, but to explain, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be construed by the following claims, and all technical ideas within the equivalent range should be construed as being included in the scope of the present invention.

Claims (16)

A camera module for capturing the building to which the signage will be attached;
a display in which the building is captured and displayed in real time according to a change in the lens incident angle of the camera module; and
A signboard image display control module for controlling to display in real time a pre-prepared signboard image in a predetermined area of a building captured in real time on the display;
The sign image is
It is a sample image before the time of production of the signboard or a signboard image after the production of the signboard,
and a signboard display area generating module for generating a display area of the real-time displayed signboard image by touch input; and
The signboard display area creation module,
configured to generate each vertex of the display area by the touch input,
AR signage comprising: a still cut image generating module that generates a still cut image of a building captured in real time on the display and a signboard image displayed in real time according to the movement of the camera module; image display device.
delete delete delete delete The method of claim 1,
Each size of a building captured in real time on the display and a signboard image displayed on the display in real time is corrected while moving by a touch input, or by reflecting environmental factors including day and night, time of day, weather, sunlight, and shadow to touch input. AR signage image display device, characterized in that it is configured to further include a real-time captured image correction module that performs screen correction while moving by.
7. The method of claim 6,
In the still-cut image generated by the still-cut image generating module, the size of the building and signboard image is corrected while moving by touch input, or by reflecting environmental factors including day and night, time zone, weather, sunlight, and shadow by touch input. AR signage image display device, characterized in that it is configured to further include a still-cut image correction module that performs screen correction while moving.
The method of claim 7, wherein the still-cut image correction module,
If the shape of the building and the signboard image on the still-cut image generated by the still-cut image generating module is configured to have a perspective according to the perspective of the camera module, it is configured to correct the shape of the signboard image and the building to the front shape AR signage image display device characterized by.
In the signboard image display control module, the process of generating a predetermined area of the building captured in real time on the display; and
It includes the process of displaying a signboard image prepared in advance in the generated predetermined area in real time,
The sign image is
It is a sample image before the time of production of the signboard or a signboard image after the production of the signboard,
The process of displaying a signboard image prepared in advance in the generated predetermined area in real time,
In the signage display area generating module, the process of generating the display area of the signboard image displayed in real time by touch input,
The process of generating the display area of the signboard image by touch input,
generating each vertex of the display area by the touch input;
The process of displaying a signboard image prepared in advance in the generated predetermined area in real time,
AR signage image, characterized in that in the still cut image generating module, generating a still cut image of a building captured in real time on the display and a signboard image displayed in real time according to the movement of the camera module display method.
delete delete delete delete The method of claim 9, wherein the process of displaying a signboard image prepared in advance in the generated predetermined area in real time comprises:
In the real-time captured image correction module, each size of a building captured in real time on the display and a signboard image displayed in real time on the display is corrected while moving by a touch input, or an environment including day and night, time zone, weather, sunlight, and shadow AR signage image display method, characterized in that it further comprises the process of performing screen correction while moving by touch input by reflecting the element.
15. The method of claim 14, wherein the process of displaying a signboard image prepared in advance in the generated predetermined area in real time,
In the still-cut image correction module, in the generated still-cut image, the size of the corresponding building and signboard image is corrected while moving by touch input, or by reflecting environmental factors including day and night, time zone, weather, sunlight, and shadow to touch input. AR signage image display method, characterized in that it further comprises the process of performing screen correction while moving by.
The method of claim 15, wherein the correction in the still-cut image correction module comprises:
If the shape of the building and the signboard image is configured to have a perspective according to the perspective of the camera module on the still-cut image generated by the still-cut image generating module, the process of correcting the signboard image and the shape of the building to the front shape is further performed AR signage image display method, characterized in that it includes.

Images