KR102603972B1 - Method and device for providing web ar-based business information - Google Patents

Abstract

A method and server for providing WEB AR-based business information are disclosed. According to an embodiment of the present disclosure, a method of providing WEB AR-based business information performed by a server includes identifying information of the first user and information related to the first user from a first terminal device used by the first user. Receiving information related to at least one business user interface (UI); generating a first 3D (dimensional) image based on identification information of the first user and information related to at least one business UI related to the first user; And generating a first quick response (QR) code to which the first 3D image is mapped, and providing the generated first QR code to the first terminal device, comprising the first terminal device. Based on recognition of the first QR code by at least one terminal device, the first 3D image is displayed at a location corresponding to the first QR code in the screen currently being captured by the at least one terminal device, The first 3D image includes a 3D avatar of the first user based on identification information of the first user and at least one UI element that can access at least one business UI related to the first user. can do.

Description

Method and device for providing WEB AR-based business information {METHOD AND DEVICE FOR PROVIDING WEB AR-BASED BUSINESS INFORMATION}

This disclosure relates to augmented reality (AR) technology, and more specifically, to a method and device for providing WEB AR-based business information.

AR is a field of virtual reality (VR) and refers to a computer graphics technique that synthesizes virtual objects or information into an actual environment to make them look like objects that exist in the original environment. In other words, AR refers to a technology that superimposes virtual objects on the real world that the user sees.

Recently, as information and communication technology and artificial intelligence technology have developed exponentially, AR technology has entered a full-fledged commercialization phase, and AR technology is being used not only in the metaverse, a virtual world fused with the real world, games, and education, but also in various fields. It is being grafted on.

Public Patent Publication No. 10-2023-0016266, 2023.02.02

The purpose of this disclosure is to provide a method and device for providing WEB AR-based business information.

Additionally, the purpose of the present disclosure is to provide a method and device for providing virtual objects related to business information in augmented reality through a quick-response (QR) code or the like.

The problems to be solved by the present disclosure are not limited to the problems mentioned above, and other problems not mentioned can be clearly understood by those skilled in the art from the description below.

According to an embodiment of the present disclosure, a method of providing WEB AR-based business information performed by a server includes identifying information of the first user and information related to the first user from a first terminal device used by the first user. Receiving information related to at least one business user interface (UI); generating a first 3D (dimensional) image based on identification information of the first user and information related to at least one business UI related to the first user; And generating a first quick response (QR) code to which the first 3D image is mapped, and providing the generated first QR code to the first terminal device, comprising the first terminal device. Based on recognition of the first QR code by at least one terminal device, the first 3D image is displayed at a location corresponding to the first QR code in the screen currently being captured by the at least one terminal device, The first 3D image includes a 3D avatar of the first user based on identification information of the first user and at least one UI element that can access at least one business UI related to the first user. can do.

And, based on the identification information of the first user including information related to the avatar of the first user, the 3D avatar of the first user is displayed in the first 3D image based on the information related to the avatar of the first user. is included, and based on the identification information of the first user including the photo of the first user and the image of the first user: artificial intelligence that has learned the photo of the first user and the image of the first user in advance The 3D avatar of the first user may be obtained by inputting it into an (artificial intelligence, AI) model, and the 3D avatar of the first user may be included in the first 3D image.

Then, the profile information of the first user included in the identification information is entered into a first template to generate a self-introduction text of the first user, and the self-introduction text of the first user is converted into a text-to-speech (TTS) text. ) A voice corresponding to the self-introduction text is input into the model, and the first 3D image in which the 3D avatar of the first user utters the acquired voice may be generated.

And, the information related to the at least one business UI includes a type of the at least one business UI, an overview of the at least one business UI, address information for accessing the at least one business UI, and the at least one business UI. Each image of at least one UI element that includes a logo image associated with a business UI and is accessible to the at least one business UI associated with the first user is determined based on the logo image associated with the at least one business UI; , Based on the selection of the first UI element among the at least one UI element by the at least one terminal device, the first business UI corresponding to the first UI element will be displayed in a specific area of the first 3D image. You can.

Then, information about the type and outline of the at least one business UI is entered into a second template to generate text describing the information about the type and outline of the at least one business UI, and the generated at least one business UI Text describing information about the type and outline of the UI is input into the TTS model, so that a voice corresponding to the text explaining the information about the type and outline of the at least one business UI is generated, and the at least one business UI When the second UI element corresponding to the second UI is selected, the first 3D image in which the 3D avatar of the first user utters a voice corresponding to the information about the type and outline of the second UI may be generated. there is.

And, based on the second QR code being additionally recognized while the first 3D image is displayed on the screen currently being captured by the at least one terminal device, the second 3D image mapped to the second QR code is The screen that the at least one terminal device is currently capturing is displayed at a location corresponding to the second QR code, and the second 3D image is the second 3D image based on the identification information of the second user associated with the second QR code. At least one UI element accessible to a 3D avatar of a user and at least one business UI associated with the second user, wherein the voices of the 3D avatar of the first user and the 3D avatar of the second user are alternate. can be played.

According to various embodiments of the present disclosure, a method and device for providing WEB AR-based business information can be provided.

Additionally, according to various embodiments of the present disclosure, a method and device for efficiently providing virtual objects related to business information in augmented reality through a QR code or the like can be provided.

The effects of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned may be clearly understood by those skilled in the art from the description below.

1 is a schematic diagram of a system for implementing a method of providing WEB AR-based business information, according to an embodiment of the present disclosure.
Figure 2 is a block diagram briefly illustrating the configuration of a device that provides WEB AR-based business information according to an embodiment of the present disclosure.
Figure 3 is a flowchart for explaining a method of providing WEB AR-based business information according to an embodiment of the present disclosure.
Figure 4 is a diagram for explaining a 3D image including business information according to an embodiment of the present disclosure.

The advantages and features of the present disclosure and methods for achieving them will become clear by referring to the embodiments described in detail below along with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below and may be implemented in various different forms. The present embodiments are merely provided to ensure that the disclosure is complete and to provide a general understanding of the technical field to which the present disclosure pertains. It is provided to fully inform those skilled in the art of the scope of the present disclosure, and the present disclosure is defined only by the scope of the claims.

The terminology used herein is for the purpose of describing embodiments and is not intended to limit the disclosure. As used herein, singular forms also include plural forms, unless specifically stated otherwise in the context. As used in the specification, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other elements in addition to the mentioned elements.

Like reference numerals refer to like elements throughout the specification, and “and/or” includes each and every combination of one or more of the referenced elements. Although “first”, “second”, etc. are used to describe various components, these components are of course not limited by these terms. These terms are merely used to distinguish one component from another. Therefore, it goes without saying that the first component mentioned below may also be the second component within the technical spirit of the present disclosure.

Unless otherwise defined, all terms (including technical and scientific terms) used in this specification may be used with meanings commonly understood by those skilled in the art to which this disclosure pertains. Additionally, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless clearly specifically defined.

Spatially relative terms such as “below”, “beneath”, “lower”, “above”, “upper”, etc. are used as a single term as shown in the drawing. It can be used to easily describe the correlation between a component and other components. Spatially relative terms should be understood as terms that include different directions of components during use or operation in addition to the directions shown in the drawings.

For example, if a component shown in a drawing is flipped over, a component described as “below” or “beneath” another component will be placed “above” the other component. You can. Accordingly, the illustrative term “down” may include both downward and upward directions. Components can also be oriented in other directions, so spatially relative terms can be interpreted according to orientation.

Below, a method and device for providing WEB AR-based business information will be described with reference to the drawings.

FIG. 1 is a diagram briefly illustrating a system 1000 that implements a method of providing WEB AR-based business information according to an embodiment of the present disclosure.

As shown in FIG. 1, the system 1000 implementing a method of providing WEB AR-based business information includes a server 100, a terminal device 200-1 used by a first user, and a terminal used by a second user. It may include a device 200-2.

Figure 1 shows a case where two users (ie, a first user and a second user) use a service that provides WEB AR-based business information controlled/managed by the server 100, but is not limited thereto. Two or more users can receive WEB AR-based business information controlled/managed by the server 100.

Figure 1 shows a case in which terminal devices 200-1 and 200-2 used by each of the first user and the second user are implemented in the form of a single smart phone, but the present invention is not limited thereto.

As described above, the terminal devices 200-1 and 200-2 used by each of the first and second users are various types of electronic devices (e.g., smartphones, desktops, laptops, tablet PCs, server devices, wearable devices). etc.), or it may refer to a group of devices to which one or more types of electronic devices are connected. In addition, the server 100 may also be implemented as a separate type of electronic device or as a device group in which one or more types of electronic devices are connected.

The server 100 included in the system 1000 and the terminal devices 200-1 and 200-2 used by the first and second users, respectively, may perform communication through the network (W).

Here, the network W may include a wired network and a wireless network. For example, the network may include various networks such as a local area network (LAN), a metropolitan area network (MAN), and a wide area network (WAN).

Additionally, the network W may include the known World Wide Web (WWW). However, the network (W) according to an embodiment of the present disclosure is not limited to the networks listed above, and may include at least some of a known wireless data network, a known telephone network, and a known wired and wireless television network.

The server 100 may create an application/web page that implements a method of providing WEB AR-based business information. The terminal devices 200-1 and 200-2 used by each of the first and second users may use an application/web page that implements a method of providing WEB AR-based business information generated by the server 100. .

The server 100 may generate a 3D image corresponding to a quick response (QR) code. The terminal devices 200-1 and 200-2 used by each of the first and second users recognize the QR code, so that the terminal devices 200-1 and 200-2 currently used by each of the first and second users respectively. 3D images can be displayed on the screen being filmed.

The method by which the server 100 provides WEB AR-based business information will be described in detail with reference to FIGS. 3 and 4.

Figure 2 is a block diagram briefly illustrating the configuration of a device that provides WEB AR-based business information according to an embodiment of the present disclosure.

As shown in FIG. 2, the server 100 may include a memory 110, a communication module 120, a display 130, an input module 140, and a processor 150. However, it is not limited to this, and the software and hardware configuration of the server 100 may be modified/added/omitted depending on the required operation within the range obvious to those skilled in the art.

The memory 110 may store data supporting various functions of the device and a program for the operation of the control unit, and may store input/output data (e.g., identification information of the first user, information related to the first user). Information related to at least one business UI, etc.) can be stored, and a plurality of application programs (application programs or applications) running on the device, data for operation of the device, and commands can be stored. At least some of these applications may be downloaded from an external server via wireless communication.

The memory 110 is of a flash memory type, hard disk type, solid state disk type, SDD type (Silicon Disk Drive type), and multimedia card micro type. micro type), card type memory (e.g. SD or XD memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), EEPROM (electrically erasable) It may include at least one type of storage medium among programmable read-only memory (PROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk. Additionally, the memory 110 is separate from the main server 100, but may be a database connected by wire or wirelessly.

The communication module 120 may include one or more components that enable communication with an external device, and may include, for example, at least one of a wireless communication module or a location information module.

Here, the wireless communication module includes, in addition to the Wi-Fi module and WiBro (Wireless broadband) module, GSM (global System for Mobile Communication), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), and UMTS (universal mobile). It may include a wireless communication module that supports various wireless communication methods such as telecommunications system, TDMA (Time Division Multiple Access), LTE (Long Term Evolution), 4G, 5G, and 6G.

The wireless communication module is a wireless communication module including an antenna and a transmitter that transmits various signals (e.g., identification information of the first user, information related to at least one business UI related to the first user, etc.) May contain interfaces. Additionally, the wireless communication module may further include a signal conversion module that modulates a digital control signal output from the control unit through a wireless communication interface into an analog wireless signal under the control of the control unit.

The wireless communication module may include a wireless communication interface including an antenna and a receiver that receives various signals. Additionally, the wireless communication module may further include a signal conversion module for demodulating an analog wireless signal received through a wireless communication interface into a digital control signal.

The display 130 displays (outputs) information processed by the server 100 (eg, a first 3D image, a second 3D image, etc.). For example, the display may display execution screen information of an application (for example, an application) running on this server 100, or UI (User Interface) and GUI (Graphic User Interface) information according to such execution screen information. You can.

The input unit 140 is for inputting image information (or signal), audio information (or signal), data, or information input from a user, and may include a user input unit, etc.

Specifically, the user input unit is for receiving information from the user, and when information is input through the user input unit, the control unit can control the operation of the device to correspond to the input information. This user input unit uses hardware-type physical keys (e.g., buttons, dome switches, jog wheels, jog switches, etc. located on at least one of the front, back, and sides of the device) and software-type touch keys. It can be included.

As an example, the touch key consists of a virtual key, soft key, or visual key displayed on a touch screen-type display unit through software processing, or is displayed on the touch screen. It may be composed of touch keys placed in other parts. Meanwhile, the virtual key or visual key can be displayed on the touch screen in various forms, for example, graphic, text, icon, video or these. It can be made up of a combination of .

The processor 150 includes a memory that stores data for an algorithm for controlling the operation of components in the device or a program that reproduces the algorithm, and at least one processor ( (not shown) may be implemented. At this time, the memory and processor may each be implemented as separate chips. Alternatively, the memory and processor may be implemented as a single chip.

In addition, the processor may control any one or a combination of the above-described components in order to implement various embodiments according to the present disclosure described in FIGS. 3 and 4 below on the device.

Figure 3 is a flowchart for explaining a method of providing WEB AR-based business information according to an embodiment of the present disclosure.

The server may receive identification information of the first user and information related to at least one business user interface (UI) related to the first user from the first terminal device used by the first user (S310).

Here, the identification information of the first user may include various types of information that can identify the first user. For example, the identification information of the first user includes at least one of the first user's profile information (e.g., the first user's name, phone number, email, photo, video, etc.), information related to the first user's 3D avatar, etc. It can be included.

As another example, information related to at least one business UI related to the first user may include the type of at least one business UI related to the first user (e.g., homepage UI managed by the first user, SNS operated by the first user) UI, etc.), an overview of at least one business UI associated with the first user, address information (e.g., uniform resource locator (URL), etc.) for accessing the at least one business UI associated with the first user, and the first user It may include a logo image related to at least one business UI related to the.

The server may generate the first 3D image based on the identification information of the first user and information related to at least one business UI related to the first user (S320).

Here, the first 3D image may include a 3D avatar of the first user based on the identification information of the first user and at least one UI element that can access at least one business UI related to the first user. there is.

As an example, based on the identification information of the first user including information related to the avatar of the first user (e.g., source code for generating the avatar of the first user, actions or dialogue of the avatar of the first user, etc.), The server may generate a 3D avatar of the first user based on information related to the avatar of the first user and include the 3D avatar of the first user in the first 3D image.

Additionally or alternatively, based on the first user's identification information including the first user's photo and the first user's video, the server uses the first user's photo and the first user's video with a pre-trained artificial intelligence (AI) The 3D avatar of the first user can be obtained by inputting it into an artificial intelligence (AI) model, and the 3D avatar of the first user can be included in the first 3D image.

Specifically, the server may extract the area where the first user exists from the first user's video. The server may obtain a 3D avatar of the first user (or/and source code for generating a 3D avatar of the first user, etc.) by inputting information about the extracted area or/and a photo of the first user into the AI model. there is. The server may include the avatar of the first user obtained through the AI model in the 3D image.

If the identification information of the first user includes all information related to the avatar of the first user, a photo of the first user, and an image of the first user, the server identifies one first user through the information related to the avatar of the first user. A first 3D avatar of a user may be created, and a second 3D avatar of the first user may be created based on a photo of a user and an image of the first user.

The device may provide the first 3D avatar and the second 3D avatar of the first user to the terminal device used by the first user.

As an example, the first user may select one of the second 3D avatars among the first 3D avatars. The server may include the 3D avatar selected by the first user in the 3D image.

As another example, the terminal device used by the first user may provide the device with a combination ratio of the first 3D avatar and the second 3D avatar. The server may synthesize the first 3D avatar and the second 3D avatar based on the provided synthesis ratio. For example, if a compositing ratio of 2:1 is received from the terminal device used by the first user, the server may compositing the first 3D avatar and the second 3D avatar at a 2:1 ratio.

As another example, the server may provide a UI capable of combining the components of each of the first 3D avatar and the second 3D avatar to the terminal device used by the first user. The first user can create his or her 3D avatar on the UI.

As an example of the present disclosure, the server may generate a self-introduction text of the first user by inputting the first user's profile information included in the first user's identification information into the first template. The first template may refer to a template that can generate self-introduction text. When profile information is entered into the template, self-introduction text can be created.

The server may input the first user's self-introduction text into a text-to-speech (TTS) model and generate a voice corresponding to the self-introduction text. The server may generate a first 3D image so that the 3D avatar of the first user utters the voice obtained through the TTS model.

As an example of the present disclosure, each image of at least one UI element that can access at least one business UI associated with the first user may be determined based on a logo image associated with the at least one business UI.

Additionally or alternatively, when accessing at least one business UI, the server may obtain various images included in the business UI. The server may determine various acquired images as UI element images corresponding to the corresponding business UI.

As an example of the present disclosure, the server provides a type and outline of at least one business UI (e.g., a company homepage UI operated by the first user, an SNS UI operated by the first user, etc.) and an outline (i.e., at least one business UI). Information about (summary of included information) can be entered into the second template to generate text explaining information about the type and outline of at least one business UI.

The server inputs text describing information about the type and outline of at least one generated business UI into the TTS model to generate a voice corresponding to the text describing information about the type and outline of at least one business UI. You can.

Additionally or alternatively, if no information is received about the outline corresponding to a specific business UI, the server may, after accessing the specific business UI, retrieve at least one content (e.g., text, image, video, etc.) included in the specific business UI. ) can be crawled. The server may obtain summary information about at least one content by inputting at least one crawled content into a separate AI model. The AI may be an artificial intelligence model learned to output summary information of the input content.

The server may utilize summary information about at least one acquired content as an overview of a specific business UI.

The server may generate a first quick response (QR) code to which the first 3D image is mapped, and provide the generated first QR code to the first terminal device (S330). That is, the server can provide a first QR code that can play the first 3D image (that is, can access the first 3D image) to the first terminal device.

The first QR code may be attached to physical data such as the first user's business card and/or report, but is not limited thereto. The first QR code may be displayed on the screen of various websites/applications operated by the first user.

Based on the first QR code being recognized by at least one terminal device including the first terminal device, a first 3D image is displayed at a location corresponding to the first QR code in the screen currently being captured by the at least one terminal device. can be displayed.

Specifically, at least one terminal device including the first terminal device may execute a camera application to recognize the first QR code. When the first QR code is recognized through the camera application, the location corresponding to the first QR code (e.g., the screen currently being captured) displayed on at least one terminal device including the first terminal device. 1 The first 3D image may be displayed in the space surrounding the QR code. That is, the first 3D image may be provided in augmented reality.

As an example of the present disclosure, based on the selection of a first UI element among at least one UI element displayed in the first 3D image by at least one terminal device, a first UI element corresponding to the first UI element is displayed in a specific area of the 3D image. 1 Business UI can be displayed.

As another example of the present disclosure, when a second UI element corresponding to a second UI among at least one business UI is selected, the 3D avatar of the first user utters a voice corresponding to the type and outline information in the second UI. The first 3D image may be played/generated.

As an example of the present disclosure, as shown in FIG. 4, when the first terminal device recognizes the first QR code 10 present on a business card, the first terminal device displays the first 3D image on the screen currently being captured. can be played.

The first user's 3D avatar 20 on the first 3D image may output a pre-generated voice or perform a pre-defined action. Additionally, the first 3D image may include at least one UI element 30-1, 30-2, and 30-3 that can access at least one business UI.

As a further example of the present disclosure, based on the second QR code being additionally recognized while the first 3D image is displayed on the screen currently being captured by at least one terminal device, the second 3D mapped to the second QR code The image may be displayed at a location corresponding to the second QR code (eg, a space around the second QR code).

The second 3D image may include a 3D avatar of the second user based on identification information of the second user associated with the second QR code and at least one UI element accessible to at least one business UI associated with the second user. there is.

At this time, the voices of the first user's 3D avatar and the second user's 3D avatar may be played alternately. The order of voice reproduction of the first user's 3D avatar and the second user's 3D avatar may be determined by at least one terminal device. Additionally or alternatively, one of the first user's 3D avatar and the second user's 3D avatar may be controlled not to utter a voice by at least one terminal device.

Additionally or alternatively, the server may provide the metaverse platform to a terminal device used by at least one user. The metaverse platform may include the first user's 3D avatar and the second user's 3D avatar. When a specific 3D avatar is selected among the first user's 3D avatar and the second user's 3D avatar, the specific 3D avatar and at least one business UI related to the specific 3D avatar may be provided on the metaverse platform.

Meanwhile, the disclosed embodiments may be implemented in the form of a recording medium that stores instructions executable by a computer. Instructions may be stored in the form of program code, and when executed by a processor, may create program modules to perform operations of the disclosed embodiments. The recording medium may be implemented as a computer-readable recording medium.

Computer-readable recording media include all types of recording media storing instructions that can be decoded by a computer. For example, there may be Read Only Memory (ROM), Random Access Memory (RAM), magnetic tape, magnetic disk, flash memory, optical data storage device, etc.

As described above, the disclosed embodiments have been described with reference to the attached drawings. A person skilled in the art to which this disclosure pertains will understand that the present disclosure may be practiced in forms different from the disclosed embodiments without changing the technical idea or essential features of the present disclosure. The disclosed embodiments are illustrative and should not be construed as limiting.

110: memory
120: communication module
130: display
140: input module
150: processor

Claims (6)

In a method of providing WEB AR-based business information performed by a server, the method includes:
Receiving identification information of the first user and information related to at least one business user interface (UI) related to the first user from a first terminal device used by the first user;
generating a first 3D (dimensional) image based on identification information of the first user and information related to at least one business UI related to the first user; and
Generating a first quick response (QR) code to which the first 3D image is mapped, and providing the generated first QR code to the first terminal device,
The first QR code is attached to the first user's business card or report or displayed on a website screen or application screen operated by the first user,
When at least one terminal device recognizes the first QR code on the business card, the report, the website screen operated by the first user, or the application screen through the camera application, the at least one terminal device recognizes the first QR code 1 Display the first 3D image corresponding to the QR code,
The first 3D image includes a 3D avatar of the first user based on identification information of the first user and at least one UI element that can access at least one business UI related to the first user. do,
Based on the fact that the identification information of the first user includes a photo of the first user and an image of the first user, information about the area where the first user exists among the images of the first user and the first user The photo is input into an artificial intelligence (AI) model to create a first 3D avatar of the first user,
Based on the identification information of the first user including the source code for creating the avatar of the first user and the actions and conversations related to the avatar of the first user, the source code for creating the avatar of the first user And a second 3D avatar of the first user is created through actions and conversations related to the avatar of the first user,
A method in which the 3D avatar of the first user is created by compositing the first 3D avatar and the second 3D avatar according to a compositing ratio provided from the first terminal device.
delete According to paragraph 1,
The profile information of the first user included in the identification information is entered into a first template to generate a self-introduction text of the first user,
The first user's self-introduction text is input into a text-to-speech (TTS) model to generate a voice corresponding to the self-introduction text,
A method in which the first 3D image is generated in which the 3D avatar of the first user utters a voice corresponding to the self-introduction text.
According to paragraph 3,
Information related to the at least one business UI includes: a type of the at least one business UI, an overview of the at least one business UI, address information for accessing the at least one business UI, and the at least one business UI. Contains logo images related to,
Each image of at least one UI element accessible to the at least one business UI associated with the first user is determined based on a logo image associated with the at least one business UI,
Based on the selection of a first UI element among the at least one UI element by the at least one terminal device, a first business UI corresponding to the first UI element is displayed in a specific area of the first 3D image, method.
According to clause 4,
Information about the type and outline of the at least one business UI is entered into a second template to generate text describing the information about the type and outline of the at least one business UI,
By inputting text describing information about the type and outline of the generated at least one business UI into the TTS model, a voice corresponding to the text explaining information about the type and outline of the at least one business UI is generated, ,
When a second UI element corresponding to a second UI among the at least one business UI is selected, the 3D avatar of the first user utters a voice corresponding to information about the type and outline of the second UI. How 3D images are generated.
delete