KR101870407B1 - Augmented reality providing system using social network service - Google Patents

Augmented reality providing system using social network service Download PDF

Info

Publication number
KR101870407B1
KR101870407B1 KR1020160077122A KR20160077122A KR101870407B1 KR 101870407 B1 KR101870407 B1 KR 101870407B1 KR 1020160077122 A KR1020160077122 A KR 1020160077122A KR 20160077122 A KR20160077122 A KR 20160077122A KR 101870407 B1 KR101870407 B1 KR 101870407B1
Authority
KR
South Korea
Prior art keywords
augmented reality
keyword
object
module
data
Prior art date
Application number
KR1020160077122A
Other languages
Korean (ko)
Other versions
KR20180000016A (en
Inventor
송지성
박수조
방용호
정상범
황유비
윤현하
Original Assignee
한양대학교 에리카산학협력단
송지성
박수조
방용호
정상범
황유비
윤현하
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한양대학교 에리카산학협력단, 송지성, 박수조, 방용호, 정상범, 황유비, 윤현하 filed Critical 한양대학교 에리카산학협력단
Priority to KR1020160077122A priority Critical patent/KR101870407B1/en
Publication of KR20180000016A publication Critical patent/KR20180000016A/en
Application granted granted Critical
Publication of KR101870407B1 publication Critical patent/KR101870407B1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06QDATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/01Social networking
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/275Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
    • H04N13/279Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals the virtual viewpoint locations being selected by the viewers or determined by tracking
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/0179Display position adjusting means not related to the information to be displayed
    • G02B2027/0187Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye

Abstract

The present invention provides an augmented reality providing system using a social network service.
According to an aspect of the present invention, an augmented reality providing system using a social network service includes a data collection unit for selecting a preferred keyword from data of a user's social network service (SNS), an augmented reality object having data the same as or similar to the preference keyword And an output control unit for inserting the augmented reality data related to the preferred KID word into an object displayed on the screen of the augmented reality device and outputting the augmented reality data.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to augmented reality providing system using a social network service,

The present invention relates to an augmented reality providing system, and more particularly, to a augmented reality providing system using a social network service.

Augmented Reality is a technique for superimposing virtual objects on the real world seen by the user. It is called Mixed Reality (MR) because it combines real world and virtual world with additional information in real time and displays it as one image.

Augmented reality, a concept that complements the real world with a virtual world, uses a virtual environment created by computer graphics, but the protagonist is a real environment. Computer graphics serve to provide additional information needed for the real world.

Unlike the virtual reality technology, which consists of a virtual environment only, the augmented reality technology provides a mixed reality environment and a virtual object so that the user can see the real environment and provide better reality and additional information.

Augmented reality technology is used for remote medical diagnosis, broadcasting, architectural design, manufacturing process management. In particular, smartphones have become popular in the commercialization stage in recent years, and various products are being developed in the game and mobile solution industry and education field.

In addition, it provides various kinds of augmented reality while moving using smart glass, but when a large amount of augmented reality is present, it is provided even to an unwanted augmented reality, which makes it difficult to easily find a desired augmented reality.
[Prior Art Literature]
Published Japanese Patent Application No. 10-2012-0134321 (December 12, 2012)

The present invention provides an augmented reality providing system using a social network service.

According to an aspect of the present invention, an augmented reality providing system using a social network service includes a data collection unit for selecting a preferred keyword from data of a user's social network service (SNS), an augmented reality object having data the same as or similar to the preference keyword And an output control unit for inserting the augmented reality data related to the preferred KID word into an object displayed on the screen of the augmented reality device and outputting the augmented reality data.

Here, the data collector may include an SNS keyword extraction module that extracts a preference keyword from the user's social network service and measures a used frequency.

The data collecting unit may include a voice keyword extracting module for extracting a preferred keyword from the voice call of the user and measuring the used frequency.

The data collecting unit may include a character keyword extracting module for extracting a preferred keyword from the user's text message and measuring the used frequency.

The data collection unit may include an identical keyword extraction module for extracting frequently used preference keywords and a similar keyword extraction module for extracting keywords derived from the preference keywords.

The object search unit may include a server search module for searching for augmented reality objects having data that is the same as or similar to the preference keyword in the augmented reality server storing the augmented reality data.

The object search unit may further include an object recognition module for recognizing objects displayed on a screen of the augmented reality.

The object search unit may include a screen search module for extracting an object having augmented reality data related to a preference keyword from an object recognized by the object recognition module.

The data collecting unit may include a rating setting module for setting a rating of the keyword as the main keyword and the auxiliary keyword according to the occurrence frequency of the keyword.

In addition, the object search unit may include a GPS search module for preferentially searching an object related to a preference keyword from a location of a user.

The output control unit may include an image loading module for inserting and loading an image on the augmented reality screen.

The output control unit may include a character loading module for inserting characters into the augmented reality screen and loading the characters.

The output control unit may include a sound loading module for inserting and loading sounds into the augmented reality screen.

The output control unit may include a content display module for inserting and loading the social network content inputted by the user into the augmented reality screen.

The output control unit may include a rating display module for displaying the contents of the augmented reality in different colors according to the keyword rating.

The output control unit may include a selection display module for loading only augmented reality data related to a preference keyword when a plurality of augmented reality data exists in one object.

In addition, the augmented reality system may further include a storage unit for storing the preference keywords collected by the data collection unit.

In addition, the augmented reality providing system may further include a mode control unit for preferentially loading the augmented reality data related to the keyword designated by the user among the afore-mentioned preferred keywords.

As described above, according to the present invention, the augmented reality is provided using the information acquired in the social network service, so that the user can preferentially provide the desired information.

1 is a schematic view for explaining an augmented reality providing system using a social network service according to a first embodiment of the present invention.
2 is a block diagram illustrating an augmented reality providing system using a social network service according to a first embodiment of the present invention.
3 is a flowchart illustrating a method of providing an augmented reality using a social network service according to a first embodiment of the present invention.
4 is a view illustrating an augmented reality realized by the augmented reality providing system using the social network service according to the first embodiment of the present invention.
5 is a block diagram illustrating an augmented reality providing system using a social network service according to a second embodiment of the present invention.
6 is a flowchart illustrating a method of providing an augmented reality using a social network service according to a second embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention can be variously modified and may have various embodiments, and specific embodiments will be described in detail with reference to the drawings. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

Hereinafter, an augmented reality providing system using a social network service according to a first embodiment of the present invention will be described with reference to FIG. 1 and FIG.

FIG. 1 is a schematic view for explaining an augmented reality providing system using a social network service according to a first embodiment of the present invention, and FIG. 2 is a schematic diagram showing an augmented reality providing system using a social network service according to a first embodiment of the present invention Fig.

1 and 2, the augmented reality providing system 101 according to the first embodiment includes a data collecting unit 10, an object searching unit 20, an output controlling unit 30, a storage unit 40 ).

The augmented reality system 101 according to the first embodiment provides an augmented reality through a smart glass 80 or a VR display and uses a smart device 70 such as a smart phone or a tablet PC and a smart glass 80 Thereby collecting data and providing an augmented reality.

The data collection unit 10 selects a preferred keyword based on data used in a user's social network service (SNS), call, text message, and the like. The data collecting unit 10 extracts frequently used keywords for a preset period of time when the user uses the smart device 70. [ The data collecting unit 10 also updates the collected data with the latest keywords.

The data collecting unit 10 includes an SNS keyword extracting module 11, a voice keyword extracting module 12, a character keyword extracting module 13, a similar keyword extracting module 14, and a rating setting module 15.

The SNS keyword extraction module 11 extracts a preferred keyword from the user's social network service and measures the used frequency. For example, the SNS keyword extraction module 11 may select a word that is used more than ten times in the social network service as a preferred keyword.

The SNS keyword extraction module 11 can extract words when the user inputs contents into the social network service and can extract words from the data registered in the social network service by accessing the user account of the social network service.

The voice keyword extracting module 12 extracts a preferred keyword from the user's voice call and measures the used frequency. The voice keyword extraction module 12 collects words in a voice call using the smart device 70 and extracts a preferred keyword based on the used frequency. For example, the voice keyword extracting module 12 may select a word that is used more than ten times in a voice call as a preferred keyword.

The character keyword extracting module 13 extracts a preferred keyword from the text message transmitted by the user and measures the used frequency. The character keyword extraction module 13 collects words in the text message transmission of the smart device and extracts a preferred keyword based on the used frequency. For example, the character keyword extraction module 13 may select a word that is used more than 10 times in a text message as a preferred keyword.

The similar keyword extraction module 14 extracts a similar keyword derived from the preferred keyword. The similar keyword derived from the preference keyword includes a lower concept keyword of the preference keyword and a keyword having a similar meaning to the preference keyword. For example, when the preferred keyword is a travel, the traffic, accommodation, schedule, and restaurant related to the travel can be extracted as similar keywords.

The class setting module 15 sets the class of the keyword as the main keyword and the secondary keyword according to the appearance frequency of the keyword. For example, the rating setting module 15 may select keywords that are mentioned 20 or more times in the SNS, voice call, and text message as the main keywords and 10 or more keywords as the secondary keywords.

The object search unit 20 searches for an augmented reality object having the same or similar data as the preference keyword. The augmented reality object is connected to a mark, and the augmented reality image or text is connected to the mark and displayed. The object search unit 20 searches for objects having the same or similar augmented reality data as the preference data on the augmented reality server 90 or the photographed screen.

The object search unit 20 includes a server search module 21, an object recognition module 22, a screen search module 23, and a GPS search module 24. The server search module 21 searches for the augmented reality object having the same or similar data as the preference keyword in the augmented reality server 90 in which the augmented reality data is stored.

The object recognition module 22 recognizes the objects displayed on the screen of the augmented reality, and can recognize the objects using the markers coupled to the objects displayed on the augmented reality screen. The screen search module 23 extracts an object having augmented reality data related to the preference keyword from the object recognized by the object recognition module 22. [

The GPS search module 24 preferentially searches for an object associated with the preference keyword from the user's location. If the object related to the preferred keyword does not appear on the augmented reality screen, the user may desire to search for the object even if it is not displayed on the augmented reality screen. Therefore, the GPS search module 24 searches for an object related to the preference keyword can do.

The output controller 30 inserts the augmented reality data related to the preferred KID word into the object displayed on the screen of the augmented reality device and outputs the augmented reality data. Here, the augmented reality device may be a smart glass, a VR display, or the like.

The output control unit 30 includes an image loading module 31, a character loading module 32, a sound loading module 33, a content display module 34, a rating display module 35 and a selection display module 36 .

The image loading module 31 inserts and loads an image on the augmented reality screen. The image loading module 31 may insert a favorite keyword related image into the augmented reality screen to inform the user of a preferred object.

The character loading module 32 inserts and loads characters on the augmented reality screen. The character loading module 32 may insert a character associated with a preference keyword on the augmented reality screen to inform the user of a preferred object.

The sound loading module 33 inserts sound into the augmented reality screen and loads the sound. The sound loading module 33 may inform the augmented reality screen that there is an object related to the preferred keyword on the augmented reality screen.

The content display module 34 inserts and loads the social network content input by the user into the augmented reality screen. The content display module 34 may insert all or a part of the content input by the user into the social network service on the augmented reality screen so that the user can instantly recognize the preferred object.

The rating display module 35 displays the contents of the augmented reality in different colors according to the keyword rank. The rating display module 35 displays the contents of the augmented reality in different colors so that a high-grade preferred keyword can be preferentially displayed.

If there are a plurality of augmented reality data in one object, the selection display module 36 loads only the augmented reality data related to the preference keyword. When there are a plurality of shops in one building and a plurality of augmented reality data exists, the selection display module loads only the augmented reality data related to the preference preference keyword so that the user can clearly recognize

The storage unit 40 stores the preference keywords collected by the data collection unit 10 in a storage medium of a server or a smart device.

As shown in FIG. 4, the augmented reality providing system 101 according to the first embodiment preferentially loads the augmented reality data associated with a preference keyword when various augmented reality data exists on one screen, You can remove it and give it to users first.

Hereinafter, a method for providing an augmented reality using a social network service according to a first embodiment of the present invention will be described. 3 is a flowchart illustrating a method of providing an augmented reality using a social network service according to a first embodiment of the present invention.

1 to 3, the method of providing an augmented reality according to the first embodiment includes a keyword collection step S101, a storage step S102, an object search step S103, and an output control step S104 .

The keyword collection step (S101) selects a preferred keyword based on data used in a user's social network service (SNS), call, text message, and the like. The keyword collection step (S101) extracts frequently used keywords during a predetermined period when the user uses the smart device (70). Also, the keyword collection step (S101) updates the collected data with the latest keyword.

The keyword collection step S101 includes an SNS keyword extraction step, a voice keyword extraction step, a character keyword extraction step, a similar keyword extraction step, and a rating setting step.

The SNS keyword extraction step extracts a preferred keyword from the user's social network service and measures the used frequency. For example, in the SNS keyword extraction step, a keyword that is used more than 10 times in the social network service can be selected as a preferred keyword.

The SNS keyword extraction step can extract words when the user inputs contents into the social network service, and can extract words from the data registered in the social network service by accessing the user account of the social network service.

The voice keyword extracting step extracts a preferred keyword from the user's voice call and measures the used frequency. The voice keyword extraction collects words in a voice call using the smart device 70 and extracts a preferred keyword based on the used frequency. For example, in the voice keyword extracting step, a word used more than 10 times in a voice call can be selected as a preferred keyword.

In the character keyword extraction step, a preferred keyword is extracted from a text message transmitted by the user and the used frequency is measured. In the character keyword extraction step, the words are collected in the text message transmission of the smart device and the preferred keywords are extracted based on the used frequency. For example, in the character keyword extracting step 13, a word used more than ten times in a text message may be selected as a preferred keyword.

The similar keyword extraction step extracts a similar keyword derived from the preferred keyword. The similar keyword derived from the preference keyword includes a lower concept keyword of the preference keyword and a keyword having a similar meaning to the preference keyword. For example, when the preferred keyword is a travel, the traffic, accommodation, schedule, and restaurant related to the travel can be extracted as similar keywords.

In the rating step, the keyword is classified into the main keyword and the secondary keyword according to the appearance frequency of the keyword. For example, in the grading step, the keywords mentioned above in the SNS, voice call, and text message may be selected as the main keywords, and the keywords mentioned in the 10 or more times may be selected as the secondary keywords.

In the storing step (S102), the preference keyword collected by the data collecting unit 10 is stored in a storage medium of the server or the smart device.

The object searching step (S103) searches for an augmented reality object having the same or similar data as the preference keyword. The augmented reality object is connected to a mark, and the augmented reality image or text is connected to the mark and displayed. The object searching step S103 searches for objects having the same or similar augmented reality data as the preference data on the augmented reality server 90 or the photographed screen.

The object search step S103 includes a server search step, an object recognition step, a screen search step, and a GPS search step. The server searching step searches for augmented reality objects having the same or similar data as the preference keywords in the augmented reality server 90 in which the augmented reality data is stored.

The object recognition step recognizes the objects displayed on the augmented reality screen, and recognizes the objects using the markers coupled to the objects displayed on the augmented reality screen. The screen searching step extracts an object having augmented reality data related to a preference keyword from the object recognized by the object recognition step.

The GPS search step preferentially searches for an object associated with the preferred keyword from the user's location. If the object related to the preferred keyword does not appear on the augmented reality screen, the user may want to search for the object even if it is not displayed on the augmented reality screen. Therefore, the GPS search step can search for and provide an object related to the preference keyword .

The output control step (S104) inserts the augmented reality data related to the preferred KID word into an object displayed on the screen of the augmented reality device and outputs the augmented reality data. Here, the augmented reality device may be a smart glass, a VR display, or the like.

The output control step S104 includes an image loading step, a character loading step, a sound loading step, a content display step, a rating display step, and a selective display step.

The image loading step inserts an image on the augmented reality screen and loads the image. The image loading step may inform the user of a preferred object by inserting an image related to the preferred keyword on the augmented reality screen.

In the character loading step, characters are inserted and loaded on the augmented reality screen. In the character loading step, the user may be informed of the preferred object by inserting characters related to the preferred keyword on the augmented reality screen.

The sound loading step inserts the sound into the augmented reality screen and loads it. The sound loading step may inform the augmented reality screen that there is an object related to the preferred keyword on the augmented reality screen.

The contents display step inserts and loads the social network contents inputted by the user into the augmented reality screen. In the content display step, all or a part of the content input by the user into the social network service may be inserted into the augmented reality screen so that the user can instantly recognize a preferred object.

The grading step displays the augmented reality contents in different colors according to the keyword rank. The grading step displays the contents of the augmented reality in different colors so that a high-grade preferred keyword is preferentially displayed.

In the selection display step, when a plurality of augmented reality data exists in one object, only the augmented reality data related to the preference keyword is loaded. When there are a plurality of stores in one building and a plurality of augmented reality data exists, the selective display step loads only the augmented reality data related to the preference preference keyword so that the user can clearly recognize

Hereinafter, an augmented reality providing system using a social network service according to a second embodiment of the present invention will be described. 5 is a block diagram illustrating an augmented reality providing system using a social network service according to a second embodiment of the present invention.

5, the augmented reality providing system 102 according to the second embodiment includes a data collection unit 10, an object search unit 20, an output control unit 30, a storage unit 40, a mode And a control unit 50.

The augmented reality system 102 according to the second embodiment provides an augmented reality through a smart glass 80 or a VR display and uses a smart device 70 such as a smart phone or a tablet PC and a smart glass 80 Thereby collecting data and providing an augmented reality.

The data collection unit 10 selects a preferred keyword based on data used in a user's social network service (SNS), call, text message, and the like. The data collecting unit 10 extracts frequently used keywords for a preset period of time when the user uses the smart device 70. [ The data collecting unit 10 also updates the collected data with the latest keywords.

The data collecting unit 10 includes an SNS keyword extracting module 11, a voice keyword extracting module 12, a character keyword extracting module 13, a similar keyword extracting module 14, and a rating setting module 15.

The SNS keyword extraction module 11 extracts a preferred keyword from the user's social network service and measures the used frequency. For example, the SNS keyword extraction module 11 may select a word that is used more than ten times in the social network service as a preferred keyword.

The SNS keyword extraction module 11 can extract words when the user inputs contents into the social network service and can extract words from the data registered in the social network service by accessing the user account of the social network service.

The voice keyword extracting module 12 extracts a preferred keyword from the user's voice call and measures the used frequency. The voice keyword extraction module 12 collects words in a voice call using the smart device 70 and extracts a preferred keyword based on the used frequency. For example, the voice keyword extracting module 12 may select a word that is used more than ten times in a voice call as a preferred keyword.

The character keyword extracting module 13 extracts a preferred keyword from the text message transmitted by the user and measures the used frequency. The character keyword extraction module 13 collects words in the text message transmission of the smart device and extracts a preferred keyword based on the used frequency. For example, the character keyword extraction module 13 may select a word that is used more than 10 times in a text message as a preferred keyword.

The similar keyword extraction module 14 extracts a similar keyword derived from the preferred keyword. The similar keyword derived from the preference keyword includes a lower concept keyword of the preference keyword and a keyword having a similar meaning to the preference keyword. For example, when the preferred keyword is a travel, the traffic, accommodation, schedule, and restaurant related to the travel can be extracted as similar keywords.

The class setting module 15 sets the class of the keyword as the main keyword and the secondary keyword according to the appearance frequency of the keyword. For example, the rating setting module 15 may select keywords that are mentioned 20 or more times in the SNS, voice call, and text message as the main keywords and 10 or more keywords as the secondary keywords.

The object search unit 20 searches for an augmented reality object having the same or similar data as the preference keyword. The augmented reality object is connected to a mark, and the augmented reality image or text is connected to the mark and displayed. The object search unit 20 searches for objects having the same or similar augmented reality data as the preference data on the augmented reality server 90 or the photographed screen.

The object search unit 20 includes a server search module 21, an object recognition module 22, a screen search module 23, and a GPS search module 24. The server search module 21 searches for the augmented reality object having the same or similar data as the preference keyword in the augmented reality server 90 in which the augmented reality data is stored.

The object recognition module 22 recognizes the objects displayed on the screen of the augmented reality, and can recognize the objects using the markers coupled to the objects displayed on the augmented reality screen. The screen search module 23 extracts an object having augmented reality data related to the preference keyword from the object recognized by the object recognition module 22. [

The GPS search module 24 preferentially searches for an object associated with the preference keyword from the user's location. If the object related to the preferred keyword does not appear on the augmented reality screen, the user may desire to search for the object even if it is not displayed on the augmented reality screen. Therefore, the GPS search module 24 searches for an object related to the preference keyword can do.

The output controller 30 inserts the augmented reality data related to the preferred KID word into the object displayed on the screen of the augmented reality device and outputs the augmented reality data. Here, the augmented reality device may be a smart glass, a VR display, or the like.

The output control unit 30 includes an image loading module 31, a character loading module 32, a sound loading module 33, a content display module 34, a rating display module 35 and a selection display module 36 .

The image loading module 31 inserts and loads an image on the augmented reality screen. The image loading module 31 may insert a favorite keyword related image into the augmented reality screen to inform the user of a preferred object.

The character loading module 32 inserts and loads characters on the augmented reality screen. The character loading module 32 may insert a character associated with a preference keyword on the augmented reality screen to inform the user of a preferred object.

The sound loading module 33 inserts sound into the augmented reality screen and loads the sound. The sound loading module 33 may inform the augmented reality screen that there is an object related to the preferred keyword on the augmented reality screen.

The content display module 34 inserts and loads the social network content input by the user into the augmented reality screen. The content display module 34 may insert all or a part of the content input by the user into the social network service on the augmented reality screen so that the user can instantly recognize the preferred object.

The rating display module 35 displays the contents of the augmented reality in different colors according to the keyword rank. The rating display module 35 displays the contents of the augmented reality in different colors so that a high-grade preferred keyword can be preferentially displayed.

If there are a plurality of augmented reality data in one object, the selection display module 36 loads only the augmented reality data related to the preference keyword. When there are a plurality of shops in one building and a plurality of augmented reality data exists, the selection display module loads only the augmented reality data related to the preference preference keyword so that the user can clearly recognize

The storage unit 40 stores the preference keywords collected by the data collection unit 10 in a storage medium of a server or a smart device.

The mode control unit 50 preferentially loads the augmented reality data related to the preference keyword designated by the user among the preference keywords. Also, the mode control unit 50 may extract preference keywords included in the category of the keyword specified by the user and preferentially load the augmented reality data related to the extracted keywords.

The user can designate the preferred keyword through voice or touch input, and the mode control unit 50 preferentially loads the augmented reality data related to the user-designated preference keyword.

For example, when the user urgently searches for a foreign exchange place while traveling, if the user designates a foreign exchange place as a preferred keyword, the data on the foreign exchange place is preferentially loaded on the augmented reality screen.

Hereinafter, a method for providing an augmented reality using a social network service according to a second embodiment of the present invention will be described. 6 is a flowchart illustrating a method of providing an augmented reality using a social network service according to a second embodiment of the present invention.

5 and 6, the method for providing an augmented reality according to the second embodiment includes a keyword collection step S201, a storage step S202, a mode control step S203, an object search step S204, And an output control step (S205).

The keyword collection step (S201) selects a preferred keyword based on data used in a user's social network service (SNS), call, text message, and the like. The keyword collection step (S201) extracts frequently used keywords during a predetermined period when the user uses the smart device (70). Also, the keyword collection step (S201) updates the collected data with the latest keyword.

The keyword collection step S201 includes an SNS keyword extraction step, a voice keyword extraction step, a character keyword extraction step, a similar keyword extraction step, and a rating setting step.

The SNS keyword extraction step extracts a preferred keyword from the user's social network service and measures the used frequency. For example, in the SNS keyword extraction step, a keyword that is used more than 10 times in the social network service can be selected as a preferred keyword.

The SNS keyword extraction step can extract words when the user inputs contents into the social network service, and can extract words from the data registered in the social network service by accessing the user account of the social network service.

The voice keyword extracting step extracts a preferred keyword from the user's voice call and measures the used frequency. The voice keyword extraction collects words in a voice call using the smart device 70 and extracts a preferred keyword based on the used frequency. For example, in the voice keyword extracting step, a word used more than 10 times in a voice call can be selected as a preferred keyword.

In the character keyword extraction step, a preferred keyword is extracted from a text message transmitted by the user and the used frequency is measured. In the character keyword extraction step, the words are collected in the text message transmission of the smart device and the preferred keywords are extracted based on the used frequency. For example, in the character keyword extracting step 13, a word used more than ten times in a text message may be selected as a preferred keyword.

The similar keyword extraction step extracts a similar keyword derived from the preferred keyword. The similar keyword derived from the preference keyword includes a lower concept keyword of the preference keyword and a keyword having a similar meaning to the preference keyword. For example, when the preferred keyword is a travel, the traffic, accommodation, schedule, and restaurant related to the travel can be extracted as similar keywords.

In the rating step, the keyword is classified into the main keyword and the secondary keyword according to the appearance frequency of the keyword. For example, in the grading step, the keywords mentioned above in the SNS, voice call, and text message may be selected as the main keywords, and the keywords mentioned in the 10 or more times may be selected as the secondary keywords.

In the storing step S202, the preference keyword collected by the data collecting unit 10 is stored in the storage medium of the server or the smart device.

The mode control step (S203) preferentially loads the augmented reality data related to the user's preferred keyword among the favorite keywords. In addition, the mode control step (S203) may extract preference keywords included in the category of the keyword designated by the user and preferentially load the augmented reality data related to the extracted keywords.

The user can designate a preferred keyword through voice or touch input, and the mode control step (S203) preferentially loads the augmented reality data related to the user-designated preference keyword.

For example, when the user urgently searches for a foreign exchange place while traveling, if the user designates a foreign exchange place as a preferred keyword, the data on the foreign exchange place is preferentially loaded on the augmented reality screen.

The object searching step (S204) searches for an augmented reality object having the same or similar data as the preference keyword. The augmented reality object is connected to a mark, and the augmented reality image or text is connected to the mark and displayed. The object searching step S204 searches for objects having the same or similar augmented reality data as the preference data on the augmented reality server 90 or the photographed screen.

The object searching step (S204) includes a server searching step, an object recognizing step, a screen searching step, and a GPS searching step. The server searching step searches for augmented reality objects having the same or similar data as the preference keywords in the augmented reality server 90 in which the augmented reality data is stored.

The object recognition step recognizes the objects displayed on the augmented reality screen, and recognizes the objects using the markers coupled to the objects displayed on the augmented reality screen. The screen searching step extracts an object having augmented reality data related to a preference keyword from the object recognized by the object recognition step.

The GPS search step preferentially searches for an object associated with the preferred keyword from the user's location. If the object related to the preferred keyword does not appear on the augmented reality screen, the user may want to search for the object even if it is not displayed on the augmented reality screen. Therefore, the GPS search step can search for and provide an object related to the preference keyword .

The output control step (S205) inserts the augmented reality data related to the preferred KID word into an object displayed on the screen of the augmented reality device and outputs the augmented reality data. Here, the augmented reality device may be a smart glass, a VR display, or the like.

The output control step S205 includes an image loading step, a character loading step, a sound loading step, a content display step, a rating display step, and a selective display step.

The image loading step inserts an image on the augmented reality screen and loads the image. The image loading step may inform the user of a preferred object by inserting an image related to the preferred keyword on the augmented reality screen.

In the character loading step, characters are inserted and loaded on the augmented reality screen. In the character loading step, the user may be informed of the preferred object by inserting characters related to the preferred keyword on the augmented reality screen.

The sound loading step inserts the sound into the augmented reality screen and loads it. The sound loading step may inform the augmented reality screen that there is an object related to the preferred keyword on the augmented reality screen.

The contents display step inserts and loads the social network contents inputted by the user into the augmented reality screen. In the content display step, all or a part of the content input by the user into the social network service may be inserted into the augmented reality screen so that the user can instantly recognize a preferred object.

The grading step displays the augmented reality contents in different colors according to the keyword rank. The grading step displays the contents of the augmented reality in different colors so that a high-grade preferred keyword is preferentially displayed.

In the selection display step, when a plurality of augmented reality data exists in one object, only the augmented reality data related to the preference keyword is loaded. When there are a plurality of stores in one building and a plurality of augmented reality data exists, the selective display step loads only the augmented reality data related to the preference preference keyword so that the user can clearly recognize

As described above, preferred embodiments of the present invention have been disclosed in the present specification and drawings, and although specific terms have been used, they have been used only in a general sense to easily describe the technical contents of the present invention and to facilitate understanding of the invention , And are not intended to limit the scope of the present invention. It is to be understood by those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

101, 102: Augmented reality providing system
10: Data collecting unit
11: SNS keyword extraction module
12: Speech Keyword Extraction Module
13: Character Keyword Extraction Module
14: Keyword Extraction Module
15: Rating module
20: Object search section
21: Server Search Module
22: Object recognition module
23: Screen search module
24: GPS search module
30:
31: Image loading module
32: Character loading module
33: Sound loading module
34: Content display module
35: Rating display module
36: Selection display module
40:
50:

Claims (18)

  1. A data collection unit for selecting a preferred keyword from data of a user's social network service (SNS); An object search unit for searching an augmented reality object having the same or similar data as the preference keyword; And an output control unit for inserting the augmented reality data related to the preference keyword into an object displayed on the screen of the augmented reality device and outputting the augmented reality data,
    The data collection unit includes an SNS keyword extraction module for extracting a preference keyword from a user's social network service and measuring a used frequency, a character keyword extraction module for extracting a preference keyword from a user's text message and measuring a used frequency, The collecting unit includes a voice keyword extracting module for extracting a preferred keyword from the voice call of the user and measuring the used frequency,
    Wherein the output control unit includes a selection display module for loading only the augmented reality data related to the preference keyword when a plurality of augmented reality data exists in one object.
  2. delete
  3. delete
  4. delete
  5. The method according to claim 1,
    Wherein the data collection unit includes an identical keyword extraction module for extracting frequently used preference keywords and a similar keyword extraction module for extracting keywords derived from the preference keywords.
  6. The method according to claim 1,
    Wherein the object searching unit includes a server search module for searching an augmented reality object having data the same as or similar to a preference keyword in an augmented reality server storing augmented reality data.
  7. The method according to claim 1,
    Wherein the object searching unit further includes an object recognizing module for recognizing objects displayed on a screen of the augmented reality.
  8. 8. The method of claim 7,
    Wherein the object searching unit includes a screen search module for extracting an object having augmented reality data related to a preference keyword from an object recognized by the object recognition module.
  9. The method according to claim 1,
    Wherein the data collecting unit includes a rating setting module for setting a rating of a keyword as a main keyword and a supplementary keyword according to the appearance frequency of the keyword.
  10. 10. The method of claim 9,
    Wherein the object search unit includes a GPS search module for preferentially searching for an object related to a preference keyword from a location of a user.
  11. 11. The method of claim 10,
    Wherein the output control unit includes an image loading module for inserting and loading an image on an augmented reality screen.
  12. 12. The method of claim 11,
    Wherein the output control unit includes a character loading module for inserting and loading characters on the augmented reality screen.
  13. 13. The method of claim 12,
    Wherein the output control unit includes a sound loading module for inserting and loading sound into the augmented reality screen.
  14. 14. The method of claim 13,
    Wherein the output control unit includes a content display module for inserting and loading a social network content inputted by the user into the augmented reality screen.
  15. 15. The method of claim 14,
    Wherein the output control unit includes a rating display module for displaying the contents of the augmented reality in different colors according to the keyword rating.
  16. delete
  17. The method according to claim 1,
    Wherein the augmented reality system further comprises a storage unit for storing the preference keywords collected by the data collection unit.
  18. The method according to claim 1,
    And a mode controller for preferentially loading the augmented reality data related to the keyword designated by the user among the afore-mentioned preferred keywords.
KR1020160077122A 2016-06-21 2016-06-21 Augmented reality providing system using social network service KR101870407B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020160077122A KR101870407B1 (en) 2016-06-21 2016-06-21 Augmented reality providing system using social network service

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020160077122A KR101870407B1 (en) 2016-06-21 2016-06-21 Augmented reality providing system using social network service

Publications (2)

Publication Number Publication Date
KR20180000016A KR20180000016A (en) 2018-01-02
KR101870407B1 true KR101870407B1 (en) 2018-06-28

Family

ID=61004495

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020160077122A KR101870407B1 (en) 2016-06-21 2016-06-21 Augmented reality providing system using social network service

Country Status (1)

Country Link
KR (1) KR101870407B1 (en)

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101060594B1 (en) * 2008-12-15 2011-08-31 한국전자통신연구원 Keyword Extraction and Association Network Configuration for Document Data
KR101260425B1 (en) * 2011-06-02 2013-05-07 (주)엘에이치에스지 Cloud-Based AR System
KR20130049263A (en) * 2011-10-31 2013-05-14 삼성전자주식회사 Social data management system and method for operating thereof
JP5980432B2 (en) * 2012-08-27 2016-08-31 エンパイア テクノロジー ディベロップメント エルエルシー Augmented reality sample generation

Also Published As

Publication number Publication date
KR20180000016A (en) 2018-01-02

Similar Documents

Publication Publication Date Title
Emmanouilidis et al. Mobile guides: Taxonomy of architectures, context awareness, technologies and applications
JP6105094B2 (en) Generate search results with status links to applications
JP4810469B2 (en) Search support device, program, and search support system
KR101337555B1 (en) Method and Apparatus for Providing Augmented Reality using Relation between Objects
KR101839319B1 (en) Contents searching method and display apparatus thereof
KR101357260B1 (en) Apparatus and Method for Providing Augmented Reality User Interface
WO2015050910A1 (en) Emoji for text predictions
US10073860B2 (en) Generating visualizations from keyword searches of color palettes
JP5526396B2 (en) Information search apparatus, information search system, and information search method
US9792303B2 (en) Identifying data from keyword searches of color palettes and keyword trends
US20150378999A1 (en) Determining affiliated colors from keyword searches of color palettes
US20150379005A1 (en) Identifying data from keyword searches of color palettes
US9898487B2 (en) Determining color names from keyword searches of color palettes
US20090216734A1 (en) Search based on document associations
AU2009337678B2 (en) Visualizing site structure and enabling site navigation for a search result or linked page
CN104335607A (en) Systems and methods for identifying and suggesting emoticons
EP2005606A2 (en) Method and system for performing tasks with a wireless device employing a graphical user interface
AU2012340952B2 (en) Grouped search query refinements
US8660580B2 (en) Method of providing location-based service using location information of mobile terminal
JP2006031379A (en) Information presentation apparatus and information presentation method
US8510287B1 (en) Annotating personalized recommendations
WO2015134739A1 (en) Performing searches and accessing search results using different devices
JP6349031B2 (en) Method and apparatus for recognition and verification of objects represented in images
JP4661159B2 (en) Information providing system, metadata collection and analysis server, and computer program
JP2013218676A (en) Input method, input device and terminal

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant