KR101647565B1 - System and method for Things-based Social Network Service - Google Patents

Abstract

The present invention recognizes an object using a smart device with a camera, stores multimedia contents such as a message, an image, and a moving picture on a server via the recognized object, And more particularly, to a method and system for object-based social network service capable of viewing or sharing the message and multimedia contents stored in a server via the object when a similar object is recognized.

Description

BACKGROUND OF THE INVENTION Field of the Invention The present invention relates to a method and system for object-based social network service,

The present invention relates to a service method and system for constructing a social network among people through objects in the world. More specifically, the present invention relates to a smart device having a camera function such as a smart phone or a tablet PC, And stores the message or the content in a database by using the recognized object as a key in a server providing the service when the user captures the object and saves the content in the form of a text message or a multimedia format, And more particularly, to a network service method and system capable of browsing the message or multimedia content, making friends, and composing reply messages and multimedia contents by performing the process of recognizing the object with the smart device.

A technique of shooting an object with a camera attached to a mobile terminal, storing the image in the terminal, and sharing the image stored in the terminal on a social network is widely spread.
Also, an object is photographed with a camera attached to the terminal, and the image is stored in the terminal, and the image is uploaded to the server. The server transmits information related to the image (for example, another image search similar to the image, And provides the retrieved information to the terminal user.
The first example is a technique of uploading an image of an object photographed by a camera attached to a terminal to a server and sharing the image with an unspecified number or a person having a specific relationship. Uploads an image of an object to a server, searches for information related to the image, and provides the retrieved information to the terminal user.

The conventional arts related to the present invention have a problem in that it is not able to utilize images of an object shot by a camera attached to a mobile terminal as an intermediary for communicating or sharing information with an unspecified number or a specific related person.
With the development of the Internet and smart devices, a wide range of social network services are available to connect with people from around the world and exchange messages and multimedia contents.

A common point of these social network services is that they establish a relationship between people when they establish a relationship between people in a service.
In other words, a social network service is performed based on a person's profile. For example, a general method of forming a relationship with a person A by a person B is to know a person B directly, , Or indirectly through a third person, C, who has a relationship with both A and B.

In other words, most of the social network services being provided use a method and system for communicating messages and multimedia contents while sharing messages or multimedia contents after establishing relationships through people

The present invention relates to a method of freely sharing contents that can be recorded on a digital medium through objects existing in the world, including multimedia contents such as text messages, images, movies, music, etc., And systems that enable users to freely share content and organize social relationships between users through the methods and systems of the present invention.

The object of the present invention is to provide a social network service method and system based on recognizable objects existing all over the world not based on a profile of a person in performing a social network service, , A smart message having a camera function, a text message or a multimedia content intended to be shared or left to be photographed, to be recorded on a server, a message left after a large number of people who recognize the object as their own smart Or social network service method and system capable of freely communicating with various people all over the world by browsing multimedia contents and establishing a relationship with a person who uploads the read messages and multimedia contents.

According to an aspect of the present invention, there is provided a object-based social network service system,

In a matter-based social network service system,

An object recognition unit for recognizing an object photographed by the smart device as a unique value;

An information input unit capable of creating contents of the recognized object through a unique value;

An information storage unit for storing the input information in a database via a unique value of the recognized object;

A filtering information input unit for allowing a user to input filtering information such as a person or an area or time for which information is stored via the unique value of the object;

An information extraction unit for extracting information stored in a database in accordance with filtering information through a unique value of the recognized object;

A screen output unit for displaying information received from the information extracting unit in association with the recognized object on a screen in accordance with filtering information;

And a social relation part capable of establishing or breaking a relationship with the person who created the information in association with the recognized object,

The object recognizing unit recognizes an object captured by a camera attached to the smart device and assigns an eigenvalue to the object or extracts the eigenvalue when the object has already been assigned an eigenvalue.

The term " captured by a camera "means that an object is captured through a method of taking a snapshot with a camera attached to a smart device or a method of shooting a moving image.

The information input unit is a place where an anonymous user or an ID user can input character type information, a photograph, or a moving image through the unique value of the object given by the object recognizing unit.

The information storage unit stores character type information, photographs, and moving pictures input through the information input unit in a database via eigenvalues for the object or the eigenvalues and the ID of the user.

The filtering information input unit selectively inputs a value for filtering information inputted through the object after the user recognizes the object with the smart device. The filtering information input unit inputs the filtering value for the information created through the object, Or a person or area or time that has a relationship with the user. If the user does not enter a filtration value, the object is regarded as all of the information created by the intermediary.

The information extracting unit extracts, from the database, information matching the filtering value inputted by the user among all the information stored via the unique value of the recognized object.

The screen output unit outputs the information extracted from the information extracting unit to a portion for outputting on the screen of the smart device, depending on how the object is captured by the camera. When the object is captured by the camera by the snapshot method, the name or the representative image of the object identified through the eigenvalue of the object is displayed on the screen, and the extracted information is displayed according to the filtered value. When an object is captured by a camera by a video shooting method, a general augmented reality technique is used to display the extracted information on the screen in the vicinity of the captured object.

The social relation unit may include a part that can be related to a user who can know through the information displayed through the screen output unit or a part that can break the relationship, and can display a lot of social information such as viewing / It is a part where various additional information related to the relationship can be set.

The essence of the present invention is that people or smart devices everywhere in the world are based on recognizable objects in providing social network services. This can constitute an unspecified majority and a high degree of freedom in relation to a social network service in which a relationship is established based on a person profile, and can provide a service of the same degree as the person profile based social network service through various filtering methods Effect.

Particularly, in the case of a merchandise to be sold commercially, a person who manufactures or sells the goods can use a service or a system implemented through the present invention to advertise at a low cost and sell the product regardless of the region.

In addition, the method of delivering messages and contents through objects has the effect of replacing conventional text messages or mails.

In the conventional text message or mail system, a recipient is specified. In the case of a text message, a telephone number or a name of a person stored in a smartphone contact, and a mail address of a person to be received are required. However, It is possible to transmit the message and the contents through the medium.

For example, if a promised object is designated among specific persons, and a message and contents shared by the specific persons are automatically notified through the object, the conventional text message and mail can be substituted.

Fig. Object - based social network service method;
Fig. Object - based Social Network Service Method using Augmented Reality;
3. Object - based social network service method using snapshot;
FIG. A method of delivering messages through objects;
Figure 5. A system for object-based social network services;

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the present invention. Were used for similar components. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

The terms first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

The term " and / or " includes any combination of a plurality of related listed items or any of the plurality of related listed items. When an element is referred to as being "connected" or "connected" to another element, May be directly connected or connected to the other component, but it should be understood that other components may be present in between.

On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between. And are not intended to limit the invention.

The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.

Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like or corresponding elements are denoted by the same reference numerals, and a duplicate description thereof will be omitted.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Figure 1 is a method of service-based social network service.

The object-based social network service method according to the present invention will now be described with reference to a specific example as illustrated in FIG.

A user 101 in London, after taking a picture of a Coca-Cola can 105 in a supermarket using his smartphone 102, recognizes Coca-Cola 104 and the user 101 sends a message (103). The user 106 in New York in the United States shoots the Coca-Cola can 110 in his living room table using the smartphone 107 of the user 106 and recognizes 109 the Coca-Cola can, The user 101 can recognize a message left by recognizing the Coca-Cola. The user 106 may send a relationship request message to the user 101 if he wants to establish a relationship with the user 101 and the user 106 either responds to the request or rejects the request of the user 101, .

In this way, the existing social network service establishes a social relationship through the person himself, whereas the service method according to the present invention is a method of establishing a social relationship and sharing necessary information through objects that can be recognized.

In the service method described above, Coca - Cola cans are examples of objects for information communication and social relations, but all perceptible objects around us can be objects.

FIG. 2 shows a preferred embodiment of the object-based social network service method using the augmented reality.

When a user A shoots the Coca-Cola bottle 202 on the table with his / her smartphone 201 in the augmented reality mode 206, the result of recognizing the Coca-Cola bottle is represented by one icon 207, Informs the user A that the Coca-Cola bottle has been recognized, and displays a message that a plurality of people have left Coca-Cola bottles or a variety of contents to enhance the smartphone screen, which is called Augmented Reality. In the example of FIG. 2, the message and the content are displayed in the form of a speech balloon 203. Due to the limitations of the physical size of the smart screen, there are limitations in expressing the message and contents. Therefore, various methods are displayed on the screen in the order of the latest order, friendship order, intimacy order, and randomness. In the embodiment of FIG. 2, a method 204 for displaying all messages is selected. In some cases, only a message of friends may be viewed. The user A can leave messages and contents through the recognized Coca Cola bottles. If the user clicks the graffiti button 205 displayed on the screen of the smartphone 201, the screen is switched to a screen for inputting a message or a content .

If the user clicks on the speech bubble line 203 displayed on the smartphone screen, the message moves to the main page 211 of the user B sharing the message or content corresponding to the speech bubble. The user B can view the photograph or introduction message 208 of the user B and the various messages and contents 209 shared by the user B via the objects on the main page. The embodiment of FIG. 2 assumes that the user B has a friend relationship with the user A, and the user A can click the leave message button 210 to leave the message. If the user B and the user A are not in a friendship relationship, the user A who visited the main page of the user B can make a friend making request on the main page of the user B, and the user B can accept or reject the friend making request of the user A can do.

FIG. 3 shows a preferred embodiment using snapshot shooting in a method of object-based social network service.

If a snapshot mode 307 is designated as a snapshot mode 307 using the smartphone 301 of the user A and then snapshots are taken, a result 304 indicating that the Coca-Cola can is recognized is displayed on the smartphone screen And displays the shared information 302 via the Coca-Cola can on the screen in accordance with the time line. The shared information 302 may select and display only messages and contents shared by all persons or messages and contents of friends (305), recognize the Coca-Cola cans and designate a place 303 where the contents are shared Only the information matching the condition can be displayed. Similar to the embodiment shown in FIG. 2, the graffiti button 306 may be clicked on this object to leave a message and content.

When the message 302 displayed on the smartphone is clicked, the screen is switched to the main page 211 of the user who has shared the message described in the embodiment of FIG.

FIG. 4 shows a preferred embodiment in which a specific object is specified in a message delivery method to notify and deliver a message left by a specific person.

After the user A shoots the Coca-Cola can with the smartphone 401 and recognizes the Coca-Cola can, the result of recognition is displayed on the screen (402). When the content shared via the Coca-Cola cans occurs, - In the embodiment of FIG. 4, a follow-up (403) check-notification condition can be specified. In this example, (405) in Seoul will automatically notify a friend (404) only when a message or content shared via a Coca-Cola can occurs. In the example of FIG. 4, only three friends (SangHO, YongWOO, MyungSUK) among the friends are set to automatically notify the smartphone 401 of the user A when a message and contents shared through the Coca-Cola can It is.

After the above setting, the friend SangHO 411 of the user A shoots the Coca-Cola can 413 in Seoul on the smartphone 412 and recognizes the message, and if the friend 420 leaves the message 420 via the Coke can, (420) is transmitted and the server (414) notifies the smartphone (401) of the user A that there is a message to be read and the user (A) who has received the notification can receive the message (420)

Figure 5 shows details of a system for object-based social network services.

First, an example of a system for outputting a message and contents shared through the object after recognizing the object on the screen of the smart device will be described.

When an object is photographed with the smart device 501 to which the camera is attached, the object recognition cache 502 stored in the smart device is first searched. The object recognition cache 502 performs a role of supporting quick object recognition by caching information on an object photographed and recognized by the smart device 501 in advance. If the object recognition is completed by the object recognition cache, the eigenvalue of the object and the filtering value of the filtering information input unit are transmitted from the object recognition cache together to the information extracting unit 513 via the communication network 530.

If the photographed object can not find appropriate information through the object recognition cache 502, the object image is transmitted to the object recognition unit 511 through the communication network 530. The object recognition unit 511 recognizes the object A search is made from a database 521 for object recognition using an object image, and an eigenvalue for the object is obtained after the recognition of the object is completed. The filtering information input unit 504 delivers the filtering value to the information extracting unit 513 through the communication network 530. The information extracting unit 513 extracts the filtering value from the filtered information,

The information extracting unit 513 extracts a message or a content from the database 522 via the object using the eigenvalue and the filtering value for the object. The extracted message and contents are delivered to the screen output unit 506 of the smart device 501 and output to the screen.

The following description relates to a system for recognizing an object and inputting a message and contents to be shared through the object.

After the process of outputting to the smart device screen, the information input unit 503 provides a method of inputting a message and contents to be shared by a user using the smart device 501. [ The information input unit provides a method of inputting the message in text form and in the form of an image, a moving picture, a voice, a music, or the like. Upon inputting the message and the content from the user, the message and the content are transmitted to the information storage unit 512 together with the object eigenvalue through the communication network 530, and the information storage unit stores the information in the database 522.

The social relation input unit 505 of the smart device 501 establishes a relationship between the message recognized by the smart device 501 or a message and content shared through the recognized object or the person who created the message and the content And release it. Examples of representative functions that can be set in the social relationship input unit include setting automatic notification of a message and a content mediated by the recognized object, and establishing a relationship between the message and the user who created the content.

The value set through the social relationship input unit is transmitted to the social relation unit 514 via the communication network 530, and the social relation unit stores various social relationship information in the database 522. [

It will be apparent to those skilled in the relevant art that various modifications, additions and substitutions are possible, without departing from the spirit and scope of the invention as defined by the appended claims. The appended claims are to be considered as falling within the scope of the following claims.

None.

Claims (18)

A network service method on-line using a smart device with a camera, the smart service device comprising: a smart phone; a tablet PC; a notebook PC; and an application running on the operating system. Wherein the smart device is mounted on the smart device or is detachable as an external device independent of the smart device,
(A) photographing an object recognizable by a camera attached to the smart device by a first user;
Assigning a unique value to the photographed object from the smart device of the first user and storing the unique value in the database as the key value of the database, b) the content includes all content capable of being recorded on a digital medium, including text, images, moving pictures, and voices;
(C) a third user, including a first user, photographing the object or a similar object with a camera attached to the smart device;
(D) extracting a key value equal to the key value with respect to the object captured by the second user;
(C) extracting the content created by the first user or stored for sharing by using the key value from the database; And
(D) outputting the content extracted from the database to a smart device of a second user, wherein the smart device is a device for displaying information to a user such as a display screen and a speaker. Way.
Deletion of claim by corrective claim
Deletion of claim by corrective claim
A network service method on-line using a smart device with a camera, the smart service device comprising: a smart phone; a tablet PC; a notebook PC; and an application running on the operating system. Wherein the smart device is mounted on the smart device or is detachable as an external device independent of the smart device,

(A) photographing an object recognizable by a camera attached to the smart device by a first user;
(B) designating, as a medium for receiving a content created by a third party or intended to be shared with the photographed object, from the smart device with respect to the object photographed by the first user;
Assigning a unique value to the object, assigning the unique value to a key value of the database, associating the key value with a value representing that the content is a content delivery medium created by a third party for the object, (C);
(D) capturing the object or a similar object with a camera attached to the smart device by a second user and inputting a content of a third party that the second user has created or wants to share;
A notification step (e) of notifying the smart device of the first user of the input of the content from the second user on a display screen or a sound;
(F) of extracting the content from the database to the smart device of the first user and delivering it via the network
Lt; RTI ID = 0.0 > 1, < / RTI >
Deletion of claim by corrective claim
4,
Designating in step (b) said content delivery vehicle logically combining with a particular user;
And only when the second user is the specific user in step (e).
A network service method on-line using a smart device with a camera, the smart service device comprising: a smart phone; a tablet PC; a notebook PC; and an application running on the operating system. Wherein the smart device is mounted on the smart device or is detachable as an external device independent of the smart device,
(A) photographing an object recognizable by a camera attached to the smart device by a first user;
Assigning a unique value to the photographed object from the smart device of the first user and storing the unique value in the database as the key value of the database, b) the content includes all content capable of being recorded on a digital medium, including text, images, moving pictures, and voices;
(C) a third user, including a first user, photographing the object or a similar object with a camera attached to the smart device;
(D) extracting a key value equal to the key value with respect to the object captured by the second user;
(C) extracting the content created by the first user or stored for sharing by using the key value from the database; And
(D) outputting the content extracted from the database to a smart device of a second user, wherein the smart device is a device for displaying information to a user such as a display screen and a speaker. system
Deletion of claim by corrective claim
Deletion of claim by corrective claim
A network service method on-line using a smart device with a camera, the smart service device comprising: a smart phone; a tablet PC; a notebook PC; and an application running on the operating system. Wherein the smart device is mounted on the smart device or is detachable as an external device independent of the smart device,

(A) photographing an object recognizable by a camera attached to the smart device by a first user;
(B) designating, by the smart device, an object that the first user has photographed or a content that the third party has created or intends to share with the photographed object;
Assigns a unique value to the object, assigns the unique value to the key value of the database, associates the key value with a value representing that the content is a content delivery medium created by the third party for the object, (C) recording;
(D) capturing the object or a similar object with a camera attached to the smart device by a second user and inputting a content of a third party that the second user has created or wants to share;
A notification step (e) of notifying the smart device of the first user of the input of the content from the second user on a display screen or a sound;
(F) of extracting the content from the database to the smart device of the first user and delivering it via the network
The network service system comprising:
Deletion of claim by corrective claim
10. The method of claim 10,
Designating in step (b) said content delivery vehicle logically combining with a particular user;
Only when the second user is the specific user in step (e). ≪ RTI ID = 0.0 >

A network service method on-line using a smart device with a camera, the smart service device comprising: a smart phone; a tablet PC; a notebook PC; and an application running on the operating system. Wherein the smart device is mounted on the smart device or is detachable as an external device independent of the smart device,
(A) photographing an object recognizable by a camera attached to the smart device by a first user;
Assigning a unique value to the photographed object from the smart device of the first user and storing the unique value in the database as the key value of the database, b) the content includes all content capable of being recorded on a digital medium, including text, images, moving pictures, and voices;
(C) a third user, including a first user, photographing the object or a similar object with a camera attached to the smart device;
(D) extracting a key value equal to the key value with respect to the object captured by the second user;
(C) extracting the content created by the first user or stored for sharing by using the key value from the database; And
(D) outputting the content extracted from the database to a smart device of a second user, wherein the smart device is a device for displaying information to a user such as a display screen and a speaker. Recording medium on which a program for implementing the method is recorded
Deletion of claim by corrective claim
Deletion of claim by corrective claim
A network service method on-line using a smart device with a camera, the smart service device comprising: a smart phone; a tablet PC; a notebook PC; and an application running on the operating system. Wherein the smart device is mounted on the smart device or is detachable as an external device independent of the smart device,

(A) photographing an object recognizable by a camera attached to the smart device by a first user;
(B) designating, by the smart device, an object that the first user has photographed or a content that the third party has created or intends to share with the photographed object;
Assigns a unique value to the object, assigns the unique value to the key value of the database, associates the key value with a value representing that the content is a content delivery medium created by the third party for the object, (C) recording;
(D) capturing the object or a similar object with a camera attached to the smart device by a second user and inputting a content of a third party that the second user has created or wants to share;
A notification step (e) of notifying the smart device of the first user of the input of the content from the second user on a display screen or a sound;
(F) of extracting the content from the database to the smart device of the first user and delivering it via the network
And a program for implementing the method for network service.
Deletion of claim by corrective claim
16. The method of claim 16,
Designating in step (b) said content delivery vehicle logically combining with a particular user;
And only when the second user is the specific user in step (e). ≪ Desc / Clms Page number 20 &gt ;

Images