KR101843585B1 - Service server and method by object recognition - Google Patents

Abstract

Disclosed is a service server and method through object recognition that performs information communication between designated individuals or groups using an augmented reality through object recognition.
In one embodiment, a service server through object recognition includes a data input interface that receives an exposure group from an information terminal; A controller for retrieving memo information associated with the image from the database as the image of the object is received from the information terminal; And a processor for processing the image and providing the image to terminals belonging to the exposure group such that the memo information is displayed together with the image.

Description

SERVICE SERVER AND METHOD BY OBJECT RECOGNITION THROUGH OBJECT RECOGNITION

Embodiments of the present invention relate to a service server and method through object recognition for performing information communication between designated individuals or groups using an augmented reality through object recognition.

Augmented Reality is a fusion of physical space and electronic space. It is augmenting the real world by adding virtual information to the perception of the user by mixing virtual images such as computer graphics on real world or real world images. .

A tangible object is a metaphor that indicates how users interact with each other in a virtual environment. The tangible object is an intuitive interface that allows the user to control digital information in a virtual environment for easy interaction between the user and the virtual content. to provide.

Augmented Reality (Augmented Reality) is a term derived from a virtual environment and virtual reality. It is a mixture of a real-world image and a virtual image by inserting a computer graphic image into a real environment. In real world information, there is information that the user does not need, and sometimes there is a lack of information that the user needs. However, using a virtual environment created by a computer, information that is not needed can be made simple or invisible. That is, the augmented reality system combines the real world and the virtual world so that the user can interact with the real time user.

In this augmented reality system, a service for exchanging information about a target object is further needed.

An embodiment of the present invention provides a service server and method through object recognition for generating and registering a new message based on information obtained through object recognition and performing information communication between designated individuals or groups.

According to an embodiment of the present invention, a service server through object recognition includes a data input interface for receiving an exposure group from an information terminal; A controller for retrieving memo information associated with the image from the database as the image of the object is received from the information terminal; And a processor for processing the image and providing the image to terminals belonging to the exposure group such that the memo information is displayed together with the image.

According to another aspect of the present invention, there is provided a service method through object recognition, comprising: receiving an exposure group from an information terminal; Retrieving memo information associated with the image from the database as the image of the object is received from the information terminal; And processing the image and providing the image to a terminal belonging to the exposure group so that the memo information is displayed together with the image.

According to an embodiment of the present invention, a new message is generated and registered based on information obtained through object recognition to perform information communication between designated individuals or groups, thereby exchanging a message for the recognized object using the information terminal among users can do.

1 is a diagram illustrating a configuration of a service server through object recognition according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating a configuration of an information generating terminal through object recognition according to an embodiment of the present invention. Referring to FIG.
3 is a diagram illustrating a configuration of an information inquiry terminal through object recognition according to an embodiment of the present invention.
4 is a flowchart illustrating a method of generating information through object recognition according to an exemplary embodiment of the present invention.
FIG. 5 is a flowchart illustrating an information inquiry method using object recognition according to an exemplary embodiment of the present invention. Referring to FIG.
FIG. 6 is an exemplary view showing an information inquiry screen through photo recognition according to an embodiment of the present invention.
7 is an exemplary view showing an information inquiry screen through landscape recognition according to an embodiment of the present invention.
FIG. 8 is an exemplary view showing an information inquiry screen through barcode recognition according to an embodiment of the present invention.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited to or limited by the embodiments. Like reference symbols in the drawings denote like elements.

1 is a diagram illustrating a configuration of a service server through object recognition according to an embodiment of the present invention.

1, the service server 120 includes a data input interface (not shown) for receiving an exposure group from the information terminal 110; A controller 121 for retrieving memo information associated with the image from the database as the image of the target object is received from the information terminal 110; And a processor 122 for processing the image so that the memo information is displayed together with the image and providing it to the terminals belonging to the exposure group.

Location of note information

The controller 121 recognizes the shape of a photograph or a specific object photographed using the camera 111 in the information terminal 110 and can receive the memo information generated through the text input interface on the basis of the recognized screen .

The controller 121 can receive the memo information generated based on the barcode from the information terminal 110 after receiving the address information through the barcode or the like by the scanner of the information terminal 110. [ The controller 121 recognizes the barcode attached to the product at the information terminal 110 and can receive the memo information linked to the barcode through the text input interface.

The controller 121 can receive the memo information specified by the address identified by the bar code from the information terminal 110 and store it in the database and retrieve the memo information identified by the address from the database.

The controller 121 makes it possible to generate the memo information by combining the position information with the information such as the recognition screen, the bar code and the like. The controller 121 can receive the memo information generated by linking the position information obtained by the GPS system to the image information recognized by the information terminal 110. [

Create note information

The controller 121 can receive information such as memos and the like from the information terminal 110 with respect to specific information (a shape of an object, a barcode, a trademark, a signboard, etc.). The controller 121 receives the memo information which is multimedia information generated by linking text information to the image information recognized by the camera 111 from the information terminal 110. [

The controller 121 receives the text information and the multimedia data of the target object from the information terminal through the data input interface, generates the memo information by attaching the multimedia data to the text information, and generates the memo information You can link and save it in the database.

The controller 121 acquires the time information of the received image, stores the time information in the memo information and stores it in the database, searches the time information when the image was received from the information terminal 110, Can be searched and selected.

The processor 122 may provide an exposure setting interface to the information terminal 110 to limit exposure conditions of the generated memo information to date, time, location, and object in addition to the above information. The processor 122 can register time and space and object information with exposure conditions of the memo information input through the exposure setting interface.

The processor 122 may provide an exposure setting interface to the information terminal 110 to specify a range (distance, etc.) to be exposed based on the position of the memo information. The processor 122 may set an exposure area by specifying a distance around a reference position to which the memo information inputted through the exposure setting interface is to be exposed.

The processor 122 may restrict the information exposure method through the exposure setting interface provided to the information terminal 110 only through recognition of the corresponding point or may provide information access at a remote location. The processor 122 allows the user to select either the near or far information access path as the exposure method of the memo information through the exposure setting interface.

The processor 122 can also set whether the original information is reused, edited and delivered, whether additional information is generated, and the like. The processor 122 may be designed to select and combine at least one of use, edit, transfer, and addition of memo information, which is text information linked to image information.

Exposed subject

The processor 122 may set an exposure target based on a specific individual or group through an exposure setting interface provided to the information terminal 110. [ The processor 122 sets an individual or a group of exposure targets of the memo information so that only a specific target can access the memo information.

The processor 122 enables the authentication processing by linking information about an individual or a group dynamically with a system having memo information. The processor 122 may perform an authentication procedure in conjunction with a system for storing memo information linked with information on an exposure target.

The processor 122 may designate a specific device as an exposure target through an exposure setting interface provided to the information terminal 110. [ The processor 122 can designate and specify a specific device whose operation attribute of the information terminal is different from the specific target as the exposure target of the memo information.

Sharing memo information

When all the specified exposure conditions are satisfied, the processor 122 can alarm the information terminal about the information to the target person when the target user is within a certain range with the generated memo information.

The processor 122 provides an information providing environment so that the information terminal 110 can inquire the corresponding memo information from a remote location according to the set exposure condition and provides an editing interface to generate additional information in the memo information You may. At this time, the processor 122 may provide an exposure interface and an editing interface to the information terminal so that the original note information can be directly transmitted to another person or edited according to the setting information.

The processor 122 may have to track that the information terminal 110 directly moves to the position of the corresponding information according to the setting condition which is an exposure condition. In this case, depending on the setting of the information creator, the processor 122 may provide the information terminal 110 with the location or path of the memo information. When the information terminal 110 moves to the corresponding position, the processor 122 may provide the note information only when the information terminal 110 recognizes a specific object / object with a device such as a camera in accordance with the setting condition.

The processor 122 does not specify a position or the like but designates the object as a bar code of the article. When the information terminal 110 recognizes only the bar code of the article through the scanner (when the condition of the object matches) And may provide information to the information terminal 110.

The processor 122 generates the memo information for the various exposure groups of the information terminal 110 for the same commodity and transmits the memo information to the information terminal 110 when the information terminal 110 belongs to several of the exposure groups. It is possible to inquire memo information by group or memo information without group identification according to the setting.

FIG. 2 is a diagram illustrating a configuration of an information generating terminal through object recognition according to an embodiment of the present invention. Referring to FIG.

2, the information generating terminal 210 includes a controller 211 for transmitting information, which recognizes an image of a target object, to the service server 220 and receiving text information about the target object from the service server 220, And a processor 212 for generating multimedia data by attaching multimedia data to the text information and storing the multimedia data in the service server 220.

The controller 211 captures an object using the camera 213 and transmits the object information recognized from the obtained image to the service server 220. [ The service server 220 inquires the database 221 to search for text information linked to a target object and transmits the search result to the controller 211.

The controller 211 displays the text information received from the service server 220, provides an editing interface, and provides an editing environment in which multimedia data is attached to the text information to generate memo information. The controller 211 transmits the memo information attached with the multimedia data to the service server 220 and stores the memo information.

When the controller 211 receives information about the exposure group of the memo information from the service server 220, the processor 212 selects an exposure group according to the user input passed through the exposure selection interface, And links the group to the service server 220.

3 is a diagram illustrating a configuration of an information inquiry terminal through object recognition according to an embodiment of the present invention.

Referring to FIG. 3, the information inquiry terminal 310 transmits a location information to the service server 320 to inform the presence of the memo information corresponding to the exposure group, And a processor 312 for downloading and displaying from the server 320.

The controller 311 transmits the detected location information to the service server 320 using the GSPS system 313. [ The service server 320 searches the database 321 for the exposure group and the memo information linked to the detected location information and notifies the presence of the memo information linked to the exposure group to which the information inquiry terminal 310, To the controller 311.

The controller 311 notifies the user of the existence of the memo information linked to the searched location information, and downloads the selected memo information from the service server 320 according to the user input and displays the memo information.

When the controller 311 transmits the photographed image to the service server 320 by using the camera 314 and receives the position information on the photographed image from the service server 320, Tracks the path of the changed location information, transmits the tracked route to the service server 320, and downloads and displays the memo information corresponding to the tracked route from the service server 320.

The processor 312 requests the service server 320 to edit the memo information, receives the memo information, and stores the edited memo information in the service server 320. Then, the processor 312 can download the edited memo information corresponding to the searched position and the exposure group from the service server 320 and display the edited memo information.

4 is a flowchart illustrating a method of generating information through object recognition according to an exemplary embodiment of the present invention.

The method for generating information through object recognition according to an embodiment of the present invention can be implemented by the information generating terminal shown in FIG. Hereinafter, FIG. 4 will be described with reference to FIG. 2 together with the description of FIG. 4 to understand the invention.

In step 401, the information generating terminal photographs a target object using the camera, recognizes it, and transmits the recognized information to the service server (step 402). In step 403, the service server searches the memo information about the recognized object and transmits the search result to the information generating terminal (step 404).

In step 405, the information generating terminal displays the memo information about the target object and executes the memo creating interface. In step 406, the information generating terminal inputs memo information added from the user through the memo creating interface.

In step 407, the information generating terminal inserts the memo information together with a multimedia file including at least one of image, music, and moving image to create memo information. In step 408, the information generating terminal lists the exposure group or the user list received from the service server to select the exposure target after completion of the creation of the memo information (step 409).

In step 410, the information generating terminal transmits the exposure target information selected from the list to the service server. In step 411, the service server requests a group information inquiry corresponding to the exposure object information to the community site. In step 412, the community site inquires the group information of the exposure target and transmits the search result to the service server (step 413).

In step 414, the service server transmits the search result of the group information corresponding to the exposure object information to the information generation terminal.

In step 415, the information generating terminal links and stores the exposure group, which is the search result, in the memo information, and transmits the information to the service server (step 416). In step 417, the service server stores the memo information and the exposure group, and transmits the stored result to the information generating terminal (step 418).

FIG. 5 is a flowchart illustrating an information inquiry method using object recognition according to an exemplary embodiment of the present invention. Referring to FIG.

The information inquiry method through object recognition according to an embodiment of the present invention can be implemented by the information inquiry terminal shown in FIG. Hereinafter, the description of Fig. 5 will be given with reference to Fig. 3 together with the description of Fig. 5, thereby understanding the invention.

In step 501, the information inquiry terminal searches the location using the GPS system and transmits the location search information to the service server (step 502).

In step 503, the service server refers to the location search information, searches for one or more pieces of exposure information among the location, date, time, and target, and requests exposure information inquiry to the community site (step 504). In step 505, the community site inquires the exposure information based on the information stored in the database and transmits the inquiry result to the service server.

In step 506, the service server refers to the inquiry result of the exposure information and notifies the information inquiry terminal of the existence of the exposure information. In step 507, the information inquiry terminal notifies the user of the existence of the exposure information, and displays memo information corresponding to the location search information.

In step 508, the information inquiry terminal requests the service server to search for the location and the route. In step 509, the service server retrieves the location information and transmits the location information to the information inquiry terminal (step 510).

In step 511, the information inquiry terminal tracks the location path based on the location information. In step 512, the information inquiry terminal requests the service server to inquire the exposure information corresponding to the location path. In step 513, the service server refers to the information stored in the database, inquires exposure information, and transmits the exposure information, which is the inquiry result, to the information inquiry terminal (step 514).

In step 515, the information inquiry terminal inquires and displays the memo information corresponding to the exposure information. In step 516, the information inquiry terminal displays the edit interface, receives the addition or editing of the memo information, and requests the service server to add or edit the memo information (step 517).

In step 518, the service server adds or edits the memo information according to the edit authority, and transmits the edit result to the information inquiry terminal (step 519). The information inquiry terminal can display the edited memo information.

FIG. 6 is an exemplary view showing an information inquiry screen through photo recognition according to an embodiment of the present invention.

The information terminal recognizes the photograph and displays the memo information corresponding to the exposure group corresponding thereto. The information terminal displays memo information registered in the corresponding exposure group for the recognized photograph.

7 is an exemplary view showing an information inquiry screen through landscape recognition according to an embodiment of the present invention.

The information terminal recognizes the landscape image and displays the memo information about the landscape corresponding to the exposure group corresponding thereto. The information terminal displays the memo information registered in the corresponding exposure group for the recognized landscape in association with the exposure position of the scenery, and enlarges and displays the selected memo information.

FIG. 8 is an exemplary view showing an information inquiry screen through barcode recognition according to an embodiment of the present invention.

The information terminal recognizes the barcode printed on the object through the scanner and displays the memo information about the barcode information corresponding to the exposure group corresponding to the barcode. The information terminal displays memo information related to the merchandise information registered in the corresponding exposure group for the recognized bar code information on the screen.

Further, embodiments of the present invention include a computer readable medium having program instructions for performing various computer implemented operations. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like.

As described above, the present invention has been described with reference to particular embodiments, such as specific elements, and specific embodiments and drawings. However, it should be understood that the present invention is not limited to the above- And various modifications and changes may be made thereto by those skilled in the art to which the present invention pertains. It is therefore to be understood that within the scope of the appended claims, the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims. .

110: Information terminal
111: camera
120: service server
121: Controller
122: Processor

Claims (16)

A data input interface for receiving an exposure group from an information terminal;
A controller for retrieving, from a database, memo information registered in the terminal belonging to the exposure group in association with the image as the image of the object is received from the information terminal; And
A processor for processing the image and providing it to the information terminal so that the memo information is displayed together with the image,
Lt; / RTI >
The controller comprising:
Searching for location information for the information terminal, determining whether memo information having the searched location information is stored in the database,
The processor comprising:
When it is determined that the memo information is stored, notifying the information terminal of the existence of the memo information, and providing the memo information in cooperation with the user input of the information terminal
Service server through object recognition. The method according to claim 1,
Wherein the data input interface comprises:
Receiving text information on the object from an arbitrary terminal including the information terminal,
The controller comprising:
Wherein the memo information is generated by attaching the multimedia data input through the data input interface to the text information, and storing the memo information in the database in correspondence with the image of the object. The method according to claim 1,
Wherein the memo information includes positional information,
The controller comprising:
Searching for location information on the information terminal or the target object, and searching the database for memo information having the searched location information. The method according to claim 1,
Wherein the memo information includes time information,
The controller comprising:
And searching the database for memo information having the retrieved time information to search for the time when the image was received. delete The method according to claim 1,
The controller comprising:
Wherein the information processing apparatus generates route information on the information terminal tracked by the GPS system and searches for memo information corresponding to the generated route information from the database to be provided to the terminals belonging to the exposure group through the processor Service server through recognition. The method according to claim 1,
The controller comprising:
And providing the editing terminal with editing authority for the memo information to the information terminal and receiving the edited memo information from the information terminal through the data input interface. The method according to claim 1,
When a barcode is received as the image, a scanner that scans the barcode to obtain an address
Further comprising:
The controller comprising:
And retrieving the memo information in the field in the database identified by the address. Receiving an exposure group from an information terminal;
Retrieving memo information registered in the terminal belonging to the exposure group from the database in association with the image as the image of the object is received from the information terminal;
Processing the image and providing the image information to the information terminal so that the memo information is displayed together with the image;
Searching location information for the information terminal and determining whether memo information having the searched location information is stored in the database; And
When it is determined that the memo information is stored, notifying the information terminal of the presence of the memo information and providing the memo information in association with user input of the information terminal
Wherein the method comprises the steps of: 10. The method of claim 9,
Receiving text information and multimedia data for the object from an arbitrary terminal including the information terminal;
Generating memo information by attaching the multimedia data to the text information; And
Storing the generated memo information in the database in association with the image of the object;
Further comprising the steps of: 10. The method of claim 9,
Wherein the memo information includes positional information,
Wherein the searching comprises:
Searching location information about the information terminal or the object and selecting the memo information having the searched location information from the database
Wherein the method comprises the steps of: 10. The method of claim 9,
Wherein the memo information includes time information,
Wherein the searching comprises:
Searching for the time information when the image is received, and searching the database for memo information having the searched time information
Wherein the method comprises the steps of: delete 10. The method of claim 9,
Generating path information on the information terminal tracked by the GPS satellite system
Further comprising:
Wherein the searching comprises:
Retrieving memo information corresponding to the generated route information from the database
Wherein the method comprises the steps of: 10. The method of claim 9,
Providing an editing authority for the memo information to the information terminal; And
Receiving memo information edited with the editing authority from the information terminal through a data input interface
Further comprising the steps of: 10. The method of claim 9,
When the barcode is received as the image, scanning the barcode to obtain an address
Further comprising:
Wherein the searching comprises:
Searching the memo information in the field in the database identified by the address
Wherein the method comprises the steps of:

Images