WO2015167231A1

WO2015167231A1 - Method and device for providing message service using visual object

Info

Publication number: WO2015167231A1
Application number: PCT/KR2015/004270
Authority: WO
Inventors: 김기태
Original assignee: 김기태
Priority date: 2014-04-28
Filing date: 2015-04-28
Publication date: 2015-11-05

Abstract

A method for providing a visual message service comprises the steps of: executing a message application; providing, through the message application, an interface for transition between a visual message application, which is distinguished from the message application and provides a visual object editable by a user, and the message application; and executing the visual message application in response to the selection of the user through the interface.

Description

Method and apparatus for providing message service using visual object

A technology related to a device for providing a visual message service and a method thereof, and more specifically, a visual object (Editable Visual Object) which executes a visual message application (VMA) linked to a message application (MA); VO) to a user.

In the existing message service, a visual object such as an emoticon, a flashcon, or a multimedia file is provided to a user in a short message service (SMS), a multimedia message service (MMS), or an IP multimedia subsystem (IMS) application.

However, since such a visual object is not editable, there is a disadvantage in that the expression desired by the user cannot be expressed in detail and freely.

Therefore, the present specification proposes a technique for providing an editable visual object so that the user can express the desired expression in detail and freely.

Embodiments of the present invention provide an apparatus and method for providing a visual message service that provides an editable visual object that expresses the expression desired by the user in detail and freedom.

In particular, embodiments of the present invention provide a visual message service providing apparatus and method for providing a user with an editable visual object by executing a visual message application linked to the message application.

Also, embodiments of the present invention provide a visual message service providing apparatus for selecting at least one editable visual object among a plurality of editable visual objects based on at least one of a message or an input message received through a message application; It provides a way.

In particular, embodiments of the present invention provide an apparatus and method for providing a visual message service that provides an editable visual object in association with a wearable device.

In addition, embodiments of the present invention provides an apparatus and method for providing a visual message service for selecting at least one visual object from among a plurality of visual objects based on a message input from a user or a user's body information measured from the user do.

A visual message service providing method according to an embodiment of the present invention includes the steps of executing a message application; Providing an interface for transition between the message application and a visual message application that is distinguished from the message application and provides a visual object editable by a user through the message application; And in response to the user's selection through the interface, executing the visual message application.

According to an embodiment of the present invention, a method of providing a visual message service in association with a wearable device includes providing a plurality of visual objects editable by a user through a visual message interface; Selecting at least one visual object of the plurality of visual objects; Receiving an operation of the user on the selected at least one visual object; And in response to the user's manipulation, changing the selected at least one visual object.

Embodiments of the present invention can provide an apparatus and method for providing a visual message service for providing an editable visual object for expressing the expression desired by the user in detail and freely.

1 is a block diagram illustrating a system for providing a visual message service according to an embodiment of the present invention.

FIG. 2 is a block diagram specifically illustrating a visual message application execution unit shown in FIG. 1.

3 to 5 are diagrams for describing a visual message service providing method according to an embodiment of the present invention.

6 is a flowchart illustrating a method for providing a visual message service according to an embodiment of the present invention.

FIG. 7 is a flowchart specifically illustrating an operation of executing the visual message application illustrated in FIG. 6.

8 is a diagram illustrating a visual message service providing apparatus and a wearable device according to an embodiment of the present invention.

9 illustrates a wearable device provided with a visual message service according to an embodiment of the present invention.

10 is a flowchart illustrating a method of providing a visual message service according to an embodiment of the present invention.

11 is a block diagram illustrating an apparatus for providing a visual message service interoperating with a wearable device according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited or limited by the embodiments. Also, like reference numerals in the drawings denote like elements.

Referring to FIG. 1, a system for providing a visual message service according to an embodiment of the present invention includes a apparatus for providing a visual message service 110 and a server 120 provided in a terminal of a user. The apparatus for providing a visual message service 110 may be connected to the server 120 through a communication module inside a user's terminal.

The apparatus for providing a visual message service 110 includes a message application executing unit 111, an interface providing unit 112, and a visual message application executing unit 113.

Here, the message application execution unit 111 executes the message application. For example, the message application execution unit 111 may execute at least one of a Short Message Service (SMS), a Multimedia Message Service (MMS), or an IP Multimedia Subsytem (IMS) application in response to a user input.

The interface provider 112 provides an interface for transition between the visual message application and the message application through the message application. In this case, the visual message application is distinguished from the message application and is an application that provides a visual object that can be edited by a user.

For example, the interface provider 112 may provide an interface for transition between the visual message application and the message application in at least some areas of the interface of the message application. Detailed description thereof will be described with reference to FIG. 3.

In addition, the interface provider 112 may provide an interface for transition between the visual message application and the message application while a message is input from the user through the interface of the executed message application. Accordingly, the apparatus 110 for providing a visual message service may allow the message application to operate normally in the process of providing an interface for transition between the visual message application and the message application (for example, the normal operation of the message application may be performed from another terminal. Receiving an input message or inputting a message through a terminal of a user).

Here, the apparatus for providing a visual message service 110 may obtain a message input from a user through an interface of an executed message application. In this case, the acquired message from the user may be used in the process of executing the visual message application in the visual message application execution unit 113. Detailed description thereof will be described with reference to FIG. 2.

As such, since the interface providing unit 112 provides an interface for transition between the visual message application and the message application through the message application, the visual message service providing apparatus 110 provides a visual object editable by a user. The visual message application can be linked with the message application. Therefore, the user can easily use the visual message application linked with the message application through the message application.

The visual message application executing unit 113 executes the visual message application in response to the user's selection through the interface provided by the interface providing unit 112.

At this time, the visual message application execution unit 113 may automatically execute the visual message application in response to the execution of the message application when a specific function is performed in the user terminal. For example, when a call reception function or a call origination function is performed in a user's terminal, the visual message application may be automatically executed in response to the execution of the message application. Therefore, when the user is difficult to answer the call, if the call reception function is being performed on the user's terminal, instead of sending a text message such as "Now meeting" or "Now driving" to the other party, By using a visual message application that is automatically executed in response to the application being executed, a visual object representing a situation in which a call is not received may be transmitted to the counterpart. Similarly, when the user is making a call, the user may express the purpose of making the call using the visual object instead of the text message.

In this way, the user may use a visual object that expresses the expression desired by the user in detail and freedom through a visual message application that provides the visual object editable by the user.

Here, the visual message application execution unit 113 recommends at least one editable visual object to a user, a function of changing at least one editable visual object, and data corresponding to the changed at least one editable visual object. Function to generate and store in the device database (not shown in the figure) included in the visual message service providing device 110, and to transmit data corresponding to the changed at least one editable visual object to the server 120 and the changed At least one editable visual object may have a function of delivering to a message application. Detailed description thereof will be described with reference to FIG. 2.

The server 120 may store and maintain information on at least one editable visual object changed through the visual message application in a server database. At this time, the updated server database in which information about the changed at least one editable visual object is stored and updated may be linked with a device database provided in a terminal of a user or a terminal of another user different from the user. Thus, when using the changed at least one editable visual object repeatedly, the user or another user distinct from the user can use the changed at least one editable visual object without further manipulation.

In addition, the apparatus 110 for providing a visual message service interoperates a visual message application with a phone book of a user terminal, thereby allowing various applications based on at least one editable visual object changed in the visual message application based on the phone book of the user terminal. Available at In this case, the visual message application may be executed independently of the message application instead of being executed in conjunction with the message application.

2, the visual message application executing unit may include a visual object providing unit 210, a visual object selecting unit 220, a user manipulation receiving unit 230, and a visual object changing unit 240.

The visual object provider 210 may provide a plurality of editable visual objects through the executed message application. Here, the information about each of the plurality of editable visual objects may be stored in advance in the form of a syntax table in the device database included in the visual message service providing device. Accordingly, the visual object providing unit 210 may provide a plurality of editable visual objects in a list form or an image form by using a syntax table stored in the device database.

In this case, the information on each of the plurality of editable visual objects may include an image, metadata, or a thumbnail. In addition, an image for each of the plurality of editable visual objects may be expressed in a schema of an XML form, and may be at least one of a static image or a dynamic image.

The visual object selector 220 may select at least one editable visual object from among the plurality of editable visual objects. Here, the visual object selector 220 may select at least one editable visual object from among the plurality of editable visual objects in response to input of at least one of text, voice, touch, or image from the user.

For example, the visual object selector 220 may provide text, voice, touch (drag / drop) or a plurality of editable visual objects provided through the interface of the visual message application from the user through the interface of the visual message application. At least one of the images may be input, and in response, at least one editable visual object may be selected. More specifically, for example, in order to select a road visual object that is index 1 of a plurality of editable visual objects provided by a user, the text “1” or “road” is input in an input window of an interface of a visual message application. Or a voice input such as "No. 1" or "Road", a touch input of the No. 1 index or road visual object, or a gaze input of staring at the area where the No. 1 index or road visual object is displayed, The visual object selector 220 may select a road visual object having index 1.

In this case, the visual object selection unit 220 may support multiple languages, thereby recognizing that at least one of text or voice is input from the user in multiple languages. In addition, the visual object selector 220 may recognize that an image is input from a user by using an image-based face shape recognition algorithm (eg, eye tracking algorithm) or a gesture recognition algorithm (eg, a hand gesture recognition algorithm). have. Detailed description thereof will be omitted since it departs from the technical idea of the present invention.

Also, the visual object selector 220 may automatically recommend at least one editable visual object to the user by automatically selecting at least one editable visual object among the plurality of editable visual objects. In detail, the visual object selecting unit 220 may include a message received through the executed message application (a message received from another user different from the user) or a message input by the user through the executed visual message application (as described above). The at least one editable visual object of the plurality of editable visual objects may be selected based on at least one of a message input from a user acquired by the apparatus for providing a visual message service.

For example, if the user inputs the message "road" in the message application, the visual object selecting unit 220 may execute a visual message application and then execute a visual object corresponding to "road" among a plurality of editable visual objects. By selecting, it is possible to automatically recommend the visual object corresponding to the "road" to the user.

As such, the visual message service providing apparatus 220 may automatically select at least one editable visual object from among the plurality of editable visual objects, so that the apparatus for providing a visual message service may be assigned to each of the plurality of editable visual objects in the device database. In the process of storing the information about the information, the association map may be additionally stored by applying a weight to the association relationship between the plurality of editable visual objects, and the search function may be supported. Accordingly, the visual object selector 220 automatically selects at least one editable visual object using various recommendation algorithms based on the information of each of the plurality of editable visual objects stored in the device database, thereby recommending to the user. Can be.

The user operation receiver 230 may receive a user's operation on the selected at least one editable visual object. In detail, the user manipulation receiver 230 may receive a manipulation of the user by receiving at least one of text, voice, touch, or image of at least one editable visual object selected from the user through an interface of the visual message application. Can be. Here, the principle in which the user manipulation receiver 230 receives at least one of text, voice, touch, or image from the user through the interface of the visual message application is described in detail above. It may be the same as the principle of receiving at least one of a text, a voice, a touch, or an image through a user.

The visual object changing unit 240 may change at least one editable visual object selected in response to a user's manipulation. Specifically, the visual object changing unit 240 changes the at least one editable visual object for the at least one selected editable visual object by using a syntax table stored in the device database in advance, and changes the at least one editable visual object. Data corresponding to the object may be generated. In this case, the information on each of the plurality of editable visual objects stored in the device database is characterized in that the physical, chemical and logical properties (eg, two) of each of the plurality of editable visual objects are combined when the plurality of editable visual objects are combined with each other. When two visual objects overlap, each physically set position, when two visual objects are placed nearby, where they should be joined automatically, or when two visual objects overlap, chemically and logically generated visuals Information of the object). Accordingly, the visual object changing unit 240 may change the at least one editable visual object selected in response to a user's manipulation based on the device database.

For example, if a user selects a road visual object and a car visual object among a plurality of editable visual objects, and manipulates the car visual object as if running on the road visual object, the visual object changing unit 240 may change the user. In response to the manipulation of the vehicle visual object, the vehicle visual object on the changed road may be generated as the vehicle visual object runs on the road visual object. Detailed description thereof will be described with reference to FIG. 5.

In addition, the visual object changing unit 240 may generate data corresponding to the changed at least one editable visual object, store the data in the device database, and transmit data corresponding to the changed at least one editable visual object to the server. It may be.

In addition, the visual object changer 240 may deliver the changed at least one editable visual object to the message application. In detail, the visual object changing unit 240 may change the based on a user's input received at an interface for delivering the changed at least one editable visual object provided to at least part of an interface of the visual message application to the message application. At least one editable visual object may be delivered to the message application. Accordingly, the apparatus for providing a visual message service may enable the user to use the visual object in the message application by delivering at least one editable visual object changed in the visual message application to the message application.

In addition, since the visual message application may be linked with the phone book of the user's terminal, the visual object changer 240 may deliver the changed at least one editable visual object to various applications based on the phone book.

In the interface of the visual message application executed by the visual message application execution unit, a plurality of menus may be displayed based on at least one of the shape, size, or movement of the user. At this time, the interface of the visual message application may be a button-based interface displayed on the user's terminal. Detailed description thereof will be described with reference to FIG. 4.

Referring to FIG. 3 showing a terminal screen of a user on which a message application is executed according to an embodiment of the present invention, the message application is described as an SMS application providing an interface of an SMS, but is not limited thereto. Or IMS application.

Here, an interface 320 for transition between the message application and the visual message application may be provided in at least some areas of the interface 310 provided by the message application. Accordingly, the apparatus for providing a visual message service may execute the visual message application while executing the message application in response to the user's selection through the interface 320 for transition between the message application and the visual message application. For example, while the user inputs a message through the interface 310 of the message application, when the user touches the interface 320 for transition between the message application and the visual message application, the visual message application may be executed.

Referring to FIG. 4, which illustrates a terminal screen of a user on which a visual message application is executed, the interface 410 of the visual message application may be a button-based interface. In detail, the plurality of menus 420 may be displayed on the interface 410 of the visual message application based on at least one of a user's hand shape, size, or movement. For example, the plurality of menus 420 may be displayed based on at least one of the shape, size, or movement of the user's hand so that the user can comfortably use it with one hand.

In addition, the plurality of menus 420 may be totally hidden or displayed in response to a user's input through the menu hide / display button 421. The plurality of menus 420 may include a first menu button 422 for providing a plurality of editable visual objects and a second for allowing a user to select at least one editable visual object among the plurality of editable visual objects. A menu button 423, a third menu button 424 for automatically selecting at least one editable visual object among the plurality of editable visual objects, and at least one editable visual object changed by the user to the message application And a fourth menu button 425 for transferring and a fifth menu button 426 for delivering at least one editable visual object changed by the user to another application. However, the plurality of menus 420 may include, but are not limited to, a menu for performing various functions.

In response to the user's touch input of the first menu button 422, the second menu button 423, or the third menu button 424, the visual message application may perform visual object editing. Referring to FIG. 5, which illustrates a terminal screen of a user on which visual object editing is performed, the user touches the visual object list area 511 in the interface of a visual message application, thereby editing the plurality of edits through the visual object image area 512. Possible visual objects can be provided. Subsequently, the user performs a touch input on the car visual object and the road visual object, which are at least one editable visual object of the plurality of editable visual objects, thereby moving the selected at least one editable visual object to the editing area 513. You can pull it.

In addition, the apparatus for providing a visual message service may edit at least one of the plurality of editable visual objects based on at least one of a message received through the executed message application or a message input by the user through the executed visual message application. By automatically selecting possible visual objects, one may recommend at least one editable visual object to the user. The recommended at least one editable visual object may be moved to and displayed in the edit area 513 and may be changed by the user.

The user can then edit the selected at least one editable visual object using the various edit menus in the edit area 513. The apparatus for providing a visual message service may change at least one editable visual object in response to a user's manipulation received through the editing area 513. For example, if a user overlaps a car visual object with a road visual object and enters the text "running" in the text input area 514, the visual message service providing apparatus overlaps the car visual object over the road visual object, The car visual object and the road visual object can be changed so that the visual object takes a running motion.

Although not shown in the drawing, a plurality of menus (eg, visual object list area 511, visual object image area 512, editing area 513, text input area 514) of an interface on which visual object editing is performed may be performed. The confirmation area 515 may be displayed on a button basis based on at least one of a hand shape, a size, or a movement of the user.

The at least one editable visual object thus modified may be delivered to the message application after being confirmed by the user through an input to the confirmation area 515. For example, the apparatus for providing a visual message service receives the changed at least one editable visual object from the user through the confirmation area 515, and then inputs the user to the fourth menu button in the visual message application illustrated in FIG. 4. By receiving, the changed at least one editable visual object can be delivered to the message application. In this case, the changed at least one editable visual object may be delivered to the message application only through the input to the confirmation area 515 without receiving the user's input to the fourth menu button.

Referring to FIG. 6, the apparatus for providing a visual message service according to an embodiment of the present invention executes a message application (610). In this case, the apparatus for providing a visual message service may execute at least one of a Short Message Service (SMS), a Multimedia Message Service (MMS), or an IP Multimedia Subsytem (IMS) application as a message application.

Subsequently, the apparatus for providing a visual message service distinguishes from the message application through the message application and provides an interface for transition between the visual message application and the message application that provides a visual object editable by the user (620). In this case, the apparatus for providing a visual message service may provide an interface for transition between the visual message application and the message application in at least part of an interface of the message application.

In addition, the apparatus for providing a visual message service may further include acquiring a message input by the user through the executed message application, and may provide an interface while the message is input by the user.

In operation 630, the apparatus for providing a visual message service executes the visual message application in response to the user's selection through the interface. Detailed description thereof will be described with reference to FIG. 7.

In addition, the apparatus for providing a visual message service may automatically execute the visual message application in response to the execution of the message application when a specific function is performed in the user terminal.

Referring to FIG. 7, the apparatus for providing a visual message service according to an embodiment of the present invention may provide a plurality of editable visual objects through the executed visual message application (710).

In operation 720, the apparatus for providing a visual message service may select at least one editable visual object from among the plurality of editable visual objects.

In this case, the apparatus for providing a visual message service may edit at least one of the plurality of editable visual objects based on at least one of a message received through the executed message application or a message input by the user through the executed message application. You can select the possible visual objects.

On the other hand, the apparatus for providing a visual message service may select at least one editable visual object among a plurality of editable visual objects in response to input of at least one of text, voice, touch, or image from the user. In this case, the apparatus for providing a visual message service may receive at least one of text, voice, touch, or image from a user through an interface of a visual message application. In the interface of the visual message application, a plurality of menus may be displayed based on at least one of a user's hand shape, size, or movement. In addition, an interface for delivering the changed at least one editable visual object to the message application may be provided in at least some areas of the interface of the visual message application.

In operation 730, the apparatus for providing a visual message service may receive a user's manipulation of the selected at least one editable visual object. In this case, the apparatus for providing a visual message service may receive a user's manipulation by receiving at least one of text, voice, touch, or video for at least one editable visual object selected from a user through an interface of a visual message application. have.

Thereafter, the apparatus for providing a visual message service may change the selected at least one editable visual object in response to the user's manipulation (740).

In this case, the apparatus for providing a visual message service may change the at least one editable visual object to the changed at least one editable visual object by using a pre-stored syntax table for the at least one selected editable visual object. Corresponding data can be generated. In addition, the apparatus for providing a visual message service may generate data corresponding to the changed at least one editable visual object, store the data in the device database included in the apparatus for providing the visual message service, or transmit the data to the server.

In addition, although not shown in the drawing, the apparatus for providing a visual message service may deliver the changed at least one editable visual object to the message application.

Referring to FIG. 8, the apparatus for providing a visual message service according to an embodiment of the present invention may be mounted in a user terminal 820 that is physically distinct from the wearable device 810 as in the case of (a), and (b). ) May be mounted in the wearable device 810. Hereinafter, the wearable device 810 will be described as a watch-type device, but the present invention is not limited or limited to this, and may be various types of devices worn on a user's body. For example, the wearable device 810 may be a device worn on a user's body in the form of a necklace, a belt, or a clothes.

In the case of (a), the apparatus for providing a visual message service displays a visual message interface on a display window of the user terminal 820, thereby providing a plurality of visual objects editable by a user through the visual message interface, and providing at least one visual. Selecting an object and changing the at least one selected visual object in response to the user's operation by receiving the user's manipulation of the selected at least one visual object. Thereafter, the apparatus for providing a visual message service delivers the changed at least one visual object to the wearable device 810 that is wirelessly connected, so that the user can use the visual message service in the wearable device 810.

In the case of (b), the apparatus for providing a visual message service displays a visual message interface on a display window of the wearable device 810, thereby providing a plurality of visual objects editable by a user through the visual message interface, and providing at least one visual object. Selecting an object and changing the at least one selected visual object in response to the user's operation by receiving the user's manipulation of the selected at least one visual object. Thereafter, the apparatus for providing a visual message service delivers the changed at least one visual object to the controller of the wearable device 810 by wire connection (which means that the apparatus for providing the visual message service is mounted inside the wearable device 810). The user may use the visual message service in the wearable device 810.

The visual message service providing apparatus operating as described above generates data corresponding to the changed at least one visual object and stores the data in a device database included in the visual message service providing apparatus, or a server database of a separate server (not shown). By transmitting to, the next time the user uses the visual message service, the modified at least one visual object may be used without going through a separate editing process.

Referring to FIG. 9, a wearable device provided with a visual message service according to an embodiment of the present invention may be a watch-type device. Here, the user may use the changed at least one visual object received from the visual message service device in the wearable device.

For example, the visual message service device selects at least one visual object from among a plurality of visual objects based on the user's body information measured from the wearable device, changes the selected at least one visual object, and changes the at least one changed. By transmitting the visual object to the wearable device, the body information of the user in the wearable device may be displayed as the changed at least one visual object according to a presentation method desired by the user. More specifically, the visual message service device wears the changed running person visual object 920 by selecting the running person visual object based on the user's heart rate 910 and changing the selected running person visual object. By delivering to the device, the heart rate 910 of the user in the wearable device may be represented and displayed as a modified running human visual object 920.

Referring to FIG. 10, the apparatus for providing a visual message service according to an embodiment of the present invention provides a plurality of visual objects that can be edited by a user through the visual message interface (1010).

In this case, the apparatus for providing a visual message service may automatically provide a plurality of visual objects through a visual message interface when a specific function is performed in the wearable device. The specific function performed by the wearable device may include a user's body information display function, a short message service (SMS) function, a multimedia message service (MMS) function, an IP multimedia subsystem (IMS) function, a social networking service (SNS) function, or a telephone. It may be at least one of a reception / outgoing function.

In operation 1020, the apparatus for providing a visual message service selects at least one visual object from among the plurality of visual objects.

In this case, the apparatus for providing a visual message service may select at least one visual object based on a user's selection input to the plurality of visual objects.

In addition, the apparatus for providing a visual message service additionally performs a process of extracting a message received from a user through another interface different from the visual message interface, thereby generating at least one visual object among the plurality of visual objects based on the extracted message. You can also choose.

In addition, the apparatus for providing a visual message service may select at least one visual object from among a plurality of visual objects based on the user's body information measured from the user.

In operation 1030, the apparatus for providing a visual message service receives a user's manipulation of the selected at least one visual object.

In this case, the apparatus for providing a visual message service receives at least one of text, voice, touch, or image for at least one visual object selected through the visual message interface from the user, thereby operating the user on the at least one selected visual object. Can be received.

In operation 1040, the apparatus for providing a visual message service changes the selected at least one visual object in response to a user's manipulation.

In this case, the apparatus for providing a visual message service may change the at least one selected visual object and then generate data corresponding to the changed at least one visual object by using a pre-stored syntax table for the at least one selected visual object. have. The data corresponding to the changed at least one visual object is stored in the device database included in the visual message service providing apparatus or transmitted to and stored in a server database of a separate server, so that the next time the user uses the visual message service, the editing process It is possible to use the changed at least one visual object without going through.

Thereafter, the apparatus for providing a visual message service may transmit the changed at least one visual object to a wearable device connected to at least one of wireless or wired in response to a user's input (1050). Accordingly, the user may use at least one visual object changed in the wearable device.

In the visual message interface provided by the apparatus for providing a visual message service, a plurality of menus may be displayed based on at least one of a user's hand shape, size, or movement.

Referring to FIG. 11, the apparatus for providing a visual message service interoperating with the wearable device includes a provider 1110, a selector 1120, a receiver 1130, and a changer 1140. In this case, the apparatus for providing a visual message service may be connected to at least one of a wearable device and a wired or wireless wire, thereby allowing a user to use the visual message service through the wearable device.

The provider 1110 provides a plurality of visual objects that can be edited by a user through the visual message interface. Here, the information about each of the plurality of visual objects may be stored in advance in the form of a syntax table in the device database included in the visual message service providing apparatus. Accordingly, the provider 1110 may provide a plurality of visual objects in a list form or an image form through a visual message interface using a syntax table stored in the device database. In this case, the information on each of the plurality of visual objects may include an image, metadata, or a thumbnail. In addition, the image for each of the plurality of visual objects may be expressed in a schema of XML form, and may be at least one of a static image or a dynamic image.

In addition, when a specific function is performed in the wearable device, the provider 1110 may automatically provide a plurality of visual objects through a visual message interface. For example, the wearable device displays the user's body information, a short message service (SMS) function, a multimedia message service (MMS) function, an IP multimedia subsystem (IMS) function, a social networking service (SNS) function, or an incoming / outgoing call. When a specific function such as a function is being performed, the visual message interface may be provided in some areas of the interface provided by the specific function. Detailed description thereof will be described below.

The selector 1120 selects at least one visual object from among the plurality of visual objects. Here, the selector 1120 may select at least one visual object based on a selection input such as text, voice, touch, or image of the user for the plurality of visual objects. For example, the selector 1120 receives at least one of a text, a voice touch (drag / drop), or an image from a user with respect to the plurality of visual objects through a visual message interface, and in response thereto, at least one visual object. Can be selected. For more specific example, in order to select a jogging visual object that is the index 1 of the plurality of provided visual objects, the user inputs the text "No. 1" or "jogging" in the input window of the visual message interface, or "1". When a voice input such as "Burn" or "jogging" is performed, a touch input of index 1 or a jogging visual object is performed, or a gaze input of staring at the index 1 or jogging visual object is performed, the selection unit 1120 is performed. ) Can select a jogging visual object that is index 1.

In this case, the selector 1120 may support multiple languages, thereby recognizing that at least one of text or voice is input from the user in multiple languages. In addition, the selector 1120 may recognize that an image is input from the user by using an image-based face shape recognition algorithm (eg, eye tracking algorithm) or a gesture recognition algorithm (eg, a hand gesture recognition algorithm). Detailed description thereof will be omitted since it departs from the technical idea of the present invention.

In addition, the selector 1120 may automatically select at least one visual object from among the plurality of visual objects, thereby recommending at least one visual object to the user. Specifically, the selector 1120 receives a message extracted from an extractor (not shown) that extracts a message input from a user through another interface different from the visual message interface, and receives the extracted message from the extracted message. At least one visual object may be selected from among the plurality of visual objects. For example, if the message "jogging" is input from the user through another interface different from the visual message interface (for example, an interface such as SMS, MMS, IMS, or SNS provided by the wearable device), it is extracted by the extractor. The message "jogging" is transmitted to the selection unit 1120, and the selection unit 1120 automatically selects a visual object corresponding to "jogging" among a plurality of visual objects, thereby automatically visualizing the user corresponding to "jogging". You can recommend an object.

As such, the visual message service providing apparatus may store information about each of the plurality of visual objects in the device database so that the selector 1120 may automatically select at least one visual object from among the plurality of visual objects. An association map may be additionally stored by applying a weight to an association relationship between a plurality of visual objects and may support a search function. Therefore, the selector 1120 may automatically select at least one visual object by using various recommendation algorithms based on the information of each of the plurality of visual objects stored in the device database, thereby recommending it to the user.

Also, the selector 1120 may select at least one visual object from among the plurality of visual objects based on the user's body information measured by the user. For example, when the user's body information such as heart rate, blood pressure or body temperature measured by the wearable device is transmitted to the selection unit 1120, the selection unit 1120 may select a user such as heart rate, blood pressure or body temperature among a plurality of visual objects. At least one visual object corresponding to each of the body information may be selected.

The receiver 1130 receives a user's manipulation of the selected at least one visual object. In detail, the receiving unit 1130 may receive a user's manipulation by receiving at least one of text, voice, touch, or image for at least one visual object selected from the user through the visual message interface. Here, the principle that the receiver 1130 receives at least one of text, voice, touch, or image from the user through the visual message interface is that the selection unit 1120 described above is text, voice, and touch from the user through the visual message interface. Or it may be the same as the principle of receiving at least one of the image.

The changer 1140 changes at least one visual object selected in response to a user's manipulation. In detail, the changer 1140 may change at least one visual object with respect to the selected at least one visual object using a syntax table stored in the device database in advance, and generate data corresponding to the changed at least one visual object. Can be. At this time, the information on each of the plurality of visual objects stored in the device database is characterized in that when the plurality of visual objects are combined with each other, the physical, chemical and logical properties of each of the plurality of visual objects (eg, two visual objects overlap). Each position that is physically set, a position that should be automatically joined when two visual objects are placed nearby, or information about a chemical object that is chemically and logically generated when two visual objects overlap. can do. Accordingly, the changer 1140 may change the at least one visual object selected in response to a user's manipulation based on the device database.

For example, if the user selects a road visual object and a car visual object among a plurality of visual objects, and manipulates the car visual object as if running on the road visual object, the changer 1140 responds to the user's operation. The car visual object may be generated on the changed road as the car visual object runs on the road visual object. Detailed description thereof will be described with reference to FIG. 4.

In addition, the changer 1140 may generate data corresponding to the changed at least one visual object, store the data in the device database, and transmit the data corresponding to the changed at least one visual object to a server database of a separate server. . Therefore, when the user next uses the visual message service, the user may use the changed at least one visual object without undergoing a separate editing process.

Although not shown, the apparatus for providing a visual message service may further include a delivery unit. Here, the transfer unit may transmit the changed at least one visual object to the wearable device connected to at least one of wireless or wired in response to a user input. In detail, the transfer unit may transmit the changed at least one visual object to the wearable device in response to a user input received through the visual message interface. Accordingly, the user may use at least one visual object changed in various functions performed in the wearable device.

For example, a user may display at least one changed visual object, which is delivered from a visual message service providing apparatus, a body information display function, an SMS function, an MMS function, an IMS function, an SNS function, or an incoming / outgoing call of a user performed on a wearable device. It can be used in a function. Detailed description thereof will be described with reference to FIG. 9. In addition, the user may use the changed at least one visual object transmitted from the apparatus for providing a visual message service in an avatar function provided by the wearable device (eg, displaying an avatar representing the user on a display window of the wearable device).

In this case, when a specific function is performed in the wearable device, the providing unit 1110 may operate automatically, such that the selector 1120, the receiver 1130, the changer 1140, and the transfer unit may operate in order. . For example, when a call reception function is performed in the wearable device, the provider 1110 automatically provides a plurality of visual objects to a user through a visual message interface, and selects the selector 1120, the receiver 1130, and the user. The visual object expressing a situation in which the part 1140 and the delivery unit operate in order and does not answer the call through the visual message interface, instead of transmitting a text message such as "Now meeting" or "Now driving" to the other party, May be sent to. Similarly, when the user is making a call, the user may express the purpose of making the call using the visual object instead of the text message.

As described above, the user may use the visual object in the wearable device to express the expression desired by the user in detail and freely through the visual message interface providing the visual object editable by the user.

In this case, a plurality of menus may be displayed on the visual message interface provided by the apparatus for providing a visual message service based on at least one of a user's hand shape, size, or movement. In this case, when the apparatus for providing a visual message service is mounted on a user terminal distinguished from the wearable device, the visual message interface may be a button-based interface displayed on a display window of the user terminal, and when mounted on the wearable device, the wearable device It may be a button-based interface displayed on the display window of the.

Various application examples:

* Send out of office message

Embodiments of the present invention may deliver a missed message through a wearable device using a visual message.

For example, assume that user a in a meeting or in the subway received a call from user b. At this time, user a may transmit a response to the call from user b as a visual message.

1) User A: When receiving a call while in a meeting, send a 'in conference' visual object.

2) User B: Receives a 'in a meeting' visual object, and transmits a 'when is it over' (ex_clock object) object selected among recommended visual objects [when is it over?

3) User A: Creates a recommended visual object through the received visual object ['after 30 minutes' / 'after 1 hour' object], edits and transmits at least one of the recommended visual objects.

I. When you reject a call, the missed message is created on the screen.

* Ability to add information in visual objects

When user A sends a visual object message to user B, the visual object message contains hidden content, and only user B may further check the hidden content.

In addition, if a user sends a visual object message with a TIMER set to the user B, and the user B does not check / receive the visual object message until the timer expires, the visual object message or a hidden message is sent to the friends around the user B. Can be delivered automatically. Friends can reply to a pre-set reply to the received message. At this time, friends can use the Internet, disaster network, emergency network, and can send a response message in various forms, such as SMS, SNS, beacons.

* Disaster / Emergency Message Service

According to embodiments of the present invention, a message including a visual object may be generated by a user in a short time compared to text. Accordingly, in case of an emergency such as an earthquake or tsunami, a disaster / emergency message service provider, an administrator, or users may transmit a message including a visual object to other users in the vicinity as an emergency message.

In addition, according to embodiments of the present invention, since a visual object represented in the form of a schema is used, the size of an emergency message can be minimized, and an emergency message can be generated with a size smaller than 93 bytes according to an international standard. have. Such emergency messages can be particularly effective in explaining the situation to foreigners.

Although the embodiments have been described by the limited embodiments and the drawings as described above, various modifications and variations are possible to those skilled in the art from the above description. For example, the described techniques may be performed in a different order than the described method, and / or components of the described systems, structures, devices, circuits, etc. may be combined or combined in a different form than the described method, or other components. Or even if replaced or substituted by equivalents, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and equivalents to the claims are within the scope of the claims that follow.

Claims

Executing a message application;

Providing an interface for transition between the message application and a visual message application that is distinguished from the message application and provides a visual object editable by a user through the message application; And

In response to the user's selection through the interface, executing the visual message application.

Visual message service providing method comprising a.
The method of claim 1,

Providing the interface

And providing an interface for transition between the visual message application and the message application in at least a portion of an interface of the message application.
The method of claim 1,

Acquiring a message input by the user through the executed message application

More,

Providing the interface

Providing the interface while the message is being input by the user.
The method of claim 1,

Running the visual message application

Providing a plurality of editable visual objects through the executed visual message application;

Selecting at least one editable visual object of the plurality of editable visual objects;

Receiving the user's manipulation of the selected at least one editable visual object; And

Changing the selected at least one editable visual object in response to the user's manipulation

Visual message service providing method comprising a.
The method of claim 4, wherein

Changing the selected at least one editable visual object

Generating data corresponding to the changed at least one editable visual object using a pre-stored syntax table for the selected at least one editable visual object

Visual message service providing method comprising a.
The method of claim 4, wherein

Selecting the at least one editable visual object

Based on at least one of a message received through the executed message application or a message input by the user through the executed message application, the at least one editable visual object of the plurality of editable visual objects is selected. Step to choose

Visual message service providing method comprising a.
The method of claim 4, wherein

Selecting the at least one editable visual object

Selecting at least one editable visual object from among the plurality of editable visual objects in response to input of at least one of text, voice, touch, or image from the user

Visual message service providing method comprising a.
The method of claim 4, wherein

Receiving the user's operation

Receiving at least one of text, voice, touch, or video for the selected at least one editable visual object through an interface of the visual message application from the user;

Visual message service providing method comprising a.
The method of claim 8,

At least a portion of an interface of the visual message application may be

And providing an interface for delivering the changed at least one editable visual object to the message application.
The method of claim 1,

Running the visual message application

Automatically executing the visual message application in response to the execution of the message application when a specific function is performed in the user terminal.

Visual message service providing method comprising a.
In the method of providing a visual message service in conjunction with a wearable device (wearable device),

Providing a plurality of visual objects editable by a user via a visual message interface;

Selecting at least one visual object of the plurality of visual objects;

Receiving an operation of the user on the selected at least one visual object; And

In response to the user's manipulation, changing the selected at least one visual object

How to provide a visual message service comprising a.
The method of claim 11,

Transmitting the changed at least one visual object to a wearable device connected to at least one of wireless and wired in response to the user's input.

The method of providing a visual message service further comprising.
The method of claim 11,

Providing the plurality of visual objects

And providing a plurality of visual objects automatically through the visual message interface when a specific function is performed in the wearable device.
The method of claim 13,

The specific function performed by the wearable device is

At least one of the user's body information display function, SMS (Short Message Service), MMS (Multimedia Message Service), IMS (IP Multimedia Subsytem), SNS (Social Networking Service), or a call reception / call function How to provide a visual message service.
The method of claim 11,

Changing the selected at least one visual object

Generating data corresponding to the changed at least one visual object by using a pre-stored syntax table for the selected at least one visual object

The method of providing a visual message service further comprising.
The method of claim 11,

Selecting the at least one visual object

Selecting the at least one visual object based on the user's selection input for the plurality of visual objects

How to provide a visual message service comprising a.
The method of claim 11,

Extracting a message received from the user through another interface distinct from the visual message interface

More,

Selecting the at least one visual object

Selecting the at least one visual object among the plurality of visual objects based on the extracted message

How to provide a visual message service comprising a.
The method of claim 11,

Selecting the at least one visual object

Selecting the at least one visual object among the plurality of visual objects based on the user's body information measured from the user

How to provide a visual message service comprising a.