KR20180122308A - Method, device, system and non-transitory computer-readable recording medium for providing user interface - Google Patents

Abstract

According to an aspect of the present invention, a method for providing a user interface includes a step (a) of acquiring information about the attitude or motion of a first device and a second device and detecting an input event specified based on a relative relationship between the attitude or movement of the first device and the attitude or movement of the second device and a step (b) of preventing at least some of content and functions provided on the first device being provided on the second device in correspondence with the generation of the input event or providing at least some of content and functions provided on the second device onto the first device. It is possible to provide a user with a more convenient and expanded user interface.

Description

≪ Desc / Clms Page number 1 > METHOD, DEVICE, SYSTEM AND NON-TRANSITORY COMPUTER READABLE RECORDING MEDIUM FOR PROVIDING USER INTERFACE,

The present invention relates to a method, a device, a system and a non-transitory computer-readable recording medium for providing a user interface.

In recent years, mobile smart devices having various communication and sensing functions and powerful computing functions such as smart phones and smart pads are widely used. Some of these mobile smart devices include a relatively small size that can be worn on the body by a user (e.g., smart devices in the form of smart glasses, smart watches, smart bands, rings or broaches, Smart devices that are attached or embedded).

In this situation, you might want to do something with your own two or more (heterogeneous) smart devices, or try to do something that needs to involve your smart device and another user's devices together . However, according to the prior art, the (potential) intention of such a user could not be adequately supported.

It is an object of the present invention to solve all the problems described above.

The present invention also provides a method for obtaining information about an attitude or a motion of a first device and a second device and acquiring an input event specified based on a relative relationship between the attitude or motion of the first device and the attitude or motion of the second device At least a part of the content and the function provided on the first device is provided on the second device or the content and the function provided on the second device are provided on the first device in response to the occurrence of the input event So as to provide a more convenient and extended user interface to the user by using the relative relationship between the attitudes or movements of two or more devices.

In order to accomplish the above object, a representative structure of the present invention is as follows.

According to one aspect of the present invention there is provided a method for providing a user interface, comprising: (a) acquiring information about a pose or motion of a first device and a second device, Detecting an input event that is specified based on a relative relationship between the attitude or movement of the device, and (b) at least some of the content and functions provided on the first device corresponding to the occurrence of the input event The method comprising providing at least a portion of the content and the functionality provided on the second device to be provided on the second device or on the first device.

According to another aspect of the present invention, there is provided a device for providing a user interface, comprising: information obtaining means for obtaining information about a posture or motion of the device and another device associated with the device; At least a part of contents and functions provided on the device are provided on the other device in correspondence with the occurrence of the input event, There is provided a device comprising a program module for causing at least some of the content and functions provided on another device to be provided on the device.

According to another aspect of the present invention, there is provided a system for providing a user interface, the system comprising: means for obtaining information about a posture or a motion of a first device and a second device, Detecting an input event that is specified based on a relative relationship between the attitude or motion and causing at least a part of the content and the function provided on the first device to be provided on the second device in response to the occurrence of the input event A control unit for causing at least a part of contents and functions provided on the second device to be provided on the first device and a storage for storing information provided from at least one of the first device and the second device, / RTI >

In addition, there is further provided a non-transitory computer-readable recording medium for recording a computer program for carrying out the method and a device, system, and other methods for implementing the invention.

According to the present invention, it is possible to provide a more convenient and extended user interface to the user by using the relative relationship between the attitudes or movements of two or more devices.

Further, according to the present invention, even if a user holding a first device in the same hand while wearing a second device in a body part of a wrist or the like performs an action of flipping his / her hand (i.e., flip) The effect that content (or function) provision status in the first device and the second device can be switched between each other is achieved.

According to the present invention, a user holding both the first device and the second device facing each other in different directions can move the first device and the second device in the same direction regardless of the posture or direction of the hand holding these devices The content or the function can be provided in a state in which the continuity thereof is maintained.

Further, according to the present invention, only the first user and the second user holding the first device and the second device perform a simple action corresponding to an input event, Function) can be continuously shared.

1 is a diagram showing a schematic configuration of an overall system for providing a user interface according to an embodiment of the present invention.
2 is a diagram conceptually showing a configuration in which a content (or function) provision state is switched between a first device and a second device according to an embodiment of the present invention.
FIGS. 3 to 5 are views illustrating a configuration for providing a user interface according to an embodiment of the present invention.
6 is a diagram illustrating a configuration in which a format of content provided on a first device and a format of content provided on a second device are different from each other according to an embodiment of the present invention.
7 is a diagram illustrating a configuration in which content stored in a first device is transmitted to a second device according to an embodiment of the present invention.
8 to 15 are views illustrating a configuration in which a user interface is provided according to another embodiment of the present invention.
Figures 16-22 are illustrations of a user interface being actually demonstrated in accordance with various embodiments of the present invention.

The following detailed description of the invention refers to the accompanying drawings, which illustrate, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different, but need not be mutually exclusive. For example, certain features, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention in connection with an embodiment. It is also to be understood that the position or arrangement of the individual components within each disclosed embodiment may be varied without departing from the spirit and scope of the invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is to be limited only by the appended claims, along with the full scope of equivalents to which such claims are entitled, if properly explained. In the drawings, like reference numerals refer to the same or similar functions throughout the several views.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, so that those skilled in the art can easily carry out the present invention.

Configuration of the entire system

1 is a diagram showing a schematic configuration of an overall system for providing a user interface according to an embodiment of the present invention.

1, an overall system according to an exemplary embodiment of the present invention may include a communication network 100, a user interface providing system 200, and a plurality of devices 310 and 320.

First, the communication network 100 according to an embodiment of the present invention may be configured without regard to communication modes such as wired communication and wireless communication, and may be a LAN (Local Area Network), a Metropolitan Area Network ), A wide area network (WAN), and the like. Preferably, the communication network 100 referred to herein may be the well-known Internet or World Wide Web (WWW). However, the communication network 100 may include, at least in part, a known wire / wireless data communication network, a known telephone network, or a known wire / wireless television communication network, without being limited thereto.

Next, the user interface providing system 200 according to an embodiment of the present invention may be a digital device having memory means and equipped with a microprocessor and having computation capability. The user interface providing system 200 may be a server system. The user interface providing system 200 may be configured to provide predetermined information or control commands to the other one of the devices 310 and 320 through the communication network 100 or to provide predetermined information or control commands Can be performed.

To this end, the user interface providing system 200 acquires information about the attitude or motion of the first device and the second device, and acquires information about the attitude or motion of the first device and the motion of the second device Detecting an input event that is specified based on a relative relationship between the attitude or motion and causing at least a part of the content and the function provided on the first device to be provided on the second device, By providing at least a part of the contents and functions provided on the first device to be provided on the first device, it is possible to perform a function of providing a more convenient and extended user interface to the user by using the relative relationship between the attitudes or movements of two or more devices have.

Such a user interface may be provided by a control unit (not shown) included in the user interface providing system 200. Such a control unit may exist in the form of a program module in the user interface providing system 200. Such program modules may take the form of an operating system, application program modules or other program modules. In addition, the program module may be stored in a remote storage device capable of communicating with the user interface providing system 200. A program module, on the other hand, encompasses but is not limited to routines, subroutines, programs, objects, components, data structures, etc. that perform particular tasks or perform particular abstract data types as described below in accordance with the present invention.

The user interface providing system 200 may also store information about attitudes or motions provided from at least one of the plurality of devices 310 and 320 and may be used by at least one of the plurality of devices 310 and 320 Can be performed. Further, the interface providing system 200 stores information constituting contents or functions provided in at least one of the plurality of devices 310 and 320, and transmits the information to at least one of the plurality of devices 310 and 320 And can be further utilized. The above-described storage may be performed by a repository (not shown) included by the user interface providing system 200. Such a repository is a concept including a computer-readable recording medium, and may be a broad database including a data base based on a file system as well as a consultation database.

The function of the user interface providing system 200 will be described in more detail below. Although the description has been made with respect to the user interface providing system 200 as described above, the description is for illustrative purposes only, and at least a part of the functions or components required for the user interface providing system 200 may be a plurality It will be apparent to those skilled in the art that it may be implemented or included in at least one of the devices 310 and 320 of FIG.

The plurality of devices 310 and 320 according to an exemplary embodiment of the present invention may include a user interface providing system 200 or a plurality of devices 310 and 320 , 320 may be separate from each other or may be externalized), and may be a digital device having memory means and a computing device equipped with a microprocessor Can be employed as any of the devices 310 and 320 according to the present invention. Devices 310 and 320 may be smart devices such as smart phones, smart pads, smart glasses, smart watches, smart bands, smart rings, and the like, or may be a desktop computer, a laptop computer, a workstation, a PDA, a web pad, , A keyboard, an electronic pen, and the like. In addition, the devices 310 and 320 may be IoT (Internet of Things) devices such as remote controllers and home appliances.

In particular, according to one embodiment of the present invention, the devices 310 and 320 may include at least one technical means capable of receiving an operation from a user. Examples of such technical means include a touch panel, a pointing tool (e.g., a mouse, a stylus, an electronic pen, etc.), a graphical object that can be operated by a user, a keyboard, a toggle switch, A recognition sensor, a distance sensor, and the like.

In addition, according to an embodiment of the present invention, the devices 310 and 320 may include at least one technical means for acquiring physical information about the posture or movement of the devices 310 and 320. (GPS module, beacon-based positioning module or the like), a barometer, a distance sensor, a camera, and the like, which are known components of this technical means, which are known components such as a motion sensor, an acceleration sensor, a gyroscope, And the like.

In addition, according to an embodiment of the present invention, the device 310 or 320 may be provided with the posture of the device 310 or 320 based on the biometric information obtained from the user's body holding the device 310 or 320, Technological means to obtain physical information about the motion may be included. Examples of such technical means include an electromyogram signal measuring apparatus and the like.

The devices 310 and 320 process the above physical information to provide information or control commands to other devices 310 and 320 or receive information or control commands from other devices 310 and 320 An application program for generating such information or a control command may be further included. Such an application may exist in the form of a program module within the device 310, 320. The nature of such a program module may be generally similar to the control of the user interface providing system 200 as described above. Here, the application may be replaced with a hardware device or a firmware device, at least some of which can perform substantially the same or equivalent functions as necessary.

Meanwhile, according to an embodiment of the present invention, the first device 310 and the second device 320 may have a predetermined relationship (for example, a relation that they belong to the same user, a relation that they function for the same user, , It is recognized that one of them is reasonable to authenticate or permit the other), the first device 310 and the second device 320 May be performed by the user interface providing system 200 or may be performed by the first device 310 and the second device 320. In this case,

Examples

Hereinafter, a specific example in which the user interface providing system 200 according to the present invention provides a user interface through which a plurality of devices 310 and 320 are interleaved according to various embodiments will be described in detail.

According to one embodiment of the present invention, the user interface providing system 200 acquires information on the attitude or motion of the first device 310 and the second device 320, Or an input event that is specified based on the relative relationship between the motion and the posture or movement of the second device 320 and that corresponds to the occurrence of the input event, At least a portion may be provided on the second device 320 or at least some of the content and functionality provided on the second device 320 may be provided on the first device 310. [

In particular, according to an embodiment of the present invention, at least one of the first device 310 and the second device 320 may be moved together with the input means for generating an input event. For example, the first device 310 may be a smart phone that the user can grasp by hand, and the second device 320 may be a smart watch that may be worn on the wearer's wrist.

Also, according to one embodiment of the present invention, an input event that is specified based on the relative relationship between the attitude or motion of the first device 310 and the attitude or motion of the second device 320 may include at least one coordinate axis The direction in which the direction of the first device 310 changes and the direction in which the direction of the second device 320 changes may be opposite to or symmetric with each other. For example, according to an embodiment of the present invention, a user may flip a hand (a so-called flip) holding a first device 310 and wearing a second device 320 on the wrist You can point to the event you are performing.

Meanwhile, according to an embodiment of the present invention, the input event may include a posture or movement of the first device 310 with respect to the first surface and a posture or movement of the second device 310 with respect to the second surface, Based on the relative relationship between the two. Here, the first surface or the second surface may correspond to an upper surface, a lower surface, a left surface, a right surface, a front surface, a rear surface, and the like of the first device 310 or the second device 320.

2 is a diagram conceptually showing a configuration in which a content (or function) provision state is switched between a first device and a second device according to an embodiment of the present invention.

In general, when the user holding the first device 310 by hand and wearing the second device 320 on the wrist of the same hand performs an action of flipping the hand (i.e., flip), the above action The first device 310 or the second device 320 that has provided the content (or the function) to the user while the display screen is looking at the user side is displayed, The screen can not be viewed by the user, and it may become difficult to provide the content (or the function) to the user any more.

Referring to FIG. 2, a user interface providing system 200 according to an embodiment of the present invention includes a first device 310 and a second device 320, In the case of performing the flip operation in which the hands are turned upside down, the above-described actions are performed in such a manner that the direction in which the direction of the first device 310 in the smartphone form changes and the direction in which the direction of the second device 320 in the smart- (Or functions) provided on the first device 310 (or the second device 320) on which the display screen has been looking at the user before the input event occurs, Some of the devices 201 and 202 may be provided on the second device 320 (or the first device 310) on which the display screen is viewed after the input event occurs. Therefore, according to the present invention, the content (or function) provided to the user can be provided while continuing the continuity through both the first device 310 and the second device 320. 16 and 17, it can be seen that the above embodiment is actually being demonstrated.

FIGS. 3 to 5 are views illustrating a configuration for providing a user interface according to an embodiment of the present invention.

3 and 4, when a user wearing the second device 320 on the left wrist and holding the first device 310 with the same left hand performs an action of flipping their left hand (i.e., flip) It is possible to assume the case where In this case, the first device 310, which has been looking at the user side, may no longer look at the user side, but the second device 320 that has not looked at the user side may look at the user side (See FIG. 3). On the contrary, the first device 310, which has not looked at the user side, looks at the user side instead of the second device 320 that is looking at the user side no longer looks at the user side (See FIG. 4).

5, the positions of the first device 310 and the second device 320 measured by a gyroscope included in the first device 310 and the second device 320 are shown in FIG. And the user interface providing system 200 according to an embodiment of the present invention can detect whether or not an input event is generated based on the physical information as shown in Fig. 5 have. 5A and 5B show gyroscope measurement values for the first device 310 and the second device 320, respectively. In FIGS. 5A and 5B, , And the red and green graphs are azimuth (azimuth), respectively. And indicates measured values in the pitch and roll directions.

According to an embodiment of the present invention, at least a part of the contents provided on the first device 310, which has been looking at the user, corresponds to the input event according to the flip action of the user, Or at least a portion of the content provided on the second device 320 that has been looking at the user may be transmitted to the first device 310. [

According to an embodiment of the present invention, in response to an input event occurring due to a flip action of a user, a process executed on the first device 310, which has been looking at the user, Or on the contrary, the process running on the second device 320 that was looking at the user side may be executed on the first device 310. [

According to an embodiment of the present invention, in response to an input event occurring due to a flip action of a user, the first device 310 (or the second device 320) And the format of the content provided on the second device 320 (or the first device 310) after the input event occurs may be different from each other.

6 is a diagram illustrating a configuration in which a format of content provided on a first device and a format of content provided on a second device are different from each other according to an embodiment of the present invention.

Referring to FIG. 6, contents that have been provided in a visual form on the first device 310 before an input event occurs may be provided in an audible or tactile form on the second device 320 after an input event occurs have. For example, if the reading contents provided in the form of text on the first device 310 having a relatively large display screen are relatively small in size of the display screen and are worn in close contact with the user's wrist, 320 may be provided in the form of voice or vibration.

According to an embodiment of the present invention, the input event may be generated by the first device 310 or the second device 320, as well as the relative relationship between the posture or movement of the first device 310, Based on a user operation input to the second device 320. [ For example, a user operation input to the first device 310 or the second device 320 may include a touch operation, a keyboard operation, a voice recognition operation, and the like.

Specifically, according to an embodiment of the present invention, when an input event occurs in which a user touches a specific content displayed on the display screen of the first device 310 or the second device 320, The specific content associated with the above touch operation among the contents provided on the first device 310 facing the user is provided on the second device 320 or conversely, 2 device 320 may be provided on the first device 310. In this case,

7 is a diagram illustrating a configuration in which content stored in a first device is transmitted to a second device according to an embodiment of the present invention.

7, the specific contents 701 and 702 selected by the user's touch operation 710 (for example, a specific sound source file, etc.) among the contents provided on the first device 310 before an input event occurs May be provided on the second device 320 after an input event occurs.

Also, according to an embodiment of the present invention, the user interface providing system 200 may allow the user to view the first device 310 while the second device 320 faces the user as the user performs the flip action, (Or a web page) displayed on the display screen of the first device 310, the content provided on the first device 310 that has been looking at the user is bookmarked And the list including the bookmark may be displayed on the second device 320. In this case, In addition, according to an embodiment of the present invention, the user interface providing system 200 may be configured such that when the user performs a flip operation, the first device 310 is viewed by the user, Corresponding to the occurrence of an input event that selects (i.e., touches) a specific bookmark among bookmark lists (e.g., bookmarked web page lists, etc.) displayed on the display screen of the first device The content corresponding to a specific bookmark selected on the first device 310 may be displayed on the first device 310. [ Referring to Figures 20-22, it can be seen that the above embodiment is actually being demonstrated.

While the present invention has been described in detail above with reference to an embodiment in which an input event is specified by a user's overturning of his / her hand once, the present invention is not necessarily limited thereto, It should be noted that input events can also be specified by any other action within the scope of the present invention (for example, by reversing a hand more than once).

In the above description, the first device is a smart phone held in the user's hand and the second device is a smart watch worn on the user's wrist. However, the present invention is not limited thereto. It is noted that the first device and the second device may be implemented in other forms such as a smart pad, a smart glass, a smart band, and a smart ring within the scope of achieving the object of the invention.

8 to 15 are views illustrating a configuration in which a user interface is provided according to another embodiment of the present invention.

Referring to FIG. 8, a user interface providing system 200 according to another embodiment of the present invention includes a first device 310 and a second device 320, When the flip action is performed in which the hands are turned upside down, the above behavior is changed in the direction in which the direction of the first device 310 in the smartphone form changes and in the direction in which the direction of the second device 320 in the smart watch form changes They can be recognized as input events that are opposite to each other or symmetrical. In response to the occurrence of the above-described input event, the user interface providing system 200 according to another embodiment of the present invention includes a first device 310 in which a display screen is viewed by a user before an input event occurs, (Or function) 810 of the contents (or functions) provided on the first device 310 and the mirrored contents (or functions) 810 of the first device 310 are mirrored, But also on the second device 320 that has been viewed. Accordingly, even when the user rotates the wrist so that the first device 310 looks at the other party, the second device 320 can know what content (or function) is being provided to the other party on the first device 310, . ≪ / RTI >

9, a user interface providing system 200 according to another exemplary embodiment of the present invention may include a user interface providing system 200 according to an exemplary embodiment of the present invention, The content (or the function) 910 provided on the first device 310 that the display screen has been looking at before is generated is divided into the public content 920 and the private content 930, The public contents 920 are displayed on the first device 310 on which the display screen is viewed after the occurrence of the input event and the private contents 920 are displayed on the second device 320, 930) can be displayed. Thus, the public contents and the private contents can be separately displayed according to the situation of the user.

10, a user interface providing system 200 according to another exemplary embodiment of the present invention may be configured such that, in response to the occurrence of an input event in which the user performs the flip action as described in connection with FIG. 8, The language of the content (or the function) 1010 provided on the first device 310 on which the display screen is facing the user is translated into another language before the occurrence of the input event, and the display screen is viewed The content 1020 of the first language (for example, English) is displayed on the first device 310 and the second language 320 of the second language 320 For example, Korean) can be displayed.

Next, referring to FIGS. 11 and 12, it is assumed that a user performs settlement based on short-distance communication using the first device 310 of smartphone type held by his / her hand. In such a case, the user interface providing system 200 according to another embodiment of the present invention may be configured such that, in response to the occurrence of the input event in which the user performs the flip action as described with reference to Fig. 8, On the second device 320 that has looked at the user side after the generation of the input event on behalf of the first device 310 which looked at the payment processing device (for example, the RFID reader or the like) 330, Information (for example, a payment amount, etc.) 1110 can be displayed (refer to FIG. 11). In addition, the user interface providing system 200 according to another embodiment of the present invention may be configured such that, in response to the occurrence of an input event in which the user makes a flip action as described with reference to FIG. 8, On the basis of the touch operation, on the second device 320 which has looked at the user side after the occurrence of the input event on behalf of the first device 310 which has looked at the device (for example, the RFID reader, etc.) 330, (Refer to FIG. 12).

Next, referring to FIG. 13, it can be assumed that the user wears the second device 320 on his or her wrist and performs a movement like running. In such a case, the user interface providing system 200 according to another embodiment of the present invention performs the flip action referred to with reference to Fig. 8 in addition to performing the touch operation of selecting the destination on the first device 310 (For example, the distance or time remaining to the current location, the destination, music, etc.) on the second device 320, which the user can easily manipulate during the exercise, Can be provided.

Next, referring to FIG. 14, it is assumed that the user holds the second device 320 on the wrist with the same hand as the IoT home appliance (corresponding to the first device 310) such as a remote controller . In this case, the user interface providing system 200 according to another embodiment of the present invention may be configured such that, in response to the occurrence of the input event that the user makes the flip action as described in connection with FIG. 8, The user operation interface 1410 of the IoT home appliance such as the remote controller, which is the first device 310, can be displayed on the second device 320 viewed.

Next, referring to FIG. 15, when the user holds the first device 310 of the smartphone type with one hand and wears the second device 320 of the smart watch type on the wrist of the other hand, It can be assumed that the required task is performed. In this case, the user interface providing system 200 according to another embodiment of the present invention may be configured such that when the user operates the wrist of the hand wearing the second device 320, (Or a function) provided on the first device 310 (for example, when the user inputs a security key code (e.g., a secret key code)) corresponding to an input event that both the first device 310 and the second device 320 look at the user, (E.g., a security key code to be input) 1520 related to the content 1510 (e.g., a function for supporting the input of a password) to be input on the second device 320 . Thus, convenience and security can be enhanced when the user performs an operation of inputting security information such as a password.

Meanwhile, in the user interface providing system 200 according to another embodiment of the present invention, when the user operates the wrist of the hand wearing the second device 320, the first device 310 All of the second devices 320 are viewed by the user, and in response to the occurrence of an input event in which the user performs a touch operation to select a specific text among the contents displayed on the first device 310, Information about the translation of the text or the dictionary search result of the language can be displayed on the second device. 18 and 19, it can be seen that the above embodiment is actually being demonstrated.

On the other hand, in a situation where a first user wearing a first device of smart watch type on the right wrist and a second user wearing a second device of smart watch type on his left wrist share a handshake with his right hand and left hand respectively, It can be assumed that an input event occurs in which the user and the second user perform a flip operation in which hands are rotated together. In this case, the user interface providing system 200 according to another embodiment of the present invention may be configured such that, in response to the occurrence of the input event as described above, the contents (or functions Is provided on the second device worn by the second user, or conversely, at least a part of the content (or the function) provided on the second device worn by the second user is provided by the first user To be provided on the first device. Thus, the user can receive content from another user's device or provide content to another user's device simply by performing a flip operation while shaking hands with another user with a hand wearing the device.

The embodiments of the present invention described above can be implemented in the form of program instructions that can be executed through various computer components and recorded in a non-transitory computer readable recording medium. The non-transitory computer readable medium may include program instructions, data files, data structures, etc., either alone or in combination. The program instructions recorded on the non-transitory computer-readable recording medium may be those specially designed and constructed for the present invention or may be those known to those skilled in the computer software arts. Examples of non-transitory computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs, DVDs, magneto-optical media such as floppy disks magneto-optical media), and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules for performing the processing according to the present invention, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, Those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims.

Therefore, the spirit of the present invention should not be construed as being limited to the above-described embodiments, and all of the equivalents or equivalents of the claims, as well as the following claims, I will say.

100: Network
200: User interface providing system
310: first device
320: second device

Claims (1)

A method for providing a user interface.

Images