WO2016052859A1

WO2016052859A1 - Method, device, and system for providing user interface and non-transitory computer-readable recording medium

Info

Publication number: WO2016052859A1
Application number: PCT/KR2015/008747
Authority: WO
Inventors: 황성재
Original assignee: 주식회사 퓨처플레이
Priority date: 2014-10-02
Filing date: 2015-08-21
Publication date: 2016-04-07

Abstract

An aspect of the present invention provides a method for providing a user interface, the method comprising the steps of: (a) acquiring information on postures or movements of a first device and a second device, and detecting an input event specified on the basis of a relative relationship between the posture or movement of the first device and the posture or movement of the second device; and (b) allowing at least some of contents and functions provided on the first device to be provided on the second device or allowing at least some of contents and functions provided on the second device to be provided on the first device, in response to the occurrence of the input event.

Description

Method, device, system and non-transitory computer readable recording medium for providing a user interface

The present invention relates to a method, device, system, and non-transitory computer readable recording medium for providing a user interface.

In recent years, mobile smart devices having various communication and sensing functions and powerful computing functions such as smart phones and smart pads have been widely used. Such mobile smart devices may be relatively small in size and can be carried by the user (eg, smart glasses, smart watches, smart bands, smart devices in the form of rings or broaches, directly on the body or clothing). Smart devices that are attached or embedded).

In this situation, a user might want to perform some task using his or her two or more (heterogeneous) smart devices, or want to perform some task that needs to intervene with his smart device and another user's device. Can be. However, according to the prior art, the (potential) intention of such a user could not be properly supported.

The object of the present invention is to solve all the above-mentioned problems.

In addition, the present invention obtains information about the attitude or movement of the first device and the second device, and inputs an input event that is specified based on the relative relationship between the attitude or movement of the first device and the attitude or movement of the second device. Detect and in response to the input event occur, cause at least some of the content and functions provided on the first device to be provided on the second device or provide at least some of the content and functions provided on the second device on the first device It is another object of the present invention to provide a user with a more convenient and expanded user interface by using a relative relationship between postures or movements of two or more devices.

Representative configuration of the present invention for achieving the above object is as follows.

According to an aspect of the present invention, there is provided a method for providing a user interface, comprising: (a) obtaining information about a posture or movement of a first device and a second device, wherein the posture or movement of the first device and the second device are obtained; Detecting an input event specified based on a relative relationship between a device's posture or movement, and (b) in response to the input event occurring, at least some of the content and functionality provided on the first device To be provided on a second device or to cause at least some of the content and functionality provided on the second device to be provided on the first device.

According to another aspect of the present invention, a device for providing a user interface, comprising: obtaining information about the posture or movement of the device and other devices associated with the device, the posture or movement of the device and the posture or of the other device; Technical means for sensing a specified input event based on a relative relationship between movements, and in response to the input event occurring, at least some of the content and functions provided on the device are provided on the other device, or A device is provided that includes a program module to allow at least some of the content and functions provided on another device to be provided on the device.

According to yet another aspect of the present invention, a system for providing a user interface, comprising: obtaining information about a posture or movement of a first device and a second device, wherein the posture or movement of the first device and the second device Detect a specified input event based on a relative relationship between posture or movement, and in response to the input event occurring, at least some of the content and functions provided on the first device to be provided on the second device; And a control unit for allowing at least some of the contents and functions provided on the second device to be provided on the first device, and a storage storing information received from at least one of the first device and the second device. This is provided.

In addition, there is further provided a non-transitory computer readable recording medium for recording another method, device, system, and computer program for executing the method.

According to the present invention, an effect of providing a more convenient and expanded user interface to a user is achieved by using a relative relationship between postures or movements of two or more devices.

In addition, according to the present invention, a user holding the first device in the same hand while wearing the second device on a body part such as a wrist, even if the user flips his or her hand (that is, flips), An effect is achieved that enables the content (or function) provision state at the first device and the second device to be switched between each other.

In addition, according to the present invention, a user having both the first device and the second device looking at different directions may use the first device and the second device irrespective of the posture or the direction of the hand holding the device. Through this, the effect that the content or function can be provided while maintaining its continuity is achieved.

In addition, according to the present invention, the first user and the second user each having the first device and the second device, respectively, by simply performing a simple action corresponding to an input event, the content (or The effect is that the functions) can be shared continuously.

1 is a view showing a schematic configuration of an entire system for providing a user interface according to an embodiment of the present invention.

2 is a diagram conceptually illustrating a configuration in which a content (or function) provision state is switched between a first device and a second device according to an embodiment of the present invention.

3 to 5 are diagrams exemplarily illustrating a configuration for providing a user interface according to an embodiment of the present invention.

6 is a diagram illustrating a configuration in which a format of content provided on a first device and a format of content provided on a second device are different from each other according to an embodiment of the present invention.

FIG. 7 is a diagram illustrating a configuration in which content stored in a first device is transmitted to a second device according to an embodiment of the present invention.

8 to 15 are diagrams exemplarily illustrating a configuration in which a user interface is provided according to another embodiment of the present invention.

16 to 22 are diagrams exemplarily illustrating how a user interface provided according to various embodiments of the present invention is actually demonstrated.

Configuration of the entire system

As shown in FIG. 1, the entire system according to an embodiment of the present invention may include a communication network 100, a user interface providing system 200, and a plurality of

devices

310 and 320.

First, the communication network 100 according to an embodiment of the present invention may be configured regardless of a communication mode such as wired communication or wireless communication, and includes a local area network (LAN) and a metropolitan area network (MAN). ), And various communication networks such as a wide area network (WAN). Preferably, the communication network 100 as used herein may be a known Internet or World Wide Web (WWW). However, the communication network 100 may include, at least in part, a known wired / wireless data communication network, a known telephone network, or a known wired / wireless television communication network without being limited thereto.

Next, the user interface providing system 200 according to an embodiment of the present invention may be a digital device having a computing capability by mounting a microprocessor and a memory means. The user interface providing system 200 may be a server system. The user interface providing system 200 may be configured to provide one of the

devices

310 and 320 to the other through the communication network 100 to provide predetermined information or control commands to the other, or to receive the predetermined information or control commands from the other. To perform the function.

To this end, the user interface providing system 200 acquires information about the posture or movement of the first device and the second device, as described in detail below, and the posture or movement of the first device and the second device. Detect a specified input event based on a relative relationship between posture or movement, and in response to the input event occurring, at least some of the content and functions provided on the first device are provided on the second device or By allowing at least some of the contents and functions provided on the first device to be provided on the first device, a function of providing a more convenient and expanded user interface to a user may be performed by using a relative relationship between postures or movements of two or more devices. have.

Such user interface provision may be performed by a controller (not shown) included by the user interface provision system 200. Such a controller may exist in the form of a program module in the user interface providing system 200. Such program modules may take the form of operating systems, application modules or other program modules. In addition, the program module may be stored in a remote storage device that can communicate with the user interface providing system 200. Meanwhile, the program module includes, but is not limited to, routines, subroutines, programs, objects, components, data structures, etc. that perform particular tasks or execute particular abstract data types, which will be described later, according to the present invention.

In addition, the user interface providing system 200 may store information about a posture or a movement provided from at least one of the plurality of

devices

310 and 320, and may be used by at least one of the plurality of

devices

310 and 320. To do more. Furthermore, the interface providing system 200 stores information constituting contents or functions provided by at least one of the plurality of

devices

310 and 320, and the information is stored in at least one of the plurality of

devices

310 and 320. It can further perform the function to be used by. The above-described storage may be performed by a storage (not shown) included by the user interface providing system 200. Such storage is a concept that includes a computer readable recording medium, and may be a broad database including not only a narrow database but also a file system based data record.

The function of the user interface providing system 200 will be described in more detail below. On the other hand, the user interface providing system 200 has been described as above, but this description is exemplary, and at least some of the functions or components required for the user interface providing system 200 are subject to manipulation as necessary. It will be apparent to those skilled in the art that at least one of the

devices

310, 320 may be implemented or included.

Lastly, the plurality of

devices

310 and 320 according to an embodiment of the present invention may be matched to the user interface providing system 200 or the plurality of devices 310 and 320 (preferably, the plurality of devices 310). , 320) may be separated from each other or externalized (externalized), and may be a digital device having a function of communicating with each other, and having a memory means and a microprocessor, Any number may be employed as the

device

310, 320 according to the present invention.

Devices

310 and 320 may be so-called smart devices such as smartphones, smart pads, smart glasses, smart watches, smart bands, smart rings, etc., or may be desktop computers, notebook computers, workstations, PDAs, web pads, mobile phones, buttons, mice. It may be a more traditional device such as, a keyboard, an electronic pen, and the like. In addition, the

devices

310 and 320 may be Internet of Things (IoT) devices such as a remote controller and a home appliance.

In particular, according to an embodiment of the present invention, the

devices

310 and 320 may include at least one technical means capable of receiving an operation from a user. Examples of such technical means include known components, such as touch panels, pointing tools (e.g., mouse, stylus, electronic pen, etc.), graphical objects that can be manipulated by users, keyboards, toggle switches, biometric information (fingerprints, etc.). Recognition sensors, distance sensors, and the like.

In addition, according to an embodiment of the present invention, the

device

310, 320 may include at least one technical means for obtaining physical information about the attitude or movement of the device (310, 320). Examples of such technical means are known components, such as motion sensors, acceleration sensors, gyroscopes, magnetic sensors, positioning modules (GPS modules, beacon-based positioning (identification) modules, etc.), barometers, distance sensors, cameras Etc. can be mentioned.

In addition, according to an embodiment of the present invention, the

device

310, 320 has a posture of the

device

310, 320 based on the biometric information obtained from the human body of the user having the device (310, 320) Technical means may be obtained for obtaining physical information about the movement. As an example of such technical means, an EMG signal measuring apparatus etc. are mentioned.

In addition, the

devices

310 and 320 process the above physical information to provide information or control commands to

other devices

310 and 320, or receive information or control commands from

other devices

310 and 320, or the like. An application program for generating such information or control command may be further included. Such an application may exist in the form of a program module in the

corresponding devices

310 and 320. The nature of the program module may be similar to the overall control of the user interface providing system 200 as described above. Here, the application may be replaced with a hardware device or a firmware device, at least a part of which may perform a function substantially the same or equivalent thereto.

Meanwhile, according to an embodiment of the present invention, the first device 310 and the second device 320 may have a predetermined association (for example, an association that belongs to the same user, or an association that functions for the same user). The first device 310 and the second device 320 when it is recognized that they have an association that is located substantially close to each other, or that one of them is reasonable to authenticate or allow the other. A predetermined connection may be formed between the two terminals, which may be performed by the user interface providing system 200 or may be performed by the first device 310 and the second device 320.

Examples

Hereinafter, a detailed example in which the user interface providing system 200 according to the present invention provides a user interface in which a plurality of

devices

310 and 320 are involved according to various embodiments will be described in detail.

According to an embodiment of the present invention, the user interface providing system 200 obtains information about the attitude or movement of the first device 310 and the second device 320, and the attitude of the first device 310. Or detecting a specific input event based on a relative relationship between a movement and a posture or movement of the second device 320, and in response to the occurrence of the input event, among the contents and functions provided on the first device 310. At least some may be provided on the second device 320 or at least some of the content and functions provided on the second device 320 may be provided on the first device 310.

In detail, according to one embodiment of the present invention, at least one of the first device 310 and the second device 320 may move in combination with an input means for causing an input event. For example, the first device 310 may be a smart phone that the user can hold by hand, and the second device 320 may be a smart watch that may be worn on the user's wrist.

In addition, according to an embodiment of the present invention, the input event specified based on a relative relationship between the posture or movement of the first device 310 and the posture or movement of the second device 320 may include at least one coordinate axis. As a reference, an aspect in which the direction of the first device 310 and an aspect in which the direction of the second device 320 is changed may indicate an event that is opposite or symmetrical to each other. For example, according to an embodiment of the present invention, the user is holding the first device 310 and flipping a hand (also known as flip) that is wearing the second device 320 on the wrist. It can point to an event.

Meanwhile, according to an embodiment of the present invention, the input event may include a posture or movement of the first device 310 based on the first surface and a posture or movement of the second device 310 based on the second surface. It can be specified based on the relative relationship between them. Here, the first surface or the second surface may correspond to an upper surface, a lower surface, a left surface, a right surface, a front surface, a rear surface, or the like of the first device 310 or the second device 320.

In general, when the user holding the first device 310 by hand and wearing the second device 320 on the wrist of the same hand performs an inverted hand (ie flip), the above action is performed. The first device 310 or the second device 320 which has provided the content (or function) to the user with the display screen facing the user before the execution is performed, displays the display after the above action is performed. The screen may not be facing the user and may no longer provide content (or functions) to the user.

Referring to FIG. 2, the system 200 for providing a user interface according to an embodiment of the present invention includes both the first device 310 and the second device 320 that the user faces in different directions. In the case of flipping hands, the direction of the first device 310 in the form of a smartphone is changed and the direction of the second device 320 in the form of a smart watch is reversed. At least one of contents (or functions) provided on the first device 310 (or the second device 320) that the display screen is facing toward the user before the input event occurs. Some of the

parts

201 and 202 may be provided on the second device 320 (or the first device 310) facing the user after the input event occurs. Therefore, according to the present invention, the content (or function) provided to the user can be provided while maintaining continuity through both the first device 310 and the second device 320. 16 and 17, it can be seen that the above embodiment is actually demonstrated.

3 and 4, a user wearing the second device 320 on the left wrist and holding the first device 310 with the same left hand turns over his left hand (ie, flips). The case can be assumed. In this case, instead of the first device 310 looking at the user side no longer looking at the user side, the second device 320 not looking at the user side may be looking at the user side. On the contrary, instead of the second device 320 looking at the user no longer looking at the user, the first device 310 not looking at the user is facing the user. Can be seen (see FIG. 4).

Referring to FIG. 5, a posture or direction of the first device 310 and the second device 320 measured by a gyroscope provided in the first device 310 and the second device 320 is measured. Physical information relating to the present invention may be obtained, and the user interface providing system 200 according to an exemplary embodiment may detect whether an input event occurs based on the physical information as illustrated in FIG. 5. have. Specifically, FIGS. 5A and 5B indicate gyroscope measurements of the first device 310 and the second device 320, respectively, and yellow in FIGS. 5A and 5B, respectively. , Red and green graphs are azimuth respectively. It indicates the measured value in the pitch and roll direction.

Meanwhile, according to an embodiment of the present disclosure, in response to an input event caused by a user's flipping action, at least a part of content provided on the first device 310 facing the user is the second device. At least a portion of the content being provided on the second device 320 facing the user may be transmitted to the first device 310.

In addition, according to an embodiment of the present invention, in response to an input event caused by a user's flipping action, a process that is being executed on the first device 310 facing toward the user is performed by the second device 320. On the contrary, a process that is being executed on the second device 320 that is facing the user may be executed on the first device 310.

In addition, according to an embodiment of the present invention, in response to an input event generated according to a user's flipping action, provided on the first device 310 (or the second device 320) before the input event occurs. The format of the content that is being used and the format of the content provided on the second device 320 (or the first device 310) after the input event occurs may be different.

Referring to FIG. 6, content that was provided in a visual form on the first device 310 before the input event occurs may be provided on the second device 320 in an auditory or tactile form after the input event occurs. have. For example, a second device in which reading content, which has been provided in the form of text on the first device 310 having a relatively large display screen, is worn in close contact with a user's wrist. 320 may be provided in the form of voice or vibration.

Meanwhile, according to an embodiment of the present invention, the input event may include not only a relative relationship between the posture or movement of the first device 310 and the posture or movement of the second device 320, but also the first device 310 or It may be specified further based on a user manipulation input to the second device 320. For example, a user operation input to the first device 310 or the second device 320 may include a touch operation, a keyboard operation, a voice recognition operation, and the like.

Specifically, according to an embodiment of the present invention, when a user performs a flip action and an input event for touching specific content displayed on the display screen of the first device 310 or the second device 320 occurs. Correspondingly, the specific content associated with the above touch manipulation among the contents provided on the first device 310 facing toward the user may be provided on the second device 320 or vice versa. The specific content associated with the above touch manipulation among the contents provided on the second device 320 may be provided on the first device 310.

Referring to FIG. 7, specific content 701, 702 (eg, a specific sound source file, etc.) selected by the user's touch manipulation 710 among contents provided on the first device 310 before an input event occurs. ) May be provided on the second device 320 after an input event occurs.

In addition, according to an embodiment of the present invention, the user interface providing system 200 allows the user to display the first device 310 with the second device 320 facing the user as the user flips. In response to an input event of touching a specific content (for example, a web page, etc.) displayed on the display screen of the user, content provided on the first device 310 facing the user is bookmarked (or A list registered as a bookmark and including the bookmark may be displayed on the second device 320. In addition, according to an embodiment of the present invention, the user interface providing system 200 allows the user to display the second device 310 with the first device 310 facing the user as the user flips. In response to an input event for selecting (ie, touching) a specific bookmark from a list of bookmarks (for example, a list of bookmarked web pages, etc.) displayed on the display screen of the second device, The content corresponding to the specific bookmark selected on the 310 may be displayed on the first device 310. 20 to 22, it can be seen that the above embodiment is actually demonstrated.

On the other hand, in the above, mainly described with respect to the embodiment in which the input event is specified by the user flipping his hand once, the present invention is not necessarily limited thereto, the scope of the present invention can be achieved It is noted that the input event can be specified by any number of other actions within (eg, flipping the hand more than once).

In addition, while the above is mainly described with respect to the embodiment in which the first device is a smart phone held in the user's hand and the second device is a smart watch worn on the user's wrist, the present invention is not necessarily limited thereto. It will be appreciated that the first device and the second device may be implemented in other forms such as a smart pad, a smart glass, a smart band, a smart ring, and the like within the scope of the object of the present invention.

First, referring to FIG. 8, a user interface providing system 200 according to another embodiment of the present invention possesses both a first device 310 and a second device 320 that a user looks in different directions. In the case of flipping the flipping hand, the direction of the first device 310 in the form of a smartphone is changed and the direction of the second device 320 in the form of a smart watch is changed. It can be recognized as input events that are opposite or symmetric to each other. Subsequently, the user interface providing system 200 according to another embodiment of the present invention corresponds to the occurrence of the above input event, and the first device 310 in which the display screen is facing the user before the input event occurs. Mirror (Mirroring) at least a portion (810) of the content (or function) that was being provided on the screen, and the display screen after the mirrored content (or function) 810 not only the first device 310 but also an input event occurs It may also be provided on the second device 320 facing the side. As a result, even when the user rotates his or her wrist so that the first device 310 faces the other party, the second device 320 indicates what content (or function) is provided to the other party on the first device 310. You can check through.

Next, referring to FIG. 9, the system 200 for providing a user interface according to another embodiment of the present disclosure corresponds to an input event in which a user performs a flip action mentioned with reference to FIG. 8. Before the occurrence, the content (or function) 910 provided on the first device 310 that the display screen was facing toward the user is divided into public content 920 and private content 930. The public content 920 is displayed on the first device 310 facing the other side after the input event is generated, and the private content (on the second device 320 facing the user after the input event is generated) 930 may be displayed. As a result, the public content and the private content can be classified and displayed according to the situation of the user.

Next, referring to FIG. 10, the user interface providing system 200 according to another exemplary embodiment of the present disclosure may correspond to an input event in which a user performs a flip action mentioned with reference to FIG. 8. Before the occurrence, the language of the content (or function) 1010 provided on the first device 310 facing the user is translated into another language, and the display screen faces the other side after the input event occurs. In order to display the content 1020 in a first language (eg, English) on the first device 310, the second language 320 may be displayed on the second device 320 facing the user after the input event occurs. For example, the content 1030 in Korean may be displayed.

Next, referring to FIGS. 11 and 12, it may be assumed that a user performs payment based on short-range communication using the first device 310 of a smartphone type held by his or her hand. In this case, the user interface providing system 200 according to another embodiment of the present invention may display a display screen after the input event is generated in response to the occurrence of an input event for a user to perform the flip action described with reference to FIG. 8. On the second device 320 facing the user after the occurrence of the input event on behalf of the first device 310 facing the payment processing device (eg, RFID reader, etc.) 330 Information (eg, payment amount, etc.) 1110 may be displayed (see FIG. 11). In addition, in the user interface providing system 200 according to another embodiment of the present invention, in response to an input event of a flip action mentioned by the user in relation to FIG. 8 being generated, a display screen is processed after the input event occurs. On the basis of the touch manipulation on the second device 320 facing the user after the occurrence of the input event on behalf of the first device 310 facing the device (eg, RFID reader, etc.) 330. A function 1210 may be provided to support the input of a key (see FIG. 12).

Next, referring to FIG. 13, it may be assumed that a user performs an exercise such as running while wearing the second device 320 on a wrist. In this case, the user interface providing system 200 according to another embodiment of the present invention may perform the flipping operation described with reference to FIG. 8 in addition to the user performing a touch operation of selecting a destination on the first device 310. In response to the input event to be generated, various contents related to the exercise (for example, current location, distance or time remaining to the destination, music, etc.) on the second device 320 that the user can easily manipulate during the exercise. Can be provided.

Next, referring to FIG. 14, it will be assumed that a user grips an IoT home appliance (corresponding to the first device 310), such as a remote controller, with the same hand while wearing the second device 320 on a wrist. Can be. In such a case, the user interface providing system 200 according to another embodiment of the present invention may respond to the user after the input event occurs in response to the occurrence of an input event that the user performs flip action described with reference to FIG. 8. The user manipulation interface 1410 of the IoT household appliance such as a remote controller, which is the first device 310, may be displayed on the second device 320 that is viewed.

Next, referring to FIG. 15, the security is secured while the user holds the first device 310 in the form of a smartphone with one hand and wears the second device 320 in the form of a smart watch on the wrist of the other hand. Suppose you are performing a required task. In this case, the user interface providing system 200 according to another embodiment of the present invention, the first device 310 as the user performs an operation such as turning the wrist of the hand wearing the second device 320, etc. ) And the content (or function) provided on the first device 310 (eg, a security key code) in response to an input event where both the second device 320 and the second device 320 are facing the user. To allow additional content (or functions) (eg, security key codes to be entered, etc.) 1520 associated with 1510 to be provided on the second device 320. Can be. As a result, the user may increase convenience and security in performing a task of inputting security information such as a password.

On the other hand, the user interface providing system 200 according to another embodiment of the present invention, as the user performs an operation such as turning the wrist of the hand wearing the second device 320 and the like; In response to an occurrence of an input event for performing a touch operation for selecting a specific text among the contents displayed on the first device 310 as the second device 320 is all faced toward the user, Information about the translation or text dictionary search results for the text may be displayed on the second device. 18 and 19, it can be seen that the above embodiment is actually demonstrated.

On the other hand, a first user wearing a smart watch-type first device on the right wrist and a second user wearing a smart watch-type second device on the left wrist shake hands with the right hand and the left hand, respectively. It may be assumed that an input event occurs in which the user and the second user perform a flip action in which the user turns hands held together. In this case, the user interface providing system 200 according to another embodiment of the present invention may provide content (or function) provided on the first device worn by the first user in response to the occurrence of the above input event. At least some of the content (or functionality) being provided on the second device worn by the second user is at least partially worn by the first user. It can be provided on the first device that is doing. As a result, the user may receive content from another user's device or provide content to another user's device by simply flipping while shaking hands with the other user with a hand wearing the device.

Embodiments according to the present invention described above may be implemented in the form of program instructions that may be executed by various computer components, and may be recorded on a non-transitory computer readable recording medium. The non-transitory computer readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the non-transitory computer readable recording medium may be those specially designed and configured for the present invention, or may be known and available to those skilled in the computer software arts. Examples of non-transitory computer readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs, DVDs, magnetic-optical media such as floppy disks ( magneto-optical media) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform the process according to the invention, and vice versa.

Although the present invention has been described by specific embodiments such as specific components and the like, but the embodiments and the drawings are provided to assist in a more general understanding of the present invention, the present invention is not limited to the above embodiments. For those skilled in the art, various modifications and variations can be made from these descriptions.

Accordingly, the spirit of the present invention should not be limited to the above-described embodiments, and all of the equivalents or equivalents of the claims, as well as the appended claims, fall within the scope of the spirit of the present invention. I will say.

Explanation of sign

100: network

200: user interface providing system

310: first device

320: second device

Claims

As a method for providing a user interface,

(a) obtaining information about a posture or movement of the first device and the second device, and inputting an input event specified based on a relative relationship between the posture or movement of the first device and the posture or movement of the second device; Detecting, and

(b) in response to the occurrence of the input event, at least some of the content and functions provided on the first device are provided on the second device, or at least some of the content and functions provided on the second device are Providing on the first device

How to include.
The method of claim 1,

At least one of the first device and the second device moves integrally with the input means causing the input event.
The method of claim 1,

In the step (a),

And changing the direction of the first device and the changing direction of the second device are opposite or symmetrical to each other.
The method of claim 3,

In the step (a),

If the first device was looking toward the user before the input event occurred, the second device is looking at the user after the input event occurred, and before the input event occurs, the second device is If the user is looking at the user, the first device is looking at the user after the input event occurs.
The method of claim 1,

In step (b),

In response to the input event occurring, at least some of the contents provided on the first device are transmitted to the second device, or at least some of the contents provided on the second device are transmitted to the first device. How to get it sent.
The method of claim 1,

In step (b),

In response to the input event occurring, causing a process that was running on the first device to run on a second device, or causing a process that was running on the second device to run on the first device.
The method of claim 1,

In step (b),

And a format of content provided on the first device before the input event occurs and a format provided on the second device after the input event occurs.
The method of claim 1,

And the input event is further specified based on a user operation input to at least one of the first device and the second device.
The method of claim 8,

In step (b),

In response to the occurrence of the input event, a portion associated with the user manipulation of content provided on the first device may be provided on the second device, or the content of content provided on the second device may be different from the user manipulation. Causing an associated portion to be provided on the first device.
The method of claim 1,

In the step (a),

As both the direction of the display screen of the first device and the direction of the display screen of the second device are within a preset range, both the display screen of the first device and the display screen of the second device face the user. If it is determined that the input event has occurred.
The method of claim 1,

And the input event is specified based on a relative relationship between a posture or movement of the first device relative to a first face and a posture or movement of the second device relative to a second face.
A non-transitory computer readable recording medium having recorded thereon a computer program for executing the method according to any one of claims 1 to 11.
A device for providing a user interface,

Technical means for obtaining information about a posture or movement of the device and another device associated with the device and detecting a specified input event based on a relative relationship between the posture or movement of the device and the posture or movement of the other device , And

A program for causing at least some of the content and functions provided on the device to be provided on the other device in response to the occurrence of the input event, or at least some of the content and functions provided on the other device to be provided on the device; module

Device comprising a.
A system for providing a user interface,

Acquires information about a posture or movement of a first device and a second device, detects an input event specified based on a relative relationship between the posture or movement of the first device and the posture or movement of the second device, In response to the input event occurring, at least some of the contents and functions provided on the first device are provided on the second device, or at least some of the contents and functions provided on the second device are provided on the first device. A control unit to be provided on the device, and

A storage storing information received from at least one of the first device and the second device

System comprising.
The method of claim 14,

And the controller is configured to detect that the input event has occurred when an aspect in which the direction of the first device changes and an aspect in which the direction of the second device changes are opposite or symmetric to each other.
The method of claim 14,

The controller may be configured to display both the display screen of the first device and the display screen of the second device as both the direction of the display screen of the first device and the direction of the display screen of the second device are within a preset range. And if it is determined that the user is looking to the side, the system detects that the input event has occurred.