WO2016093463A1

WO2016093463A1 - Method for providing user interface, device, system, and computer-readable permanent recording medium

Info

Publication number: WO2016093463A1
Application number: PCT/KR2015/008329
Authority: WO
Inventors: 황성재
Original assignee: 주식회사 퓨쳐플레이
Priority date: 2014-12-10
Filing date: 2015-08-10
Publication date: 2016-06-16
Also published as: KR20170121302A; KR101790216B1; KR20160084811A

Abstract

According to an embodiment of the present invention, a method for providing a user interface is provided, the method comprising the steps of: obtaining information on relative position with respect to at least one user of a first device and a second device; and, when a triggering event occurs which induces audio feedback in at least one of the first device and the second device, referring to at least one of information on the type of the triggering event, the obtained information on relative position, information on a displayed state related to the triggering event, information on contents or functions related to the triggering event, and information on the audio performance of at least one of the first device and the second device, and controlling the properties of the audio feedback provided by at least one of the first device and the second device.

Description

Method, device, system and non-transitory computer readable recording medium for providing a user interface

The present invention relates to a method, device, system, and non-transitory computer readable recording medium for providing a user interface.

In recent years, mobile smart devices having various communication and sensing functions and powerful computing functions such as smart phones and smart pads have been widely used. Such mobile smart devices may be relatively small in size and can be carried by the user (eg, smart glasses, smart watches, smart bands, smart devices in the form of rings or broaches, directly on the body or clothing). Worn or embedded smart devices).

In this situation, a user might want to perform some task using his or her two or more (heterogeneous) smart devices, or want to perform some task that needs to intervene with his smart device and another user's device. And may want to be intuitively provided with information about the state in which the task is being performed. However, according to the prior art, these (potential) intentions and needs of the user could not be properly supported.

The object of the present invention is to solve all the above-mentioned problems.

In addition, the present invention obtains information about the relative position with respect to the user of the first device or the second device, when the triggering event that causes the acoustic feedback in the first device or the second device occurs, the above triggering event Information regarding the type of a, information about a relative position obtained above, information about a display state associated with the above triggering event, information about a content or function associated with the above triggering event, or at least one of a first device and a second device. By referring to the information about one acoustic performance, by controlling the property of the acoustic feedback provided by the first device or the second device, a speaker provided in each of the two or more associated devices can be used to provide more realistic sound to the user. Provided, and performed when two or more devices are associated And that the information relating to up to provide the user with intuitive by the sounds by another object.

Representative configuration of the present invention for achieving the above object is as follows.

According to an aspect of the present invention, there is provided a method for providing a user interface, the method comprising: obtaining information about a relative position with respect to a user of at least one of a first device and a second device, and the first device and the When a triggering event that causes acoustic feedback occurs in at least one of the second devices, information regarding the type of the triggering event, information about the obtained relative position, information about a display state associated with the triggering event, the triggering event Sound provided by at least one of the first device and the second device, with reference to at least one of information about content or functionality associated with the information and information about acoustic performance of at least one of the first device and the second device. Controlling the properties of the feedback This method is provided.

According to another aspect of the invention, there is provided a device for providing a user interface, wherein the device obtains information about a relative position relative to a user of the device, and obtains acoustic feedback from at least one of the device and other devices associated with the device. Technical means for detecting that an triggering event occurs, and when the triggering event occurs, information regarding the type of the triggering event, information about the obtained relative position, information about a display state associated with the triggering event, A sound provided by at least one of the device and the other device with reference to at least one of information about a content or function associated with the triggering event and information about acoustic performance of at least one of the device and the other device. A device is provided comprising a program module for controlling the properties of the feedback.

According to yet another aspect of the present invention, a system for providing a user interface, the system comprising: obtaining relative information based on at least one user of a first device and a second device, wherein among the first device and the second device; If at least one triggering event occurs that causes acoustic feedback, information about the type of triggering event, information about the obtained relative position, information about a display state associated with the triggering event, content associated with the triggering event, or The attribute of the acoustic feedback provided in at least one of the first device and the second device with reference to at least one of information about a function and information about acoustic performance of at least one of the first device and the second device. A control unit for controlling the first device; A system is provided that includes a storage for storing information provided from at least one of the second devices.

In addition, there is further provided a non-transitory computer readable recording medium for recording another method, device, system, and computer program for executing the method.

According to the present invention, there is an intuition of information about a task performed between a device worn on the user's body and a device not worn on the user's body or between two or more devices worn on the user's body. The effect of being able to provide various patterns of acoustic feedback is achieved.

In addition, according to the present invention, the effect of being able to provide more realistic (or richer) acoustic feedback to the user by using a speaker provided in each of two or more related devices.

1 is a view showing a schematic configuration of an entire system for providing a user interface according to an embodiment of the present invention.

2 and 3 exemplarily illustrate relative positions with respect to users of a plurality of devices according to an embodiment of the present invention.

4 and 5 are diagrams exemplarily illustrating a configuration in which acoustic feedback is provided in a first device not worn on a user's body and a second device worn on a user's body according to an embodiment of the present invention.

6 and 12 exemplarily illustrate a configuration of controlling an attribute (ie, a pattern) of acoustic feedback provided in two or more devices based on a display state of a portion associated with a triggering event according to an embodiment of the present invention. to be.

13 to 15 are diagrams exemplarily illustrating a configuration for controlling a time for providing acoustic feedback in two or more devices according to an embodiment of the present invention.

16 to 19 are diagrams exemplarily illustrating a configuration in which acoustic feedback is provided based on various operations performed in a state in which two or more devices are associated according to an embodiment of the present invention.

20 is a diagram exemplarily illustrating a configuration in which acoustic feedback is provided in at least two devices worn on a user's body according to an embodiment of the present invention.

FIG. 21 is a diagram exemplarily illustrating a configuration in which acoustic feedback is provided at two or more devices respectively worn on the bodies of two or more users according to an embodiment of the present invention.

DETAILED DESCRIPTION The following detailed description of the invention refers to the accompanying drawings that show, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different but need not be mutually exclusive. For example, certain shapes, structures, and characteristics described herein may be embodied in other embodiments without departing from the spirit and scope of the invention with respect to one embodiment. In addition, it is to be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the invention. The following detailed description, therefore, is not to be taken in a limiting sense, and the scope of the present invention, if properly described, is defined only by the appended claims, along with the full range of equivalents to which such claims are entitled. Like reference numerals in the drawings refer to the same or similar functions throughout the several aspects.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement the present invention.

Configuration of the entire system

As shown in FIG. 1, the entire system according to an embodiment of the present invention may include a communication network 100, a user interface providing system 200, and a plurality of

devices

310 and 320.

First, the communication network 100 according to an embodiment of the present invention may be configured regardless of a communication mode such as wired communication or wireless communication, and includes a local area network (LAN) and a metropolitan area network (MAN). ), And various communication networks such as a wide area network (WAN). Preferably, the communication network 100 as used herein may be a known Internet or World Wide Web (WWW). However, the communication network 100 may include, at least in part, a known wired / wireless data communication network, a known telephone network, or a known wired / wireless television communication network without being limited thereto.

Next, the user interface providing system 200 according to an embodiment of the present invention may be a digital device having a computing capability by mounting a microprocessor and a memory means. The user interface providing system 200 may be a server system. The user interface providing system 200 may be configured to provide one of the

devices

310 and 320 to the other through the communication network 100 to provide predetermined information or control commands to the other, or to receive the predetermined information or control commands from the other. To perform the function.

To this end, the user interface providing system 200 acquires information regarding a relative position of the user of the first device 310 or the second device 320 as described in detail below, When a triggering event occurs that causes acoustic feedback in the device 310 or the second device 320, information regarding the type of triggering event above, information about the obtained relative position above, an indication associated with the triggering event above The first device 310 with reference to information on a state, information on a content or function associated with the triggering event above, or information on acoustic performance of at least one of the first device 310 and the second device 320. Or by controlling the properties of the acoustic feedback provided by the second device 320, thereby removing the speakers provided in each of the two or more associated devices. It provides a more realistic sound to the user, and can perform a function to intuitively provide the user with information about the work performed in the state where two or more devices are associated.

Such user interface provision may be performed by a controller (not shown) included by the user interface provision system 200. Such a controller may exist in the form of a program module in the user interface providing system 200. Such program modules may take the form of operating systems, application modules or other program modules. In addition, the program module may be stored in a remote storage device that can communicate with the user interface providing system 200. Meanwhile, the program module includes, but is not limited to, routines, subroutines, programs, objects, components, data structures, etc. that perform particular tasks or execute particular abstract data types, which will be described later, according to the present invention.

In addition, the user interface providing system 200 stores information regarding a relative position or a body wearing position based on a user provided from at least one of the plurality of

devices

310 and 320, which is a plurality of devices 310 and 320. ) May be further performed. Furthermore, the interface providing system 200 stores information constituting contents or functions provided by at least one of the plurality of

devices

310 and 320, and the information is stored in at least one of the plurality of

devices

310 and 320. It can further perform the function to be used by. The above-described storage may be performed by a storage (not shown) included by the user interface providing system 200. Such storage is a concept that includes a computer readable recording medium, and may be a broad database including not only a narrow database but also a file system based data record.

The function of the user interface providing system 200 will be described in more detail below. On the other hand, the user interface providing system 200 has been described as above, but this description is exemplary, and at least some of the functions or components required for the user interface providing system 200 are subject to manipulation as necessary. It will be apparent to those skilled in the art that at least one of the

devices

310, 320 may be implemented or included.

Lastly, the plurality of

devices

310 and 320 according to an embodiment of the present invention may be matched to the user interface providing system 200 or the plurality of devices 310 and 320 (preferably, the plurality of devices 310). , 320) may be separated from each other or externalized (externalized), and may be a digital device having a function of communicating with each other, and having a memory means and a microprocessor, Any number may be employed as the

device

310, 320 according to the present invention.

Devices

310 and 320 are so-called smart devices such as smartphones, smart pads, smart glasses, smart watches, smart bands, smart rings, smart necklaces, etc., or are desktop computers, notebook computers, workstations, PDAs, web pads. It may be a more traditional device such as a mobile phone, a button, a mouse, a keyboard, an electronic pen, and the like. In addition, the

devices

310 and 320 may be Internet of Things (IoT) devices such as a remote controller and a home appliance.

In particular, according to an embodiment of the present invention, the

devices

310 and 320 may include at least one technical means capable of generating acoustic feedback transmitted to the user. Examples of such technical means include known speakers, mono speakers, stereo speakers, multi-channel speakers and the like.

In addition, according to an embodiment of the present invention, the

devices

310 and 320 may include at least one technical means capable of receiving an operation from a user. Examples of such technical means include known components, such as touch panels, pointing tools (e.g., mouse, stylus, electronic pen, etc.), graphical objects that can be manipulated by users, keyboards, toggle switches, biometric information (fingerprints, etc.). Recognition sensors, distance sensors, and the like.

In addition, according to an embodiment of the present invention, the

device

310, 320 may include at least one technical means for obtaining physical information about the attitude or movement of the device (310, 320). Examples of such technical means are known components, such as motion sensors, acceleration sensors, gyroscopes, magnetic sensors, positioning modules (GPS modules, beacon-based positioning (identification) modules, etc.), barometers, distance sensors, cameras Etc. can be mentioned.

In addition, according to an embodiment of the present invention, the

device

310, 320 has a posture of the

device

310, 320 based on the biometric information obtained from the human body of the user having the device (310, 320) Technical means may be obtained for obtaining physical information about the movement. As an example of such technical means, an EMG signal measuring apparatus etc. are mentioned.

In addition, the

devices

310 and 320 process the above physical information to provide information or control commands to

other devices

310 and 320, or receive information or control commands from

other devices

310 and 320, or the like. An application program for generating such information or control command may be further included. Such an application may exist in the form of a program module in the

corresponding devices

310 and 320. The nature of the program module may be similar to the overall control of the user interface providing system 200 as described above. Here, the application may be replaced with a hardware device or a firmware device, at least a part of which may perform a function substantially the same or equivalent thereto.

Meanwhile, according to an embodiment of the present invention, the first device 310 and the second device 320 may have a predetermined association (for example, an association that belongs to the same user, or an association that functions for the same user). The first device 310 and the second device 320 when it is recognized that they have an association that is located substantially close to each other, or that one of them is reasonable to authenticate or allow the other. A predetermined connection may be formed between the two terminals, which may be performed by the user interface providing system 200 or may be performed by the first device 310 and the second device 320.

Examples

Hereinafter, a detailed example in which the user interface providing system 200 according to the present invention provides a user interface in which a plurality of

devices

310 and 320 are involved according to various embodiments will be described in detail.

According to an embodiment of the present invention, the user interface providing system 200 obtains information about a relative position with respect to the user of the first device 310 or the second device 320, and obtains the first device ( 310 or the triggering event that causes acoustic feedback in the second device 320, information regarding the type of triggering event above, information about the relative position obtained above, and a display state associated with the triggering event above. The first device 310 or with reference to information relating to the information relating to the information, the content or function associated with the above triggering event or at least one of the first device 310 and the second device 320. The property of the acoustic feedback provided by the second device 320 may be controlled. Here, only one of the first device 310 and the second device 320 may be worn on the user's body, or both the first device 310 and the second device 320 may be worn on the user's body.

According to an embodiment of the present invention, the triggering event, while the first device 310 and the second device 320 may be involved, the first device 310, the second device 320 or the user interface providing system ( All kinds of events that can be detected by 200 may be included. For example, the triggering event may include an event in which a user performs a touch manipulation with respect to the first device 310 or the second device 320. For another example, the triggering event may include data transmission, payment, security authentication, etc. between the first device 310 and the second device 320 as the first device 310 and the second device 320 interact with each other. It may include an event that the operation of the. For another example, in the triggering event, a relative relationship between a posture or a movement of the first device 310 and a posture or a movement of the second device 320 is preset (eg, the first device 310). The display screen and the display screen of the second device 320 may include an event corresponding to the opposite direction). As another example, the triggering event may include an event in which predetermined multimedia content is played on the first device 310 or the second device 320. As another example, the triggering event may be a predetermined event (eg, in the device 310 or 320) with respect to a situation in which acoustic content is provided in at least one of the first device 310 or the second device 320. An event in which music is played while the game is running, an event in which music is played at a predetermined time in the

devices

310 and 320, and the like.

Specifically, in the user interface providing system 200 according to an embodiment of the present invention, at least a part of the acoustic feedback provided from the first device 310 may correspond to the occurrence of the triggering event. Or at least some of the acoustic feedback provided by the second device 320 may be provided by the first device 310. Here, the device to provide the acoustic feedback may be determined according to where the first device 310 or the second device 320 is located relative to the user.

Further, according to an embodiment of the present invention, the user interface providing system 200 according to an embodiment of the present invention, in response to the triggering event occurs, with reference to the display state of the portion associated with the triggering event, The first device 310 and the second device 320 may perform a function of determining a property (ie, a pattern) of the acoustic feedback provided from each. For example, it may be determined which device of the first device 310 and the second device 320 to generate acoustic feedback based on the color or brightness of the graphical object displayed on the portion touched by the user.

In addition, according to an embodiment of the present invention, the user interface providing system 200 according to an embodiment of the present invention, in response to the triggering event occurs, by referring to the content or function associated with the triggering event with reference to the first A function of determining a pattern of acoustic feedback provided by each of the device 310 and the second device 320 may be performed. For example, when predetermined data is transmitted from the first device 310 to the second device 320, the second device 320 is reduced along with a decrease in the intensity of the sound provided from the first device 310. Intensity of the sound provided in the can be increased, so that the user can be provided with a user experience (UX, User Experience) that feels as if the sound provided from the first device 310 has been transferred to the second device (320) do.

In addition, the user interface providing system 200 according to an embodiment of the present invention may correspond to where the triggering event occurs, where the first device 310 or the second device 320 is relative to the user. A function of determining a pattern of acoustic feedback provided from each of the first device 310 and the second device 320 may be performed with reference to the information regarding whether the information is located. For example, when the first device 310 and the second device 320 are worn at the first point and the second point of the user's body, respectively, the first device 310 and the second device 320 Each of the patterns of acoustic feedback provided at can be adjusted accordingly, such that the user feels as if the acoustic feedback occurs at any point located between the first point and the second point or at the second point. You will be provided with a user experience that feels like moving acoustic feedback to a point.

Here, the pattern of acoustic feedback provided in each of the first device 310 and the second device 320 may be specified by at least one of time, order, time interval, and intensity at which the acoustic feedback is provided. According to an embodiment of the present invention, the pattern of the acoustic feedback provided by the first device 310 and the pattern of the acoustic feedback provided by the second device 320 may have a complementary relationship.

In addition, the user interface providing system 200 according to an exemplary embodiment of the present disclosure may correspond to information on acoustic performance of the first device 310 or the second device 320 in response to the occurrence of a triggering event. As a result, a function of determining a pattern of acoustic feedback provided from each of the first device 310 and the second device 320 may be performed. For example, information about whether the first device 310 or the second device 320 has a function to output sound, and the sound mounted on the first device 310 or the second device 320. Information on whether the output function is activated or the specification of the sound output function mounted on the first device 310 or the second device 320 (for example, the output power intensity, the output frequency, and the output power) The pattern of acoustic feedback provided in each of the first device 310 and the second device 320 may be determined based on the information about the number of channels, etc.).

First, referring to FIG. 2, it may be assumed that the first device 310, which is a smartphone, is gripped by a user's left hand, and the second device 320, which is a smart watch, is worn on a user's right wrist. In this case, if the user interface providing system 200 according to an embodiment of the present invention needs to be provided with acoustic feedback on the right side when facing the user, the acoustic feedback may be dominantly generated in the first device 310. When the acoustic feedback needs to be provided on the left side when facing the user, the acoustic feedback may be dominantly generated in the second device 320.

Next, referring to FIG. 3, the first device 310, which is a smartphone, is gripped on the user's left hand, and the second device 320, which is a smart watch, is worn on the user's right wrist, and the third is a smart necklace. It may be assumed that the device 330 is worn on the user's neck. In this case, the user interface providing system 200 according to an embodiment of the present invention may have a sound feedback at the lower right when facing the user. If so, the acoustic feedback is dominantly generated in the first device 310, and if it needs to be provided from the bottom left when facing the user, the acoustic feedback is dominant in the second device 320. If the acoustic feedback needs to be provided from the upper right when facing the user, the acoustic feedback is transmitted to the first device 310 and To be dominantly generated in the third device 330, and if the acoustic feedback needs to be provided in the upper left when facing the user, such acoustic feedback may be dominantly generated in the second device 320 and the third device 330 can do.

4 and 5, in a user interface providing system 200 according to an exemplary embodiment, a user wearing a second device 320 on a wrist touches a touch panel of the first device 310. When a triggering event occurs, the sound may be generated in the second device 320 after the sound is generated in the first device 310, and accordingly, the user may receive the sound provided by the first device 310. It is possible to receive a user experience that is felt as if moved to the second device 320 worn on his wrist.

For another example, as shown in Figure 3, the user is holding the smart phone 310 in the left hand, wearing the smart watch 320 on the right wrist, wearing the smart neckles 330 on the neck The case can be assumed. In this case, the user interface providing system 200 according to an embodiment of the present invention, in the smartphone 310, the smart watch 320 and the smart neckles 330 in the order listed above or as listed above By causing the acoustic feedback to occur in the reverse order, it is possible to provide spatiotemporal acoustic feedback to the user.

First, referring to FIGS. 6 and 7, various graphic elements having various colors or brightness are displayed on the display screen of the first device 310, which is a smartphone, and wears the second device 320, which is a smart watch. It may be assumed that a user performs a touch operation on the display screen of the first device 310.

In this case, according to an embodiment of the present invention, when the user touches a graphic element of relatively bright color, acoustic feedback occurs in the first device 310, and when the user touches a graphic element of relatively dark color, Acoustic feedback may occur at the second device 320 (see FIG. 6). In addition, according to an embodiment of the present invention, when a user performs a drag operation over an area in which relatively light color graphic elements and relatively dark color graphic elements are alternately displayed (see FIG. 7A). In addition, the acoustic feedback may occur alternately in the first device 310 and the second device 320 (see FIG. 7B).

Next, referring to FIGS. 8 to 11, the system 200 for providing a user interface according to an embodiment of the present invention includes various sounds in a smart phone, which is a first device 310, and a smart watch, which is a second device 320. The feedback may be provided. Specifically, the time, period, time interval, intensity, etc. in which the acoustic feedback is provided may be variously set.

Next, referring to FIG. 12, graphic elements of various patterns are displayed on the display screen of the first device 310, which is a smartphone, and a user who wears the second device 320, which is a smart watch, is the first device. It may be assumed that a touch operation is performed on the display screen of 310. In this case, according to one embodiment of the present invention, the acoustic feedback (ie, sound) corresponding to the pattern of the graphic element displayed on the display screen of the first device 310 is the first device 310 or the second May occur at device 320. For example, according to an embodiment of the present invention, the first device 310 and the second device in response to a user touching a display screen of the first device 310 displaying a graphic element having a rough texture. The acoustic feedback may be generated alternately with each other in a short cycle at 320, thereby allowing the user to intuitively feel the rough texture of the graphic element displayed on the display screen of the first device 310.

Referring to FIGS. 13 and 15, a triggering event occurs in which a user wearing the second device 320 on the wrist drags the touch panel of the first device 310 in a touched state and then releases it in an untouched state. (See FIG. 13), in this case, the acoustic feedback may occur in the second device 320 after the acoustic feedback occurs in the first device 310, and in particular, the user. The acoustic feedback may continue to occur in the second device 320 even in a release state in which the touch panel of the first device 310 is no longer touched (see FIG. 14). In addition, the intensity of the acoustic feedback occurring in the released state may decay over time (see FIG. 15).

First, referring to FIGS. 16 and 17, the user wearing the second device 320 on the wrist maintains a state in which a part corresponding to certain content 1610 is touched on the touch panel of the first device 310. Accordingly, it may be assumed that the corresponding content 1610 is transmitted from the first device 310 to the second device 320. In this case, according to an embodiment of the present invention, the user interface providing system 200 provides acoustic feedback with information regarding the transmission status of the content 1610 transmitted from the first device 310 to the second device 320. For example, as the transmission of the content 1610 proceeds, the strength of the acoustic feedback generated by the first device 310 is weakened while the strength of the acoustic feedback generated by the second device 320 is reduced. Can be made stronger (see FIG. 17).

Next, referring to FIGS. 18 and 19, as the user wearing the second device 320 on the wrist maintains a state in which the user touches the touch panel of the first device 310, the second device 320 is provided. It may be assumed that the content 1810 is transmitted from the second device 320 to the first device 310. In this case, according to an embodiment of the present invention, the user interface providing system 200 provides acoustic feedback with information regarding the transmission status of the content 1810 transmitted from the second device 320 to the first device 310. For example, as the transmission of the content 1810 proceeds, the intensity of the acoustic feedback generated by the second device 320 is weakened while the intensity of the acoustic feedback generated by the first device 310 is reduced. Can be made stronger (see FIG. 19).

Referring to FIG. 20, it may be assumed that a user wears a smart watch 310 on a wrist and a smart band 330 on a forearm. In this case, the user interface providing system 200 according to an embodiment of the present invention recognizes the position where the smart watch 310 and the smart band 320 are worn, and the smart watch 310 and the smart band ( By encoding the acoustic signal such that acoustic feedback is provided sequentially or complementarily at 320, spatiotemporal acoustic feedback may be provided to the user. For example, when the sound generated by the smart band 320 decreases in intensity and the intensity of the sound generated by the smart watch 310 increases, the user may be provided with acoustic feedback of a feeling away from himself. do.

Referring to FIG. 21, it may be assumed that a first user and a second user respectively wear a first smart watch 310 and a second smart watch 320 on a wrist. In this case, the user interface providing system 200 according to an embodiment of the present invention recognizes a position where the first smart watch 310 and the second smart watch 320 are worn, and the first smart watch ( By encoding the acoustic signals such that the acoustic feedback is provided sequentially or complementarily in the 310 and the second smart watch 320, spatiotemporal acoustic feedback may be provided to the first user and the second user. For example, when the sound generated by the first smart watch 310 decreases in intensity and the intensity of the sound generated by the second smart watch 320 increases, the first user and the second user receive the first sound. The user may be provided with acoustic feedback of the feeling transmitted from the user to the second user.

In addition, in the above, the first device 310 is a smart phone that is held in the user's hand and the second device 320 is mainly described for the smart watch worn on the user's wrist, the present invention is not necessarily The present invention is not limited thereto, and the first device and the second device may be implemented in other forms such as a smart pad, a smart glass, a smart band, and a smart ring within the scope of achieving the object of the present invention.

Embodiments according to the present invention described above may be implemented in the form of program instructions that may be executed by various computer components, and may be recorded on a non-transitory computer readable recording medium. The non-transitory computer readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the non-transitory computer readable recording medium may be those specially designed and configured for the present invention, or may be known and available to those skilled in the computer software arts. Examples of non-transitory computer readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs, DVDs, magnetic-optical media such as floppy disks ( magneto-optical media) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform the process according to the invention, and vice versa.

Although the present invention has been described by specific embodiments such as specific components and the like, but the embodiments and the drawings are provided to assist in a more general understanding of the present invention, the present invention is not limited to the above embodiments. For those skilled in the art, various modifications and variations can be made from these descriptions.

Accordingly, the spirit of the present invention should not be limited to the above-described embodiments, and all of the equivalents or equivalents of the claims, as well as the appended claims, fall within the scope of the spirit of the present invention. I will say.

Explanation of sign

100: network

200: user interface providing system

310: first device

320: second device

330: third device

1610, 1810: content

Claims

As a method for providing a user interface,

Obtaining information regarding a relative position relative to a user of at least one of the first device and the second device, and

When at least one of the first device and the second device has a triggering event that causes acoustic feedback, information regarding the type of the triggering event, information about the obtained relative position, and a display state associated with the triggering event are provided. Among at least one of the first device and the second device, with reference to at least one of information related to the information related to the information, the content or function associated with the triggering event, and information about the acoustic performance of at least one of the first device and the second device. Controlling the properties of the acoustic feedback provided in the at least one

How to include.
The method of claim 1,

The triggering event may include an event in which a touch manipulation occurs in at least one of the first device and the second device, between the first device and the second device as the first device and the second device interact with each other. An event in which at least one of data transmission, payment, and security authentication is performed, an event in which a relative relationship between a posture or movement of the first device and a posture or movement of the second device corresponds to a preset relationship, and the first device And at least one of a preset event with respect to a situation in which acoustic content is provided in at least one of the second devices.
The method of claim 1,

The property of the acoustic feedback is specified by at least one of time, order, time interval and intensity at which the acoustic feedback is provided.
The method of claim 1,

And the property of the acoustic feedback provided in the first device and the property of the acoustic feedback provided in the second device are complementary.
The method of claim 1,

Any one of the first device and the second device is worn on the body of the user,

In the control step,

When the triggering event occurs, at least one of the first device and the second device, information regarding the acquired body wearing position, information about a display state associated with the triggering event, information about a content or function associated with the triggering event, and the like. With reference to at least one of the information about one acoustic performance, at least some of the acoustic feedback provided by the first device is provided by the second device, or at least some of the acoustic feedback provided by the second device is Provided to the first device.
The method of claim 1,

The first device and the second device is worn on the body of the user,

In the control step,

When the triggering event occurs, at least one of the first device and the second device, information regarding the acquired body wearing position, information about a display state associated with the triggering event, information about a content or function associated with the triggering event, and the like. A method for controlling the property of acoustic feedback provided in each of the first device and the second device with reference to at least one of information regarding one acoustic performance.
A non-transitory computer readable recording medium having recorded thereon a computer program for executing the method according to any one of claims 1 to 6.
A device for providing a user interface,

Technical means for obtaining information regarding a relative location relative to a user of the device and detecting that a triggering event occurs that causes acoustic feedback in at least one of the device and other devices associated with the device, and

When the triggering event occurs, information on the type of the triggering event, information on the obtained relative position, information on the display state associated with the triggering event, information on the content or function associated with the triggering event and the device And a program module for controlling an attribute of acoustic feedback provided in at least one of the device and the other device with reference to at least one of information regarding acoustic performance of at least one of the other devices.

Device comprising a.
A system for providing a user interface,

Acquiring relative information based on a user of at least one of the first device and the second device, and when a triggering event that causes acoustic feedback occurs in at least one of the first device and the second device, the triggering event Information regarding a type, information about the obtained relative position, information about a display state associated with the triggering event, information about a content or function associated with the triggering event, and sound of at least one of the first device and the second device. A controller for controlling an attribute of acoustic feedback provided by at least one of the first device and the second device with reference to at least one of the information about the performance, and

A storage storing information received from at least one of the first device and the second device

System comprising.
The method of claim 9,

The triggering event may include an event in which a touch manipulation occurs in at least one of the first device and the second device, between the first device and the second device as the first device and the second device interact with each other. An event in which at least one of data transmission, payment, and security authentication is performed, an event in which a relative relationship between a posture or movement of the first device and a posture or movement of the second device corresponds to a preset relationship, and the first device And at least one of a predetermined event with respect to a situation in which acoustic content is provided in at least one of the second devices.
The method of claim 9,

The property of the acoustic feedback is specified by at least one of time, order, time interval and intensity at which the acoustic feedback is provided.
The method of claim 9,

Wherein the property of the acoustic feedback provided at the first device and the property of the acoustic feedback provided at the second device are complementary.
The method of claim 9,

Any one of the first device and the second device is worn on the body of the user,

The control unit, when the triggering event occurs, information about the acquired body wearing position, information on the display state associated with the triggering event, information on the content or function associated with the triggering event and the first device and the first device. With reference to at least one of the information regarding the acoustic performance of at least one of the two devices, at least some of the acoustic feedback provided by the first device is provided by the second device, or the acoustic feedback provided by the second device At least some of which are provided to the first device.
The method of claim 9,

The first device and the second device is worn on the body of the user,

The control unit, when the triggering event occurs, information about the acquired body wearing position, information on the display state associated with the triggering event, information on the content or function associated with the triggering event and the first device and the first device. A system for controlling an attribute of acoustic feedback provided in each of the first device and the second device with reference to at least one of information regarding the acoustic performance of at least one of the two devices.