KR20200084906A - User interface object manipulations in a user interface - Google Patents

Abstract

Systems and processes for manipulating a graphical user interface are disclosed. One process can include receiving user input through a crown to rotate a virtual object. The process includes selecting an object's surface among multiple surfaces of the object in response to determining whether the crown rotation exceeds a speed threshold.

Description

User interface object manipulation in the user interface {USER INTERFACE OBJECT MANIPULATIONS IN A USER INTERFACE}

Cross reference of related applications

This application is filed on September 3, 2013, and the title of the invention is "CROWN INPUT FOR A WEARABLE ELECTRONIC DEVICE", US Patent Provisional Application No. 61/873,356; United States Patent Provisional Application No. 61/873,359, filed September 3, 2013 and entitled "User Interface Object Manipulation in a User Interface (USER INTERFACE OBJECT MANIPULATIONS IN A USER INTERFACE)"; United States Patent Provisional Application No. 61/959,851, filed September 3, 2013 and entitled "User Interface for Manipulating User Interface Objects (USER INTERFACE FOR MANIPULATING USER INTERFACE OBJECTS)"; U.S. Patent Provisional Application No. 61/ 873,360; And US Patent Application No. 14/476,657, filed September 3, 2014, entitled "User Interface for Manipulating User Interface Objects Using Magnetic Properties". The contents of these applications are in fact incorporated herein by reference in their entirety.

This application is filed on September 3, 2014, and the title of the invention is "crown input for wearable electronic devices," and the inventor is Nicholas Zambetti et al., a US patent regular application; United States patent regular application filed on September 3, 2014, the name of the invention being "user interface for manipulating user interface objects", and the inventor Nicholas Zambetti et al.; United States Patent Application Serial No. 14/476,657, filed September 3, 2014, entitled “Manipulating User Interface Objects in a User Interface”; And United States Patent Application Serial No. 61/747,278, filed December 29, 2012, entitled "Device, Method, and Graphical User Interface for Manipulating User Interface Objects Using Visual and/or Haptic Feedback" It is related to the co-pending applications as in the call. The contents of these applications are in fact incorporated herein by reference in their entirety.

The present disclosure relates generally to a user interface, and more specifically to a user interface using a crown input mechanism.

Modern personal electronic devices may have a small form factor. Such personal electronic devices include, but are not limited to, tablets and smart phones. The use of such personal electronic devices entails manipulation of user interface objects on the display screen, which also has a small form factor that complements the design of the personal electronic device.

Exemplary operations a user can perform on a personal electronic device include hierarchical navigation, selection of user interface objects, adjustment of the location, size, and magnification of user interface objects, or other user interface manipulation. Exemplary user interface objects include digital images, video, text, icons, maps, control elements such as buttons, and other graphics. The user can perform such operations in image management software, video editing software, word processing software, software execution platforms such as operating system workspaces, website browsing software, and other environments.

Existing methods for manipulating user interface objects on a reduced size touch-sensitive display may be inefficient. Also, existing methods are generally less precise than preferred.

Systems and processes for manipulating a graphical user interface are disclosed. One process can include receiving user input through a crown to rotate a virtual object. The process includes selecting an object's surface among multiple surfaces of the object in response to determining whether the crown rotation exceeds a speed threshold.

This application may be best understood with reference to the following descriptions described in conjunction with the accompanying drawing features, and the same parts may be referenced by the same number.
1 shows an example wearable electronic device according to various examples.
2 shows a block diagram of an example wearable electronic device according to various examples.
3-12 show an exemplary graphical user interface showing the selection of the surface of a double-sided object in response to the rotation of the crown.
13 shows an exemplary process for selecting the surface of a double-sided object in response to the rotation of the crown.
14-23 illustrate exemplary graphical user interfaces showing the selection of the surface of an object in response to rotation of the crown.
24 shows an exemplary process for selecting the surface of an object in response to the rotation of the crown.
25 shows an exemplary polyhedral object in a graphical user interface.
26 shows an example computing system for manipulating a user interface in response to rotation of a crown according to various examples.

In the following description of the disclosure and examples, reference is made to the accompanying drawings in which specific examples that may be practiced are shown by way of illustration within the drawings. It will be understood that other examples can be practiced and structural modifications can be made without departing from the scope of the disclosure.

Many personal electronic devices have a graphical user interface with options that can be activated in response to user input. Typically, a user can select and activate a specific option from among several options. For example, the user can select an option by using the pointing device to place the mouse cursor over the desired option. The user can activate the option by clicking the button of the pointing device while the option is being selected. In another example, a user can select or activate an option displayed on a touch-sensitive display (also known as a touch screen) by touching a touch-sensitive display at a location where the options are displayed. Considering the inefficiencies of existing methods for selecting options on a reduced size touch-sensitive display, there is a need for methods that enable users to more efficiently and conveniently select desired options in a graphical user interface environment. .

The examples below describe improved techniques for selecting the surface of a user interface object in a graphical user interface using user input. More specifically, these techniques use a physical crown as an input device that allows the user to select a desired option by selecting the surface of a user interface object. Consequently, the examples described below allow the user to more efficiently and conveniently select the desired option.

1 shows an exemplary personal electronic device 100. In the illustrated example, the device 100 is generally a watch that includes a body 102 and a watch band 104 for securing the device 100 to the user's body. That is, the device 100 is wearable. Body 102 may be designed to engage watch bands 104. Device 100 may have a touch-sensitive display screen (hereafter touch screen) 106 and crown 108. Device 100 may also have buttons 110, 112, 114.

Conventionally, in the context of a watch, the term'crown' refers to the cap on the stem to wind the watch. In the context of a personal electronic device, the crown may be a physical component of the electronic device rather than a virtual crown on a touch-sensitive display. Crown 108 can be a mechanical means that can be connected to a sensor for converting the physical movement of the crown into an electrical signal. The crown 108 can rotate in two directions of rotation (eg, front and rear). Crown 108 may also be pushed towards the body of device 100 and/or pulled out of device 100. The crown 108 may be touch-sensitive, for example, using capacitive touch technology that can detect whether the user is touching the crown. In addition, the crown 108 may further swing in one or more directions, or at least partially translate around the perimeter around the track along the edge of the body 102. In some examples, two or more crowns 108 may be used. The visual appearance of the crown 108 may follow the crown of a conventional watch, but this is not necessary. When the buttons 110, 112, and 114 are included, each may be a physical or touch-sensitive button. That is, the buttons can be, for example, physical buttons or capacitive buttons. Also, the main body 102, which may include a bezel, may have predetermined areas that serve as buttons on the bezel.

Display 106 may include a display device such as a liquid crystal display (LCD), light emitting diode (LED) display, organic light emitting diode (OLED) display, etc., which may be any desired touch sensing technology, such as mutual capacitive touch sensing, It is disposed on the front or partially or completely behind the touch sensor panel implemented using single capacitive touch sensing, resistive touch sensing, projection scan touch sensing, and the like. Through the display 106, the user may perform various functions by touching the touch sensor panel using one or more fingers or other objects or roaming the vicinity.

In some examples, device 100 may further include one or more pressure sensors (not shown) to detect forces or pressures applied to the display. The force or pressure exerted on the display 106 can be used as input to the device 100 to perform any desired action, such as selecting, entering or exiting a menu, causing additional options/activities to be displayed, and the like. . In some examples, different actions can be performed based on the amount of force or pressure being applied to the display 106. One or more pressure sensors may be further used to determine where force is being applied to the display 106.

2 shows a block diagram of some components of device 100. As shown, crown 108 may be coupled to encoder 204, which monitors the physical state or change in state of crown 108 (eg, the position of the crown), converts it into an electrical signal, and (For example, converting it to an analog or digital signal representation of the position or change in position of the crown 108), it can be configured to provide a signal to the processor 202. For example, in some examples, the encoder 204 detects the absolute rotational position of the crown 108 (eg, an angle from 0 to 360° each) and sends an analog or digital indication of this position to the processor 202. It can be configured to output. Alternatively, in other examples, the encoder 204 detects a change in the rotational position of the crown 108 (eg, a change in rotation angle) during some sampling period and displays an analog or digital indication of the detected change in the processor ( 202). In these examples, crown position information may also indicate the direction of rotation of the crown (eg, a positive value may correspond to one direction and a negative value may correspond to the other direction). In still other examples, the encoder 204 can be configured to detect rotation of the crown 108 in any desired manner (eg, speed, acceleration, etc.) and provide crown rotation information to the processor 202. Can. In alternative examples, instead of providing information to the processor 202, this information can be provided to other components of the device 100. Although the examples described herein refer to the use of the rotational position of the crown 108 to control scrolling, scaling, or object position, it will be understood that any other physical state of the crown 108 can be used.

In some examples, the physical state of the crown can control the physical properties of the display 106. For example, if the crown 108 is in a certain position (eg, rotated forward), the display 106 may be limited in z-axis crossing capability. In other words, the physical state of the crown can indicate the functionality of the physical modality of the display 106. In some examples, the temporal properties of the physical state of crown 108 can be used as input to device 100. For example, a rapid change in physical state can be interpreted differently from a slow change in physical state.

The processor 202 may further be coupled to receive input signals from the buttons 110, 112, 114 in accordance with touch signals from the touch-sensitive display 106. The button can be, for example, a physical button or a capacitive button. Also, the main body 102, which may include a bezel, may have predetermined areas that serve as buttons on the bezel. The processor 202 may be configured to interpret these input signals and output an appropriate display signal, such that an image is generated by the touch-sensitive display 106. Although a single processor 202 is shown, it will be understood that any number of processors or other computing devices may be used to perform the general functions discussed above.

3-12 show an exemplary user interface 300 displaying a user interface object 302 on both sides. Object 302 has a first surface 304 and a second surface 306. Each surface of the object 302 is a selectable surface associated with corresponding data. The data can be, for example, text, images, application icons, commands, binary ON or OFF options, and the like. The user selects a surface among multiple selectable surfaces of the object 302 by rotating the object 302 using the physical crown of the wearable electronic device to align the desired select surface, so that the preferred select surface is the device 100 It is parallel to the display 106 of and is displayed on the display 106. The system is designed to switch from one surface to another and not stop between surfaces. Although the examples are described with respect to an object surface (or planes) parallel to the display 106, the examples may also be modified to be described with respect to an object surface (or planes) instead facing the observer of the display 106. This modification can be particularly helpful when the object surface or display 106 is not a planar surface.

Crown 108 of device 100 is a user interface input that is rotatable by a user. The crown 108 can return in two distinct directions: clockwise and counterclockwise. 3 to 12 include a rotation direction arrow indicating the direction of crown rotation, and, if applicable, a movement direction arrow indicating the rotation direction of the user interface object. Rotation direction arrows and movement direction arrows are not part of the normally displayed user interface, but are provided to aid in the interpretation of the drawing. In this example, the clockwise rotation of crown 108 is illustrated by a rotational direction arrow pointing upwards. Likewise, the counterclockwise rotation of the crown 108 is illustrated by a rotational direction arrow pointing down. The nature of the rotation direction arrow does not indicate the distance, speed, or acceleration at which the crown 108 is rotated by the user. Instead, the direction of rotation arrow indicates the direction of rotation of the crown 108 by the user.

In FIG. 3, the first surface 304 of the object 302 is aligned and displayed parallel to the display 106, indicating the selection of the first surface 304. The selected first surface 304 can be activated, for example, through additional user input. In FIG. 4, device 100 determines a change in the position of crown 108 clockwise, as indicated by rotation direction arrow 308. The device 100 determines the rotational speed and direction based on the determined change in the position of the crown 108. In response to determining the change in the position of the crown 108, the device rotates the object 302, as indicated by the direction of movement arrow 310 and shown in FIG. The rotation of the object 302 is based on the determined rotation speed and direction. The rotational speed can be expressed in several ways. For example, the rotation speed may be expressed in hertz, rotation per unit time, rotation per frame, revolution per unit time, revolution per frame, change in angle per unit time, and the like. In one example, object 302 may be associated with mass or may have a calculated rotational inertia.

In FIGS. 5-7, device 100 continues to determine a change in the position of crown 108 clockwise, as indicated by rotational arrow 308. The device 100 determines the rotational speed and direction based on the determined change in the position of the crown 108. In response to determining the change in the position of the crown 108, the device continues to rotate the object 302, as indicated by the direction of movement arrow 310 and shown in FIGS. 5 and 6. The rotation of the object 302 is based on the determined rotation speed and direction.

In one example, the rotation angle of the object 302 is based on the determined speed as measured from the position of the object when parallel to the display 106. More easily visualized, object 302 can be considered to have some similar characteristics to an analog tachometer. As the determined speed increases, the angle of rotation of the object 302 increases. In this example, if the rotation of crown 108 is maintained at a constant speed, object 302 will stay static in a rotated position that is not parallel to display 106. If the rotational speed of crown 108 is increased, the determined speed will increase and object 302 will rotate by increments.

In some examples, object 302 is configured to be perpendicular to display 106 in response to the determined speed being a speed threshold. If the determined speed exceeds the speed threshold, the object 302 exceeds the total rotation of 90 degrees, such that the first surface 304 of the object 302 is no longer displayed, and instead the second surface of the object 302 ( 306) is displayed. This transition between the indication of the first surface 304 and the indication of the second surface 306 is shown as the transition between FIGS. 7 and 8. Thus, as the determined speed exceeds the speed threshold, the object 302 is flipped from one side to the other.

In FIGS. 9-12, device 100 determines that there is no further change in the position of crown 108. As a result of this determination, the rotation of the object 302 is changed such that the surface of the object 302 is parallel to the display 106. This change can be animated, as shown in Figures 9-12. The device 100 rotates the object 302 so that the surface of the object 302 partially opposite the display 106 is displayed 106 when the device 100 determines that there is no change in the position of the crown 108. Make it the surface to be marked as parallel to. When the surface of the object 302 is parallel to the display 106 and no change in the position of the crown 108 is detected, the object 302 is in a steady state. When an object is not translated, rotated, or scaled, it is in a normal state.

In some examples, when the object 302 is in a normal state, the display surface of the object 302 parallel to the display 106 can be activated using additional input. It is determined that in the normal state, a display surface parallel to the display 106 is selected prior to activation. For example, the object 302 can be used as an ON/OFF switch or toggle. The first surface 304 is associated with an ON command, and the second surface 306 is associated with an OFF command. The user can switch between the ON and OFF states by rotating the crown 108 above the speed threshold to cause the object 302 to flip over to display the desired surface. When the desired surface is displayed on the display 106, parallel to the display 106, and a change in the position of the crown 108 is not detected, it is determined that the desired surface is selected.

While the surface is being selected, the user can activate the selected surface using one or more of a number of techniques. For example, the user presses the touch-sensitive display 106, presses the touch-sensitive display with a force greater than a predetermined threshold, presses the button 112, or simply the time the surface is of a predetermined length. Can remain selected for a while. In another example, when the display surface is parallel to the display 106, the operation can be interpreted as selection of the display surface and activation of data associated with the display surface.

13 shows an exemplary process for selecting the surface of a graphical user interface object on both sides in response to the rotation of the crown. Process 1300 is performed in a wearable electronic device having a physical crown (eg, device 100 of FIG. 1 ). In some examples, the electronic device also includes a touch-sensitive display. The process provides an effective technique for selecting the surface of a two-sided, two-dimensional object.

In block 1302, the device causes a double-sided object to be displayed on the touch-sensitive display of the wearable electronic device. In some examples, the object is two-dimensional. In other examples, the object is three-dimensional, but only two surfaces are selectable. Each selectable surface of the object is associated with a corresponding data value. The data can be, for example, text, images, application icons, commands, binary ON or OFF options, and the like.

At block 1304, the device receives crown location information. Crown position information can be received as a series of pulse signals, real values, integer values, and the like.

At block 1306, the device determines whether a change in crown distance value has occurred. The crown distance value is based on the angular displacement of the physical crown of the wearable electronic device. A change in crown distance value indicates that the user provides input to the wearable electronic device, for example, by turning a physical crown. If the device determines that no change in crown distance value has occurred, the system returns to block 1304 to continue receiving crown location information. If the device determines that a change in crown distance value has occurred, the system continues to block 1308, but the system can continue to receive crown position information.

At block 1308, the device determines direction and crown speed. Crown speed is based on the rotational speed of the physical crown of the wearable electronic device. For example, the determined crown speed may be expressed in hertz, rotation per unit time, rotation per frame, revolution per unit time, revolution per frame, and the like. The determined direction is based on the rotational direction of the physical crown of the wearable electronic device. For example, the upward direction can be determined based on the clockwise rotation of the physical crown. Likewise, the downward direction can be determined based on the counterclockwise rotation of the physical crown. In other examples, the downward direction may be determined based on the clockwise rotation of the physical crown, and the upward direction may be determined based on the counterclockwise rotation of the physical crown.

In block 1310, in response to determining the change in crown distance value, the device causes an initial rotation of the double-sided object on the display. The amount of rotation is based on the determined crown speed. The direction of rotation is based on the determined direction. Rotation can be animated.

At block 1312, the device determines whether the determined crown speed exceeds the speed threshold. If the device determines that the determined crown speed exceeds the speed threshold, the device continues to block 1314. For example, the speed threshold can be considered as the escape velocity (or escape velocity). The escape velocity is the speed at which the sum of the kinetic energy of the object and the potential energy due to gravity becomes zero. If the device determines that the determined crown speed does not exceed the speed threshold, the device proceeds to block 1316.

In some examples, the minimum angular velocity of crown rotation required to reach the escape velocity directly corresponds to the instantaneous angular velocity of crown 108 (FIG. 1), which means that the user interface of device 100 is, essentially, crown 108 This means that it responds when it reaches a sufficient angular velocity. In some embodiments, the minimum angular velocity of crown rotation required to reach the escape velocity is a calculated velocity that is based on the instantaneous (“current”) angular velocity of crown 108, but is not necessarily the same. In these examples, device 100 may maintain the calculated crown (angular) velocity V at each discrete moment of time T according to Equation 1:

[Equation 1]

V _T =V _(T-1) + ΔV _crown -ΔV _drag .

In Equation 1, V _T represents the crown velocity (speed and direction) calculated at time T, V _(T-1) represents the previous velocity (speed and direction) at time T-1, and the ΔV _crown Denotes a change in velocity caused by the force being applied through the rotation of the crown at time T, and ΔV _drag represents a change in velocity due to the drag force. The force exerted is reflected through the ΔV _crown , and may vary depending on the current angular rotational speed of the crown. Thus, the ΔV _crown can also vary depending on the current angular velocity of the crown. In this way, the device 100 not only is based on the instantaneous crown speed, but also provides user interface interaction based on user input in the form of crown movement over multiple time intervals even when the intervals are finely separated. Can. Typically, if there is no user input in the form of a ΔV _crown , V _T will approach (and become 0) based on the ΔV _drag according to Equation 1, but the user input in the form of a crown rotation (ΔV _crown ) will It should be noted that if not present, V _T may not change the signal.

Typically, the greater the speed of each rotation of the crown, the greater the value of the ΔV _crown . However, the actual mapping between the angular rotational speed of the _crown and the ΔV _crown can vary depending on the desired user interface effect. For example, various linear or nonlinear mappings between the angular rotational speed of the _crown and the ΔV _crown can be used.

Also, ΔV _drag can take a variety of values. For example, ΔV _drag can vary depending on the speed of the crown rotation, so that at larger speeds, the opposite change of greater speed (ΔV _drag ) can be created. In another example, ΔV _drag may have a constant value. It will be appreciated that the requirements of the ΔV _crown and ΔV _drag described above can be changed to create desirable user interface effects.

As can be seen in Equation 1, as long as the ΔV _crown is larger than the ΔV _drag , the retained velocity V _T may continue to increase. Additionally, even when ΔV _crown input is not received, V _T can have a non-zero value, which means that user interface objects can still be changed without the user rotating the crown. When this occurs, the objects can stop changing when the user stops rotating the crown and ΔV _drag component based on the speed maintained.

In some examples, if the crown rotates in a direction corresponding to the opposite rotational direction in which the current user interface is changed, the V _(T-1) component is reset to a value of 0, allowing the user sufficient force to offset V _T. You can quickly change the orientation of an object without providing it.

In block 1314, the device causes the object to flip past the transition position between the first and second surfaces that were last selected. For example, if the object is flipped past the transition position, it will not turn so that the first surface is displayed parallel to the display without receiving additional user input. In the example of a double-sided object, the transition position will be when the surface is perpendicular to the display.

When the object reaches a steady state, a display surface parallel to the display can be activated by a designated user input. It is determined that under normal conditions the display surface parallel to the display is selected prior to activation. When an object is not translated, rotated, or scaled, it is in a normal state. For this reason, in the case of a cube-shaped object, the first surface of the object may no longer be displayed.

In block 1316, because the escape velocity has not been reached, the device causes the object to return to the initial position of the object when at least partially in block 1302. For example, some of the initial rotation of the object caused by block 2410 may be invalidated. To achieve this, the device animates the rotation of the object in block 1310 in the opposite direction of the initial rotation.

14-23 illustrate exemplary graphical user interfaces showing the selection of the surface of a cube object in response to rotation of the crown. Object 1402 is a cube with six surfaces. In this example, 4 of the 6 surfaces are selectable. These four selectable surfaces include the surface 1404 of the object 1402 facing the observer of the display 106, the top surface of the object 1402, the bottom surface of the object 1402, and the back surface of the object 1402. do. In this example, the left and right sides of the object 1402 are not selectable. However, in other examples, the left and right surfaces of the object 1402 may be selectable. Although the examples are described with respect to an object surface (or planes) parallel to the display 106, the examples may also be modified to be described with respect to an object surface (or planes) that opposes an observer of the display 106 instead. This change can be particularly helpful when the object surface or display 106 is not a planar surface.

Each selectable surface of object 1402 is associated with corresponding data. The data can be, for example, text, images, application icons, commands, quaternary-state settings (eg, Off/Low/Medium/High) and the like. The user selects a surface from among multiple selectable surfaces of the object 1402 by rotating the object 1402 using a physical crown of the wearable electronic device to align the desired select surface, so that the preferred select surface is displayed 106 And to be displayed on the display 106.

Crown 108 of device 100 is a user rotatable user interface input. The crown 108 can return in two distinct directions: clockwise and counterclockwise. 14 to 23 include a rotation direction arrow indicating the direction of crown rotation and, if applicable, a movement direction arrow indicating the rotation direction of the user interface object. Rotation direction arrows and movement direction arrows are not part of the normally displayed user interface, but are provided to aid in the interpretation of the drawing. In this example, the clockwise rotation of crown 108 is illustrated by a rotational direction arrow pointing upwards. Likewise, the counterclockwise rotation of the crown 108 is illustrated by a rotational direction arrow pointing down. The nature of the rotation direction arrow does not indicate the distance, speed, or acceleration at which the crown 108 is rotated by the user. Instead, the direction of rotation arrow indicates the direction of rotation of the crown 108 by the user.

In FIG. 14, the first surface 1404 of the object 1402 is aligned and displayed parallel to the display 106, indicating the selection of the first surface 1404. In FIG. 15, device 100 determines a change in the position of crown 108 in a counterclockwise direction, as indicated by rotation direction arrow 1502. The device 100 determines the rotational speed and direction based on the determined change in the position of the crown 108. In response to determining the change of the position of the crown 108, the device rotates the object 1402, as indicated by the direction of movement arrow 1504 and shown in FIG. The rotation of the object 1402 is based on the determined rotation speed and direction. The rotational speed can be expressed in several ways. For example, rotation speed may be expressed in hertz, rotation per unit time, rotation per frame, revolution per unit time, revolution per frame, and the like. In one example, object 1402 can be associated with a mass or have a calculated rotational inertia.

In FIG. 16, device 100 continues to determine a change in the position of crown 108 counterclockwise, as indicated by rotational arrow 1502. The device 100 determines the rotational speed and direction based on the determined change in the position of the crown 108. In response to determining the change of the position of the crown 108, the device continues to rotate the object 1402, as indicated by the direction of movement arrow 1504 and shown in FIG. The rotation of the object 1402 is based on the determined rotation speed and direction.

In one example, the angle of rotation of the object 1402 is based on the determined speed. As the determined speed increases, the rotation angle of the object 1402 increases. In this example, if the rotation of the crown 108 is maintained at a constant speed, the object 1402 will stay static in the rotated position, where the surface of the object 1402 is not parallel to the display 106. If the rotational speed of crown 108 is increased, the determined speed will increase and object 1402 will rotate by an additional amount.

In some examples, object 1402 is configured to rotate to have a surface parallel to display 106 in response to the determined speed being above a speed threshold. If the determined speed exceeds the speed threshold, the object 1402 exceeds a rotation of 45 degrees, such that the first surface 1404 of the object 1402 rotates away from the display so that it is no longer visible, and instead the object 1404 The second surface 1406 of the display is rotated toward the display. This transition between the indication of the first surface 1404 and the indication of the second surface 1406 is shown as the transition between FIGS. 16 and 17. Thus, as the determined speed exceeds the speed threshold, the object 1402 is flipped from one surface to another.

17 and 18, device 100 determines that there is no change in the position of crown 108. As a result of this determination, object 1402 is rotated so that the display surface of object 1402 is parallel to display 106. This rotation can be animated, as shown in Figures 17 and 18. The device 100 will rotate the object 1402 so that the display surface of the object 1402 having the smallest angle with respect to the display is parallel to the display 106. In other words, the surface of the object that best opposes the display 106 or is parallel to the display 106 is parallel to the display 106. When the surface of the object 1402 is parallel to the display 106 and no change in the position of the crown 108 is detected, the object 1402 is in a normal state. When an object is not translated, rotated, or scaled, it is in a normal state.

In some examples, when the object 1402 is in a steady state, it is determined that the surface of the object 1402 parallel to the display 106 and displayed on the display 106 is selected. For example, the object 1402 can be used as four state selection switches. The first surface 1404 is associated with the LOW setting command, and the second surface 1406 is associated with the MEDIUM command setting. The remaining two selectable surfaces are associated with HIGH and OFF command settings. The user can switch between the four settings by rotating the crown 108 above the speed threshold to cause the object 1402 to turn over and display the desired surface. When the displayed surface is parallel to the display 106, and a change in the position of the crown 108 is not detected, it is determined that the desired surface is selected.

While the surface is being selected, the user can activate the selected surface using one or more of a number of techniques. For example, the user can press the touch-sensitive display 106, press the button 112, or simply allow the surface to remain selected for a predetermined length of time. In another example, when the display surface is parallel to the display 106, the operation can be interpreted as selection of the display surface and activation of data associated with the display surface.

20-23 show a second flip of the object 1402 for selecting the third surface 2002 of the object 1402. 21 and 22, the device 100 determines a change in the position of the crown 108 in a counterclockwise direction, as indicated by the rotational arrow 1502. The device 100 determines the rotational speed and direction based on the determined change in the position of the crown 108. In response to determining the change of the position of the crown 108, the device rotates the object 1402, which is indicated by the direction of movement arrow 1504 and is shown in FIGS. 21 and 22. The rotation of the object 1402 is based on the determined rotation speed and direction.

In response to the rotational speed exceeding the threshold, as shown in FIG. 23, the object 1402 is turned over so that the third surface 2002 is parallel to the display 106 and displayed on the display 106. When an object is not translated, rotated, or scaled, it is in a normal state. When the object 1402 is in a steady state, it is determined that the surface of the object 1402 parallel to the display 106 and displayed on the display 106 is selected. In this example, the third surface 2002 is selected.

24 shows an exemplary process for selecting the surface of a multi-faceted graphical user interface object in response to the rotation of the crown. Process 2400 is performed in a wearable electronic device having a physical crown (eg, device 100 of FIG. 1 ). In some examples, the electronic device also includes a touch-sensitive display. The process provides an effective technique for selecting the surface of a multi-faceted, three-dimensional object.

In block 2402, the device causes the multifaceted object to be displayed on the touch-sensitive display of the wearable electronic device. Each selectable surface of the object is associated with a corresponding data value. The data can be, for example, text, images, application icons, commands, and the like.

At block 2404, the device receives crown location information. Crown position information can be received as a series of pulse signals, real values, integer values, and the like.

At block 2406, the device determines whether a change has occurred to the crown distance value. The crown distance value is based on the angular displacement of the physical crown of the wearable electronic device. A change in crown distance value indicates that the user provides input to the wearable electronic device, for example, by turning a physical crown. If the device determines that no change in crown distance value has occurred, the system returns to block 2404 to continue receiving crown position information. If the device determines that a change in crown distance value has occurred, the system continues to block 2408, but the system can continue to receive crown position information.

At block 2408, the device determines direction and crown speed. Crown speed is based on the rotational speed of the physical crown of the wearable electronic device. For example, the determined crown speed may be expressed in hertz, rotation per unit time, rotation per frame, revolution per unit time, revolution per frame, and the like. The determined direction is based on the rotational direction of the physical crown of the wearable electronic device. For example, the upward direction can be determined based on the clockwise rotation of the physical crown. Likewise, the downward direction can be determined based on the counterclockwise rotation of the physical crown. In other examples, the downward direction may be determined based on the clockwise rotation of the physical crown, and the upward direction may be determined based on the counterclockwise rotation of the physical crown.

In block 2410, in response to determining the change of the crown distance value, the device causes an initial rotation of the faceted object on the display. The amount of rotation is based on the determined crown speed. The direction of rotation is based on the determined direction. Rotation can be animated.

At block 2412, the device determines whether the determined crown speed exceeds the speed threshold. If the device determines that the determined crown speed exceeds the speed threshold, the device continues to block 2414. For example, the speed threshold can be considered as the escape velocity (or escape velocity). The escape velocity is the speed at which the sum of the kinetic energy of the object and the potential energy due to gravity becomes zero. If the device determines that the determined speed does not exceed the speed threshold, the device continues to block 2416.

In some examples, the minimum angular velocity of crown rotation required to reach the escape velocity directly corresponds to the instantaneous angular velocity of crown 108 (FIG. 1), which means that the user interface of device 100 is, essentially, crown 108 This means that it responds when it reaches a sufficient angular velocity. In some embodiments, the minimum angular velocity of crown rotation required to reach the escape velocity is a calculated velocity that is based on the instantaneous (“current”) angular velocity of crown 108, but is not necessarily the same. In these examples, device 100 may maintain the calculated crown (angular) velocity V at each discrete moment of time T according to Equation 1:

[Equation 1]

V _T =V _(T-1) + ΔV _crown -ΔV _drag .

In Equation 1, V _T represents the crown velocity (speed and direction) calculated at time T, V _(T-1) represents the previous velocity (speed and direction) at time T-1, and the ΔV _crown Denotes a change in velocity caused by the force being applied through the rotation of the crown at time T, and ΔV _drag represents a change in velocity due to the drag force. The force exerted is reflected through the ΔV _crown , and may vary depending on the current angular rotational speed of the crown. Thus, the ΔV _crown can also vary depending on the current angular velocity of the crown. In this way, the device 100 not only is based on the instantaneous crown speed, but also provides user interface interaction based on user input in the form of crown movement over multiple time intervals even when the intervals are finely separated. Can. Typically, if there is no user input in the form of a ΔV _crown , V _T will approach (and become 0) based on the ΔV _drag according to Equation 1, but the user input in the form of a crown rotation (ΔV _crown ) will It should be noted that if not present, V _T may not change the signal.

Typically, the greater the speed of each rotation of the crown, the greater the value of the ΔV _crown . However, the actual mapping between the angular rotational speed of the _crown and the ΔV _crown can vary depending on the desired user interface effect. For example, various linear or nonlinear mappings between the angular rotational speed of the _crown and the ΔV _crown can be used.

Also, ΔV _drag can take a variety of values. For example, ΔV _drag can vary depending on the speed of the crown rotation, so that at larger speeds, the opposite change of greater speed (ΔV _drag ) can be created. In another example, ΔV _drag may have a constant value. It will be appreciated that the requirements of the ΔV _crown and ΔV _drag described above can be changed to create desirable user interface effects.

As can be seen in Equation 1, as long as the ΔV _crown is larger than the ΔV _drag , the retained velocity V _T may continue to increase. Additionally, even when ΔV _crown input is not received, V _T can have a non-zero value, which means that user interface objects can still be changed without the user rotating the crown. When this occurs, the objects can stop changing when the user stops rotating the crown and ΔV _drag component based on the speed maintained.

In some examples, if the crown rotates in a direction corresponding to the opposite rotational direction in which the current user interface is changed, the V _(T-1) component is reset to a value of 0, allowing the user sufficient force to offset V _T. You can quickly change the orientation of an object without providing it.

At block 2414, the device causes the object to flip past the transition position between the first and new surfaces that were last selected. For example, if the object is flipped past the transition position, it will not turn so that the first surface is displayed parallel to the display without receiving additional user input.

When the object reaches a steady state, a display surface parallel to the display can be activated through a designated user input. It is determined that under normal conditions the display surface parallel to the display is selected prior to activation. When an object is not translated, rotated, or scaled, it is in a normal state. For this reason, in the case of a cube-shaped object, the first surface of the object may no longer be displayed.

At block 2416, because the escape velocity has not been reached, the device causes the object to return to the initial position of the object when at least partially in block 2408. For example, some of the initial rotation of the object caused by block 2410 may be invalidated. To achieve this, the device animates the rotation of the object in block 2410 in the opposite direction of the initial rotation.

25 shows a graphical user interface 2500 showing the selection of the surface 2506 of a polyhedral object in response to the rotation of the crown. The object 2502 is a 12-sided rotatable face similar to a wheel. The object 2502 is rotatable along a fixed axis. In this example, all 12 surfaces of object 2502 are selectable. These twelve selectable surfaces include surface 2504, surface 2506, surface 2508, surface 2510, and surface 2512. In FIG. 25, surface 2508 is selected because surface 2508 is parallel to display 106 and is displayed on display 106. Selectable surfaces of object 2505 can be selected according to the processes and techniques described in other examples.

In some examples, device 100 may provide haptic feedback based on what is displayed on display 106. When a user interface object is displayed on the display 106, the device may change the appearance of the object based on the change in crown distance value received at the device 100 based on the rotation of the crown 108. When the criteria are met, a tactile output is output from the device 100.

In one example, the object is, for example, the rotatable polyhedral object described above. The criteria are met when the surface of a polyhedral object is selected. In another example, the criterion is met whenever the display surface of a polyhedral object passes through a plane parallel to the display.

One or more of the functions related to the user interface may be performed by a system similar or identical to the system 2600 illustrated in FIG. 26. System 2600 may include instructions stored on a non-transitory computer-readable storage medium, such as memory 2604 or storage device 2602, and executed by processor 2606. Instructions are also used by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, a processor-containing system, or other system capable of fetching and executing instructions from an instruction execution system, apparatus, or device. It may be stored in any non-transitory computer-readable storage medium. In the context of this specification, “non-transitory computer readable storage medium” can be any non-transitory medium that can contain or store a program for use by or connected to an instruction execution system, apparatus, or device. Non-transitory computer readable storage media includes electronic, magnetic, optical, or semiconductor systems, apparatus or devices, portable computer diskettes (magnetic), random access memory (RAM), read only memory (ROM), erasable programming read only memory ( EPROM) (magnetic), portable optical discs such as CD, CD-R, CD-RW, DVD, DVD-R, or DVD-RW, or compact flash cards, secure digital cards, USB memory devices, flash such as memory sticks Memory, and the like, but is not limited thereto.

Instructions are also used by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, a processor-containing system, or other system capable of fetching and executing instructions from an instruction execution system, apparatus, or device. It can be delivered within any transmission medium. In the context of this specification, a “delivery medium” can be any medium that can communicate, deliver, or transmit a program for use by or connected to an instruction execution system, apparatus, or device. Transmission media can include, but are not limited to, electronic, magnetic, optical, electromagnetic or infrared wired or wireless transmission media.

In some examples, system 2600 can be included within device 100. In these examples, the processor 2606 may be the same or different process than the processor 202. Processor 2606 may be configured to receive output from encoder 204, buttons 110, 112, 114, and touch-sensitive display 106. The processor 2606 can process these inputs as described above and processes are described and illustrated. It will be understood that the system is not limited to the components and configurations of FIG. 26 and may include other or additional components in multiple configurations according to various examples.

It should be noted that although the disclosure and examples have been sufficiently described with reference to the accompanying drawings, various changes and modifications will be apparent to those skilled in the art. It should be understood that such changes and modifications are included within the scope of the disclosure and examples as defined by the appended claims.

Claims (1)

The device according to claim 1.

Images