JP2009259163A - User interface device and program - Google Patents

User interface device and program Download PDF

Info

Publication number
JP2009259163A
JP2009259163A JP2008110335A JP2008110335A JP2009259163A JP 2009259163 A JP2009259163 A JP 2009259163A JP 2008110335 A JP2008110335 A JP 2008110335A JP 2008110335 A JP2008110335 A JP 2008110335A JP 2009259163 A JP2009259163 A JP 2009259163A
Authority
JP
Japan
Prior art keywords
list
scroll
display
operation information
hierarchy
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2008110335A
Other languages
Japanese (ja)
Inventor
Hiroyoshi Konaka
Akira Toyooka
裕喜 小中
明 豊岡
Original Assignee
Mitsubishi Electric Corp
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Corp, 三菱電機株式会社 filed Critical Mitsubishi Electric Corp
Priority to JP2008110335A priority Critical patent/JP2009259163A/en
Publication of JP2009259163A publication Critical patent/JP2009259163A/en
Application status is Pending legal-status Critical

Links

Images

Abstract

<P>PROBLEM TO BE SOLVED: To provide a user interface device capable of retrieving quickly a content from a large volume of contents, at a reduced operation frequency. <P>SOLUTION: An operation information generating means 102 generates scroll operation information of a list, and display hierarchy operation information of the list, based on a direction and a speed of a drag operation on a touch panel 101. An automatic scroll control means 103 controls a scroll of the list, based on the scroll operation information. A display hierarchy management means 104 determines a display hierarchy of the list, based on the display hierarchy operation information. A list display means 107 displays a list of the hierarchy determined by the display hierarchy management means 104, on a screen of a display 108, and scrolls the list of the hierarchy displayed based on the control by the automatic scroll control means 103. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a user interface device and a program for content search in electronic devices such as a car navigation system and a portable music player.

As a user interface device in a conventional electronic device, for example, contents such as music files recorded on a built-in recording medium are classified, and further, the classification is hierarchized so that the number of contents included in each classification is electronic There has been one that ensures searchability by limiting the number to a list that can be displayed on the user interface of the device (for example, see Patent Document 1).
Further, as a measure for improving the searchability when a single list is long, there is an automatic scroll method in which the user can specify the scrolling speed (see, for example, Patent Document 2).

US Pat. No. 6,928,433 JP 2002-32170 A

  However, in the conventional user interface for content search, when the number of contents further increases, the number of layers is increased in order to suppress the number of contents per classification. As a result, the number of operations for moving between hierarchies increases, and there is a problem that the searchability of content across categories deteriorates.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to obtain a user interface device and a program capable of quickly retrieving content from a large amount of content with a small number of operations.

  The user interface device according to the present invention is based on the direction and speed of the drag operation to the input device, scroll operation information indicating the scroll direction and scroll speed of the list, and display hierarchy operation indicating which hierarchy of the list is displayed. Operation information generating means for generating information, automatic scroll control means for controlling scrolling of the list based on the scroll operation information, display hierarchy management means for determining the display hierarchy of the list based on the display hierarchy operation information, A list display means for displaying a list of hierarchies determined by the display hierarchy management means on a screen and scrolling the list of hierarchies displayed based on control by the automatic scroll control means.

  According to the user interface device of the present invention, the scroll direction and scroll speed of the list and the display hierarchy of the list are determined based on the direction and speed of the drag operation. Can be searched.

Embodiment 1 FIG.
FIG. 1 is a block diagram showing a user interface apparatus according to Embodiment 1 of the present invention.
In the figure, the user interface device includes a touch panel 101, operation information generation means 102, automatic scroll control means 103, display hierarchy management means 104, recording medium 105, expanded list management means 106, list display means 107, and display 108. . The recording medium 105 stores content data 109 and hierarchy management data 110.

  The touch panel 101 is an input device that is provided on the upper surface of the display 108 and is operated by a user of the apparatus. The touch panel 101 sends a signal indicating a pressed position when the user touches or drags the surface with a finger or a pen. The operation information generation unit 102 receives a signal from the touch panel 101, generates scroll operation information and display hierarchy operation information according to a user operation on the touch panel 101, and outputs the generated scroll operation information. In the case of a drag operation, the speed and direction of automatic scrolling are calculated from the speed component of the drag operation on coordinate axes parallel to the scroll direction of a list displayed on the screen (which will be described later), and the result is used as scroll operation information. Output to the automatic scroll control means 103. Further, the operation information generation unit 102 calculates the moving direction and the number of moving hierarchies of the display hierarchy from the distance and direction of the drag operation on the coordinate axis orthogonal to the scroll direction of the list, and displays the result as display hierarchy operation information. Output to the means 104. When the drag speed is 0, that is, in the case of a simple touch operation, scroll operation information with the automatic scroll speed set to 0 is output to the automatic scroll control means 103 in order to stop the automatic scroll.

The automatic scroll control means 103 sets the automatic scroll direction and speed of the list based on the scroll operation information generated by the operation information generation means 102, and controls to start the automatic scrolling of the list. When the speed setting is 0, the automatic scrolling is stopped. The automatic scroll control means 103 requests the list display means 107 to increase or decrease the in-list screen display position at a cycle according to the speed of automatic scrolling during execution of the automatic scroll.
The display hierarchy management means 104 determines a new display hierarchy from the display hierarchy operation information generated by the operation information generation means 102 and the current display hierarchy, and requests the list display means 107 to move to the new display hierarchy.

The recording medium 105 records content data 109 and hierarchy management data 110.
The expansion list management means 106 acquires all the contents or classification names belonging to the designated display hierarchy from the content data 109 and the hierarchy management data 110 recorded on the recording medium 105, and combines them in the acquired order to obtain a single name. Is generated and provided to the list display means 107. Further, when the display hierarchy is changed, a list item at a higher level including a designated list item or a designated list item in a hierarchy to be newly displayed is added to the currently displayed list item designated by the list display means 107. The list item of the lower hierarchy including is retrieved by retrieving the hierarchy management data 110 recorded in the recording medium 105 and notified to the list display means 107.
The list display means 107 obtains an expanded list of the display hierarchy from the expanded list management means 106, determines list items to be displayed on the screen from the screen display position in the list, and displays the list.
The display 108 physically visualizes the list displayed by the list display means 107 and presents it to the user.

  The content data 109 stored in the recording medium 105 is data such as music, photos, and moving images, and includes content name information. Further, the hierarchy management data 110 is data of content data classification and hierarchy relation between classifications, and includes information on classification names.

FIG. 2A is a flowchart showing the operation of the user interface device according to the first embodiment.
When the user interface device is activated, the process proceeds to a touch panel operation waiting step (ST201). The touch panel operation waiting step (ST201) is a process of waiting until the touch panel is operated. When the touch panel is operated, the process proceeds to the next step (operation determination step (ST202)).
In the operation determination step (ST202), the type of operation of the touch panel is determined. For the drag operation and the touch operation, the process proceeds to the next step. That is, in the case of a drag operation, the process proceeds to a display hierarchy movement process step (ST203), and in the case of a touch operation, the process proceeds to an automatic scroll stop process step (ST206).

  In the display hierarchy movement processing step (ST203), the operation information generation means 102 receives a signal from the touch panel 101, and from the distance and direction of the drag operation on the coordinate axis orthogonal to the scroll direction of the list, the movement direction and movement hierarchy of the display hierarchy. The number is calculated and the result is output as display hierarchy operation information. The display hierarchy management means 104 determines a new display hierarchy from the display hierarchy operation information generated by the operation information generation means 102 and the current display hierarchy, and requests the list display means 107 to move to the new display hierarchy.

  In the automatic scroll speed change processing step (ST204), the operation information generation means 102 receives a signal from the touch panel 101 and calculates the speed and direction of automatic scroll from the speed component of the drag operation on the coordinate axis parallel to the scroll direction of the list. The result is output as scroll operation information. The automatic scroll control means 103 sets the automatic scroll direction and speed of the list based on the scroll operation information generated by the operation information generation means 102, and starts the automatic scroll control of the list. When the automatic scroll control unit 103 starts executing the automatic scroll, the automatic scroll control unit 103 executes the automatic scroll control process shown in FIG. 2B in parallel with the process of this flowchart. The speed of automatic scrolling is adjusted by changing the scroll cycle. The scroll cycle is a time interval when scrolling for one item is performed at a constant cycle. If the scroll period is shortened, the speed of automatic scrolling is increased, and if the scroll period is lengthened, the speed of automatic scrolling is decreased.

  In the list display processing step (ST205), the list display means 107 determines the list items to be displayed on the screen from the list screen display position, and displays the list. When the list display means 107 has received a request to move the display hierarchy, the list display means 107 requests the expansion list management means 106 for an expansion list of the movement destination hierarchy. The expanded list management unit 106 acquires all the contents or classification names belonging to the destination hierarchy from the content data 109 and the hierarchy management data 110 recorded in the recording medium 105, and combines them in the acquired order to form a single list. Is generated and provided to the list display means 107. Further, the list display means 107 designates the list item displayed at the top of the screen, and requests the expanded list management means 106 to search for the list item to be displayed at the top of the screen in the destination hierarchy. The expanded list management means 106 displays the list item of the movement destination hierarchy including the list item when the movement destination hierarchy is higher than the current display hierarchy with respect to the list item specified by the list display means 107, and the movement destination hierarchy is If the list item is lower than the current display layer, the list item at the head of the expanded list among a plurality of list items in the destination layer included in the list item is retrieved by searching the layer management data 110 recorded in the recording medium 105. The list display means 107 is notified. The list display means 107 that has acquired the expanded list and the top list item of the destination hierarchy sets the top list item as the screen display position in the list, determines the list item to be displayed on the screen from the screen display position in the list, and displays the list. It is displayed on the screen of the display 108.

  In the automatic scroll stop processing step (ST206), if the automatic scroll is being executed, the automatic scroll control means 103 makes a transition to stop.

Next, the operation of the automatic scroll control means 103 shown in FIG.
When automatic scrolling is started, the automatic scroll control means 103 proceeds to a scroll cycle waiting step (ST211). In this scroll cycle waiting step (ST211), a timer for measuring the scroll cycle time is started first, and when the timer is activated after the scroll cycle time has elapsed, the timer is stopped and the next step (automatic scroll execution is performed). The process proceeds to the medium determination step (ST212).
In the automatic scroll execution determination step (ST212), the automatic scroll execution state is determined. If it is being executed, the process proceeds to the next display position movement processing step (ST213). If it is stopped, the automatic scrolling process is terminated. In the display position movement processing step (ST213), the automatic scroll control means 103 increases or decreases the list screen display position by one item in accordance with the set automatic scroll direction, and sets it as a new list screen display position. The next list display processing step (ST205) is the same as the list display processing step (ST205) of FIG.

FIG. 3 is a configuration example of a user interface screen according to the first embodiment of the present invention.
The user interface screen 301 is a screen displayed on the display 108. The upper left corner of the screen is the origin (0, 0), the X axis is on the right side of the screen, and the Y axis is on the lower side of the screen. The list scrolls in the vertical direction of the screen (parallel to the Y axis). The first item in the list is arranged in the upper direction of the screen, and the last item in the list is arranged in the lower direction of the screen. At the same time, four list items are displayed on the screen. The list item 303 displayed at the top is an item serving as a reference for hierarchical movement, and is highlighted as a reference list item so that it can be distinguished from other list items (indicated by a thick frame in FIG. 3). Here, although the top list item is the reference list item of the hierarchy transition, the position of another list item may be used. If the total number of list items is greater than 4, not all list items can be displayed on the screen, but by referring to the scroll bar 302, it is possible to grasp which part of the entire list is displayed on the screen.

Next, a calculation example of scroll operation information in the operation information generation unit 102 will be described with reference to FIG.
When the drag operation is performed over t seconds from the coordinates (x1, y1) on the touch panel 101 superimposed on the screen to the coordinates (x2, y2),
The drag operation speed on the Y axis parallel to the scroll direction of the list is assumed to be v = (y2−y1) / t [pixel / second]. Further, when the interval between the list items on the screen is d [pixel], the speed of scrolling the list is obtained as V = −a · v / d [item / second]. Here, a is a coefficient, and when a = 1, since the speed of dragging the screen matches the speed of automatic scrolling of the list, an operational feeling as if the list is scrolled directly by dragging operation can be obtained. .
When V is a positive number, it represents a positive automatic scroll, and scrolls in a direction to display items close to the end of the list. When V is a negative number, it represents a negative automatic scroll, and scrolls in a direction to display an item close to the top of the list. If there is no movement in the Y direction by dragging (only movement in the X direction), the scroll speed is not adjusted.

Next, a calculation example of display hierarchy operation information in the operation information generation unit 102 will be described with reference to FIG.
When the drag operation is performed from the coordinates (x1, y1) on the touch panel superimposed on the screen to the coordinates (x2, y2),
The distance of the drag operation on the X axis orthogonal to the scroll direction of the list is s = x2−x1 [pixel], and the number of moving layers is obtained as level = s / b [pieces]. However, level is an integer, and the decimal part is rounded down. Here, b is a distance that must be dragged to move one layer. As an example of setting the value of b, the initial value may be 100 pixels, and the user may be able to change it. In addition, when level is a positive number, it represents a movement in the direction of descending the hierarchy, and moves to a hierarchy close to the content. When the level is a negative number, it represents a movement in the direction of ascending the hierarchy, and moves to a hierarchy close to the highest level (Root).

Thus, in Embodiment 1, the scroll speed is changed by performing the following operations. On the other hand, the scroll speed until then is maintained except for the following operations.
・ Stop scrolling when the screen is touched.
When the screen is dragged, if the movement distance in the Y-axis direction from the drag start point to the drag end point is other than 0, the scrolling speed is adjusted to the (proportional) speed and direction according to the distance ( (If the movement distance in the Y-axis direction is 0, the scroll speed is not adjusted.)

Next, the display of the expansion list will be described with an example of data.
FIG. 4 is a diagram showing an example of content data and its hierarchical structure.
Layer 0 is the root node in the tree structure and is not displayed on the user interface screen. Hierarchy 1 has nine classifications in this example, and the names are “Cat1” to “Cat9”, respectively. There is also a classification in the hierarchy 2, and the names are “Cat11” to “Cat18”, “Cat21” to “Cat24”, “Cat91” to “Cat98”, and the like. The layer 3 has contents, and the names are “Song 111” to “Song 118”, “Song 121”, “Song 122”, “Song 123”, “Song 181”, “Song 182”, “Song 211” to “Song 217”, and the like.

  FIG. 5 is a screen example of a list displaying four items on one screen. In the screen 501, the display hierarchy is the hierarchy 1 shown in FIG. 4, and four classifications among the nine classifications included in the hierarchy 1 are displayed as list items. A screen 502 is a display example when the display hierarchy is set to level 3 in the same list screen example as the screen 501. Among the contents included in the hierarchy 3, four contents continuing from “Song 117” are displayed as list items.

  FIG. 6 is a diagram illustrating an example of a screen change during execution of automatic scrolling. When dragging on the screen 601 from the upper left to the lower right, lowering of one layer and automatic scrolling in the negative direction are performed. That is, the display hierarchy movement process and the automatic scroll process shown in the flowcharts of FIGS. At this time, the list item serving as a reference for the hierarchy movement is “Cat21”. A screen 602 is a state in which the lowering of one layer is performed. Among the contents included in “Cat21”, the top content is newly displayed at the position of the reference list item. A screen 603 is a state in which automatic scrolling for one item is performed from the screen 602. A screen 604 is in a state where automatic scrolling for one item has been performed from the screen 603. If you drag from right to left here, one level up is performed. At this time, the standard of hierarchy movement is “Song181”. That is, this drag operation is a movement in the direction of moving up the hierarchy because the level is a negative number, and since the movement amount in the Y-axis direction is 0, there is no change in the automatic scrolling speed. Continue scrolling speed.

  A screen 605 is in a state in which one layer has been raised. A classification “Cat18” including “Song181” is newly displayed at the position of the reference list item. A screen 606 is in a state where automatic scrolling for one item has been performed from the screen 605. A screen 607 is a state in which automatic scrolling for one item is performed from the screen 606. If you touch the screen here, automatic scrolling stops. A screen 608 is in a state where automatic scrolling is stopped.

  Further, the operation information generation unit 102 obtains the coordinate value x as level = (W−x) / (W / TS) at the end point (x, y) of the drag operation in the direction parallel to the scroll direction of the list. The hierarchy level may be output as display hierarchy operation information, and the display hierarchy management means 104 may be configured to use this hierarchy level as the display hierarchy. However, level is an integer, and the decimal part is rounded down. Here, W is a constant representing the number of pixels in the horizontal direction of the screen. TS is the number of layers, and in the example of FIG.

  Further, the operation information generating unit 102 may be configured to be able to set the direction of the drag operation to be received independently of the scroll direction of the list. In other words, in the above example, the scroll direction of the list is the same as the drag direction, but these directions may be set independently. For example, as shown in FIG. 7, a configuration in which the axis for changing the display hierarchy is taken in the radial direction of the circle and the axis for changing the scroll speed is taken in the circumferential direction may be adopted.

  As described above, since the display hierarchy can be moved and the automatic scroll can be instructed by one drag, the content can be quickly searched with a small number of operations. In addition, by associating the display hierarchy movement and the automatic scroll instruction operation with the orthogonal axes, the content can be searched only by the drag operation, so that the operability is improved.

  As described above, according to the user interface device of the first embodiment, a user interface device that displays a list of any one of the hierarchies in the list on the screen, to the input device for the displayed list Operation information that generates a scrolling operation information indicating the scroll direction and scrolling speed of the list and a display hierarchy operation information indicating which level of the list is displayed based on the direction and speed of the drag operation in response to the drag operation The generation means, the automatic scroll control means for controlling the scrolling of the list based on the scroll operation information, the display hierarchy management means for determining the display hierarchy of the list based on the display hierarchy operation information, and the display hierarchy management means A list of the selected hierarchy is displayed on the screen and based on the control by the automatic scroll control means. Since it has a list display means for scrolling the list of the displayed hierarchy, it is possible to instruct to move the display hierarchy and auto scroll with a single drag, so that content can be searched quickly from a large amount of content with a small number of operations. Can do. Further, since the content can be searched only by a drag operation, the operability can be improved.

  Further, according to the user interface device of the first embodiment, the operation information generating means obtains the scroll operation information from the drag operation in the direction parallel to the scroll direction of the displayed list, and in the direction orthogonal to the scroll direction. Since the display hierarchy operation information is obtained from the drag operation, the operation feeling as if the list is scrolled directly by the drag operation is obtained, and the display hierarchy can be directly specified. It can be reduced and the operability can be further improved.

  Further, according to the user interface device of the first embodiment, the operation information generating means detects the scroll direction and the scroll speed in the drag operation independently of the scroll direction of the displayed list. Even if there are restrictions such as the screen shape, input device resolution, user interface screen layout, etc., it is possible to freely set the content and quickly search the content with a small number of operations from a large amount of content. Can be improved.

Embodiment 2. FIG.
FIG. 8 is a block diagram showing a user interface device according to Embodiment 2 of the present invention.
In the second embodiment, automatic variable speed scroll control means 801 is used instead of the automatic scroll control means 103 of the first embodiment, and display hierarchy management / change notification means is used instead of the display hierarchy management means 104 of the first embodiment. 802 is provided. In addition to the function of the automatic scroll control means 103, the automatic variable speed scroll control means 801 receives a display hierarchy change notification from the display hierarchy management / change notification means 802 during execution of automatic scrolling. Decrease the speed and increase the scrolling speed when descending the display hierarchy. For example, how much the scrolling speed when changing the display hierarchy is changed is determined as follows.
Scroll speed before display layer change: V 0 [item / second]
Number of list items in the hierarchy before the display hierarchy change: N 0 [item]
Number of list items in the hierarchy after the display hierarchy change: N new [item]
Scroll speed after changing the display hierarchy V new = (N new / N 0 ) * V 0 [item / second]

  In addition to the function of the display hierarchy management unit 104 of the first embodiment, the display hierarchy management / change notification unit 802 notifies the automatic variable speed scroll control unit 801 of the change of the display layer when the display layer is changed. Since other configurations and operations are the same as those in the first embodiment, the corresponding parts are denoted by the same reference numerals and description thereof is omitted.

  In this way, by changing the speed of automatic scrolling when the display hierarchy is moved, the number of contents scrolled per unit time changes gently, so that the user can easily understand the change in the display hierarchy.

  As described above, according to the user interface device of the second embodiment, a user interface device that displays a list of any one of the hierarchies in the list on the screen, to the input device for the displayed list Operation information that generates a scrolling operation information indicating the scroll direction and scrolling speed of the list and a display hierarchy operation information indicating which level of the list is displayed based on the direction and speed of the drag operation in response to the drag operation The display hierarchy of the list is determined based on the generation means, the display hierarchy operation information, the display hierarchy management / change notification means for outputting the determined display hierarchy, and the scroll control of the list is performed based on the scroll operation information. At the same time, based on the display hierarchy notified from the display hierarchy management / change notification means, Based on the control by the automatic variable speed scroll control means and the automatic variable speed scroll control means for controlling the scroll speed according to the descending display and the list of the hierarchy determined by the display hierarchy management / change notification means are displayed on the screen. Since the list display means for scrolling the displayed hierarchy list is provided, the display hierarchy can be changed by changing the number of contents scrolled per unit time step by step when changing the display hierarchy. Can be easily understood, and the operability can be further improved.

Embodiment 3 FIG.
The third embodiment shows a configuration when the user interface device is realized by a computer.
FIG. 9 is a configuration diagram showing a computer system that operates a program for realizing the user interface device according to the third embodiment of the present invention.
The illustrated computer system includes a touch panel 101, a touch panel controller 902, a CPU 903, a flash memory 904, a memory 905, a display controller 906, and a display 108. Here, touch panel 101 and display 108 have the same configuration as touch panel 101 and display 108 in the first and second embodiments.

  An input operation to the touch panel 101 is transmitted to the touch panel controller 902 as an operation signal. The touch panel controller 902 converts an operation signal of the touch panel 101 into data that can be read from the CPU 903. The CPU 903 reads the program from the flash memory 904, arranges it on the memory 905, and executes it. The flash memory 904 records programs, content data, and hierarchy management data. The memory 905 holds programs, data, and screen bitmap data. The display controller 906 outputs the screen bitmap data on the memory 905 to the display 108. The display 108 displays screen bitmap data according to the control of the display controller 906.

  Here, in the operation information generation unit 102 to the list display unit 107 in the first embodiment, programs corresponding to the respective functions are stored in the flash memory 904, and the CPU 903 reads out these programs, expands them on the memory 905, and executes them. It is realized by doing. Further, the content data 109 and the hierarchy management data 110 in the first embodiment are stored in the flash memory 904. Further, the automatic variable speed scroll control means 801 and the display hierarchy management / change notification means 802 in the second embodiment are also realized by storing programs corresponding to these functions in the flash memory 904 and executing them by the CPU 903. Is.

  As described above, according to the program of the user interface device of the third embodiment, it is a program that causes a computer to function as a user interface device that displays a list of any hierarchy in a hierarchical structure list on a screen. In response to a drag operation on the displayed list to the input device, based on the direction and speed of the drag operation, scroll operation information that indicates the scroll direction and scroll speed of the list, and which level of the list is displayed Operation information generating means for generating hierarchy operation information, automatic scroll control means for controlling scrolling of the list based on the scroll operation information, and display hierarchy management means for determining the display hierarchy of the list based on the display hierarchy operation information And a list of hierarchies determined by the display hierarchy management means is displayed on the screen. In addition, since the computer is made to function as a list display means for scrolling the displayed list of hierarchies based on the control by the automatic scroll control means, it is possible to quickly search for contents with a small number of operations from a large amount of contents. A possible user interface device can be realized on a computer.

  In the first to third embodiments, the touch panel 101 provided on the display 108 is used as the input device for the displayed list. However, the present invention is not limited to this and is different from the screen on the display 108. For example, an input device such as a tablet provided at the position can be similarly applied.

  In the third embodiment, each configuration in the first and second embodiments is configured using a program. However, the operation information generating unit 102 to the expansion list managing unit 106 in the first embodiment and the configuration in the second embodiment are also used. The automatic variable speed scroll control means 801 and the display hierarchy management / change notification means 802 may be configured by dedicated hardware.

It is a block diagram which shows the user interface apparatus by Embodiment 1 of this invention. It is a flowchart which shows operation | movement of the user interface apparatus by Embodiment 1 of this invention. It is explanatory drawing which shows the structural example of the user interface equipment screen by Embodiment 1 of this invention. It is explanatory drawing which shows the content data of the user interface apparatus by Embodiment 1 of this invention, and its hierarchical structure. It is explanatory drawing which shows the example of a screen of the list of the user interface apparatus by Embodiment 1 of this invention. It is explanatory drawing which shows the example of the screen change during automatic scroll execution of the user interface device by Embodiment 1 of this invention. It is explanatory drawing which shows the other example in drag operation of the user interface device by Embodiment 1 of this invention. It is a block diagram which shows the user interface apparatus by Embodiment 2 of this invention. It is a block diagram which shows the user interface apparatus by Embodiment 3 of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 101 Touch panel, 102 Operation information generation means, 103 Automatic scroll control means, 104 Display hierarchy management means, 107 List display means, 108 Display, 109 Content data, 110 hierarchy management data, 801 Automatic variable speed scroll control means, 802 Display hierarchy management Change notification means, 902 touch panel controller, 903 CPU, 904 flash memory, 905 memory, 906 display controller.

Claims (5)

  1. A user interface device that displays a list of any hierarchy in a list of hierarchical configurations on a screen,
    Upon receiving a drag operation to the input device for the displayed list, scroll operation information indicating the scroll direction and scroll speed of the list and which level of the list is displayed based on the direction and speed of the drag operation. Operation information generating means for generating display hierarchy operation information representing
    Automatic scroll control means for performing scroll control of the list based on the scroll operation information;
    Display hierarchy management means for determining a display hierarchy of the list based on the display hierarchy operation information;
    A list display means for displaying a list of hierarchies determined by the display hierarchy management means on the screen and scrolling the displayed list of hierarchies based on control by the automatic scroll control means; Interface device.
  2.   The operation information generating means obtains scroll operation information from a drag operation in a direction parallel to the scroll direction of the displayed list, and obtains display hierarchy operation information from the drag operation in a direction orthogonal to the scroll direction. The user interface device according to claim 1.
  3.   2. The user interface device according to claim 1, wherein the operation information generating means detects a scroll direction and a scroll speed in the drag operation independently of a scroll direction of the displayed list.
  4. A user interface device that displays a list of any hierarchy in a list of hierarchical configurations on a screen,
    Upon receiving a drag operation to the input device for the displayed list, scroll operation information indicating the scroll direction and scroll speed of the list and which level of the list is displayed based on the direction and speed of the drag operation. Operation information generating means for generating display hierarchy operation information representing
    A display hierarchy management / change notification means for determining the display hierarchy of the list based on the display hierarchy operation information and outputting the determined display hierarchy;
    An automatic control for scrolling the list based on the scroll operation information and controlling the scrolling speed according to the rise or fall of the display hierarchy based on the display hierarchy notified from the display hierarchy management / change notification means. Variable speed scroll control means;
    List display means for displaying a list of hierarchies determined by the display hierarchy management / change notification means on the screen and scrolling the displayed list of hierarchies based on control by the automatic variable speed scroll control means A user interface device.
  5. A program that causes a computer to function as a user interface device that displays a list of any hierarchy in a hierarchical list on a screen,
    Upon receiving a drag operation to the input device for the displayed list, scroll operation information indicating the scroll direction and scroll speed of the list and which level of the list is displayed based on the direction and speed of the drag operation. Operation information generating means for generating display hierarchy operation information representing
    Automatic scroll control means for performing scroll control of the list based on the scroll operation information;
    Display hierarchy management means for determining a display hierarchy of the list based on the display hierarchy operation information;
    A list of hierarchies determined by the display hierarchy management means is displayed on the screen, and the computer is caused to function as list display means for scrolling the displayed list of hierarchies based on control by the automatic scroll control means. program.
JP2008110335A 2008-04-21 2008-04-21 User interface device and program Pending JP2009259163A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2008110335A JP2009259163A (en) 2008-04-21 2008-04-21 User interface device and program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2008110335A JP2009259163A (en) 2008-04-21 2008-04-21 User interface device and program

Publications (1)

Publication Number Publication Date
JP2009259163A true JP2009259163A (en) 2009-11-05

Family

ID=41386480

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2008110335A Pending JP2009259163A (en) 2008-04-21 2008-04-21 User interface device and program

Country Status (1)

Country Link
JP (1) JP2009259163A (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101138388B1 (en) 2010-04-07 2012-04-26 크루셜텍 (주) Terminal unit with Optical pointing device and screen controlling method thereof
JP2012093844A (en) * 2010-10-25 2012-05-17 Profield Co Ltd Information processing apparatus, information processing method, and program
JP2013003718A (en) * 2011-06-14 2013-01-07 Mitsubishi Electric Information Systems Corp Information processing device, scroll display method of information processing device, and scroll display program
WO2013031135A1 (en) 2011-09-01 2013-03-07 Sony Corporation Information processing apparatus, information processing method, and program
KR101333005B1 (en) 2012-01-03 2013-11-26 주식회사 인프라웨어 Method for controlling speed of scalable scroll, and computer-readable recording medium for the same
CN103428396A (en) * 2012-05-25 2013-12-04 京瓷办公信息系统株式会社 Display input device, display input method, and image forming apparatus
JP2015169944A (en) * 2014-03-04 2015-09-28 株式会社デンソー data retrieval device
JP2015228248A (en) * 2015-08-13 2015-12-17 キヤノン株式会社 Display control device, display control device control method, and program
JP2016127959A (en) * 2016-02-10 2016-07-14 株式会社コナミデジタルエンタテインメント Game device, game system, method for controlling computer and program
JP2016189226A (en) * 2016-08-12 2016-11-04 キヤノン株式会社 Display control device, control method of display control device, and program

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101138388B1 (en) 2010-04-07 2012-04-26 크루셜텍 (주) Terminal unit with Optical pointing device and screen controlling method thereof
JP2012093844A (en) * 2010-10-25 2012-05-17 Profield Co Ltd Information processing apparatus, information processing method, and program
JP2013003718A (en) * 2011-06-14 2013-01-07 Mitsubishi Electric Information Systems Corp Information processing device, scroll display method of information processing device, and scroll display program
WO2013031135A1 (en) 2011-09-01 2013-03-07 Sony Corporation Information processing apparatus, information processing method, and program
US10331326B2 (en) 2011-09-01 2019-06-25 Sony Corporation Apparatus that controls scrolling operation past an edge of an image based on a type of user input
KR101333005B1 (en) 2012-01-03 2013-11-26 주식회사 인프라웨어 Method for controlling speed of scalable scroll, and computer-readable recording medium for the same
JP2013246615A (en) * 2012-05-25 2013-12-09 Kyocera Document Solutions Inc Display input device and image formation device
CN103428396A (en) * 2012-05-25 2013-12-04 京瓷办公信息系统株式会社 Display input device, display input method, and image forming apparatus
JP2015169944A (en) * 2014-03-04 2015-09-28 株式会社デンソー data retrieval device
JP2015228248A (en) * 2015-08-13 2015-12-17 キヤノン株式会社 Display control device, display control device control method, and program
JP2016127959A (en) * 2016-02-10 2016-07-14 株式会社コナミデジタルエンタテインメント Game device, game system, method for controlling computer and program
JP2016189226A (en) * 2016-08-12 2016-11-04 キヤノン株式会社 Display control device, control method of display control device, and program

Similar Documents

Publication Publication Date Title
US9069416B2 (en) Method and system for selecting content using a touchscreen
US9405367B2 (en) Object execution method using an input pressure and apparatus executing the same
JP5714519B2 (en) Device, method and graphical user interface for accessibility using touch sensitive surfaces
KR101548434B1 (en) Device, method, and graphical user interface for user interface screen navigation
AU2010339636B2 (en) Device, method, and graphical user interface for navigating through multiple viewing areas
US9244606B2 (en) Device, method, and graphical user interface for navigation of concurrently open software applications
US8972879B2 (en) Device, method, and graphical user interface for reordering the front-to-back positions of objects
US9569102B2 (en) Device, method, and graphical user interface with interactive popup views
CN104487927B (en) For selecting the equipment, method and graphic user interface of user interface object
TW591398B (en) Method of implementing a plurality of system tray areas
US8539385B2 (en) Device, method, and graphical user interface for precise positioning of objects
AU2011354808B2 (en) Method and apparatus for editing touch display
US8612884B2 (en) Device, method, and graphical user interface for resizing objects
US8291349B1 (en) Gesture-based metadata display
JP5533165B2 (en) Information processing apparatus, information processing method, and program
US10031549B2 (en) Transitioning between modes of input
JP2016532973A (en) User interface for manipulating user interface objects
JP5883128B2 (en) Device, method and graphical user interface for controlling a touch user interface without physical touch functionality
US9098182B2 (en) Device, method, and graphical user interface for copying user interface objects between content regions
KR101541928B1 (en) visual feedback display
US9015639B2 (en) Methods and systems for navigating a list with gestures
KR101570116B1 (en) Methods and apparatus for searching and executing contents using touch screen
CN101866262B (en) Display control apparatus, display control method and computer program
KR20140038568A (en) Multi-touch uses, gestures, and implementation
JP5987054B2 (en) Device, method and graphical user interface for document manipulation