JP2014142677A - Guidance display device, guidance display method and guidance display program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display guidance about an operation method that an operator is not aware of.SOLUTION: A guidance display device 100 includes: an object information table 122 for storing the display regions and hierarchical structures of display components; a screen management part 102 for, on the basis of operation coordinates accepted from an input part and the display regions and hierarchical structures of the display components stored in the object information table 122, determining the operation object display component as information on which display component has been subjected to an input operation accepted by the input part; a component information table 121 for storing the operation frequency of the input operation accepted for the operation object display component determined by the screen management part 102; and a guidance display control part 112 for determining the necessity of guidance display in accordance with whether or not the operation frequency for the display component is equal to or less than a threshold. When it is determined that the guidance is necessary, the guidance display control part 112 allows a display part to display the guidance for the display component.

Description

  The present invention relates to a guidance display device, a guidance display method, and a guidance display program used for an information terminal equipped with a touch panel or the like.

  Conventionally, as this type of guidance display, there is an area display unit that displays an operation area to be operated, and a guidance display unit that displays the operation guidance and measures the number of times the operation input to be guided is received, A guidance display unit configured to be positioned within the area display is known (see, for example, Patent Document 1).

  According to this, the guidance display is displayed in advance before the input of the operation guided by the guidance display is received, and when the input of the operation guided by the guidance display is received, the guidance display is displayed from within the operation area. The guidance display unit can be configured not to display the guidance display when the number of operations guided by the guidance display exceeds a threshold value.

JP 2007-086823 A

  However, in the device described in Patent Document 1, the guidance display is controlled based on the number of operations performed by the operator or the proficiency level of operations input using the keyboard and mouse. If the number of operations is less than the threshold value or the operator is not familiar with the operation, the operation method guidance is displayed. Therefore, in the case of a display screen in which only a small number of operators need guidance because the operation method is clear, guidance is not displayed for the majority of operators because it is cumbersome to display the guidance. I want to In order not to display the operation guidance, it is necessary to repeat the operation until the threshold value is exceeded or to input the proficiency level of the operation with a keyboard and a mouse, which is troublesome.

  Moreover, in the thing described in patent document 1, when the same operation method exists in a different application, the frequency | count of operation cannot be shared between applications.

  In addition, in the case described in Patent Document 1, when a plurality of types of operation objects are displayed in an overlapping manner on the same screen, when the operation guidance is simply displayed, the guidance itself overlaps with each other and the visibility is improved. Even if there are multiple objects of the same type on the same screen, if guidance is given to all, the screen will become complicated and the visibility will deteriorate. It is unclear whether to display the guidance.

  The present invention has been made in view of such a conventional problem, and a guidance display device capable of accurately determining and displaying a guidance for an operation method not noticed by an operator regarding display components constituting a display screen. A guidance display method and a guidance display program are provided. Furthermore, it is preferable that the display component can be shared between applications by using a common display component even if the applications are different.

  The guidance display device of the present invention includes a display unit that displays a display component and guidance related to the display component, an object information table that stores a display area and a hierarchical structure of the display component, an input operation, and an operation coordinate The input operation received by the input unit is based on the input unit that outputs, the operation coordinates received from the input unit, and the display area and hierarchical structure of the display component stored in the object information table. A screen management unit that determines a display component that is an operation target, which is information about which display component is performed, and a number of operations of an input operation that are received for the display component that is the operation target determined by the screen management unit And a guidance table for determining whether or not guidance display is necessary based on whether or not the number of operations on the display component is equal to or less than a threshold value. And a control unit, wherein the guidance display control unit, when it is determined that the guidance is needed, and displays the guidance for the display parts on the display unit.

  A guidance display method of the present invention is a guidance display device comprising: a display unit that displays a display component and guidance related to the display component; and an object information table that stores a display area and a hierarchical structure of the display component. A guidance display method for receiving an input operation and outputting an operation coordinate, an input operation received in the input step, a display area and a hierarchical structure of the display component stored in the object information table And a screen management step for determining a display component as an operation target, which is information on which display component the input operation accepted by the input step is performed, and an operation target determined by the screen management step An operation count storage step for storing the number of input operations received for the display component; A guidance display control step for determining whether or not guidance display is necessary based on whether or not the number of operations on the display component is equal to or less than a threshold, and when the guidance display control step determines that guidance is necessary, Guidance is displayed on the display unit.

  A guidance display program according to the present invention is a guidance display device including a display unit that displays a display component and guidance related to the display component, and an object information table that stores a display area and a hierarchical structure of the display component. An input step of receiving an input operation and outputting operation coordinates to a computer, an input operation received in the input step, and a display area and a hierarchical structure of the display component stored in the object information table A screen management step for determining a display component to be operated, which is information on which display component the input operation accepted by the input step is performed, and a display component for the operation target determined by the screen management step An operation count storage step for storing the number of input operations received for A guidance display control step for determining whether or not guidance display is necessary based on whether or not the number of operations on a component is equal to or less than a threshold value, wherein the guidance display control step determines that guidance is necessary. In such a case, guidance for the display component is displayed on the display unit.

  According to the guidance display device, the guidance display method, and the guidance display program of the present invention, it is possible to display guidance on an operation method not noticed by the operator.

The figure which shows the screen display of the guidance display apparatus in each embodiment of this invention The figure which shows the hierarchical structure of the display components which comprise the screen display of the guidance display apparatus in each embodiment of this invention The block diagram which shows the internal structure of the guidance display apparatus in Embodiment 1 of this invention. The figure which shows the structural example of the components information table in Embodiment 1 of this invention. The figure which shows the structural example of the object information table in Embodiment 1 of this invention. The figure which shows the structural example of the guidance description information table in Embodiment 1 of this invention. The figure which shows the structural example of the application information table in Embodiment 3 of this invention. The flowchart explaining operation | movement when input operation generate | occur | produces in the guidance display apparatus in Embodiment 1 of this invention. The flowchart explaining operation | movement in case the guidance display apparatus in Embodiment 1 of this invention displays guidance. The figure which shows the guidance display of the guidance display apparatus in Embodiment 1 of this invention. The figure which shows the guidance display of the guidance display apparatus in Embodiment 1 of this invention. The block diagram which shows the internal structure of the guidance display apparatus in Embodiment 2 of this invention. The figure which shows the structural example of the components information table in Embodiment 2 of this invention. The flowchart explaining operation | movement in case the guidance display apparatus in Embodiment 2 of this invention displays guidance. The figure which shows the structural example of the components information table in Embodiment 2 of this invention. The flowchart explaining operation | movement in case the guidance display apparatus in Embodiment 2 of this invention displays guidance. The flowchart explaining operation | movement in case the guidance display apparatus in Embodiment 2 of this invention updates accumulated display time. The flowchart explaining operation | movement in case the guidance display apparatus in Embodiment 2 of this invention updates display start time. The block diagram which shows the internal structure of the guidance display apparatus in Embodiment 3 of this invention. The figure which shows the structural example of the components information table in Embodiment 3 of this invention.

  Embodiments of the present invention will be described below with reference to the drawings. The present invention can also be expressed as a “program” for operating a device such as a guidance display device or a computer that is the device, and further includes steps executed by the guidance display device 100. It can also be expressed as a “method”. That is, the present invention can be expressed in any category of the apparatus, method, and program.

  First, terms necessary for describing the embodiment of the present invention are defined.

  (1) Display component: A display component is an element on the display that constitutes a screen. There are several types of display components depending on the application. As an example, the types of display components will be described with reference to FIG. 1, which is a screen of a program for organizing and managing content such as still images, music, and moving images (hereinafter referred to as a content management program).

  1 includes a text input box 11, a button 12, a rectangle 13, icons 14, 15, 16, text labels 17, 18, 19, list items 20, 21, 22, a scrollable list 23, a tab sheet 24, a window. It consists of 31 display parts.

  A unique component ID is assigned to the display component in order to identify the type of the display component. In the embodiment of the present invention, the name of the display component is used as the component ID, but it may be a number that can be uniquely identified instead of the name.

  (2) Object: An object is a display component that is materialized by giving an attribute such as a display area on the screen. The display component is displayed on the screen by being generated as an object. It is possible to generate a plurality of objects for one display component.

  In the screen of FIG. 1, for example, icons 14, 15, and 16 are objects in which icons that are screen components are materialized, and are displayed at different positions because display areas that are attributes of the objects are different.

  Each object is given a unique object ID to identify each object.

  (3) Hierarchical structure: The hierarchical structure is a relationship of arrangement of display components. As shown in the screen example of FIG. 1, other display components can be arranged on the display component. By arranging different types of display components on the display components, the functions of the display components can be combined. For example, the tab sheet 24 can arrange only one display component on the sheet of each tab, but by arranging a scrollable list 23 capable of arranging a plurality of list items on the tab sheet 24, the sheet A plurality of list items can be arranged on the top. The display component can have a hierarchical structure of three or more layers by arranging another display component on the display component.

  FIG. 2 shows a hierarchical structure of display components used to construct the screen example of FIG. The hierarchical structure of display components can be considered as a tree structure in the data structure.

  The window 31 is a display component corresponding to a vertex in the tree structure, and is called a root component.

  With respect to a certain two display components, when the other display component is arranged on one display component, the two display components are in a parent-child relationship. Further, in the parent-child relationship, the lower part is called a parent part, and the upper part is called a child part. An arrow 51 indicates the parent-child relationship of the display components. The start point side of the arrow 51 is a parent part, and the end point side of the arrow 51 is a child part. For example, regarding the list item 21 and the icon 15, since the icon 15 is arranged on the list item 21, the icon 15 is a child part of the list item 21, and the list item 21 is a parent part of the icon 15.

  A plurality of child parts that share the same parent part are said to have a sibling relationship, and display parts that have a sibling relationship are called sibling parts. For example, since the parent part of the text input box 11 and the button 12 is a rectangle 13 and shares the same parent part, the text input box 11 and the button 12 are sibling parts.

  A display component having no child component is called a leaf component. For example, the icons 14, 15, and 16 are leaf parts because they do not have child parts.

  A partial tree structure when an arbitrary display component in the tree structure is regarded as a root component is called a subtree. For example, a set comprising a scrollable list 23, list items 20, 21, 22, icons 14, 15, 16, and text labels 17, 18, 19, is a subtree having the scrollable list 23 as a root part. .

  (4) Gesture operation: In a coordinate input device such as a touch panel or a touch pad, for example, a single tap that is an operation of quickly tapping the input device once with a finger, a double tap that is an operation of quickly tapping the input device with a finger twice, Long tap, which is an operation of releasing a finger after the finger is brought into contact with the input device for a certain period of time or longer, a slide which is an operation of moving the finger from one point to another while keeping the finger in contact with the input device These operations are referred to as gesture operations.

  An operation ID is assigned to the gesture operation in order to identify the operation type. In the case of the guidance display device 100 described later, ST, DT, LT, SLV, and SLH exist as operation IDs. The correspondence between the gesture operation and the operation ID is ST for single tap, DT for double tap, LT for long tap, SLV for up / down slide, and SLH for left / right slide. In the embodiment of the present invention, the character string as described above is used as the operation ID, but it may be a number that can be uniquely identified instead.

  The types of effective gesture operations differ depending on the type of display component. For example, the list items 20, 21, and 22 are gesture operations in which single tap and right / left slide are effective. When a single tap or a left / right slide is performed on the display component, different functions can be executed. For example, when a single tap is performed within the display area of the display component, a function associated with the list item is executed, and when a left / right slide is performed, a list item deletion function is executed.

  When a gesture operation that is invalid for the display component is performed in the display area of the display component, the gesture operation is regarded as a gesture operation for the parent component of the display component. For example, since the list items 20, 21, and 22 are gesture operations in which the up / down slide is invalid, if the up / down slide is performed within the display area of the display component, the list item 20, 21, 22 corresponds to the scrollable list 23 that is the parent component of the display component. It is considered to be a vertical slide operation. The scrollable list 23 is a gesture operation in which vertical slide is effective, and has a function of performing vertical scroll display of the child parts of the display component when the vertical slide is performed within the display component. For this reason, when the up / down slide operation is performed in the display area of the list items 20, 21, and 22, the vertical scroll display of the list items 20, 21, and 22 is executed.

(Embodiment 1)
1. FIG. 3 is a block diagram illustrating an internal configuration of the guidance display device 100 according to Embodiment 1 of the present invention.

  As shown in FIG. 3, a guidance display device 100 according to Embodiment 1 of the present invention includes an input unit 101, a screen management unit 102, an execution unit 103, an output unit 105, a component display control unit 111, a guidance display control unit 112, A display composition unit 113, a component information table 121, an object information table 122, a guidance notation information table 123, and an application information table 124 are provided.

  The input unit 101 serving as an input unit is configured by a coordinate input device such as a touch panel or a touch pad, and receives a gesture operation from an operator. The operation target is, for example, display components such as list items 20, 21, 22 and a scrollable list 23.

  When the input unit 101 receives a gesture operation, the input unit 101 calculates an operation ID corresponding to the type of gesture operation and the coordinates of the operation target, and sends operation information that is a combination of the operation coordinates and the operation ID to the screen management unit 102.

  The screen management unit 102 searches the object information table 122 using the operation coordinates received from the input unit 101, determines the object ID and the component ID of the object ID, and further stores the component ID and the operation in the component information table 121. The number of operations recorded at the position determined by the ID is updated.

  The screen management unit 102 sends the operation target object ID and the operation ID received from the input unit 101 to the execution unit 103.

  Based on the object display instruction received from the execution unit 103, the screen management unit 102 instructs the component display control unit 111 and the guidance display control unit 112 to display the object.

  When the execution unit 103 receives the operation ID and the operation target object ID from the screen management unit 102, the execution unit 103 executes a function associated with the combination of the operation ID and the operation target object ID according to the program included in the application information table 124. As a function execution result, an object is added, deleted, or changed to an object information table 122 described later, and an instruction to display or delete the object is given to the screen management unit 102.

  For example, a case will be described in which the above-described content management program displays the screen of FIG. The execution unit 103 adds an object of a display component constituting the screen of FIG. 1 to an object information table 122 (to be described later) according to a program included in the application information table 124. Further, the execution unit 103 searches the object information table 122 to acquire the object ID of the object that is the root part, and instructs the screen management unit 102 to display the object.

  When the component display control unit 111 receives an object display instruction from the screen management unit 102, the component display control unit 111 generates a display image of the display component for a subtree having the object as a root component. The component display control unit 111 refers to the object information table 122 in order to scan the tree structure of the object. The component display control unit 111 outputs the display image to the display composition unit 113.

  When the guidance display control unit 112 receives an object display instruction from the screen management unit 102, the guidance display control unit 112 generates a guidance display image for a subtree having the object as a root part. The guidance display control unit 112 refers to the object information table 122 to scan the tree structure of the object. The guidance display control unit 112 refers to the component information table 121 to determine an object ID and an operation ID that require guidance display for a tree structure having the object as a root component. The guidance display control unit 112 acquires guidance notation for the operation ID from the guidance notation information table 123, generates a guidance display image, and outputs the display image to the display composition unit 113.

  The display synthesis unit 113 receives the display image of the display component generated by the component display control unit 111 and the display image of the guidance generated by the guidance display control unit 112 as input, and generates a display image obtained by synthesizing the two display images. For example, a display image in which the guidance display image generated by the guidance display control unit 112 is superimposed on the display image of the display component generated by the component display control unit 111 is generated. The display combining unit 113 outputs the combined display image to the output unit 105.

  The output unit 105 includes an organic EL display, a liquid crystal display, and the like, and outputs a screen display according to a display image supplied by the screen management unit 102.

2. Explanation of Stored Information The component information table 121 is a table stored in an existing memory or the like, and stores display components.

  The component information table 121 will be described with reference to FIG. The display component is assigned a component ID for identifying the type of the display component. The display component holds the number of gesture operations performed on the display component for each operation ID. When an invalid gesture operation exists in the display component, a hyphen is entered in this table as the number of times of the gesture operation of the display component.

  The object information table 122 is a table stored in an existing memory or the like, and stores objects.

  The object information table 122 will be described with reference to FIG. Each object has an object ID to uniquely identify it. Each object has a component ID for identifying which display component the object is. Each object has an object ID of a parent part and an object ID of a child part in order to maintain the hierarchical structure of the object. Each object excluding the root part always has one object ID of the parent part. Since the object ID of the parent part does not exist in the root part object, a hyphen is entered as the object ID of the parent part in this table. Each object excluding leaf parts always has at least one child part object ID. Since the object ID of the child part does not exist in the object of the leaf part, a hyphen is entered as the object ID of the child part in this table. Each object has a depth in the tree structure. For the depth, the value of the root part is 0, the value is increased by 1 for a child part, and the value is decreased by 1 for a parent part. Each object has a rectangular area formed by the display position (X, Y), width, and height (W, H) on the display screen of the object as a display area. In this table, the upper left corner of the display screen is the coordinate origin (0, 0), the right direction from the origin is the positive direction of the width, and the downward direction from the origin is the positive direction of the height, but the present invention is concerned with these. It is not a thing.

  The guidance notation information table 123 is a table stored in an existing memory or the like, and stores guidance notation information.

  The guidance notation information will be described with reference to the guidance notation information table 123 of FIG. This table includes a column 191 indicating an operation ID and a column 192 indicating guidance notation corresponding thereto. An operation ID is stored in a column 191 indicating the operation ID. A column 192 indicating guidance notation stores a design for guiding the operation method. In addition, a plurality of operation methods can be combined and described for simultaneous guidance. In line 193, the operation ID SLV + SLH indicates a combination of two gesture operations, that is, an up / down slide operation and a left / right slide operation, and the guidance notation stores a corresponding design. In this table, the design is used as the notation information, but a character string or the like may be used as the notation information.

  The application information table 124 is a table stored in an existing memory or the like, and stores application information.

  The application information will be described with reference to the application information table 124 in FIG. This table includes a column 125 indicating an application ID and a column 126 indicating a program. A column 125 indicating application IDs is an identifier for uniquely identifying each application, and stores IDs that do not overlap among all applications. A column 126 indicating a program stores an execution code executed by the execution unit 103.

3. Description of Operation when Input Operation Occurs Next, an operation when an input operation occurs in the guidance display device 100 according to the first embodiment will be described with reference to the flowchart of FIG. Also, FIG. 5 is used to describe the object information table 122, and FIG. 6 is used to describe the component information table 121.

  In step S <b> 201, when the input unit 101 detects a gesture operation on the touch panel by the operator, the input unit 101 generates operation information including at least the operation coordinates and the operation ID, and sends the operation information to the screen management unit 102. And it changes to step S202.

  In step S202, the screen management unit 102 determines the object ID, the display position (X, Y), the display position (X, Y), the width, and the height (W) of any one of the leaf part objects in the object information table 122. , H). And it changes to step S203.

  In step S203, the screen management unit 102 configures the display coordinates (X, Y), width and height (W, H) read in the previous step as the operation coordinates included in the operation information received from the input unit 101. Calculate whether it is included in the rectangular area. If it is included, it is determined that the object is an object to be operated by the operator, and the process proceeds to step S204. If it is not included, it is determined that the object is not an object to be operated by the operator. The process proceeds to step S207.

  In step S <b> 204, the screen management unit 102 determines a row that matches the object ID from the object ID column 182 in the object information table 122. Further, the value of the column 183 of the component ID in that row is acquired. And it changes to step S205.

  In step S205, the screen management unit 102 determines a row that matches the component ID acquired in step S204 from the component ID column 172 in the component information table 121. Further, a column that matches the operation ID included in the operation information received from the input unit 101 is determined from the operation ID value row 173 in the component information table 121. It is determined whether the grid value determined by the determined row and column in the component information table 121 is a value indicating an effective gesture operation. If the determination result is a valid gesture operation, the process proceeds to step S206. If the determination result is an invalid gesture operation, the process proceeds to step S209.

  In step S <b> 206, the screen management unit 102 increments the value of the row and the column in the part information table 121 by 1 and the operation information received from the input unit 101 and the object of the object last read from the object information table 122. The ID is output to the execution unit 103.

  In step S <b> 211, the execution unit 103 processes the operation information and the object ID acquired from the screen management unit 102 according to the program read from the application information table 124. When it is necessary to update the screen display according to the execution result of the program, the object is added, deleted, or changed in the object information table 122 and the screen management unit 102 is instructed to display or delete the object. Then, the process in the case where an input operation has occurred in the guidance display device 100 according to the first embodiment is terminated.

  In step S <b> 207, the screen management unit 102 confirms whether there is a leaf component that has not yet been read among the leaf component objects in the object information table 122. When there is a leaf component that has not been read, the process proceeds to step S208. When there is no leaf component that has not been read, the processing when an input operation has occurred in the guidance display device 100 according to the first embodiment is terminated.

  In step S208, the screen management unit 102 displays the display position (X, Y), width, and height (W, H) of the display area of any one of the leaf parts that have not yet been read from the object information table 122. Is read. And it changes to step S203.

  In step S209, the screen management unit 102 searches for the parent part ID of the object read last from the object information table 122, and confirms whether the parent part exists in the object. If a parent part exists in the object, the process proceeds to step S210. When the parent part does not exist in the object, the process when the input operation occurs in the guidance display device 100 according to the first embodiment is terminated.

  In step S210, the screen management unit 102 refers to the object information table 122 and reads the object ID of the parent part found in step S209. And it changes to step S204.

  Next, the operation of each step will be described by taking as an example a case where the operator performs a single tap at a point of coordinates = (330, 30). Here, FIG. 4 is used to describe the component information table 121, FIG. 5 is used to describe the object information table 122, and FIG. 6 is used to describe the component information table 121.

  In step S <b> 201, the input unit 101 sends operation coordinates = (330, 30) and operation ID = ST to the screen management unit 102.

  In step S <b> 202, the screen management unit 102 takes out any one of the leaf parts in the object information table 122. In order to simplify the description, it is assumed that the leaf parts are sequentially extracted from the top of the object information table 122. First, the object ID = 1 and the component ID = text input box are selected, and the display position = (10, 10) and the width and height = (300, 60) are read.

  In step S <b> 203, the screen management unit 102 includes the operation coordinates = (330, 30) in the rectangular area configured by the display position = (10, 10) and the width / height = (300, 60). Calculate what. Since it does not include, it progresses to step S207.

  In step S207, the next leaf part is searched. Since there are leaf parts that have not yet been read, the process proceeds to step S208.

  In step S208, the screen management unit 102 selects the object ID = 2 and the component ID = button as the leaf component, reads the display position = (320, 10) and the width and height = (150, 60), and proceeds to step S203. move on.

  In step S <b> 203, the screen management unit 102 includes the operation coordinates = (330, 30) in the rectangular area configured by the display position = (320, 10) and the width and height = (150, 60). Calculate what. Since it contains, it progresses to step S204.

  In step S <b> 204, the screen management unit 102 determines a row that matches object ID = 2 from the object ID column 182 in the object information table 122. Further, the value = button in the part ID column 183 of the row is acquired. And it changes to step S205.

  In step S <b> 205, the screen management unit 102 determines a line that matches the component ID = button from the component ID column 172 in the component information table 121. Further, a column matching operation ID = ST is determined from the operation ID value row 173 in the component information table 121. It is determined whether the cell 174 = 4 determined by the determined row and column in the component information table 121 is a value indicating an effective gesture operation. Since the determination result is a valid gesture operation, the process proceeds to step S206.

  In step S <b> 206, the screen management unit 102 increases the number of operations (the value of the cell 174) in the component information table 121 by 1 to 5. The operation information received from the input unit 101 and the object ID = 2 are output to the execution unit 103.

  In step S211, the execution unit 103 transitions to a screen (hereinafter, referred to as a content detail display screen) in which the function of the program assigned to the combination of operation ID = ST and object ID = 2 displays the details of the content. If so, various objects constituting the content detail display screen are generated and registered in the object information table 122, and among the various objects constituting the content detail display screen, the display of the object ID of the window that is the root part is screen managed. Request to the unit 102.

  Then, the process in the case where an input operation has occurred in the guidance display device 100 according to the first embodiment is terminated.

4). Description of Operation when Displaying Guidance Next, an operation when the guidance display device 100 according to the first embodiment displays guidance will be described with reference to the flowchart of FIG.

  In step S <b> 301, when the screen management unit 102 receives an object display instruction from the execution unit 103, the screen management unit 102 requests the component display control unit 111 and the guidance display control unit 112 for the display instruction. And it changes to step S302.

  In step S302, the guidance display control unit 112 acquires one arbitrary object from the object information table 122 among the objects having the maximum depth in the subtree whose root component is the object that has received the display instruction in step S301. To do. And it changes to step S303.

  In step S <b> 303, the guidance display control unit 112 refers to the object information table 122 to acquire the component ID of the object ID acquired in the immediately previous step, and from the component ID column 172 in the component information table 121, The line that matches the component ID is determined. The guidance display control unit 112 checks whether there is an operation type for which the number of gesture operations is smaller than the threshold value N for the determined row in the component information table 121. If the operation type exists, the guidance display control unit 112 determines that guidance display is necessary for the display component with the component ID, and the process proceeds to step S308. If the operation type does not exist, the guidance display control unit 112 determines that guidance display is not necessary for the display component with the component ID, and the process proceeds to step S304.

  In step S304, the guidance display control unit 112 refers to the object information table 122 and confirms whether there is an unacquired object at the same depth as the last acquired object. When there is an unacquired object, the process proceeds to step S305. If there is no unacquired object, the process proceeds to step S306.

  In step S305, the guidance display control unit 112 refers to the object information table 122 and acquires one arbitrary object from the unacquired objects at the same depth as the object acquired last. And it changes to step S303.

  In step S306, the guidance display control unit 112 refers to the object information table 122 and confirms whether or not the object of the parent part exists in the last acquired object. When the parent part object exists, the process proceeds to step S307. When the object of the parent part does not exist, the process in the case where the guidance display device 100 according to the first embodiment displays the guidance is ended.

  In step S307, the guidance display control unit 112 refers to the object information table 122, and acquires the parent part object of the last acquired object. And it changes to step S303.

  In step S308, the guidance display control unit 112 refers to the row in the component information table 121 determined in step S303, extracts all operation IDs of operation types whose operation count is smaller than the threshold value N, and proceeds to step S309. .

  For example, when the component ID that needs guidance display is a list item and the specified number N = 1, referring to the row 171 of the component information table 121, the operation ID with the gesture operation count smaller than 1 is SLH. Therefore, the operation ID for which guidance display is required for the list item is determined as SLH. Then, the process proceeds to step S309.

  In step S309, the guidance display control unit 112 refers to the part ID column 183 of the object information table 122, and acquires the object IDs of all objects that match the part IDs that require guidance display determined in step S303. And it changes to step S310.

  In step S310, the guidance display control unit 112 refers to the object information table 122 and determines a plurality of subtrees including all the object IDs acquired in step S309. And it changes to step S311.

  In step S311, the guidance display control unit 112 refers to the object information table 122, determines a subtree having the largest depth of the root component of the subtree from the plurality of subtrees determined in step S310, and determines the root of the subtree. Get the object ID of the part. And it changes to step S312.

  In step S312, the guidance display control unit 112 refers to the object ID column 182 of the object information table 122, and displays the width and height (W, H) of the display area of the line that matches the object ID acquired in the immediately preceding step. Is larger than the specified width WC and larger than the specified height HC. If both the width and height of the object are larger than the specified value, the process proceeds to step S314. Otherwise, the process proceeds to step S313.

  In step S313, the guidance display control unit 112 refers to the object information table 122 and acquires the object ID of the parent part of the last acquired object. And it changes to step S312.

  In step S314, the guidance display control unit 112 refers to the column 191 indicating the operation ID column in the guidance notation information table 123, and acquires the notation information of a row that matches the combination of the plurality of operation IDs determined in step S308. Next, in order to determine the display position of the guidance, the guidance display control unit 112 determines the display area of the last acquired object as the guidance display area. The determined notation information and display area are transmitted to the display composition unit 113.

  For example, when the operation ID requiring guidance display is SLH and the last acquired object is object ID = 13, when the row 181 is referred to in the object information table 122, the display area is (20, 160), (440 , 460), guidance notation is displayed around (230, 310) which is the center coordinates of the display area of the object (FIG. 10A). And the process in case the guidance display apparatus 100 in this Embodiment 1 displays guidance is complete | finished.

  In order to make it easier for the operator to understand which display component is the guidance display target, the display image of the object that is the guidance display target may be changed during guidance display.

  For example, when the component ID that requires guidance display is a list item, the border lines of the list items 20, 21, and 22 are highlighted as shown in FIG.

  In the above description, the procedure for displaying guidance for one type of display component at the same time has been described. However, it may be replaced with a procedure for displaying guidance for a plurality of types of display components at the same time.

  Note that the guidance display device 100 may include means for initializing the number of operations that the component information table 121 has.

  As described above, the guidance display device 100 according to the first embodiment detects the operation type input by the operator and the display component to be operated, and counts the number of operations by the combination of the component ID and the operation ID. It is possible to determine the proficiency level of the operation method for the display component of the operator and display the operation method guidance for the operation type of the display component determined to be low in proficiency level. Thus, the operator is not bothered by displaying guidance about the familiar operation method, and can know the guidance about the unfamiliar operation method. In addition, by displaying the guidance with priority over the object of the leaf part, various types of guidance are displayed at the same time, and the display screen is not complicated. Also, by changing the display image of the display component that is the display target of the guidance, it is possible to make it easier for the operator to recognize which display component the guidance is for.

  Another effect obtained by counting the number of operations by the combination of the component ID and the operation ID as described above will be described with reference to FIGS. 11 (a), 11 (b), and 11 (c).

  FIG. 11A shows an example of an application that searches and displays a map. This application includes a map display area 400 in addition to the display parts such as the window 31, the text input box 11, the button 12, and the rectangle 13 described above. The map display area 400 is an area for displaying map data, and at least the vertical slide SLV and the horizontal slide SLH can be accepted as effective gesture operations. The operator can scroll the map display position in the north-south direction or the east-west direction by performing an up / down slide or a left / right slide, respectively.

  FIG. 11B shows an example of an application that searches for restaurants and the like, displays a list of searched stores, and displays a map including the stores. This application also has a map display area 400 as a display component. Description of other parts is omitted. This map display area 400 can also accept vertical and horizontal slides as effective gesture operations. The map display position can be scrolled in the north-south direction or the east-west direction by up-down slide or left-right slide, respectively.

  In the case where the operator has operated only the number of operations for the map display area 400 that has not reached the threshold value N for both the up / down slide and the left / right slide, the up / down slide and the left / right as shown in FIG. A guidance display 401 indicating that sliding is possible is displayed. When the operator performs an operation exceeding the threshold value N for both the up / down slide and the left / right slide in the map display area 400, the guidance as shown in FIG. 11C is not displayed.

  A case will be described in which the application in FIG. 11B is started for the first time after the guidance for the map display area 400 of the application in FIG. Even in this case, since the number of operations of the up / down slide and the left / right slide with respect to the map display area 400 exceeds the threshold value N, the guidance is not displayed. By counting the number of operations using the combination of the component ID and the operation ID in this way, the guidance display can be suppressed in another application for the operation that is determined to be familiar with the operation in one application. Can prevent the screen from becoming complicated.

  The threshold value N of the number of times can be set to N = 10 (times), for example.

(Embodiment 2)
1. Description of Each Block and Relationship Between Blocks The configuration of the guidance display device 200 according to Embodiment 2 will be described with reference to FIG. FIG. 12 is a block diagram illustrating an internal configuration of the guidance display device 200. In FIG. 12, the description of the same parts as those in the first embodiment is omitted, and different parts are mainly described here.

  As compared with the guidance display device 100 according to the first embodiment, the guidance display device 200 includes a screen management unit 102, a guidance display control unit 112, and a component information table 121 that are changed, and a clock unit 2001 is added.

  The screen management unit 102 refers to the object information table 122 when receiving an object display instruction from the execution unit 103 in addition to the operation of the screen management unit 102 in the first embodiment. For all the objects constituting the tree, with reference to the parts information table 121, if there is a display part of each object for the first time, the current time is read from the clock unit 2001, and the parts information table is used as the first display time described later. 121 is written.

  In addition to the operation of the guidance display control unit 112 in the first embodiment, the guidance display control unit 112 refers to the component information table 121 to determine the object ID and operation ID that require guidance display, and the number of gesture operations. In addition, the first display time is also used. The elapsed time from the initial display time of the display component is calculated from the difference between the initial display time and the current time read from the clock unit 2001. When the elapsed time is equal to or greater than the time threshold T, the operation method guidance is displayed.

  The clock unit 2001 measures the current time. The clock unit 2001 outputs time information to the screen management unit 102 and the guidance display control unit 112.

2. Description of Stored Information Here, the component information table 121 will be described with reference to FIG. However, since FIG. 13 is almost the same as FIG. 4 that is the description of the component information table 121 in the first embodiment, the description of the same parts as those in FIG. 4 is omitted. FIG. 13 is different from FIG. 4 in that a column 2002 for recording the first display time is added. The first display time is the time when each display component is first displayed on the guidance display device 200. In the case where the display component has not been displayed on the guidance display device 200 yet, a hyphen is entered at the first display time of the display component in FIG.

3. Description of Operation when Input Operation Occurs Since the operation when an input operation occurs in guidance display device 200 is the same as the operation when an input operation occurs in guidance display device 100 in the first embodiment, description will be given. Is omitted.

4). Description of Operation when Displaying Guidance Next, an operation when the guidance display device 200 displays guidance will be described with reference to the flowchart of FIG. In FIG. 14, portions that are different from FIG. 9, which is a flowchart when displaying the guidance in the first embodiment, are extracted. Compared to FIG. 9, in FIG. 14, steps S3001, S3002, S3003, S3004, and S3005 are added, and the operations of steps S301 and S303 are changed. Description of steps that are not different between FIG. 9 and FIG. 14 is omitted.

  In step S <b> 301, when the screen management unit 102 receives an object display instruction from the execution unit 103, the screen management unit 102 requests the component display control unit 111 and the guidance display control unit 112 for the display instruction. And it changes to step S3001.

  In step S3001, the screen management unit 102 sets the part ID of an arbitrary object from among the objects constituting the subtree for the subtree whose root part is the object that has received the display instruction in step S301. Get one from And it changes to step S3002.

  In step S <b> 3002, the screen management unit 102 determines a row that matches the component ID acquired in the immediately preceding step from the component ID column 172 in the component information table 121. The screen management unit 102 checks whether time information is present in the initial display time column 2002 for the determined row in the component information table 121. When the time information does not exist, the screen management unit 102 determines that the display component with the component ID is the first display, and proceeds to step S3003. If the time information exists, the screen management unit 102 determines that the display component with the component ID is not the first display, and the process proceeds to step S3004.

  In step S3003, the screen management unit 102 acquires the current time from the clock unit 2001, and writes the current time in the first display time column 2002 of the row in the component information table 121 determined in the immediately preceding step. And it changes to step S3004.

  In step S3004, the screen management unit 102 determines whether there is an object for which a part ID has not been acquired in each object constituting the subtree of the subtree whose root part is the object that has received the display instruction in step S301. Check if. If there is an unacquired object, the process proceeds to step S3001. If there is no unacquired object, the process proceeds to step S302.

  In step S <b> 303, the guidance display control unit 112 refers to the object information table 122 to acquire the component ID of the object ID acquired in the immediately previous step, and from the component ID column 172 in the component information table 121, The line that matches the component ID is determined. The guidance display control unit 112 acquires the current time from the clock unit 2001, and from the difference between the initial display time and the current time in the determined row in the component information table 121, the initial display of the display component of the component ID from the initial display. Calculate elapsed time. If the elapsed time is less than the time threshold T, the guidance display control unit 112 determines that guidance display is unnecessary for the object, and the process proceeds to step S304. If the elapsed time is equal to or greater than the time threshold T, the guidance display control unit 112 determines whether there is an operation type for which the number of gesture operations is smaller than the threshold N for the determined row in the component information table 121. Check out. If the operation type exists, the guidance display control unit 112 determines that guidance display is necessary for the display component with the component ID, and the process proceeds to step S308. If the operation type does not exist, the guidance display control unit 112 determines that guidance display is not necessary for the display component with the component ID, and the process proceeds to step S304.

5. Explanation when using cumulative display time It is also possible to use the cumulative display time of the display component instead of the initial display time of the display component. In the following description, a method using the accumulated display time of the display component will be described.

  In the method using the accumulated display time of the display component, the component information table 121 is replaced with the component information table 121 shown in FIG. The component information table 121 in FIG. 15 will be described. Compared to FIG. 13, the component information table 121 in FIG. 15 includes a column 2003 for recording the accumulated display time instead of the initial display time. A column 2004 is added to record the display start time. The cumulative display time refers to the cumulative value of the time that the display component is displayed on the screen. The display start time indicates the time when a display instruction is received from the execution unit 103 for each display component.

  Next, the operation when the guidance display device 200 displays guidance in the method using the cumulative display time of display components will be described with reference to the flowchart of FIG. In FIG. 16, portions that are different from FIG. 14 are extracted. Compared to FIG. 14, in FIG. 16, steps S3005 and S3006 are added, and the operations of steps S301 and S303 are changed. Description of steps that are not different between FIG. 14 and FIG. 16 is omitted.

  In step S <b> 301, when the screen management unit 102 receives an object display instruction from the execution unit 103, the screen management unit 102 requests the component display control unit 111 and the guidance display control unit 112 for the display instruction. And it changes to step S3005.

  In step S3005, in order to update the accumulated display time in the component information table 121, an accumulated display time update subroutine described later is executed. And it changes to step S3006.

  In step S3006, in order to update the initial display time in the component information table 121, a display start time update subroutine described later is executed. And it changes to step S302.

  In step S <b> 303, the guidance display control unit 112 refers to the object information table 122 to acquire the component ID of the object ID acquired in the immediately previous step, and from the component ID column 172 in the component information table 121, The line that matches the component ID is determined. If the accumulated display time in the determined row in the component information table 121 is less than the time threshold TA, the guidance display control unit 112 determines that guidance display is unnecessary for the object, and the process proceeds to step S304. If the accumulated display time is equal to or greater than the time threshold TA, the guidance display control unit 112 determines whether there is an operation type for which the number of gesture operations is smaller than the threshold N for the determined row in the component information table 121. Find out. If the operation type exists, the guidance display control unit 112 determines that guidance display is necessary for the display component with the component ID, and the process proceeds to step S308. If the operation type does not exist, the guidance display control unit 112 determines that guidance display is not necessary for the display component with the component ID, and the process proceeds to step S304.

6). Explanation of Operation of Cumulative Display Time Update Subroutine Next, the cumulative display time update subroutine will be described with reference to the flowchart of FIG.

  In step S <b> 321, the screen management unit 102 acquires one arbitrary display component from the component information table 121. Then, the process proceeds to step S322.

  In step S322, the screen management unit 102 checks whether the display component acquired in step S321 is being displayed on the screen. When the time information exists in the display start time column 2004 of the display component acquired in step S321, the screen management unit 102 determines that the display component is being displayed on the screen, and proceeds to step S323. If the time information does not exist, the screen management unit 102 determines that the display component is not displayed on the screen, and the process proceeds to step S325.

  In step S323, the screen management unit 102 acquires the current time from the clock unit 2001. In addition, the display start time of the display component column 2004 acquired in step S321 is acquired. The display elapsed time of the display component is calculated by subtracting the display disclosure time from the current time, and the display elapsed time is added to the accumulated display time value in the column 2003. And it changes to step S324.

  In step S324, the screen management unit 102 changes the display start time of the display component column 2004 acquired in step S321 to a hyphen. And it changes to step S325.

  In step S <b> 325, the screen management unit 102 confirms whether there is an unacquired display component in the component information table 121. If there is an unacquired display component, the process proceeds to step S321. If there are no unacquired display parts, the subroutine is terminated.

7). Description of Operation of Display Start Time Update Subroutine Next, the display start time update subroutine will be described with reference to the flowchart of FIG.

  In step S <b> 331, the screen management unit 102 acquires the root part object from the object information table 122. And it changes to step S332.

  In step S332, the screen management unit 102 reads the component ID of the object acquired in the previous step. Then, a cell having the same value as the component ID is searched from the column 172 of the component information table 121. For the found cell row, the current time is read from the clock unit 2001, and the current time is written in the display start time of the column 2004. And it changes to step S333.

  In step S <b> 333, the screen management unit 102 reads the object ID of the child part included in the object for the object last acquired from the object information table 122. It is confirmed whether or not there is an object ID that matches the object ID of an object that has not been acquired from the object information table 122. If there is an object that matches the object ID, the process proceeds to step S334. If there is no object that matches the object ID, the process proceeds to step S335.

  In step S <b> 334, the screen management unit 102 selects one arbitrary object ID from the object IDs confirmed to exist in step S <b> 333, and acquires an object related to the object ID from the object information table 122. And it changes to step S332.

  In step S <b> 335, the screen management unit 102 confirms whether the object acquired last from the object information table 122 is a root part. If it is a root part, the subroutine is terminated. If it is not a root part, the process proceeds to step S336.

  In step S 336, the screen management unit 102 reads the object ID of the parent part that the object last acquired from the object information table 122 and acquires the object related to the object ID from the object information table 122. And it changes to step S333.

  In addition, when the application that has been executed is terminated, the screen that has been displayed so far, such as when the power supply to the device constituting the output unit 105 is stopped for the purpose of reducing the power consumption of the device, etc. is deleted. In some cases, the increase in the accumulated display time of the display parts must be stopped. In such a case, the screen management unit 102 operates an accumulated display time update subroutine. By operating the cumulative display time update subroutine, the cumulative display time of each display component in the component information table 121 is updated to the value at the time of screen erasure, and a hyphen is entered at the display start time. As a result, since the accumulated display time does not increase when the screen is erased, it is possible to more accurately determine the proficiency level regarding the display component.

  The time threshold T or TA can be set to T = 2000 (minutes) and TA = 1000 (minutes), for example.

  The guidance display device 200 may include means for initializing the number of operations, the initial display time, the accumulated display time, and the previous display start time that the component information table 121 has.

  As described above, the guidance display device 200 according to the second embodiment detects the operation type input by the operator and the display component to be operated, and counts the number of operations in units of display components constituting the display screen. Thus, it is possible to determine the proficiency level of the operation method for the display component of the operator and display the operation method guidance for the operation type of the display component determined to be low in proficiency level. Furthermore, by using the elapsed time from the first display time of the display component or the cumulative display time of the display component, it is determined whether the operator is aware of the operation method of the display component, and is determined not to be noticed by the operator. The operation method guidance can be displayed for the operation type of the displayed component.

  In the first embodiment, the number N of threshold values has been described as a constant value regardless of the display component. However, a different number of threshold values for each display component, for each operation type, or for each combination of display component and operation type. You may decide.

  For example, an operation that is easy to notice intuitively such as single-tapping a button and an operation that is difficult to notice such as long-tapping a button will be described as examples. The threshold value of the number of times when the button is single-tapped is 1 (times), and the threshold value of the number of times when the button is long-tapped is 5 (times). As a result, a single tap that is easy to notice intuitively will not display guidance if it is operated even once, and a long tap that is difficult to notice intuitively will not be displayed five times after a certain elapsed time from the initial display time unless it is operated five times. Guidance can be displayed.

  Similarly, in the second embodiment, the time threshold T or TA has been described as a constant value regardless of the display component, but for each display component, for each operation type, or for each combination of display component and operation type. Different time thresholds may be determined.

  Thus, the operator is not bothered by displaying guidance about the familiar operation method, and can know the guidance about the unfamiliar operation method. Further, by displaying the guidance with priority over the display component of the leaf component object, various types of guidance are displayed at the same time, and the display screen is not complicated.

(Embodiment 3)
In the third embodiment, when a plurality of different types of applications use a display component to display a screen, an operation method proficiency determination method that reflects the frequency of use for each application will be described.

1. Description of Blocks and Relationship Between Blocks The configuration of the guidance display device 300 according to Embodiment 3 will be described with reference to FIG. FIG. 19 is a block diagram showing an internal configuration of the guidance display device 300. In FIG. 19, the description of the same parts as those of the first embodiment is omitted, and different parts are mainly described here.

  As compared with the guidance display device 100 according to the first embodiment, the guidance display device 300 includes a screen management unit 102 and a guidance display control unit 112 that are changed, and an individual component information table 130 is added.

  When the screen management unit 102 receives operation information from the input unit 101 in addition to the operation of the screen management unit 102 in the first embodiment, the screen management unit 102 displays the current screen from a plurality of sub-tables included in the individual component information table 130 described later. The number of operations recorded at the position determined by the component ID and the operation ID in the sub table is updated by referring to the sub table assigned to the displayed application.

  When the guidance display control unit 112 receives an object display instruction from the screen management unit 102 in addition to the operation of the guidance display control unit 112 in the first embodiment, the guidance display control unit 112 determines an object ID and an operation ID that require guidance display. The sub-table assigned to the application currently displaying the screen is referred to from among a plurality of sub-tables included in the individual component information table 130 described later, and is recorded at a position determined by the component ID and operation ID. Use the number of operations.

2. Description of Stored Information Here, the component information table 121 will be described with reference to FIG. However, since FIG. 20 is substantially the same as FIG. 4 which is the description of the component information table 121 in the first embodiment, the description of the same part as FIG. 4 is omitted. FIG. 20 differs from FIG. 4 in that a plurality of tables exist and a cell 3001 indicating an application ID is added. In the component information table 121, there are as many sub tables as the types of application IDs included in the application information table 124. The value of the cell 3001 in each sub table is equal to any one of the application IDs included in the application information table 124. Each sub-table has a one-to-one correspondence with each application ID included in the application information table 124.

3. Description of Operation when Input Operation Occurs Next, an operation when an input operation occurs in the guidance display device 300 will be described. The operation when an input operation occurs in the guidance display device 300 is substantially the same as the flowchart of FIG. 8, which is an operation when an input operation occurs in the guidance display device 300 of the first embodiment. For this reason, the difference between the flowchart of FIG. 8 will be described. In the third embodiment, the operations of S201 and S206 are changed among the steps included in the flowchart of FIG.

  In step S201, in addition to the operation of step S201 of the first embodiment, when the process proceeds to step S202, the screen management unit 102 displays the screen from among the plurality of sub-tables included in the individual component information table 130. A sub-table in which the application ID of the existing application matches the value of the cell 3001 is selected.

  In step S206, in addition to the operation of step S206 of the first embodiment, the screen management unit 102 increases the value of the grid determined by the row and column determined in step S205 in the component information table 121 by 1, and the individual component. Also for the selected sub-table in the information table 130, the value of the cell at the same location is increased by 1.

4). Description of Operation when Displaying Guidance Next, an operation when the guidance display device 300 displays guidance will be described. The operation when the guidance display device 300 displays guidance is almost the same as the flowchart of FIG. 9 which is the operation when the guidance display device 100 of the first embodiment displays guidance. For this reason, the difference between the flowchart of FIG. 9 will be described. In the third embodiment, the operations of S301 and S303 are changed among the steps of the flowchart of FIG.

  In step S301, in addition to the operation of step S301 in the first embodiment, when the process proceeds to step S302, the screen management unit 102 displays the screen from among the plurality of sub tables included in the individual component information table 130. A sub-table in which the application ID of the existing application matches the value of the cell 3001 is selected.

  In step S <b> 303, the guidance display control unit 112 determines a row that matches the component ID acquired in the immediately preceding step from the component ID column 172 of the component information table 121.

  The guidance display control unit 112 checks the component information table 121 whether or not there is an operation type in which the number of gesture operations in the determined row is smaller than the number of times threshold N1. If the operation type does not exist, the guidance display control unit 112 determines that guidance display is not necessary for the display component with the component ID, and the process proceeds to step S304.

  When the operation type is present, the guidance display control unit 112 performs an operation in which the number of gesture operations is smaller than the number of times threshold N2 for the determined row in the selected sub-table in the individual component information table 130. Check if the type exists. If the operation type exists, the guidance display control unit 112 determines that guidance display is necessary for the display component with the component ID, and the process proceeds to step S308. If the operation type does not exist, the guidance display control unit 112 determines that guidance display is not necessary for the display component with the component ID, and the process proceeds to step S304.

  The threshold value N1 for the number of times and the threshold value N2 for the number of times can be, for example, N1 = 20 (times) and N2 = 10 (times).

  The guidance display device 300 may include means for initializing the number of operations that the component information table 121 and the individual component information table 130 have.

  As described above, the guidance display device 300 according to the third embodiment detects the operation type input by the operator and the display component to be operated, and counts the number of operations in units of display components constituting the display screen. Thus, it is possible to determine the proficiency level of the operation method for the display component of the operator and display the operation method guidance for the operation type of the display component determined to be low in proficiency level. Furthermore, by changing the guidance display conditions according to the nature of each application, the number of operations for each application ID can be reduced for display components that are commonly used by multiple applications, such as display components for displaying a map. By recording, even if the operator is proficient in the operation method in the application A, if the operation method is not proficient in the application B, the guidance is not displayed in the application A and the guidance is displayed in the application B. Thus, the guidance display device 300 can operate.

  Thus, the operator is not bothered by displaying guidance about the familiar operation method, and can know the guidance about the unfamiliar operation method. Further, by displaying the guidance with priority over the display component of the leaf component object, various types of guidance are displayed at the same time, and the display screen is not complicated.

  The present invention is useful as a guidance display device, a guidance display method, and a guidance display program because it can display guidance on an operation method not noticed by the operator.

11 Text input box 12 Button 13 Rectangle 14, 15, 16 Icon 17, 18, 19 Text label 20, 21, 22 List item 23 Scrollable list 24 Tab sheet 31 Window 100, 200, 300 Guidance display device 101 Input section 102 Screen Management unit 103 Execution unit 105 Output unit 111 Component display control unit 112 Guidance display control unit 113 Display composition unit 121 Component information table 122 Object information table 123 Guidance notation information table 124 Application information table 130 Individual component information table 171, 173, 181, 193 rows 125, 126, 172, 182, 183, 191, 192, 2002, 2003, 2004 columns 174, 3001 square 400 map display area 401 Guidance display 2001 Clock part ST Single tap DT Double tap LT Long tap SL slide SLV Up / down slide SLH Left / right slide

Claims (11)

A display unit for displaying a display component and guidance regarding the display component;
An object information table for storing a display area and a hierarchical structure of the display component;
An input unit that accepts input operations and outputs operation coordinates;
Based on the operation coordinates received from the input unit and the display area and hierarchical structure of the display component stored in the object information table, for which display component the input operation received by the input unit is performed. A screen management unit that determines the display component to be operated as information on the game,
A component information table for storing the number of input operations accepted for the display component to be operated determined by the screen management unit;
A guidance display control unit that determines whether or not guidance display is necessary based on whether or not the number of operations on the display component is equal to or less than a threshold value,
When the guidance display control unit determines that guidance is required, the guidance display control unit displays guidance for the display component on the display unit. The input unit accepts an input operation, outputs an operation coordinate and an operation ID,
When the screen management unit receives the operation coordinates and the operation ID from the input unit, the object in which the operation coordinates are located inside the display area of the object among the plurality of objects stored in the object information table The operation target object is determined by using the depth in the hierarchical structure and information on whether the operation ID is valid or invalid, and the operation target display component is determined from the operation target object. Guidance display device. The input unit accepts an input operation, outputs an operation coordinate and an operation ID,
When the screen management unit receives the operation ID from the input unit, the operation ID of the display component that matches the component ID of the display component to be operated among the plurality of display components stored in the component information table. The guidance display device according to claim 1, wherein the number of operations related to the operation is increased. When a plurality of display components are displayed on the display unit, the guidance display control unit selects a display component having the deepest hierarchy among display components that require guidance display among the plurality of display components. The guidance display device according to any one of claims 1 to 3, wherein the guidance is preferentially displayed on the output unit. The guidance display control unit displays guidance on the display unit when a certain time has elapsed from the initial display time of the display component, and when the certain time has not elapsed from the initial display time of the display component. The guidance display device according to claim 1, wherein the guidance is not displayed on the display unit. The guidance display control unit displays guidance on the display unit when the accumulated display time of the display component exceeds a certain value, and displays guidance when the accumulated display time of the display component does not exceed the certain value. The guidance display device according to claim 1, wherein the guidance display device is not displayed on the display unit. The guidance display device according to claim 1, further comprising an individual component information table that records, for each application, the number of operations for each operation type of the display component. When the display component is used in a plurality of applications, the guidance display control unit uses the display component by comparing the number of operations recorded in the individual component information table with a threshold of the number of times. The guidance display device according to claim 7, wherein the necessity of displaying the guidance is determined for each application. When the display component is used in a plurality of applications, the guidance display control unit calculates the number of operations recorded in the component information table and the number of operations recorded in the individual component information table for each number of times. The guidance display apparatus according to claim 7, wherein the guidance display necessity is determined for each application using the display component by comparing with a threshold value. A guidance display method in a guidance display device comprising: a display unit that displays a display component and guidance related to the display component; and an object information table that stores a display area and a hierarchical structure of the display component,
An input step for accepting an input operation and outputting operation coordinates;
Based on the input operation received in the input step and the display area and hierarchical structure of the display component stored in the object information table, for which display component the input operation received in the input step is performed. Screen management step for determining the display component to be operated, which is information about
An operation count storage step for storing the operation count of the input operation received for the operation target display component determined by the screen management step;
A guidance display control step of determining whether or not guidance display is necessary based on whether or not the number of operations on the display component is equal to or less than a threshold value,
A guidance display method in which the guidance display control step displays guidance for the display component on the display unit when it is determined that guidance is necessary. In a computer that is a guidance display device comprising a display unit that displays a display component and guidance related to the display component, and an object information table that stores a display area and a hierarchical structure of the display component,
An input step for accepting an input operation and outputting operation coordinates;
Based on the input operation received in the input step and the display area and hierarchical structure of the display component stored in the object information table, for which display component the input operation received in the input step is performed. Screen management step for determining the display component to be operated, which is information about
An operation count storage step for storing the operation count of the input operation received for the operation target display component determined by the screen management step;
A guidance display control step for determining whether or not guidance display is necessary depending on whether or not the number of operations on the display component is equal to or less than a threshold;
A guidance display program for executing
A guidance display program for causing the display unit to display guidance for the display component when the guidance display control step determines that guidance is necessary.

Images