WO2023248912A1 - Electronic device and control method - Google Patents

Electronic device and control method Download PDF

Info

Publication number
WO2023248912A1
WO2023248912A1 PCT/JP2023/022180 JP2023022180W WO2023248912A1 WO 2023248912 A1 WO2023248912 A1 WO 2023248912A1 JP 2023022180 W JP2023022180 W JP 2023022180W WO 2023248912 A1 WO2023248912 A1 WO 2023248912A1
Authority
WO
WIPO (PCT)
Prior art keywords
displayed
screen
pointing object
pointing
layer screen
Prior art date
Application number
PCT/JP2023/022180
Other languages
French (fr)
Japanese (ja)
Inventor
美和子 神田
Original Assignee
京セラドキュメントソリューションズ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京セラドキュメントソリューションズ株式会社 filed Critical 京セラドキュメントソリューションズ株式会社
Publication of WO2023248912A1 publication Critical patent/WO2023248912A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the present invention relates to an electronic device having a touch panel and a method of controlling the electronic device.
  • Patent Document 1 is very similar in that it includes a virtual stylus that assists operations other than direct operations with a finger or a stylus pen, and that the virtual stylus is accompanied and placed over the operation object. However, it is necessary to move the virtual stylus so that it overlaps the operation object, and then perform item operations such as tapping on the virtual stylus, and it is also necessary to determine whether to continue the drag operation or detect another tap operation. .
  • the purpose of this virtual stylus is to assist in cases where direct operation with a finger or stylus pen is not easy due to the display screen, and operation errors are likely to occur. It can only be operated, and there are no unique operation functions that can only be achieved with a virtual stylus.
  • Patent Document 2 is mainly aimed at software keyboards, and has a function of holding a predetermined operation key by placing a pointer on the predetermined operation key. A holding process (time elapse, etc.) is required. Also, the function will not be activated just by holding a predetermined key; if you hold multiple keys and move the pointer over another predetermined operation key and overlap them, This includes an execution step in which the functions of a predetermined operation key and all of the held state keys are simultaneously executed by releasing the holding of the keys at the same time.
  • Patent Document 3 additional screens and information such as a help screen and a setting item screen corresponding to the operation object are displayed by a "tracing" operation, which is different from tapping, on the operation object, but the tap operation with a finger is the main method.
  • a "tracing" operation which is different from tapping, on the operation object, but the tap operation with a finger is the main method.
  • the existence of the finger tracing operation itself may be overlooked, and if awareness of the "tracing operation" on the touch panel is low, it is necessary to make the existence known, but in the end, the tracing operation itself may be overlooked.
  • help is displayed using a ⁇ trace operation'' that allows a quick transition from the main operation of tapping. Users who operate it for the first time are likely to miss the existence of the ⁇ tracing operation'' itself, and because the tap operation and tracing operation are similar, the user may misunderstand the operation and cause confusion.
  • An electronic device includes: touch panel and A first layer screen including one or more first operation objects each representing one or more first items is displayed on the touch panel in full screen, and the pointing object is positioned at a position that does not overlap the one or more first operation objects. display at a certain initial position, When the pointing object is dragged by an input means, the pointing object is moved and displayed in accordance with the movement of the input means, While the pointing object is being dragged and displayed over one of the first operation objects, a lower level hierarchy of the first item indicated by the one first operation object is displayed.
  • the control circuit includes a control circuit that pops up and displays a second layer screen showing additional information over at least a portion of the one or more first operation objects on the first layer screen.
  • FIG. 1 shows an image forming apparatus according to an embodiment of the present invention.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • An example of touch panel display is shown.
  • an image forming apparatus 10 such as an MFP (Multifunction Peripheral) installed in a convenience store or the like will be described as an example of an electronic device.
  • MFP Multifunction Peripheral
  • FIG. 1 shows an image forming apparatus according to an embodiment of the present invention.
  • the image forming apparatus 10 includes a control circuit 100.
  • the control circuit 100 is composed of a CPU 11a (Central Processing Unit) that is a processor, a RAM 11b (Random Access Memory), a ROM 11c (Read Only Memory) that is a memory, a dedicated hardware circuit, etc., and controls the entire image forming apparatus 10. Controls movement control.
  • the CPU 11a loads the information processing program stored in the ROM 11c into the RAM 11b and executes it, thereby executing the operations described in the operation flow below and controlling the display and operation input of the touch panel 17.
  • the ROM 11c permanently stores programs and data executed by the CPU 11a.
  • the ROM 11c is an example of a non-transitory computer-readable recording medium.
  • the control circuit 100 is an operation unit that includes an image reading unit 12 (image scanner), an image processing unit 14 (including a GPU (Graphics Processing Unit)), an image memory 15, an image forming unit 16 (printer), and a display unit 17a. It is connected to a touch panel 17, a large-capacity nonvolatile storage device 18 such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), a facsimile communication section 19, a network communication interface 13 (communication section), and the like.
  • the control circuit 100 controls the operations of the above-mentioned parts connected to it, and transmits and receives signals and data to and from each part.
  • the operation section of the touch panel 17 is one form of an input device, and an audio input device including a microphone may be provided as the input device.
  • FIGS 2 and below show examples of display on the touch panel.
  • the control circuit 100 of the image forming apparatus 10 displays the main menu screen 200 (first layer screen) on the entire screen on the touch panel 17 and displays the pointing object 110 at the initial position 111.
  • the main menu screen 200 (FIG. 2) is the top screen that the user first recognizes.
  • the main menu screen 200 includes one or more (in this embodiment, a plurality of) first operation objects 210-213.
  • the plurality of first operation objects 210-213 each indicate one or more (in this embodiment, a plurality of) first items (language switching, copying, fax, and network printing).
  • the first operation objects 210-213 are GUI button objects that can be tapped by the user using the input means 112 (user's finger, stylus pen, etc.; the same applies hereinafter).
  • the plurality of first operation objects 210-213 include a language switching button object 210, a copy button object 211, a fax button object 212, and a network print button object 213.
  • the control circuit 100 When one first operation object 210-213 included in the main menu screen 200 is tapped by the input means 112, the control circuit 100 hides the main menu screen 200 and performs one first operation.
  • a second layer screen showing additional information in a layer below the first item indicated by objects 210-213 is displayed in full screen, and pointing object 110 is displayed at initial position 111.
  • the control circuit 100 displays a second layer screen (including information on how to place the document) showing additional information in the lower layer of the item (copy) indicated by the copy button object 211.
  • the screen 310 shown in FIG. 3 is displayed in full screen (FIG. 3).
  • the initial position 111 of the pointing object 110 is a position that does not overlap with the plurality of first operation objects 210-213 (in this example, the upper left of the screen).
  • the pointing object 110 may be a simple graphic object such as a round object, or may be an object representing an icon or a character.
  • the control circuit 100 may display a speech bubble such as "Help Pointer" when the screen starts up, when switching, etc. (FIG. 4). Note that in this embodiment, the tap operation and the drag operation may be performed either with the input means in contact with the touch panel 17 or without contact.
  • the pointing object 110 can be dragged using the input means 112.
  • the pointing object 110 can be moved by a drag operation only when the input means 112 overlaps the pointing object 110.
  • the control circuit 100 moves the pointing object 110 to the touch panel 17 along with the movement of the input means 112.
  • the image is displayed moving as if drawing a trajectory above.
  • the pointing object 110 also moves along with the drag operation (FIG. 5).
  • the control circuit 100 hides the main menu screen 200 and displays a lower layer of the item (fax) indicated by the fax button object 212.
  • the screen is switched by displaying the second layer screen (fax menu screen 800) showing additional information on the full screen (FIG. 7).
  • the control circuit 100 When the fax button object 212 on the menu screen 200 is tapped (FIG. 8), the main menu screen 200 is hidden and a second layer screen (showing additional information in the hierarchy below the item (fax) indicated by the fax button object 212) is displayed.
  • the fax menu screen 800 is displayed on the full screen, and the pointing object 110 is further displayed at the initial position 111 (FIG. 7).
  • the control circuit 100 controls the pointing object 110 while the pointing object 110 is being dragged and displayed over the first operating object (for example, the language switching button object 210).
  • the language switching screen 400 (second hierarchy screen) showing additional information in the hierarchy below the first item (language switching) indicated by the language switching button object 210) is displayed on the plurality of first operation objects 210 of the main menu screen 200. -213 ( Figure 9).
  • the language switching screen 400 (second hierarchical screen) is hierarchical additional information of the first item (language switching) indicated by the language switching button object 210 over which the pointing object 110 is displayed.
  • the language switching screen 400 displays one or more (in this example, a plurality of) second items that are lower hierarchical items of the first item (language switching) indicated by the first operation object (language switching button object 210).
  • Each includes one or more (in this example, a plurality of) second operation objects 410-411.
  • the second operation objects 410-411 are button objects for selecting a language, and include at least an English button object 410 and a Japanese button object 411.
  • the control circuit 100 controls the operation of the pointing object 110 by the input means 112 to be interrupted while the pointing object 110 is being displayed superimposed on the language switching button object 210 and the language switching screen 400 is being displayed as a pop-up. At this time, the display of the pointing object 110 superimposed on the language switching button object 210 and the pop-up display of the language switching screen 400 are continued. In other words, when the pointing object 110 is dragged and displayed over the language switching button object 210 and the input means 112 is removed from the touch panel 17 in this state, the control circuit 100 causes the pointing object 110 to switch languages. It continues to be displayed overlapping the button object 210.
  • the control circuit 100 displays the language switching screen 400 as a pop-up based on the state in which the pointing object 110 is displayed overlapping any of the first operation objects 210-213 as a criterion. In other words, whether the input means 112 is touching the touch panel 17 or not is irrelevant to the judgment criteria. Even if the input means 112 is not operating the touch panel 17, the control circuit 100 pops up the language switching screen 400 if the pointing object 110 overlaps any of the first operation objects 210-213 (see FIG. 9).
  • the control circuit 100 controls the pointing object 110 by the input means 112.
  • the display of the pointing object 110 superimposed on the language switching button object 210 and the pop-up display of the language switching screen 400 are continued.
  • the language switching screen 400 continues to be displayed as a pop-up even if the input means 112 is released.
  • the operation objects 410-411 can be operated by tapping using the input means 112.
  • control circuit 100 determines that input to English button object 410 has been performed. In this case, the control circuit 100 switches the language of the main menu screen 200 to English and hides the language switching screen 400 (FIG. 10).
  • the main menu screen 200 displays a lower layer screen (second layer screen) showing additional information (for example, explanation and information regarding copying) in a layer below the first item (copy) indicated by the button object 211). is displayed in a pop-up manner overlapping at least a portion of the plurality of first operation objects 210-213 (not shown).
  • the function setting screen 500 is a screen for setting various items (document size, resolution, etc.) for the copy function and scan function.
  • a function setting screen 500 for setting various items (document size, resolution, etc.) of the copy function will be explained.
  • the function setting screen 500 includes one or more (in this embodiment, a plurality of) first operation objects 510-511.
  • the plurality of first operation objects 510-511 each indicate one or more (in this embodiment, plural) first items (document size and resolution).
  • the first operation objects 510-511 are GUI button objects that can be tapped by the user using the input means 112.
  • the plurality of first operation objects 510-511 include a document size object 510 and a resolution object 511.
  • the control circuit 100 controls the pointing object 110 while the pointing object 110 is being dragged and displayed overlapping the first operating object (for example, the original size object 510).
  • the document size selection screen 600 (second layer screen) showing additional information in the hierarchy below the first item (document size) indicated by the size object 510) is displayed on the plurality of first operation objects 510- of the function setting screen 500. 511 (FIG. 11).
  • the document size selection screen 600 (second hierarchical screen) is hierarchical additional information of the first item (document size) indicated by the document size object 510 overlaid with the pointing object 110.
  • the document size selection screen 600 displays one or more (in this example, a plurality of) second items that are items in a lower hierarchy of the first item (document size) indicated by the first operation object (document size object 510).
  • One or more (in this example, a plurality of) second operation objects 610-613 are included.
  • the second operation objects 610-613 are objects for selecting the document size, and include a B5 object 610, an A4 object 611, a B4 object 612, and an A3 object 613.
  • the control circuit 100 controls the control circuit 100 when the operation of the pointing object 110 by the input means 112 is interrupted while the pointing object 110 is displayed superimposed on the document size object 510 and the document size selection screen 600 is being displayed as a pop-up. At this time, the pointing object 110 superimposed on the document size object 510 and the pop-up display of the document size selection screen 600 continue to be displayed. In other words, when the pointing object 110 is dragged and displayed over the document size object 510 and the input means 112 is removed from the touch panel 17 in this state, the control circuit 100 moves the pointing object 110 to the document size object. It continues to be displayed over 510.
  • the control circuit 100 pops up the document size selection screen 600 using the state in which the pointing object 110 is displayed overlapping any of the first operation objects 510-511 as a determination criterion. In other words, whether the input means 112 is touching the touch panel 17 or not is irrelevant to the judgment criterion. Even if the input means 112 is not operating the touch panel 17, the control circuit 100 pops up the document size selection screen 600 if the pointing object 110 overlaps any of the first operation objects 510-511 ( Figure 11).
  • the control circuit 100 controls the pointing object 110 by the input means 112.
  • the pointing object 110 superimposed on the document size object 510 and the pop-up display of the document size selection screen 600 continue to be displayed.
  • the document size selection screen 600 continues to be displayed as a pop-up even if the input means 112 is released. 2 operation objects 610 to 613 can be operated by tapping using the input means 112.
  • control circuit 100 determines that input to A4 object 611 has been performed. In this case, the control circuit 100 displays "A4" on the document size object 510 and hides the document size selection screen 600 (FIG. 11).
  • a document size selection screen 600 related to the document size is displayed as a pop-up.
  • the user moves the input means 112 away from the touch panel 17 while placing the pointing object 110 on the document size object 510 and taps the A4 object 611 displayed on the document size selection screen 600 to change the document size to A4.
  • Can be set when such a decision action occurs due to a user's tap operation, even if the pointing object 110 overlaps the document size object 510, the document size selection screen 600 that closes the lower layer screen showing additional information is hidden. ( Figure 11). In this case, although there is a tap operation, screen switching (for example, switching from main menu screen 200 (FIG. 6) to fax menu screen 800 (FIG. 7)) does not occur.
  • a document size selection screen 600 pops up as a layer below the function setting screen 500 (first layer screen), and a document size explanation is displayed as a layer below the document size selection screen 600 (second layer screen).
  • Screens 710-711 (third layer screen) pop up. That is, while the document size selection screen 600 is being pop-up displayed as a layer below the function setting screen 500, the document size explanation screens 710-711 are pop-up displayed as a layer below the document size selection screen 600.
  • the document size explanation screens 710-711 are two levels lower than the function setting screen 500. Such a scene will be explained below.
  • a document size selection screen 600 (second layer screen) is displayed as a pop-up as a lower layer of the function setting screen 500 (first layer screen).
  • the control circuit 100 displays the pointing object 110 superimposed on one second operation object (for example, the B5 object 610) included in the document size selection screen 600 (second layer screen) by dragging the pointing object 110. While the second operation object (B5 object 610) indicates the document size explanation screen 710, which shows additional information in the lower hierarchy of the second item (B5), The pop-up display is superimposed on at least a portion of the operation objects 610 to 613 of No. 2.
  • the manuscript size explanation screen 710 that shows additional information in the hierarchy below the second item (B5) is an explanation of the B5 size, and includes additional information such as "B5 (257 mm x 182 mm) size used for notebooks and magazines.” ( Figure 12).
  • the user moves the pointing object 110 so as to trace it by a drag operation, and further overlaps the pointing object 110 with the plurality of second operation objects 610 to 613 on the document size selection screen 600 (second layer screen) to hierarchically
  • a document size explanation screen 710 pops up.
  • the second operation objects 610-613 overlapping the pointing object 110 change one after another as the pointing object 110 is moved and displayed, there is only one document size explanation screen 710 corresponding to the second operation objects 610-613. Pop-ups are displayed one after another.
  • the control circuit 100 may move the second operation object (A4 object 611) shows the additional information in the hierarchy below the second item (A4). Display a popup on top of the .
  • the document size explanation screen 711 showing additional information in the hierarchy below A4 is an explanation of A4 size, and includes additional information "A4 (297 mm x 210 mm) -- (FIG. 13).
  • the control circuit 100 displays the pointing object 110 in an overlapping manner.
  • a pop-up is displayed so that only the document size explanation screen 710-701 (third layer screen) showing additional information on the lower layer of the second item indicated by the second operation object 610-613 inside is displayed as a pop-up.
  • Switch document size explanation screens 710-701 third layer screen within the same layer.
  • the control circuit 100 controls the pointing object 110 when the pointing object 110 is switched from a B5 object 610 to an A4 object 611 in the same hierarchy as a result of a dragging operation.
  • the screen is switched so that only the document size explanation screen 711 showing additional information (description of A4 size) in the hierarchy below the second item (A4) indicated by the A4 object 611 that is being displayed in an overlapping manner is displayed as a pop-up (FIG. 13).
  • the control circuit 100 determines that the second operation objects 610 to 613 included in the document size selection screen 600 as the second layer screen are operation objects in the same layer, the third layer screen is will not pop up at the same time.
  • the control circuit 100 controls the pointing object 110 to be dragged and displayed over one first operation object (for example, fax button object 212) on the main menu screen 200 (first layer screen).
  • a fax menu screen 800 (second layer screen) showing additional information in a layer below the first item (Fax) indicated by this first operation object (Fax button object 212) is displayed on the main menu screen 200.
  • a pop-up display is displayed overlapping at least a portion of the plurality of first operation objects 210-213 (FIG. 14).
  • the fax menu screen 800 (second hierarchical screen) is hierarchical additional information of the first item (fax) indicated by the fax button object 212 over which the pointing object 110 is displayed.
  • the fax menu screen 800 each shows one or more (in this example, a plurality of) second items that are items in a lower hierarchy of the first item (Fax) indicated by the first operation object (Fax button object 212). It includes one or more (in this example, a plurality of) second operation objects 810-811.
  • the second operation objects 810-811 are button objects for selecting a fax menu, including a domestic fax transmission button object 810, an international fax transmission button object 811, an external vendor fax transmission button object 812, and an external vendor fax transmission button object 812. Contains a receive fax button object 813.
  • a fax menu screen 800 is displayed as a pop-up as a lower layer of the main menu screen 200.
  • the control circuit 100 drags the pointing object 110 and superimposes it on one second operation object (for example, external vendor fax transmission button object 812) included in the fax menu screen 800 (second layer screen).
  • an external vendor fax explanation screen 820 shows additional information in the hierarchy below the second item (external vendor fax transmission) indicated by this second operation object (external vendor fax transmission button object 812).
  • third layer screen is displayed as a pop-up superimposed on at least a portion of the plurality of second operation objects 810 to 813 on the fax menu screen 800.
  • the external vendor fax explanation screen 820 which shows additional information in the hierarchy below the second item (external vendor fax transmission), is a description of the external vendor fax function and includes a "hyperlink to access the external vendor's web page.” ( Figure 14).
  • the destination fax menu screen 800 (second layer screen) pops up as a lower layer screen showing additional information, and is derived from the fax menu screen 800. Users can visually understand the functions to be used. Similar to FIGS. 12 and 13, the pointing object 110 is dragged and placed over the second operation object 810-813 included in the fax menu screen 800 that is popped up as a lower-level screen showing additional information. As a result, the external vendor fax explanation screen 820, which would normally be displayed in full screen after the screen is switched, can be hierarchically displayed as a pop-up before the screen is switched from the fax menu screen 800.
  • the corresponding function is activated.
  • a web page screen 821 associated with the hyperlink is displayed as a pop-up (FIG. 15).
  • the control circuit 100 pops up the second layer screens 500, 800, and 900 on the opposite side of the pointing object 110 in the direction of progress of the drag operation. That is, the second layer screens 500, 800, and 900 are pop-up displayed on the opposite side to the direction of movement of the pointing object 110 (FIG. 16).
  • the control circuit 100 hides the second layer screens 500, 800, and 900 when the pointing object 110 is no longer displayed over any of the first operation objects 210-213 due to the dragging operation of the pointing object 110. Display. Therefore, if the user wants to close the second layer screen 500, 800, 900 that has been displayed as a pop-up, drag the pointing object 110 to a location where the first operation objects 210-213 do not exist, and then 110 does not overlap any of the first operation objects 210-213. ( Figure 17)
  • a lower layer screen that shows additional information such as help for functions and operation buttons and operation explanations through intuitive operation can be displayed as a pop-up.
  • a pointing object is always displayed on the touch panel regardless of the display screen.
  • the pointing object is placed over various buttons, etc. (operation objects) displayed on the touch panel as the input means moves. This allows you to smoothly switch between lower-level screens that show additional information such as help and operation explanation screens, pop up and close them, and further lower-level screens that show additional information using input means such as your finger. operation is also possible.
  • the present invention reduces the possibility that a user will miss an operation related to a help function, compared to Patent Document 3. Since it can be recognized, operational errors are less likely to occur. Furthermore, since the operation functions by the input means and the functions executable by the pointing object are completely separated, it is easy for the user to distinguish between the operation means. In addition, since the pointing object functions simply by overlapping it with the operation object, there is no need for an operation process after moving the pointing object, and compared to Patent Documents 1 and 2, it is easier for the user to cover the functions, and the pointing object Roles can be instantly understood or predicted by users.

Abstract

An electronic device (10) comprises: a touch panel (17); and a control circuit (100) that displays, on an entire screen of the touch panel (17), a first layer screen (200) including one or more first operation objects (210)-(213) each indicating one or more first items, displays a pointing object (110) at an initial position (111) that does not overlap the one or more first operation objects (210)-(213), moves and displays the pointing object (110) following the movement of an input means (112) upon dragging of the pointing object (110) by the input means (112), and displays, in a pop-up manner, a second layer screen (310) indicating additional information in a layer lower than that of the first items indicated by one of the first operation objects (210)-(213) so as to be overlaid on at least a portion of the one or more first operation objects (210)-(213) in the first layer screen (200) while the pointing object (110) is dragged and displayed overlaid on one of the first operation objects (210)-(213).

Description

電子機器及び制御方法Electronic equipment and control method
　本発明は、タッチパネルを有する電子機器及び電子機器の制御方法に関する。 The present invention relates to an electronic device having a touch panel and a method of controlling the electronic device.
　コンビニエンスストアやオフィスに設置されるＭＦＰ（Multifunction Peripheral）やＡＴＭ装置等の電子機器には直感的な操作が可能であるタッチパネルが搭載されていることが多い。またそれらの装置は、機械操作に不慣れなユーザーが使う機会も多く、高頻度で繰り返し使用する場合も少ないことから習熟度の向上を見込めないことを前提とする為、表示するボタンや機能がシンプルにまとめられているものが多い。しかしそれでも技術進歩に伴って電子機器は多機能化しており、電子機器に組み込まれたソフトウェアのアップデートによるＵＩ変更や機能追加がされることを鑑みても、それらの電子機器における操作説明やヘルプ表示は全てのユーザーに対して必須であり、なるべく素早く簡単な操作で説明画面等にアクセスできる様々な手段が考えられている。また電子機器の多機能化により詳細設定や詳細項目画面の表示も必要とされ、紙詰まりに代表されるトラブル解決プロセスの表示もヘルプ表示同様に重要である。 Electronic devices such as MFPs (Multifunction Peripherals) and ATM devices installed in convenience stores and offices are often equipped with touch panels that allow intuitive operation. In addition, these devices are often used by users who are not familiar with machine operation, and are rarely used repeatedly, so it is assumed that there is no expectation of improvement in proficiency, so the displayed buttons and functions are simple. Many things are summarized in. However, with technological advances, electronic devices are becoming more multi-functional, and considering that UI changes and functions are added through updates to the software built into electronic devices, operating instructions and help displays on these electronic devices are becoming more and more complex. is essential for all users, and various means have been devised to enable access to explanation screens and the like with as quick and simple operations as possible. Furthermore, as electronic devices become more multi-functional, it becomes necessary to display detailed settings and detailed item screens, and the display of troubleshooting processes such as paper jams is as important as the help display.
特開２００９－１９３４２３号公報Japanese Patent Application Publication No. 2009-193423 特開２００５－３５２５６９号公報Japanese Patent Application Publication No. 2005-352569 特開２０１４－８１９２０号公報JP2014-81920A
　特許文献１は、指やスタイラスペンでの直接操作以外の操作を補助する仮想スタイラスを備えており、仮想スタイラスを随伴させ、操作オブジェクトに重ねて配置するという点は非常に近い。しかし仮想スタイラスを移動させて操作オブジェクトに重ねた上で、タップ等の項目操作を仮想スタイラスに重ねて行う必要があり、またドラッグ操作の継続か他のタップ操作の検出かを判定しなければならない。またこの仮想スタイラスは表示画面での都合上指やスタイラスペンでの直接操作が容易でなく操作ミスが発生しやすい場合にそれを補助代行するのが目的であり、指やスタイラスペンで本来可能な操作しか行えず、仮想スタイラスでしか実現できないような独自の操作機能は付与されていない。 Patent Document 1 is very similar in that it includes a virtual stylus that assists operations other than direct operations with a finger or a stylus pen, and that the virtual stylus is accompanied and placed over the operation object. However, it is necessary to move the virtual stylus so that it overlaps the operation object, and then perform item operations such as tapping on the virtual stylus, and it is also necessary to determine whether to continue the drag operation or detect another tap operation. . In addition, the purpose of this virtual stylus is to assist in cases where direct operation with a finger or stylus pen is not easy due to the display screen, and operation errors are likely to occur. It can only be operated, and there are no unique operation functions that can only be achieved with a virtual stylus.
　特許文献２は、主にソフトウェアキーボードを対象とし、所定の操作キーにポインターを合わせて該所定の操作キーを保持する機能を有するが、所定のキーに重ねただけでは保持状態にならず一定の保持工程(時間経過等)が必要である。また所定のキーを保持しただけで機能が発現することはなく、複数のキーを保持した状態でポインターを更に別の所定操作キー上に移動し重ねた状態で、所定の操作キー及び保持状態のキーの保持を同時に解除することで、所定の操作キーと保持状態キー全ての機能を同時に実行するという実行工程が含まれる。 Patent Document 2 is mainly aimed at software keyboards, and has a function of holding a predetermined operation key by placing a pointer on the predetermined operation key. A holding process (time elapse, etc.) is required. Also, the function will not be activated just by holding a predetermined key; if you hold multiple keys and move the pointer over another predetermined operation key and overlap them, This includes an execution step in which the functions of a predetermined operation key and all of the held state keys are simultaneously executed by releasing the holding of the keys at the same time.
　特許文献３は、操作オブジェクトに対してタップとは異なる「なぞる」という操作によって、操作オブジェクトに対応するヘルプ画面や設定項目画面などの追加画面及び情報を表示させるが、指によるタップ操作が主とされる操作装置において、指でなぞるという動作の存在自体に見逃しが発生する可能性があり、タッチパネルにおける「なぞり操作」の認知が低い場合には存在の周知が必要であるが、結局なぞり操作自体に関するヘルプの表示はどうするのかという問題がある。また複数のボタンを跨ぐようになぞった場合は複数ボタンに対応する説明画面がページ毎に表示され「次へボタン」で表示画面を切り替えられるとのことだが、操作の軌跡が視覚的に残らない場合においてユーザーが自分の操作を視覚的に認識するのは難しく、複数のボタンに対するなぞり操作が意図されたものとは限らない場合が発生し得る。また、ヘルプモードに移行するような特別な工程やハードキー及びソフトキーを用意するのではなく、主操作であるタップ操作から速やかに移行できる「なぞり操作」によってヘルプ表示を実現しているが、初見で操作するユーザーには「なぞり操作」そのものの存在が見逃される可能性が高く、タップ操作となぞり操作が近いが故にユーザー側で操作の勘違いが発生し却って混乱を招く可能性がある。 In Patent Document 3, additional screens and information such as a help screen and a setting item screen corresponding to the operation object are displayed by a "tracing" operation, which is different from tapping, on the operation object, but the tap operation with a finger is the main method. In operating devices that use finger tracing, there is a possibility that the existence of the finger tracing operation itself may be overlooked, and if awareness of the "tracing operation" on the touch panel is low, it is necessary to make the existence known, but in the end, the tracing operation itself may be overlooked. There is a problem as to how to display the help for. Also, if you trace across multiple buttons, an explanation screen corresponding to the multiple buttons will be displayed on each page, and you can switch the display screen with the "Next button", but the trace of the operation will not remain visually. In some cases, it is difficult for the user to visually recognize his/her own operations, and there may be cases where the tracing operations on multiple buttons are not necessarily the intended ones. In addition, instead of preparing a special process or hard keys and soft keys to enter help mode, help is displayed using a ``trace operation'' that allows a quick transition from the main operation of tapping. Users who operate it for the first time are likely to miss the existence of the ``tracing operation'' itself, and because the tap operation and tracing operation are similar, the user may misunderstand the operation and cause confusion.
　以上のような事情に鑑み、本発明の目的は、追加情報の見逃しが発生することなく、直感的で視覚的に極めて分かりやすい変化で操作オブジェクトに対する階層的な追加情報を表示することにある。 In view of the above circumstances, it is an object of the present invention to display hierarchical additional information for an operation object using changes that are intuitive and visually very easy to understand, without causing additional information to be overlooked.
　本発明の一形態に係る電子機器は、
　タッチパネルと、
　　１以上の第１の項目をそれぞれ示す１以上の第１の操作オブジェクトを含む第１階層画面を前記タッチパネルに全画面表示し、ポインティングオブジェクトを前記１以上の第１の操作オブジェクトに重ならない位置である初期位置に表示し、
　　前記ポインティングオブジェクトが入力手段によりドラッグ操作されると前記入力手段の移動に随伴して前記ポインティングオブジェクトを移動表示し、
　　前記ポインティングオブジェクトがドラッグ操作されて１個の第１の操作オブジェクトの上に重ねて表示されている最中に、前記１個の第１の操作オブジェクトが示す前記第１の項目の下位の階層の追加情報を示す第２階層画面を、前記第１階層画面の前記１以上の第１の操作オブジェクトの少なくとも一部の上に重ねてポップアップ表示する
　制御回路
　を具備する。 An electronic device according to one embodiment of the present invention includes:
touch panel and
A first layer screen including one or more first operation objects each representing one or more first items is displayed on the touch panel in full screen, and the pointing object is positioned at a position that does not overlap the one or more first operation objects. display at a certain initial position,
When the pointing object is dragged by an input means, the pointing object is moved and displayed in accordance with the movement of the input means,
While the pointing object is being dragged and displayed over one of the first operation objects, a lower level hierarchy of the first item indicated by the one first operation object is displayed. The control circuit includes a control circuit that pops up and displays a second layer screen showing additional information over at least a portion of the one or more first operation objects on the first layer screen.
　本発明によれば、追加情報の見逃しが発生することなく、直感的で視覚的に極めて分かりやすい変化で操作オブジェクトに対する階層的な追加情報を表示することを図れる。 According to the present invention, it is possible to display hierarchical additional information for an operation object with intuitive and visually extremely easy-to-understand changes without missing additional information.
　なお、ここに記載された効果は必ずしも限定されるものではなく、本開示中に記載されたいずれかの効果であってもよい。 Note that the effects described here are not necessarily limited, and may be any of the effects described in this disclosure.
本発明の一実施形態に係る画像形成装置を示す。1 shows an image forming apparatus according to an embodiment of the present invention. タッチパネルの表示例を示す。An example of touch panel display is shown. タッチパネルの表示例を示す。An example of touch panel display is shown. タッチパネルの表示例を示す。An example of touch panel display is shown. タッチパネルの表示例を示す。An example of touch panel display is shown. タッチパネルの表示例を示す。An example of touch panel display is shown. タッチパネルの表示例を示す。An example of touch panel display is shown. タッチパネルの表示例を示す。An example of touch panel display is shown. タッチパネルの表示例を示す。An example of touch panel display is shown. タッチパネルの表示例を示す。An example of touch panel display is shown. タッチパネルの表示例を示す。An example of touch panel display is shown. タッチパネルの表示例を示す。An example of touch panel display is shown. タッチパネルの表示例を示す。An example of touch panel display is shown. タッチパネルの表示例を示す。An example of touch panel display is shown. タッチパネルの表示例を示す。An example of touch panel display is shown. タッチパネルの表示例を示す。An example of touch panel display is shown. タッチパネルの表示例を示す。An example of touch panel display is shown.
　以下、図面を参照しながら、本発明の実施形態を説明する。本実施形態では、電子機器として、コンビニエンスストア等に設置されるＭＦＰ（Multifunction Peripheral）等の画像形成装置１０を一例として説明する。 Embodiments of the present invention will be described below with reference to the drawings. In this embodiment, an image forming apparatus 10 such as an MFP (Multifunction Peripheral) installed in a convenience store or the like will be described as an example of an electronic device.
　１．画像形成装置のハードウェア構成 1. Hardware configuration of image forming device
　図１は、本発明の一実施形態に係る画像形成装置を示す。 FIG. 1 shows an image forming apparatus according to an embodiment of the present invention.
　画像形成装置１０は、制御回路１００を備える。制御回路１００は、プロセッサーであるＣＰＵ１１ａ（Central Processing Unit）、ＲＡＭ１１ｂ（Random Access Memory）、メモリーであるＲＯＭ１１ｃ（Read Only Memory）及び専用のハードウェア回路等から構成され、画像形成装置１０の全体的な動作制御を司る。ＣＰＵ１１ａは、ＲＯＭ１１ｃが記憶する情報処理プログラムをＲＡＭ１１ｂにロードして実行することにより、下記の動作フローで説明する動作を実行し、タッチパネル１７の表示及び操作入力を制御する。ＲＯＭ１１ｃは、ＣＰＵ１１ａが実行するプログラムやデータなどを固定的に記憶する。ＲＯＭ１１ｃは、非一過性のコンピューター読み取り可能な記録媒体の一例である。 The image forming apparatus 10 includes a control circuit 100. The control circuit 100 is composed of a CPU 11a (Central Processing Unit) that is a processor, a RAM 11b (Random Access Memory), a ROM 11c (Read Only Memory) that is a memory, a dedicated hardware circuit, etc., and controls the entire image forming apparatus 10. Controls movement control. The CPU 11a loads the information processing program stored in the ROM 11c into the RAM 11b and executes it, thereby executing the operations described in the operation flow below and controlling the display and operation input of the touch panel 17. The ROM 11c permanently stores programs and data executed by the CPU 11a. The ROM 11c is an example of a non-transitory computer-readable recording medium.
　制御回路１００は、画像読取部１２（イメージスキャナー）、画像処理部１４（ＧＰＵ（Graphics Processing Unit）を含む）、画像メモリー１５、画像形成部１６（プリンター）、表示部１７ａを備える操作部であるタッチパネル１７、ＨＤＤ（Hard Disk Drive）やＳＳＤ（Solid State Drive）等の大容量の不揮発性の記憶装置１８、ファクシミリ通信部１９及びネットワーク通信インターフェース１３（通信部）等と接続されている。制御回路１００は、接続されている上記各部の動作制御や、各部との間での信号又はデータの送受信を行う。タッチパネル１７の操作部は、入力装置の一形態であり、入力装置として、マイクロフォンを含む音声入力装置が設けられてもよい。 The control circuit 100 is an operation unit that includes an image reading unit 12 (image scanner), an image processing unit 14 (including a GPU (Graphics Processing Unit)), an image memory 15, an image forming unit 16 (printer), and a display unit 17a. It is connected to a touch panel 17, a large-capacity nonvolatile storage device 18 such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), a facsimile communication section 19, a network communication interface 13 (communication section), and the like. The control circuit 100 controls the operations of the above-mentioned parts connected to it, and transmits and receives signals and data to and from each part. The operation section of the touch panel 17 is one form of an input device, and an audio input device including a microphone may be provided as the input device.
　２．画像形成装置の制御方法 2. Image forming apparatus control method
　図２以下は、タッチパネルの表示例を示す。 Figures 2 and below show examples of display on the touch panel.
　初期状態において、画像形成装置１０の制御回路１００は、メインメニュー画面２００（第１階層画面）をタッチパネル１７に全画面表示し、ポインティングオブジェクト１１０を初期位置１１１に表示する。 In the initial state, the control circuit 100 of the image forming apparatus 10 displays the main menu screen 200 (first layer screen) on the entire screen on the touch panel 17 and displays the pointing object 110 at the initial position 111.
　メインメニュー画面２００（図２）は、ユーザーが最初に認識するトップ画面である。メインメニュー画面２００は、１以上（本実施形態では複数）の第１の操作オブジェクト２１０－２１３を含む。複数の第１の操作オブジェクト２１０－２１３は、１以上（本実施形態では複数）の第１の項目（言語切り替え、コピー、ファックス及びネットワークプリント）をそれぞれ示す。第１の操作オブジェクト２１０－２１３は、ユーザーが入力手段１１２（ユーザーの手指やスタイラスペン等。以下同様）によりタップ操作可能なＧＵＩボタンオブジェクトである。本例では、複数の第１の操作オブジェクト２１０－２１３は、言語切り替えボタンオブジェクト２１０、コピーボタンオブジェクト２１１、ファックスボタンオブジェクト２１２及びネットワークプリントボタンオブジェクト２１３を含む。 The main menu screen 200 (FIG. 2) is the top screen that the user first recognizes. The main menu screen 200 includes one or more (in this embodiment, a plurality of) first operation objects 210-213. The plurality of first operation objects 210-213 each indicate one or more (in this embodiment, a plurality of) first items (language switching, copying, fax, and network printing). The first operation objects 210-213 are GUI button objects that can be tapped by the user using the input means 112 (user's finger, stylus pen, etc.; the same applies hereinafter). In this example, the plurality of first operation objects 210-213 include a language switching button object 210, a copy button object 211, a fax button object 212, and a network print button object 213.
　制御回路１００は、メインメニュー画面２００に含まれる１個の第１の操作オブジェクト２１０－２１３が入力手段１１２によりタップ操作されると、メインメニュー画面２００を非表示とし、１個の第１の操作オブジェクト２１０－２１３が示す第１の項目の下位の階層の追加情報を示す第２階層画面を全画面表示し、ポインティングオブジェクト１１０を初期位置１１１に表示する。制御回路１００は、ユーザーがメインメニュー画面２００のコピーボタンオブジェクト２１１をタップ操作すると、コピーボタンオブジェクト２１１が示す項目（コピー）の下位の階層の追加情報を示す第２階層画面（原稿の置き方を示す画面３１０）を全画面表示する（図３）。 When one first operation object 210-213 included in the main menu screen 200 is tapped by the input means 112, the control circuit 100 hides the main menu screen 200 and performs one first operation. A second layer screen showing additional information in a layer below the first item indicated by objects 210-213 is displayed in full screen, and pointing object 110 is displayed at initial position 111. When the user taps the copy button object 211 on the main menu screen 200, the control circuit 100 displays a second layer screen (including information on how to place the document) showing additional information in the lower layer of the item (copy) indicated by the copy button object 211. The screen 310 shown in FIG. 3 is displayed in full screen (FIG. 3).
　ポインティングオブジェクト１１０の初期位置１１１は、複数の第１の操作オブジェクト２１０－２１３に重ならない位置（本例では、画面の左上）である。ポインティングオブジェクト１１０は、丸形のオブジェクト等の単純な図形のオブジェクトでもよいし、アイコンやキャラクターを表現したオブジェクト等でもよい。制御回路１００は、ポインティングオブジェクト１１０の機能をユーザーに認識させるため、画面立ち上がり時や切り替え時等に「お助けポインター」等の吹き出しを表示してもよい（図４）。なお、本実施形態においてタップ操作及びドラッグ操作は、入力手段がタッチパネル１７に接触しての操作及び非接触での操作の何れでもよい。 The initial position 111 of the pointing object 110 is a position that does not overlap with the plurality of first operation objects 210-213 (in this example, the upper left of the screen). The pointing object 110 may be a simple graphic object such as a round object, or may be an object representing an icon or a character. In order to make the user aware of the function of the pointing object 110, the control circuit 100 may display a speech bubble such as "Help Pointer" when the screen starts up, when switching, etc. (FIG. 4). Note that in this embodiment, the tap operation and the drag operation may be performed either with the input means in contact with the touch panel 17 or without contact.
　ポインティングオブジェクト１１０は、入力手段１１２によりドラッグ操作することが可能である。ポインティングオブジェクト１１０は、入力手段１１２がポインティングオブジェクト１１０に重なった場合のみ、ドラッグ操作により移動させることが出来る。制御回路１００は、入力手段１１２がポインティングオブジェクト１１０に重なった状態から、ポインティングオブジェクト１１０が入力手段１１２によりドラッグ操作（矢印）されると、入力手段１１２の移動に随伴してポインティングオブジェクト１１０をタッチパネル１７上で軌跡を描くように移動表示する。ドラッグ操作に随伴するようにポインティングオブジェクト１１０も移動する（図５）。 The pointing object 110 can be dragged using the input means 112. The pointing object 110 can be moved by a drag operation only when the input means 112 overlaps the pointing object 110. When the pointing object 110 is dragged (arrow) by the input means 112 from a state where the input means 112 overlaps the pointing object 110, the control circuit 100 moves the pointing object 110 to the touch panel 17 along with the movement of the input means 112. The image is displayed moving as if drawing a trajectory above. The pointing object 110 also moves along with the drag operation (FIG. 5).
　一方、ポインティングオブジェクト１１０に入力手段１１２が触れてない場合は、入力手段１１２によるタップ操作等で画面の切り替え等の通常のアクションが有効となる。例えば、制御回路１００は、ユーザーがメインメニュー画面２００のファックスボタンオブジェクト２１２をタップ操作すると（図６）、メインメニュー画面２００を非表示とし、ファックスボタンオブジェクト２１２が示す項目（ファックス）の下位の階層の追加情報を示す第２階層画面（ファックスメニュー画面８００）を全画面表示することで画面を切り替える（図７）。 On the other hand, when the pointing object 110 is not touched by the input means 112, normal actions such as switching the screen by a tap operation or the like by the input means 112 become effective. For example, when the user taps the fax button object 212 on the main menu screen 200 (FIG. 6), the control circuit 100 hides the main menu screen 200 and displays a lower layer of the item (fax) indicated by the fax button object 212. The screen is switched by displaying the second layer screen (fax menu screen 800) showing additional information on the full screen (FIG. 7).
　なお、ユーザーがメインメニュー画面２００のファックスボタンオブジェクト２１２をタップ操作するときに（即ち、画面切り替え前に）ポインティングオブジェクト１１０が初期位置１１１以外の位置にある場合は、制御回路１００は、ユーザーがメインメニュー画面２００のファックスボタンオブジェクト２１２をタップ操作すると（図８）、メインメニュー画面２００を非表示とし、ファックスボタンオブジェクト２１２が示す項目（ファックス）の下位の階層の追加情報を示す第２階層画面（ファックスメニュー画面８００）を全画面表示し、さらに、ポインティングオブジェクト１１０を初期位置１１１に表示する（図７）。 Note that if the pointing object 110 is at a position other than the initial position 111 when the user taps the fax button object 212 on the main menu screen 200 (that is, before switching the screen), the control circuit 100 When the fax button object 212 on the menu screen 200 is tapped (FIG. 8), the main menu screen 200 is hidden and a second layer screen (showing additional information in the hierarchy below the item (fax) indicated by the fax button object 212) is displayed. The fax menu screen 800) is displayed on the full screen, and the pointing object 110 is further displayed at the initial position 111 (FIG. 7).
　制御回路１００は、ポインティングオブジェクト１１０がドラッグ操作されて１個の第１の操作オブジェクト（例えば、言語切り替えボタンオブジェクト２１０）の上に重ねて表示されている最中に、この第１の操作オブジェクト（言語切り替えボタンオブジェクト２１０）が示す第１の項目（言語切り替え）の下位の階層の追加情報を示す言語切り替え画面４００（第２階層画面）を、メインメニュー画面２００の複数の第１の操作オブジェクト２１０－２１３の少なくとも一部の上に重ねてポップアップ表示する（図９）。 The control circuit 100 controls the pointing object 110 while the pointing object 110 is being dragged and displayed over the first operating object (for example, the language switching button object 210). The language switching screen 400 (second hierarchy screen) showing additional information in the hierarchy below the first item (language switching) indicated by the language switching button object 210) is displayed on the plurality of first operation objects 210 of the main menu screen 200. -213 (Figure 9).
　言語切り替え画面４００（第２階層画面）は、ポインティングオブジェクト１１０が重ねて表示された言語切り替えボタンオブジェクト２１０が示す第１の項目（言語切り替え）の階層的な追加情報である。言語切り替え画面４００は、第１の操作オブジェクト（言語切り替えボタンオブジェクト２１０）が示す第１の項目（言語切り替え）の下位の階層の項目である１以上（本例では複数）の第２の項目をそれぞれ示す１以上（本例では複数）の第２の操作オブジェクト４１０－４１１を含む。本例では、第２の操作オブジェクト４１０－４１１は、言語を選択するためのボタンオブジェクトであり、英語ボタンオブジェクト４１０及び日本語ボタンオブジェクト４１１を少なくとも含む。 The language switching screen 400 (second hierarchical screen) is hierarchical additional information of the first item (language switching) indicated by the language switching button object 210 over which the pointing object 110 is displayed. The language switching screen 400 displays one or more (in this example, a plurality of) second items that are lower hierarchical items of the first item (language switching) indicated by the first operation object (language switching button object 210). Each includes one or more (in this example, a plurality of) second operation objects 410-411. In this example, the second operation objects 410-411 are button objects for selecting a language, and include at least an English button object 410 and a Japanese button object 411.
　制御回路１００は、ポインティングオブジェクト１１０が言語切り替えボタンオブジェクト２１０の上に重ねて表示され、且つ、言語切り替え画面４００がポップアップ表示されている最中に、入力手段１１２によるポインティングオブジェクト１１０の操作が中断されたとき、言語切り替えボタンオブジェクト２１０の上に重ねられたポインティングオブジェクト１１０の表示及び言語切り替え画面４００のポップアップ表示を継続する。言い換えれば、制御回路１００は、ポインティングオブジェクト１１０がドラッグ操作されて言語切り替えボタンオブジェクト２１０の上に重ねて表示され、その状態で、入力手段１１２がタッチパネル１７から離れた場合、ポインティングオブジェクト１１０を言語切り替えボタンオブジェクト２１０の上に重ねて表示し続ける。制御回路１００は、ポインティングオブジェクト１１０が何れかの第１の操作オブジェクト２１０－２１３と重なって表示されている状態を判断基準として言語切り替え画面４００をポップアップ表示する。逆に言えば、入力手段１１２がタッチパネル１７に触れているかいないかは判断基準には関わらない。制御回路１００は、入力手段１１２がタッチパネル１７を操作していなくても、ポインティングオブジェクト１１０が何れかの第１の操作オブジェクト２１０－２１３と重なっていれば、言語切り替え画面４００をポップアップ表示する（図９）。 The control circuit 100 controls the operation of the pointing object 110 by the input means 112 to be interrupted while the pointing object 110 is being displayed superimposed on the language switching button object 210 and the language switching screen 400 is being displayed as a pop-up. At this time, the display of the pointing object 110 superimposed on the language switching button object 210 and the pop-up display of the language switching screen 400 are continued. In other words, when the pointing object 110 is dragged and displayed over the language switching button object 210 and the input means 112 is removed from the touch panel 17 in this state, the control circuit 100 causes the pointing object 110 to switch languages. It continues to be displayed overlapping the button object 210. The control circuit 100 displays the language switching screen 400 as a pop-up based on the state in which the pointing object 110 is displayed overlapping any of the first operation objects 210-213 as a criterion. In other words, whether the input means 112 is touching the touch panel 17 or not is irrelevant to the judgment criteria. Even if the input means 112 is not operating the touch panel 17, the control circuit 100 pops up the language switching screen 400 if the pointing object 110 overlaps any of the first operation objects 210-213 (see FIG. 9).
　制御回路１００は、上述のように、ポインティングオブジェクト１１０が言語切り替えボタンオブジェクト２１０の上に重ねて表示され、且つ、言語切り替え画面４００がポップアップ表示されている最中に、入力手段１１２によるポインティングオブジェクト１１０の操作が中断されたとき、言語切り替えボタンオブジェクト２１０の上に重ねられたポインティングオブジェクト１１０の表示及び言語切り替え画面４００のポップアップ表示を継続する。ポインティングオブジェクト１１０が言語切り替えボタンオブジェクト２１０の上に重ねて表示された状態で、入力手段１１２を離しても言語切り替え画面４００はポップアップ表示され続けるので、ユーザーは、言語切り替え画面４００に含まれる第２の操作オブジェクト４１０－４１１を入力手段１１２でタップ操作することができる。制御回路１００は、言語切り替え画面４００に含まれる１個の第２の操作オブジェクト(本例では、英語ボタンオブジェクト４１０)がタップ操作されると、英語ボタンオブジェクト４１０に対する入力が実行されたと判断する。この場合、制御回路１００は、メインメニュー画面２００の言語を英語に切り替え、言語切り替え画面４００を非表示とする（図１０）。 As described above, while the pointing object 110 is displayed over the language switching button object 210 and the language switching screen 400 is being displayed as a pop-up, the control circuit 100 controls the pointing object 110 by the input means 112. When the operation is interrupted, the display of the pointing object 110 superimposed on the language switching button object 210 and the pop-up display of the language switching screen 400 are continued. With the pointing object 110 superimposed on the language switching button object 210, the language switching screen 400 continues to be displayed as a pop-up even if the input means 112 is released. The operation objects 410-411 can be operated by tapping using the input means 112. When one second operation object (in this example, English button object 410) included in language switching screen 400 is tapped, control circuit 100 determines that input to English button object 410 has been performed. In this case, the control circuit 100 switches the language of the main menu screen 200 to English and hides the language switching screen 400 (FIG. 10).
　制御回路１００は、ポインティングオブジェクト１１０がドラッグ操作されて１個の第１の操作オブジェクト（例えば、コピーボタンオブジェクト２１１）の上に重ねて表示されている最中に、この第１の操作オブジェクト（コピーボタンオブジェクト２１１）が示す第１の項目（コピー）の下位の階層の追加情報（例えば、コピーに関する説明及び情報）を示す追加情報を示す下位階層画面（第２階層画面）を、メインメニュー画面２００の複数の第１の操作オブジェクト２１０－２１３の少なくとも一部の上に重ねてポップアップ表示する（不図示）。 While the pointing object 110 is being dragged and displayed overlappingly on one first operation object (for example, the copy button object 211), the control circuit 100 controls the first operation object (for example, the copy button object 211). The main menu screen 200 displays a lower layer screen (second layer screen) showing additional information (for example, explanation and information regarding copying) in a layer below the first item (copy) indicated by the button object 211). is displayed in a pop-up manner overlapping at least a portion of the plurality of first operation objects 210-213 (not shown).
　以上、第１階層画面がメインメニュー画面２００である場合を説明した。次に、第１階層画面が機能設定画面５００である場合を説明する。機能設定画面５００は、コピー機能やスキャン機能の各種項目（原稿サイズ、解像度等）を設定するための画面である。本例では、コピー機能の各種項目（原稿サイズ、解像度等）を設定するための機能設定画面５００を例に説明する。 The case where the first layer screen is the main menu screen 200 has been described above. Next, a case where the first layer screen is the function setting screen 500 will be described. The function setting screen 500 is a screen for setting various items (document size, resolution, etc.) for the copy function and scan function. In this example, a function setting screen 500 for setting various items (document size, resolution, etc.) of the copy function will be explained.
　機能設定画面５００は、１以上（本実施形態では複数）の第１の操作オブジェクト５１０－５１１を含む。複数の第１の操作オブジェクト５１０－５１１は、１以上（本実施形態では複数）の第１の項目（原稿サイズ及び解像度）をそれぞれ示す。第１の操作オブジェクト５１０－５１１は、ユーザーが入力手段１１２によりタップ操作可能なＧＵＩボタンオブジェクトである。本例では、複数の第１の操作オブジェクト５１０－５１１は、原稿サイズオブジェクト５１０及び解像度オブジェクト５１１を含む。 The function setting screen 500 includes one or more (in this embodiment, a plurality of) first operation objects 510-511. The plurality of first operation objects 510-511 each indicate one or more (in this embodiment, plural) first items (document size and resolution). The first operation objects 510-511 are GUI button objects that can be tapped by the user using the input means 112. In this example, the plurality of first operation objects 510-511 include a document size object 510 and a resolution object 511.
　制御回路１００は、ポインティングオブジェクト１１０がドラッグ操作されて１個の第１の操作オブジェクト（例えば、原稿サイズオブジェクト５１０）の上に重ねて表示されている最中に、この第１の操作オブジェクト（原稿サイズオブジェクト５１０）が示す第１の項目（原稿サイズ）の下位の階層の追加情報を示す原稿サイズ選択画面６００（第２階層画面）を、機能設定画面５００の複数の第１の操作オブジェクト５１０－５１１の少なくとも一部の上に重ねてポップアップ表示する（図１１）。 The control circuit 100 controls the pointing object 110 while the pointing object 110 is being dragged and displayed overlapping the first operating object (for example, the original size object 510). The document size selection screen 600 (second layer screen) showing additional information in the hierarchy below the first item (document size) indicated by the size object 510) is displayed on the plurality of first operation objects 510- of the function setting screen 500. 511 (FIG. 11).
　原稿サイズ選択画面６００（第２階層画面）は、ポインティングオブジェクト１１０が重ねて表示された原稿サイズオブジェクト５１０が示す第１の項目（原稿サイズ）の階層的な追加情報である。原稿サイズ選択画面６００は、第１の操作オブジェクト（原稿サイズオブジェクト５１０）が示す第１の項目（原稿サイズ）の下位の階層の項目である１以上（本例では複数）の第２の項目をそれぞれ示す１以上（本例では複数）の第２の操作オブジェクト６１０－６１３を含む。本例では、第２の操作オブジェクト６１０－６１３は、原稿サイズを選択するためのオブジェクトであり、Ｂ５オブジェクト６１０、Ａ４オブジェクト６１１、Ｂ４オブジェクト６１２及びＡ３オブジェクト６１３を含む。 The document size selection screen 600 (second hierarchical screen) is hierarchical additional information of the first item (document size) indicated by the document size object 510 overlaid with the pointing object 110. The document size selection screen 600 displays one or more (in this example, a plurality of) second items that are items in a lower hierarchy of the first item (document size) indicated by the first operation object (document size object 510). One or more (in this example, a plurality of) second operation objects 610-613 are included. In this example, the second operation objects 610-613 are objects for selecting the document size, and include a B5 object 610, an A4 object 611, a B4 object 612, and an A3 object 613.
　制御回路１００は、ポインティングオブジェクト１１０が原稿サイズオブジェクト５１０の上に重ねて表示され、且つ、原稿サイズ選択画面６００がポップアップ表示されている最中に、入力手段１１２によるポインティングオブジェクト１１０の操作が中断されたとき、原稿サイズオブジェクト５１０の上に重ねられたポインティングオブジェクト１１０の表示及び原稿サイズ選択画面６００のポップアップ表示を継続する。言い換えれば、制御回路１００は、ポインティングオブジェクト１１０がドラッグ操作されて原稿サイズオブジェクト５１０の上に重ねて表示され、その状態で、入力手段１１２がタッチパネル１７から離れた場合、ポインティングオブジェクト１１０を原稿サイズオブジェクト５１０の上に重ねて表示し続ける。制御回路１００は、ポインティングオブジェクト１１０が何れかの第１の操作オブジェクト５１０－５１１と重なって表示されている状態を判断基準として原稿サイズ選択画面６００をポップアップ表示する。逆に言えば、入力手段１１２がタッチパネル１７に触れているかいないかは判断基準には関わらない。制御回路１００は、入力手段１１２がタッチパネル１７を操作していなくても、ポインティングオブジェクト１１０が何れかの第１の操作オブジェクト５１０－５１１と重なっていれば、原稿サイズ選択画面６００をポップアップ表示する（図１１）。 The control circuit 100 controls the control circuit 100 when the operation of the pointing object 110 by the input means 112 is interrupted while the pointing object 110 is displayed superimposed on the document size object 510 and the document size selection screen 600 is being displayed as a pop-up. At this time, the pointing object 110 superimposed on the document size object 510 and the pop-up display of the document size selection screen 600 continue to be displayed. In other words, when the pointing object 110 is dragged and displayed over the document size object 510 and the input means 112 is removed from the touch panel 17 in this state, the control circuit 100 moves the pointing object 110 to the document size object. It continues to be displayed over 510. The control circuit 100 pops up the document size selection screen 600 using the state in which the pointing object 110 is displayed overlapping any of the first operation objects 510-511 as a determination criterion. In other words, whether the input means 112 is touching the touch panel 17 or not is irrelevant to the judgment criterion. Even if the input means 112 is not operating the touch panel 17, the control circuit 100 pops up the document size selection screen 600 if the pointing object 110 overlaps any of the first operation objects 510-511 ( Figure 11).
　制御回路１００は、上述のように、ポインティングオブジェクト１１０が原稿サイズオブジェクト５１０の上に重ねて表示され、且つ、原稿サイズ選択画面６００がポップアップ表示されている最中に、入力手段１１２によるポインティングオブジェクト１１０の操作が中断されたとき、原稿サイズオブジェクト５１０の上に重ねられたポインティングオブジェクト１１０の表示及び原稿サイズ選択画面６００のポップアップ表示を継続する。ポインティングオブジェクト１１０が原稿サイズオブジェクト５１０の上に重ねて表示された状態で、入力手段１１２を離しても原稿サイズ選択画面６００はポップアップ表示され続けるので、ユーザーは、原稿サイズ選択画面６００に含まれる第２の操作オブジェクト６１０－６１３を入力手段１１２でタップ操作することができる。制御回路１００は、原稿サイズ選択画面６００に含まれる１個の第２の操作オブジェクト(本例では、Ａ４オブジェクト６１１)がタップ操作されると、Ａ４オブジェクト６１１に対する入力が実行されたと判断する。この場合、制御回路１００は、原稿サイズオブジェクト５１０に「Ａ４」と表示し、原稿サイズ選択画面６００を非表示とする（図１１）。 As described above, while the pointing object 110 is displayed superimposed on the document size object 510 and the document size selection screen 600 is being displayed as a pop-up, the control circuit 100 controls the pointing object 110 by the input means 112. When the operation is interrupted, the pointing object 110 superimposed on the document size object 510 and the pop-up display of the document size selection screen 600 continue to be displayed. With the pointing object 110 superimposed on the document size object 510, the document size selection screen 600 continues to be displayed as a pop-up even if the input means 112 is released. 2 operation objects 610 to 613 can be operated by tapping using the input means 112. When one second operation object (A4 object 611 in this example) included in document size selection screen 600 is tapped, control circuit 100 determines that input to A4 object 611 has been performed. In this case, the control circuit 100 displays "A4" on the document size object 510 and hides the document size selection screen 600 (FIG. 11).
　言い換えれば、制御回路１００は、機能設定画面５００において、原稿サイズオブジェクト５１０の上にポインティングオブジェクト１１０を重ねると、原稿サイズに関する原稿サイズ選択画面６００がポップアップ表示される。ユーザーは、ポインティングオブジェクト１１０を原稿サイズオブジェクト５１０の上に配置したまま入力手段１１２をタッチパネル１７から離し、原稿サイズ選択画面６００に表示されたＡ４オブジェクト６１１をタップ操作することで、原稿サイズをＡ４に設定できる。このようなユーザーのタップ操作による決定アクションが発生した場合は、ポインティングオブジェクト１１０が原稿サイズオブジェクト５１０の上に重なっていても、追加情報を示す下位階層画面を閉じる原稿サイズ選択画面６００を非表示とする（図１１）。なお、この場合、タップ操作があるものの、画面切り替え（例えば、メインメニュー画面２００（図６）からファックスメニュー画面８００（図７）への切り替え）は発生しない。 In other words, when the control circuit 100 places the pointing object 110 on the document size object 510 on the function setting screen 500, a document size selection screen 600 related to the document size is displayed as a pop-up. The user moves the input means 112 away from the touch panel 17 while placing the pointing object 110 on the document size object 510 and taps the A4 object 611 displayed on the document size selection screen 600 to change the document size to A4. Can be set. When such a decision action occurs due to a user's tap operation, even if the pointing object 110 overlaps the document size object 510, the document size selection screen 600 that closes the lower layer screen showing additional information is hidden. (Figure 11). In this case, although there is a tap operation, screen switching (for example, switching from main menu screen 200 (FIG. 6) to fax menu screen 800 (FIG. 7)) does not occur.
　機能設定画面５００（第１階層画面）の下位の階層として原稿サイズ選択画面６００（第２階層画面）がポップアップ表示され、原稿サイズ選択画面６００（第２階層画面）の下位の階層として原稿サイズ説明画面７１０－７１１（第３階層画面）がポップアップ表示される。即ち、機能設定画面５００の下位の階層として原稿サイズ選択画面６００がポップアップ表示されている最中に、原稿サイズ選択画面６００の下位の階層として原稿サイズ説明画面７１０－７１１がポップアップ表示される。原稿サイズ説明画面７１０－７１１は、機能設定画面５００を基準とすると２段階下位の階層となる。以下、この様な場面を説明する。 A document size selection screen 600 (second layer screen) pops up as a layer below the function setting screen 500 (first layer screen), and a document size explanation is displayed as a layer below the document size selection screen 600 (second layer screen). Screens 710-711 (third layer screen) pop up. That is, while the document size selection screen 600 is being pop-up displayed as a layer below the function setting screen 500, the document size explanation screens 710-711 are pop-up displayed as a layer below the document size selection screen 600. The document size explanation screens 710-711 are two levels lower than the function setting screen 500. Such a scene will be explained below.
　機能設定画面５００（第１階層画面）の下位の階層として原稿サイズ選択画面６００（第２階層画面）がポップアップ表示されている。制御回路１００は、ポインティングオブジェクト１１０がドラッグ操作されて原稿サイズ選択画面６００（第２階層画面）に含まれる１個の第２の操作オブジェクト（例えば、Ｂ５オブジェクト６１０）の上に重ねて表示されている最中に、この第２の操作オブジェクト（Ｂ５オブジェクト６１０）が示す第２の項目（Ｂ５）の下位の階層の追加情報を示す原稿サイズ説明画面７１０を、原稿サイズ選択画面６００の複数の第２の操作オブジェクト６１０－６１３の少なくとも一部の上に重ねてポップアップ表示する。第２の項目（Ｂ５）の下位の階層の追加情報を示す原稿サイズ説明画面７１０は、Ｂ５サイズの説明であり、「Ｂ５（２５７ｍｍ×１８２ｍｍ）ノートや雑誌に使われるサイズ」という追加情報を含む（図１２）。 A document size selection screen 600 (second layer screen) is displayed as a pop-up as a lower layer of the function setting screen 500 (first layer screen). The control circuit 100 displays the pointing object 110 superimposed on one second operation object (for example, the B5 object 610) included in the document size selection screen 600 (second layer screen) by dragging the pointing object 110. While the second operation object (B5 object 610) indicates the document size explanation screen 710, which shows additional information in the lower hierarchy of the second item (B5), The pop-up display is superimposed on at least a portion of the operation objects 610 to 613 of No. 2. The manuscript size explanation screen 710 that shows additional information in the hierarchy below the second item (B5) is an explanation of the B5 size, and includes additional information such as "B5 (257 mm x 182 mm) size used for notebooks and magazines." (Figure 12).
　ユーザーは、ドラッグ操作により辿るようにポインティングオブジェクト１１０を移動させ、更に原稿サイズ選択画面６００（第２階層画面）の複数の第２の操作オブジェクト６１０－６１３にポインティングオブジェクト１１０を重ねることで階層的に原稿サイズ説明画面７１０がポップアップ表示される。ポインティングオブジェクト１１０が移動表示されることによりポインティングオブジェクト１１０に重なる第２の操作オブジェクト６１０－６１３が次々と変化する場合は、第２の操作オブジェクト６１０－６１３に対応する原稿サイズ説明画面７１０が１個ずつ次々とポップアップ表示される。例えば、制御回路１００は、ポインティングオブジェクト１１０がドラッグ操作されて原稿サイズ選択画面６００に含まれるＢ５オブジェクト６１０からＡ４オブジェクト６１１に移動して重ねて表示されている最中に、この第２の操作オブジェクト（Ａ４オブジェクト６１１）が示す第２の項目（Ａ４）の下位の階層の追加情報を示す原稿サイズ説明画面７１１を、原稿サイズ選択画面６００の複数の第２の操作オブジェクト６１０－６１３の少なくとも一部の上に重ねてポップアップ表示する。Ａ４の下位の階層の追加情報を示す原稿サイズ説明画面７１１は、Ａ４サイズの説明であり、「Ａ４（２９７ｍｍ×２１０ｍｍ）・・・・」という追加情報を含む（図１３）。 The user moves the pointing object 110 so as to trace it by a drag operation, and further overlaps the pointing object 110 with the plurality of second operation objects 610 to 613 on the document size selection screen 600 (second layer screen) to hierarchically A document size explanation screen 710 pops up. When the second operation objects 610-613 overlapping the pointing object 110 change one after another as the pointing object 110 is moved and displayed, there is only one document size explanation screen 710 corresponding to the second operation objects 610-613. Pop-ups are displayed one after another. For example, while the pointing object 110 is being dragged and moved from a B5 object 610 included in the document size selection screen 600 to an A4 object 611 and being displayed in an overlapping manner, the control circuit 100 may move the second operation object (A4 object 611) shows the additional information in the hierarchy below the second item (A4). Display a popup on top of the . The document size explanation screen 711 showing additional information in the hierarchy below A4 is an explanation of A4 size, and includes additional information "A4 (297 mm x 210 mm)..." (FIG. 13).
　即ち、制御回路１００は、ポインティングオブジェクト１１０がドラッグ操作されることにより、ポインティングオブジェクト１１０が重ねて表示される第２の操作オブジェクト６１０－６１３が同一階層内で切り替わるとき、ポインティングオブジェクト１１０を重ねて表示中の第２の操作オブジェクト６１０－６１３が示す第２の項目の下位の階層の追加情報を示す原稿サイズ説明画面７１０－７０１（第３階層画面）のみをポップアップ表示するように、ポップアップ表示される原稿サイズ説明画面７１０－７０１（第３階層画面）を同一階層内で切り替える。本例では、制御回路１００は、ポインティングオブジェクト１１０がドラッグ操作されることにより、ポインティングオブジェクト１１０がＢ５オブジェクト６１０からＡ４オブジェクト６１１に重ねて表示されるように同一階層内で切り替わるとき、ポインティングオブジェクト１１０を重ねて表示中のＡ４オブジェクト６１１が示す第２の項目（Ａ４）の下位の階層の追加情報（Ａ４サイズの説明）を示す原稿サイズ説明画面７１１のみをポップアップ表示するように切り替える（図１３）。言い換えれば、制御回路１００は、第２階層画面としての原稿サイズ選択画面６００に含まれる第２の操作オブジェクト６１０－６１３は同一階層の操作オブジェクトと判断するので、重ねて第３階層画面が階層的に同時ポップアップ表示されることはない。 That is, when the pointing object 110 is dragged and the second operation objects 610 to 613 on which the pointing object 110 is displayed are switched within the same hierarchy, the control circuit 100 displays the pointing object 110 in an overlapping manner. A pop-up is displayed so that only the document size explanation screen 710-701 (third layer screen) showing additional information on the lower layer of the second item indicated by the second operation object 610-613 inside is displayed as a pop-up. Switch document size explanation screens 710-701 (third layer screen) within the same layer. In this example, the control circuit 100 controls the pointing object 110 when the pointing object 110 is switched from a B5 object 610 to an A4 object 611 in the same hierarchy as a result of a dragging operation. The screen is switched so that only the document size explanation screen 711 showing additional information (description of A4 size) in the hierarchy below the second item (A4) indicated by the A4 object 611 that is being displayed in an overlapping manner is displayed as a pop-up (FIG. 13). In other words, since the control circuit 100 determines that the second operation objects 610 to 613 included in the document size selection screen 600 as the second layer screen are operation objects in the same layer, the third layer screen is will not pop up at the same time.
　制御回路１００は、ポインティングオブジェクト１１０がドラッグ操作されてメインメニュー画面２００（第１階層画面）の１個の第１の操作オブジェクト（例えば、ファックスボタンオブジェクト２１２）の上に重ねて表示されている最中に、この第１の操作オブジェクト（ファックスボタンオブジェクト２１２）が示す第１の項目（ファックス）の下位の階層の追加情報を示すファックスメニュー画面８００（第２階層画面）を、メインメニュー画面２００の複数の第１の操作オブジェクト２１０－２１３の少なくとも一部の上に重ねてポップアップ表示する（図１４）。 The control circuit 100 controls the pointing object 110 to be dragged and displayed over one first operation object (for example, fax button object 212) on the main menu screen 200 (first layer screen). Inside, a fax menu screen 800 (second layer screen) showing additional information in a layer below the first item (Fax) indicated by this first operation object (Fax button object 212) is displayed on the main menu screen 200. A pop-up display is displayed overlapping at least a portion of the plurality of first operation objects 210-213 (FIG. 14).
　ファックスメニュー画面８００（第２階層画面）は、ポインティングオブジェクト１１０が重ねて表示されたファックスボタンオブジェクト２１２が示す第１の項目（ファックス）の階層的な追加情報である。ファックスメニュー画面８００は、第１の操作オブジェクト（ファックスボタンオブジェクト２１２）が示す第１の項目（ファックス）の下位の階層の項目である１以上（本例では複数）の第２の項目をそれぞれ示す１以上（本例では複数）の第２の操作オブジェクト８１０－８１１を含む。本例では、第２の操作オブジェクト８１０－８１１は、ファックスメニューを選択するためのボタンオブジェクトであり、国内ファックス送信ボタンオブジェクト８１０、海外ファックス送信ボタンオブジェクト８１１、外部ベンダファックス送信ボタンオブジェクト８１２及び外部ベンダファックス受信ボタンオブジェクト８１３を含む。 The fax menu screen 800 (second hierarchical screen) is hierarchical additional information of the first item (fax) indicated by the fax button object 212 over which the pointing object 110 is displayed. The fax menu screen 800 each shows one or more (in this example, a plurality of) second items that are items in a lower hierarchy of the first item (Fax) indicated by the first operation object (Fax button object 212). It includes one or more (in this example, a plurality of) second operation objects 810-811. In this example, the second operation objects 810-811 are button objects for selecting a fax menu, including a domestic fax transmission button object 810, an international fax transmission button object 811, an external vendor fax transmission button object 812, and an external vendor fax transmission button object 812. Contains a receive fax button object 813.
　メインメニュー画面２００の下位の階層として、ファックスメニュー画面８００がポップアップ表示されている。制御回路１００は、ポインティングオブジェクト１１０がドラッグ操作されてファックスメニュー画面８００（第２階層画面）に含まれる１個の第２の操作オブジェクト（例えば、外部ベンダファックス送信ボタンオブジェクト８１２）の上に重ねて表示されている最中に、この第２の操作オブジェクト（外部ベンダファックス送信ボタンオブジェクト８１２）が示す第２の項目（外部ベンダファックス送信）の下位の階層の追加情報を示す外部ベンダファックス説明画面８２０（第３階層画面）を、ファックスメニュー画面８００の複数の第２の操作オブジェクト８１０－８１３の少なくとも一部の上に重ねてポップアップ表示する。第２の項目（外部ベンダファックス送信）の下位の階層の追加情報を示す外部ベンダファックス説明画面８２０は、外部ベンダファックス機能の説明であり、「外部ベンダのウェブページにアクセスするためのハイパーリンク」という追加情報を含む（図１４）。 A fax menu screen 800 is displayed as a pop-up as a lower layer of the main menu screen 200. The control circuit 100 drags the pointing object 110 and superimposes it on one second operation object (for example, external vendor fax transmission button object 812) included in the fax menu screen 800 (second layer screen). While being displayed, an external vendor fax explanation screen 820 shows additional information in the hierarchy below the second item (external vendor fax transmission) indicated by this second operation object (external vendor fax transmission button object 812). (third layer screen) is displayed as a pop-up superimposed on at least a portion of the plurality of second operation objects 810 to 813 on the fax menu screen 800. The external vendor fax explanation screen 820, which shows additional information in the hierarchy below the second item (external vendor fax transmission), is a description of the external vendor fax function and includes a "hyperlink to access the external vendor's web page." (Figure 14).
　この様に、ファックスボタンオブジェクト２１２とポインティングオブジェクト１１０が重なった場合は、遷移先のファックスメニュー画面８００（第２階層画面）が追加情報を示す下位階層画面としてポップアップ表示され、ファックスメニュー画面８００から派生する機能をユーザーが視覚的に把握できる。図１２及び図１３と同様に、ポインティングオブジェクト１１０をドラッグ操作して、追加情報を示す下位階層画面としてポップアップ表示されたファックスメニュー画面８００に含まれる第２の操作オブジェクト８１０－８１３の上に重ねる。これにより、本来は画面切り替え後に全画面表示される外部ベンダファックス説明画面８２０を、ファックスメニュー画面８００からの画面切り替え前に階層的にポップアップ表示することができる。また階層的にポップアップ表示されている外部ベンダファックス説明画面８２０（第３階層画面）をタップ操作することで、対応した機能が作動する。本例では、外部ベンダファックス説明画面８２０に含まれるハイパーリンクをタップすることで、ハイパーリンクに紐づけられたｗｅｂページ画面８２１がポップアップ表示される（図１５）。 In this way, when the fax button object 212 and pointing object 110 overlap, the destination fax menu screen 800 (second layer screen) pops up as a lower layer screen showing additional information, and is derived from the fax menu screen 800. Users can visually understand the functions to be used. Similar to FIGS. 12 and 13, the pointing object 110 is dragged and placed over the second operation object 810-813 included in the fax menu screen 800 that is popped up as a lower-level screen showing additional information. As a result, the external vendor fax explanation screen 820, which would normally be displayed in full screen after the screen is switched, can be hierarchically displayed as a pop-up before the screen is switched from the fax menu screen 800. Further, by tapping the external vendor fax explanation screen 820 (third layer screen) that is hierarchically displayed as a pop-up, the corresponding function is activated. In this example, by tapping a hyperlink included in the external vendor fax explanation screen 820, a web page screen 821 associated with the hyperlink is displayed as a pop-up (FIG. 15).
　ポインティングオブジェクト１１０を、ファックスボタンオブジェクト２１２の上に重ねるためにドラッグ操作する際に、ポインティングオブジェクト１１０がコピーボタンオブジェクト２１１の上に一時的に重なった際も、コピーボタンオブジェクト２１１に関する追加情報を示す第２階層画面（機能設定画面５００）がポップアップ表示される。コピーボタンオブジェクト２１１からポインティングオブジェクト１１０が移動により離れた場合、コピーボタンオブジェクト２１１に関する追加情報を示す第２階層画面（機能設定画面５００）は閉じられる（図１６）。 When the pointing object 110 is dragged to overlap the fax button object 212 and the pointing object 110 temporarily overlaps the copy button object 211, a message indicating additional information regarding the copy button object 211 is displayed. A two-layer screen (function setting screen 500) pops up. When the pointing object 110 moves away from the copy button object 211, the second layer screen (function setting screen 500) showing additional information regarding the copy button object 211 is closed (FIG. 16).
　制御回路１００は、第２階層画面５００、８００、９００を、ドラッグ操作の進行方向に対して、ポインティングオブジェクト１１０の反対側にポップアップ表示する。即ち、第２階層画面５００、８００、９００は、ポインティングオブジェクト１１０の進行方向に対して反対側にポップアップ表示される（図１６）。 The control circuit 100 pops up the second layer screens 500, 800, and 900 on the opposite side of the pointing object 110 in the direction of progress of the drag operation. That is, the second layer screens 500, 800, and 900 are pop-up displayed on the opposite side to the direction of movement of the pointing object 110 (FIG. 16).
　制御回路１００は、ポインティングオブジェクト１１０がドラッグ操作されることにより、ポインティングオブジェクト１１０が何れの第１の操作オブジェクト２１０－２１３にも重ねて表示されなくなると、第２階層画面５００、８００、９００を非表示とする。したがって、ユーザーが、ポップアップ表示された第２階層画面５００、８００、９００を閉じたい場合は、第１の操作オブジェクト２１０－２１３の存在しない場所にポインティングオブジェクト１１０をドラッグ操作して移動させ、ポインティングオブジェクト１１０が何れの第１の操作オブジェクト２１０－２１３にも重ならない状態にする。（図１７） The control circuit 100 hides the second layer screens 500, 800, and 900 when the pointing object 110 is no longer displayed over any of the first operation objects 210-213 due to the dragging operation of the pointing object 110. Display. Therefore, if the user wants to close the second layer screen 500, 800, 900 that has been displayed as a pop-up, drag the pointing object 110 to a location where the first operation objects 210-213 do not exist, and then 110 does not overlap any of the first operation objects 210-213. (Figure 17)
　３．結語 3. Conclusion
　本実施形態によれば、ＭＦＰやＡＴＭ装置等の操作画面にタッチパネルが採用されている場合において、直感的な操作により、機能及び操作ボタンのヘルプや、操作説明等の追加情報を示す下位階層画面をポップアップ表示することが出来る。タッチパネルにはポインティングオブジェクトが表示画面を問わず常に表示されている。ポインティングオブジェクトを指等の入力手段によりドラッグ操作して、ポインティングオブジェクトを入力手段の移動に随伴してタッチパネルに表示された様々なボタン等(操作オブジェクト)の上に重ねて配置させる。これにより、次々とヘルプ及び操作説明画面等の追加情報を示す下位階層画面をスムーズに切り替えてポップアップ表示したり閉じたりすることができ、さらに指等の入力手段による追加情報を示す下位階層画面での操作も可能になる。 According to the present embodiment, when a touch panel is adopted as an operation screen of an MFP, an ATM device, etc., a lower layer screen that shows additional information such as help for functions and operation buttons and operation explanations through intuitive operation. can be displayed as a pop-up. A pointing object is always displayed on the touch panel regardless of the display screen. By dragging the pointing object with an input means such as a finger, the pointing object is placed over various buttons, etc. (operation objects) displayed on the touch panel as the input means moves. This allows you to smoothly switch between lower-level screens that show additional information such as help and operation explanation screens, pop up and close them, and further lower-level screens that show additional information using input means such as your finger. operation is also possible.
　本発明は視覚的に認識が容易なポインティングオブジェクトをタッチパネルに常に表示することにより、特許文献３と比較して、ユーザーがヘルプ機能関連操作を見逃す可能性が減少し、ポインティングオブジェクトを視覚的に常に認識できることから操作ミスが発生しにくくなる。また入力手段による操作機能とポインティングオブジェクトで実行可能な機能が完全に分かれていることから、操作手段としてユーザーが区別しやすい。またポインティングオブジェクトは操作オブジェクトと重ねるだけで機能することから、ポインティングオブジェクト移動後の操作工程が不要であり、特許文献１や特許文献２と比較して、ユーザーが機能を網羅しやすく、ポインティングオブジェクトの役割をユーザーが瞬時に理解または予測することができる。 By always displaying a pointing object that is easy to visually recognize on a touch panel, the present invention reduces the possibility that a user will miss an operation related to a help function, compared to Patent Document 3. Since it can be recognized, operational errors are less likely to occur. Furthermore, since the operation functions by the input means and the functions executable by the pointing object are completely separated, it is easy for the user to distinguish between the operation means. In addition, since the pointing object functions simply by overlapping it with the operation object, there is no need for an operation process after moving the pointing object, and compared to Patent Documents 1 and 2, it is easier for the user to cover the functions, and the pointing object Roles can be instantly understood or predicted by users.
　本技術の各実施形態及び各変形例について上に説明したが、本技術は上述の実施形態にのみ限定されるものではなく、本技術の要旨を逸脱しない範囲内において種々変更を加え得ることは勿論である。 Although each embodiment and each modification of the present technology has been described above, the present technology is not limited to the above-described embodiments, and various changes may be made within the scope of the gist of the present technology. Of course.

Claims (9)

  1. 　タッチパネルと、
    　　１以上の第１の項目をそれぞれ示す１以上の第１の操作オブジェクトを含む第１階層画面を前記タッチパネルに全画面表示し、ポインティングオブジェクトを前記１以上の第１の操作オブジェクトに重ならない位置である初期位置に表示し、
    　　前記ポインティングオブジェクトが入力手段によりドラッグ操作されると前記入力手段の移動に随伴して前記ポインティングオブジェクトを移動表示し、
    　　前記ポインティングオブジェクトがドラッグ操作されて１個の第１の操作オブジェクトの上に重ねて表示されている最中に、前記１個の第１の操作オブジェクトが示す前記第１の項目の下位の階層の追加情報を示す第２階層画面を、前記第１階層画面の前記１以上の第１の操作オブジェクトの少なくとも一部の上に重ねてポップアップ表示する
    　制御回路
    　を具備する電子機器。     touch panel and
    A first layer screen including one or more first operation objects each representing one or more first items is displayed on the touch panel in full screen, and the pointing object is positioned at a position that does not overlap the one or more first operation objects. display at a certain initial position,
    When the pointing object is dragged by an input means, the pointing object is moved and displayed in accordance with the movement of the input means,
    While the pointing object is being dragged and displayed over one of the first operation objects, a lower level hierarchy of the first item indicated by the one first operation object is displayed. An electronic device comprising: a control circuit that pops up and displays a second layer screen showing additional information over at least a portion of the one or more first operation objects on the first layer screen.
  2. 　請求項１に記載の電子機器であって、
    　前記制御回路は、前記ポインティングオブジェクトがドラッグ操作されることにより、前記ポインティングオブジェクトが重ねて表示される前記第１の操作オブジェクトが同一階層内で切り替わるとき、前記ポインティングオブジェクトを重ねて表示中の第１の操作オブジェクトが示す前記第１の項目の下位の階層の追加情報を示す第２階層画面のみをポップアップ表示するように、ポップアップ表示される第２階層画面を切り替える
    　電子機器。     The electronic device according to claim 1,
    The control circuit is configured to control, when the first operation object, on which the pointing object is displayed in an overlapping manner, is switched within the same hierarchy due to a dragging operation of the pointing object, the first operation object on which the pointing object is displayed in an overlapping manner is switched. An electronic device that switches a pop-up second-layer screen so that only a second-layer screen showing additional information in a hierarchy below the first item indicated by the operation object of is displayed as a pop-up.
  3. 　請求項１に記載の電子機器であって、
    　前記第２階層画面は、前記１個の第１の操作オブジェクトが示す前記第１の項目の下位の階層の項目である１以上の第２の項目をそれぞれ示す１以上の第２の操作オブジェクトを含む
    　電子機器。     The electronic device according to claim 1,
    The second layer screen displays one or more second operation objects each indicating one or more second items that are items in a lower layer than the first item indicated by the one first operation object. Including electronic equipment.
  4. 　請求項３に記載の電子機器であって、
    　前記制御回路は、前記ポインティングオブジェクトが前記１個の第１の操作オブジェクトの上に重ねて表示され、且つ、前記第２階層画面がポップアップ表示されている最中に、前記入力手段による前記ポインティングオブジェクトの操作が中断されたとき、前記１個の第１の操作オブジェクトの上に重ねられた前記ポインティングオブジェクトの表示及び前記第２階層画面のポップアップ表示を継続し、１個の第１の操作オブジェクトがタップ操作されると前記１個の第１の操作オブジェクトに対する入力が実行されたと判断する
    　電子機器。     The electronic device according to claim 3,
    The control circuit is configured to control the pointing object by the input means while the pointing object is displayed superimposed on the one first operation object and the second hierarchical screen is being displayed as a pop-up. When the operation is interrupted, the display of the pointing object superimposed on the one first operation object and the pop-up display of the second layer screen are continued, and the one first operation object is An electronic device that determines that an input to the one first operation object has been performed when a tap operation is performed.
  5. 　請求項３に記載の電子機器であって、
    　前記制御回路は、前記ポインティングオブジェクトがドラッグ操作されて１個の第１の操作オブジェクトの上に重ねて表示され、且つ、前記第２階層画面がポップアップ表示されている最中に、１個の第２の操作オブジェクトが示す前記第２の項目の下位の階層の追加情報を示す第３階層画面を、前記第２階層画面の前記１以上の第２の操作オブジェクトの少なくとも一部の上に重ねてポップアップ表示する
    　電子機器。     The electronic device according to claim 3,
    The control circuit is configured to control the pointing object when the pointing object is being dragged and displayed on top of the first operating object, and while the second hierarchical screen is being displayed as a pop-up, a third layer screen showing additional information in a lower layer of the second item indicated by the second operation object, overlapping at least a portion of the one or more second operation objects on the second layer screen; Pop up electronic devices.
  6. 　請求項１に記載の電子機器であって、
    　前記制御回路は、前記ポインティングオブジェクトがドラッグ操作されることにより、前記ポインティングオブジェクトが何れの第１の操作オブジェクトにも重ねて表示されなくなると、前記第２階層画面を非表示とする
    　電子機器。     The electronic device according to claim 1,
    The control circuit hides the second layer screen when the pointing object is no longer displayed over any first operation object due to a dragging operation of the pointing object.
  7. 　請求項１に記載の電子機器であって、
    　前記制御回路は、前記第１階層画面に含まれる１個の第１の操作オブジェクトが前記入力手段によりタップ操作されると、前記第１階層画面を非表示とし、前記１個の第１の操作オブジェクトが示す前記第１の項目の下位の階層の追加情報を示す第２階層画面を全画面表示し、前記ポインティングオブジェクトを前記初期位置に表示する
    　電子機器。     The electronic device according to claim 1,
    When one first operation object included in the first layer screen is tapped by the input means, the control circuit hides the first layer screen and performs the one first operation. An electronic device that displays, in full screen, a second layer screen showing additional information in a layer below the first item indicated by the object, and displays the pointing object at the initial position.
  8. 　請求項１に記載の電子機器であって、
    　前記制御回路は、前記第２階層画面を、前記ドラッグ操作の進行方向に対して、前記ポインティングオブジェクトの反対側にポップアップ表示する
    　電子機器。     The electronic device according to claim 1,
    The control circuit displays the second layer screen as a pop-up on the opposite side of the pointing object with respect to the advancing direction of the drag operation.
  9. 　タッチパネルを有する電子機器の制御方法であって、
    　　１以上の第１の項目をそれぞれ示す１以上の第１の操作オブジェクトを含む第１階層画面を前記タッチパネルに全画面表示し、ポインティングオブジェクトを前記１以上の第１の操作オブジェクトに重ならない位置である初期位置に表示し、
    　　前記ポインティングオブジェクトが入力手段によりドラッグ操作されると前記入力手段の移動に随伴して前記ポインティングオブジェクトを移動表示し、
    　　前記ポインティングオブジェクトがドラッグ操作されて１個の第１の操作オブジェクトの上に重ねて表示されている最中に、前記１個の第１の操作オブジェクトが示す前記第１の項目の下位の階層の追加情報を示す第２階層画面を、前記第１階層画面の前記１以上の第１の操作オブジェクトの少なくとも一部の上に重ねてポップアップ表示する
    　制御方法。     A method for controlling an electronic device having a touch panel, the method comprising:
    A first layer screen including one or more first operation objects each representing one or more first items is displayed on the touch panel in full screen, and the pointing object is positioned at a position that does not overlap the one or more first operation objects. display at a certain initial position,
    When the pointing object is dragged by an input means, the pointing object is moved and displayed in accordance with the movement of the input means,
    While the pointing object is being dragged and displayed over one of the first operation objects, a lower level hierarchy of the first item indicated by the one first operation object is displayed. A control method, wherein a second layer screen showing additional information is displayed as a pop-up superimposed on at least a portion of the one or more first operation objects on the first layer screen.
PCT/JP2023/022180 2022-06-23 2023-06-15 Electronic device and control method WO2023248912A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2022-100838 2022-06-23
JP2022100838 2022-06-23

Publications (1)

Publication Number Publication Date
WO2023248912A1 true WO2023248912A1 (en) 2023-12-28

Family

ID=89379901

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2023/022180 WO2023248912A1 (en) 2022-06-23 2023-06-15 Electronic device and control method

Country Status (1)

Country Link
WO (1) WO2023248912A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013093021A (en) * 2011-10-03 2013-05-16 Kyocera Corp Device, method, and program
WO2013094371A1 (en) * 2011-12-22 2013-06-27 ソニー株式会社 Display control device, display control method, and computer program
US20200057596A1 (en) * 2017-02-17 2020-02-20 Samsung Electronics Co., Ltd. Electronic device and method for sharing screen
JP2020197932A (en) * 2019-06-03 2020-12-10 三菱電機株式会社 Software operation support system
JP2022068749A (en) * 2020-10-22 2022-05-10 キヤノン株式会社 Electronic apparatus, control method thereof, program, and recording medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013093021A (en) * 2011-10-03 2013-05-16 Kyocera Corp Device, method, and program
WO2013094371A1 (en) * 2011-12-22 2013-06-27 ソニー株式会社 Display control device, display control method, and computer program
US20200057596A1 (en) * 2017-02-17 2020-02-20 Samsung Electronics Co., Ltd. Electronic device and method for sharing screen
JP2020197932A (en) * 2019-06-03 2020-12-10 三菱電機株式会社 Software operation support system
JP2022068749A (en) * 2020-10-22 2022-05-10 キヤノン株式会社 Electronic apparatus, control method thereof, program, and recording medium

Similar Documents

Publication Publication Date Title
JP7342208B2 (en) Image processing device, control method and program for the image processing device
JP6053332B2 (en) Information processing apparatus, information processing apparatus control method, and program
US10228843B2 (en) Image processing apparatus, method of controlling image processing apparatus, and recording medium
JP2018074364A (en) Information processing device, program, and storage medium
JP6840571B2 (en) Image processing device, control method of image processing device, and program
US20150277826A1 (en) Non-transitory storage medium storing instructions executable by device control apparatus, device control method, and device control apparatus
JP5370317B2 (en) Display control apparatus, image forming apparatus, and display control method for operation panel
JP5648405B2 (en) Image forming apparatus and computer program
JP6217576B2 (en) Image forming apparatus and screen operation method
JP5459177B2 (en) Image forming apparatus and computer program
JP5451290B2 (en) Information processing apparatus, information processing apparatus control method, and program
CN114063867A (en) Image processing apparatus, control method of image processing apparatus, and recording medium
JP5901514B2 (en) Electronic device and display program
JP2008129823A (en) Touch panel input device and image forming apparatus
WO2023248912A1 (en) Electronic device and control method
JP2014109833A (en) Contact operation processor, contact operation processing method, and program
JP6786199B2 (en) Print control device, control method of print control device, and printer driver program
JP6643405B2 (en) Image forming apparatus, method of controlling image forming apparatus, and computer program
JP2024001952A (en) Electronic apparatus and control method
JP6822063B2 (en) Programs and equipment
JP2024001953A (en) Electronic apparatus and control method
JP7156116B2 (en) Image forming apparatus, display method
JP6210664B2 (en) Information processing apparatus, control method therefor, program, and storage medium
JP6891248B2 (en) Image processing device, control method of image processing device, and computer program
JP6694540B2 (en) Print control device, print control device control method, and printer driver program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23827098

Country of ref document: EP

Kind code of ref document: A1