JP2008180833A - Operation display device, operation display program and electronic equipment - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an operation display device capable of easily transitionally displaying a function setting screen for setting a desired function and providing improved work efficiency, and electronic equipment and an operation display program. <P>SOLUTION: The operation display device is equipped with: a panel control part 20 to changeably display a plurality of functional items over a plurality of pages on a display panel part 10; a character input part to character-input the name of the functional item in a keyword display part provided on the display panel part 10; a storage part 15 to store the keywords corresponding to the plurality of functional items which can be displayed on the display panel part 10; a retrieval processing part 24 to compare the name of the functional item input by the character input part with the keyword stored in the storage part 15 to thereby prioritize and select an identical or similar function; and a system control part 20 to control the function of a device main body in accordance with the setting of the function after transitionally displaying the display state of the display panel part 10 on the function setting screen. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an operation display device, an operation display program, and an electronic apparatus that enable function setting using a display panel unit.

  2. Description of the Related Art Conventionally, when operating various electronic devices, it is well known to set the device main body function using a touch panel function of a display panel unit.

  At this time, when a function such as a plurality of modes is provided, the display on the display panel is divided and displayed in a tab format, and a plurality of function item names corresponding to the device main body functions are displayed for each tab. Generally, setting of each function can be changed by selecting a function item using a touch panel function.

  For example, in the field of image forming apparatuses as electronic devices, for example, as shown in FIG. 7, a function setting screen in which function items are divided by a plurality of tabs 31 to 35 is displayed on a display panel unit 10 having a touch panel function. It is displayed so that it can be switched and displayed by selecting 31 to 35, and a basic screen in which the basic tab 31 is selected is displayed on a general initial screen (when starting up).

  Here, when it is desired to display a function item list for performing function setting, the function setting tab 34 is selected by using the touch panel function of the display panel unit 10 to display the function setting screen. Thereafter, a function setting screen for a desired function item can be displayed by selecting a desired function switch from the function setting screen.

  At this time, for example, when it is desired to use the “recopy” mode, the mode selection switch group (16 items of 4 × 4 in the figure) displayed on the first page of the display panel unit 10 corresponds to the recopy mode. Since the mode selection switch does not exist, after selecting the next screen key 40 to display the next screen, the “recopy” mode is selected as a key, and the function setting screen for the “recopy” mode is displayed on the display panel section. 10 is displayed.

  Further, when operating such various electronic devices, those using voice are known for the purpose of improving operability such as hands-free and understanding of operation contents. In addition, as an electronic device using such a voice, one that guides an operation by voice guidance (for example, see Patent Document 1) or one that can be operated by voice input (for example, see Patent Documents 2 and 3). ).

  At this time, the purpose of guiding the operation by voice guidance is to improve the operability when the function items are complicated, such as an image forming apparatus or a vehicle navigation system.

  For example, whether or not the operator of the device is at a loss is measured by measuring the time from the first key input, and when a predetermined time has passed, it is determined that the operator is at a loss and voice guidance is started. In addition, a voice guidance ON / OFF key for starting voice guidance from the beginning for the visually impaired operator is provided (see Patent Document 1).

  On the other hand, for enabling operation by voice input, as a word for instructing operation of the navigation device, for example, a word indicating a display position such as “destination”, “departure point”, “route point”, “home”, etc. , "Now what time" "Now where" "Speed" "List" (command to display a list of recognizable commands on display) The phoneme model to be stored is stored, and the navigation operation is performed by inputting these words by voice (see Patent Document 2).

  For example, when a user sitting in a driver's seat of a car starts voice input to a microphone and inputs “home”, which is a “destination”, the processing means of the navigation device is changed from the voice recognition device. The voice is analyzed, and a map around the home is displayed on the display device. As a result, the user can confirm that he / she has recognized his / her home as the destination, and when the user continues to input “to there”, the above-mentioned “home” is set as the destination and the navigation (guidance) ).

  Similarly, a device that can be operated by voice input includes a recognition dictionary to which a hierarchical dictionary structure is applied, and is displayed in the voice input window using the hierarchical recognition dictionary. The destinations are narrowed down hierarchically based on the utterance screen guidance (see Patent Document 3).

  For example, when a police signature having jurisdiction over the destination is uttered to a microphone, the voice input to the microphone is converted into a digital voice signal, and a phonological feature (for example, a cepstrum coefficient) is converted by a voice recognition unit. After extracting and converting a speech signal into a speech label by a composite similarity method or the like based on the extraction result, the retrieval item registered in the recognition dictionary by the discrete hidden Markov model (HMM) method or the like is extracted. By collating with the model for each word shown, the speech recognition results (recognition candidates) from the word with the highest similarity to the fifth place are displayed, and the destinations are narrowed down hierarchically below.

  On the other hand, for example, in an image forming apparatus such as a printer or a copying machine, the function items to be set are increasing as the number of functions increases.

  In other words, there are discharge bins and cassette settings in addition to the general print mode function items such as specifying the document size and paper size, setting the number of copies (printing), single-sided / double-sided, etc. In the case of a multifunction device equipped with a printer function, copying function, FAX function, scanner function, etc., there are function items corresponding to functions for each function (for example, setting of data transmission destination information in the FAX function). The number of items is even more diverse.

  However, many steps are required for the operator to transition to a function setting screen that allows a desired operation while referring to the panel display of the liquid crystal touch panel.

  For this reason, if the setting operation is performed while listening to the voice guidance described above, the operation is performed after listening to the voice, and setting with complicated processes is difficult. In addition, cassette settings and display language settings that are not frequently used take time to display the desired function setting screen even though the function items to be set, that is, the keywords are known. Increased complexity.

Further, in the above-described hierarchically inputting function items by voice, the liquid crystal touch panel for performing both display and operation as in the image forming apparatus tends to be miniaturized, so that all the function items are displayed on the display panel. It is difficult to display the same part on one screen, and it is necessary to make the layer division more detailed across multiple pages.
JP 2003-122199 A JP-A-11-142165 Japanese Patent Laid-Open No. 10-021254

  However, when the display panel unit 10 having a small display area is employed as in the above-described image forming apparatus, selection cannot be made unless the function item is shifted to the next screen, as in the above-described “recopy” mode. The work was inefficient.

  Further, even if such an operation is set to be performed by voice input, it is only a difference in whether or not the touch panel function of the display panel unit 10 is used only by hierarchically inputting function items. The number of steps is substantially the same, and the complexity of the setting operation cannot be eliminated.

  Therefore, the purpose of voice guidance and voice input is to allow voice input to perform the same operation as manual input regardless of which method is used. In order to select a desired function item from a large number of function items that cannot be displayed on the screen, it is necessary to set the selection of the function item in stages, and depending on the function item when selecting the desired function item It was necessary to perform the next screen (next page) operation, etc., and the problem that the operation was troublesome could not be solved.

  Therefore, in consideration of the above circumstances, the present invention provides an operation display device, an operation display program, and an image forming apparatus that can easily display a desired function setting screen and can improve workability. With the goal.

  The operation display device of the present invention includes a panel control unit that causes a display panel unit to display a plurality of function items across a plurality of pages in a switchable display, and a function item name to be displayed on the keyword display unit provided in the display panel unit. A character input unit to be input; a storage unit storing keywords corresponding to a plurality of function items that can be displayed on the display panel unit; a function item name input through the character input unit; and a keyword stored in the storage unit If there is a search processing unit that prioritizes and selects a matching or similar function, and the search processing unit has a matching or similar function, the display state of the display panel unit is set as its function And a system control unit that controls the device main body function in accordance with the function setting after the transition display on the screen.

  In this case, the character input unit includes a voice input unit, and a voice recognition unit that recognizes the voice input to the voice input unit and displays the identification result on the keyword display unit. And

  In addition, the present invention can be an electronic apparatus that employs an operation display device having any one of the above-described configurations and an operation unit that executes an apparatus main body function set by using the operation display device.

  In addition, the operation display program of the present invention includes a display step of displaying a plurality of function items in a display panel unit having a keyword display unit so that a plurality of function items can be switched and displayed across a plurality of pages, and the keyword input by the user is displayed. When there is a keyword display step to be displayed on the panel, a search step to search whether there is a function setting screen corresponding to the keyword confirmed by the user, and a function setting screen corresponding to the confirmed keyword And a function setting screen display step for displaying the function setting screen on a computer.

  According to the operation display device, the electronic apparatus, and the operation display program of the present invention, it is possible to easily display the function setting screen for setting a desired function, thereby improving workability.

  Next, an operation display device according to an embodiment of the present invention is applied to an image forming apparatus and will be described with reference to the drawings.

  FIG. 1 is a perspective view of an image forming apparatus as an electronic apparatus including an operation display device according to an embodiment of the present invention, FIG. 2 is a block explanatory diagram of the operation display device according to an embodiment of the present invention, and FIG. FIG. 4 is an explanatory diagram of a transition display example of the operation display device according to the embodiment of the present invention, and FIG. 4 is a flowchart of the operation display device according to the embodiment of the present invention.

  As shown in FIG. 1, an image forming apparatus 1 as an electronic apparatus including an operation display device according to an embodiment of the present invention includes a plurality of stages of paper tray units 3, 4, 4 that can be pulled out from the front surface of the apparatus body 2. 5, 6, a manual paper tray 7 that can be opened and closed from one side of the apparatus body 2, a paper discharge tray 8 that protrudes from the other side of the apparatus body 2, and a copy machine, a facsimile machine, and a scanner when reading a document. An automatic document feeder (ADF) 9, a display panel unit 10 having a touch panel function, and a button switch type operation unit 11 for setting and selecting various functions in combination with the touch panel function of the display panel unit 10. And.

  As shown in FIG. 2, the image forming apparatus 1 is input from a panel control unit 20 that controls the display state of the display panel unit 10, a voice input unit 21 such as a microphone, and a voice input unit 21. A voice recognition unit 22 for recognizing the voice converted into a voice signal such as a digital signal, a storage unit (ROM) 23 storing at least keywords corresponding to a plurality of function items that can be displayed on the display panel unit 10, and a panel A search processing unit 24 that controls the control unit 12 and recognizes the speech signal recognized by the speech recognition unit 22 and the keyword stored in the storage unit 15 to prioritize and select a matching or similar function; A system control unit 25 that performs bridging control such as setting for the entire system of the apparatus 1 and a personal computer (not shown) connected to the image forming apparatus 1 via a network. The data receiving unit 26 that receives the print command data transmitted from the above, the scanner unit 27 that reads the document using the ADF 9 and generates image data based on the read document image, and the system control unit 25 A drawing processing unit 28 that generates bitmap data based on print command data received by the data receiving unit 26 or image data generated by the scanner unit 27 according to the bridge-controlled setting, and a drawing processing unit 28 that generates the bitmap data. And a printing unit 29 that performs image forming processing on a transport sheet fed from the paper tray units 3 to 6 and the like based on the bitmap data. The drawing processing unit 28 and the printing unit 29 are an operation unit 30 that executes a function set using the operation display device of the present invention.

  In this case, the discharge tray 8 is displaceable in the vertical and horizontal directions, so that when conveying sheets (copied paper) are stacked, the discharge tray 8 is displaced in the vertical direction according to the stacking amount, and is stacked when the sort function or the like is used. It is displaced left and right so that the transported sheets can be sorted. The displacement of the paper discharge tray 8 is known. Further, the paper discharge tray 8 is provided with a known sensor for detecting the presence or absence of the stacked conveyance sheets.

  The ADF 9 is provided with a known sensor or the like for automatically detecting the presence and size of the set original as well as a reading original. The ADF 9 is provided with a known detection sensor for collecting the originals after reading and detecting the presence or absence of the accumulated originals.

  In the display panel 10, as shown in FIG. 3, the function setting screen is divided by a plurality of tabs 31 to 35, and the main display state in which the basic setting tab 31 is selected at all times (including when the power is turned on). It has become. When the basic setting tab 31 is selected, a voice input key 36 for starting a voice input mode using the voice input unit 21 is displayed. Further, a keyword display section 37, a search key 38, and a redo key 39 that are displayed regardless of the selection of the tabs 31 to 35 are displayed above the display panel 10.

  The panel control unit 20 divides the display panel unit 10 into a plurality of tab methods to display a plurality of function setting screens, and switches and displays function items that cannot be displayed in one tab after the next page of the same tab. In addition, the function setting screen corresponding to the function item selected using the touch panel function is switched and displayed.

  The storage unit 23 stores keywords corresponding to a plurality of function items that can be displayed on the display panel unit 10 described above in association with each other, and general functions (printer function, copy function, facsimile function, Stores setting / control commands related to the scanner function.

  At this time, as keywords, the settings present in the various function setting screens displayed on the tabs 31 to 35 of the display panel unit 10 (including the subsequent pages that are not displayed in one screen of the tabs 31 to 35). Possible function items and keywords similar to the function items are set in advance and stored in the storage unit 23.

  The voice signal input from the voice input unit 21 is converted into text data by the voice recognition unit 22 and collated with the keyword associated with each function setting screen by the search processing unit 24, thereby corresponding function setting. Search the screen. If the search is hit (or similar), the panel control unit 20 causes the function setting screen associated with the keyword to be transitionally displayed on the panel display unit 10.

  These control commands excluding keywords are stored in a hard disk or RAM that temporarily stores the image data received by the data receiving unit 26 and the scanner unit 27 and the setting conditions set in the display panel unit 10. Also good.

  The system control unit 25 uses the touch panel function of the display panel unit 10 to select or select the function setting screen selected using the selection function of the search processing unit 16 and then displays the touch panel function of the display panel unit 10. The copying function and the like of the apparatus main body 2 are controlled by combining the function set using the function and the function set using the voice input.

  Next, a case where sound is used when setting functions of the image forming apparatus 1 of the present invention will be described with reference to FIGS.

(Step S1)
In step S1, the panel control unit 20 determines whether or not the voice input key 36 has been pressed to perform function setting by voice input in the main display state corresponding to the upper diagram of FIG. If the key is pressed, the process proceeds to step S2. If the voice input key 36 is not pressed, the function setting by voice input is in a standby state.

(Step S2)
In step S2, a keyword is input by the user's voice input, and the process proceeds to step S3. In step S2, the panel control unit 20 waits until a voice input is made, but when a predetermined time has elapsed using a timer function or the like in the energy saving mode, the process loops to step S1.

(Step S3)
In step S3, the voice input keyword is signal-processed by the voice identification unit 22 to be converted into text data, the text characters are displayed on the keyword display unit 37 (see the middle diagram of FIG. 3), and the process proceeds to step S4.

(Step S4)
In step S4, the user confirms whether the text characters displayed on the keyword display unit 37 match the desired function item name, and then the function item name displayed on the keyword display unit 37 by the user. If the keyword display unit 37 has been pressed because it is correct, the panel control unit 20 determines whether the keyword display unit 37 has been pressed. If the keyword display unit 37 has been pressed, the process proceeds to step S5 and is displayed on the keyword display unit 37 by the user. If the redo key 39 is pressed because the function item name is incorrect, the process loops to step S1.

  At this time, if it is desired to display similar function item names of next candidates, the function item names are displayed in the keyword display unit 37 in the order in which the function item names are prioritized each time the search key 38 is pressed. If the keyword display unit 37 is pressed when the function item name is displayed, the process proceeds to step S5, and when the search key 38 is pressed and the next candidate is exhausted, the process loops to step S1.

(Step S5)
In step S5, a function setting screen corresponding to the function item name determined to be correct by the user (or a function item name directly inputted with characters) is searched with reference to the keyword stored in the ROM 23, and the process proceeds to step S6. Transition.

(Step S6)
In step S6, the confirmed keyword and the keyword stored in the storage unit 15 are compared by the search processing unit 24. If they match, the process proceeds to step S7, and if they do not match, the process proceeds to step S8. .

(Step S7)
In step S7, the matched function setting screen is displayed on the panel display unit 10 by the panel control unit 20 (see the lower diagram in FIG. 3), and thereafter function settings using the touch panel function and the like of the panel display unit 10 are accepted.

(Step S8)
In step S8, since there is no matching function setting screen, the panel control unit 20 causes the panel display unit 10 to display an error, and then loops to step S1.

  By the way, in the above-described embodiment, the keyword input by the user is converted into text and displayed on the keyword display unit 37. When the keyword is a desired keyword, the presence / absence of a function setting screen actually corresponding to the keyword is determined. Although the confirmation routine has been described, the presence / absence of the function setting screen may be confirmed directly from the keyword input by the user.

  Hereinafter, the routine will be described with reference to FIG.

(Step S11)
In step S11, the panel control unit 20 determines whether or not the voice input key 36 has been pressed to perform function setting by voice input in the main display state corresponding to the upper diagram of FIG. If the key is pressed, the process proceeds to step S12. If the voice input key 36 is not pressed, the function setting by voice input is in a standby state.

(Step S12)
In step S12, a keyword is input by the user's voice input, and the process proceeds to step S13. In step S12, the panel control unit 20 stands by until a voice input is made, but when a predetermined time has elapsed using the timer function or the like in the energy saving mode, the process loops to step S11.

(Step S13)
In step S13, after the voice input keyword is signal-processed by the voice identification unit 22, the keyword and the keyword stored in the storage unit 15 are compared to determine whether there is a matching or similar keyword. If there is a matching or similar keyword, the process proceeds to step S14. If no matching or similar keyword exists, the process proceeds to step S15.

(Step S14)
In step S14, priorities are given to matching or similar keywords, the highest priority keyword is displayed on the keyword display section 37 (see the middle diagram of FIG. 3), and the process proceeds to step S16.

(Step S15)
In step S15, since there is no matching or similar keyword, the panel control unit 20 causes the panel display unit 10 to display an error, and then loops to step S12 to prompt the user to input voice again. .

(Step S16)
In step S16, it is confirmed whether or not the keyword displayed on the keyword display unit 37 matches the desired function item by the user, and the keyword displayed on the keyword display unit 37 by the user is correct. Whether or not the keyword display unit 37 has been pressed is determined by the panel control unit 20, and if the keyword display unit 37 has been pressed, the process proceeds to step S17, and the function displayed on the keyword display unit 37 by the user. If the redo key 39 is pressed because the item is not a keyword corresponding to the desired function item, the process loops to step S11 (or step S12).

  At this time, if it is desired to display the function item name of a similar next candidate, the function item name is displayed on the keyword display unit 37 each time the search key 38 is pressed, and the correct function item name is displayed on the keyword display unit 37. If the keyword display section 37 is pressed at the time point, the process proceeds to step S15. When the search key 38 is pressed and the next candidate is exhausted, the process loops to step S11.

(Step S17)
In step S <b> 17, the matched function setting screen is displayed on the panel display unit 10 by the panel control unit 20, and thereafter function setting using the touch panel function or the like of the panel display unit 10 is accepted.

  By the way, when the keyword is in the lower layer after the second layer of the function setting screen, as shown in FIG. 6, it is possible to perform stepwise transition display, direct transition display by keyword input, or default transition display. be able to.

  For example, if “aggregation” is present in the same layer as the above-mentioned “recopy”, “aggregation” is displayed on the keyword display section 37 when the user inputs “aggregation” by voice input (two levels in FIG. 6). After “aggregation” is confirmed on the keyword display unit 37 and the aggregation setting screen is displayed (see the third row in FIG. 6), “4 in 1” by the touch panel function of the panel display unit 10 or voice input is displayed. It is possible to display the setting screen of “4 in 1” (see the fourth row in FIG. 6) by inputting the voice.

  Note that when performing aggregation setting on the aggregation setting screen shown in the third row of FIG. 6, there are three types of keywords that can be input by voice: “no setting”, “2 in 1”, and “4 in 1”. When “4 in 1” is input, the “4 in 1” setting screen shown in the fourth row of FIG. 6 is displayed, and the keyword determination operation using the keyword display unit 37 can be omitted.

  It is also possible to display a setting screen of “4 in 1” by default (see the fourth row in FIG. 6) when the user inputs “consolidation” by voice.

  Further, when the user omits the “aggregate” voice input and inputs “4 in 1”, the user is determined to display “4 in 1” when the display on the second-level keyword display section 37 in FIG. It is also possible to display the setting screen (see the fourth row in FIG. 6).

  As described above, in the display operation device of the present invention, the function setting screen desired by the operator can be immediately displayed on the display panel unit 10 and the transition-displayed function setting screen is The user may perform setting by input using the touch panel function of the display panel unit 10, or may be set by key input or voice input using voice guidance corresponding to the function setting screen.

  Accordingly, the operation of switching tabs 31 to 35 for displaying a list, searching for a desired setting item from each of tabs 31 to 35, and the like can be omitted by calling a key by voice input. It becomes possible to realize simplification of the above.

  At this time, if the keyword at the time of voice input is wrong or ambiguous, a desired setting item can be easily searched by prioritizing and displaying a plurality of similar keywords on the keyword display unit 37. . The keyword may be a character input using the operation unit 11 in addition to the voice.

  In the above embodiment, the operation display device of the present invention is applied to the image forming apparatus 1. However, for example, the operation display device is applied to all electronic devices that execute an operation changing to the operation unit 30 using a function setting screen. In particular, the present invention is useful for an electronic device in which a full keyboard or the like for facilitating character input is not provided for making the apparatus main body compact.

1 is a perspective view of an image forming apparatus as an electronic apparatus including an operation display device according to an embodiment of the present invention. It is block explanatory drawing of the operation display apparatus which concerns on one Embodiment of this invention. It is explanatory drawing of the example of a transition display of the operation display apparatus which concerns on one Embodiment of this invention. It is a flowchart of the operation display apparatus which concerns on one Embodiment of this invention. It is another flowchart of the operation display apparatus which concerns on one Embodiment of this invention. It is explanatory drawing of the other transition display example of the operation display apparatus which concerns on one Embodiment of this invention. It is explanatory drawing of the example of a transition display of the conventional operation display apparatus.

Explanation of symbols

10 ... Display panel section (character input section)
11 ... operation part (character input part)
20 ... Panel control unit 21 ... Voice input unit (character input unit)
22 ... Voice recognition unit (character input unit)
23. Storage unit (ROM)
24 ... Search processing unit 25 ... System control unit

Claims (4)

  A panel control unit that displays a plurality of function items on a display panel unit across a plurality of pages so that the display can be switched, a character input unit that inputs a function item name on a keyword display unit provided in the display panel unit, and A storage unit storing keywords corresponding to a plurality of function items that can be displayed on the display panel unit, and a function item name input in the character input unit and a keyword stored in the storage unit are compared and matched or similar If there is a search processing unit that prioritizes and selects functions to be selected, and a function that matches or is similar in the search processing unit, the display state of the display panel unit is displayed on the function setting screen. An operation display device comprising: a system control unit that controls an apparatus main body function according to the function setting.   The character input unit includes a voice input unit, and a voice recognition unit that recognizes a voice input to the voice input unit and displays the identification result on the keyword display unit. Item 4. The operation display device according to Item 1.   An electronic apparatus comprising: the operation display device according to claim 1 or 2; and an operation unit that executes an apparatus main body function set by using the operation display device.   A display step of displaying a plurality of function items across a plurality of pages on a display panel unit having a keyword display unit so that the display can be switched, a keyword display step of displaying a keyword input by a user on the display panel unit, A search step that searches whether there is a function setting screen corresponding to the keyword determined by the user, and a function setting that displays the function setting screen when there is a function setting screen corresponding to the confirmed keyword An operation display program for causing a computer to execute a screen display step.

Images