JP2014132472A - Device with image display function, display method for device with image display and computer-readable program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To avoid overlap between an image display region and a display object, and to prevent the missing of the image display region and viewing/listening interference by rearranging objects to be displayed at an operation unit.SOLUTION: An image display device having display means for displaying an image and a plurality of display objects includes: reception means for receiving image data corresponding to an image to be displayed at the display means; first determination means for determining the size of the image to be displayed at the display means on the basis of the image data received by the reception means; second determination means for determining the display object to be displayed at the display means with the image from among the plurality of display objects on the basis of the size of the image determined by the first determination means; and display control means for allowing the display means to display the display object determined by the second determination means with the image, and for not allowing the display means to display any display object other than the display object determined by the second determination means with the image.

Description

  The present invention relates to a device with an image display function having a function of displaying an image, a display method for the device with an image display, and a computer-readable program therefor.

  There are products with image display functions such as car navigation systems, mobile phones, and multifunction printers (hereinafter referred to as MFPs), apart from their original use. However, when viewing images on these models, there are many methods in which the entire screen display is switched to image display or the image display area is fixed to display a device operation input unit (hereinafter referred to as an operation unit). .

JP 2003-219308 A

  However, in a device such as an MFP, a layout change of the operation unit, an addition of display contents, or the like may occur due to addition of a function or occurrence of an error. In that case, the content additionally displayed on the image display area overlapped.

  Japanese Patent Application Laid-Open No. 2003-219308 is a prior art, but the effect is limited to the reduction of viewing disturbance because the object overlapping the image display area is made translucent. Even in view of the above, it is still not possible to prevent viewing disturbance of image display.

  In view of the problems of the prior art, the present invention rearranges objects to be displayed on the operation unit when displaying a video display area, avoids overlapping of the image display area and the display object, The purpose is to prevent viewing disturbance.

In order to solve the above problems, an image display device of the present invention provides
An image display device comprising display means for displaying an image and a plurality of display objects, the receiving means receiving image data corresponding to the image to be displayed on the display means, and the received by the receiving means Based on the image data, a first determining unit that determines the size of the image to be displayed on the display unit, and the plurality of display objects based on the size of the image determined by the first determining unit. Determining means for determining a display object to be displayed on the display means together with the image; and displaying the display object determined to be displayed on the display means together with the image by the second determining means on the display means together with the image; The display object determined to be displayed on the display unit together with the image by the second determination unit. Together with the image the display unit display objects and having a display control means that is not shown.

Furthermore, the control method of the image display apparatus of the present invention solves the above-described problem,
An image display apparatus control method comprising display means for displaying an image and a plurality of display objects, the method comprising: receiving image data corresponding to the image to be displayed on the display means; and the received image data And determining the size of the image to be displayed on the display means based on the image, and displaying the image on the display means together with the image from the plurality of display objects based on the determined size of the image. Determining a display object; displaying the determined display object together with the image on the display means; and not displaying a display object other than the determined display object together with the image on the display means; It is characterized by having.

  In the present invention, the following effects can be obtained by performing the above-described measures.

  1. By displaying an operation button or an object such as a display item together with the input image data, the operation unit can operate the device while viewing the image.

  2. The operation unit displays the image display area and an object such as an operation button or a display item together without overlapping, thereby preventing image display viewing interference.

Configuration example of device with image display function Example of standby device display and device display during image display Display priority of objects (buttons or display items) displayed on the device Main flowchart Example of operation when receiving image data Example of display operation Example of object relocation operation Example of device status display Example of display operation based on operation history information Example of reducing the image display area when displaying the device status An example of the operation to hide some objects when displaying the device status Example of display operation when adding a new function Example of displaying the image display area and device status in parallel Example of displaying device operation buttons and input image operation buttons Example of priority display of operation buttons by attribute

  Hereinafter, an example of a specific embodiment of the present invention will be described.

  FIG. 1 shows a configuration example of a device with an image display function in the present invention. Here, an example of a Multi Function Printer (multifunction printer, abbreviated as MFP) having a copy function and a print function will be described as a specific device. Here, a Multi Function Printer (multifunction printer, abbreviated as MFP) will be described, but the present invention is not limited to this. It may be a single-function printer device, a scanner device, a data transmission / reception device such as a facsimile, a mobile phone terminal, a video data display device, or the like. The description will be given according to the order of the assigned numbers in the figure.

  Reference numeral 101 denotes a device main body 101 in the present invention. In this embodiment, the operation will be described by taking an MFP as an example of a device.

  Reference numeral 102 denotes an operation input unit in the present invention.

  Reference numeral 105 denotes image data input to the device via the external interface 108. The image data in this case indicates a still image, a moving image, and TV video data, and the type of the image is not particularly limited.

  Reference numeral 108 denotes an external interface for communicating with the device and an external apparatus. This external interface may be either a wireless interface or a wired interface. More specifically, the external interface 108 is an interface for transmitting / receiving data including operation instructions, device status information, and images to / from an external device. The external interface 108 may include a function as a media slot or the like for the device to accept input of image data or the like.

  Reference numeral 109 denotes an audio output unit in the device. The audio output unit 109 outputs a description of the function of the device, a method of use, a state of the apparatus, audio information included in transmitted / received image data, and the like as audio or sound. Specifically, it is composed of a speaker, a known audio codec, and the like.

  Reference numeral 110 denotes a main bus. The main bus 110 is a data communication path for transmitting and receiving data within the device.

  Reference numeral 111 denotes an image data control unit in the device. The device detects pixel information, format, and the like of the image data received by the input, and performs control related to display (decoding of moving images, received images of TV images, etc.). Specifically, an image analysis module, a moving image code module, a TV image tuner, and the like are provided.

  Reference numeral 112 denotes a work memory for the image data control unit 111 to develop and manipulate image data. Specifically, it is composed of a RAM.

  Reference numeral 113 denotes an MFP control unit that controls the entire device. Specifically, a CPU, an image data control unit 111, and a work memory 112 are provided.

  Reference numeral 114 denotes a table indicating the display priority stored in the device. Specifically, when the image display area 202 is formed in the operation input unit 102 for the received image data, the display priority order of objects such as various buttons or display items is described. That is, the display priority order indicating whether each display object is displayed or not is described. Details will be described later with reference to FIG.

  Reference numeral 115 denotes an operation history information storage unit for storing an operation input history input via the operation input unit 101 and a reception history of instruction information received via the external interface 108.

  A program storage unit 116 stores a program executed by the MFP control unit 113.

  An image data storage unit 117 stores image data input from the external interface 108 and the scanner unit 118 and image data output to the printer unit 120.

  Reference numeral 118 denotes a storage unit. The storage unit 118 includes a display priority order table 114, an operation history information storage unit 115, a program storage unit 116, and an image data storage unit 117, and specifically includes a hard disk.

  Here, an example composed of a hard disk will be described, but the present invention is not limited to this. You may comprise by semiconductor memory, such as ROM and flash memory, removable memory, such as USB memory, the combination of a semiconductor memory and a hard disk.

  Reference numeral 119 denotes a scanner unit for reading an original, and 120 denotes a printer unit for printing image data.

  With reference to FIG. FIG. 2 shows a typical embodiment envisaged in the present invention.

  Reference numeral 201 denotes an operation screen displayed on the operation input unit 102. The operation screen 201 is composed of a touch panel type liquid crystal display and displays a plurality of display objects. The MFP control unit 113 is configured to control the device or display various objects indicating the state of the device so that the user can operate the displayed buttons and check the displayed items. Here, an example in which the operation screen 201 is configured by a touch panel type liquid crystal display will be described, but the present invention is not limited thereto. A display such as a liquid crystal display or CRT that is not a touch panel type may be used. In that case, a pointing device such as a mouse designates the displayed object. Reference numeral 202 denotes an image display area formed when image data is input to the device.

  Reference numeral 203 denotes a message display unit for displaying a message on the operation screen 201. The message display unit is a part for displaying the operation state of the device, paper setting information, various setting information, and the like.

  Reference numeral 204 denotes a button for selecting whether the scanner unit 119 reads a document as a color image or a monochrome image. Reference numeral 205 denotes a button for setting a mode for maintenance by the serviceman or the administrator of the device 102. Reference numeral 206 denotes a button for setting double-sided copying, stapling, bookbinding, reduced layout, and the like. Reference numeral 207 denotes a button for designating the resolution of the document read by the scanner unit 119. Reference numeral 208 denotes a button for making various settings by the user. Reference numeral 209 denotes a button for registering functions frequently used by the user. 210 is a redial button for redialing a telephone line. Reference numeral 211 denotes a copy key (copy button) for setting the operation mode of the device 103 to the copy mode. In the copy mode, the device 101 can perform various settings related to the copy function. Reference numeral 212 denotes a FAX button for setting the operation mode of the device 103 to the FAX mode. In the FAX mode, the device can make various settings related to the facsimile function. Reference numeral 213 denotes a Send button for setting the operation mode of the device 103 to the Send mode. In the Send mode, in the Send mode, the device can perform various settings for transmitting the image data read by the scanner unit 119 or the image data stored in the image data storage unit 117 to a predetermined destination. Reference numeral 214 denotes a Start key for instructing reading of a document. In addition, there are a “play button”, “fast forward button”, “rewind button” and the like (not shown) used when playing back video data. It also has a “channel button” used for watching television, a “volume button” (not shown) used for volume adjustment, and the like. Here, the buttons for instructing the operation have been described, but the buttons are not necessarily limited thereto. Display items representing date and time information, time information, and the state of the apparatus may be displayed as objects.

  The device body 102 receives the image data 105 and displays the image data 105 on the image data 105 operation input unit 102 based on the vertical and horizontal sizes of the received image data 105. The arrows in the figure indicate that the display form has changed from the state in which the message display unit 203 is displayed to the state in which the image display area 202 is formed. Specifically, when forming the image display area 202, the MFP control unit 113 secures the image display area 202 by causing the operation input unit 102 to hide display objects indicating some buttons. In this way, display objects indicating some buttons are hidden. However, even when the received image data is displayed, display objects such as the copy button 211, the FAX button 212, and the SEND button 213 are displayed. Thus, even when a certain user is viewing the received image / moving image, viewing of the image data is not disturbed. In addition, there is a remarkable effect that another user can use the functions of the device such as copy, FAX, and SEND. In addition, since buttons (or items) that are not often used are not displayed, there is a remarkable advantage that an area for displaying received image data can be enlarged.

  FIG. 3 shows an example of the table 114 indicating the display priority of objects (buttons or display items) to be displayed when the image data 105 is displayed on the operation input unit 102 in the present invention. The figure is described below.

301. Priority display object (button or display item)
This column indicates the priority of display for objects such as individual objects (buttons or display items) in the operation input unit 101 when the MFP control unit 113 forms the image display area 202. In the case of the present embodiment, it is indicated that a non-display state is preferentially started from an item with a low priority, that is, the smaller the number after the priority is, the more difficult it is to be hidden. Therefore, here, a high priority is set for a frequently used function (for example, an application setting function button). Thus, even when the received image is displayed, the user can always use frequently used functions. The registered object (button or display item) is made up of an object and an attribute. The object is actually a character / picture displayed on the operation unit. The attribute indicates a target on which the object acts. Reference numeral 308 indicates that the object on which the object operates is a device. Reference numeral 309 denotes that the object on which the object acts is audio data. 310 indicates that the object on which the object acts is image data such as video. As an example of the figure, the display item registered in the priority (1) has the item body “application setting” and the attribute “device”.

302. Required display object (button or display item)
This column indicates objects (buttons or display items) that are displayed side by side at the same time as the image display area 202 when the operation unit forms the image display area 202.

303. Hidden object (button or display item)
This field indicates objects (buttons or display items) that are not displayed on the operation input unit 101 when the operation input unit 102 forms the image display area 202.

304. Display position setting This item sets the display position of an object such as a button (item) on the operation input unit 112.

310a. Image Display The setting here is in which part on the operation input unit the image display area 202 is arranged. In this embodiment, it is “upper left end”. This indicates that the image display area 202 is arranged so as to be in contact with the upper left end of the operation input unit 102.

310b. Object (button or display item) display start position Here, when an object (button or display item) is rearranged, the display position of the object (button or display item) after the rearrangement is indicated.

305. Device Operation History Reference This field indicates that history information stored in the operation history information storage unit 115 is referred to when the operation input unit 102 forms the image display area 202. Based on the history information, the MFP control unit 113 determines an object (button or display item) to be displayed or hidden. Here, an n value is set as to whether or not the highest n frequently used items from the stored history information are to be displayed.

306. Priority display This field is a setting for determining a reference for selecting an object (button or display item) to be displayed when the operation input unit 102 rearranges the object (button or display item) with the formation of the image display area 202. It is.

  As a condition of the present embodiment, it is selectively set which object is displayed following the essential display object (button or display item). Specifically, the setting 311a for displaying the priority display object, the setting 311b for displaying the object having the same attribute, and the setting 311c for displaying the higher-level object in the history are selectively set. The specific meaning of each is as follows.

  311a. Priority display: The operation unit refers to the priority display object 301 and rearranges display objects (buttons or display items).

  311b. Attribute priority: The operation unit refers to the attributes of individual objects (buttons or display items) and preferentially displays objects whose attributes match those of the display objects 302 and 301 having a higher priority. The priority order within the same attribute refers to the priority order of the priority display object (button or display item) 301.

  Specifically, the objects are displayed in the order of essential display objects (buttons or display items) and priority display objects (buttons or display items).

  311c. History priority: The operation unit preferentially displays higher-order objects in the history information. For example, the operation unit rearranges objects (buttons or display items) to be displayed from a history of the number of operations of each button (or each item).

307. Settings for Displaying Device Status This field defines an operation when a window indicating the device status is displayed on the operation input unit 102 in a state where the image display area 202 is formed. It is set how to secure a window area indicating the state of the device.

  Here, the image display area 202 side is reduced, or some of the displayed objects (buttons or display items) in the operation input unit are further hidden. As a result, a window area indicating the state of the device can be secured.

  FIG. 4 shows a main flowchart in the present invention. This main flowchart is stored in the program storage unit 117. The MFP control unit 113 executes the flowchart shown in FIG. 4 according to the program stored in the program storage unit 117. The operation of the MFP control unit 113 will be described with reference to FIG.

  S 401 indicates that the device 101 has received the image data 105 through the external interface 108. When the image data is received, the MFP controller 113 proceeds to S402. In S402, the image data control unit 111 calculates the aspect ratio based on the vertical and horizontal resolutions and the vertical and horizontal pixel numbers of the image data input to the device. Thereby, the size of the image display area 202 is determined.

  As described above, the image data control unit 111 constituting the MFP control unit 113 functions as an image display area determination unit.

  In step S <b> 403, the MFP control unit 113 confirms the setting when the operation input unit 102 receives image data. Specifically, the display priority order table 114 described in FIG. 3 is checked. In addition to the table 114 indicating the display priority, a device display setting may be provided separately.

  As described above, the MFP control unit 113 functions as a display priority determination unit by referring to the display priority table 114 and operating according to the program stored in the program storage unit 116.

  In step S <b> 404, the MFP control unit 113 forms the image display area 202. The MFP control unit 113 forms the image display area 202 in the work memory 112 based on the size of the image display area 202 calculated in S402 and the setting value 310a confirmed in S403.

  In step S405, the MFP control unit 113 hides the corresponding object (button or display item) in the operation input unit 102 in accordance with the image display area 202 formed in step S404 and the display setting confirmed in step S403.

  In step S406, the MFP control unit 113 enlarges the image display area 202 within a range that does not overlap the various objects to be displayed (buttons or display items) displayed in step S405, and displays objects (buttons or display items) to be displayed. Rearrange. At this time, the MFP control unit 113 does not change the aspect ratio of the image display area 202. As a result, there is a remarkable merit that an image with little distortion of the image can be viewed even when I is scaled. Here, the image display area 202 is enlarged, but when the image data size to be displayed is large, the same size or reduction processing may be performed. As a result, the image display area 202 has a remarkable advantage that an area larger than the area of the message display unit 203 for confirming various settings and states of the MFP device can be secured. In addition, there is a significant advantage that an object (operation button or display object) can be arranged at a position suitable for a long horizontal image such as a high-definition broadcast whose horizontal to vertical ratio is 16: 9. Yes.

  As described above, the MFP control unit 113 functions as an arrangement unit by referring to the display priority order table 114 and operating according to the program stored in the program storage unit 116.

  In step S407, the MFP control unit 113 displays the input image data 105 in the image display area 202 enlarged in step S406.

  Here, the description has been given of the case where the MFP control unit 113 executes the flow of FIG. 4 in accordance with the program stored in the program storage unit 117, but the present invention is not limited to this. The operation input unit 102 may include a processor and a program storage unit for execution. FIG. 5 shows an example of the operation when the device receives image data in the present invention. In the present embodiment, S402 in FIG. 4 is described in detail. The program showing the flowchart of FIG. 5 is stored in the program storage unit 117. MFP control section 113 causes each section to execute the flowchart shown in FIG. 5 according to the program stored in program storage section 117. The figure is described below.

  S401 is equivalent to S401 of FIG.

  In step S501, the MFP control unit 113 causes the image control unit 111 to detect the format of image data received by the device. Specifically, it is determined whether the received multi-image data is a still image or a moving image, and the image data format, attribute, etc., such as the image data size and decoding format, are detected.

  In step S <b> 502, the MFP control unit 113 indicates to the image control unit 111 to detect the vertical and horizontal resolutions and the vertical and horizontal pixel numbers of the input image data 105.

  In step S <b> 503, the MFP control unit 113 detects that the image control unit 111 detects the aspect ratio based on the number of vertical and horizontal pixels of the received image data 105, the vertical and horizontal resolution, and the like.

  In step S <b> 504, the MFP control unit 113 holds the result detected by the image control unit 111 in steps S <b> 501 to S <b> 503 in the work memory 112.

In step S <b> 505, the MFP control unit 113 causes the image control unit 111 to derive the maximum size of the image display area 202 formed in the operation unit from the contents of the input data stored in the work memory 112. The reason for determining the maximum image display area 202 is that when the image display area 202 exceeding the number of pixels of the input image data 105 is formed, it is necessary to perform inter-pixel interpolation of the input image data 105 and display the input image. S403 because the quality at the time is lowered is equivalent to S403 in FIG.

  Although the MFP control unit 113 has executed the flow of FIG. 5 according to the program stored in the program storage unit 117, the present invention is not limited to this. The image control unit 111 may be configured to execute instead of the MFP control unit 113. The operation input unit 102 may include a processor, a program storage unit, an image data control unit, and the like, and may be executed by the operation input unit.

  FIG. 6 shows an example of the display operation of the operation input unit 102 in the present invention. In the present embodiment, S405 in FIG. 4 is described in detail. Here, the MFP control unit 113 executes the flow of FIG. 6 according to the program stored in the program storage unit 117. The figure is described below.

  S404 is equivalent to S404 of FIG.

  In step S601, the MFP control unit 113 confirms the setting of the display priority order table 114 illustrated in FIG. Specifically, information such as the priority display object 301, the essential display object 302, the non-display object 303, the display position setting 304, the operation history information 305, the priority display setting 306, and the device state display setting 307 are confirmed. In step S <b> 602, the MFP control unit 113 confirms an essential display object (button or display item) in the display priority order table 114.

  S603 is a control when there is a setting for an essential display object (button or display item) in S602. In this case, the MFP control unit 113 indicates that the mandatory display object (button or display item) registered in the display priority order table 114 is rearranged in the work memory 112.

  In step S <b> 604, the MFP control unit 113 confirms whether a non-display object (button or display item) in the display priority table 114 is set.

  S605 is control when there is a setting for a non-display object in S604. In this case, the MFP control unit indicates that the non-display object (button or display item) registered in the display priority order table 114 is hidden in the operation input unit 102.

  S606 indicates that the MFP control unit 113 rearranges the object (button or display item) registered in the priority display object (button or display item) in the display priority table 114 on the operation unit. .

Specifically, the rearrangement is performed at a location that does not overlap the virtual area on the work memory as the image display area 202. The virtual image display area 202 here is used to secure the image display area 202, and is a virtual area for confirming whether or not the image display area 202 can be formed.
S406 is equivalent to S406 of FIG.

  Here, the MFP management 113 selects display or non-display of the object according to the settings set in the fields 301, 302, and 303 of the display priority table 114. However, the present invention is not limited to this, and the MFP control unit 113 may select display / non-display of an object based on settings such as the operation history information 305, the priority display setting 306, and the device state display setting 307.

  Although the MFP control unit 113 has executed the flow of FIG. 6 according to the program stored in the program storage unit 117, the present invention is not limited to this. The operation input unit 102 may include a processor and a program storage unit for execution.

  FIG. 7 shows an example of the rearrangement operation of various objects (buttons or display items) in the present invention. Here, the MFP control unit 113 executes the flow of FIG. 7 according to the program stored in the program storage unit 117. The figure is described below. This drawing is a detailed view of the processing from S603 to S606 in FIG.

  In step S <b> 701, the MFP control unit 113 starts arrangement processing of an object (button or display item) in the operation screen 201 in order to form the image display area 202.

  In step S <b> 702, the MFP control unit 113 arranges the maximum virtual image display area 202 according to the display priority order table 114.

  In step S <b> 703, the MFP control unit 113 arranges one of the essential display objects (buttons or display items) in the display priority table based on the first arrangement start point 310 b set in the display priority table. Show.

  In step S <b> 704, the MFP control unit 113 determines whether the required display object (button or display item) that has already been arranged overlaps the virtual image display area 202.

  S705 is a motion when the essential display object (button or display item) and the virtual image display area 202 overlap in S704. In this case, the MFP control unit 113 indicates that the virtual image display area 202 is reduced to a size that does not overlap while maintaining the aspect ratio.

  In step S <b> 706, the MFP control unit 113 arranges an unplaced object in the display screen 201 among the essential display objects (buttons or display items) in the display priority order table 113.

  In step S <b> 707, the MFP control unit 113 determines whether the essential display object (button or display item) already arranged overlaps the virtual image display area 202.

  In step S <b> 708, the MFP control unit 113 confirms whether there is an unplaced object (button or display item) among the mandatory display objects (button or display item) in the display priority table 114. .

  S709 is an operation when there is no unplaced object (button or display item) in the mandatory display object (button or display item) in S708. Here, it is indicated that the MFP control unit 113 has confirmed the presence of an unplaced priority display object (button or display item) in the priority display object (button or display item) in the display priority table 114.

  S710 is an item when there is an unplaced object (button or display item) in the object (button or display item) to be preferentially displayed in S709. Of the objects (buttons or display items) to be displayed with priority in the display priority table, the remaining objects (buttons or display items) are arranged in the operation screen 201.

  In step S <b> 711, the MFP control unit 113 determines whether an object (button or display item) that has already been placed and displayed with priority overlaps the virtual image display area 202.

S712 is processing performed when the priority display object (button or display item) arranged immediately before in S711 overlaps the virtual image display area 202.
Here, it is indicated that the priority display object (button or display item) arranged immediately before the determination of S711 and overlapping the virtual image display area 202 is not displayed.

  S713 indicates that the rearrangement is finished.

  S <b> 714 is an operation when the mandatory display object (button or display item) rearranged by the MFP control unit 113 in S <b> 707 overlaps the virtual image display area 202.

  Here, it is shown that the image display area 202 is reduced to a position that does not overlap with the essential display item while maintaining the aspect ratio.

  In step S715, the MFP control unit 114 performs an operation in response to the image display area 202 being reduced in step S714. Specifically, the confirmation of whether or not the object (button or display item) to be displayed in a required position can be arranged at a diagonal position in the operation unit at the first arrangement start point set in the operation unit display priority order table 114 is shown. .

  In step S716, if the object (button or display item) that the MFP control unit 113 must display in step S715 can be arranged, the object (button or display item) is also displayed at the diagonal position in the operation unit at the first arrangement start point. ).

  When the essential display object and the image display area image display 202 overlap, there is a remarkable effect that the device can be operated without obstructing viewing of the image by reducing the image display area.

  On the other hand, when the priority display object overlaps with the image display area image display 202, a non-display object has a remarkable effect that the image display area is not reduced into a list and the viewing of the image is not hindered.

  Here, the priority display object has been described as a non-display object when it overlaps the image display area image display 202, but the present invention is not limited to this. The image display area image display 202 may be reduced within a range in which viewing of the image displayed in the image display area image display 202 does not become difficult.

  Here, the description has been given of the case where the MFP control unit 113 executes the flow of FIG. 7 according to the program stored in the program storage unit 117, but the present invention is not limited to this. The operation input unit 102 may include a processor and a program storage unit for execution.

  FIG. 8 shows an example of a device status display in the present invention. The figure is described below.

  Here, an example in which the MFP control unit 113 executes the flow of FIG. 8 according to a program stored in the program storage unit 117 will be described.

  Here, S801 indicates a case where a state abnormality has occurred in the device main body 101. As specific examples in the present embodiment, it is assumed that the paper is jammed in the MFP, the remaining amount of toner and ink is exhausted, and the like. When the MFP controller 113 detects an abnormality in the device 101, S802 indicates that it is confirmed whether or not the image display area 202 is currently formed.

  When the image display area is not formed, the process proceeds to S812.

  In S812, the device abnormality is displayed in the normal display area (message window 203).

  If an image display area is formed in S802, the process proceeds to S803.

  S803 indicates that the MFP control unit 113 confirms the display size of the area for displaying the device status.

  S804 indicates that the MFP control unit 113 confirms whether or not an area for displaying the device status can be secured in the current operation unit.

  If there is an area for displaying the device status in S804, an object for displaying the device status is displayed in the free space, and the process proceeds to S808.

  On the other hand, S805 is an operation in the case where there is no display space in the area for displaying the device status in S804. This indicates that the setting 307 regarding the display of the device status in the display priority table 114 is confirmed. In this case, as the embodiment of FIG. 2, the reduction of the image display area 202 is set.

  S806 indicates that the operation unit receives the confirmation result of S807, reduces the image display area 202 while maintaining the aspect ratio, and secures the device state display area.

  In step S807, the MFP control unit 113 forms an object (area) for displaying the device state in the space in the operation screen 201 generated by the operation in step S806, and displays the device state.

  S808 indicates that the MFP control unit 113 displays an object (area) for displaying the device state together with a method for canceling the abnormality of the device state.

  In step S809, the MFP control unit 113 periodically checks whether the device abnormal state has been canceled.

  In step S810, the MFP control unit 113 receives the confirmation result of canceling the abnormal state of the device in step S810, and hides the object for displaying the device state. That is, the object that displays the device status is not displayed. In this case, the MFP control unit 113 returns to the non-display area for displaying the device status and also returns to the display on the operation unit layout at the time of S801.

  Here, the example in which the image display area is reduced when there is no area for displaying the device state in S804 is not limited to this. In the setting 307 relating to the display of the device status, when the number of objects to be displayed is set to be reduced, the display may be changed to reduce the number of objects to be displayed without reducing the image display area.

  Here, a case has been described in which an object that displays a device state is hidden when a device abnormality is canceled, but the present invention is not limited to this. As shown in FIG. 13, even after the abnormality of the device is released, the object display for displaying the device state may be continued.

  Although the MFP control unit 113 has executed the flow of FIG. 8 according to the program stored in the program storage unit 117, the present invention is not limited to this. The operation input unit 102 may include a processor and a program storage unit for execution.

  FIG. 9 shows an example of display processing based on device operation history in the present invention. This embodiment is another embodiment of S405 in FIG. The figure is described below.

  Here, an example in which the MFP control unit 113 executes the flow of FIG. 9 according to a program stored in the program storage unit 117 will be described.

  S404 is equivalent to S404 of FIG.

  In step S <b> 901, the MFP control unit 113 confirms the setting of the device operation history reference field 305 in the display priority order table 114. When the setting of the operation history reference field 305 is confirmed, the MFP control unit 113 reads the operation history information stored in the operation history information storage unit 115.

  In S902, when the MFP control unit 113 confirms the device operation history information in S901, the top n most frequently operated operations in the operation history information are set as essential display objects (buttons or display items), and the subsequent items are displayed. Indicates classification into priority display items. Here, n may be registered in the storage unit 118 in advance, or the user may be able to set an arbitrary number.

  In step S903, the MFP control unit 113 hides an object that has not been selected as a display object in step S902. Specifically, the same operation as in FIG. 7 is performed.

  S406 is equivalent to S406 of FIG.

  Although the MFP control unit 113 has executed the flow of FIG. 8 according to the program stored in the program storage unit 117, the present invention is not limited to this. The operation input unit 102 may include a processor and a program storage unit for execution. FIG. 10 illustrates an example of an operation for reducing the image display area 202 when the device state is displayed. About this, it follows the operation | movement demonstrated in the flow of FIG.

  1000 conceptually indicates a state in which it is confirmed whether or not there is an area for displaying an object for displaying the device state (for example, an object displayed as “JAM generated!”) On the operation input unit 112. ing. Here, the MFP control unit 113 confirms whether a space for displaying an object for displaying the device status can be secured. Here, it can be seen that the image display area 202 overlaps the area for displaying the state of the device. As a result, the MFP controller 113 confirms that there is not enough space in the area for displaying the device status.

  Reference numeral 1001 indicates that the MFP control unit 113 has reduced the image display area 202 and thereby secured and displayed an area for displaying the device status.

  FIG. 11 illustrates an example of an operation for hiding some objects when displaying the state of a device. About this, it follows the operation | movement demonstrated in the flow of FIG.

  In the same way as 1000, 1100 is a state in which it is confirmed whether or not there is an area for displaying an object for displaying the device status on the operation input unit 102 (for example, an object displayed as “JAM generated!”) Is shown conceptually. This indicates that the MFP control unit 113 confirms a space for displaying an area for displaying the device status. Here, it can be seen that the operation buttons (“Send button, FAX button, COPY button, application setting button”) overlap the area for displaying the device status. As a result, the MFP control unit 113 confirms that the area for displaying the device status is insufficient.

  1101 indicates that the MFP control unit 113 hides the object (operation button or display item) and secures an area for displaying the state of the device.

  FIG. 12 illustrates an example of rearranging objects when a new function program is installed in the device and a new object is added to the operation input unit.

  1200 indicates that the MFP control unit 113 displays a display object (IC card function) regarding a function newly added to the device on the operation input unit 102. Here, since the image display area 202 of the operation input unit 102 overlaps with a display object related to the newly added function, the display object related to the newly added function is translucently displayed.

Reference numeral 1201 indicates that the MFP control unit 113 has expanded the image display area and rearranged the objects in order to display objects related to the newly added functions.
Here, the MFP control unit 113 executes an operation according to a program stored in the program storage unit 117.

  When a new function program (for example, an ID card application) is installed in the device, the MFP control unit 113 updates the display priority order table 114. An object indicating an ID card application is registered as an essential display object. When registered as an essential object, the MFP control unit 113 arranges each object and enlarges or reduces the image display area based on the relationship with other objects and the image display area (see FIGS. 6, 7, and 8). reference).

  Further, the processing from S801 to S807 may be read as follows and processed. That is, “Situation Abnormality in Device” in S801 in FIG. 8 is read as “Installing a new function program (for example, ID card application) in the device”. Further, the processing relating to “area for displaying the device status” from S802 to S807 is read as processing relating to “an object indicating a new function program (for example, an ID card application)”. At this time, since the installation of the new function program is irrelevant, the processing from S808 to S811 is not executed.

  FIG. 13 illustrates an example in which the image display area 202 and the device state are displayed in parallel. This indicates that, in the flow of FIG. 8, the device status display is set to be maintained even after the device abnormal state is canceled. Here, according to the program stored in the program storage unit 117, the MFP control unit 113 executes display processing so as to maintain the device status display even after the device abnormal state in FIG. Here, “COPY / A4 GREEN” indicates a state where there is no abnormality. FIG. 14 shows an example displayed together with a device operation button and input image data 105 operation button in the operation input unit 102. This is an example of the arrangement of objects generated by the flow of FIG. Here, operation buttons for moving images and audio data displayed in the image display area are also set in the priority display objects (buttons or display items) set in the display priority table 114. The “−Ch +” button represents a button for selecting a channel for terrestrial television or cable broadcasting. The “−Vo +” button is a button for selecting the volume of audio data output with a moving image. The MFP control unit 113 displays both operation objects related to the device (“COPY” button, “FAX” button, etc.) and operation objects related to the input image data 105 (“−Ch +” button, “−Vo +” button). . This makes it possible to use the device functions such as copy, FAX, and SEND without switching the operation screen even when an operation relating to viewing of received images is performed. Have FIG. 15 illustrates an example of priority display based on attributes of display objects (buttons or display items) in the operation unit. This shows an example of the operation when the display setting of the object (button or display item) displayed on the operation input unit 102 is set to display object attribute priority in the flow of FIG. 9. Here, objects (buttons or display items) related to sound and image data have priority over objects related to devices (COPY, Send, Fax, etc.).

  1500 indicates a normal standby state in which the MFP control unit 113 has not received image data.

  In 1501, an object (play / pause button) related to the image display area 202 is added as an essential display object (button or display item). As described above, here, when the received image data 105 is displayed on the operation input unit 102, an object (button or display item) to be “non-display” is defined, but the present invention is not limited to this. Instead of “non-display”, these objects may be defined as “reduced display” objects. In this case, the reduced objects are rearranged without disturbing the display of the image display area 202, the essential display object, and the priority display object. Specifically, in the flow from FIG. 4 to FIG. 9, the portion related to the process of hiding the object may be read as reduced display. Here, the MFP control unit 113 may execute the above processing according to a program stored in the program storage unit 117. Not limited to this, the operation input unit 102 may include a processor and a program storage unit to execute the above processing.

  Although not particularly illustrated, information for managing a program group stored in the storage medium, for example, version information, creator, etc. is also stored, and information depending on the OS on the program reading side, for example, a program is identified and displayed. Icons may also be stored.

  Further, data depending on various programs is also managed in the directory. In addition, a program for installing various programs in the computer, and a program for decompressing when the program to be installed is compressed may be stored.

  The functions in this embodiment may be performed by a host computer by a program installed from the outside. In this case, the present invention is applied even when an information group including a program is supplied to the output device from a storage medium such as a CD-ROM, a flash memory, or an FD, or from an external storage medium via a network. Is.

  As described above, the object of the present invention can also be achieved by supplying to the apparatus a storage medium that records software program codes that implement the functions of the above-described embodiments.

  In that case, the computer (CPU or MPU) of the apparatus reads and executes the program code recorded in the supplied storage medium.

  In this case, the program code itself read from the storage medium realizes the novel function of the present invention, and the storage medium storing the program code constitutes the present invention.

  As a storage medium for supplying the program code, for example, floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, magnetic tape, nonvolatile memory card, ROM, EEPROM, etc. Can be used.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) or the like running on the computer based on the instruction of the program code. It goes without saying that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.

  Further, after the program code read from the storage medium is written to a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. It goes without saying that the case where the CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

101 Device body 101
102 Operation input unit 111 Image data control unit 112 Work memory 113 MFP control unit 114 that controls the entire device 114 Table indicating display priority stored in the device 115 Operation history information storage unit 116 A program storage unit 117 that stores a program to be executed by the MFP control unit 113 117 an external interface 108 a scanner unit. An image data storage unit 118 that stores image data input from 118 and image data output to the printer unit 120. The storage unit 118 includes a display priority table 114, an operation history information storage unit 115, a program storage unit 116, and an image data storage unit 117. 119 A scanner unit for reading a document. 120 A printer unit for printing image data.

Claims (9)

An image display device comprising display means for displaying an image and a plurality of display objects,
Receiving means for receiving image data corresponding to the image to be displayed on the display means;
First determining means for determining a size of the image to be displayed on the display means based on the image data received by the receiving means;
Second determining means for determining a display object to be displayed on the display means together with the image from the plurality of display objects based on the size of the image determined by the first determining means;
The display object determined to be displayed on the display unit together with the image by the second determination unit is displayed on the display unit together with the image, and is determined to be displayed on the display unit together with the image by the second determination unit. An image display apparatus comprising: a display control unit that does not display a display object other than the display object together with the image on the display unit.   The display control means displays the image on the display means so that the image does not overlap the display object determined to be displayed on the display means by the second determination means. The image display device described in 1.   The image display apparatus according to claim 1, wherein any one of the plurality of display objects is a display object for performing an operation related to the image display apparatus.   4. The image display apparatus according to claim 1, wherein any one of the plurality of display objects is a display object for performing an operation related to the image. 5.   5. The image display apparatus according to claim 1, wherein any one of the plurality of display objects is a display screen indicating a state of the image display apparatus.   The display area of the image is determined based on at least one of an aspect ratio, a pixel number, and a resolution of an image to be displayed on the display unit. The image display device described. The image display device can execute at least one of a copy function and a print function,
The image display apparatus according to claim 1, wherein the plurality of display objects are operation keys for performing an operation related to at least one of the copy function and the print function. A control method for an image display device comprising display means for displaying an image and a plurality of display objects,
Receiving image data corresponding to the image to be displayed on the display means;
Determining the size of the image to be displayed on the display means based on the received image data;
Determining a display object to be displayed on the display unit together with the image from the plurality of display objects based on the determined size of the image;
And displaying the determined display object together with the image on the display means, but not displaying the display object other than the determined display object together with the image on the display means. Display device control method.   A computer-readable program for causing a computer to execute the control method of the image display device according to claim 8.

Images