JP2013206226A - Display device, display control method and display control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce power consumption, and simplify an operation.SOLUTION: An MFP (MultiFunction Peripheral) includes: a liquid crystal display device including a backlight capable of partially lighting; a touch panel disposed so as to be superimposed on a display screen of the liquid crystal display device for detecting a position instructed by a user on the display screen; and a CPU for controlling the liquid crystal display device and the touch panel. The CPU includes: a valid section determination unit 57 for determining a valid section in the screen displayed at the liquid crystal display device; a valid section lighting unit 61 for lighting the determined valid section of the backlight; a prediction section determination unit 59 for determining an area to be occupied by the valid section after the lapse of a predetermined time as a prediction section on the basis of the temporary change of the position detected by the touch panel; and a prediction section lighting unit 65 for lighting the prediction section of the backlight while the operation is detected.

Description

  The present invention relates to a display device, a display control method, and a display control program, and more particularly to a display device including a liquid crystal display device with a backlight, a display control method and a display control program executed by the display device.

  2. Description of the Related Art In recent years, an image forming apparatus typified by a multifunction peripheral (MFP) includes a liquid crystal display device with a backlight (hereinafter referred to as “LCD”). In this MFP, a technique for partially lighting a backlight in response to a request for reducing power consumption is known.

  Japanese Patent Application Laid-Open No. 2011-095913 discloses a display unit in which one display area is divided into a plurality of display areas, and a function necessary for normal mode is assigned to each of the divided display areas. A backlight provided for each display area, a touch panel provided for each divided display area that can accept operations for setting assigned functions, and a normal mode. Backlight based on definition data in which ON / OFF settings of backlight and touch panel are defined in advance according to multiple patterns and multiple functions required in normal mode, and recognized normal mode pattern And an image forming apparatus having a control unit for controlling on / off of the touch panel.

However, since the conventional image forming apparatus predetermines the display area for turning on the backlight among the plurality of display areas according to the definition data, corresponding to the plurality of functions, the part that is actually operated by the user In some cases, the backlight is lit in another display area. For this reason, the backlight is turned on even in a portion not operated by the user, and there is a problem that power consumption cannot be reduced sufficiently.
JP 2011-095913 A

  The present invention has been made to solve the above-described problems, and one of the objects of the present invention is to provide a display device capable of facilitating operation while reducing power consumption.

  Another object of the present invention is to provide a display control method capable of facilitating operation while reducing power consumption.

  Still another object of the present invention is to provide a display control program capable of facilitating operation while reducing power consumption.

  In order to achieve the above-described object, according to one aspect of the present invention, a display device is provided with a liquid crystal display device including a backlight that can be partially lit, and a display surface of the liquid crystal display device, A touch panel for detecting a position instructed by a user on the display surface; a liquid crystal display device; and a control means for controlling the touch panel. The control means determines an effective portion in the screen displayed on the liquid crystal display device. The effective part determining means to perform, the effective part lighting means for lighting the determined effective part of the backlight, and the area occupied by the effective part after a predetermined time based on the temporal change of the position detected by the touch panel is predicted Predicted part determining means for determining the part and predicted lighting means for lighting the predicted part of the backlight while the operation is detected.

  According to this aspect, the effective portion of the backlight is turned on, and based on the temporal change in the position detected by the touch panel, the region that the effective portion occupies after a predetermined time has elapsed is determined as the predicted portion, and the operation is detected. During this time, the predicted portion of the backlight is turned on. For this reason, while the user is instructing the touch panel, the predicted part of the backlight is lit, so the user can determine the position to place the effective part while looking at the background image, Operation can be facilitated. In addition, since the effective part or the predicted part is lit, the power consumption of the backlight can be reduced. As a result, a display device capable of facilitating operation while reducing power consumption can be provided.

  Preferably, the touch panel further includes touch panel control means for detecting a position at a sampling interval determined by a response time of the backlight, and the predicted part determining means is based on two positions detected continuously at the sampling interval by the touch panel. Thus, the prediction portion is determined, and the predetermined time is determined based on the sampling interval.

  According to this aspect, the touch panel detects a position at a sampling interval determined by the response time of the backlight, and a predetermined time determined based on the sampling interval based on two positions detected continuously by the touch panel at the sampling interval. After the elapse of time, the area occupied by the effective portion is determined as the predicted portion. For this reason, an effective part can be lighted efficiently.

  Preferably, the apparatus further includes a resizing operation detecting unit that detects a temporal change in the position detected by the touch panel as an operation for changing the size of the effective portion as a resizing operation, and the predicted part determining unit includes the resizing operation. Is detected, the area occupied by the effective portion after a predetermined time is predicted based on the speed at which the position detected by the touch panel changes.

  According to this aspect, a change in position over time is detected as an operation for changing the size of the effective part, and a predicted part is determined based on a speed at which the position changes over time. For this reason, the precision which estimates a prediction part can be improved.

  Preferably, the apparatus further includes a movement operation detection unit that detects a temporal change in the position detected by the touch panel as a movement operation that changes the position of the effective portion on the display surface, and the predicted part determination unit includes the movement operation. When detected, the area occupied by the effective portion after a predetermined time is predicted based on the speed and direction at which the position detected by the touch panel changes.

  According to this aspect, a temporal change in position is detected as an operation for moving the effective portion, and the predicted portion is determined based on the speed and direction in which the position changes with time. For this reason, the precision which estimates a prediction part can be improved.

  Preferably, when an image of a predetermined component is displayed on the liquid crystal display device and the position detected by the touch panel is within an area where the image of the component is displayed, the image of the component is displayed. The system further comprises component selection means for selecting a region, and the effective part determination means determines the area selected by the part selection means as an effective part.

  According to this aspect, when the image of the component is instructed by the user in a state where the image of the predetermined component is displayed, the area where the image of the component is displayed is determined as the effective portion. For this reason, the user can select the effective portion, and the operation of selecting the effective portion can be facilitated.

  Preferably, the effective portion determination means selects two or more areas of the plurality of areas in which the images of the plurality of parts are displayed by the component selection means in a state where the images of the plurality of parts are displayed on the liquid crystal display device. If so, the selected two or more regions are determined as effective portions.

  Preferably, the effective part determining means includes an instruction range enabling means for determining an area within a predetermined range from a position detected by the touch panel as an effective part.

  According to this aspect, since an area in a predetermined range from the position detected by the touch panel is determined as an effective portion, the periphery of the position designated by the user is lit with the backlight. For this reason, the user can browse an arbitrary part of the image displayed on the liquid crystal display device.

  According to another aspect of the present invention, a display control method includes a liquid crystal display device having a backlight that can be partially lit, and a display surface of the liquid crystal display device that is provided so as to be overlapped by a user on the display surface. A display control method executed by a display device including a touch panel for detecting an instructed position, an effective portion determination step for determining an effective portion in a screen displayed on the liquid crystal display device, and a backlight The effective portion lighting step for lighting the determined effective portion and the temporal change in the position detected by the touch panel, the operation for changing the size of the effective portion, or the operation for changing the position of the effective portion on the display surface If an operation is detected, the operation is detected based on the temporal change in the position detected by the touch panel in the operation. A prediction part determination step for predicting an area occupied by the part after a predetermined time and determining the predicted area as a prediction part; and a lighting control step for turning on the prediction part of the backlight while an operation is detected. .

  If this aspect is followed, the display control method which can make operation easy, reducing the power consumption of a display apparatus can be provided.

  According to still another aspect of the present invention, a display control program is provided so as to overlap with a liquid crystal display device having a partially lit backlight and a display surface of the liquid crystal display device. A display control program that is executed by a computer that controls a display device that includes a touch panel that detects a position instructed by the computer, and determines an effective portion in a screen displayed on the liquid crystal display device A step, an effective part lighting step for lighting the determined effective part of the backlight, a temporal change in the position detected by the touch panel, an operation for changing the size of the effective part, or an effective part on the display surface An operation detection step for detecting an operation for changing the position, and when an operation is detected, A prediction portion determination step for predicting a region that the effective portion occupies after a predetermined time based on a temporal change in the position to be issued, and determining the predicted region as a prediction portion; and a backlight while an operation is detected And a lighting control step of lighting the predicted portion of the computer.

  If this aspect is followed, the display control program which can make operation easy, reducing the power consumption of a display apparatus can be provided.

1 is a perspective view showing an appearance of an MFP in one embodiment of the present invention. It is a top view which shows an example of an operation panel. 2 is a block diagram illustrating an example of an outline of a hardware configuration of an MFP. FIG. It is a figure for demonstrating the response period of LED. FIG. 3 is a block diagram illustrating an example of functions of a CPU included in an MFP. It is a figure for demonstrating the effective part and prediction part in case size change operation is input. It is a figure for demonstrating the effective part and prediction part in case movement operation is input. It is a flowchart which shows an example of the flow of a display control process. It is a flowchart which shows an example of the flow of an effective part determination process. It is a flowchart which shows an example of the flow of a 1st size change process. It is a flowchart which shows an example of the flow of a 2nd size change process. It is a figure which shows an example of the flow of a movement process. It is a figure for demonstrating moving operation. It is a 1st figure which shows an example in case an icon is displayed. It is a 2nd figure which shows an example in case an icon is displayed.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

  FIG. 1 is a perspective view showing an external appearance of an MFP according to one embodiment. FIG. 2 is a plan view showing an example of the operation panel. Referring to FIGS. 1 and 2, MFP 100 includes a document reading unit 130 for reading a document, an automatic document feeder 120 for conveying a document to document reading unit 130, and document reading unit 130 reads a document. An image forming unit 140 for forming an image on a sheet or the like based on image data to be output, a sheet feeding unit 150 for supplying the sheet to the image forming unit 140, and an operation panel 160 as a user interface. .

  Operation panel 160 is provided on the upper surface of MFP 100. The operation panel 160 includes an LCD 161, a touch panel 163 that is provided so as to overlap the LCD 161 and is made of a transparent member, and a hard key unit 165. The LCD 161 displays an instruction menu for the user, information about the acquired image data, and the like. The hard key unit 165 includes a plurality of keys, and accepts input of various instructions, data such as characters and numbers by user operations corresponding to the keys. Touch panel 163 detects a position on the display surface of LCD 161. The touch panel 163 is provided on the upper surface or the lower surface of the LCD 161.

  The automatic document feeder 120 automatically conveys a plurality of documents set on the document feeding tray one by one to a predetermined document reading position set on the platen glass of the document reading unit 130, and reads the document. The document whose document image is read by the unit 130 is discharged onto a document discharge tray. The document reading unit 130 includes a light source that irradiates light to the document conveyed to the document reading position and a photoelectric conversion element that receives light reflected from the document, and scans a document image corresponding to the size of the document. The photoelectric conversion element converts the received light into image data that is an electrical signal and outputs the image data to the image forming unit 140. The paper feed unit 150 conveys the paper stored in the paper feed tray to the image forming unit 140.

  The image forming unit 140 forms an image by a well-known electrophotographic method, and the image data after data processing is obtained by performing various data processing such as shading correction on the image data input from the document reading unit 130. Alternatively, an image is formed on a sheet conveyed by the sheet feeding unit 150 based on image data received from the outside.

  FIG. 3 is a block diagram illustrating an example of an outline of the hardware configuration of the MFP. Referring to FIG. 3, MFP 100 includes a main circuit 110. The main circuit 110 includes a CPU 111, a communication interface (I / F) unit 112, a ROM 113, a RAM 114, a hard disk drive (HDD) 115 as a mass storage device, a facsimile unit 116, an external storage device 117, including. CPU 111 is connected to automatic document feeder 120, document reading unit 130, image forming unit 140, sheet feeding unit 150, and operation panel 160, and controls the entire MFP 100.

  The ROM 113 stores a program executed by the CPU 111 or data necessary for executing the program. The RAM 114 is used as a work area when the CPU 111 executes a program. Further, the RAM 114 temporarily stores the read images continuously sent from the document reading unit 130.

  The facsimile unit 116 is connected to the public switched telephone network (PSTN) and transmits facsimile data to the PSTN or receives facsimile data from the PSTN. The facsimile unit 116 stores the received facsimile data in the HDD 115 or converts the received facsimile data into print data that can be printed by the image forming unit 140 and outputs the print data to the image forming unit 140. As a result, the image forming unit 140 forms an image on a sheet of facsimile data received by the facsimile unit 116. Further, the facsimile unit 116 converts the data stored in the HDD 115 into facsimile data, and transmits the facsimile data to a facsimile machine connected to the PSTN.

  Communication I / F unit 112 is an interface for connecting MFP 100 to a network. The communication I / F unit 112 communicates with other computers connected to the network using a communication protocol such as TCP (Transmission Control Protocol) or FTP (File Transfer Protocol). Note that the protocol for communication is not particularly limited, and an arbitrary protocol can be used. The network to which the communication I / F unit 112 is connected is, for example, a local area network (LAN), and the connection form may be wired or wireless. The network is not limited to the LAN, and may be a network using a wide area network (WAN), a public switched telephone network, or the like. Furthermore, the network is connected to the Internet. Therefore, MFP 100 can communicate with a computer such as a server connected to the Internet.

  The external storage device 117 is controlled by the CPU 111, and a CD-ROM (Compact Disk Read Only Memory) 118 or a semiconductor memory is mounted. The CPU 111 can access the CD-ROM 118 or the semiconductor memory via the external storage device 117. The CPU 111 loads the program recorded in the CD-ROM 118 or semiconductor memory mounted on the external storage device 117 into the RAM 114 and executes it. Note that the program executed by the CPU 111 is not limited to the program recorded on the CD-ROM 118, and the program stored in the HDD 115 may be loaded into the RAM 114 and executed. In this case, another computer connected to the network rewrites the program stored in HDD 115 of MFP 100 or adds a new program and writes it via the network connected to communication I / F unit 112. You may do it. Further, MFP 100 may download a program from another computer connected to the network and store the program in HDD 115. The program here includes not only a program directly executable by the CPU 111 but also a source program, a compressed program, an encrypted program, and the like.

  The medium for storing the program executed by the CPU 111 is not limited to the CD-ROM 118, but an optical disc (MO (Magnetic Optical Disc / MD (Mini Disc) / DVD (Digital Versatile Disc)), IC card, optical card, mask. It may be a semiconductor memory such as a ROM, an EPROM (Erasable Programmable ROM), or an EEPROM (Electrically EPROM).

  Operation panel 160 includes an LCD 161, a touch panel 163, and a hard key unit 165. The LCD 161 includes a display unit 167 and a backlight 169 provided on the back surface of the display unit 167. The display unit 167 has a plurality of pixels, is controlled by the CPU 111, and displays an image by switching light transmitted from the backlight 169 between a transmitting state and a blocking state for each of the plurality of pixels.

  The backlight 169 is a surface light source that emits light over the entire display surface of the display unit 167. The backlight 169 is a surface light source in which a plurality of light emitting diodes (hereinafter referred to as “LEDs”) respectively corresponding to a plurality of pixels included in the display unit 167 are arranged. The backlight 169 is controlled by the CPU 111 and can emit light partially on the entire display surface of the display unit 167 or on one or more regions.

  Note that the backlight 169 may not emit light corresponding to each of the plurality of pixels included in the display portion 167 as long as the backlight 169 can partially emit light to the display portion 167. For example, a plurality of pixels included in the display unit 167 may be grouped into a group of two or more pixels, and the backlight 169 may be arranged corresponding to each of the plurality of groups. The plurality of groups are composed of, for example, pixels in which a predetermined number (for example, 2 to 5) is arranged vertically and horizontally.

  Each of the plurality of LEDs included in the backlight 169 emits light when a voltage is applied thereto, but the CPU 111 prevents the inrush current from being applied so that the voltage applied to the LEDs in the response period R becomes a predetermined voltage. The voltage applied to the LED is gradually increased. The response period R is a constant determined by a plurality of LEDs provided in the backlight 169.

  FIG. 4 is a diagram for explaining the response period of the LED. FIG. 4A is a diagram illustrating an example of a signal for driving the LED, and FIG. 4B is a diagram illustrating a temporal change in a voltage applied to the LED. Referring to FIG. 4A, the horizontal axis indicates a time axis and the vertical axis indicates a signal. A value of 0 indicates that the LED is turned off, and a value of 1 indicates that the LED is turned on. The drive signal indicates that the light is switched from off to on at time t1. Referring to FIG. 4B, the horizontal axis indicates the time axis, and the vertical axis indicates the voltage applied to the LED. The amount of light of the LED changes depending on the value of the applied voltage, and here, the voltage for causing the LED to emit light with a predetermined amount of light is V1. The voltage is 0 until time t1, the voltage gradually increases from time t1, and the voltage becomes V1 at time t2 when the response period R has elapsed. The LED is turned off when the voltage is 0, and emits light when the voltage exceeds 0.

  Returning to FIG. 3, the hard key unit 165 includes a plurality of hard keys. The hard key is a contact switch and is connected to the CPU 111. When the hard key is pressed by the operation user, the contact is closed and the circuit connected to the CPU 111 is closed. The hard key closes the circuit while being pressed by the operating user who operates the MFP 100, and opens the circuit when not pressed by the operating user.

  The touch panel 163 is provided on the upper surface or the lower surface of the LCD 161 and outputs the coordinates of the position pressed by the operating user to the CPU 111. The touch panel 163 detects a position designated by the operation user with a finger or a stylus pen, and outputs the coordinates of the detected position to the CPU 111. The touch panel 163 is preferably the same size or larger than the display surface of the display unit 167 of the LCD 161. Since the touch panel 163 is provided so as to overlap the LCD 161, the touch panel 163 indicates the coordinates of the position designated by the operation user on the display surface of the display unit 167 to the CPU 111 when the operation user indicates the display surface of the display unit 167. Output. For the touch panel 163, for example, a resistive film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, or a capacitance method can be used, and the method is not limited.

  FIG. 5 is a block diagram illustrating an example of functions of a CPU included in the MFP. The functions shown in FIG. 5 are functions realized by CPU 111 when CPU 111 provided in MFP 100 executes a display control program stored in ROM 113, HDD 115, or CD-ROM 118.

  Referring to FIG. 5, the CPU 111 includes a display control unit 51 that controls the display unit 167 of the LCD 161, a touch panel control unit 53 that controls the touch panel 163, an operation detection unit 55 that detects an operation input by the user, The effective part determination part 57, the prediction part determination part 59, and the backlight control part 61 which controls the backlight 169 are included.

  The display control unit 51 controls the display unit 167 to display an image in accordance with an instruction from the operation detection unit 55 described later. The image displayed by the display control unit 51 includes a screen image output when the MFP 100 executes the application program in addition to the screen image stored in the ROM 113 or the HDD 115. Screens stored in advance in ROM 113 or HDD 115 include operation screens for operating MFP 100. Application programs executed by MFP 100 include, for example, a browsing program for browsing a Web page.

  Furthermore, when an instruction to display a component is input from the operation detection unit 55, the display control unit 51 displays an image of the component superimposed on the image displayed so far. The part includes a pop-up screen, a list-up screen, and a thumbnail. The thumbnail includes a reduced image obtained by reducing a data image in addition to a predetermined image.

  The touch panel control unit 53 controls the touch panel 163 to detect a position on the display surface of the display unit 167 that is designated by the user with a finger or a stylus pen at the sampling interval T, and indicates the detected position. The position information is output to the operation detection unit 55 and the effective part determination unit 57. The sampling interval T may be a predetermined period. Here, the sampling interval T is the same as the response time R of the backlight 169 included in the LCD 161.

  The backlight control unit 61 controls the backlight 169 to partially light one or more areas of the backlight. Since the backlight 169 includes a plurality of LEDs, the backlight control unit 61 turns on each of the plurality of LEDs by applying a voltage to each of the plurality of LEDs. When applying a voltage to the LED, the backlight control unit 61 gradually increases the applied voltage so that the voltage applied in the response period R becomes a predetermined voltage in order to prevent an inrush current.

  The operation detection unit 55 detects an operation that the user inputs to the touch panel 163 or the hard key unit 165. The operation includes an operation assigned in advance to a plurality of hard keys included in the hard key unit 165 and an operation determined by the screen displayed on the LCD 161 by the display control unit 51. The operations assigned in advance to the plurality of hard keys included in hard key unit 165 include, for example, an operation for switching the operation mode of MFP 100, an operation for switching the displayed screen, and an operation for inputting a number. The operation mode of the MFP 100 includes a copy mode for executing a copy process, a scan mode for executing a document reading process, a facsimile mode for executing a facsimile transmission process, and a browsing mode for browsing data stored in the HDD 115. Etc. Operations determined by the screen are assigned to positions in the screen.

  The operation detection unit 55 receives position information from the touch panel control unit 53 at sampling intervals. When the position information is input from the touch panel control unit 53, the operation detection unit 55 detects an operation assigned to the position on the screen based on the position information. For example, when the screen displayed by the display control unit 51 includes a button image, if the position information input from the touch panel control unit 53 is within the button image in the screen, the button is assigned to the button. Identify the operation.

  When detecting an operation for switching the operation mode, the operation detection unit 55 outputs an instruction to display an operation screen corresponding to the operation mode to the display control unit 51. Further, when detecting an operation for switching the screen, the operation detection unit 55 outputs an instruction to display the screen after switching to the display control unit 51. In particular, the instruction to display the operation screen corresponding to the browsing mode includes an instruction to display a component. The component here is a reduced image obtained by reducing an image of data stored in the HDD 115.

  When a button in the screen displayed by the display control unit 51 is assigned an operation for instructing display of a component such as a pop-up screen or a list-up screen, the operation detection unit 55 is input from the touch panel control unit 53. If the position information to be displayed is the position in the button, an instruction to display a component such as a pop-up screen or a list-up screen is output to the display control unit 51.

  The operation detection unit 55 includes a component selection unit 71, a size change operation detection unit 73, and a movement operation detection unit 75. When the image displayed by the display control unit 51 includes an image of a component, the component selection unit 71 selects the component as a processing target if the position information input from the touch panel control unit 53 is within the component image. Then, the component identification information for identifying the selected component is output to the display control unit 51, the effective part determination unit 57, and the prediction part determination unit 59. Instead of the component identification information, position information indicating the position of the region where the image of the component is displayed by the display control unit 51 may be output.

  The size change operation detection unit 73 detects a size change operation input by the user in a state where a component is selected as a processing target by the component selection unit 71. The size changing operation is an operation for instructing to change the size of the image of the component selected as the processing target. For this reason, the size changing operation includes a magnification for determining the changed size.

  The size change operation detection unit 73 performs the size change operation when two pieces of position information are simultaneously input from the touch panel control unit 53 and the distance between the two positions respectively determined by the two position information changes with time. To detect. The size change operation detection unit 73 receives position information from the touch panel control unit 53 at sampling intervals. The size change operation detection unit 73 detects the size change operation every time two pieces of position information are input at the sampling interval T with reference to the distance between the two positions detected first. A distance between two positions detected first is referred to as a reference distance, and a distance between two positions detected after the second time is referred to as a reference distance.

  The size change operation detection unit 73 detects a size change operation indicating that the size is increased when the reference distance is longer than the reference distance, and indicates that the size is reduced when the reference distance is shorter than the reference distance. Detect resize operations. The size change operation detection unit 73 determines the magnification based on the amount of change in the distance between the two positions. The magnification is based on the reference distance between the two positions detected first, and is an enlargement ratio if the reference distance between the two positions detected after the second time is longer than the reference distance. If it is shorter than the reference distance, it is a reduction rate. The size change operation detection unit 73 determines that the operation for inputting the size change operation is continued while two pieces of position information are simultaneously input from the touch panel control unit 53, and the two positions are simultaneously received from the touch panel control unit 53. When the information is no longer input, or when two pieces of position information are simultaneously input from the touch panel control unit 53, but the distance between the two positions is not changed, the operation for inputting the resize operation is completed. The size change operation is confirmed.

  In the size change operation detection unit 73, the position specified by the position information first input from the touch panel control unit 53 indicates a predetermined position of the image of the component selected as the processing target in the component selection unit 71. If a resize operation is detected. The size change operation detection unit 73 detects the size change operation every time position information is input at the sampling interval T after that, based on the position (predetermined position) specified by the position information input first. . The predetermined position is a predetermined position corresponding to the part. For example, a rectangular part such as a pop-up screen or a list screen has four vertices of the rectangle and four sides of the part. Here, when the part is a rectangle, the predetermined position is the lower right vertex of the rectangle. In this case, the size change operation detection unit 73 sets the distance between the upper left vertex corresponding to the lower right vertex of the rectangle and the lower right vertex as the reference distance.

  The size change operation detection unit 73 detects the size change operation when the position information input at the sampling interval T from the touch panel control unit 53 is different from the reference position after the position information of the reference position is input from the touch panel control unit 53. To do.

  The size change operation detection unit 73 calculates the reference distance based on the position information input at the sampling interval T from the touch panel control unit 53 after the position information of the predetermined position is input from the touch panel control unit 53, and the magnification To decide. Specifically, the size change operation detection unit 73 receives the position information of a predetermined position from the touch panel control unit 53 and then the upper left position corresponding to the position defined by the input position information and the lower right vertex of the rectangle. The distance from the vertex of is a reference distance.

  The size change operation detection unit 73 is an operation for inputting a size change operation while position information is input from the touch panel control unit 53 at the sampling interval T after position information of a predetermined position is input from the touch panel control unit 53. When the position information is no longer input from the touch panel control unit 53 or when the same position information is continuously input from the touch panel control unit 53, a resize operation is input. It is determined that the operation to be performed is completed, and the resize operation is confirmed.

  While the operation for inputting the size change operation is continued, the size change operation detection unit 73 calculates the magnification every time the position information is input at the sampling interval T from the touch panel control unit 53, the display control unit 51, and the prediction part. It outputs to the determination part 59 and the effective part determination part 57, and when the operation which inputs size change operation is completed, a completion signal is output to the display control part 51, the prediction part determination part 59, and the effective part determination part 57.

  The movement operation detection unit 75 detects a movement operation by the user in a state where a component is selected as a processing target by the component selection unit 71. The movement operation is an operation for instructing the display position of the image of the component selected as the processing target. For this reason, the movement operation includes a movement vector including a direction and a distance.

  The movement operation detection unit 75 detects a movement operation when an instruction is given within the image of the component selected as a processing target in the component selection unit 71 for a predetermined time. Specifically, the movement operation detection unit 75 has the position specified by the position information first input from the touch panel control unit 53 in the image of the component selected as the processing target in the component selection unit 71. Then, when a predetermined number of the same position information is continuously input from the touch panel control unit 53 thereafter, the moving operation is detected. The movement operation detection unit 75 has the position specified by the position information first input from the touch panel control unit 53 in the image of the component selected as the processing target in the component selection unit 71. In the case of a predetermined position, the movement operation may be detected. Hereinafter, the position specified by the position information input from the touch panel control unit 53 when the movement operation detection unit 75 first detects the movement operation is referred to as a pre-movement position.

  The movement operation detection unit 75 is based on the pre-movement position specified by the position information at the time when the movement operation is first detected, and each time position information is input at the sampling interval T after the movement operation is first detected. Detect move operations. The movement operation detection unit 75 detects the movement operation when the position information input at the sampling interval T from the touch panel control unit 53 is different from the pre-movement position after first detecting the movement operation.

  Further, the movement operation detection unit 75 detects a movement operation when the user designates an area different from the part image. In this case, an instruction range validating unit 83 to be described later determines a region within a predetermined range from the position designated by the user as an effective portion. Specifically, the movement operation detection unit 75 detects a movement operation when position information is input from the touch panel control unit 53 in a state where a component to be processed is not selected in the component selection unit 71. When the movement operation detection unit 75 detects the movement operation, the position specified by the position information input from the touch panel control unit 53 becomes the pre-movement position.

  The movement operation detection unit 75 is based on the pre-movement position specified by the position information at the time when the movement operation is first detected, and each time position information is input at the sampling interval T after the movement operation is first detected. Detect move operations. The movement operation detection unit 75 detects the movement operation when the position information input at the sampling interval T from the touch panel control unit 53 is different from the pre-movement position after first detecting the movement operation.

  Hereinafter, the position specified by the position information input at the sampling interval T from the touch panel control unit 53 after first detecting the movement operation is referred to as a post-movement position. The movement operation detection unit 75 determines a movement vector based on the position before movement and the position after movement. The movement vector includes a direction from the pre-movement position to the post-movement position and a distance between the pre-movement position and the post-movement position. The movement operation detection unit 75 is assumed to continue the movement operation while the position information is input from the touch panel control unit 53 at the sampling interval T after the position information of the pre-movement position is input from the touch panel control unit 53. When the position information is no longer input from the touch panel control unit 53 or when a predetermined number of the same position information is continuously input from the touch panel control unit 53, it is determined that the movement operation is completed, and the movement operation is completed. Confirm.

  The movement operation detection unit 75 displays the movement vector while the movement operation continues, and each time position information is input from the touch panel control unit 53 at the sampling interval T, the display control unit 51, the predicted part determination unit 59, and the effective When the operation for inputting the size change operation is completed, a completion signal is output to the display control unit 51, the predicted part determination unit 59, and the effective part determination unit 57.

  When the magnification is input from the size change operation detection unit 73 after the component identification information is input from the component selection unit 71, the display control unit 51 receives the component every time the magnification is input from the size change operation detection unit 73. The size of the image of the component specified by the identification information is enlarged or reduced according to the magnification, and the enlarged or reduced image of the component is displayed on the display unit 167 included in the LCD 161. The position to be displayed is arranged such that an arbitrary point of the image of the part before enlargement or reduction overlaps with a corresponding point of the image of the part after enlargement or reduction. For example, when the part is rectangular, the top left vertex is set to the same position before and after enlargement or reduction.

  When the movement vector is input from the movement operation detection unit 75 after the component identification information is input from the component selection unit 71, the display control unit 51 receives the component every time the movement vector is input from the movement operation detection unit 75. The image of the part specified by the identification information is displayed at the position moved in parallel by the movement vector.

  The effective part determination unit 57 determines an effective part in the screen displayed on the display unit 167 of the LCD 161 and outputs the determined effective part to the prediction part determination unit 59 and the backlight control unit 61. The effective part includes area information indicating an area in the screen displayed on the display unit 167 of the LCD 161. The effective portion determination unit 57 includes a component validation unit 81 and an instruction range validation unit 83. In response to the input of the component identification information from the component selection unit 71, the component validation unit 81 displays the image of the component specified by the component identification information in the screen displayed on the display unit 167. The part is determined as an effective part. In addition, when the magnification is input from the size change operation detection unit 73 after the component identification information is input from the component selection unit 71, the component validation unit 81 every time the magnification is input from the size change operation detection unit 73. In addition, the size of the image of the component specified by the component identification information is enlarged or reduced according to the magnification, and a portion where the enlarged or reduced image of the component is displayed in the screen displayed on the display unit 167 is displayed. Determine the effective part. In addition, when the movement vector is input from the movement operation detection unit 75 after the component identification information is input from the component selection unit 71, the valid part determination unit 57 is input each time the movement vector is input from the movement operation detection unit 75. In addition, in the screen displayed on the display unit 167, a part obtained by moving the part image specified by the part identification information in parallel by the movement vector is determined as an effective part.

  The instruction range validating unit 83 validates a predetermined range from the position specified by the position information when position information is input from the touch panel control unit 53 in a state where no part identification information is input from the part selecting unit 71. Decide on a part.

  The predicted part determination unit 59 determines the area occupied by the effective part after the elapse of a predetermined time as the predicted part, and outputs the determined predicted part to the backlight control unit 61. The prediction portion includes area information indicating an area in the screen displayed on the display unit 167 of the LCD 161. The prediction portion determination unit 59 receives an effective portion from the effective portion determination unit 57.

  When the effective part is input from the effective part determination unit 57 and the magnification is input from the size change operation detection unit 73, the prediction part determination unit 59 predicts the prediction part based on two successively input magnifications. And the determined prediction portion is output to the backlight control unit 61. Hereinafter, of the two magnifications input in succession, the magnification input first is referred to as a first magnification M1, and the magnification input after the first magnification is referred to as a second magnification M2. The prediction part determination unit 59 outputs the prediction part to the backlight control unit 61 after the effective part is input and after the magnification is input from the size change operation detection unit 73 until the completion signal is input.

  Specifically, the predicted magnification M3 is calculated from the second magnification M2 input from the size change operation detection unit 73 and the first magnification M1 input immediately before the second magnification M2. The prediction magnification M3 is a magnification of the effective portion after the lapse of the predetermined time with respect to the effective portion before the lapse of the predetermined time. Since the size change operation detection unit 73 outputs a magnification every time position information is input from the touch panel control unit 53 at the sampling interval T, the interval at which the two magnifications are input to the predicted portion determination unit 59 is the sampling interval T. Will be the same. Further, the magnification output by the size change operation detection unit 73 is the magnification of the effective portion with respect to the component. For this reason, the prediction portion determination unit 59 calculates the prediction magnification M3 using the following equation (1). Then, the predicted portion determination unit 59 determines a region obtained by enlarging or reducing the region specified by the effective portion input from the effective portion determination unit 57 with the prediction magnification M3 as the predicted portion.

M3 = (2 × M1-M2) / M1 (1)
When the effective part is input from the effective part determination unit 57 and the movement vector is input from the movement operation detection unit 75, the prediction part determination unit 59 performs prediction based on two movement vectors that are input in succession. The part is determined, and the determined predicted part is output to the backlight control unit 61. Hereinafter, of the two movement vectors that are successively input, the movement vector that is input first is referred to as a first movement vector V1, and the movement vector that is input after the first movement vector V1 is the second movement vector. It is called V2. The prediction part determination unit 59 outputs the prediction part to the backlight control unit 61 after the valid part is input and after the movement vector is input from the movement operation detection unit 75 until the completion signal is input.

  Specifically, the prediction vector V3 is calculated from the second movement vector V2 input from the movement operation detection unit 75 and the first movement vector V1 input immediately before the second movement vector V2. The prediction vector V3 determines the direction and distance that the effective part before the predetermined time elapses moves to the position of the effective part after the predetermined time elapses. Since the movement operation detection unit 75 outputs a movement vector every time position information is input from the touch panel control unit 53 at the sampling interval T, the interval at which the two movement vectors are input to the predicted portion determination unit 59 is the sampling interval. Same as T. For this reason, the prediction part determination part 59 calculates the prediction vector V3 using following Formula (2). Then, the predicted portion determination unit 59 determines, as the predicted portion, a region obtained by moving the region specified by the effective portion input from the effective portion determination unit 57 by the direction and distance determined by the prediction vector.

Predicted vector V3 = moving vector V2-moving vector V1 (2)
The backlight control unit 61 controls the backlight 169. The backlight control unit 61 includes an effective partial lighting unit 63 and a predicted partial lighting unit 65. The effective part lighting unit 63 corresponds to the effective part of the backlight 169 on the condition that the lighting signal is not input from the predicted part lighting unit 65 in response to the input of the effective part from the effective part determination unit 57. Only the part to be turned on is turned on, and the part other than the effective part is turned off.

  The prediction part lighting unit 65 turns on only the part corresponding to the prediction part of the backlight 169 while the prediction part is input from the prediction part determination unit 59, turns off the part other than the prediction part, and turns off the effective part lighting unit 63. A lighting signal is output to. The effective part lighting unit 63 does not light the effective part while the lighting signal is input from the predicted partial lighting unit 65. For this reason, since the backlight control part 61 lights only either a prediction part or an effective part, the electric power consumed by the backlight 169 can be reduced.

  FIGS. 6A and 6B are diagrams for explaining an effective portion and a prediction portion when a size change operation is input. 6A and 6B, a case where the pop-up screen 251 is determined as an effective portion will be described. FIG. 6A shows a case where the user points to the lower right vertex 254 of the pop-up screen 251 and moves his / her finger to the position 255. In this case, when the vertex 254 at the lower right of the pop-up screen 251 is instructed by the user, the position of the vertex 254 is detected and a resize operation is accepted. When the position of the vertex 254 is detected and a resize operation is accepted, the distance between the vertex 253 and the vertex 254 is set as the reference distance, and the distance between the vertex 253 and the vertex 254 is set as the reference distance. A value obtained by dividing the reference distance by the reference distance is set as the first magnification M1.

  When the position 255 is detected as the position designated by the user after the predetermined time T has elapsed, the distance between the vertex 253 and the position 255 is set as the reference distance, and a value obtained by dividing the reference distance by the reference distance is The second magnification M2 is set.

  FIG. 6B is a diagram illustrating an effective portion and a predicted portion after the user points to the lower right vertex 254 of the pop-up screen 251 and moves the finger to the position 255. At this time, the effective portion is a rectangular area having the vertex 253 and the position 255 as diagonal lines. The pop-up screen 251 is enlarged and displayed in a rectangle with the vertex 253 and the position 255 as diagonal lines. Furthermore, the prediction magnification M3 is calculated using the above equation (1), and the position 256 is determined by enlarging the pop-up screen 251 with the prediction magnification M3. In this case, the predicted portion is a rectangular area having the vertex 253 and the position 256 as diagonal lines. Since the predicted portion 256 is larger than the effective portion, the size change operation can be input while looking at the portion in the background of the effective portion obtained by enlarging the pop-up screen 251.

  FIG. 7A, FIG. 7B, and FIG. 7C are diagrams for explaining an effective portion and a predicted portion when a moving operation is input. 7A, 7B, and 7C, a case where the icon 261 is determined as an effective portion will be described. FIG. 7A is a diagram illustrating an effective portion at the time when the user inputs a moving operation. Referring to FIG. 7A, when a position 263 in icon 261 is designated by the user, position 263 is detected, and a moving operation is accepted. At the time when the moving operation is accepted, the position 263 is set as the pre-movement position. When the position 264 is detected as a position instructed by the user after the predetermined time T has elapsed, the position 264 is set as the post-movement position, and the movement is performed with the pre-movement position 263 as the start point and the post-movement position 264 as the end point. A vector V1 is set.

  FIG. 7B is a diagram illustrating an effective portion after the movement operation is input. Referring to FIG. 7B, when the user moves his / her finger from position 263 to position 264, icon 261 is moved to a position moved by movement vector V1, and moved icon 261A becomes an effective portion. It is determined. When the position 265 is detected as a position instructed by the user after a predetermined time T has elapsed, the position 265 is set as the post-movement position, and the movement is performed with the inter-movement position 263 as the start point and the post-movement position 265 as the end point. A vector V2 is set. At this stage, since the movement vector V1 and the movement vector V2 are set, a prediction vector V3 having the end point of the movement vector V1 as the start point and the end point of the movement vector V2 as the end point is calculated according to the above equation (2). .

  FIG. 7C is a diagram illustrating an effective portion and a predicted portion after a movement operation is input. With reference to FIG. 7C, a prediction portion 261C obtained by moving the prediction portion 261B by the prediction vector V3 is determined. In this case, since the predicted portion 261C is shifted from the effective portion 261B, the predicted portion 261C includes a portion of the effective portion 261B and a portion in the background. Therefore, the user can input a movement operation while looking at the background.

  FIG. 8 is a flowchart illustrating an example of the flow of display control processing. The display control process is a process executed by CPU 111 when CPU 111 provided in MFP 100 executes a display control program stored in ROM 113, HDD 115, or CD-ROM 118. Referring to FIG. 8, CPU 111 displays a screen on LCD 161 (step S01). The screen may be a screen that can be displayed by MFP 100. For example, it may be an initial operation screen displayed when power is turned on to MFP 100, or may be a screen selected by the user.

  In the next step S02, it is determined whether or not the position designated by the user is detected on the display surface of the LCD 161. When position information is input from the touch panel 163, it is determined that the position has been detected. If the position is detected, the process proceeds to step S03; otherwise, the process proceeds to step S09. In step S03, it is determined whether or not the position detected in step S02 is within the operation button in the displayed screen. If it is within the operation button, the process proceeds to step S04; otherwise, the process proceeds to step S06.

  In step S04, it is determined whether or not the operation button including the position detected in step S02 is a button to which an end instruction is assigned. If the operation button is a button to which an end instruction is assigned, the process ends. If not, the process proceeds to step S05. In step S05, the process assigned to the operation button including the position detected in step S02 is executed, and the process returns to step S02. The process assigned to the operation button includes, for example, a process of switching a screen to be displayed to another screen, a process of causing the MFP 100 to execute a copying operation, a scanning operation, and a facsimile transmission process.

  In step S06, it is determined whether or not the position detected in step S02 is within the effective portion. The effective part is set in step S07. Before step S07 is executed, the effective portion is not set, so it is determined that the position detected in step S02 is not within the effective portion. If the position detected in step S02 is within the valid portion, the process proceeds to step S09. If not, the process proceeds to step S07. In step S07, an effective part determination process is executed, and the process proceeds to step S08. Although details of the effective part determination process will be described later, this is a process of determining an area in the screen displayed on the LCD 161 as an effective part. In step S08, only the effective portion of backlight 169 is turned on, and the process proceeds to step S09.

  In step S09, it is determined whether or not a size change operation has been detected. When two positions are detected at the same time on the touch panel 163, the size change operation is detected when the position of the lower right vertex of the image of the part in the screen displayed at step S01 is detected on the touch panel 163. If a resize operation is detected, the process proceeds to step S10. If not, the process proceeds to step S11. In step S10, a size change process is executed, and the process returns to step S02. Details of the size changing process will be described later.

  In step S11, it is determined whether a movement operation has been detected. When the position in the image of the component in the screen displayed in step S01 is continuously detected for a predetermined time on touch panel 163, a predetermined position determined in advance in the image of the component in the screen displayed in step S01 When the position of a part different from the image of the part is detected in the screen displayed in step S01, the moving operation is detected. If a moving operation is detected, the process proceeds to step S12. If not, the process returns to step S02. In step S12, a movement process is executed, and the process returns to step S02. Details of the movement process will be described later.

  FIG. 9 is a flowchart illustrating an example of the flow of the effective part determination process. The effective portion determination process is a process executed in step S07 in FIG. Referring to FIG. 9, it is determined whether or not the position detected in step S02 in FIG. 8 is within the pop-up screen in the screen displayed in step S01 in FIG. 8 (step S21). If the popup screen is instructed, the process proceeds to step S22; otherwise, the process proceeds to step S23. In step S22, the pop-up screen is determined as an effective portion, and the process returns to the display control process.

  In step S23, it is determined whether or not the position detected in step S02 in FIG. 8 is within the icon on the screen displayed in step S01 in FIG. If the inside of the icon is instructed, the process proceeds to step S24; otherwise, the process proceeds to step S25. In step S24, the icon is determined as an effective portion, and the process returns to the display control process.

  In step S25, a predetermined range is determined as an effective portion from the position detected in step S02 of FIG. 8, and the process returns to the display control process.

  In the effective portion determination process, it is possible to determine a plurality of icons as effective portions.

  Next, the size change process executed in step S10 in FIG. 8 will be described. The size change process is executed when one of the two types of size change operations is detected in step S09 in FIG. 8, but the size change process corresponding to each of the two types of size change operations is different. Explained. Specifically, the first size changing process executed when two positions are detected simultaneously on the touch panel 163, and the position of the lower right vertex of the part image on the screen are detected on the touch panel 163. The second size change process to be executed will be described.

  FIG. 10 is a flowchart illustrating an example of the flow of the first size change process. Referring to FIG. 10, it is determined whether or not two positions are simultaneously detected on touch panel 163 (step S31). At the time when the resize operation is accepted, since two positions are simultaneously detected on the touch panel 163, it is determined that the two positions have been detected, and the process proceeds to step S32.

  Then, it is determined whether or not a reference distance is set. The reference distance is a distance between two positions detected simultaneously on the touch panel 163 at the time when the resize operation is detected. If the reference distance is set, the process proceeds to step S34. If the reference distance is not set, the process proceeds to step S33. In step S33, a reference distance is set, and the process proceeds to step S45. When the resize operation is detected, the distance between the two positions detected simultaneously on the touch panel 163 is set as the reference distance.

  In step S34, a reference distance is calculated. The distance between the two positions detected in step S31 is calculated as a reference distance. Next, a magnification is calculated (step S35). The magnification is calculated by dividing the reference distance by the standard distance. Then, by enlarging or reducing the component image at the calculated magnification, the size of the component image is changed and displayed on the display unit 167 of the LCD 161 (step S36). The parts to be processed are parts determined as effective parts in the effective part determination process shown in FIG. When step S22 is executed, a pop-up screen is displayed. When step S24 is executed, an icon is displayed.

  In the next step S37, it is determined whether or not the first magnification is stored. Since the first magnification is stored in step S38, the first magnification is not stored when step S37 is first executed. If the first magnification is stored, the process proceeds to step S39; otherwise, the process proceeds to step S38. In step S38, the magnification calculated in step S35 is stored as the first magnification, and the process proceeds to step S45.

  In step S39, the magnification calculated in step S35 is set to the second magnification. In the next step S40, a prediction magnification is calculated based on the first magnification and the second magnification. Specifically, assuming that the first magnification is M1 and the second magnification is M2, the predicted magnification M3 is calculated by the above equation (1).

  Then, the size of the effective portion is changed by the prediction magnification (step S41), and the effective portion after the size change is determined as the predicted portion (step S42). In step S43, only the predicted portion of the backlight 169 is turned on, and the process proceeds to step S44. In step S44, the second magnification is stored in RAM 114 as the first magnification, and the process proceeds to step S45.

  In step S45, it is determined whether or not the resize operation has been completed. When the two positions are not detected at the same time on the touch panel 163, or when the two positions are detected at the same time on the touch panel 163 but the distance between the two positions is not changed, the resize operation is finished. Judge. If the resize operation is completed, the process returns to the display control process. If not, the process returns to step S31.

  FIG. 11 is a flowchart illustrating an example of the flow of the second size change process. Referring to FIG. 11, the difference from the first size changing process shown in FIG. 10 is that steps S31 to S35 are changed to steps S51 to S55, and step S45 is changed to step S45A. is there. Since other processes are the same as those shown in FIG. 10, the same reference numerals are given and description thereof will not be repeated here.

  In step S51, it is determined whether a predetermined position has been detected. It is determined whether or not the touch panel 163 has detected the position of the lower right vertex of the component image on the screen. At the time when the resize operation is accepted, the position of the lower right vertex of the component image on the screen is detected on the touch panel 163, so the process proceeds to step S52.

  In step S52, a reference distance is set. Since the position of the lower right vertex of the component image on the screen is detected on the touch panel 163, the distance between the upper left vertex corresponding to the lower right vertex of the component image and the lower right vertex is used as a reference. Set to distance.

  In the next step S53, the position is detected. A position newly detected on the touch panel 163 is acquired. Then, a reference distance is calculated. The distance between the position detected in step S53 and the position of the top left vertex of the component image is set as the reference distance. Then, the magnification is determined (step S55), and the process proceeds to step S36.

  In step S45A, it is determined whether or not the resize operation has been completed. When the position is no longer detected by the touch panel 163, or when the same position is continuously detected by the touch panel 163 a predetermined number of times, it is determined that the resize operation has ended. If the resize operation is completed, the process returns to the display control process. If not, the process returns to step S53.

  FIG. 12 is a diagram illustrating an example of the flow of movement processing. The movement process is a process executed in step S12 of FIG. Referring to FIG. 12, CPU 111 sets a pre-movement position. Before the movement process is executed, the movement operation is detected in step S11 of FIG. Specifically, when the position in the image of the component on the screen is continuously detected for a predetermined time on the touch panel 163, when the predetermined position is detected in the image of the component on the screen, or When the position of a part different from the part image is detected on the screen, the moving operation is detected. For this reason, when a movement operation is detected, a predetermined position is detected on the touch panel 163. For this reason, the position detected by the touch panel 163 when the movement operation is detected is set as the position before movement.

  In the next step S62, the position designated by the user is detected. A position newly detected by the touch panel 163 is detected. Then, the position detected in step S62 is set as the post-movement position.

  In the next step S64, a movement vector is calculated based on the position before movement and the position after movement. The movement vector includes a direction from the pre-movement position to the post-movement position, and a scalar amount that is a distance between the pre-movement position and the post-movement position. In the next step S65, it is determined whether or not a part is selected. When step S22 of FIG. 9 is executed and the pop-up screen is determined to be an effective portion, it is determined that the pop-up screen is selected, and when step S24 is executed and the icon is determined to be an effective portion. , It is determined that the icon is selected. If a part has been selected, the process proceeds to step S66; otherwise, step S66 is skipped and the process proceeds to step S67. In step S66, the selected part is moved and displayed, and the process proceeds to step S67. The component image is moved in a direction determined by the movement vector by a scalar amount determined by the movement vector.

  In step S67, it is determined whether or not the first movement vector is stored. Since the first movement vector is stored in step S68, the first movement vector is not stored when step S67 is first executed. If the first movement vector is stored, the process proceeds to step S69. If not, the process proceeds to step S68. In step S68, the movement vector calculated in step S64 is stored in RAM 114 as the first movement vector, and the process proceeds to step S75.

  In step S69, the movement vector calculated in step S64 is set as the second movement vector. Then, a prediction vector is calculated (step S70). The prediction vector is a vector obtained by subtracting the first movement vector from the second movement vector. In the next step S71, the effective portion is moved according to the prediction vector. The effective portion is moved in a direction determined by the prediction vector by a scalar amount determined by the prediction vector.

  In step S72, the effective part after movement is determined as the predicted part, and the process proceeds to step S73. In step S73, only the predicted portion of backlight 169 is turned on, and the process proceeds to step S74. In step S74, the second movement vector is stored in RAM 114 as the first movement vector, and the process proceeds to step S75.

  In step S75, it is determined whether or not the moving operation has been completed. When the position is no longer detected on the touch panel 163, or when the position is detected on the touch panel 163 but the detected position does not change, it is determined that the moving operation is finished. If the moving operation is completed, the process returns to the display control process. If not, the process returns to step S62.

  FIGS. 13A to 13D are diagrams for explaining the movement operation. FIG. 13A is a diagram illustrating an example of the operation screen. The operation screen 300 includes buttons 301 to 307 to which commands for selecting parts are assigned. When any of the buttons 301 to 307 is instructed, an image of a component assigned to the instructed button is displayed. Here, a case will be described as an example where the button 301 has a popup screen as a component and a command for selecting the popup screen is assigned.

  FIG. 13B is a first diagram illustrating an example when a pop-up screen is displayed. FIG. 13B illustrates an example in which the button 301 is instructed in FIG. Referring to FIG. 13B, the pop-up screen 310 is displayed so as to be superimposed on the operation screen 300. However, since the pop-up screen 310 is set as an effective portion, portions other than the pop-up screen 310 are displayed from the backlight 169. Since no light is irradiated, the display is dark. The pop-up screen 310 includes an area 311 to which a command for selecting the pop-up screen of the numeric keypad is assigned using a pop-up screen of the ten-key pad as a component.

  FIG. 13C is a second diagram illustrating an example when a pop-up screen is displayed. FIG. 13C shows an example in which the area 311 is designated in FIG. Referring to FIG. 13C, the ten-key pop-up screen 320 is displayed so as to be superimposed on the operation screen 300 and the pop-up screen 310. However, since the ten-key pop-up screen 320 is set as an effective portion, the ten-key pop-up screen 320 is displayed. Since portions other than the screen 320 are not irradiated with light from the backlight 169, the display is dark.

  FIG. 13D is a diagram illustrating an example of moving a part image. FIG. 13D shows an example in which the user inputs a move operation by instructing the ten-key pop-up screen 320 on the screen shown in FIG. Referring to FIG. 13D, the ten-key pop-up screen 320 is moved and displayed as a ten-key pop-up screen 320A. Also in this case, since the pop-up screen 320A after the movement is an effective portion, only the effective portion is irradiated with light by the backlight 169, so that power consumption can be reduced.

  FIG. 14A and FIG. 14B are first diagrams illustrating an example where icons are displayed. Referring to FIG. 14A, screen 331 includes eight icons 333, 333A to 333G. Here, the case where the icon 333 is instruct | indicated is shown. In this case, since the icon 333 is set as an effective portion, portions other than the icon 333 are darkly displayed because light is not emitted from the backlight 169.

  FIG. 14B is a first diagram illustrating an example of moving an icon. FIG. 14B illustrates an example in which the user instructs the icon 333 and inputs a movement operation on the screen illustrated in FIG. Referring to FIG. 14B, the icon 333 is moved, and the displayed position is changed. Also in this case, since the icon 333 after the movement is an effective part and only the effective part is irradiated with light by the backlight 169, power consumption can be reduced.

  FIG. 15A and FIG. 15B are second diagrams illustrating an example in which an icon is displayed. Referring to FIG. 15A, screen 331 includes eight icons 333, 333A to 333G. Here, a case where icons 333 and 333A to 333C are instructed is shown. In this case, since the icons 333 and 333A to 333C are set as effective portions, the portions other than the icons 333 and 333A to 333C are not irradiated with light from the backlight 169, and thus are darkly displayed.

  FIG. 15B is a second diagram illustrating an example of moving an icon. FIG. 15B illustrates an example in which the user instructs the icons 333 and 333A to 333C and inputs a movement operation on the screen illustrated in FIG. Referring to FIG. 15B, icons 333 and 333A to 333C are moved to change the displayed position. Also in this case, since the icons 333, 333A to 333C after the movement are effective portions and only the effective portion is irradiated with light by the backlight 169, power consumption can be reduced.

  As described above, MFP 100 functioning as a display device determines an effective part in the screen displayed on display unit 167 of LCD 161, turns on an effective part of backlight 169 of LCD 161, and is detected by touch panel 163. Based on the temporal change of the position, the area occupied by the effective portion after the lapse of a predetermined time is determined as the predicted portion. If only the effective portion of the backlight 169 is lit, the power consumed by the backlight 169 can be reduced. Further, based on the temporal change in the position detected by the touch panel 163, the area occupied by the effective part after the lapse of the predetermined time is determined as the predicted part, and the predicted part of the backlight is turned on while the operation is detected. . If only the effective portion of the backlight 169 is lit, the power consumed by the backlight 169 can be reduced. Furthermore, while the user is instructing the touch panel 163, the predicted portion of the backlight 169 is lit, so the user can determine the position where the effective portion is to be placed while viewing the background image. , Can make the operation easy. As a result, a display device capable of facilitating operation while reducing power consumption can be provided.

  Further, preferably, the touch panel further includes a touch panel control means for detecting a position at a sampling interval determined by a response time of the backlight, and the predicted portion determination means includes two pieces of detection detected continuously at the sampling interval by the touch panel. A predicted portion is determined based on the position, and the predetermined time is determined based on the sampling interval.

  The touch panel 163 detects a position at a sampling interval determined by the response time of the backlight 169, and a predetermined time determined based on the sampling interval elapses based on two positions detected continuously by the touch panel 163 at the sampling interval. After that, the area occupied by the effective portion is determined as the predicted portion. For this reason, an effective part can be lighted efficiently.

  Further, when the temporal change in the position detected by the touch panel 163 is detected as an operation for changing the size of the effective portion as a size changing operation, and the size changing operation is detected, the position detected by the touch panel 163 changes. Based on the speed to perform, the area occupied by the effective portion after a predetermined time is predicted. For this reason, the precision which estimates a prediction part can be improved.

  In addition, when a temporal change in the position detected by the touch panel 163 is detected as a moving operation, and the moving operation is detected, the effective portion is determined based on the speed and direction at which the position detected by the touch panel 163 changes. An area occupied after a predetermined time is predicted. Therefore, a temporal change in position is detected as an operation for moving the effective part, and the predicted part is determined based on the speed and direction in which the position changes with time. For this reason, the precision which estimates a prediction part can be improved.

  In addition, when a part image such as a pop-up screen, a list screen, or an icon is displayed, when the user instructs the part image, an area where the part image is displayed is determined as an effective portion. For this reason, the user can easily select the effective portion because the effective portion is selected simply by designating the part image.

  In addition, since an area within a predetermined range from the position detected by the touch panel 163 is determined as an effective portion, the periphery of the position designated by the user is lit by the backlight 169. For this reason, the user can browse an arbitrary part of the image displayed on the LCD 161.

  In the above-described embodiment, MFP 100 has been described as an example of a display device. However, the display device may be a portable information device such as a PDA, a mobile phone, or the like. Further, the invention can be understood as a display control method for causing the CPU 111 that controls the MFP 100 to execute the display processing shown in FIGS. 8 to 12 and a display control program for causing the CPU 111 to execute the display control method. Needless to say.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

<Appendix>
(1) The display device according to claim 5, wherein the predetermined component is a pop-up screen.
(2) The display device according to claim 5, wherein the predetermined component is reduced image data obtained by reducing image data.

  MFP 100, 51 Display control unit, 53 Touch panel control unit, 55 Operation detection unit, 57 Effective part determination unit, 59 Prediction part determination unit, 61 Backlight control unit, 63 Effective part lighting unit, 65 Prediction partial lighting unit, 71 Component selection , 73 Size change operation detection unit, 75 Moving operation detection unit, 81 Component validation unit, 83 Instruction range validation unit, 110 Main circuit, 111 CPU, 112 Communication I / F unit, 113 ROM, 114 RAM, 115 HDD 116 facsimile unit, 117 external storage device, 120 automatic document feeder, 130 document reading unit, 140 image forming unit, 150 sheet feeding unit, 160, 160A operation panel.

Claims (9)

A liquid crystal display device with a partially lit backlight,
A touch panel that is provided so as to overlap the display surface of the liquid crystal display device and detects a position instructed by a user in the display surface;
Control means for controlling the liquid crystal display device and the touch panel,
The control means includes
Effective portion determining means for determining an effective portion in a screen displayed on the liquid crystal display device;
Effective part lighting means for lighting the determined effective part of the backlight;
Predicted part determining means for determining, as a predicted part, a region that the effective part occupies after elapse of a predetermined time based on a temporal change in a position detected by the touch panel;
And a predictive lighting means for lighting the predicted portion of the backlight while the operation is detected. The touch panel further comprises touch panel control means for detecting the position at a sampling interval determined by the response time of the backlight,
The predicted part determining means determines the predicted part based on two positions detected continuously by the touch panel at the sampling interval,
The display device according to claim 1, wherein the predetermined time is determined based on the sampling interval. Resizing operation detecting means for detecting a temporal change in the position detected by the touch panel as an operation for changing the size of the effective portion as a resizing operation,
The said prediction part determination means predicts the area | region which the said effective part occupies after predetermined time based on the speed which the position detected by the said touch panel changes, when the said size change operation is detected. The display device described in 1. A movement operation detecting means for detecting a temporal change in the position detected by the touch panel as a movement operation for changing the position of the effective portion in the display surface;
The said prediction part determination means predicts the area | region which the said effective part occupies after predetermined time based on the speed and direction where the position detected by the said touch panel changes, when the said movement operation is detected. 4. The display device according to any one of 3. In a state where an image of a predetermined component is displayed on the liquid crystal display device, the image of the component is displayed when the position detected by the touch panel is within an area where the image of the component is displayed. A component selection means for selecting a region that is
The display device according to claim 1, wherein the effective part determination unit determines an area selected by the component selection unit as an effective part.   The effective portion determination means has two or more areas in which the images of the plurality of parts are displayed by the part selection means in a state where the images of the plurality of parts are displayed on the liquid crystal display device. The display device according to claim 5, wherein when selected, the two or more selected regions are determined as the effective portion.   The display device according to claim 1, wherein the effective part determining unit includes an instruction range enabling unit that determines an area in a predetermined range from the position detected by the touch panel as the effective part. A liquid crystal display device with a partially lit backlight,
A display control method that is provided on a display surface of the liquid crystal display device, and that is executed by a display device including a touch panel that detects a position instructed by a user on the display surface,
An effective part determining step for determining an effective part in a screen displayed on the liquid crystal display device;
An effective part lighting step of lighting the determined effective part of the backlight; and
An operation detecting step for detecting a temporal change in the position detected by the touch panel as an operation for changing the size of the effective portion or an operation for changing the position of the effective portion in the display surface;
When the operation is detected, a region occupied by the effective portion after a predetermined time is predicted based on a temporal change in a position detected by the touch panel in the operation, and the predicted region is determined as a predicted portion. A prediction segment determination step;
A lighting control step of lighting the predicted portion of the backlight while the operation is detected. A liquid crystal display device with a partially lit backlight,
A display control program executed by a computer for controlling a display device, comprising: a touch panel that is provided so as to overlap with a display surface of the liquid crystal display device and detects a position designated by a user on the display surface. ,
An effective part determining step for determining an effective part in a screen displayed on the liquid crystal display device;
An effective part lighting step of lighting the determined effective part of the backlight; and
An operation detecting step for detecting a temporal change in the position detected by the touch panel as an operation for changing the size of the effective portion or an operation for changing the position of the effective portion in the display surface;
When the operation is detected, a region occupied by the effective portion after a predetermined time is predicted based on a temporal change in a position detected by the touch panel in the operation, and the predicted region is determined as a predicted portion. A prediction segment determination step;
A display control program for causing the computer to execute a lighting control step of lighting the predicted portion of the backlight while the operation is detected.

Images