JP5246974B2 - Electronic device input device, input operation processing method, and input control program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve operability even while an operation target is under a non-displayed state, by appropriately setting a display area for an operation button or the like that becomes the operation target, and a sensible area for operation in various situations. <P>SOLUTION: The present invention relates to an input device for an electronic apparatus including: a display unit which is capable of displaying an object that is an operation target of an input operation; an input operation unit which accepts a user operation for the object of the operation target; and a control unit which allocates a sensible area which is sensible to the user operation, regarding the object of the operation target. The control unit allocates the sensible area as a first sensible area when the object is to be non-displayed, and allocates the sensible area as a second sensible area when the object is to be displayed. <P>COPYRIGHT: (C)2012,JPO&amp;INPIT

Description

  The present invention relates to an input device of an electronic device that can be used for an input operation in an electronic device such as a mobile phone terminal, a portable information terminal (PDA), a portable music player, and a portable game machine.

  In various electronic devices, recently, in order to improve user operability and reduce the number of mechanical operation buttons, a touch panel is often used as an operation unit for user input operations. When the user touches or presses an arbitrary point on the plane with a finger or the like, this touch panel detects this input operation and detects the coordinates of the input position or detects changes in the coordinates of the input position. In general, a touch panel is arranged in a state where it is overlapped with a display screen such as a liquid crystal display, and the position of various operation buttons (or icons) displayed on the display screen and the coordinates on the touch panel according to the situation. Associate. This eliminates the need to provide a large number of mechanical operation buttons, and only changes the information representing the correspondence between the position of each displayed operation button and the coordinates on the touch panel, and the content displayed on the display screen. The position, number, and shape of the operation buttons can be freely changed without changing the hardware.

  This type of input device is applicable when an input operation (for example, pressing on the touch panel) is detected within a specific operation range that matches the display range of each operation button or icon displayed on the display screen. In general, control is performed so that a command assigned in advance to an operation button or icon to be executed is executed.

  However, in the case of an electronic device having a relatively small display screen such as a mobile phone terminal, for example, the operation buttons and icons displayed on the screen must be reduced, so that the user presses the touch panel particularly with a finger. When the input operation is performed, the range of the area where the operation button to be operated by the user is displayed and the position where the user actually presses with a finger or the like is likely to be shifted. There was a situation in which the user repeatedly pressed the same operation button many times before starting the operation.

  As conventional techniques for solving such problems and improving user operability, for example, techniques disclosed in Patent Document 1, Patent Document 2, Patent Document 3, and Patent Document 4 are known.

  In Patent Document 1, it is disclosed that when a finger approaches the touch panel is recognized by a signal from a camera, an icon near the target position is enlarged and displayed. Thereby, even when the screen is small, when operating the touch panel, each icon can be confirmed in an enlarged state, so that the position can be easily grasped.

  In Patent Document 2, it is disclosed that when the position of the cursor displayed on the screen approaches a target button on the screen, the corresponding button is enlarged and displayed. Thereby, even when the screen is small, when the button on the screen is operated, the button is displayed in an enlarged manner, so that it is easy to align the button and the cursor.

  In Patent Document 3, when a position outside an area of a displayed icon or the like is operated (clicked) with a mouse cursor, the display of the corresponding icon or the like is enlarged, and an area that responds to an input operation is also enlarged. It is disclosed. Thereby, even when the screen is small, it is possible to operate an enlarged icon or the like on the screen, so that it is easy to align the icon and the mouse cursor.

  In Patent Document 4, priority (priority) is assigned to each of a large number of icons displayed on the screen of the touch panel, the size of each icon area is controlled according to the priority, and each icon is actually operated. It is disclosed that the priority of each icon is automatically changed according to the detected frequency. As a result, icons with high priority and icons with high operation frequency are displayed in a large size, so that it is easy to align each icon with a finger.

JP 2006-236143 A JP-A-8-16353 JP-A-9-251341 JP-A-9-54657

  By the way, it is a device that displays visible information (display elements constituting a graphical user interface: also called widgets) such as operation buttons and icons on a screen for operations using a touch panel or a mouse cursor. However, the display may be temporarily deleted.

  For example, when displaying a moving image such as a TV program or a still image content such as a photograph on a relatively small screen, the display of each operation button or icon is annoying for the user when viewing the content. Since there is a high possibility, even an operation button that can be operated on the screen is switched to the non-display state, waits for an input operation from the user, and the operation button is hidden only when an operation is actually detected. Control to switch from the display state to the display state.

  Therefore, the user can also operate the operation buttons and icons in the non-display state, and may actually operate them. That is, if the user is familiar with the electronic device, the user remembers the position of each operation button in the display state by himself or herself, by pressing the touch panel near the hidden area where the desired operation button is present or Operation is performed using a mouse cursor or the like.

  However, when operating non-display operation buttons and icons, their positions cannot be confirmed with the eyes, and it is necessary to rely only on the user's own memory and intuition. Absent. Further, even when operating the operation buttons and icons in the display state, alignment may be difficult. For example, when the contrast (brightness difference) or color difference between the displayed contents of the operation button displayed on the screen and the background (for example, image) is small, the boundary between the operation button and the background Since it is difficult to distinguish between the buttons, it is difficult to grasp the range in which the operation buttons to be operated are displayed. In addition, the range of operation buttons to be operated even when the shape of the operation buttons is complicated or the contour portion of the operation buttons is not linear or curved (for example, a waveform or a jagged shape). It is difficult to grasp to what area the is.

  The present invention has been made in view of the above circumstances, and in various situations, it is possible to appropriately set the display area of elements such as operation buttons and icons to be operated and the sensitive area for the operation, and the operation target is clearly defined. An object of the present invention is to provide an input device, an input operation processing method, and an input control program for an electronic device that can improve operability even when they cannot be recognized.

An input device of an electronic device according to the present invention relates to a display unit capable of displaying an operation target object of an input operation, an input operation unit that accepts a user operation with respect to the operation target object, and the operation target object. A control unit that allocates a sensitive region that is sensitive to the user operation, and the control unit assigns the sensitive region to the first sensitive region when the object is not displayed, When the object is a display, the sensitive area is assigned as a second sensitive area.
Thus, when the object is not displayed, the sensitive area is assigned as the first sensitive area, and when the object is displayed, the sensitive area is assigned as the second sensitive area. The display area of elements such as buttons and icons and the sensitive area for the operation can be set appropriately, and the operation becomes easy even when the operation target is in the non-display state.

Moreover, this invention is an input device of said electronic device, Comprising: A said 1st sensitive area | region contains a thing larger than a said 2nd sensitive area | region.
In addition, the present invention provides the input device for an electronic device described above, wherein the first sensitive area includes a larger area than the display area of the object.
As a result, even if the object to be operated cannot be clearly recognized by setting the area larger than the display area of the object as the first sensitive area, the user operates a position slightly deviated from the display range of the object. Even if it exists, the input operation can be received and a corresponding process can be performed.

In addition, the present invention provides the input device for an electronic device described above, wherein the second sensitive area includes a size approximately equal to the display area of the object and smaller than the first sensitive area.
As a result, when the object to be operated can be recognized by setting an area that is approximately the same size as the object display area and smaller than the first sensitive area as the second sensitive area, an input suitable for the object display area is used. Only operations can be properly accepted and processed, and erroneous detection during input operations can be prevented.

Moreover, this invention is an input device of said electronic device, Comprising: The said input operation part contains what is a touchscreen.
Further, the present invention is the input device of the electronic device, wherein the operation target object is at least one of a button, a knob, a knob, a switch, a wheel, a slide bar, and an icon that can be displayed by the display unit. Including those that are one.

  The input operation processing method of the present invention relates to a display unit that can display an operation target object of an input operation, an input operation unit that accepts a user operation on the operation target object, and the operation target object. An input operation processing method in an input device of an electronic device, the control unit allocating a sensitive region sensitive to a user operation, wherein, when the object is not displayed in the control unit, the sensitive region is defined as a first sensitive region. When the object is displayed, the step of assigning the sensitive area to the second sensitive area is included.

  Further, the present invention provides a display unit capable of displaying an operation target object of an input operation, an input operation unit that accepts a user operation with respect to the operation target object, and the user operation related to the operation target object. An input control program executable by a computer for performing an input operation process in an input device of an electronic device, the control unit allocating a sensitive region to be sensitive, wherein the input control program includes the object in the control unit An input control program is provided for causing the computer to execute a step of assigning the sensitive area to a first sensitive area when the object is not displayed and assigning the sensitive area to a second sensitive area when the object is displayed.

  Moreover, this invention provides the electronic device carrying the input device in any one of the said.

  According to the present invention, in various situations, it is possible to appropriately set the display area of the operation buttons, icons, and other elements to be operated and the sensitive area for the operation, even if the operation target cannot be clearly recognized. It is possible to provide an input device, an input operation processing method, and an input control program for an electronic device that can improve the performance.

The block diagram which shows the structure of the principal part of the input device of the electronic device in embodiment of this invention The schematic diagram which shows the specific example of the display screen and operation | movement in the input device of 1st Embodiment. The sequence diagram which shows the main operation | movement in the input device of 1st Embodiment The schematic diagram which shows the specific example of the display screen in the input device of 1st Embodiment. Schematic diagram showing a specific example of a command assignment table used in the input device of the first embodiment The flowchart which shows the processing content of the sensitive area | region switching operation | movement in 1st Embodiment. The flowchart which shows the processing content of the input processing operation in 1st Embodiment. The time chart which shows the operation example at the time of the sensitive area change in 1st Embodiment The schematic diagram which shows the specific example of the display screen in the input device of 2nd Embodiment, and a sensitive area | region. The flowchart which shows the processing content of the sensitive area | region switching operation | movement in 2nd Embodiment.

  In the following embodiments, a configuration example applied to a mobile electronic device such as a mobile phone terminal is shown as an example of an input device of the electronic device.

(First embodiment)
FIG. 1 is a block diagram showing a configuration of a main part of an input device for an electronic device according to an embodiment of the present invention.

  The input device of the present embodiment is used for a user to perform an input operation on an electronic device such as a mobile phone terminal, a portable information terminal (PDA), a portable music player, and a portable game machine. This is an assumed device. The input device is mounted on an electronic device and includes a touch panel having an input function by a touch operation such as touching or tracing on an input surface on a display unit.

  The input device 1 illustrated in FIG. 1 includes a touch panel 10, a display unit 30, an application 100, an input signal analysis unit 200, an input signal control unit 300, a setting control unit 400, and a screen display control unit 500. In addition, an electronic device equipped with the input device 1 is provided with a device to be controlled 50 such as an audio signal output amplifier and an audio output unit such as a speaker or headphones.

  The touch panel 10 is an input device for operation, includes a transparent pressure-sensitive sheet formed in a flat shape, and periodically outputs a signal representing the presence or absence of contact on the surface of the pressure-sensitive sheet and the coordinate information of the position where the contact is detected. To output automatically. Therefore, when the user presses (touches) the surface of the pressure sensitive sheet with his / her finger or stylus pen, a signal indicating contact and coordinate information of the input position are output. Note that the touch panel 10 may be configured using a detection element other than a pressure-sensitive sheet, such as an electrostatic touch panel, as long as it can detect the presence or absence of contact and the coordinates of the touched input position.

  The display unit 30 is a device capable of displaying various visible information such as characters, graphics, and images on a flat display screen, and is configured by a liquid crystal display device or the like. The touch panel 10 is arranged on the display screen of the display unit 30 so as to form an input surface. Therefore, the user can touch a specific position on the touch panel 10 (a position where an operation button or the like is displayed) while confirming the content of the display screen of the display unit 30 with the light transmitted through the touch panel 10. In addition, although the display of each operation button may be temporarily deleted from the display screen of the display unit 30 to be in a non-display state, an input operation can also be performed on the operation button in the non-display state.

  The application 100 is an interface for exchanging various data, control information, and the like between an upper individual application program (for example, a program that provides a music playback function) and an input device 1 that provides a function for input operation. This is a program (middleware) that provides The application 100 executes a corresponding command based on the control signal notified from the input signal analysis unit 200 and gives an instruction to the setting control unit 400 and the screen display control unit 500. At this time, the display state / non-display state of each operation button on the display screen of the display unit 30 is also managed.

  The input signal control unit 300 controls reception of a signal output from the touch panel 10 that is an input device. Specifically, whether or not the signal input from the touch panel 10 is noise is detected, and when an appropriate signal that is not noise is detected, the input position on the input surface is detected, the presence or absence of contact, and the coordinates of the contacted position Is sent to the input signal analysis unit 200 at regular intervals.

  The input signal analysis unit 200 analyzes information input from the input signal control unit 300, thereby associating the contents of the user's input operation with a pre-assigned command and instructing execution of the corresponding command. Output a signal. Specifically, an operation state corresponding to a simple button press (contact on), an operation state indicating release of the press (contact off), and a movement trajectory when moving the contact position while pressing (contact position The operation content such as displacement) and the coordinates (input coordinates) of these operation positions are detected. In addition, the size of the area that responds to user input for each operation button is switched depending on whether the corresponding operation button is in a display state or a non-display state. More detailed operation will be described later. The analysis result of the input signal analysis unit 200 is input to the setting control unit 400 or the screen display control unit 500 via the application 100.

  The setting control unit 400 manages various parameters used when the electronic device operates and controls the target unit. For example, the setting control unit 400 manages volume adjustment parameters for adjusting the volume when playing music, sound quality adjustment parameters for adjusting sound quality, and the like. Then, these parameters are given to the control target device (for example, amplifier) 50.

  The screen display control unit 500 controls the display of the operation target object on the display screen of the display unit 30, and displays the operation button as an example of the operation target object with visible information (an image similar to a physical operation button). Display control such as display as display content) or deletion of the display. In addition, a brightness adjustment parameter for adjusting the brightness on the display screen of the display unit 30 is managed, and the display unit 30 is controlled. In this embodiment, an operation button will be described as an example of an operation target object. However, various operation target objects such as buttons, knobs, knobs, switches, wheels, slide bars, and icons are visible in the operation target object. Includes information to be displayed.

  In the above configuration, the input signal analysis unit 200, the input signal control unit 300, the setting control unit 400, and the screen display control unit 500 realize the function of the input control unit. Among these, the input signal control unit 300 is the input position detection unit. Realize the function.

  When performing volume adjustment (volume adjustment), the value of the volume adjustment parameter is input from the setting control unit 400 to the audio signal output amplifier as the control target device 50 as a control signal for adjusting the gain. For example, when the user performs an input operation for volume adjustment on the touch panel 10, the input signal analysis unit 200 recognizes this input operation, and the recognition result is input to the setting control unit 400 via the application 100. The volume adjustment parameter in the setting control unit 400 is changed. As a result, the gain of the amplifier to be controlled changes, and the output volume from the audio output unit changes.

  FIG. 2 is a schematic diagram illustrating a specific example of a display screen and an operation in the input device according to the first embodiment. A specific example of the operation of the input device according to the first embodiment will be described with reference to FIG. As shown in FIG. 2, the display unit 30 displays an operation button 32 that is visible information having a circular shape imitating a volume operation knob on the display screen 31. The user can operate the touch panel 10 while viewing the display content of the screen, that is, the visible information of the operation buttons 32 on the touch panel, by the light transmitted through the touch panel 10 overlapping the screen.

  In the case of a general device, as shown in FIG. 2B, the range of the operation button 32 displayed on the display screen 31 and the area of the touch panel 10 that is sensitive to the operation input with the finger 33 from the user. It is controlled so as to match the range of. Further, for example, in a situation where the user hardly performs an input operation, control is performed so that the display of the unnecessary operation button 32 is temporarily deleted. Even when the operation button 32 is erased from the display screen 31, the user can perform an input operation on the operation button 32. That is, if the user is familiar with the electronic device, the user stores the approximate position where the operation button 32 is present, and therefore the operation button 32 that is invisible and not visible is stored. You can touch and operate with intuition. When the operation position matches the position of the operation button 32, the input device accepts an input operation.

  However, when operating the non-displayed operation button 32 that cannot be seen with the eyes, the user operates depending on the memory and intuition, so that there is a high possibility that a positional shift will occur. As a result, in order to realize a desired operation, the user repeats the same input operation many times while moving his finger little by little, and the operability may not be good.

  Therefore, in the input device according to the present embodiment, the region sensitive to the corresponding operation button 32 is automatically switched according to whether the operation button 32 is in the display state or the non-display state. For example, as shown in FIG. 2A, when the operation button 32 is in the display state, a sensitive area A2 (second sensitive area) that matches the area where the operation button 32 is displayed (inside the outline of the button). Are assigned as areas sensitive to input operations. When the operation button 32 is in the non-display state, a sensitive area A1 (first sensitive area) larger than the area A2 where the operation button 32 is displayed is assigned as an area sensitive to the input operation.

  Also, when the input operation is performed while the operation button 32 is in the non-display state, when the operation button 32 is switched from the non-display state to the display state, switching from the sensitive area A1 sensitive to the input operation to the A2 is performed for a predetermined time. Even if it is delayed in time or an input outside this sensitive area is detected, if it moves within the predetermined time, it is controlled so as to be accepted as a series of input operations.

  FIG. 2C shows a specific example of the user input operation and the state transition of the display screen. In the display screen 31a on the left side in the drawing, the operation button 32 is not displayed, and a sensitive area A1 larger than the outline of the operation button is sensitive to the input operation. In this state, when the user starts an operation from a wide position slightly deviated from the button position by the finger 33, the operation button 32 is changed to the display state in accordance with the input operation of the user as in the display screen 31b in the center of the drawing. When the operation button 32 changes to the display state, the user can accurately grasp the position of the operation button to be operated. Therefore, the trajectory of the operation position can be corrected and the movement trajectory 34 can be converged within the display area of the operation button 32. Is possible. In this state, the area sensitive to the input operation is switched from the sensitive area A1 larger than the operation button to the sensitive area A2 inside the outline of the operation button. Then, as in the display screen 31c on the right side in the figure, by continuing the circular rotation operation with respect to the operation button 32, it is possible to perform continuous state change input operations such as volume adjustment.

  In this embodiment, a continuous input operation such as a circular motion continuous operation that rotates around the operation button is performed, and the volume, sound quality, brightness, and playback for the continuous operation as commands corresponding to this input operation Description will be made assuming that the state such as the position is continuously changed.

  Next, a specific processing procedure of the input device according to the first embodiment will be described with reference to FIG. FIG. 3 is a sequence diagram showing main operations in the input apparatus according to the first embodiment.

  When the user touches the touch panel 10 to perform an input operation, the operation detection signal SG1 including coordinate information indicating an input position on the touch panel 10 is input to the input signal control unit 300 when the touch operation is performed on the touch panel 10. Are output at regular intervals. The input signal control unit 300 removes noise from the operation detection signal SG1 output from the touch panel 10 and gives only effective information to the input signal analysis unit 200 as the operation signal SG2. The input coordinate information from the touch panel 10 is continuously notified to the input signal analysis unit 200 via the input signal control unit 300 between the components T shown on the right side of FIG.

  The input signal analysis unit 200 analyzes the command associated with the current input operation in step S1. That is, the input position and its movement locus are detected based on the input operation signal SG2, and the corresponding command is determined using the command assignment table 210 that is set and held in advance.

  At this time, the input signal analysis unit 200 first obtains input coordinates indicating the input position when the operation is started, and an operation button corresponding to the coordinate position is defined with reference to the command assignment table 210. Determine whether or not. Here, when the operation button is in the non-display state, the input operation is accepted in a sensitive area (A1 in FIG. 2) wider than the area of the area where the operation button is displayed. If there is a corresponding operation button, the input signal analysis unit 200 selects a command assigned to the operation button, gives command information to the application 100, and causes the corresponding command to be executed. The command execution timing is executed at a predetermined time interval in the case of an input by an operation in which input coordinates continuously change, and is executed when the user's finger leaves the touch panel 10 in the case of an input by a single operation.

  At this time, the command signal SG3 corresponding to the input operation is given from the input signal analysis unit 200 to the application 100, and the display control signal SG5 is given from the application 100 to the screen display control unit 500 to control the display switching of the operation buttons. The setting control signal SG4 is given from the application 100 to the setting control unit 400, and the value of the parameter corresponding to the command is changed.

  Further, the input signal analysis unit 200 activates a timer that measures the switching timing of the sensitive area, and until the timer expires, the command associated with the input operation by the large sensitive area A1 is the same as before the operation button is displayed. Is analyzed. That is, with the detection of the user's operation start, the screen display control unit 500 is instructed to switch the non-display state operation button to the display state. Area switching (switching from A1 to A2) is delayed in time.

  For example, in the example of FIG. 3, even in the command analysis in step S2 following step S1, if the timer is not expired, the input signal analysis unit 200 is the large sensitive area A1 that is the same sensitive area as before the operation button is displayed. The input operation is accepted by. Thereafter, when the elapse of a predetermined time is detected by the timer, the input signal analysis unit 200 switches the area for receiving the input operation to the small sensitive area A2, and determines whether or not the same input operation continues in subsequent steps S3 and S4. In addition, the input operation is accepted only for the range of the sensitive area A2 equivalent to the button display area (outline) which is the same sensitive area as after the operation button is displayed. In steps S3 and S4, when the input operation is continued, the command information of the same command is output and the corresponding command is executed again. When the interruption of the input operation is detected, a new input operation is performed. judge.

  FIG. 4 is a schematic diagram illustrating a specific example of a display screen in the input device according to the first embodiment. 4, (a) is an operation button displayed on the display screen 31 of the display unit 30, (b) is a sensitive area A1 larger than the operation button, and (c) is a sensitive area having the same size as the operation button. A2 is shown respectively. On the display screen 31 of the display unit 30, circular operation buttons 32a and 32b simulating a volume operation knob are arranged. In the input signal analysis unit 200, the command assignment table 210 is referred to in steps S1, S2, S3, and S4 in FIG. 3, and the sensitive area A1 (non-display state) in FIG. In the case of the above), or the command corresponding to the touch panel operation is determined by the sensitive area A2 (in the display state) of FIG.

  FIG. 5 is a schematic diagram illustrating a specific example of a command assignment table used in the input device according to the first embodiment. FIG. 5 shows the contents of the command assignment table 210 corresponding to each operation button of FIG. In the command assignment table 210, as information associated with each input operation, for each operation button, information indicating the shape of the operation button, the coordinate position (X, Y) and size (radius R) of the operation button. The operation button display range, the operation content corresponding to the operation button (tapping, rotation, etc.), and the type of command to be executed (button X, button Y, etc.) are registered. Therefore, in step S1 and the like of FIG. 3, the command to be executed can be specified by referring to the contents of the command assignment table 210 and comparing with the input coordinates and movement trajectory of the input operation signal SG2. .

  In the present embodiment, as other control parameters in the input signal analysis unit 200, the sensitive area enlarged width (for example, 50 dots) before the operation button is displayed, the sensitive area enlarged width (for example, 0 dots) after the display, the sensitive area Change timing delay time (for example, 500 msec) is set. In this example, before the operation button is displayed, the operation position is sensitive even if it is outside 50 dots from the button outline, and after the operation button is displayed, it is sensitive within the button outline according to the button size. Switch. At this time, the sensitive area is changed (narrowed) after 500 msec has elapsed after the operation button is displayed, and a little margin is provided so that the user can correct the trajectory of the operation position.

  For example, when the operation button is in a non-display state, when an input operation is detected in the sensitive area A1 where the coordinate position is X = 100 to 300 and Y = 0 to 250, the corresponding operation button 32a (button X). It is determined that an operation has been performed, and the command assigned to the operation button is determined as an execution target. On the other hand, when the operation button is in the display state, when an input operation is detected in the sensitive area A2 where the coordinate position is X = 150 to 250 and Y = 100 to 200, the corresponding operation button 32a (button X) is displayed. It is determined that an operation has been performed, and the command assigned to the operation button is determined as an execution target.

  As a result of analyzing the input operation in step S1 of FIG. 3, when the command associated with the input operation is recognized as a “volume adjustment (volume increase)” command, the input signal analysis unit 200 performs the volume adjustment. Is given to the application 100 as a command to increase the volume. In this case, the application 100 gives a setting control signal SG4 for increasing the volume to the setting control unit 400 in accordance with the command signal SG3, and changes the value of the volume adjustment parameter. As a result, the volume adjustment parameter in the setting control unit 400 is increased by one step from the current volume value.

  When the user's input operation continues (the finger touches the touch panel 10 continues), the input signal analysis unit 200 performs steps S2, S3, and S4 according to the input operation signal SG2. The command analysis and continuation determination of the input operation are executed, and the determination result is given to the application 100. Here, when the input operation corresponding to the volume adjustment (volume increase) is continued, the volume increase command signal SG3 is input from the input signal analysis unit 200 to the application 100 every predetermined time or every predetermined displacement. As a result, the setting control signal SG4 for increasing the volume is sequentially input from the application 100 to the setting control unit 400, and the value of the volume adjustment parameter is updated and incremented by one level (5 → 6 → 7 in the example of FIG. 3). .

  Hereinafter, a more detailed operation of the present embodiment will be described with reference to FIGS. FIG. 6 is a flowchart showing the processing contents of the sensitive area switching operation in the first embodiment, and FIG. 7 is a flowchart showing the processing contents of the input processing operation in the first embodiment. Here, the process shown in FIG. 6 is repeatedly executed mainly in the input signal analysis unit 200 periodically with a short period. 7 is mainly executed when the input signal analysis unit 200 detects an input operation on the touch panel 10, and includes command analysis steps S1 and S2 and continuation determination step S3 in FIG. , S4 and the like are performed.

  In step S <b> 11 of FIG. 6, the input signal analysis unit 200 checks the state of the operation buttons 32 that can be displayed on the display screen 31 of the display unit 30 via the screen display control unit 500, and determines whether it is a display state or a non-display state. To do. If it is in the display state, the process proceeds to step S12, and if it is in the non-display state, the process proceeds to step S14.

  In step S12, the input signal analysis unit 200 checks whether or not the elapsed time after the operation button 32 is switched from the non-display state to the display state has reached a predetermined time T1 (for example, 500 milliseconds), and the time T1 has elapsed. If so, the process proceeds to step S13. If the time T1 has not elapsed, the process proceeds to step S14.

  In step S13, when the operation button 32 is in the display state, the input signal analysis unit 200 is equivalent to the inside of the outline of the display range of the operation button 32 as the sensitive area of each operation button 32 (area sensitive to the input operation). Is assigned a sensitive area A2 (see FIG. 2A).

  In step S14, when the operation button 32 is in a non-display state, the input signal analysis unit 200 sets a sensitive area A1 (see FIG. 2A) as a sensitive area of each operation button 32 by a predetermined amount larger than the display range of the operation button 32. )).

  In step S15, the input signal analysis unit 200 identifies whether or not the predetermined time T3 has elapsed since the last input operation was detected, and if no new input operation is detected after the time T3 has elapsed, Step S16 is executed.

  In step S16, the screen display control unit 500 deletes the operation button 32 in the display state from the display screen 31, and switches to the non-display state. That is, when the state where the user does not perform the input operation continues for the time T3, the operation button 32 is automatically switched to the non-display state.

  On the other hand, in step S21 of FIG. 7, the input signal analysis unit 200 determines whether or not an input operation has been detected, and proceeds to step S22 if detected. That is, based on the operation signal SG2 output from the input signal control unit 300 based on the operation detection signal SG1 output from the touch panel 10, it is determined whether the input signal analysis unit 200 has detected an input operation.

  In step S <b> 22, the input signal analysis unit 200 activates a timer used for determining the elapsed time from the start of operation. This timer corresponds to the timer shown in FIG. 3, and counts the time T1 in FIG. 6, the time T2 in FIG.

  In step S <b> 23, the input signal analysis unit 200 compares the coordinates of the input position detected by the touch panel 10 with the range of the sensitive area related to each operation button 32 registered in the command assignment table 210. As described above, this sensitive area is sequentially assigned in step S13 or step S14 in FIG.

  As a result of the comparison in step S23, when the input signal analysis unit 200 detects an operation at a position inside the sensitive area, the process proceeds from step S24 to step S25, and when an operation at a position outside the sensitive area is detected. The process proceeds from step S24 to step S27.

  In step S <b> 25, the screen display control unit 500 switches the operation button 32 in the non-display state to the display state when an operation corresponding to the operation button 32 is detected based on an instruction from the input signal analysis unit 200. Therefore, if the operation button 32 has been erased from the screen so far, the operation button 32 is displayed on the screen again with the execution of step S25 by the button operation detection.

  In step S26, the input signal analysis unit 200 refers to the contents of the command assignment table 210, identifies a specific command associated with the operation button 32 that matches the operation position, and executes this command.

  In step S27, the input signal analysis unit 200 monitors the operation position information and determines whether the operation position is moving. If the operation position is moving, the next step S28 is executed.

  In step S28, it is determined whether or not a predetermined time T2 (for example, 1 second) has elapsed since the start of the operation. If the time T2 has not elapsed, the process returns to step S23. If the position outside the sensitive area of the operation button 32 is operated even after the time T2 has elapsed, the operation position is not corrected and is normal. This processing is terminated assuming that the current operation is not continued.

  By the above processing, when the operation button 32 is actually displayed on the display screen 31, the area A2 is assigned as the sensitive area of the operation button 32 in step S13 of FIG. By operating within the range of the operation button 32, a command assigned to the operation button can be executed.

  Further, when the operation button 32 is in the non-display state, the area A1 is assigned as the sensitive area of the operation button 32 in step S14 in FIG. 6, and therefore a range wider than the display range of the operation button 32 stored by the user. The input operation will be accepted. In this case, even if the user's operation position is slightly shifted from the range of the non-display operation button 32, the command for the corresponding operation button can be executed.

  Further, even when the operation button 32 is switched from the non-display state to the display state, step S14 of FIG. 6 is executed until the predetermined time T1 has elapsed from that point, so that the range of the sensitive region for accepting the input operation is abrupt. It can be prevented from changing. That is, it is possible to prevent the user from feeling uncomfortable by not changing the sensitive area until the user recognizes the operation button 32 actually displayed and recognizes that the situation has changed.

  FIG. 8 is a time chart showing an operation example when the sensitive area is changed in the first embodiment. In the operation example shown in FIG. 8, when an input operation of the user is detected at time ta1, an operation button that has been hidden and hidden until then is displayed in response to this operation. Here, in consideration of the influence of processing delay, display device operation delay, and the like, the operation button is actually displayed at time ta2 delayed by several tens of milliseconds from time ta1. In addition, a relatively large sensitive area A1 is assigned as the sensitive area of the operation button for a while after the user starts the operation, but when a time T1 (for example, 500 msec) elapses at time ta3, the sensitive area of the operation button is The area is changed to A2.

  Further, even when the user first operates the outside of the sensitive area of the operation button, if the user moves the finger position so that the inside of the sensitive area is operated within the predetermined time T2, the input signal analyzing unit 200 detects the movement of the input position, determines that the input operation is for the corresponding operation button, and accepts the operation from the beginning as a series of operations. That is, when the operation position moves outside the sensitive region, the process proceeds from step S24 to S27, S28, and S21 in FIG. 7 until the time T2 elapses, so that the monitoring of the movement of the operation position is continued. In step S26, when the movement to the inside of the sensitive area is detected, the input operation is accepted as a series of operations (movement locus, etc.) including the operation at the position outside the sensitive area.

  According to the configuration of the first embodiment, even when the operation button that the user intends to operate is switched between the display state and the non-display state according to the situation, the user operability is ensured in each situation. Can be controlled appropriately.

  In the input device according to the present embodiment, when the operation button is in the non-display state, a larger range than the display state is assigned as the sensitive area. Therefore, the position slightly deviated from the original display range of the operation button or icon is set by the user. Even when an operation is performed, the input operation can be accepted and a corresponding process can be performed. In this case, even when the input position is shifted with respect to the operation button, it is possible to detect the input operation and execute processing corresponding to the operation target. By appropriately setting the display area and the sensitive area of the operation button as in this embodiment, even when the operation button cannot be clearly recognized, it is possible to execute appropriate processing for the operation position. , It is possible to suppress unresponsiveness to input operations and false detection, and greatly improve operability.

  In addition, in the display state of the operation button, by switching the sensitive area so as to assign a sensitive area equivalent to the button size, the input operation corresponding to the operation button can be appropriately accepted and processed, and the operation position by the user can be changed. It is easy to grasp and align. In this case, it is possible to prevent erroneous detection during an input operation. Furthermore, when an operation input is detected, the operation button is displayed or the outline of the operation button is displayed by highlighting or the like so that the user can confirm the reaction to the operation and can clearly recognize the operation target. .

  In addition, when the user performs a continuous operation such as a rotation operation, even if the initial or intermediate operation position temporarily falls outside the sensitive area, the operation position is corrected and moved into the sensitive area within a predetermined time. In such a case, it is possible to appropriately cope with the correction of the operation position of the user by regarding the input operation with respect to the corresponding operation button and detecting it as a series of operations, and the operability can be improved.

(Second Embodiment)
FIG. 9 is a schematic diagram illustrating a specific example of a display screen and a sensitive area in the input device according to the second embodiment.

  The second embodiment is a modification of the first embodiment. Also in the second embodiment, an input device having the same configuration as in FIG. 1 is assumed, but the operation is slightly changed. The changed operation will be described below.

  Even if the operation button 32 is actually displayed on the display screen 31, the outline of the operation button 32 has a low clarity, and it may be difficult for the user to accurately grasp the range. . In the example shown in FIG. 9A, the contour portion of the operation button 32c has a complicated shape, and it is difficult for the user to identify the boundary between the inside and the outside of the display range of the operation button. Therefore, in the second embodiment, when the contour of the operation button is not linear, for example, when the contour portion is ambiguous and cannot be clearly identified, the circular sensitive area A1 larger than the contour of the operation button 32c is sensitive to the input operation. Allocate as space.

  In the example shown in FIG. 9B, since the display of the operation button 32d includes gradation, it is difficult to identify the position of the contour. Therefore, also for the operation button 32d including gradation display, a circular sensitive area A1 larger than the entire display range of the operation button is assigned as an area sensitive to the input operation. In addition, as a form in which the outline of the operation button 32 is low, the display brightness of the operation button is high in addition to the case where the outline portion of the object has a complicated shape or the display of the object includes gradation. The low case includes a case where the contrast between the operation button and the background is low due to the close color tone and brightness of the operation button and the background.

  Here, when the display of the operation button 32 itself changes or the background image changes, such as when highlighting is displayed at the time of an operation input so that the user can grasp the operation on the operation button 32, this is accompanied by this. Thus, the display range of the operation button 32 changes so as to be clear to the user. Therefore, when there is a change in the display of such operation buttons, the sensitive area is switched after a predetermined period.

  In the example shown in FIG. 9C, when the button highlight display 35 is performed as a response process to the operation of the operation button 32c, the outline of the operation button 32c cannot be clearly identified with a complicated shape. However, since the contrast between the operation buttons and the background is increased by the highlight display 35, the display range becomes clear. In this case, initially, a circular sensitive area A1 larger than the contour of the operation button 32c is allocated, and when the highlight display 35 is made after the operation is started, the size is equal to the display range of the operation button (inside the contour). The sensitive area A2 is assigned as an area sensitive to the input operation.

  In the example shown in FIG. 9D, even when the operation button 32d includes gradation and it is difficult to identify the position of the contour, the display range becomes clear by the highlight display 35 after the operation. Also in this case, initially, a circular sensitive area A1 larger than the outline of the operation button 32d is allocated, and when the highlight display 35 is made after the start of the operation, the sensitive area A2 having the same size as the size of the original operation button. Is assigned as an area sensitive to input operations.

  In the example shown in FIG. 4 as well, two operation buttons 32a and 32b are displayed on the display screen 31, but the contour portions of the operation buttons 32a and 32b are formed in a jagged shape or a waveform. In some cases, the waveform portion is large and it is difficult for the user to identify the boundary between the inside and outside of the operation button display range. Even when the contour portion cannot be clearly identified as described above, a sensitive area A1 larger than the contour of the operation button may be assigned as an area sensitive to the input operation as shown in FIG. 4B.

  FIG. 10 is a flowchart showing the processing contents of the sensitive area switching operation in the second embodiment. The process shown in FIG. 10 is repeatedly executed regularly in a short cycle mainly in the input signal analysis unit 200 instead of the process of FIG. 6 in the first embodiment.

  In step S31 of FIG. 10, the input signal analysis unit 200 selects in order to determine each of the plurality of operation buttons 32 registered in the command assignment table 210, and assigns necessary information for each operation button to the command assignment. Obtain from table 210.

  In step S <b> 32, the input signal analysis unit 200 determines whether or not the outline of the display content of the corresponding operation button 32 is a complicated shape. If it is complicated (for example, the shape shown in FIG. 9A), the process proceeds to step S37, and if it is a linear or simple curved shape, the process proceeds to step S33.

  In step S33, the input signal analysis unit 200 determines whether or not the display content of the corresponding operation button 32 has gradation. If it has gradation (for example, the display content as shown in FIG. 9B), the process proceeds to step S37, and if not, the process proceeds to step S34.

  In step S34, the input signal analysis unit 200 acquires display information necessary for each operation button in order to determine the contrast between the display of the corresponding operation button 32 and its background.

  In step S35, the input signal analysis unit 200 determines the level of contrast between the display of the corresponding operation button 32 and its background. When the contrast is relatively low (for example, before highlight display 35 in FIGS. 9C and 9D), the process proceeds to step S37, and when the contrast is high (for example, FIGS. 9C and 9D). ), After the highlight display 35 is made), the process proceeds to step S36. In addition to the contrast, a change or process may be added so as to determine a color difference.

  In step S <b> 36, when the outline of the operation button 32 can be clearly identified, the input signal analysis unit 200 sets the display range of the operation button 32 as the sensitive region of the corresponding operation button 32 (region sensitive to the input operation). A sensitive area A2 (see FIG. 2A) equivalent to the inside of the contour is assigned.

  In step S <b> 37, when it is difficult to identify the contour of the operation button 32, the input signal analysis unit 200 sets a sensitive area A <b> 1 that is a predetermined amount larger than the display range of the operation button 32 as the sensitive area of the corresponding operation button 32 (FIG. 2 (a)) is assigned.

  In step S38, it is determined whether or not the processing of all operation buttons has been completed, and the processing in steps S31 to S37 is repeated for all the operation buttons 32 currently displayed on the display screen 31. The above processing may be performed for all operation buttons 32 registered in the command assignment table 210. If it is detected in step S38 that the process has been completed for all the operation buttons 32, the process is terminated.

  In the second embodiment, in the operation button actually displayed on the display screen, when the contour shape is complicated, or when the operation button display includes gradation, the contrast between the operation button and the background is low. When the user has difficulty in clearly grasping the operation button in a form with low clarity of the operation button outline, the sensitive area A1 larger than the operation button outline is allocated, and the input operation is detected in a large range. It becomes possible. Thereby, even when the user's operation position is slightly shaken, the input device can accept the operation and execute a process corresponding to the operation target. Further, when the operation button is operated and highlighted, and the outline of the operation button is clear, a sensitive area A2 having the same size as the outline of the operation button is allocated. It is easy to understand the range in which operations can be accepted.

  It should be noted that the present invention is not limited to those shown in the above-described embodiments, and those skilled in the art can also make changes and applications based on the description in the specification and well-known techniques. Yes, included in the scope of protection.

  In the above-described embodiment, it is assumed that the input position detection unit detects the coordinates of the input position using the touch panel 10 as the input unit, but any touch panel that has an input function having input position information can be used. Instead of 10, the input position may be detected using another input device such as a mouse, a trackball, or a pen input device for the input unit. For example, display the mouse cursor on the screen, move the display position of the mouse cursor in accordance with the operation of the input device such as the mouse, and recognize the coordinates of the input position for operations such as clicking the display position of the mouse cursor You can also

  Further, the input device of the present embodiment can be configured only by dedicated hardware such as an electronic circuit, or is configured by combining a computer including a control processor and a memory and a program executed on the computer. You can also

  In addition, by mounting the input device of this embodiment on an electronic device such as a speaker, a receiver, a mobile phone terminal having an external AV output, a portable music player, or a portable game machine, The effect of the embodiment can be obtained. For example, the output value of sound such as volume and sound quality, and the operation of selecting the content being output can be easily performed by touching and touching even when objects such as buttons and switches are not displayed. Therefore, it is possible to easily perform an operation intended by the user. In addition, when the content includes an image, it can be easily operated while the object is not displayed while the user does not operate, so that it can be easily operated while enjoying the image, and a useful electronic device can be configured. it can. In addition to the output device such as the speaker, the input device is useful not only for settings inside the electronic device, for example, for selecting a phone book or content, or for browsing a web page.

  In various situations, the present invention can appropriately set the display area of the operation buttons, icons, and other elements to be operated and the sensitive area for the operation, and can improve the operability even when the operation target cannot be clearly recognized. An input of an electronic device that can be used for an input operation in an electronic device such as a mobile phone terminal, a portable information terminal (PDA), a portable music player, and a portable game machine. This is useful in an apparatus, an input operation processing method, an input control program, and the like.

DESCRIPTION OF SYMBOLS 1 Input device 10 Touch panel 30 Display part 31 Display screen 32 Operation button 34 Movement locus 35 Highlight display 50 Control target device 100 Application 200 Input signal analysis part 210 Command allocation table 300 Input signal control part 400 Setting control part 500 Screen display control part A1, A2 Sensitive area

Claims (9)

A display unit capable of displaying an object to be operated in input operation;
An input operation unit that receives a user operation on the operation target object;
A control unit that assigns a sensitive area that is sensitive to the user's operation with respect to the object to be operated;
An input device for an electronic device comprising:
The control unit assigns the sensitive area to a first sensitive area when the object is not displayed, and assigns the sensitive area as a second sensitive area when the object is displayed. An input device for an electronic device according to claim 1,
The input device of the electronic device, wherein the first sensitive area is larger than the second sensitive area. An input device for an electronic device according to claim 1,
The input device of an electronic device, wherein the first sensitive area is larger than the display area of the object. An input device for an electronic device according to claim 1,
The second sensitive area is an input device of an electronic device that is approximately the same size as the display area of the object and smaller than the first sensitive area. It is an input device of the electronic device according to any one of claims 1 to 4,
The input operation unit is an input device of an electronic device which is a touch panel. An input device for an electronic device according to claim 5,
The electronic device input device, wherein the operation target object is at least one of a button, a knob, a knob, a switch, a wheel, a slide bar, and an icon that can be displayed by the display unit. A display unit that can display an operation target object of an input operation, an input operation unit that receives a user operation for the operation target object, and a sensitive area that is sensitive to the user operation related to the operation target object An input operation processing method in an input device of an electronic device comprising a control unit,
In the control unit,
An input operation processing method comprising: assigning the sensitive area to a first sensitive area when the object is not displayed; and assigning the sensitive area to a second sensitive area when the object is displayed. A display unit that can display an operation target object of an input operation, an input operation unit that receives a user operation for the operation target object, and a sensitive area that is sensitive to the user operation related to the operation target object An input control program executable by a computer for performing an input operation process in an input device of an electronic device comprising a control unit,
The input control program is
In the control unit,
An input control program for causing the computer to execute a step of assigning the sensitive area to a first sensitive area when the object is not displayed and assigning the sensitive area to a second sensitive area when the object is displayed.   The electronic device carrying the input device as described in any one of Claims 1-6.

Images