JP5656107B2 - Input device, input method, and program - Google Patents

Description

The present invention relates to an input device , an input method, and a program for performing input processing according to an operation.

In general, when a key (button) arranged on the apparatus main body is operated, in an input device that performs input processing according to the operation, the position of various buttons is fixed, and thus the operation method is different. It will be limited. For example, in a digital camera (compact camera), the release button is basically held at one position where it can be pressed with the index finger of the right hand when holding the camera body with your hand, so hold it with one hand. In order to perform the operation, the holding method is limited and the operation with the right hand is limited.
Therefore, conventionally, a technology has been disclosed in which release buttons are provided at two locations on the left and right sides so that a photographing operation can be performed with either one of the left and right hands (see Patent Document 1). In other words, a right-hand release button and a left-hand release button are provided corresponding to the right-hand and left-hand grips, and the lever that also functions as a power switch is operated to either the left or right grip side, so that the right-hand and left-hand use A technique for selectively using any one of the release buttons is disclosed.

JP 2002-40534 A

  However, even if the release buttons are provided in two places on the left and right as in the prior art described above, the way to hold the camera is not limited as long as the release button is disposed in a fixed position. One-handed shooting with a good holding method is desired. This is not limited to digital cameras (compact cameras), and the same problem occurs for all electronic devices that perform button operations.

  An object of the present invention is to enable operation without being limited to how the apparatus main body is held and held when the operation is performed while holding the apparatus main body by hand.

In order to solve the above-described problem, the invention described in claim 1
An input device that performs input processing according to an operation,
Are disposed on the outer surface of said input equipment, a touch sensor comprising a plurality of areas, said input equipment is in contact with the human body in which region of the plurality in a state of being held in the hand Contact state detection means for detecting the contact state of which region the human body is not in contact with;
Holding state determination for determining the holding state if it is held being held in the hand in any condition the input equipment based on the location of the contact region in which the contact state is detected by the detecting means human body is in contact Means,
An operation region suitable for the holding state determined by the holding state determination unit is selected from non-contact regions that are not in contact with the human body detected by the contact state detection unit, and a touch operation with a predetermined function is performed on the operation region. An assigning means for assigning a part;
With
Of the plurality of regions, the region used for determining the holding state by the holding state determining unit also functions as a region for assigning the touch operation unit having the predetermined function by the assigning unit.
It is characterized by that.

As an invention dependent on claim 1 ,
The holding state determining means has right hand has left hand hand, while discriminating the held state or held in any two-handed, has right hand has left hand hand, the human body which region each two-handed The contact area of whether or not is in contact is determined as a holding state,
The invention according to claim 2, which is configured as described above.

As an invention dependent on claim 1 or claim 2,
Further comprising an attitude detection means for detecting an attitude of the input equipment,
The holding state determining means, when determining the holding state in which the input equipment is given in hand, to determine the holding state for each position of the detected said input equipment by the posture detection means,
The invention according to claim 3, which is configured as described above.

As an invention dependent on any one of claims 1 to 3 ,
The assigning means, when selecting an operation area suitable for the holding state determined by the holding state determination means, selects the non-contact area in the vicinity of a predetermined operation finger as an operation area ;
The invention according to claim 4, which is configured as described above.

As an invention dependent on any one of claims 1 to 4 ,
When the touch operation unit having a predetermined function is assigned to the non-contact area by the assigning means, the display further includes an identification display means for identifying and displaying the area .
The invention according to claim 5, which is configured as described above.

As an invention dependent on claim 5 ,
The touch sensor is configured by a touch screen as a touch screen,
It said identification means, when the touch operation of the predetermined function to the non-contact area is allocated by the allocating means, thereby identifying and displaying the function name of the touch operating unit in the region,
The invention according to claim 6 is characterized in that it is configured as described above.

As an invention dependent on any one of claims 1 to 6 ,
It further comprises an operation mode discriminating means for discriminating the currently switched operation mode from various operation modes,
The assigning unit assigns a touch operation unit having a function of a type corresponding to a current operation mode determined by the operation mode determination unit when assigning a touch operation unit having a predetermined function.
The invention according to claim 7 , characterized in that it is configured as described above.

As an invention dependent on any one of claims 1 to 7 ,
It further comprises imaging means for imaging the subject,
The allocating unit allocates a touch operation unit having a function related to imaging that controls the imaging unit;
The invention according to claim 8, which is configured as described above.

As an invention dependent on any one of claims 1 to 7 ,
Image storage means for storing images;
The assigning means assigns a touch operation unit having a function related to image reproduction in the image storing means;
The invention according to claim 9 , characterized in that it is configured as described above.

As an invention dependent on any one of claims 1 to 7 ,
Further comprising an acquisition means for acquiring an electronic book,
The assigning means assigns a touch operation unit having a function related to browsing of the electronic book obtained by the obtaining means.
Characterized in that as may be the invention of claim 1 0, wherein.

As an invention dependent on any one of claims 1 to 10,
The touch sensor is a plurality of touch sensors disposed on the outer surface of said input equipment,
The contact state detection means detects a contact state of a touch sensor at which position of the plurality of touch sensors and a touch of the touch sensor at which position of the human body is not touched.
The invention according to claim 11, which is configured as described above.

As an invention dependent on any one of claims 1 to 11,
The assigning means assigns touch operation units having different functions corresponding to a plurality of non-contact areas,
The invention according to claim 12 is characterized in that it is configured as described above.
In order to solve the above-mentioned problem, the invention according to claim 13 is
An input device that performs an input process corresponding to the operation, are disposed on the outer surface of said input equipment, an input method of the input device having a touch sensor comprising a plurality of regions,
A contact state detecting step of said input equipment is to detect whether the contact is not in contact with the human body in which area in contact with the human body in which region of the plurality in a state of being held in the hand,
Holding state determination for determining the holding state if it is held being held in the hand in any condition the input equipment based on the location of the contact region in which the contact state body detected by the detection step is in contact Process,
An operation region suitable for the holding state determined by the holding state determination step is selected from non-contact regions that are not in contact with the human body detected by the contact state detection step, and a touch operation with a predetermined function is performed on the operation region. An allocation process for assigning parts,
Including
Of the plurality of regions, the region used for determining the holding state by the holding state determining step also functions as a region to which the touch operation unit having the predetermined function is assigned by the assigning step.
It is characterized by that.

In order to solve the above-mentioned problem, the invention according to claim 14 is
In the computer that controls the input device that performs input processing according to the operation,
Are disposed on the outer surface of said input equipment, a touch sensor comprising a plurality of areas, said input equipment is in contact with the human body in which region of the plurality in a state of being held in the hand A contact state detection function that detects a contact state of which region the human body is not in contact with;
Holding state determination for determining the holding state if it is held being held in the hand in any condition the input equipment based on the location of the contact region in which the human body detected by the contact state detecting function is in contact function,
An operation area suitable for the holding state determined by the holding state determination function is selected from non-contact areas detected by the contact state detection function that are not in contact with the human body, and a touch operation with a predetermined function is performed on the operation area. Assignment function to assign parts,
A program that Ru is realized,
Of the plurality of regions, the region used for determining the holding state by the holding state determining function also functions as a region to which the touch operation unit having the predetermined function by the allocation function is allocated.
It is characterized by that.

  According to the present invention, when performing an operation while holding the apparatus main body by hand, the operation position can be dynamically changed according to the holding state of how the apparatus main body is held and held, It is possible to operate without being limited to the holding state, and the degree of freedom of holding can be enhanced without impairing operability.

The block diagram which showed the basic component of the portable terminal device applied as an input device. The figure which showed the state by which the some touch sensor 10 with a display is arrange | positioned at the outer peripheral edge part of the portable terminal device. The figure for demonstrating the holding | maintenance state table memory | storage part M4. The figure which showed the content of the operation button position table memory | storage part M5 corresponding to camera function imaging | photography mode. The figure which showed the content of the operation button position table memory | storage part M5 following FIG. The figure which showed the content of the operation button position table memory | storage part M5 corresponding to camera function reproduction | regeneration mode. The figure which showed the content of the corresponding operation button position table memory | storage part M5 of an electronic book function. The flowchart which showed the operation | movement outline | summary of the operation | movement of the portable terminal device started execution according to power-on, especially the characteristic part of this embodiment. The flowchart which showed the operation | movement following FIG. The flowchart which showed the operation | movement following FIG. 10 is a flowchart for explaining in detail an operation button position determination process (step A4 in FIG. 8, step A20 in FIG. 9, and step A33 in FIG. 10).

Hereinafter, embodiments of the present invention will be described with reference to FIGS.
FIG. 1 is a block diagram showing basic components of a mobile terminal device applied as an input device.
The portable terminal device is a portable terminal device having a camera function for imaging a subject, an electronic book function for displaying each page of an electronic book (electronic book), a communication function for transmitting and receiving data, and the like. It is configured to operate with 1 as the core. The control unit 1 operates by supplying power from the power source unit (secondary battery) 2 and controls the overall operation of the portable terminal device according to various programs in the storage unit 3. Are provided with a CPU (Central Processing Unit) and a memory (not shown).

  The storage unit 3 has a configuration including, for example, a ROM, a flash memory, and the like, and a program storage in which a program for realizing the present embodiment and various applications are stored in accordance with the operation procedure illustrated in FIGS. Part M1, image storage part M2 for storing many captured images and the like in a predetermined file format, electronic book storage part M3 for storing various electronic books, holding state table storage part M4 and operation button positions to be described later And a table storage unit M5. Note that the storage unit 3 may be configured to include a removable portable memory (recording medium) such as an SD card or an IC card, and is connected to a network via a communication function (not shown). Then, a configuration including a storage area on a predetermined external server side may be adopted.

  The RAM 4 is a work area for temporarily storing various information necessary for the operation of the mobile terminal device, such as flag information and screen information. The display unit 5 has a rectangular shape with different aspect ratios (aspect ratios), and uses, for example, a high-definition liquid crystal display, an organic EL (Electro Luminescence) display, or an electrophoretic display (electronic paper). When the camera function is activated, it functions as a finder screen (monitor screen) that displays captured images (through image: live view image), as a playback screen that displays saved images, and as an electronic book function During the operation, it functions as a browsing screen for displaying the pages of the electronic book.

  Although not shown, the operation unit 6 is a menu button for selecting a camera function, an electronic book function, or the like as various keys (operation buttons) in a push button format, and a mode selection button for selecting switching between a shooting mode and a playback mode. , A button for various functions such as a camera function end button and an electronic book function end button, and a data input button. The control unit 1 performs, for example, a process according to an input operation signal from the operation unit 6. Camera function processing, electronic book function processing, data input processing, and the like are performed.

  The imaging unit 7 is disposed on the opposite side to the side on which the display unit 5 is disposed. Although not illustrated, an imaging element such as an imaging lens, a diaphragm mechanism, a C-MOS, or a CCD is provided. (Area image sensor), optical system drive unit, etc., as well as strobes for illumination, analog processing circuits, signal processing circuits, etc. The control unit 1 executes autofocus processing (AF processing), zoom processing, exposure adjustment processing (AE processing), and executes white balance adjustment as various image processing on the image data from the imaging unit 7. , A compression process is executed, and a decompression process for decompressing and restoring the compressed data is executed. The communication unit 8 performs transmission / reception of image data, electronic book data, and the like by a wide area communication network or near field communication. The control unit 1 receives image data and electronic book data received via the communication unit 8 as an image storage unit. M2 is stored in the electronic book storage unit M3.

  The acceleration sensor 9 is, for example, a three-axis type acceleration sensor that functions as a posture detection unit that detects the posture of the casing (device main body) of the mobile terminal device, and determines the orientation of the display unit 5 with respect to the direction of gravity as the posture of the device main body. Whether the display unit 5 having a different aspect ratio is held in a landscape orientation when the apparatus main body is held by the hand based on the posture detection result. Thus, it is determined whether the display unit 5 is held in a portrait orientation that is in a portrait state. Note that the display unit 5 in the horizontal and vertical directions means a horizontal and vertical direction in a state in which the display content appears to be upright, except for a state in which the display content displayed on the display unit 5 appears to be inverted. The horizontal and vertical orientations of the display unit 5 correspond to the horizontal and vertical orientations of the apparatus main body, which is the attitude of the housing.

  Further, the acceleration sensor 9 functions as a vibration detection unit that detects vibration according to the use of the apparatus main body, and whether the control unit 1 is substantially stationary for a certain time (for example, 1 second) based on the vibration detection result. If it is determined that the camera function or the electronic book function is being used, the camera function or the electronic book function is determined to be in use. In this case, when a strong vibration or a fine vibration is detected within a certain time, it is determined that the vehicle is not stationary. When weak vibrations are detected or large gentle vibrations are detected, it is determined that the object is substantially stationary.

  The plurality of touch sensors with display 10 constitute a touch screen (touch screen) arranged in an annular manner on the outer surface (outer peripheral edge) of the apparatus body, and an operation button display unit (for example, a liquid crystal display panel). A transparent contact detector (for example, a capacitance-type contact detector for detecting human contact) 12 is laminated on 11. The touch sensor with display 10 will be described in detail later with reference to FIG. 2. The adjacent touch sensors with display 10 are arranged in a line at the outer peripheral end of the apparatus main body without a gap. Yes. Based on the contact state of the human body detected by the plurality of touch sensors with display 10, the control unit 1 determines which position of the touch sensor 10 in the state where the apparatus main body is held in the hand among the plurality of touch sensors with display 10. A contact state is detected as to which position of the touch sensor 10 is not touched by a human body touching (touch-on), and the device body is held in a hand based on the contact state. The holding state is determined as to whether it is held.

FIG. 2 is an external view of the portable terminal device, and shows a state in which a plurality of touch sensors with a display (touch screen) 10 are arranged on the outer surface (outer peripheral edge) of the device main body.
The mobile terminal device is entirely oval (egg-shaped), and is located on the front side of the device body, that is, on the opposite side of the display unit side (back side) on which the display unit 5 is disposed. An imaging lens (not shown) constituting the imaging unit 7 is disposed on the surface. A plurality (20 in the present embodiment) of touch sensors 10 with a display are disposed at the outer peripheral end of the apparatus main body so as to surround the display unit 5. In the drawing, the serial numbers “1” to “20” indicate the arrangement order of the 20 touch sensors 10 with display, and when the display unit 5 is in the horizontal state, the hour hand is at the 12 o'clock position. The touch sensor 10 of “1” is arranged, the touch sensor 10 of “6” is arranged at the 3 o'clock position, the touch sensor 10 of “11” is arranged at the 6 o'clock position, and 9 A touch sensor 10 of “16” is disposed at the hour position.

  In this case, the plurality of touch sensors with display 10 are plate members having an L-shaped cross section formed so as to cover the outer peripheral end of the apparatus main body, and are arranged from the back side to the side of the apparatus main body. Note that the width of each touch sensor with display 10 (the size in the direction in which the touch sensors 10 are adjacent to each other) is equal to or smaller than the width of one standard finger (for example, about 1 cm). Hereinafter, the touch sensor with display 10 is simply referred to as a touch sensor 10. In this way, each touch sensor 10 is arranged by bending a plate member into an L-shaped cross section at the outer peripheral end of the apparatus main body, and on either the back side or the side of the outer peripheral end of the apparatus main body. It is configured to detect touch-on even when touched by a hand.

  For example, in the state where the display unit 5 is in the horizontal direction, one of the front side “7” to “10” touch sensors 10 is pressed with the thumb (fingertip) of the right hand, and the back side is pressed with the index finger and middle finger (fingertip) of the right hand. In the holding state where the finger is pressed (one-point holding by three fingers of the right hand), the touch sensors 10 of “7” to “10” that are in contact with the fingers are turned on. Further, when the display unit 5 is in the sideways state, the touch sensors 10 of “4” to “8” on the front side are all pressed by the right thumb and the entire side surface of the base portion, and the back side is pressed by the middle finger of the right hand. In the holding state (holding with two right hands), the touch sensors 10 "4" to "8" with which each finger is in contact are turned on.

  Based on the posture detection result (the orientation of the display unit 5) by the acceleration sensor 9 and the detection result (contact state) of each touch sensor 10, the control unit 1 sets the display unit as a holding state held by the hand. When the display unit 5 is in the landscape orientation, the holding state is any of six types: right hand one hand holding, left hand one hand holding, both hands holding, and when the display unit 5 is in the portrait orientation, right hand one hand holding, left hand one hand holding, both hands holding. I am trying to determine. Further, the control unit 1 determines the relationship of the contact position as to which position the human body is in contact with each hand held by the right hand, left hand, and both hands as a holding state. Even with the same kind of holding method (for example, holding the right hand with one hand), the holding state is determined from the relationship of the contact position because the way of contact differs depending on which finger is used and where it is touched. And the control part 1 selects the touch sensor 10 in the operation position suitable for the now holding | maintenance state from the non-contact touch sensors 10 which the human body does not contact among several touch sensors 10, and the position A touch operation unit (touch key: operation button) having a predetermined function is assigned to the touch sensor 10.

  That is, the control unit 1 selects the non-contact touch sensor 10 in the vicinity of the position of a predetermined operation finger (for example, the index finger) as an operation position suitable for the current holding state of the apparatus main body, A touch operation unit (for example, a release button, an exposure correction button, etc.) having a predetermined function is assigned to the non-contact touch sensor 10 at the operation position. In this case, the function name (symbol) of the assigned button is displayed on the touch sensor 10. For example, as shown in FIG. 2, as a button function name (symbol), a “double circle” symbol is displayed for a release button, and a “+” symbol is displayed for a + direction exposure compensation button. Is displayed, and if the exposure compensation button is in the − direction, a symbol “−” is displayed. In addition, the “>” symbol is displayed for the next image feed button and the next page feed button, and the “<” symbol is displayed for the previous image feed button and the previous page feed button, and the zoom button can be used. For example, a “square” symbol is displayed.

FIG. 3 is a diagram for explaining the holding state table storage unit M4.
The holding state table storage unit M4 determines the holding state in which the apparatus main body is held by the hand based on the detection result by the acceleration sensor 9 (direction of the display unit 5) and the detection result by each touch sensor 10 (contact state). The contents are referred to when performing the operation, and the contents can be arbitrarily set by a user operation. Here, in the example shown in the figure, the control unit 1 has the display unit 5 in the horizontal direction between the touch sensors 10 of “2” to “10” regardless of the camera function shooting mode, the camera function playback mode, and the electronic book function. If the touch of only the touch sensor 10 of "17" to "20" or "1" to "5" is detected when the display unit 5 is detected in the vertical direction The state is determined to be one-handed with the right hand.

  In the illustrated example, the control unit 1 detects that the display unit 5 is in the landscape orientation and only the touch sensor 10 between “12” and “20” is detected, or the display unit 5 is in the portrait orientation. When contact between only the touch sensors 10 of “7” to “15” is detected, it is determined that the holding state is one-hand holding with the left hand. Further, when the display unit 5 is in landscape orientation and contact between both the touch sensors 10 of “2” to “10” and “12” to “20” is detected, or the display unit 5 is in portrait orientation, When contact between both of the touch sensors 10 of “17” to “20” or “1” to “5” and “7” to “15” is detected, the holding state is determined to be held by both hands. Yes.

4 to 7 are diagrams for explaining the operation button position table storage unit M5.
In addition to the holding state determined by referring to the holding state table storage unit M4 as described above, the operation button position table storage unit M5 detects the detection result (the direction of the display unit 5) by the acceleration sensor 9 and each touch sensor. A table for assigning operation buttons of a predetermined function based on the detection result (contact state) of 10 and having table contents corresponding to the camera function shooting mode, camera function playback mode, and electronic book function as described above. . 4 and 5 show the contents of the operation button position table storage unit M5 corresponding to the camera function photographing mode, and FIG. 6 shows the contents of the operation button position table storage unit M5 corresponding to the camera function reproduction mode. Reference numeral 7 denotes the contents of the operation button position table storage unit M5 corresponding to the electronic book function.

  The operation button position table storage unit M5 has a matrix-like table, and the row direction (vertical direction in the figure) of this table is associated with the holding state (six types of holding states described above) of the apparatus main body. ing. That is, the display unit 5 is held in the right-handed one-handed, left-handed one-handed, two-handed state when the display unit 5 is in the horizontal state, the right-handed one-handed hand, the left-handed one-handed device, and the two-handed holding device. When the display unit 5 is in landscape orientation and in portrait orientation, the display unit 5 is held in both hands when the display unit 5 is in landscape orientation and in portrait orientation. 6 types are associated with each other in the landscape orientation and the portrait orientation. In addition, each row for each type is associated with a holding state indicating a contact position relationship indicating which position the human body is in contact with. In this case, even with the same type of holding method, since the way of contact differs depending on which finger is used and where it is touched, a holding state indicating the relationship between the contact positions is associated. Furthermore, in the column direction of the table (the horizontal direction in the figure), 20 touch sensors 10 are associated in the arrangement order. In each matrix cell portion of the table, “◯” indicating that the touch sensor 10 is in contact with the human body is stored. Further, “A”, “B” to “H” in the cell indicate the function names of the buttons assigned to the touch sensor 10.

  As shown in FIGS. 4 and 5, the operation button position table storage unit M5 corresponding to the camera function photographing mode stores “A” to “C” as button function names, and “A” is a release button. , “B” indicates a + direction exposure correction button, and “C” indicates a − direction exposure correction button. In this case, the non-contact touch sensor 10 in the vicinity of the position of the operation finger (for example, the index finger) suitable for the holding state corresponding to the six types described above is set to the release button, the + direction exposure correction button, and the − direction exposure correction. The stored contents are assigned as buttons. For example, when only the touch sensor 10 of “7” is touched as shown in the first line in FIG. 4, or only the touch sensor 10 of “7” and “8” is touched as shown in the second line. In this case, a negative exposure correction button is assigned to the “2” touch sensor 10, a positive exposure correction button is assigned to the “3” touch sensor 10, and a release button is assigned to the “4” touch sensor 10. Is shown.

  As shown in FIG. 6, the operation button position table storage unit M5 corresponding to the camera function playback mode stores “D” to “F” as button function names, where “D” is the next image feed button, “E” indicates a previous image feed button, and “F” indicates a zoom button. In this case, the non-contact touch sensor 10 in the vicinity of the position of the operation finger (for example, the index finger) suitable for the holding state corresponding to the six types described above is assigned as the next image advance button, the previous image advance button, and the zoom button. It has become a memory content. For example, when only the touch sensor 10 of “7” is touched as shown in the first line of FIG. 6 or when only the touch sensor 10 of “8” is touched as shown in the second line. Indicates that a zoom button is assigned to the touch sensor 10 “2”, a next image feed button is assigned to the touch sensor 10 “3”, and a previous image feed button is assigned to the touch sensor 10 “4”.

  As shown in FIG. 7, the operation button position table storage unit M5 corresponding to the electronic book function stores “G” and “H” as the function names of the buttons, where “G” is the next page feed button, “ "H" indicates a previous page feed button. In this case, the storage content is such that the non-contact touch sensor 10 in the vicinity of the operation finger (for example, the index finger) suitable for the holding state corresponding to the six types described above is assigned as the next page feed button and the previous page feed button. ing. For example, when only the touch sensor 10 of “7” is touched as shown in the first line of FIG. 7 or when only the touch sensor 10 of “8” is touched as shown in the second line. Indicates that the next page feed button is assigned to the touch sensor 10 of “3”, and the previous page feed button is assigned to the touch sensor 10 of “4”.

  Next, the operation concept of the mobile terminal device in the present embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. In addition, the operation according to the above-described program code transmitted via a transmission medium such as a network can be sequentially executed. In other words, in addition to the recording medium, an operation unique to the present embodiment can be executed using a program / data supplied externally via a transmission medium.

FIG. 8 to FIG. 11 are flowcharts showing the overall operation of the mobile terminal device, particularly the operation outline of the characteristic part of the present embodiment, and the execution is started in response to power-on.
First, the control unit 1 checks whether the camera function is activated by operating a menu button for selecting a camera function, an electronic book function, or the like (step A1 in FIG. 8), or determines whether the electronic book function is activated. It is checked (step A31 in FIG. 10) or whether another operation has been performed (step A40 in FIG. 10). Here, as other operations, when a communication function for transmitting / receiving data is started, brightness adjustment is instructed, or setting of the holding state table storage unit M4 is instructed (YES in step A40), After performing communication processing, brightness adjustment processing, table setting processing, etc. as processing according to the operation (step A41), the processing returns to the first step A1 in FIG.

  When the camera function is activated (YES in step A1 in FIG. 8), it is checked whether the mode has been switched to the shooting mode or the playback mode by operating the mode selection button (step A2), and the mode is switched to the shooting mode. If it is determined (YES in step A2), it is in a standby state until it is substantially stationary while determining whether it is substantially stationary for a certain time based on the vibration detection result by the acceleration sensor 9 (step A3). Here, when it is detected that the camera is substantially stationary for a certain time (YES in step A3), the operation button position determination process is started by referring to the holding state table storage unit M4 and the operation button position table storage unit M5 (step A4). .

FIG. 11 is a flowchart for explaining the operation button position determination processing (step A4 in FIG. 8, step A20 in FIG. 9, and step A33 in FIG. 10) in detail.
First, the control unit 1 acquires the orientation (horizontal / vertical orientation) of the display unit 5 with respect to the direction of gravity based on the detection result of the acceleration sensor 9 as the orientation (lateral / vertical orientation) of the apparatus body (step B1). A contact state is acquired from the touch sensor 10 (step B2). Then, based on the detection result by the acceleration sensor 9 (direction of the display unit 5) and the detection result by each touch sensor 10 (contact state), the holding state table storage unit M4 is referred to (step B3), and the apparatus main body is manually operated. It is checked whether the holding state is a holding state corresponding to one of the six types of holding methods described above (step B4).

  If there is no corresponding holding state (NO in step B4), a message prompting the user to change to an appropriate holding method because the current holding method is not appropriate is displayed on the display unit 5 as an alert (step B8). If there is a corresponding holding state (YES in step B4), the operation button position table storage unit M5 is referred to (step B5), and the process proceeds to a process for determining the operation button (step B6). In this case, in addition to the corresponding holding state, the operation button position table storage unit M5 is referred to based on the detection result (direction of the display unit 5) by the acceleration sensor 9 and the detection result (contact state) of each touch sensor 10. The non-contact touch sensor 10 in the vicinity of the operation finger (for example, the index finger) is determined as the operation button.

  Since this is the case of the camera function shooting mode, the operation button is determined based on the contents of the operation button position table storage unit M5 corresponding to the camera function shooting mode shown in FIGS. Then, the function name of the determined operation button is displayed on the touch sensor 10 (step B7). In this case, as a function name of the operation button, a symbol “double circle” is displayed on the touch sensor 10 on the release button, and a symbol “+” is displayed on the touch sensor 10 on the exposure correction button in the + direction. The “−” symbol is displayed on the touch sensor 10 on the exposure correction buttons in the − and − directions.

  When the operation button position determination process (step A4 in FIG. 8) is completed in this way, a through image (live view image) from the imaging unit 7 is displayed on the monitor 5 (step A5), and then as described above. Whether the assigned release button has been operated (step A6), whether the exposure compensation button has been operated (step A10), whether the mode selection button on the operation unit 6 has been operated (step A12), or camera function end It is checked whether the button has been operated (step A14) or other operations have been operated (step A15).

  Here, if any operation is not performed (NO in step A15), the process returns to step A3 in which the stillness determination described above is performed, but as other operations, for example, operations such as exposure setting, zooming, and shooting scene setting are performed. If it is interrupted (YES in step A15), after performing an exposure setting process, a zoom process, a shooting scene setting process, etc. as a process corresponding to the operation (step A16), the process proceeds to step A3 in which the above-described stillness determination is performed. When the exposure correction button is operated (YES in step A10), the process for correcting the exposure in the + direction or the − direction is performed according to the type of the operation button (step A11), and then the above-described stillness determination is performed. Return to step A3 to be performed.

  When the release button is operated (YES in step A6), AE processing, AF processing, and the like are executed (step A7), and then the processing proceeds to shooting processing (step A8), and white balance adjustment is performed on the captured image. After performing the above process, a storage process for storing and saving the image data compressed by the compression process in the image storage unit M2 is performed (step A9). Then, it returns to step A3 which performs the above-mentioned stillness determination. Thereafter, the above operation is repeated every time the release button is operated. When the camera function end button is operated (YES in step A14), the process returns to step A1 described above. However, when the mode selection button is operated in the shooting mode (YES in step A12), the shooting mode is switched to the playback mode. After switching (step A13), the flow proceeds to the flow of FIG.

  When the camera function is switched to the playback mode in this way, an image selection operation is performed to select a desired image as a playback target from the captured images stored in the image storage unit M2 (FIG. 9). In step A17, YES), the selected image is read out as a reproduction target (step A18). Then, as in the case described above, the system stands by until it is substantially stationary while determining whether it is substantially stationary for a certain time based on the vibration detection result by the acceleration sensor 9 (step A19). If it is detected that the camera is substantially stationary for a certain time (YES in step A19), the process proceeds to the operation button position determination process (step A20).

  Even in this case, the operation according to the flow of FIG. 11 is executed. Now, since it is the camera function photographing mode, as shown in FIG. 6, the operation button is determined based on the contents of the operation button position table storage unit M5 corresponding to the camera function reproduction mode. As a result, as the function name of the operation button, the symbol “>” is displayed on the touch sensor 10 for the next image feed button, and the symbol “<” is displayed on the touch sensor 10 for the previous image feed button. On the zoom button, a symbol “square” is displayed on the touch sensor 10.

  Then, after the image read out as a reproduction target is displayed on the display unit 5 (step A21), it is checked whether the image feed button assigned as described above is operated (step A22) or the zoom button is operated. (Step A24), whether the mode selection button on the operation unit 6 has been operated (Step A26), the camera function end button has been operated (Step A28), or other operations have been operated (Step A29). . If no operation is performed (NO in step A29), the process returns to step A19 in which the stillness determination described above is performed. However, as other operations, for example, editing such as deleting an image, starting a slide show, and the like are performed. If YES (YES in step A29), editing processing, slide show display processing, and the like are executed as processing corresponding to the operation (step A30), and the flow returns to step A19 for performing the above-described stillness determination.

  When the image feed button assigned as described above is operated (YES in step A22), image feed processing to the next image or image feed processing to the previous image is performed according to the type of the operation button. After performing (step A23), it returns to step A19 which performs the above-mentioned stillness determination. When the zoom button assigned as described above is operated (YES in step A24), zoom processing is performed in accordance with the button operation (step A25), and then the process returns to step A19 for performing the stillness determination described above. . When the mode selection button is operated in the playback mode (YES in step A26), after switching to the shooting mode (step A27), the process proceeds to the flow of FIG. 8, but the camera function end button is operated. Sometimes (YES in step A28), the process returns to the first step A1 in FIG.

  On the other hand, when the electronic book function is activated (YES in step A31 of FIG. 10), the electronic book function is in a standby state until it is substantially stationary while determining whether or not it is substantially stationary for a certain period of time based on the vibration detection result by the acceleration sensor 9. (Step A32). If it is detected that the camera is substantially stationary for a certain time (YES in step A32), the process proceeds to the operation button position determination process (step A33). Even in this case, the operation according to the flow of FIG. 11 is executed. Since the electronic book function is being activated, the operation button is determined based on the contents of the operation button position table storage unit M5 corresponding to the electronic book function as shown in FIG. As a result, as a function name of the operation button, a symbol “>” is displayed on the touch sensor 10 on the next page feed button and a symbol “<” is displayed on the previous page feed button.

  Then, after the page content read from the electronic book is displayed on the display unit 5 (step A34), it is checked whether the page feed button assigned as described above is operated (step A35), or on the operation unit 6. It is checked whether the electronic book function end button has been operated (step A37) or other operations have been operated (step A38). If no operation is performed (NO in step A38), the process returns to step A32 in which the above-described stillness determination is performed. However, for example, when a bookmark insertion operation is performed as another operation (in step A38). (YES) After performing bookmark insertion processing or the like as processing according to the operation (step A39), the processing returns to step A32 where the above-described stillness determination is performed. When the page feed button assigned as described above is operated (YES in step A35), the page feed process to the next page or the page feed process to the previous page is performed according to the type of the operation button. After performing (step A36), it returns to step A32 which performs the above-mentioned stillness determination. When the electronic book function end button is operated (YES in step A37), the process returns to the first step A1 in FIG.

  As described above, in the present embodiment, the control unit 1 determines which position of the plurality of touch sensors 10 the human body is in contact with and the human body is not in contact with the apparatus main body held by the hand. A non-contact touch sensor in which the human body is not in contact with each other by detecting the contact state of the device and determining the holding state of the device main body in the hand based on the contact position. The touch sensor 10 at a position suitable for the current holding state is selected as the operation position from among the ten, and an operation button (touch operation unit) having a predetermined function is assigned to the touch sensor 10 at the operation position. When operating with the hand held, the position of the operation button can be changed dynamically according to the holding state of how the device main body is held and held, and it is limited to the holding state. It is possible to operate, it is possible to increase the degree of freedom of the way of holding without impairing the operability.

  Based on the contact state of the plurality of touch sensors 10, it is determined as a holding state whether one hand is held by a right hand, one hand held by a left hand, or both hands, and at which position each hand is held by a right hand, a left hand, and both hands Since the contact position of whether the human body is touching is determined as the holding state, it is possible to determine the holding state according to a plurality of types, and which finger can be held even in the same type of holding method. Since the manner of contact differs depending on where the user is using, the holding state can be determined from the relationship of the contact position, and the degree of freedom of holding can be further increased.

  Since the holding state of the apparatus main body is determined based on the attitude of the apparatus main body detected by the acceleration sensor 9, whether the display unit 5 having a different aspect ratio is held in a landscape orientation in which it is in a landscape state is displayed. It is possible to determine whether it is held in a portrait orientation of 5 or portrait, and the degree of freedom of holding can be further increased.

  When selecting an operation position suitable for the holding state of the apparatus main body, the non-contact position near the predetermined operation finger is selected as the operation position. However, the operation buttons having the same function can be operated with the same finger.

  Since the touch sensor 10 assigned as the operation button having the predetermined function is identified and displayed, the operation button can be appropriately operated.

  Since the function name is identified and displayed on the touch sensor 10 assigned as the operation button of the predetermined function, the desired operation button is appropriately operated even when a plurality of operation buttons having different functions are assigned. be able to.

  When assigning the operation buttons of the predetermined function, the operation buttons having the types of functions corresponding to the current operation mode are assigned. Therefore, even if the same touch sensor 10 has different functions depending on the current operation mode. Operation buttons can be assigned, and the number of operation buttons can be increased according to the number of modes.

  Since operation buttons (for example, a release button and an exposure correction button) related to shooting for controlling the image pickup unit 7 are assigned, release operation and the like can be easily performed without being affected by how the apparatus body is held at the time of shooting. It can be carried out.

  Since operation buttons (for example, next image advance button, previous image advance button, zoom button) related to image reproduction in the image storage unit M2 are assigned, it is influenced by how the apparatus main body is held during image reproduction. Therefore, it is possible to easily perform an image feed operation.

  Operation buttons (e.g., next page forward button, previous page forward button) related to browsing of electronic books are assigned, so page navigation operations are not affected by the way the device is held when browsing electronic books. Etc. can be easily performed.

  Since the plurality of touch sensors 10 are arranged on the outer surface (outer peripheral edge) of the apparatus main body, the touch state can be detected or an operation button can be assigned to each touch sensor.

  Since a plurality of operation buttons having different functions are respectively assigned, it is possible to arbitrarily operate the plurality of operation buttons without being limited by how to hold the apparatus main body.

  In the above-described embodiment, the plurality of touch sensors 10 are arranged in a line on the outer surface (outer peripheral end) of the apparatus main body. However, the touch sensor 10 is not limited to the outer peripheral end but is arranged on the outer surface of the apparatus main body. It may be arranged at both the left and right end portions and the upper and lower both end portions, and it may be arranged at any one of the left end portion, right end portion, upper end portion, and lower end portion of the apparatus main body. Also good.

  In the above-described embodiment, the case where the overall shape of the mobile terminal device is an ellipse (egg) is illustrated, but the overall shape of the mobile terminal device is not limited to an oval, and may be a rectangular parallelepiped. Well, its shape is arbitrary.

  In the embodiment described above, a single touch sensor 10 may be disposed at the outer peripheral end of the apparatus main body. That is, in a state where the annular touch sensor 10 is disposed at the outer peripheral end portion of the apparatus main body, a plurality of logical touch areas (for example, the same 20 as in the above-described embodiment) of the single touch sensor 10 are provided. You may make it classify into.

  In the embodiment described above, the horizontal direction and vertical direction of the display unit 5 are detected by the acceleration sensor 9 as the posture of the apparatus body. However, the angle 45 between the horizontal direction and the vertical direction is not limited to the horizontal direction and the vertical direction. The position may be detected regardless of the angle.

  In the embodiment described above, the index finger is taken as an example of the operation finger suitable for the operation, but a thumb or the like may be used as the operation finger suitable for the operation. Further, not only the right hand but also the left index finger or thumb may be used as an operation finger suitable for the operation.

  In the above-described embodiment, the holding state is determined based on the contact state of the plurality of touch sensors 10 as to whether the hand is held by the right hand, the left hand, or the both hands. It may be possible to set by hand operation whether to hold by hand, left hand or both hands.

  In the above-described embodiment, the function name is displayed when the touch sensor 10 assigned as the operation button of the predetermined function is identified and displayed. However, the function name may be changed to light up. For example, the release button may be identified and displayed in red, and the exposure correction button may be identified in blue. Further, the function name of the button is displayed on the touch sensor 10 to which the operation button is assigned. When the display unit 5 is surrounded by a plurality of touch sensors 10, the touch sensor 10 to which the operation button is assigned is displayed. The function name of the button may be displayed in the area of the display unit 5 closest to the button.

  In the above-described embodiment, the case where the present invention is applied to a mobile terminal device having a camera function and an electronic book function as an input device has been shown. There may be.

  In addition, the “apparatus” and “unit” shown in the above-described embodiments may be separated into a plurality of cases by function, and are not limited to a single case. In addition, each step described in the above-described flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or separately.

DESCRIPTION OF SYMBOLS 1 Control part 3 Memory | storage part 5 Display part 6 Operation part 7 Imaging part 9 Acceleration sensor 10 Touch sensor with a display M1 Program memory | storage part M2 Image memory | storage part M3 Electronic book memory | storage part M4 Holding state table memory | storage part M5 Operation button position table memory | storage part

Claims (14)

An input device that performs input processing according to an operation,
Are disposed on the outer surface of said input equipment, a touch sensor comprising a plurality of areas, said input equipment is in contact with the human body in which region of the plurality in a state of being held in the hand Contact state detection means for detecting the contact state of which region the human body is not in contact with;
Holding state determination for determining the holding state if it is held being held in the hand in any condition the input equipment based on the location of the contact region in which the contact state is detected by the detecting means human body is in contact Means,
An operation region suitable for the holding state determined by the holding state determination unit is selected from non-contact regions that are not in contact with the human body detected by the contact state detection unit, and a touch operation with a predetermined function is performed on the operation region. An assigning means for assigning a part;
With
Of the plurality of regions, the region used for determining the holding state by the holding state determining unit also functions as a region for assigning the touch operation unit having the predetermined function by the assigning unit.
An input device characterized by that. The holding state discriminating means discriminates whether the holding state is one of the right hand, left hand, and both hands as a holding state, and the human body is in contact with the right hand, left hand, and both hands The contact area is determined as the holding state,
The input device according to claim 1, which is configured as described above. Further comprising an attitude detection means for detecting an attitude of the input equipment,
The holding state determining means, when determining the holding state in which the input equipment is given in hand, to determine the holding state for each position of the detected said input equipment by the posture detection means,
3. The input device according to claim 1, wherein the input device is configured as described above. The assigning means, when selecting an operation area suitable for the holding state determined by the holding state determination means, selects the non-contact area in the vicinity of a predetermined operation finger as an operation area;
The input device according to any one of claims 1 to 3, wherein the input device is configured as described above. When the touch operation unit having a predetermined function is assigned to the non-contact area by the assigning means, the display further includes an identification display means for identifying and displaying the area.
The input device according to any one of claims 1 to 4, wherein the input device is configured as described above. The touch sensor is configured by a touch screen as a touch screen,
The identification display means, when a touch operation part having a predetermined function is assigned to the non-contact area by the assignment means, displays the function name of the touch operation part in the area.
6. The input device according to claim 5, wherein the input device is configured as described above. It further comprises an operation mode discriminating means for discriminating the currently switched operation mode from various operation modes,
The assigning unit assigns a touch operation unit having a function of a type corresponding to a current operation mode determined by the operation mode determination unit when assigning a touch operation unit having a predetermined function.
The input device according to claim 1, wherein the input device is configured as described above. It further comprises imaging means for imaging the subject,
The allocating unit allocates a touch operation unit having a function related to imaging that controls the imaging unit;
The input device according to claim 1, wherein the input device is configured as described above. Image storage means for storing images;
The assigning means assigns a touch operation unit having a function related to image reproduction in the image storing means;
The input device according to claim 1, wherein the input device is configured as described above. Further comprising an acquisition means for acquiring an electronic book,
The assigning means assigns a touch operation unit having a function related to browsing of the electronic book obtained by the obtaining means.
The input device according to claim 1, wherein the input device is configured as described above. The touch sensor is a plurality of touch sensors disposed on the outer surface of said input equipment,
The contact state detection means detects a contact state of a touch sensor at which position of the plurality of touch sensors and a touch of the touch sensor at which position of the human body is not touched.
The input device according to any one of claims 1 to 10, wherein the input device is configured as described above. The assigning means assigns touch operation units having different functions corresponding to a plurality of non-contact areas,
The input device according to any one of claims 1 to 11, wherein the input device is configured as described above. An input device that performs an input process corresponding to the operation, are disposed on the outer surface of said input equipment, an input method of the input device having a touch sensor comprising a plurality of regions,
A contact state detecting step of said input equipment is to detect whether the contact is not in contact with the human body in which area in contact with the human body in which region of the plurality in a state of being held in the hand,
Holding state determination for determining the holding state if it is held being held in the hand in any condition the input equipment based on the location of the contact region in which the contact state body detected by the detection step is in contact Process,
An operation region suitable for the holding state determined by the holding state determination step is selected from non-contact regions that are not in contact with the human body detected by the contact state detection step, and a touch operation with a predetermined function is performed on the operation region. An allocation process for assigning parts,
Including
Of the plurality of regions, the region used for determining the holding state by the holding state determining step also functions as a region to which the touch operation unit having the predetermined function is assigned by the assigning step.
An input method characterized by that. In the computer that controls the input device that performs input processing according to the operation,
Are disposed on the outer surface of said input equipment, a touch sensor comprising a plurality of areas, said input equipment is in contact with the human body in which region of the plurality in a state of being held in the hand A contact state detection function that detects a contact state of which region the human body is not in contact with;
Holding state determination for determining the holding state of either being held being held in the hand in any condition the input equipment based on the location of the contact region in which the human body detected by the contact state detecting function is in contact function,
An operation area suitable for the holding state determined by the holding state determination function is selected from non-contact areas detected by the contact state detection function that are not in contact with the human body, and a touch operation with a predetermined function is performed on the operation area. Assignment function to assign parts,
Realized,
Of the plurality of regions, the region used for determining the holding state by the holding state determining function also functions as a region to which the touch operation unit having the predetermined function by the allocation function is allocated.
A program characterized by that.

Images