JP2011188345A - Portable electronic device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a portable electronic device that achieves a user-friendly interface and the like, by acquiring sensor information, determining a hand of the user holding the portable electronic device, and changing the content of processing based on the result of the determination. <P>SOLUTION: The portable electronic device includes: a sensor information acquiring section 166 which acquires sensor information from a sensor; a determination section 162 which determines a hand of the user holding the portable electronic device, based on the sensor information; and a processing section 164 which changes the content of processing of the portable electronic device based on the result of the determination by the determination section 162 as to the hand of the user holding the portable electronic device. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a portable electronic device and the like.

  In recent portable electronic devices, it has been proposed to use a motion sensor as a user interface for instructing execution of a function instead of an operation button, for example, as in Patent Documents 1 and 2.

  In the technique of Patent Document 1, for example, the camera body is moved in the optical axis direction in order to perform a zoom operation.

  In the technique of Patent Document 2, a motion controller is built in a game controller, and for example, a tennis swing is expressed by moving the controller to play a game.

JP 2006-21458 A JP 2007-241655 A

  Executing the operation command by the motion sensor has an advantage that the user can perform an intuitive operation.

  However, most users have a dominant hand, and rough operations are not different between the left and right hands, but it is uncomfortable if detailed operations are not performed with the dominant hand. Conventional mobile electronic devices with built-in motion sensors have not taken this into consideration.

  In some aspects of the present invention, it is possible to provide a portable electronic device or the like that can execute appropriate processing depending on whether the user is holding the portable electronic device with the left or right hand.

  In addition, some aspects of the present invention provide a portable electronic device that realizes an interface that is easy to use for the user by changing the sensitivity, function, and algorithm processing content of the sensor information by the hand held by the user. it can.

  In one aspect of the present invention, a sensor information acquisition unit that acquires sensor information from a sensor, and a determination that performs a process of determining whether the user is holding the portable electronic device with the left or right hand based on the sensor information And a processing unit that performs a process of changing the content of the process of the mobile electronic device based on a determination result of whether the user is holding the mobile electronic device with the left or right hand by the determination unit. Including portable electronic devices.

  In one embodiment of the present invention, sensor information is acquired, and it is determined based on the acquired sensor information whether the user is holding the portable electronic device with the left or right hand. Then, the processing contents of the portable electronic device are changed based on the determination result. Thereby, since the sensor sensitivity and the like can be changed depending on whether or not the user is a dominant hand, an interface that is easy for the user to use can be realized.

  In one aspect of the present invention, a moving distance information calculation unit, an imaging unit that captures an image, and an angle-of-view adjustment unit that adjusts an angle of view at the imaging unit are included, and the sensor is a motion sensor. The sensor information acquisition unit acquires motion information from the motion sensor as the sensor information, and the movement distance information calculation unit calculates movement distance information of the motion sensor based on the motion information, The angle of view adjustment unit may adjust the angle of view at the imaging unit based on the movement distance information calculated by the movement distance information calculation unit.

  In this way, it is possible to realize a portable electronic device or the like that can adjust the angle of view (zoom operation) of the imaging unit by motion.

  In one aspect of the present invention, the image sensor includes a detection threshold level setting unit that sets a detection threshold level for determining whether or not the motion detected by the motion sensor is a motion for instructing the angle of view adjustment. The angle of view adjustment unit adjusts the angle of view when it is determined that the distance represented by the moving distance information is greater than the sensing threshold level, and the distance represented by the moving distance information is the sensing threshold. If it is determined that the angle is smaller than the level, the angle of view may be unadjusted.

  In this way, it is possible to set a sensing threshold level for determining whether or not the motion is a motion for instructing angle of view adjustment. Thus, by setting an appropriate detection threshold level, it is possible to distinguish between intentional motion by the user and motion due to camera shake, sensor noise, or the like.

  In the aspect of the invention, the detection threshold level setting unit may be configured such that when the determination unit determines that the user is holding the portable electronic device with a dominant hand, the user holds the portable electronic device with a non-dominant hand. The sensing threshold level may be set lower than when it is determined that the object is gripped.

  In this way, even if the motion with the dominant hand is small, it is easy to recognize that it is a motion that instructs to adjust the angle of view. It will not be recognized as. Therefore, the dominant hand capable of performing an accurate operation can recognize a small movement (for example, fine adjustment) intended for the user as a motion instructing the angle of view adjustment. On the other hand, in a non-dominant hand whose motion is inaccurate, it is possible to recognize a motion unintended by the user, such as camera shake, as a motion that does not instruct a view angle adjustment.

  In the aspect of the invention, the angle of view adjustment unit may be configured such that when the determination unit determines that the user is holding the portable electronic device with a dominant hand, the user holds the portable electronic device with a non-dominant hand. The angle of view adjustment for the moving distance information may be increased as compared with the case where it is determined that the movement distance has been set.

  In this way, even with the same motion magnitude (movement distance information magnitude), the dominant hand motion can increase the zoom amount compared to the non-dominant hand motion. Accordingly, a dominant hand capable of performing an accurate operation can perform telephoto (high zoom magnification) and can reduce a moving distance when setting a predetermined zoom magnification. On the other hand, a non-dominant hand whose operation is inaccurate can reduce the zoom amount with respect to the distance represented by the movement distance information, thereby enabling fine adjustment of the zoom amount and facilitating the operation.

  In one aspect of the present invention, the processing unit performs a first process and a second process as the process, and the first process is set to have a high frequency of setting change by the user. The second process is a process that is set when the frequency of changing the setting by the user is low, and the processing unit is configured to allow the user to hold the portable electronic device with a dominant hand by the determination unit. If it is determined that the user is holding, the first process set as a process whose setting is frequently changed by the user is performed, and the user holds the portable electronic device with a non-dominant hand. If it is determined that the setting is changed, the second process set as a process whose setting is changed less frequently by the user may be performed.

  In this way, it is possible to distribute the processing to the dominant hand and the non-dominant hand. At that time, frequently changed settings are assigned to the dominant hand that is easy to operate, and those that are not changed so much are assigned to the non-dominant hand that is difficult to perform precise operation.

  In one embodiment of the present invention, the sensor is a motion sensor, the sensor information acquisition unit acquires motion information from the motion sensor as the sensor information, and the determination unit is based on the motion information. Then, a process of determining whether the user is holding the portable electronic device with the left or right hand may be performed.

  In this way, it is possible to determine whether the user is holding the portable electronic device with the left or right hand based on the motion information of the motion sensor.

  In the aspect of the invention, the determination unit may calculate a movement trajectory of the motion sensor based on the motion information, and the user may use the left or right hand to move the mobile electronic device based on the calculated trajectory. Processing for determining whether or not the hand is held may be performed.

  In this way, it is possible to calculate the movement trajectory of the motion sensor from the motion information of the motion sensor and determine whether the user is holding the portable electronic device with the left or right hand based on the calculated trajectory. It becomes possible.

  In one embodiment of the present invention, the sensor is a touch sensor, and the sensor information acquisition unit receives touch information indicating whether the user is touching a portable electronic device from the touch sensor. And the determination unit may perform a process of determining whether the user is holding the portable electronic device with the left or right hand based on the touch information.

  In this way, it is possible to determine whether the user is holding the portable electronic device with the left or right hand based on the touch information of the touch sensor.

  In one aspect of the present invention, the sensor is an imaging sensor that images a user, the sensor information acquisition unit acquires a user image captured by the imaging sensor as the sensor information, and the determination unit includes: Based on the user image, a process of determining whether the user is holding the portable electronic device with the left or right hand may be performed.

  In this way, it is possible to determine whether the user is holding the portable electronic device with the left or right hand based on the user image captured by the image sensor.

1 is a configuration example of a portable electronic device according to an embodiment. An example of a motion sensor (acceleration sensor). Explanatory drawing of the motion sensor incorporated in a portable electronic device. The flowchart for demonstrating the process using a motion sensor. The flowchart for demonstrating the process using a touch sensor or an imaging sensor. FIG. 6A shows an example of a locus when the operation of pushing the portable electronic device forward is performed with the right hand, and FIG. 6B shows an example of a locus when the operation of pushing the portable electronic device forward is performed with the left hand. 7A to 7C show examples of acceleration when the operation is performed with the right hand, and FIGS. 7D to 7F show examples of acceleration when the operation is performed with the left hand. Explanatory drawing of the touch sensor installed in the outer side of a portable electronic device. Explanatory drawing of the touch sensor installed in the outer side of a game controller. An example of a portable electronic device having an imaging sensor. The example of the user image imaged with an imaging sensor. An example of zoom magnification with respect to travel distance. The other flowchart for demonstrating the process using a motion sensor. The other flowchart for demonstrating the process using a touch sensor or an imaging sensor. An example in which the processing of a portable electronic device is distributed between the right hand and the left hand. The flowchart for demonstrating the process of this embodiment.

  Hereinafter, this embodiment will be described. In addition, this embodiment demonstrated below does not unduly limit the content of this invention described in the claim. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

  1. First embodiment

  First, the method of this embodiment will be described. In this embodiment, based on some sensor information, it is determined whether the user is holding the portable electronic device with the right hand or the left hand. Then, based on the determination, the contents of the process are changed depending on whether the hand is held with the right hand or the left hand.

  As a sensor used for determining whether it is a right hand or a left hand, a motion sensor, a touch sensor, an imaging sensor, or the like can be considered. In addition, the sensor which discriminate | determines left and right is not limited to these.

  The motion sensor is, for example, an acceleration sensor, detects acceleration in movement of the portable electronic device, calculates a movement trajectory by performing integration processing twice, and performs left / right discrimination based on the calculated trajectory. Alternatively, the left / right determination may be performed directly from the acceleration information.

  The touch sensor detects whether the user is touching a portable electronic device (strictly, a touch sensor installed in the portable electronic device). The left / right determination is performed depending on whether the touch sensor installed in the right hand grip portion detects a touch or the touch sensor installed in the left hand grip portion detects a touch.

  An imaging sensor images a user (photographer) and acquires a user image. Specifically, this is, for example, an image as shown in FIG. The user's arm part is detected from the user image, and left / right discrimination is performed based on the detected position of the arm part and the like.

  As a specific example of the content of the process to be changed, a case where the sensitivity to sensor information is changed can be considered. For example, when using a motion sensor, if a hand is gripped by a dominant hand, even a small movement is recognized as a motion, whereas if it is gripped by a non-dominant hand, it is determined that the small movement is camera shake or the like. Is not recognized as motion. The above example will be described in detail in the first embodiment.

  Further, when a zoom operation is performed based on the distance between the mobile electronic device and the user (hereinafter referred to as smart zoom as appropriate), there may be a case where the zoom magnification is changed depending on whether the user is a dominant hand or a non-dominant hand. For example, when holding with a dominant hand, the zoom magnification is set to be large and the zoom change amount is set to be large even with a small movement, whereas when holding with a non-dominant hand, the zoom magnification is reduced. Set it so that the amount of zoom change is small even if there is movement due to camera shake or inaccurate motion. The above example will be described in detail in the second embodiment.

  Further, as shown in FIG. 15 to be described later, there may be a case where the process to be executed is different depending on whether the right hand or the left hand is applied to the same motion. The above example will be described in detail in the third embodiment.

  Hereinafter, a first embodiment will be described with reference to FIGS. In the present embodiment, as an example, a portable electronic device (imaging device) having a specification in which the zoom position is changed by moving the imaging device in the optical axis direction as in Patent Document 1 is considered.

  FIG. 1 is a block diagram illustrating a schematic configuration of a portable electronic device (imaging device) according to the present embodiment. The portable electronic device includes an imaging unit 115, an image processing unit 130, an I / F unit 140, a storage unit 150, a control unit 160, a lens driving motor (AF motor, zoom motor) 170, and an angle of view adjustment unit. 180 and the sensor unit 200 are included. Various modifications such as omission of some of these components and addition of other components are possible.

  Although not shown, the portable electronic device may be provided with a device equipped in a general imaging device (for example, a digital camera) such as a display device such as a rear liquid crystal panel or a flash mechanism.

  The imaging unit 115 includes a photographing lens 110 (optical system) and an imaging element 120 (image sensor).

  The photographic lens 110 (optical system) is a variable focal length zoom lens that forms a subject image on the imaging surface of the imaging device 120 formed of a CCD or CMOS image sensor. In the present specification, the image sensor 120 will be described as a CMOS image sensor having processing blocks such as CDS and A / D conversion therein and capable of outputting digital image signals.

  The digital image signal output from the image sensor 120 is temporarily stored in the storage unit 150. Since the storage unit 150 is also used as a buffer memory when the image processing unit 130 performs image processing, it is desirable that the writing / reading speed is high, and it can be configured by, for example, a DRAM, an SRAM, or the like. The storage unit 150 is configured to be accessible by the image sensor 120, the image processing unit 130, and the control unit 160 via a system bus. The storage unit 150 has a function of arbitrating memory access requests from the above-described components.

  The image processing unit 130 can be configured by an application specific integrated circuit (ASIC) or the like. The image processing unit 130 synchronizes with a digital image signal output from the image sensor 120 and temporarily stored in the storage unit 150 (demosaic processing), white balance adjustment, gradation / level correction, unsharp mask, Digital image data is generated by processing such as shading correction.

  When the image processing unit 130 performs image recording processing, the image data generated by the image processing unit 130 is JPEG-compressed as necessary and is recorded on a storage medium (not shown) via the I / F unit 140. . Various storage media can be used. As an example, the storage medium may be a flash memory that may be built in a portable electronic device or configured to be detachable from the portable electronic device.

  The control unit 160 performs various processes for operating the portable electronic device. In particular, information from a sensor included in the sensor unit 200 is received and the content of the process is determined. In addition, it performs integrated control of portable electronic devices such as a series of operations such as photometry for automatic exposure, exposure amount calculation, charging of the main capacitor for the flash unit, adjustment of the flash emission amount, and acceptance of setting operation of the shooting mode by the photographer. .

  The control unit 160 includes a determination unit 162, a processing unit 164, a sensor information acquisition unit 166, a movement distance information calculation unit 168, and a sensing threshold level setting unit 169. Various modifications such as omission of some of these components and addition of other components are possible.

  Based on the sensor information acquired by the sensor information acquisition unit 166, the determination unit 162 determines whether the user has the portable electronic device with the right hand or the left hand.

  The processing unit 164 changes the content of the processing based on whether it is held with the right hand or the left hand based on the determination result in the determination unit 162. Details of the processing will be described later.

  The sensor information acquisition unit 166 acquires information from at least one sensor included in the sensor unit 200. For example, when the sensor is a touch sensor, information on whether or not the user is touching is acquired, and when the sensor is an acceleration sensor, acceleration information is acquired.

  The movement distance information calculation unit 168 calculates a movement locus of the motion sensor 201 based on acceleration information acquired by the sensor information acquisition unit 166 from a motion sensor 201 described later, and calculates movement distance information based on the calculated locus. To do. The moving distance information is sent to the angle of view adjustment unit 180 and used to adjust the angle of view.

  The sensing threshold level setting unit 169 sets the sensing threshold level. The detection threshold level represents a threshold value indicating whether or not the movement of the motion sensor is recognized as a motion for adjusting the angle of view. When the distance represented by the moving distance information is larger than the sensing threshold level, it is recognized as a motion for adjusting the angle of view in the imaging unit 115, and when the distance represented by the moving distance information is smaller than the sensing threshold level, the image is displayed. Not recognized as a motion to adjust corners. The detection threshold level setting unit 169 instructs the angle of view adjustment unit 180 to adjust the angle of view when a motion for adjusting the angle of view is recognized, and instructs the angle of view adjustment when the motion is not recognized. do not do.

  The lens drive motor 170 is composed of an AF motor and a zoom motor. The zoom motor adjusts the position of the taking lens 110 so that an appropriate angle of view is obtained. The AF motor also performs AF (autofocus) for automatically focusing on the subject after the end of the field angle adjustment. Specifically, the position of the photographing lens 110 is adjusted in the same manner as the zoom motor.

  The angle of view adjustment unit 180 adjusts the angle of view in the imaging unit 115. Specifically, information on the processing content and movement distance information from the control unit 160 is acquired, an appropriate angle of view is calculated, an angle of view adjustment signal is output to the lens drive motor 170, and the imaging unit 115 Perform angle of view adjustment.

  The display unit 190 is a liquid crystal display device, for example, and displays various images.

  The sensor unit 200 includes at least one sensor. In the present embodiment, at least the motion sensor 201 is included, but the present invention is not limited to this. Moreover, the touch sensor 203, the imaging sensor 205, etc. may be included.

  Next, the motion sensor 201 included in the sensor unit 200 will be described.

  FIG. 2 is a plan view of an acceleration sensor which is an example of the motion sensor 201.

  This acceleration sensor detects angular velocities in the X-axis, Y-axis, and Z-axis directions, and outputs voltage signals corresponding to the detected angular velocities, and has piezo resistors RX1 to RX4, RY1 to RY4, and RZ1 to RZ4. is doing. The piezo resistors RX1 to RX4, RY1 to RY4, and RZ1 to RZ4 are each configured as a bridge.

  Here, when acceleration is applied to the acceleration sensor only from the X-axis direction, all the piezo resistors RX1 to RX4, RY1 to RY4, and RZ1 to RZ4 are subjected to tensile stress, and the resistance values of the piezo resistors RX1 and RX3 are decreased. However, the resistance value of other piezoresistors increases. As a result, output is obtained only from the bridge that detects acceleration in the X-axis direction, and the output of the bridge that detects acceleration in the Y-axis direction and Z-axis direction is zero.

  Similarly, when acceleration is applied only from the Y-axis direction or the Z-axis direction, only the output of the bridge that detects the acceleration in the Y-axis direction or the Z-axis direction is obtained, and the outputs of the other two bridges are zero. . Accordingly, this acceleration sensor can independently detect accelerations in the three-axis directions.

  The motion sensor may be an acceleration sensor, a gyro sensor, a geomagnetic sensor, a pressure sensor such as atmospheric pressure or water pressure, GPS, mobile phone, wireless LAN, Bluetooth, PHS. It may be a wireless position detection sensor such as an RFID (wireless tag), a position detection means by image processing, an active sensor such as an ultrasonic wave or an infrared ray, or a plurality of combinations.

  FIG. 3 is a schematic diagram in which the motion sensor of FIG. 2 is arranged in a portable electronic device (imaging device). Although it is not always necessary to incorporate the motion sensor in the portable electronic device, in this embodiment, the motion sensor is a built-in type. Therefore, hereinafter, the movement of the motion sensor and the movement of the portable electronic device are synonymous. It is assumed that the right hand grip portion is 210 and the left hand grip portion is 220.

  A voltage signal indicating the acceleration in each axial direction obtained by the motion sensor is output to the control unit 160. When there is a certain amount of acceleration in the z direction with the arrangement of the motion sensors in FIG. 3 (the movement distance information is larger than the detection threshold level set by the detection threshold level setting unit 169), the angle of view adjustment unit 180 sets the motion for setting the zoom. Judgment is made and adjustment of the angle of view is started.

  FIG. 4 is a flowchart showing details of zoom processing (smart zoom) in the present embodiment.

  When this process is started, it is first determined whether or not the portable electronic device is moving (S301). If not moving, it waits until movement is detected. If it is moving, acceleration information is detected as sensor information from a motion sensor (here, an acceleration sensor is assumed) (S302).

  Then, the speed is calculated by integrating the acceleration (S303), and the trajectory of the motion sensor is calculated by integrating the speed (S304).

  Next, it is determined whether or not the hand is held with a dominant hand (S305). The trajectory information calculated in S304 is used for the determination. Specific examples are shown in FIGS. 6A and 6B. FIGS. 6A and 6B show movement trajectories when the motion of pushing the portable electronic device to the front of the body is performed with the right hand and the left hand. Due to the structure of the human joint, the action of extending the arm includes an element of rotation about the elbow. Since the elbow itself moves with the shoulder as a fulcrum, it does not become a complete rotational movement, but it is difficult to extend the arm only by a straight movement. Therefore, the locus of the portable electronic device is as shown in FIG. 6A when it is performed with the right hand, and as shown in FIG. 6B when it is performed with the left hand. By discriminating this difference, it is possible to determine whether it is a right hand or a left hand.

  Further, FIGS. 7A to 7F show the difference between the right hand and the left hand from the viewpoint of acceleration. FIGS. 7A to 7C are examples of changes in acceleration on the x-axis, y-axis, and z-axis when a motion is performed with the right hand. FIGS. It is an example of the change of the acceleration on the x-axis, y-axis, and z-axis when a motion is performed with the left hand. As shown in FIGS. 6A and 6B, the movement direction in the x-axis direction is reversed, so that the right hand changes from negative to positive as shown in FIG. 7A. On the other hand, the left hand changes from positive to negative as shown in FIG. By discriminating this difference, it is possible to determine whether it is the right hand or the left hand. It should be noted that although the acceleration is not ideally detected on the y-axis, the actual operation has a certain degree of acceleration due to the influence of vibration or the like (FIGS. 7B and 7E).

  If it is determined that the hand is gripped by the dominant hand, the sensing threshold level setting unit 169 sets the sensing threshold level low (S306). If it is determined that the hand is held by a non-dominant hand, the sensing threshold level setting unit 169 sets the sensing threshold level high (S307).

  Setting in this way allows flexible and accurate operations when operating with the dominant hand, so even if it is a relatively small movement, it can be a problem even if it is determined that the motion is intentional by the user On the other hand, since the operation with a non-dominant hand lacks accuracy, there is a high possibility that a small movement is a blur unintended by the user.

  It is determined whether or not the movement distance of the portable electronic device obtained from the trajectory is larger than the sensing threshold level set in S306 or S307 (S308). If it is larger, the angle of view is adjusted (S309). In this case, nothing is done and the process is terminated.

  The above flowchart corresponds to one zoom operation. When the zoom operation is performed again, the process is started again from S301.

  In the above description, the motion sensor is used to determine whether or not it is a dominant hand, but the present invention is not limited to this.

  For example, the touch sensor 203 may be used to determine whether or not the user is a dominant hand. FIG. 8 is a schematic diagram in which the motion sensor 201 and the touch sensor 203 are arranged in a portable electronic device. The touch sensor 203 is installed on the left hand holding unit 220, and it can be seen whether the camera is held with the left hand. In addition, the touch sensor 203 may be installed in the right hand holding unit 210 to detect how to hold the right hand, the left hand, and both hands, and the sensitivity (sensing threshold level) of the motion sensor may be changed according to the holding method. .

  FIG. 5 is a flowchart for explaining processing when the touch sensor 203 is used to determine whether or not the user is a dominant hand. The difference from the determination by the motion sensor is that it is possible to determine whether or not the user is a dominant hand before calculating the motion (trajectory).

  When this process is started, it is first determined whether or not the hand is possessed by a dominant hand (S401). Specifically, the determination is made based on whether the touch sensor installed on the right hand holding unit 210 detects a touch or the touch sensor installed on the left hand holding unit 220 detects a touch.

  If it is determined that the hand is gripped by the dominant hand, the sensing threshold level setting unit 169 sets the sensing threshold level low (S402). If it is determined that the hand is held by a non-dominant hand, the sensing threshold level setting unit 169 sets the sensing threshold level high (S403).

  Next, it is determined whether or not the portable electronic device is moving (S404). If not moving, it waits until movement is detected. If it is moving, acceleration information is detected as sensor information from a motion sensor (here, an acceleration sensor is assumed) (S405).

  Then, the speed is calculated by integrating the acceleration (S406), and the movement trajectory of the motion sensor is calculated by integrating the speed (S407).

  It is determined whether or not the movement distance of the portable electronic device obtained from the locus is larger than the sensing threshold level set in S402 or S403 (S408). If it is larger, the angle of view is adjusted (S409), otherwise In this case, nothing is done and the process is terminated.

  Note that the application example of the left / right discrimination by the touch sensor is not limited to a mobile phone or an imaging device (for example, a digital camera or a digital video camera). FIG. 9 is a diagram showing an example in which a right-hand touch sensor is installed in a game controller with a built-in motion sensor. It is conceivable that the touch sensor detects whether the game controller is grasped with the right hand or the left hand, and is automatically left-handed or left-handed when playing a tennis game, for example. Although not shown, the touch sensors may be installed on both the right hand holding part and the left hand holding part.

  Further, the image sensor 205 may be used to determine whether or not the user is a dominant hand. FIG. 10 shows a portable electronic device (for example, a mobile phone with a built-in camera) in which an imaging sensor 205 is mounted in addition to the camera on the subject side (imaging unit 115). The imaging sensor 205 captures a user image, and the determination unit 162 analyzes the user image to detect which hand is holding the main body.

  FIG. 11 is an example of a user image captured by the image sensor 205. In FIG. 11, by recognizing the photographer's arm by pattern matching or the like, it can be determined which hand is holding the main body. Note that it is necessary to use a wide-angle camera that can capture a wide range because the user image needs to show the arm of the photographer. In some cases, a fisheye lens or the like may be used.

  The flowchart for explaining the processing of the image sensor is the same as that of the touch sensor, and is shown in FIG. The difference from the case of using the touch sensor is a method for determining whether or not the hand is held by a dominant hand in S401. In the present embodiment, the user image captured by the image sensor 205 is used as described above.

  Specifically, first, a person is extracted from the user image. Specifically, this can be realized, for example, by recognizing a face from skin color recognition and estimating the positions of other parts (body, right arm, left arm, etc.) based on the position and size of the face. The left and right arms are extracted therefrom, and it is determined that the portable electronic device is held by the hand of the arm extending in the direction in which it is estimated that the portable electronic device is present (bottom of the screen in the example of FIG. 11). do it.

  In the above embodiment, as shown in FIG. 1, the portable electronic device includes the sensor information acquisition unit 166, the determination unit 162, and the processing unit 164. The sensor information acquisition unit 166 acquires sensor information, and the determination unit 162 determines whether the user is holding the portable electronic device with the left or right hand based on the sensor information. And the process part 164 changes the content of a process based on the determination result in the determination part 162. FIG. In the example of FIG. 4, the sensing threshold level is set low when gripping with a dominant hand (S306), whereas the sensing threshold level is set high when gripping with a non-dominant hand (S307). ).

  Accordingly, it is possible to realize a portable electronic device that acquires sensor information, performs determination based on the acquired sensor information, and changes processing based on the determination. Therefore, since the sensor sensitivity, the zoom magnification, and the like can be changed based on whether the user is dominant or non-dominant, an interface that is easy for the user to use can be realized.

  In addition, as shown in FIG. 1, the portable electronic device of the present embodiment can include an imaging unit 115, a movement distance information calculation unit 168, and an angle of view adjustment unit 180. The movement distance information calculation unit 168 calculates movement distance information of the portable electronic device based on the motion information acquired by the sensor information acquisition unit 166 from the motion sensor 201 as illustrated in FIG. Then, the angle-of-view adjustment unit 180 adjusts the angle of view in the imaging unit 115 based on the calculated moving distance information, as shown in step S309 in FIG. 4 and step S409 in FIG.

  This makes it possible to realize a portable electronic device that combines the technique of the present embodiment with smart zoom. A specific zoom operation method in the smart zoom is a motion of pushing the portable electronic device forward as shown in FIGS. 6 (A) and 6 (B).

  In addition, the portable electronic device of the present embodiment can include a sensing threshold level setting unit 169 as shown in FIG. Then, as shown in S308 and S309 in FIG. 4, the view angle adjustment unit 180 adjusts the view angle when the movement distance information calculated by the movement distance information calculation unit 168 is larger than the sensing threshold level, and the movement distance information May be set so as not to adjust the angle of view.

  This makes it possible to set a sensing threshold level (motion threshold). When the movement of the portable electronic device is larger than the detection threshold level, it is determined that the motion is intentional by the user. On the other hand, when the movement of the portable electronic device is smaller than the detection threshold level, camera shake or sensor Judged as noise, etc., not treated as motion.

  Further, as shown in S305 to S307 in FIG. 4, the detection threshold level setting unit 169 sets the detection threshold level low when the determination unit 162 is gripped by a dominant hand, and is held by a non-dominant hand May be set to a high threshold level.

  Thereby, it is possible to determine that even a small movement is a motion when gripping with a dominant hand. This is because it is assumed that the dominant hand moves accurately. In addition, when the hand is held by a non-dominant hand, it is assumed that the hand movement is large, so that a small movement is not determined to be a motion.

  Further, the sensor information acquisition unit 166 acquires motion information from the motion sensor 201. And the discrimination | determination part 162 may discriminate | determine whether it is a right hand or a left hand based on motion information. Specifically, the movement trajectory of the motion sensor may be calculated, and the determination may be performed based on the calculated trajectory.

  As a result, it is possible to determine whether the hand is a right hand or a left hand based on information from the motion sensor 201. Specifically, as shown in FIGS. 6 (A) and 6 (B), the difference in trajectory is determined. Or you may discriminate | determine from the difference in acceleration as shown to FIG. 7 (A)-FIG.7 (F).

  The sensor information acquisition unit 166 may acquire touch information from the touch sensor 203. And the discrimination | determination part 162 may discriminate | determine whether it is a right hand or a left hand based on motion information. Here, the touch information is information indicating whether the user is touching the portable electronic device (specifically, the touch sensor 203 installed in the portable electronic device).

  As a result, it is possible to determine whether the right hand or the left hand is based on the information from the touch sensor 203. Specifically, as shown in FIG. 8, it is conceivable to install the touch sensor 203 on the right hand holding part and the left hand holding part. In addition, as shown in FIG. 9, it may be determined whether it is a right hand or a left hand by installing the game controller.

  Moreover, the sensor information acquisition part 166 may acquire the user image by the user imaging | photography camera 205 which image | photographs a user as shown in FIG. Then, the determination unit 162 determines whether the right hand or the left hand is based on the user image. Specifically, as shown in FIG. 11, it is performed by determining the position of the user's arm from the acquired user image.

  Accordingly, it is possible to determine whether the right hand or the left hand is based on the information from the user photographing camera.

  2. Second embodiment

  Next, a second embodiment will be described with reference to FIGS. The basic configuration of this embodiment is the same as that of the first embodiment, and the processing content changing method is different based on the result of determination as to whether or not the user is a dominant hand.

  FIG. 1 is a block diagram illustrating a schematic configuration of a portable electronic device according to the present embodiment. Since it is the same as that of 1st Embodiment, detailed description is abbreviate | omitted.

  In the present embodiment, the field angle adjustment amount (zoom magnification) in smart zoom is changed according to whether or not the user is a dominant hand. FIG. 12 shows an example of the angle of view adjustment amount (zoom amount). In the case of a motion by a dominant hand, a delicate operation is possible, and therefore the angle of view adjustment with respect to the movement distance may be increased. In the example of FIG. 12, a zoom of 10 times that is the maximum zoom amount is performed for a movement of 50 cm.

  On the other hand, in the case of motion by a non-dominant hand, it is considered that fine operations cannot be performed well. Therefore, the zoom operation (for example, fine adjustment) is facilitated by reducing the amount of view angle adjustment with respect to the movement distance. In the example of FIG. 12, the left hand can only zoom 5 times for a 50 cm movement.

  FIG. 13 is a flowchart showing details of the processing of the present embodiment when the left / right determination is performed by the motion sensor.

  Since S501 to S505 in this process are the same as S301 to S305 in FIG. 4, detailed description thereof is omitted. If it is determined in S505 that the camera is held by a dominant hand, the zoom magnification (viewing angle adjustment amount) is set large (S506). If it is determined that the camera is held by a non-dominant hand, the zoom magnification is determined. Is set small (S507). Then, the angle of view is adjusted based on the movement distance information based on the trajectory obtained in S504 and the zoom magnification obtained in S506 or S507 (S509).

  Also in this embodiment, the touch sensor 203 or the image sensor 205 may be used to determine whether or not the user is a dominant hand. Also, other sensors that can determine whether or not the user is a dominant hand may be used.

  FIG. 14 is a flowchart showing details of processing when the touch sensor 203 or the imaging sensor 205 is used. Similar to FIG. 5 with respect to FIG. 4, since it is the same as FIG. 13 described above except that it can be determined whether or not it is a dominant hand before the motion is performed, detailed description thereof will be omitted.

  In the present embodiment described above, the view angle adjustment unit 180 in FIG. 1 increases the view angle adjustment amount with respect to the movement distance information when held with a dominant hand, as shown in S505 to S507 in FIG. When the hand is held by a non-dominant hand, the angle of view adjustment amount for the movement distance information is reduced.

  As a result, as shown in FIG. 12, the angle of view adjustment amount (zoom magnification) can be changed based on whether or not the user is a dominant hand. Specifically, since the dominant hand can perform accurate movement, the zoom amount with respect to the movement distance may be increased, and more specifically, for example, the maximum magnification can be realized when the arm is extended to the maximum. In addition, since the influence of camera shake or the like is increased in the non-dominant hand, the zoom amount with respect to the movement distance is set small.

  3. Third embodiment

  Next, a third embodiment will be described with reference to FIGS. The basic configuration of this embodiment is the same as that of the first embodiment, and the method for changing the processing content based on the result of the determination as to whether or not it is a dominant hand is different.

  FIG. 1 is a block diagram illustrating a schematic configuration of a portable electronic device according to the present embodiment. Since it is the same as that of 1st Embodiment, detailed description is abbreviate | omitted.

  In the present embodiment, the operation of the mobile electronic device is set by being distributed to the right hand and the left hand. An example of specific operation distribution is shown in FIG. In the following example, the right hand is the dominant hand.

  In the example of FIG. 15, the zoom operation is performed when the motion 1 is performed with the right hand, and the ISO sensitivity is adjusted when the motion 1 is performed with the left hand. Further, when motion 2 is performed with the right hand, data is transmitted, and when motion 2 is performed with the left hand, white balance is adjusted.

  By doing in this way, even if it is the same motion, it becomes possible to perform a different process depending on whether it was performed with the right hand or the left hand. Therefore, many types of processing can be performed with few types of motion.

  In this case, it is preferable to distribute an operation whose setting is frequently changed by the user to a dominant hand. By doing so, it is possible to realize frequently performed operations with natural and easy motion for the user. In addition, operations that are not preferably performed erroneously, such as data transmission, may be distributed to the dominant hand. By doing so, the risk of erroneous operation can be reduced.

  FIG. 16 is a flowchart showing details of the processing of this embodiment.

  Since S701 to S704 in this process are the same as S301 to S304 in FIG. 4, detailed description thereof is omitted. In S705, it is determined whether or not the trajectory calculated in S704 is motion 1. If it is determined that the motion 1 is detected, it is determined whether the user is gripping with a dominant hand (S706), the zoom operation is performed for a dominant hand (S707), and the ISO sensitivity is adjusted for a non-dominant hand. (S708).

  If it is not motion 1, it is determined whether it is motion 2 (S709). If it is determined that the motion 2 is detected, it is determined whether the user is gripping with a dominant hand (S710), data is transmitted for a dominant hand (S711), and WB is adjusted for a non-dominant hand. (S712).

  If neither motion 1 nor motion 2 is found, it is determined that the motion is illegal (S713), and the process ends without doing anything. Alternatively, the user may be notified that the motion is illegal.

  In the above description, there are two motions, but the present invention is not limited to this.

  In the above description, as in the first and second embodiments, any of the motion sensor 201, the touch sensor 203, and the imaging sensor 205 may be used to determine whether or not the user is a dominant hand. Other sensors may be used.

  However, the motion sensor 201 is also used to determine whether the motion is motion 1 or motion 2. Therefore, it is necessary to be able to determine whether or not each hand is a dominant hand, such as motion 1 by a dominant hand, motion 1 by a non-dominant hand, motion 2 by a dominant hand, and motion 2 by a non-dominant hand. As described above in the first embodiment, it is possible to discriminate left and right regarding the operation of extending the arm. However, depending on the motion, there may be a case where it is difficult to discriminate left and right. In such a case, it is conceivable to use other sensors such as the touch sensor 203 and the imaging sensor 205 for the left / right discrimination.

  In the above embodiment, the processing performed by the processing unit 164 in FIG. 1 includes the first processing and the second processing. The first processing is processing with high frequency of setting change by the user. This process is a process with a low frequency of setting change by the user. The processing unit 164 performs the first processing with a high setting change frequency when the determination unit 162 determines that the hand is gripped with a dominant hand, and sets the processing unit 164 when it is determined that the hand is gripped with a non-dominant hand. A second process with a low change frequency is performed. In the example of FIG. 15, the zoom operation corresponds to the first process, and the ISO sensitivity adjustment corresponds to the second operation.

  Thereby, processing with a high setting change frequency is executed by a motion by a dominant hand, and processing with a low setting change frequency is executed by a motion by a non-dominant hand. Accordingly, since frequently performed processing can be performed by a dominant hand with motion, many motions that are natural and easy for the user are performed. Therefore, an interface that is easy for the user to use can be realized. Specifically, it is conceivable to distribute operations as shown in FIG.

  As described above, the three embodiments 1 to 3 to which the present invention is applied and the modified examples thereof have been described. However, the present invention is not limited to the embodiments 1 to 3 and the modified examples as they are. The constituent elements can be modified and embodied without departing from the scope of the invention. Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above-described first to third embodiments and modifications. For example, some constituent elements may be deleted from all the constituent elements described in the first to third embodiments and modifications. Furthermore, you may combine suitably the component demonstrated in different embodiment and modification. Thus, various modifications and applications are possible without departing from the spirit of the invention.

  In addition, in the specification or drawings, a term (for example, zoom amount) described at least once together with a different term having a broader meaning or the same meaning (for example, an angle of view adjustment amount) may be used anywhere in the specification or the drawing. Can be replaced with a different term.

110 imaging lens, 115 imaging unit, 120 imaging element, 130 image processing unit,
140 I / F unit, 150 storage unit, 160 control unit, 162 discrimination unit,
164 processing unit, 166 sensor information acquisition unit, 168 movement distance information calculation unit,
169 Sensing threshold level setting unit, 170 lens drive motor, 180 angle of view adjustment unit,
190 display unit, 200 sensor unit, 201 motion sensor,
203 touch sensor, 205 imaging sensor, 210 right hand grip, 220 left hand grip

Claims (10)

A sensor information acquisition unit for acquiring sensor information from the sensor;
Based on the sensor information, a determination unit that performs a process of determining whether the user is holding the portable electronic device with the left or right hand,
A processing unit that performs a process of changing the content of the process of the mobile electronic device based on a determination result of whether the user is holding the mobile electronic device with the left or right hand by the determination unit;
A portable electronic device comprising: In claim 1,
A travel distance information calculation unit;
An imaging unit that captures an image;
An angle-of-view adjustment unit for adjusting an angle of view in the imaging unit;
Including
The sensor is a motion sensor;
The sensor information acquisition unit
Obtaining motion information from the motion sensor as the sensor information;
The movement distance information calculation unit
Based on the motion information, the movement distance information of the motion sensor is calculated,
The angle of view adjustment unit
A portable electronic device that adjusts an angle of view in the imaging unit based on the movement distance information calculated by the movement distance information calculation unit. In claim 2,
A detection threshold level setting unit for setting a detection threshold level for determining whether or not the motion detected by the motion sensor is a motion for instructing angle of view adjustment;
The angle of view adjustment unit
When it is determined that the distance represented by the moving distance information is greater than the sensing threshold level, the angle of view is adjusted, and the distance represented by the moving distance information is determined to be smaller than the sensing threshold level. A portable electronic device characterized by non-adjusting the angle of view in the case of In claim 3,
The sensing threshold level setting unit includes:
When the determination unit determines that the user is holding the portable electronic device with a dominant hand, the detection threshold level is higher than when the user is determined to be holding the portable electronic device with a non-dominant hand. Is set to a low value. In any of claims 2 to 4,
The angle of view adjustment unit
When it is determined by the determination unit that the user is holding the portable electronic device with a dominant hand, the movement distance information is greater than when the user is determined to be holding the portable electronic device with a non-dominant hand. A portable electronic device characterized in that the angle of view adjustment with respect to is increased. In any one of Claims 1 thru | or 5,
The processor is
As the process, a first process and a second process are performed.
The first process is a process that is set when the frequency of changing the setting by the user is high,
The second process is a process set when the frequency of changing the setting by the user is low,
The processor is
When it is determined by the determination unit that the user is holding the portable electronic device with a dominant hand, the first process set as a process whose setting is frequently changed by the user is performed. When it is determined that the user is holding the portable electronic device with a non-dominant hand, the second process set as a process with a low frequency of setting change by the user is performed. Mobile electronic devices. In any one of Claims 1 thru | or 6.
The sensor is a motion sensor;
The sensor information acquisition unit
Obtaining motion information from the motion sensor as the sensor information;
The discrimination unit
A portable electronic device that performs processing to determine whether the user is holding the portable electronic device with the left or right hand based on the motion information. In claim 7,
The discrimination unit
A motion trajectory of the motion sensor is calculated based on the motion information, and a process of determining whether the user is holding the portable electronic device with the left or right hand based on the calculated trajectory is performed. Mobile electronic devices. In any one of Claims 1 thru | or 6.
The sensor is a touch sensor,
The sensor information acquisition unit
Touch information indicating whether or not the user is touching the portable electronic device is acquired from the touch sensor as the sensor information,
The discrimination unit
A portable electronic device that performs processing to determine whether the user is holding the portable electronic device with the left or right hand based on the touch information. In any one of Claims 1 thru | or 6.
The sensor is an imaging sensor that images a user;
The sensor information acquisition unit
A user image captured by the imaging sensor is acquired as the sensor information,
The discrimination unit
A portable electronic device that performs processing to determine whether the user is holding the portable electronic device with the left or right hand based on the user image.

Images