JP2013228813A - Electronic apparatus and movement detection method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To prevent input due to movement of a vibration device installed in an electronic apparatus using the movement of the apparatus as an interface.SOLUTION: An electronic apparatus 100 includes: an acceleration sensor 113 for detecting acceleration; a vibration section 16 for generating vibration; a sound collection section 114 for generating voice data by collecting voice generated in the vibration section 16; a storage section 112 for storing the acceleration corresponding to each voice data; and a movement detection section 121 for reading the acceleration corresponding to the voice data generated by the sound collection section 114 from the storage section 112, and for detecting the movement of the apparatus on the basis of acceleration obtained by removing the read acceleration from the acceleration detected by the acceleration sensor 113.

Description

  The present invention relates to an electronic device and a motion detection method.

  For example, Patent Document 1 is known as an electronic device such as a mobile phone or a personal digital assistant provided with a triaxial acceleration sensor or the like. An electronic apparatus as shown in Patent Document 1 has a motion interface that uses the movement of the own apparatus as an interface by detecting the movement of the own apparatus by a three-axis acceleration sensor.

Special table 2007-53113 gazette

  However, in a conventional electronic device, when vibration is generated by a vibration device or the like, the vibration is detected as the movement of the own device. For this reason, when the user performs a motion operation while the electronic device is vibrating, the conventional electronic device detects a mixed motion of the vibration and the motion operation, and thus the function desired by the user is not executed. There is a problem that there is a case.

  The present invention has been made in view of the above points, and an object of the present invention is to provide an electronic apparatus and a motion detection that can prevent an input due to the movement of a vibration device provided therein, in an electronic apparatus that uses the movement of its own device as an interface. It is to provide a method.

  SUMMARY An advantage of some aspects of the invention is that an acceleration sensor that detects acceleration, a vibration unit that generates vibration, and a sound that is generated by the vibration unit are collected. A sound collecting unit that generates sound data, a storage unit that stores acceleration corresponding to each sound data, an acceleration corresponding to the sound data generated by the sound collecting unit is read from the storage unit, and the acceleration sensor And a motion detector that detects a motion of the device based on an acceleration obtained by removing the read acceleration from the acceleration detected by the electronic device.

  Further, according to one embodiment of the present invention, the electronic device detects acceleration by the electronic device, and the electronic device collects sound from a vibration unit that generates vibration to generate sound data; The electronic device reads the acceleration corresponding to the generated voice data from the storage unit that stores the acceleration corresponding to each voice data, and moves the own device based on the acceleration obtained by removing the read acceleration from the detected acceleration. And a step of detecting a motion detection method.

  ADVANTAGE OF THE INVENTION According to this invention, in the electronic device which uses the motion of an own apparatus as an interface, the input by the motion of the vibration device with which it is equipped can be prevented.

It is a figure which shows the cross-sectional structure of the electronic device by embodiment of this invention. It is a figure which shows the cross-sectional structure of the electronic device by this embodiment. It is a block diagram which shows the function structure of the electronic device by this embodiment. It is the schematic which shows the data structure and data example of the operation table which the operation memory | storage part by this embodiment memorize | stores. It is an image figure which shows an example of operation by this embodiment. It is the schematic which shows the data structure of the acceleration data table which the acceleration data storage part by this embodiment memorize | stores. It is a figure for demonstrating operation | movement of the motion detection process by this embodiment. It is a flowchart which shows the procedure of the motion detection process by this embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
1 and 2 are views showing a cross-sectional configuration of the electronic device 100 according to the present embodiment. In FIG. 1 and FIG. 2, a part of the configuration is omitted for easy identification of the components of the electronic device 100.
As shown in FIGS. 1 and 2, the electronic device 100 includes a display unit 10, a base unit 11, a bottom cover 15, a vibration unit 16, a contact detection unit 22, a cover member 26, a microphone 17, and a speaker 24. ing. The electronic device 100 is assembled in a state where these components are stacked. Although not shown in the figure, the electronic device 100 further includes a power supply unit such as a control unit and a battery.

  Hereinafter, in the present embodiment, an XYZ orthogonal coordinate system is used to describe the configuration of the electronic device 100. In the XYZ orthogonal coordinate system, the stacking direction of the components of the electronic device 100 is the Z direction. A plane orthogonal to the Z direction is defined as an XY plane, and directions orthogonal to the XY plane are defined as an X direction and a Y direction, respectively.

The display unit 10 is formed in a rectangular shape when viewed in the Z direction. The display unit 10 has a display surface 10a on the −Z side surface. Images such as still images and moving images are displayed on the display surface 10a. For example, a liquid crystal display panel or an organic EL panel is used as the display unit 10. A touch panel mechanism (not shown) is provided on the display surface 10 a of the display unit 10.
The base unit 11 holds the display unit 10. The base part 11 is formed so as to surround the side part of the display part 10 and the peripheral part of the display surface 10a. The base portion 11 is a first housing portion 101 for accommodating an electronic circuit.

  The vibration part 16 includes a fixed part 16a, a movable part 16b, and a drive part. The fixed part 16a is formed in a cylindrical shape, for example, and accommodates the movable part 16b and the drive part. The fixed portion 16 a is disposed in the opening of the bottom cover 15.

  The movable portion 16b is provided so as to be movable in the Z direction. The drive unit is connected to the movable unit 16b and moves the movable unit 16b in the Z direction. For example, a voice coil motor is used as the drive unit. The drive operation of the drive unit is performed by a control circuit. The vibration unit 16 has a configuration in which the movable unit 16b vibrates in the Z direction when the drive unit reciprocates the movable unit 16b in the Z direction.

  The contact detection unit 22 is installed on each side surface of the display unit 10 with respect to the surface on which the display surface 10a is installed, and is formed in a rectangular frame shape when viewed in the Z direction so as to surround four sides of the display unit 10. The contact detection unit 22 detects the presence / absence of a contact from the outside (for example, a user) and the contact position.

The microphone 17 is installed in the vicinity of the vibration unit 16 on the substrate on which the vibration unit 16 is installed, and detects sound from the vibration unit 16.
The speaker 24 outputs sound to the outside.

  As shown in FIGS. 1 and 2, the cover member 26 covers the + Z side end of the electronic device 100. The cover member 26 has a contact detection unit 22.

  The cover member 26 and the contact detection unit 22 are a second housing portion 102 for housing an electronic circuit. In addition, the second housing portion 102 and the first housing portion 101 including the base portion 11 constitute a housing of the electronic device 100.

  The cover member 26 is connected to the movable part 16 b of the vibration part 16. Therefore, the cover member 26 is provided so as to be movable in the Z direction integrally with the movable portion 16b. When the movable portion 16b vibrates in the Z direction, the vibration of the movable portion 16b is transmitted to the cover member 26, and the cover member 26 vibrates in the Z direction.

  For example, when the movable part 16b moves in the + Z direction from the state shown in FIG. 1, the cover member 26 and the contact detection part 22 move in the + Z direction as the movable part 16b moves as shown in FIG. . Accordingly, the space between the first housing portion 101 and the second housing portion 102 is widened, and the relative movement between the first housing portion 101 and the second housing portion 102 has been performed. become.

  When the movable portion 16b moves in the −Z direction from the state shown in FIG. 2, the cover member 26 moves in the −Z direction as the movable portion 16b moves, and returns to the state shown in FIG. Also in this case, a relative movement has been performed between the first housing portion 101 and the second housing portion 102. In the case of this embodiment, the cover member 26 and the contact detection unit 22 vibrate by reciprocating (vibrating) the movable part 16b in the Z direction.

  As described above, the electronic device 100 includes a housing having the first housing portion 101 and the second housing portion 102 for housing the electronic circuit, and the first housing portion 101 and the second housing that vibrate in a predetermined direction. Since the vibration unit 16 that relatively moves the housing portion 102 is provided, at least one of the first housing portion 101 and the second housing portion 102 can be directly vibrated. As a result, vibration can be efficiently transmitted to the outside.

FIG. 3 is a block diagram illustrating a functional configuration of the electronic device 100 according to the present embodiment.
The electronic device 100 is a portable information terminal such as a mobile phone, a smartphone, or a digital camera. The electronic device 100 includes a control unit 111, a storage unit 112, an acceleration sensor 113, a sound collection unit 114, an operation unit 115, an audio output unit 116, a display unit 10, and a vibration unit 16. Is done.

The acceleration sensor 113 is a three-axis acceleration sensor that detects acceleration in each of three axes orthogonal to each other.
The operation unit 115 includes a contact detection unit 22 and receives an operation from the user.

The audio output unit 116 includes a speaker 24 and outputs audio.
The sound collection unit 114 includes a microphone 17 installed in the vicinity of the vibration unit 16 and collects sound from the vibration unit 16 to generate sound data.

  The storage unit 112 includes an operation storage unit 123 and an acceleration data storage unit 124. The operation storage unit 123 stores reference data for movement of the electronic device 100 for executing each function. The acceleration data storage unit 124 stores acceleration data corresponding to each voice data. The acceleration data is data indicating the acceleration detected by the acceleration sensor 113 in each of the three axes when the sound collecting unit 114 picks up the sound of the corresponding sound data.

  The control unit 111 controls each unit of the electronic device 100 in an integrated manner. The control unit 111 includes a motion detection unit 121 and an execution control unit 122. The motion detection unit 121 detects a motion based on the voice data generated by the sound collection unit 114 and the acceleration detected by the acceleration sensor 113 when the contact detection unit 22 detects contact. Specifically, the motion detection unit 121 reads acceleration data corresponding to the sound data generated by the sound collection unit 114 from the acceleration data storage unit 124, and the acceleration data read from the acceleration detected by the acceleration sensor 113 indicates Subtract acceleration. Then, the motion detection unit 121 generates motion data of the own device based on the acceleration after subtraction. The execution control unit 122 determines a function to be executed based on the motion data generated by the motion detection unit 121 and the reference data stored in the operation storage unit 123.

FIG. 4 is a schematic diagram illustrating a data structure and a data example of an operation table stored in the operation storage unit 123 according to the present embodiment. As shown in the figure, the operation table is tabular data composed of rows and columns, and has columns of items of functions and operations. Each row in this table exists for each function.
The function is a function that can be executed by the electronic device 100. The operation is data indicating an operation for executing a function, and is reference data of movement of the electronic device 100 detected by the movement detection unit 121 when the user performs the operation.
In the example shown in this figure, an operation for “playing” music or the like is “pattern 1”, an operation for “fast forward” is “pattern 2”, and an operation for “rewinding” is performed. The operation is “pattern 3”.

FIG. 5 is an image diagram illustrating an example of an operation according to the present embodiment.
FIG. 5A shows the operation “Pattern 1”. The operation “pattern 1” is a gesture for moving the electronic device 100 to draw a circle. FIG. 5B shows the operation “Pattern 2”. The operation “pattern 2” is a gesture for moving the electronic device 100 on a straight line. FIG. 5C shows the operation “Pattern 3”. The operation “pattern 3” is a gesture of shaking the electronic device 100.

FIG. 6 is a schematic diagram illustrating a data structure of an acceleration data table stored in the acceleration data storage unit 124 according to the present embodiment. As shown in the figure, the acceleration data table is tabular data composed of rows and columns, and has columns for each item of reference audio data and acceleration data.
The reference sound data is sound data serving as a reference for sound collected by the sound collection unit 114. The reference sound data may be data indicating sound, or data related to sound such as frequency and vibration amplitude. The acceleration data is acceleration data that the acceleration sensor 113 detects on each of the three axes when the sound collection unit 114 collects sound corresponding to the reference sound data. The acceleration data is acquired in advance by experiments or the like.

Next, with reference to FIGS. 7 and 8, the motion detection process in the electronic apparatus 100 according to the present embodiment will be described. FIG. 7 is a diagram for explaining the operation of the motion detection process according to the present embodiment.
Hereinafter, a case where the user performs a gesture for moving the electronic device 100 on a straight line while the electronic device 100 is reproducing music will be described as an example. In the electronic device 100, music is output from the audio output unit 116, and vibration corresponding to the music is generated by the vibration unit 16.

  FIG. 7A shows the movement a of the electronic device 100 in this case. The motion a is a motion in which a gesture (linear motion) by the user and vibration by the vibration unit 16 are mixed. In the movement a, the movement in the Z direction is a movement by vibration, and the movement in the X direction is a gesture (linear movement) by the user. The acceleration sensor 113 of the electronic device 100 detects the acceleration corresponding to the motion “a” and outputs the detected acceleration to the motion detection unit 121. The sound collection unit 114 collects sound generated by the vibration unit 16 to generate sound data, and outputs the generated sound data to the motion detection unit 121.

  When the reference sound data corresponding to the sound data input from the sound collection unit 114 is stored in the acceleration data storage unit 124, the motion detection unit 121 reads the acceleration data corresponding to the reference sound data. This acceleration data is data of acceleration generated by the vibration of the vibration unit 16. Next, the motion detection unit 121 subtracts the acceleration of the read acceleration data from the acceleration detected by the acceleration sensor 113. Then, the motion detection unit 121 detects the motion b of the electronic device 100 based on the acceleration after subtraction.

  FIG. 7B shows the motion b detected by the motion detection unit 121. As shown in the figure, the motion detection unit 121 detects a motion b obtained by removing motion due to vibration from the actual motion a of the electronic device 100. The execution control unit 122 determines a function corresponding to the motion b, and controls each unit of the electronic device 100 to execute the function. Thus, when the electronic device 100 vibrates, the electronic device 100 detects the motion b from which the motion due to the vibration is removed. Thereby, even if the electronic device 100 is vibrating, the user can perform a gesture operation as intended.

FIG. 8 is a flowchart showing the procedure of motion detection processing according to this embodiment.
The following operation is performed when the vibration unit 16 is generating vibration.
First, the acceleration sensor 113 detects acceleration (step S101).
Then, the sound collection unit 114 collects sound when the acceleration sensor 113 detects acceleration in step S101 and generates sound data (step S102).
Next, the motion detection unit 121 determines whether or not contact is detected by the contact detection unit 22 (step S103). The contact detection unit 22 detects contact when the user is holding the electronic device 100. That is, the motion detection unit 121 determines whether or not the user is holding the electronic device 100. When the contact detection unit 22 does not detect contact (that is, when the user does not hold the electronic device 100) (step S103: No), the process returns to step S101.

  On the other hand, when the contact detection unit 22 detects contact (that is, when the user holds the electronic device 100) (step S103: Yes), the motion detection unit 121 generates the audio data generated in step S102. The acceleration data corresponding to is read out from the acceleration data storage unit 124 and acquired (step S104). Specifically, the motion detection unit 121 reads the acceleration data corresponding to the reference audio data from the acceleration data storage unit 124 when the reference audio data corresponding to the audio data is stored in the acceleration data storage unit 124. . If the reference voice data corresponding to the voice data is not stored in the acceleration data storage unit 124, the process proceeds to step S106.

Next, the motion detection unit 121 subtracts the acceleration of the acceleration data read in step S104 from the acceleration detected in step S101 (step S105).
Then, the motion detection unit 121 detects the motion of the electronic device 100 based on the subtraction acceleration (step S106).

Subsequently, the execution control unit 122 determines whether the movement of the electronic device 100 is an operation for executing a function (step S107). Specifically, the execution control unit 122 determines whether or not reference data (operation) corresponding to movement data of the electronic device 100 is stored in the operation storage unit 123. The corresponding data is data in which the trajectories drawn by the movement are almost the same (within a predetermined range). If the movement of the electronic device 100 is not an operation for executing a function (step S107: No), the process is terminated.
On the other hand, when the movement of the electronic device 100 is an operation for executing a function (step S107: Yes), the execution control unit 122 executes a function corresponding to the operation (step S108).

  Thus, according to the present embodiment, the electronic device 100 removes the movement of the electronic device 100 that has detected the movement of the electronic device 100 due to vibration based on the sound collected by the sound collection unit 114. Thereby, even if the electronic device 100 is vibrating, the user can perform a gesture operation as intended. That is, it is possible to prevent input due to vibration of the vibration unit 16.

Further, the program for realizing each step shown in FIG. 8 is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into a computer system and executed, whereby the operation of the apparatus itself You may perform the process which detects. Here, the “computer system” may include an OS and hardware such as peripheral devices.
The “computer-readable recording medium” refers to a floppy (registered trademark) disk, a magneto-optical disk, an SD card, a writable nonvolatile memory such as a flash memory, a portable medium such as a CD-ROM, and a computer system. A built-in storage device such as a hard disk.

Further, the “computer-readable recording medium” means a volatile memory (for example, DRAM (Dynamic DRAM) in a computer system that becomes a server or a client when a program is transmitted through a network such as the Internet or a communication line such as a telephone line. Random Access Memory)), etc., which hold programs for a certain period of time.
The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line.
The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

The embodiments of the present invention have been described in detail above with reference to the drawings. However, the specific configuration is not limited to the above-described one, and various design changes and the like can be made without departing from the scope of the present invention. Is possible.
For example, in the above-described embodiment, the motion detection process illustrated in FIG. 8 is performed when vibration is generated. However, the motion detection process illustrated in FIG. 8 may be performed even when vibration is not generated. .
In the above-described embodiment, the movement of the electronic device 100 is detected based on the difference between the output of the acceleration sensor 113 and the output of the sound collection unit 114. However, the two acceleration sensors are located at different positions from the vibration unit 16. The movement of the electronic device 100 may be detected by taking the difference between the outputs of the acceleration sensors. In this case, since the vibration by the vibration unit 16 is detected as the same value by the two acceleration sensors, the vibration component of the vibration unit 16 can be similarly canceled by taking the difference between the two acceleration sensors.
Further, the operation by the user is not limited to a gesture for drawing a circle (two-dimensional) or a straight line (one-dimensional), and the present embodiment can be similarly applied to a three-dimensional gesture for drawing a three-dimensional figure. .

  DESCRIPTION OF SYMBOLS 100 ... Electronic device 10 ... Display part 16 ... Vibration part 111 ... Control part 112 ... Memory | storage part 113 ... Acceleration sensor 114 ... Sound collection part 115 ... Operation part 116 ... Sound output part 121 ... Motion detection part 122 ... Execution control part 123 ... Operation storage unit 124 ... acceleration data storage unit

Claims (4)

An acceleration sensor for detecting acceleration;
A vibration part that generates vibration;
A sound collection unit that collects sound generated by the vibration unit and generates sound data;
A storage unit for storing acceleration corresponding to each audio data;
Motion detection that reads the acceleration corresponding to the voice data generated by the sound collection unit from the storage unit and detects the motion of the device based on the acceleration obtained by removing the read acceleration from the acceleration detected by the acceleration sensor And
An electronic device comprising: An operation storage unit for storing reference data of movement of the own device for executing each function;
An execution control unit that determines a function to be executed based on the motion data detected by the motion detection unit and the reference data stored in the operation storage unit;
The electronic apparatus according to claim 1, further comprising: It is installed on the side surface of the electronic device, and includes a contact detection unit that detects the presence or absence of contact and the contact position.
The electronic device according to claim 1, wherein the movement detection unit detects movement when contact is detected by the contact detection unit. An electronic device detecting acceleration;
The electronic device picks up sound from a vibration unit that generates vibrations and generates sound data; and
The electronic device reads the acceleration corresponding to the generated voice data from the storage unit that stores the acceleration corresponding to each voice data, and moves the own device based on the acceleration obtained by removing the read acceleration from the detected acceleration. Detecting steps,
A motion detection method comprising:

Images