JP2015005136A - Electronic apparatus, program and processing execution method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic apparatus allowing easy operation input, a program and a processing execution method.SOLUTION: An electronic apparatus according to an embodiment includes a housing, a display part, input detection means, sound detection means, and execution means. At least a part of the display part is exposed from the housing. The input detection means detects an operation input applied to the housing. The sound detection means detects an operation input applied to the housing. The execution means executes predetermined processing on the basis of the detection results of the input detection means and the sound detection means.

Description

  Embodiments described herein relate generally to an electronic device, a program, and a process execution method.

  In recent years, electronic devices have become smaller and thinner, and many portable electronic devices are in circulation. When such an electronic device is taken out of the house and used, the electronic device may be held with one hand and an operation input may be performed on, for example, a touch panel with the other hand. However, there are cases where it is difficult to use both hands outside the house, such as in a train, and there is a user need to hold an electronic device with one hand and perform operation input without using the other hand To do.

JP 2006-285966 A

  The present invention has been made in view of the above, and it is an object of the present invention to provide an electronic device, a program, and a process execution method capable of easily performing an operation input.

  The electronic device according to the embodiment includes a housing, a display unit, an input detection unit, a sound detection unit, and an execution unit. The display unit is at least partially exposed from the housing. The input detection means detects an operation input given to the casing. The sound detection means detects an operation input given to the casing. The execution means executes a predetermined process based on detection results of the input detection means and the sound detection means.

The perspective view which shows an example of the external appearance of the electronic device in embodiment. 1 is an exemplary block diagram illustrating an example of a system configuration of an electronic apparatus according to an embodiment. The block diagram which shows an example of the function structure in embodiment. The flowchart which shows an example of the input operation recognition process in embodiment. The flowchart which shows an example of the input operation recognition process in the modification 1. FIG. 11 is a perspective view illustrating an example of an external appearance of an electronic device according to Modification 2.

  Hereinafter, embodiments will be described with reference to the drawings.

  FIG. 1 is a perspective view illustrating an example of an external appearance of an electronic apparatus according to the present embodiment.

  The electronic device of the present embodiment is a portable electronic device, and is realized by, for example, the tablet computer 10. The electronic device may be realized as a smartphone, an electronic book, a notebook personal computer, or the like.

  The tablet computer 10 includes a computer main body 1 and a touch screen display 17. The computer main body 1 has a thin box-shaped housing 13. The touch screen display 17 is disposed on the surface of the computer main body 1, and a part thereof is exposed from the casing. The touch screen display 17 includes a flat panel display (for example, a liquid crystal display (LCD)) and a touch panel. The touch panel is provided so as to cover the screen of the flat panel display. The touch panel is configured to detect a position (coordinates) on the touch screen display 17 touched by a user's finger or pen.

  In addition, the tablet computer 10 can be operated by the user by an operation other than the operation input to the touch screen display 17. Examples of the operation input method include a method in which the user taps the housing 13 with a belly or a nail of a finger (hereinafter also referred to as tapping) or rubs. The tablet computer 10 detects these operation inputs and executes predetermined processing corresponding to the operation inputs.

  A protrusion 15 (hereinafter also referred to as a convex portion) is provided on a part of the surface of the housing 13. When the user holds the computer main body 1, the protrusion 15 is disposed at a position where the user can easily touch it with the hand held by the user. The user can execute an operation input by an operation such as rubbing the protrusion 15. When the user rubs the protrusion 15 of the housing 13, the computer main body 1 is vibrated differently from the case of rubbing other flat parts, and a sound different from the case of rubbing other parts is generated. In the present embodiment, the protruding portion 15 is provided in the housing 13, but is not limited thereto, and may be configured by, for example, a seal attached to the housing 13.

  As described above, the user can input an operation to the tablet computer 10 by a tap operation on the housing 13 or the like. This operation input detection method will be described later with reference to FIGS.

  Next, an overview of the system configuration of the electronic apparatus according to the present embodiment will be described with reference to FIG.

  FIG. 2 is a block diagram illustrating an example of a system configuration of the electronic device according to the present embodiment.

  The tablet computer 10 includes a central processing unit (CPU) 101, a system controller 102, a main memory 103, a graphics controller (GPU) 105, a sound controller 106, a BIOS-ROM 107, a solid state drive (SSD) 109, a wireless LAN controller 112, an embedded A controller (EC) 113, an EEPROM 114, a USB connector 13, a touch screen display 17, a video memory (VRAM) 105A, an acceleration sensor 205, and the like are provided.

  The CPU 101 is a processor that controls the operation of each unit in the tablet computer 10. The CPU 101 executes an operating system (OS) 21 and various application programs loaded from the SSD 109 to the main memory 103. The application program includes an operation input utility program 22, an application program 23, and the like. The operation input utility program 22 may be a program included in the OS 21.

  The CPU 101 also executes a BIOS (basic input / output system) stored in the BIOS-ROM 107. The BIOS is a program for hardware control.

  The system controller 102 is a bridge device that connects between the local bus of the CPU 101 and each device on a PCI (Peripheral Component Interconnect) bus and each device on an LPC (Low Pin Count) bus. Further, the system controller 102 includes an IDE (Integrated Drive Electronics) controller for controlling the SSD 109. Further, the system controller 102 has a function of executing communication with the sound controller 106. Furthermore, the system controller 102 also has a function of executing communication with the GPU 105 via a PCI EXPRESS serial bus or the like.

  The GPU 105 is a display controller that controls the LCD 17 </ b> A used as a display monitor of the tablet computer 10. A video signal (also referred to as a display signal) generated by the GPU 105 is sent to the LCD 17A.

  The sound controller 106 is a sound source device, and outputs audio data to be reproduced to the speakers 18A and 18B. The wireless LAN controller 112 is a wireless communication device that executes wireless communication of, for example, the IEEE 802.11 standard.

  The EC 113 is an embedded controller for power management. The EC 113 has a function of powering on / off the tablet computer 10 in accordance with a user operation. The power supply circuit 121 generates operating power to be supplied to each component of the tablet computer 10 using power supplied from the battery 122 in the tablet computer 10 or power supplied from an external power source such as the AC adapter 123. To do. The power supply circuit 121 also charges the battery 122 using power supplied from an external power supply.

  In addition to the LCD 17A, the touch screen display 17 incorporates a touch panel 17B. The touch panel 17B arranged so as to overlap the LCD 17A includes a sensor, an MCU (Micro controller unit), and the like. When a touch operation is performed on the touch panel 17B, the touched position is detected by a sensor, and input information including the touched position (coordinates) on the touch panel 17B is output by the MCU.

  The video memory (VRAM) 105 </ b> A is connected to the graphics controller 105. The video memory (VRAM) 105A stores, for example, screen image data corresponding to a screen image displayed on an external display or the LCD 17A.

  The acceleration sensor 205 is a sensor module capable of detecting acceleration, and can detect the posture of the main body 1 of the tablet computer 10 by detecting gravitational acceleration. Further, the acceleration sensor 205 can detect that the user's casing 13 has been tapped (tapped) or rubbed in part by detecting a predetermined acceleration pattern. In other words, the acceleration sensor 205 can detect an impact or vibration applied to the housing 13 and functions as an operation input detection unit that detects an operation input from the user. In the present embodiment, an acceleration sensor is exemplified as the operation input detection unit. However, the operation input detection unit is not limited to this as long as it is a unit that can detect a user operation input to the housing 13. For example, an angular velocity sensor, an impact sensor, a vibration sensor, etc. Other sensor modules may be used.

  The microphone 16 is sound collecting means that can collect ambient sounds and functions as sound detecting means. The microphone 16 converts ambient sound into an analog signal and outputs it to the sound controller 106. The microphone 16 can collect (detect) a sound of a user's tap operation on the housing 13 and a sound generated by rubbing the housing 13.

  In this embodiment, the tablet computer 10 has a function of executing a predetermined process based on the acceleration detected by the acceleration sensor 205 and the sound collected by the microphone 16. In other words, the tablet computer 10 has a function of executing a predetermined process based on the impact / vibration on the user's casing 13 detected by the operation input detection unit and the sound detected by the sound detection unit.

  Next, a functional configuration that constitutes the above function will be described.

  FIG. 3 is a block diagram illustrating an example of a functional configuration according to the present embodiment.

  The OS 21 is a control system (operating system) that controls the tablet computer 10 in an integrated manner.

  The application 23 is an application that runs on the OS 21 and executes a predetermined function based on an operation input from the user. Here, the application 23 is exemplified as a book application. The application 23 has a function of displaying book content data so that the user feels that he / she is calling a book.

  The input operation recognition unit 31 has a function of inputting a predetermined instruction to the OS 21 or the application 23 based on the voice input (sound input) collected by the microphone 16 and transmitted from the sound controller 106 and the acceleration detected by the acceleration sensor 205. have. The input operation recognition unit 31 can analyze the input sound and acceleration. The input operation recognition unit 31 determines whether or not the input sound corresponds to a predetermined frequency and amplitude, and determines whether or not the motion indicated by the input acceleration is a predetermined impact or vibration. Then, the input operation recognition unit 31 refers to the correspondence table 32 in which a combination of a predetermined sound and shock / vibration and an instruction to the OS 21 or the application 23 are associated with each other, and a combination of the input sound and shock / vibration If an instruction that matches is registered in the correspondence table 32, this instruction is input to the OS 21 or the application 23. The contents of the correspondence table 32 may be updated. For example, the instruction corresponding to the combination of sound and shock / vibration that has been registered so far may be changed to another instruction, or a new instruction corresponding to a new combination of sound and shock / vibration can be added. Also good. When the contents of the correspondence table 32 are updated, the sound detected by the input operation recognition unit 31 and the combination of shock / vibration and the instruction contents are registered in the correspondence table 32.

  The instruction corresponding to the operation input may be, for example, an instruction for substituting the user's operation input on the touch screen display 17. In this case, it can be considered as one of instructions to replace a touch operation on a predetermined position of the touch screen display 17 or the like. Alternatively, it may be an instruction that substitutes for an instruction by a hardware button of the tablet computer 10. Further, an undefined instruction may be used as an instruction from the touch screen display 17 or the hardware button.

  The instruction corresponding to the operation input may be an instruction supported by the OS 21 or an instruction that is not supported by the OS 21 and that communicates natively with the application 23. If the instruction is natively defined with the application 23, the input operation recognition unit 31 sends the instruction directly to the application 23.

  When the application 23 is, for example, a book application, the instructions corresponding to the operation input include page turning / returning, page skipping, enlargement / reduction, and the like. When the user holds the tablet computer 10 with one hand, the user can tap and / or tap the housing 13 with the finger of the holding hand, without using the other hand, or Operation input such as page skipping can be performed.

  For example, the input operation recognition unit 31 may identify the user's input operation based only on the impact / vibration on the user's casing 13 detected by the operation input detection unit. By specifying the user's input operation based on the two elements of the sound to be detected, more accurate detection processing can be performed, and erroneous detection can be reduced.

  The tablet computer 10 accommodates various electronic components in a housing 13, and the density of components varies depending on the position in the housing 13. Thereby, when the housing 13 is tapped / rubbed from the outside, a different sound may be generated depending on the position. That is, it is possible to specify the place where the tap or the like on the housing 13 is performed with a certain accuracy, and a different function may be assigned depending on the position where the tap is performed using this. That is, the tablet computer 10 executes a predetermined process according to the operated position, such as page turning when the side surface of the housing 13 is tapped and page returning when the back surface is tapped.

  As a method for specifying the operation position, in addition to the difference in sound quality (sound waveform pattern) at a tapped location, the operation position is specified in accordance with the volume of sound collected by the microphone 16, the detection result of the acceleration sensor 205, and the like. Can be considered. For example, if the sound collected by the microphone 16 is large, the position close to the installation position of the microphone 16 should be tapped, and if it is small, the position far from the tapping should be tapped. It is likely that The position of a tap or the like can be determined by these methods. Further, it is possible to specify the position of the tap or the like with higher accuracy by making a composite determination using sound quality, loudness, impact / vibration, and the like.

  Next, the flow of processing in this embodiment will be described.

  FIG. 4 is a flowchart showing an example of the input operation recognition process in the present embodiment.

  First, the input operation recognition unit 31 determines whether or not a predetermined pattern of impact / vibration has been detected based on the acceleration detection result by the acceleration sensor 205 (step S41). If the predetermined pattern of impact / vibration is not detected (step S41: No), the process loops through step S41.

  When the input operation recognition unit 31 detects a predetermined pattern of impact / vibration (step S41: Yes), the input operation recognition unit 31 detects the sound collected by the microphone 16 at the detected time (step S42).

  Next, the input operation recognizing unit 31 analyzes the detected shock / vibration and sound waveform pattern, and specifies an input operation corresponding to the result (step S43). At the time of identification, the input operation recognition unit 31 performs identification processing with reference to the correspondence table 32. When the operation process is specified, the input operation recognition unit 31 inputs the specified operation input to the OS 21 or the application 23, and the OS 21 or the application 23 executes a process based on the input operation (step S44).

  Thus, a series of processing flow is completed.

  In order to specify the collected sound, the sound when the user who uses the user taps / rubs the housing 13 may be stored in advance, for example, at the first use. Since the strength / speed of the tap / rub operation may differ depending on the user to be used, more accurate detection can be realized by first storing the tap / rub operation sound of a specific user. . In addition, since it is conceivable that a tablet device or the like may newly cover the main body after purchase, the sound calibration may be executed again after the cover is attached.

  Furthermore, based on the acceleration detected by the acceleration sensor 205 and the sound collected by the microphone 16, it is possible to detect the speed of the user's tap / rub operation. The input operation recognition unit 31 may determine the operation input based on this speed. For example, when the protrusion 15 is rubbed slowly, only one page may be paged, and when rubbed quickly, multiple pages may be paged (page skipping).

  Next, a modified example in the present embodiment will be described.

(Modification 1)
Modification 1 will be described with reference to FIG.

  FIG. 5 is a flowchart showing an example of the input operation recognition process in the present modification.

  In this modification, the tablet computer 10 has the same hardware and software internal configurations as those in the above embodiment. In the above-described embodiment, the user's operation input is determined based on the impact / vibration detection result and the sound detection result. However, in this modification, the user's operation input is determined based only on the sound detection result.

  First, the input operation recognition unit 31 detects the sound collected by the microphone 16 (step S51).

  If the detected sound is not equal to or higher than the predetermined volume (threshold) (step S52: No), the process returns to step S51.

  When the detected sound is equal to or higher than a predetermined volume (threshold) (step S52: Yes), the input operation recognition unit 31 analyzes the detected sound pattern and specifies an input operation corresponding to the result (step S53). At the time of identification, the input operation recognition unit 31 performs identification processing with reference to the correspondence table 32. When the operation process is specified, the input operation recognition unit 31 inputs the specified operation input to the OS 21 or the application 23, and the OS 21 or the application 23 executes a process based on the input operation (step S54).

  Thus, a series of processing flow is completed.

  In this modification, the user's operation input is determined based only on the sound detection result. At this time, the analysis process of the voice pattern has a large processing amount, and constantly executing the analysis process of the sound waveform pattern may increase the processing amount of the entire tablet computer 10 and increase the power consumption. For this reason, the processing amount and power consumption of the tablet computer 10 as a whole can be reduced by executing the analysis processing of the sound waveform pattern only for the sound having a volume equal to or higher than the threshold.

  Furthermore, other modified examples will be described.

(Modification 2)
Modification 2 will be described with reference to FIG.

  FIG. 6 is a perspective view illustrating an example of an external appearance of an electronic device according to this modification.

  In this modification, the tablet computer 10 has a software configuration substantially similar to that of the above-described embodiment, but the hardware configuration is partially different.

  The tablet computer 10 can be folded in a substantially book shape. In FIG. 6, the book application is activated and the book content is displayed on the display. In the case of such a shape, the user may hold the tablet computer 10 by grasping the left and right edges of the housing 13. The housing 13 of the tablet computer 10 of this modification is provided with a protrusion 15 at a position where it can be easily touched from the left and right hands, and the user differs from the tablet computer 10 by rubbing the left and right protrusions 15. Operation input can be performed. For example, page turning may be performed by rubbing the right protrusion 15, and page returning may be performed by rubbing the left protrusion 15.

  With these embodiments and modifications, the user can easily perform operation input without releasing the hand holding the electronic device.

Note that the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

DESCRIPTION OF SYMBOLS 1 ... Main body, 10 ... Tablet computer, 15 ... Projection part, 16 ... Microphone, 17 ... Touch screen display, 17A ... LCD, 17B ... Touch panel, 18A, B ... Speaker, 101 ... CPU, 102 ... System controller, 103 ... Main Memory, 105 ... GPU, 105A ... VRAM, 106 ... Sound controller, 107 ... BIOS-ROM, 109 ... SSD, 111A ... USB controller, 112 ... Wireless LAN controller, 113 ... EC, 114 ... EEPROM, 121 ... Power supply circuit, 122 ... Battery, 123 ... AC adapter, 205 ... Acceleration sensor, 21 ... OS, 22 ... Operation input utility program, 23 ... Application, 31 ... Input operation recognition unit, 32 ... Correspondence table.

Claims (9)

A housing,
A display part at least partially exposed from the housing;
Input detection means for detecting an operation input given to the housing;
Sound detection means for detecting ambient sounds;
Execution means for executing predetermined processing based on detection results of the input detection means and the sound detection means;
An electronic device comprising:   The electronic device according to claim 1, wherein the input detection unit includes a sensor.   The electronic apparatus according to claim 1, wherein the input detection unit detects vibration of the housing.   The electronic device according to claim 1, wherein the input detection unit detects an impact on the housing. The housing has a convex portion,
The electronic device according to claim 1, wherein the execution unit detects a contact sound with respect to the convex portion and determines a predetermined process based on the contact sound.   The execution means has a table indicating a correspondence between a combination of the detection result of the input detection means and the detection result of the sound detection means and a process to be executed, and determines a process to be executed based on the table. The electronic device according to claim 1.   The electronic apparatus according to claim 6, further comprising updating means for updating the contents of the table. A program that is executed in an electronic device including a housing and a display unit that is at least partially exposed from the housing,
Let the input detection means detect the operation input given to the housing,
Let the sound detection means detect ambient sounds,
A program for executing predetermined processing based on detection results of the input detection means and the sound detection means. A processing execution method in an electronic device comprising a housing and a display unit at least partially exposed from the housing,
An input detection means detects an operation input given to the housing,
Sound detection means detects ambient sounds,
A process execution method for executing a predetermined process based on detection results of the input detection means and the sound detection means.

Images