JP5814823B2 - Mobile terminal, specific mode setting program, and specific mode setting method - Google Patents

Description

  The present invention relates to a mobile terminal, a specific mode setting program, and a specific mode setting method, and more particularly to a mobile terminal, a specific mode setting program, and a specific mode setting method operated by a touch panel.

An example of a portable terminal operated by a touch panel is disclosed in Patent Document 1. The mobile phone of Patent Literature 1 includes a key operation unit and a touch panel, and a key lock setting process for invalidating the operation of the key operation unit may be executed. When the operation of the key operation unit is invalidated, the user can validate the operation of the key operation unit by inputting a locus that matches the locus of the registered password on the touch panel.
JP 2011-160326 [H04M 1/67, H04M 1/175, G06F 3/041, G06F 3/033]

  However, when the touch panel breaks down in the mobile phone of Patent Document 1, the user cannot input a locus that matches the locus of the registered password, and thus cannot make the operation of the key operation unit effective. Therefore, in the case of a mobile phone whose main operation is performed with a touch panel, the user cannot use the mobile phone.

  Therefore, a main object of the present invention is to provide a novel portable terminal, a specific mode setting program, and a specific mode setting method.

  Another object of the present invention is to provide a portable terminal, a specific mode setting program, and a specific mode setting method that can be operated even when a touch operation is not detected.

  The present invention employs the following configuration in order to solve the above problems. The reference numerals in parentheses, supplementary explanations, and the like indicate the corresponding relationship with the embodiments described in order to help understanding of the present invention, and do not limit the present invention.

  1st invention is the recognition part which recognizes the input audio | voice, the operation part operated based on the recognized audio | voice, a display, the control part which controls ON / OFF of a display, the touchscreen provided in a display, and the touch with respect to a touchscreen A mobile device having a detection unit for detecting an operation and enabling a screen lock state that disables a part of the touch operation when the display is turned off. The screen lock state is enabled Sometimes, a counting unit that counts the number of times the display is switched on / off by the control unit, and a setting unit that sets a specific mode for accepting an operation by voice when the counting unit counts the predetermined number of times within a predetermined time. It is a portable terminal provided.

  In the first invention, the recognition unit (20, 30) of the mobile terminal (10: reference numeral exemplifying a corresponding part in the embodiment, hereinafter the same) recognizes the voice input to the microphone. The operation unit (30) reads out address book data or makes a call based on the recognized voice. A GUI or the like is displayed on the display (14). The control units (30, 42) control the on / off of the display based on user key operations and instructions from the processor (30). The touch panel (16) is a pointing device, for example, and is provided on the display. The detection unit (48) detects a touch operation performed on the touch panel. Further, when the display is turned off, a screen lock state in which a touch operation for making a call or the like is disabled is enabled. The counting unit (30, S73, S87) counts the number of times the display is switched on / off by a user operation or the like when the screen lock state is set. The setting unit (30, S91) sets a specific mode for accepting a voice operation when a predetermined number of times is counted within a predetermined time.

  According to the first invention, the mobile terminal can be operated by voice even when a touch operation is not detected.

  The second invention is dependent on the first invention and further includes a key for switching on / off of the display, and the counting unit counts the number of operations on the key.

  In the second invention, the key (22d) for switching on / off of the display includes, for example, a power key. The counting unit counts the number of operations for this key.

  According to the second aspect, the specific mode can be set based on an operation that is highly likely to be performed by the user in a state where no touch operation is detected.

  A third invention is dependent on the first invention and the second invention, and further includes a release unit for releasing the specific mode when the display is turned off in a state where the specific mode is set.

  In the third invention, the release unit (30, S155) activates the specific mode when the display is turned off, for example, when the display is turned off or left unoperated. To release.

  A fourth invention is according to the third invention, further comprising a determination unit that determines whether a touch operation has been performed in a state in which the specific mode is set, and the release unit has been touched by the determination unit When it is judged, the specific mode is canceled.

  In the fourth invention, the determination unit (30, S153) determines whether a touch operation is detected in a state where the specific mode is set. When the touch operation is detected in the specific mode, the cancel unit cancels the specific mode.

  According to the third and fourth inventions, the user can easily release the specific mode.

  A fifth invention is according to any one of the first to fourth inventions, further comprising a security state portion that enables a security lock state that restricts the use of a specific function, and when the display is turned off, When the security lock state is further enabled, and the security lock state is enabled, the setting unit includes a first specific mode setting unit that sets a first specific mode in which a part of voice operation is restricted.

  In the fifth invention, the security state setting unit (30, S11) enables the security lock function that restricts the use of the specific function by a password or the like. For example, when the display is turned off, the screen lock state and the security lock state are simultaneously enabled. The first specific mode setting unit (30, S117) sets the first specific mode (mode 1) when a predetermined number of times are counted within a predetermined time when the security lock state is enabled. For example, when the first specific mode is set, an emergency call can be made, but use of other functions is limited.

  According to the fifth aspect, when the specific mode is set when the security lock state is enabled, functions that can be used are limited, and thus the safety of the mobile terminal is maintained.

  A sixth invention is according to any one of the first to fifth inventions, wherein the setting unit further includes a restriction mode setting part for setting a restriction mode that does not accept a voice operation, and the restriction mode is selected in advance. The limit mode setting unit is set to the specific mode when the count mode is counted a predetermined number of times within a predetermined time in a state where the limit mode is selected in advance. Instead, a restriction mode is set.

  In the sixth invention, the restriction mode setting unit (30, S121, S123) sets a restriction mode (mode 0) that does not accept voice operations. For example, when the user selects the restriction mode instead of the specific mode, the storage unit (46) records the selection result. The limit mode setting unit sets the limit mode when the predetermined number of times is counted within a predetermined time.

  According to the sixth aspect of the invention, the portable terminal can be prevented from being operated by a third party in preparation for dropping the portable terminal.

  A seventh invention is according to any one of the first to sixth inventions, further comprising an utterance unit that outputs voice, and the utterance unit outputs voice guidance when the specific mode is set.

  In the seventh invention, for example, when the specific mode is set, the utterance unit (18, 30) outputs a speech using a database of synthesized speech.

  According to the seventh aspect, the user can easily grasp the state of the mobile terminal by listening to the contents of the voice guidance.

  The eighth invention includes a recognition unit (20, 30) for recognizing an input voice, a speech unit (18, 30) for outputting a voice, an operation unit (30) operated based on the recognized voice, a display ( 14) a control unit (30, 42) for controlling on / off of the display, a touch panel (16) provided on the display, and a detection unit (48) for detecting a touch operation on the touch panel, and the display is turned off The screen lock state that disables part of the touch operation is enabled, the processor (30) of the mobile terminal (10) is turned on / off by the control unit when the screen lock state is enabled. Count unit (S73, S87) that counts the number of times the switch is turned off, and the count unit counts the predetermined number of times within a predetermined time. When, to function as a setting unit for setting a specific mode for accepting an operation by voice (S91), a special mode setting program.

  In the eighth invention as well, similar to the first invention, the mobile terminal can be operated by voice even when no touch operation is detected.

  The ninth invention comprises a recognition unit (20, 30) for recognizing an input voice, an utterance unit (18, 30) for outputting a voice, an operation unit (30) operated based on the recognized voice, a display ( 14) a control unit (30, 42) for controlling on / off of the display, a touch panel (16) provided on the display, and a detection unit (48) for detecting a touch operation on the touch panel, and the display is turned off A mode setting method of the mobile terminal (10) in which a screen lock state that disables part of the touch operation is enabled, and the display is turned on by the control unit when the screen lock state is enabled Counts the number of times the switch has been switched off (S73, S87), and when the predetermined number of times is counted within a predetermined time, the voice operation is performed. To set a specific mode for accepting (S91), a special mode setting process.

  In the ninth aspect, similar to the first aspect, the mobile terminal can be operated by voice even when a touch operation is not detected.

  According to the present invention, the user can operate the portable terminal even when the touch operation is not detected.

  The above object, other objects, features, and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

FIG. 1 is an external view showing a mobile phone according to an embodiment of the present invention. FIG. 2 is an illustrative view showing an electrical configuration of the mobile phone shown in FIG. FIG. 3 is an illustrative view showing an example of a procedure for displaying a screen lock screen on the display shown in FIG. 1, and FIG. 3 (A) shows a state in which the power key shown in FIG. 1 is operated. FIG. 3B shows a state in which an example of the screen lock screen is displayed on the display shown in FIG. 4 is an illustrative view showing an example of a procedure for releasing the screen lock state and the security lock state set in the mobile phone shown in FIG. 1, and FIG. 4A is an example of an operation for releasing the screen lock state. 4B shows an example of a procedure for releasing the security lock state, and FIG. 4C shows a state where an example of the standby screen is displayed on the display shown in FIG. FIG. 5 is an illustrative view showing an example of a state in which a touch operation is not detected on the touch panel shown in FIG. 1, FIG. 5 (A) shows another example of the operation for releasing the screen lock state, and FIG. 6 shows a state where the screen lock state is not released by the operation shown in FIG. 6 is an illustrative view showing an example of a procedure for setting a specific mode in the mobile phone shown in FIG. 1. FIG. 6 (A) shows a state where the power key shown in FIG. 1 is operated. (B) shows a state in which the specific mode is set and an example of the specific mode screen is displayed on the display shown in FIG. FIG. 7 is an illustrative view showing one example of a configuration of a specific mode table recorded in the RAM shown in FIG. FIG. 8 is an illustrative view showing an example of a procedure for releasing the specific mode set in the mobile phone shown in FIG. 1, and FIG. 8A shows a touch operation detected in a state where the specific mode is set. An example of the state is shown, and FIG. 8B shows a state where the specific mode is canceled and an example of the screen lock screen is displayed. FIG. 9 is an illustrative view showing one example of a memory map of the RAM shown in FIG. FIG. 10 is an illustrative view showing one example of a data storage area shown in FIG. FIG. 11 is a flowchart showing an example of setting processing of the processor shown in FIG. FIG. 12 is a flowchart showing an example of the release processing of the processor shown in FIG. FIG. 13 is a flowchart showing an example of the specific mode determination process of the processor shown in FIG. FIG. 14 is a flowchart showing an example of the specific mode setting process of the processor shown in FIG. FIG. 15 is a flowchart showing an example of the specific mode control processing of the processor shown in FIG.

  Referring to FIG. 1, a mobile phone 10 according to one embodiment of the present invention is a smartphone as an example, and includes a vertically long flat rectangular housing 12. However, it should be pointed out in advance that the present invention can be applied to any portable terminal such as a tablet terminal and a PDA.

  A display 14 such as a liquid crystal or an organic EL is provided on the main surface (front surface) of the housing 12. A touch panel 16 is provided on the display 14. Therefore, in the cellular phone 10 of this embodiment, most of the input operations except those by hard key operations described later are performed through the touch panel 16.

  A speaker 18 is built in the surface side of one end in the vertical direction of the housing 12, and a microphone 20 is built in the surface side of the other end in the vertical direction.

  In this embodiment, a call key 22a, an end key 22b, a menu key 22c, and a power key 22d are provided as hard keys that constitute input operation means together with the touch panel 16.

  For example, the user can input a telephone number by touching a dial key (not shown) displayed on the display 14 with the touch panel 16, and can start a voice call by operating the call key 22a. Can do. If the end call key 22b is operated, the voice call can be ended. When the menu key 22c is operated, a menu screen is displayed on the display 14. In this state, a menu can be selected by touching a soft key or a menu icon (both not shown) displayed on the display 14 and the selection can be confirmed. The user can execute a call function, a mail function, an address book function, and the like using the menu screen. Further, the user can turn off the power of the mobile phone 10 by operating the power key 22d while the power is on and touching the displayed GUI. On the other hand, the user can turn on the power of the mobile phone 10 by operating the power key 22d while the power is off. The power key 22d is sometimes called a power key.

  In addition, the mobile phone 10 has a speech recognition function for recognizing speech input to the microphone 20, a speech function for outputting a voice message based on a database of synthesized speech, and a voice operation function using these functions. ing. For example, if the user speaks to the mobile phone 10 saying “Call home” to the mobile phone 10 on which the voice operation function is executed, the voice of the user is recognized by the voice recognition function. Further, based on the recognized voice, the mobile phone 10 outputs a response message “Do you want to make a call to your home?” By using the speech function. At this time, if the user responds “call”, the mobile phone 10 reads the telephone number registered as home from the address book and makes a call to the telephone number. Thus, if the voice operation function is executed, the user can operate the mobile phone 10 without performing a touch operation on the touch panel 16. Then, the user can easily grasp the state of the mobile phone 10 by listening to the content of the voice guidance (response message).

  The microphone 20 and the processor 30 function as a recognition unit, the speaker 18 and the processor 30 function as an utterance unit, and the processor 30 functions as an operation unit.

  Referring to FIG. 2, the mobile phone 10 of the embodiment shown in FIG. 1 includes a processor 30 called a computer or CPU. The processor 30 is connected to a wireless communication circuit 32, an A / D converter 36, a D / A converter 38, an input device 40, a display driver 42, a flash memory 44, a RAM 46, a touch panel control circuit 48, and the like.

  The processor 30 controls the entire mobile phone 10. The RAM 46 functioning as a storage unit stores all or a part of the program preset in the flash memory 44 when used, and the processor 30 operates according to the program on the RAM 46. The RAM 46 is further used as a working area or a buffer area for the processor 30.

  The input device 40 includes the touch panel 16 and the hard keys 22 shown in FIG. 1, and constitutes an operation unit or an input unit. Information on the hard key operated by the user (key data) is input to the processor 30.

  The wireless communication circuit 32 is a circuit for transmitting and receiving radio waves for voice calls and mails through the antenna 34. In the embodiment, the wireless communication circuit 32 is a circuit for performing wireless communication by the CDMA method. For example, when the user operates the input device 40 to instruct a telephone call (calling), the wireless communication circuit 32 executes a telephone call process under the finger of the processor 30 and sends a telephone call signal via the antenna 34. Output. The telephone call signal is transmitted to the other party's telephone through the base station and the communication network. When an incoming call process is performed at the other party's telephone, a communicable state is established, and the processor 30 executes a call process.

  The normal call processing will be described in detail. The modulated audio signal transmitted from the other party's telephone is received by the antenna 34. The received modulated audio signal is demodulated and decoded by the wireless communication circuit 32. The received voice signal obtained by these processes is converted to a voice signal by the D / A converter 38 and then output from the speaker 18. On the other hand, the transmission voice signal captured through the microphone 20 is converted into voice data by the A / D converter 36 and then given to the processor 30. The audio data is subjected to encoding processing and modulation processing by the wireless communication circuit 32 under the instruction of the processor 30, and is output via the antenna 34. Therefore, the modulated voice signal is transmitted to the other party's telephone through the base station and the communication network.

  When a telephone call signal from the other party's telephone is received by the antenna 34, the radio communication circuit 32 notifies the processor 30 of an incoming call (incoming call). In response to this, the processor 30 controls the display driver 42 to display caller information (such as a telephone number) described in the incoming call notification on the display 14. In addition, the processor 30 causes the speaker 18 to output a ring tone (sometimes called a ringing melody or a ringing voice) from the speaker 18.

  When the user performs a response operation using the call key 22 a (FIG. 1) included in the input device 40, the wireless communication circuit 32 executes a call incoming process under the instruction of the processor 30. Further, a communicable state is established, and the processor 30 executes the above-described call processing.

  Further, when a call termination operation is performed by the call termination key 22b (FIG. 1) included in the input device 40 after shifting to a call ready state, the processor 30 controls the wireless communication circuit 32 to terminate the call to the other party. Send a signal. Then, after transmitting the call end signal, the processor 30 ends the call process. The processor 30 also ends the call process when a call end signal is received from the other party first. Furthermore, the processor 30 also ends the call process when a call end signal is received from the mobile communication network regardless of the call partner.

  The microphone 20 shown in FIG. 1 is connected to the A / D converter 36, and the audio signal from the microphone 20 is connected to the digital audio data by the A / D converter 36 and input to the processor 30 as described above. The The speaker 18 is connected to the D / A converter 38. The D / A converter 38 converts digital audio data into an audio signal and supplies the audio signal to the speaker 18 through an amplifier. Therefore, the sound data is output from the speaker 18.

  The processor 30 adjusts the volume of the sound output from the speaker 18 by controlling the amplification factor of the amplifier connected to the D / A converter 38, for example, in response to a volume adjustment operation by the user. be able to.

  The display driver 42 is connected to the display 14 and the processor 30 and stores image data output from the processor 30 in the VRAM. The display driver 42 displays an image such as a GUI corresponding to the VRAM data on the display 14. That is, the display driver 42 controls display on the display 14 connected to the display driver 42 under the instruction of the processor 30. Further, the display 14 is provided with a backlight using, for example, an LED as a light source. The display driver 42 controls on / off of the display 30 and the backlight in accordance with instructions from the processor 30. Therefore, the processor 30 and the display driver 42 may be called a control unit. The display 14 is turned on when the menu key 22c and the power key 22d are operated. The display 14 is turned off when the power key 22d is operated or when a certain time (for example, 30 seconds) elapses without operation.

  The touch panel 16 shown in FIG. 1 is connected to the touch panel control circuit 48. The touch panel control circuit 48 applies necessary voltage to the touch panel 16 and indicates a start signal indicating the start of touch by the user on the touch panel 16, an end signal indicating the end of touch by the user, and a touch position touched by the user. Coordinate data is input to the processor 30. Therefore, the processor 30 can determine which icon or key the user touched at that time based on the coordinate data.

  In the embodiment, the touch panel 16 is a capacitance type that detects a change in capacitance between electrodes caused by an object such as a finger approaching the surface. For example, one or more fingers touch the touch panel 16. Detect that. The touch panel 16 is provided on the display 14 and is a pointing device for instructing an arbitrary position within the screen. The touch panel control circuit 48 functions as a detection unit, detects a touch operation within the touch effective range of the touch panel 16, and outputs coordinate data indicating the position of the touch operation to the processor 30. That is, the user inputs an operation position, an operation direction, and the like to the mobile phone 10 by performing operations such as touch, slide, and release on the surface of the touch panel 16.

  Note that the detection method of the touch panel 16 may employ a surface-type capacitance method, or may employ a resistance film method, an ultrasonic method, an infrared method, an electromagnetic induction method, or the like. The touch operation is not limited to the user's finger, and may be performed with a stylus pen or the like.

  Here, when the mobile phone 10 enters a standby state, a screen lock state that disables part of the touch operation and a security lock state that restricts the use of a specific function are enabled.

  For example, when the power key 22d is pressed while an arbitrary screen is displayed on the display 14, the display 14 is turned off and the mobile phone 10 enters a standby state. When the standby state is set in this way, the screen lock state and the security lock state are validated. In addition, when an arbitrary screen is displayed on the display 14, the display 14 is turned off and the mobile phone 10 enters a standby state even if a certain period of time has passed without any operation.

  3A and 3B, when the power key 22d is operated while the mobile phone 10 is in a standby state, a screen lock screen is displayed on the display 14. The display range of the display 14 includes a status display area 60 and a function display area 62. In the status display area 60, an icon (pict) indicating the radio wave reception status by the antenna 12, an icon indicating the remaining battery capacity of the secondary battery, and the date and time are displayed. In the function display area 62, a screen lock screen including the object Ob is displayed.

  Referring to FIG. 4A, when the user performs a touch operation on object Ob so that the trajectory intersects with object Ob, the display mode of object Ob changes and the screen lock state is released. When the screen lock state is released, a security lock screen shown in FIG. 4B is displayed. In the security lock screen of the present embodiment, the user is requested to input a personal identification number as a release operation. When a pre-registered personal identification number is input, the security lock state is released. Then, when the security lock state is released, a screen before the display 14 is turned off (here, a standby screen shown in FIG. 4C) is displayed on the display 14.

  When the security lock state is not enabled in the standby state, when the screen lock state is released, the security lock screen is not displayed, and the previous screen as shown in FIG. 4C is displayed. .

  Referring to FIGS. 5A and 5B, for example, when the touch panel 16 breaks down and a touch operation is not detected, even if the user performs a touch operation similar to that in FIG. 4A, the object Ob is displayed. The aspect does not change and the screen lock state is not released. If the screen lock state is not released, the user cannot use the main functions of the mobile phone 10.

  Therefore, in this embodiment, the number of times the display 14 is switched on / off is counted. Then, when the counted number reaches a predetermined number of times (for example, 5 times) within a predetermined time (for example, 60 seconds), a specific mode for receiving a voice operation by the voice operation function is set.

  6A and 6B, when the power key 22d is operated in the standby state, a screen lock screen is displayed, and the count of the number of times the display 14 is switched on / off, Time measurement by the timer is started. Then, when the number of times the display 14 is switched on / off within a predetermined time reaches a predetermined number, the specific mode is set. When the specific mode is set, the voice operation function is executed. At substantially the same time, a common voice message “Start voice guidance” and an individual voice message corresponding to a mode to be described later are output from the speaker 18. The user can know that the specific mode has been set by listening to the voice message.

  For example, when there is no reaction due to the touch operation on the touch panel 16, it is conceivable that the screen lock screen is displayed again and again in order to retry the release operation. When the screen lock screen is displayed again, the power key 22d is operated many times. However, in this embodiment, when the above operation is performed, a specific mode in which an operation by voice is accepted is set.

  In this way, even when a touch operation is not detected, the user can operate the mobile phone 10 with voice. In this embodiment, the specific mode is set based on an operation that is likely to be performed by the user in a state where no touch operation is detected.

  In particular, the user sets the specific mode even when the finger is dry and the touch operation is not detected on the touch panel 16, the glove is used, or the touch operation is not detected due to a malfunction of the program. Thus, the mobile phone 10 can be operated.

  Here, in the specific mode, the operation content changes depending on whether the security lock state is set in the mobile phone 10. First, when the security lock state is enabled, the specific mode is set as “mode 1 (first specific mode)”. When the specific mode is set as “mode 1”, an emergency call can be made to the police or fire department, but the use of other functions is limited. For example, in “mode 1”, an individual voice message “Do you want to make an emergency call?” Is output after the common voice message described above. On the other hand, if the user inputs a voice including “Police” or “110”, the mobile phone 10 outputs a voice message “Call to the police station.” Make a call to it. Further, if the user inputs a voice including “fire fight” or “119”, the mobile phone 10 outputs a voice message “calls to the fire department” and then calls the fire department. To do.

  As described above, when the specific mode is set when the security lock state is enabled, it is possible to maintain the safety of the mobile phone 10 by limiting the functions that can be used. Even if the functions that can be used are limited, an emergency call can be made.

  In another embodiment, in the mobile phone 10 in which “mode 1” is set, if a user inputs a specific keyword (password) by voice, a call can be made to a specific contact (for example, home). It may be possible.

  Next, when the security lock state is not enabled, the specific mode is set as “mode 2 (third specific mode)”. When the specific mode is set as “mode 2”, the functions that can be used are not limited, and the user can execute any function. For example, in “mode 2”, an individual voice message “Please specify the function you want to use” is output after the common voice message. Then, if the user speaks a sound including the name of the function to be used, the function can be executed.

  In addition, the user can select “mode 0” in which voice operation is not accepted by the initial setting. “Mode 0” is a mode for preventing the mobile phone 10 from being operated by a third party when the mobile phone 10 is dropped. In this embodiment, the user can select “mode 0A” in which voice operation is not accepted and “mode 0B” in which data in the mobile phone 10 is erased and voice operation is not accepted thereafter. “Mode 0” may also be referred to as a restricted mode.

  For example, when “mode 0A” is selected by the initial setting or the like, an individual voice message “No voice input can be accepted” is output after the common voice message. Then, even if the user inputs a voice, the mobile phone 10 responds with “cannot accept voice input”. That is, when “mode 0A” is set, the user (third party) cannot perform voice operation on the mobile phone 10.

  When “Mode 0B” is selected, an individual voice message “Sound input cannot be accepted. Data will be erased” is output after the common voice message. At this time, the mobile phone 10 initializes the flash memory 44 and the RAM 46 regardless of key operations and voice input.

  When “mode 0” is set, the user can turn off the power of the display 14 or the mobile phone 10 with the power key 22d.

  In this way, the user can prevent the mobile phone 10 from being operated by a third party in preparation for dropping the mobile phone 10.

  FIG. 7 is an illustrative view showing a configuration of a specific mode table. The specific mode table indicates the set specific mode (modes 0, 1, and 2) and records individual voice messages corresponding to each mode. For example, when “mode 0A” is set by the specific mode setting process described later in a state in which the user selects “mode 0A” by default, the flag field corresponding to “mode 0A” is set to “on”. The flag fields corresponding to other modes are set to “off”. After the common voice message is output, the voice corresponding to the individual voice message in the “message content” column corresponding to “mode 0A” is output. When another mode is set by a specific mode setting process described later, the flag field corresponding to that mode is turned on.

  In another embodiment, the user may arbitrarily select “mode 2”, “mode 1”, “mode 0A”, and “mode 0B”.

  Here, the release of the specific mode will be described. First, when the power key 22d is operated in a state where the specific mode is set and the mobile phone 10 enters a standby state, the specific mode is canceled.

  Next, referring to FIGS. 8A and 8B, when the touch operation is detected when the touch panel 16 is not broken and the specific mode is set, the specific mode is canceled and the screen is displayed. A lock screen is displayed on the display 14. In this way, the user can easily release the specific mode.

  The features of the embodiment have been outlined above. Hereinafter, the memory map of the RAM 46 of the mobile phone 10 shown in FIGS. 9 and 10 and the flowcharts by the processor 30 of the mobile phone 10 shown in FIGS. This will be described in detail.

  Referring to FIG. 9, program storage area 302 and data storage area 304 are formed in RAM 46 shown in FIG. As described above, the program storage area 302 is an area for reading and storing part or all of the program data set in advance in the flash memory 44 (FIG. 2).

  The program storage area 302 includes a voice recognition program 310, an utterance program 312, a voice operation program 314, a setting program 316, a cancellation program 318, a specific mode determination program 320, a specific mode setting program 322, a specific mode control program 324, and the like. .

  The voice recognition program 310 is executed when an input voice is recognized. The utterance program 312 is executed when outputting a voice message. The voice operation program 314 is executed when operating the mobile phone 10 based on the recognized voice. The setting program 316 is a program for setting the screen lock state and the security lock state. The release program 318 is a program for releasing the screen lock state and the security lock state. The specific mode determination program 320 is executed when determining whether to set a specific mode. The specific mode setting program 322 is a subroutine of the specific mode determination program 320, and is executed when setting the specific mode. The specific mode control program 324 is executed when controlling the mobile phone 10 in a state where the specific mode is set.

  The program storage area 302 includes a program for executing a telephone function and the like.

  Next, referring to FIG. 10, the data storage area 304 of the RAM 46 is provided with a touch buffer 330, touch coordinate map data 332, voice recognition dictionary data 334, speech voice data 336, GUI data 338, GUI coordinates. Data 340, specific mode table data 342, and the like are stored. The data storage area 304 is provided with a touch flag 344, a screen lock flag 346, a security lock flag 348, a no-operation counter 350, a predetermined time measurement counter 352, and the like.

  The touch buffer 330 stores touch coordinate data output from the touch panel control circuit 48. The touch coordinate map data 332 is data for associating the touch coordinates in the touch operation with the display coordinates on the display 14. That is, the result of the touch operation performed on the touch panel 16 is reflected on the display 14 based on the touch coordinate map data 332.

  The voice recognition dictionary data 334 is data in which voice feature values and character strings are associated with each other. In the voice recognition process, a character string is read from the voice recognition dictionary data 334 based on the input voice feature amount. The speech voice data 336 is voice message data output from the mobile phone 10.

  The GUI data 338 includes image data and character string data for displaying a GUI such as a key. The GUI coordinate data 340 includes display coordinate data of the displayed GUI. The specific mode table data 342 is data having a configuration shown in FIG. 7, for example.

  The touch flag 344 is a flag for determining whether or not the touch panel 16 is touched. For example, the touch flag 344 is composed of a 1-bit register. When the touch flag 344 is turned on (established), a data value “1” is set in the register. On the other hand, when the touch flag 344 is turned off (not established), a data value “0” is set in the register. Touch flag 344 is switched on / off based on a signal output from touch panel control circuit 48.

  The screen lock flag 346 is a flag for determining whether the screen lock state is set. The security lock flag 348 is a flag for determining whether the security lock state is set. Note that the configuration of these flags is substantially the same as that of the touch flag 344, and thus a detailed description of the configuration is omitted.

  The non-operation counter 350 is a counter for measuring the time when the mobile phone 10 is not operated (no operation state). For example, when a touch operation or key operation is performed on the mobile phone 10, the no-operation counter 350 is initialized (reset) and starts measuring time. Then, the no-operation counter 350 expires when a certain time (for example, 30 seconds) elapses. Therefore, the no-operation counter 350 may be called an no-operation timer.

  The predetermined time measurement counter 352 is a counter for measuring a predetermined time (for example, 60 seconds). For example, when the display 14 is turned on by operating the power key 22d, the predetermined time measurement counter 352 is initialized and starts measuring time. Then, the predetermined time measurement counter 352 expires when the predetermined time elapses. Therefore, the predetermined time measurement counter 352 may be called a predetermined time measurement timer.

  The data storage area 304 stores image data displayed in a standby state, character string data, and the like, and is provided with a counter, a flag, and the like necessary for the operation of the mobile phone 10.

  The processor 30 performs the setting process shown in FIG. 11, the release process shown in FIG. 12, and the specific process shown in FIG. 13 under the control of a Linux (registered trademark) -based OS such as Android (registered trademark) and REX, and other OSs. A plurality of tasks including a mode determination process, a specific mode setting process shown in FIG. 14 and a specific mode control process shown in FIG. 15 are processed in parallel.

  Referring to FIG. 11, the setting process is started when, for example, a standby screen is displayed on display 14. In step S1, the processor 30 determines whether or not the power key 22d has been operated. If “NO” in the step S1, that is, if the power key 22d is not operated, the processor 30 determines whether or not a predetermined time has passed without any operation in a step S3. That is, the processor 30 determines whether the no-operation timer has expired. If “NO” in the step S3, that is, if the predetermined time has not passed without any operation, the processor 30 returns to the step S1.

  On the other hand, if “YES” in the step S1 or the step S3, that is, if the power key 22d is operated or a certain time elapses without being operated, the processor 30 turns off the display 14 in a step S5. That is, after the currently displayed screen data is stored in the buffer, the display 14, the backlight, and the touch panel 16 are turned off.

  Subsequently, in step S7, the processor 30 sets the screen lock state and ends the setting process. That is, the screen lock flag 346 is turned on. Subsequently, in step S9, the processor 30 determines whether or not the security lock function is enabled. That is, the processor 30 determines whether the security lock state is set to be valid when the display 14 is turned off. If “NO” in the step S9, that is, if the security lock function is not enabled, the processor 30 ends the setting process.

  On the other hand, if “YES” in the step S9, that is, if the security function is enabled, the processor 30 turns on the security lock flag 348 in a step S11 and ends the setting process. That is, the security lock state is set. The processor 30 that executes the process of step S11 functions as a security lock state unit.

  Referring to FIG. 12, the release process is started when, for example, power key 22d is operated while display 14 is turned off. In step S31, the processor 30 displays a screen lock screen. That is, the processor 30 reads the GUI data 336 and displays the screen lock screen shown in FIG. Subsequently, in step S33, the processor 30 determines whether or not the release operation is performed. For example, the processor 30 determines whether or not a release operation is performed such that the trajectory of the touch operation intersects the object Ob. If “YES” in the step S33, that is, if a releasing operation is performed, the processor 30 releases the screen lock state in a step S35. That is, the screen lock flag 346 is turned off.

  Subsequently, in step S37, the processor 30 determines whether or not the security lock flag 348 is on. That is, it is determined that the security lock state is set. If “NO” in the step S37, that is, if the security lock state is not set, the processor 30 proceeds to the step S45. On the other hand, if “YES” in the step S37, that is, if the security lock state is set, the processor 30 displays a security lock screen in a step S39. For example, the security lock screen shown in FIG.

  Subsequently, in step S41, the processor 30 determines whether or not the release operation is performed. For example, the processor 30 determines whether or not the input personal identification number matches the registered personal identification number. If “NO” in the step S41, for example, if a correct password is not inputted, the processor 30 repeats the process of the step S41.

  On the other hand, if “YES” in the step S41, for example, if the input password matches the registered password, the processor 30 turns off the security lock flag 348 in a step S43. That is, the security lock state is released.

  Subsequently, in step S45, the processor 30 displays the previous screen and ends the release process. For example, when the standby screen data is recorded in the buffer of the RAM 46, the standby screen is displayed on the display 14 in step S45.

  On the other hand, if “NO” in the step S33, that is, if the release operation of the screen lock state is not performed, the processor 30 determines whether or not the power key 22d is operated in a step S47. If “NO” in the step S47, that is, if the power key 22d is not operated, the processor 30 determines whether or not a predetermined time has passed without any operation in a step S49. If “NO” in the step S49, that is, if a predetermined time has not passed without any operation, the processor 30 returns to the step S33.

  If “YES” in the step S47 or the step S49, that is, if the power key 22d is operated or a certain time elapses with no operation, the processor 30 turns off the display 14 in a step S51 as in the step S5. . And the processor 30 will complete | finish a cancellation | release process, if the process of step S51 is complete | finished.

  Referring to FIG. 13, the specific mode determination process is started when, for example, power key 22d is operated and display 14 is turned on. In step S71, the processor 30 initializes the variable D. The variable D is a variable for counting the number of times the display 14 is switched on / off. When initialized in step S71, the variable D is set to “0”. Subsequently, in step S73, the processor 30 increments the variable D. That is, since the display 14 is turned on, the value of the variable D becomes “1” by increment. Subsequently, in step S75, the processor 30 initializes a predetermined time measurement timer. That is, a predetermined time measurement timer is initialized in order to measure the time after the display 14 is turned on.

  Subsequently, in step S77, the processor 30 determines whether or not it is a touch operation. That is, the processor 30 determines whether the touch flag 344 is turned on as a result of the touch operation performed on the touch panel 16. If “YES” in the step S77, that is, if a touch operation is detected, the processor 30 proceeds to a step S85.

  If “NO” in the step S77, that is, if the touch operation is not detected, the processor 30 determines whether or not the power key 22d is operated in a step S79. If “NO” in the step S79, that is, if the power key 22d is not operated, the processor 30 determines whether or not the no-operation timer has expired in a step S81. That is, it is determined whether a certain time has passed without any operation on the mobile phone 10. Note that when the display 14 is off, the no-operation timer is not operating, and therefore, “NO” is always determined in step S81.

  If “NO” in the step S81, that is, if a predetermined time has not elapsed in a non-operation state, the processor 30 determines whether or not a predetermined time measurement timer has expired in a step S83. That is, the specific mode determination process is executed, and it is determined whether a predetermined time has elapsed since the display 14 was turned on. If “NO” in the step S83, that is, if the predetermined time has not elapsed since the display 14 is turned on, the processor 30 returns to the step S77.

  If “YES” in the step S83, that is, if a predetermined time elapses before the number of times the display 14 is switched on / off reaches the predetermined number, the processor 30 proceeds to a step S85.

  The processor 30 initializes the variable D in step S84, and ends the specific mode determination process. That is, before the predetermined time elapses, the display 14 has not been turned on / off a predetermined number of times, or a touch operation has been detected, so the value counted by the variable D is initialized.

  If “YES” in the step S79 or the step S81, that is, if the power key 22d is operated or a certain time elapses without being operated, the processor 30 increments the variable D in a step S87. For example, when the no-operation timer expires, the display 14 is turned off and the variable D is incremented. On the other hand, when the power key 22d is operated, the display 14 is switched from on to off or from off to on, and the variable D is incremented.

  Subsequently, in step S89, it is determined whether the variable D is equal to or greater than a threshold value. That is, the threshold value is set so as to correspond to a predetermined number of times (for example, 5 times), and it is determined whether the number of times counted by the variable D is equal to or more than the predetermined number. If “NO” in the step S89, that is, if the number of times counted by the variable D is less than the predetermined number, the processor 30 returns to the step S77.

  On the other hand, if “YES” in the step S89, the value of the variable D is “5”, for example, and the processor 30 executes the specific mode setting process in a step S91 if the value is equal to or greater than a threshold value (eg, “5”). Then, the specific mode determination process ends.

  Note that the processor 30 that executes the processes of steps S73 and S87 functions as a counting unit. The processor 30 that executes the process of step S91 functions as a setting unit.

  In addition, the specific mode determination process may be executed when the display 14 is turned on by an incoming call, incoming mail, or the like. In addition, the display 14 may be turned on even if an operation is performed on a key other than the power key 22d (for example, the menu key 22c).

  Even if the display 14 is turned on while the specific mode determination process is being executed, the specific mode determination process is not executed again.

  FIG. 14 is a flowchart of the specific mode setting process. As described above, when the process of step S91 is executed, the processor 30 determines in step S111 whether or not an initial setting has been made. That is, it is determined whether or not “mode 0” that does not accept voice operation is selected. Specifically, it is determined whether a flag indicating whether the initial setting has been performed is ON. If “NO” in the step S111, that is, if the initial setting of the specific mode is not performed, the processor 30 determines whether or not the security lock state is valid in a step S113. That is, it is determined whether the security lock flag 348 is on. If “NO” in the step S113, that is, if the security lock state is not enabled, the processor 30 sets “mode 2” in a step S115 and ends the specific mode setting process. That is, the processor 30 reads the specific mode table data 342, turns on the flag column corresponding to “mode 2”, and turns off the flag column corresponding to the other modes.

  If “YES” in the step S113, that is, if the security lock state is valid, the processor 30 sets “mode 1” in a step S117, and ends the specific mode setting process. That is, in the specific mode table data 342, the processor 30 turns on the “mode 1” flag column and turns off the flag column of the other mode. Note that the processor 30 that executes the process of step S117 functions as a first specific mode setting unit.

  On the other hand, if “YES” in the step S111, that is, if the specific mode is initially set, the processor 30 determines whether or not the data is erased in a step S119. That is, it is determined whether “mode 0B” for erasing data is selected. Specifically, it is determined whether or not a flag indicating that “mode 0B” has been selected is ON.

  If “NO” in the step S119, that is, if “mode 0A” that does not delete data is selected, the processor 30 sets “mode 0A” in a step S121, and ends the specific mode setting process. That is, in the specific mode table data 342, the “mode 0A” flag column is turned on, and the other mode flag columns are turned off. If “YES” in the step S119, that is, if “mode 0B” for deleting data is selected, the processor 30 sets “mode 0B” in a step S123. That is, in the specific mode table data 342, the flag field corresponding to “mode 0B” is turned on, and the flag fields corresponding to other modes are turned off.

  Note that the processor 30 returns to the specific mode determination process when the specific mode setting process ends. Further, the processor 30 that executes the processes of steps S121 and S123 functions as a restriction mode setting unit.

  Referring to FIG. 15, the specific mode control process is started when the specific mode is set. In step S141, the processor 30 displays a specific mode screen. That is, the processor 30 issues a command for causing the display 30 to display the specific mode screen shown in FIG. Subsequently, in step S143, the processor 30 reads the specific mode table data 342. Subsequently, in step S145, the processor 30 outputs a voice message. That is, in the process of step S145, first, a common voice message is output based on the utterance voice data 336. Next, the individual voice message in which the flag column is turned on in the specific mode table data 342 is read, and the voice corresponding to the read individual voice message is output from the speaker 18.

  Subsequently, in step S147, the processor 30 executes processing corresponding to the set mode. For example, when the specific mode is set as “mode 2”, the voice operation function is executed, and the process is executed based on the input voice. When the specific mode is set as “mode 1”, the voice operation function is executed, and an emergency call is made based on the user's response. When the specific mode is set as “mode 0A”, after the voice operation function is executed, if there is a voice input by the user, a response message is output. When the specific mode is set as “mode 0B”, the data is deleted after executing the voice operation function.

  Subsequently, in step S149, the processor 30 determines whether or not the power key 22d has been operated. That is, it is determined whether an operation for canceling the specific mode has been performed. If “YES” in the step S149, that is, if the power key 22d is operated, the processor 30 proceeds to a step S155. On the other hand, if “NO” in the step S149, that is, if the power key 22d is not operated, the processor 30 determines in a step S151 whether or not a predetermined time has passed without any operation. If “YES” in the step S151, that is, if a predetermined time elapses without operation, the processor 30 proceeds to a step S155.

  On the other hand, if “NO” in the step S151, that is, if a predetermined time has not passed without any operation, the processor 30 determines whether or not the touch operation is performed in a step S153. That is, it is determined whether the touch operation has been detected because the touch panel 16 has not failed. If “NO” in the step S153, that is, if the touch operation is not detected, the processor 30 returns to the step S147. On the other hand, if “YES” in the step S153, that is, if a touch operation is detected, the processor 30 proceeds to a step S155. The processor 30 that executes the process of step S153 functions as a determination unit.

  In step S155, the processor 30 initializes the specific mode table data 342. Then, when the process of step S155 ends, the processor 30 ends the specific mode control process. That is, in the process of step S155, the specific mode is canceled. Specifically, all the flag columns in the specific mode table are set to “off”. Then, the function (such as a voice operation function) being executed in the specific mode is terminated. Further, the processor 30 that executes the process of step S155 functions as a release unit.

  Note that, when the specific mode is set, it may be confirmed whether or not the display of the display 14 can be visually recognized by the user. For example, the message “If the display is displayed normally, please input the voice while pressing the menu key.” Is displayed. When it is confirmed that the display 14 is displayed normally, the voice operation may be assisted by displaying soft keys corresponding to the call key 22a, the call end key 22b, and the menu key 22c. That is, if the display on the display 14 can be visually recognized, the voice operation function and the hard key are used together if the display on the display 14 can be visually recognized when the specific mode is set. However, in another embodiment, when the specific mode is set, the display operation on the display 14 and the hard key 22 may be performed without using the voice operation function. In another embodiment, when the specific mode is set, the operation may be performed using only the hard key 22.

  In another embodiment, when the specific mode is set, a mail may be transmitted to the mail address of the user's home. In addition, when the mobile phone 10 has a GPS circuit, the position information in which the specific mode is set may be attached to the previous mail. Thereby, when the mobile phone 10 is dropped, the user can recognize that the specific mode is set by a third party.

  In the present embodiment, the voice operation function uses the voice recognition function and the speech function of the mobile phone 10, but in other embodiments, the voice recognition function and the speech function of the server may be used. . For example, when the voice operation function uses the voice recognition function and the speech function of the server, when the input voice is sent to the server, the voice is recognized on the server side, and the recognition result is returned from the server. Then, the voice operation function requests an utterance message from the server or determines the next action based on the returned Nishiki result.

  In another embodiment, a circuit for speech recognition may be connected to the processor 30 for the speech recognition function.

  The program used in this embodiment may be stored in the HDD of the data distribution server and distributed to the mobile phone 10 via the network. Further, the storage medium may be sold or distributed in a state where a plurality of programs are stored in a storage medium such as an optical disk such as a CD, a DVD, or a BD (Blue-Ray Disk), a USB memory, and a memory card. When the program downloaded through the above-described server or storage medium is installed in a portable terminal having the same configuration as that of this embodiment, the same effect as that of this embodiment can be obtained.

  The specific numerical values given in this specification are merely examples, and can be appropriately changed according to a change in product specifications.

DESCRIPTION OF SYMBOLS 10 ... Mobile phone 14 ... Display 16 ... Touch panel 30 ... Processor 40 ... Input device 44 ... Flash memory 46 ... RAM
48 ... Touch panel control circuit

Claims (9)

Recognition unit for recognizing input voice, operation unit for operating based on recognized voice, display, control unit for controlling on / off of display, touch panel provided on display, and touch operation on touch panel detected A mobile terminal, wherein a screen lock state that disables part of the touch operation is enabled when the display is turned off.
When the screen lock state is enabled, a count unit that counts the number of times the display is turned on / off by the control unit, and when the count unit counts a predetermined number of times within a predetermined time, A portable terminal comprising a setting unit for setting a specific mode for accepting an operation by voice. A key for switching on / off the display;
The portable terminal according to claim 1, wherein the count unit counts the number of operations on the key.   The mobile terminal according to claim 1, further comprising a release unit that cancels the specific mode when the display is turned off in a state where the specific mode is set. A determination unit that determines whether a touch operation has been performed in a state where the specific mode is set;
The portable terminal according to claim 3, wherein when the determination unit determines that a touch operation has been performed, the cancellation unit cancels the specific mode. A security state part that enables a security lock state that restricts the use of a specific function;
When the display is turned off, the security lock state is further enabled,
The setting unit, when said security lock state is enabled, including the first specific mode setting unit for setting a first specific mode in which a part of the operation by the sound is restricted, of claims 1 to 4 The portable terminal in any one. The setting unit further includes a restriction mode setting part that sets a restriction mode that does not accept voice operations.
When the restriction mode is selected in advance, it further comprises a storage unit for storing the selection result,
The restriction mode setting unit sets the restriction mode instead of the specific mode when the restriction mode is pre-selected and when the predetermined number of times is counted by the counting unit within the predetermined time. The mobile terminal according to any one of 1 to 5. It further includes an utterance unit that outputs voice,
The mobile terminal according to claim 1, wherein the speech unit outputs voice guidance when the specific mode is set. Recognition unit for recognizing input voice, operation unit for operating based on recognized voice, display, control unit for controlling on / off of display, touch panel provided on display, and touch operation on touch panel detected A processor of the mobile terminal, wherein a screen lock state that disables part of the touch operation is enabled when the display is turned off.
When the screen lock state is enabled, a count unit that counts the number of times the display is turned on / off by the control unit, and when the count unit counts a predetermined number of times within a predetermined time, A specific mode setting program that functions as a setting unit that sets a specific mode for accepting voice operations. Recognition unit for recognizing input voice, operation unit for operating based on recognized voice, display, control unit for controlling on / off of display, touch panel provided on display, and touch operation on touch panel detected A mode setting method for a mobile terminal, wherein when the display is turned off, a screen lock state that disables part of the touch operation is enabled,
When the screen lock state is enabled, the control unit counts the number of times the display is turned on / off, and accepts a voice operation when the predetermined number of times is counted within a predetermined time. A specific mode setting method that sets a specific mode.

Images