JP6503957B2 - Electronic device and display control program - Google Patents

Description

  The present invention relates to an electronic device and a display control program.

  In order to prevent unauthorized use and erroneous operations, electronic devices such as portable information terminals shift to a lock state in which only predetermined operations are accepted when the user's operation is not performed for a certain period of time or longer. There is technology.

  Also, as a technology for releasing the lock state, for example, the type of operation performed by the user on the touch panel of the portable device is determined, and the lock state is released when the type of operation matches the preset authentication information. There is technology. In general, when the lock state is released, application software that was being executed prior to transition to the lock state can continue to be executed.

International Publication No. 2011/034422

  When transitioning to the locked state, the screen of the display unit of the electronic device often switches to a screen different from the screen displayed before the transition. For example, the screen changes to an off (off) state, changes to a lock screen indicating a locked state, or a screen saver is displayed.

  As described above, when the screen has been switched, the screen of the application software being executed before shifting to the locked state is redisplayed on the display unit after the locked state is released.

  However, in the portable electronic device, for example, the user may move while the electronic device is in the locked state. When the user moves or the like, the environment around the electronic device when the locked state is released along with the movement is redisplayed on the display unit of the screen of the application software from the viewpoint of information leakage etc. It may be changing.

  In addition, when the application software is activated, for example, in response to reception of information from the outside during the locked state, a screen which the user does not expect is displayed on the display unit when the locked state is released. There is also the possibility of

  The technique of this indication aims at preventing that a screen which a user does not mean is displayed on a display as one side.

  One aspect includes a display unit, a detection unit, and a control unit. The detection unit detects a lighting instruction of the display unit when the display unit is turned off. The control unit determines the presence or absence of an incidental operation other than the lighting instruction when the detection unit detects the lighting instruction. In addition, the control unit transitions to the lighting state of the display unit or transitions to the lighting state of the display unit, whichever of the application screen and the screen other than the application screen displayed on the display unit when transitioning to the off state. When transitioning from the lock release screen to be displayed after that, whether to display on the display unit is determined according to the result of the determination.

  As one aspect, it is possible to prevent a screen not intended by the user from being displayed on the display unit.

It is an outline view of an example of a personal digital assistant device concerning a 1st embodiment. It is a block diagram showing an example of the schematic structure concerning the function about the display control processing in the personal digital assistant device concerning a 1st embodiment. It is a figure showing the example of a home screen. It is a figure showing the example of a lock screen. It is a figure explaining the example of a peep filter. It is a figure showing the example of an application screen. It is a figure for demonstrating management of the application in the application management part of the portable information terminal device which concerns on 1st Embodiment, and control of the display screen in a screen control part. It is a block diagram which shows schematic structure of the hardware which implement | achieves the portable information terminal device which concerns on 1st Embodiment. It is a flow chart of an example of the 1st processing of display control processing performed with a personal digital assistant device concerning a 1st embodiment. It is a figure showing the specific example when the screen of the display of a portable information terminal device is in an OFF state. It is a flow chart of an example of the 2nd processing of display control processing performed with a personal digital assistant device concerning a 1st embodiment. It is a figure explaining change of a priority in the case of displaying an application screen or an application screen, and a peeping prevention filter after unlocking. It is a figure explaining change of a priority in the case of displaying an application screen or an application screen, and a peeping prevention filter after unlocking. It is a figure for demonstrating the user operation to which a capture image is displayed during display of a lock screen. It is a figure explaining the example of a display of a lock | rock screen and a capture image. It is a block diagram showing an example of a schematic structure concerning a function about display control processing in a personal digital assistant device concerning a 2nd embodiment. It is a block diagram which shows schematic structure of the hardware which implement | achieves the portable information terminal device which concerns on 2nd Embodiment. It is a flow chart of an example of the 1st processing of display control processing performed with a personal digital assistant device concerning a 2nd embodiment. It is a flow chart of an example of the 2nd processing of display control processing performed with a personal digital assistant device of a 2nd embodiment. It is a flowchart of 2nd processing about the case where the screen displayed on a display is switched after cancellation | release of a locked state by the presence or absence of the touch (contact) to an icon. It is a figure explaining the case where a screen displayed after cancellation is determined according to how to hold a portable information terminal device (inclination) at the time of cancellation of a lock state.

  Hereinafter, an example of the disclosed technology will be described in detail with reference to the drawings.

First Embodiment
In the present embodiment, as an example of the disclosed technology, when the electronic device is a portable information terminal device, more specifically, an aspect of being a smart phone will be described. In the present embodiment, application software may be referred to as an “application” in order to simplify the description.

  FIG. 1 shows an external view of an example of a portable information terminal device 10 of the present embodiment. FIG. 1A is a side view of the housing 11 viewed in the X direction shown in FIG. Moreover, FIG. 1 (2) is a top view of surface side (surface provided with the display 20). Further, FIG. 1 (3) is a plan view of the back side.

  As shown in FIG. 1 (2), a home button 16, an in-camera 18, and a display 20 are provided on the surface of the case 11 of the portable information terminal device 10. The display 20 according to the present embodiment is a so-called touch panel display having a function as a display unit (display unit 20A, see FIG. 8) and a function as a touch panel (touch panel 20B, see FIG. 8). The home button 16 is a button for activating a home application (details will be described later) when it is operated (pressed) by the user. The in-camera 18 has a function of photographing an object located on the front surface side of the portable information terminal device 10, and is mainly used to photograph (so-called self photographing) a user of the portable information terminal device 10.

  Further, as shown in FIG. 1A, the side surface of the case 11 of the portable information terminal device 10 is provided with a volume button 12 for raising the volume, a volume button 13 for decreasing the volume, and a power button 14.

  In addition, as shown in FIG. 1 (3), an out camera 22 and a fingerprint authentication button 24 are provided on the back of the case 11 of the portable information terminal device 10. The out camera 22 has a function of photographing an object located on the back side of the portable information terminal device 10. The fingerprint authentication button 24 has a function for performing fingerprint authentication of the user when processing requiring fingerprint authentication of the user is performed.

  FIG. 2 is a block diagram showing an example of a schematic configuration relating to the function related to display control processing in the portable information terminal device 10 of the present embodiment. The portable information terminal device 10 of the present embodiment includes a terminal state management unit 30, a touch sensor control unit 32, a hard key control unit 34, an application management unit 36, various applications 38, a screen control unit 40, and a timer 42.

  The terminal state management unit 30 has a function of managing the entire portable information terminal device 10. The terminal state management unit 30 also outputs the information received from the touch sensor control unit 32, the hard key control unit 34, and the application management unit 36 to the screen control unit 40. The terminal state management unit 30 and the screen control unit 40 are an example of a control unit of the disclosed technology. The terminal state management unit 30, the touch sensor control unit 32, and the hard key control unit 34 are an example of a detection unit of the disclosed technology.

  The touch sensor control unit 32 has a function of controlling the display 20 as a touch panel. Specifically, the touch sensor control unit 32 of the present embodiment has a function of recognizing a user operation on the display 20 and outputting the information.

  The hard key control unit 34 recognizes a user operation on a hard key group (hard key group 60) such as the volume button 12, the volume button 13, the power button 14, the home button 16, and the fingerprint authentication button 24 and outputs the information. Have a function to

  The application management unit 36 has a function of managing the priority, execution (state), and the like of the various applications 38. The portable information terminal device 10 of the present embodiment includes, as various applications 38, a home application 38A, a lock application 38B, a peep prevention application 38C, and another application 38D.

  The home application 38A is an application that realizes a function of displaying a home screen (standby screen) on the display 20 and also realizes a function of customizing the home screen. FIG. 3 is a diagram showing a specific example of the home screen of the present embodiment. In the portable information terminal device 10 of the present embodiment, when the home button 16 is operated (pressed) by the user, the home application 38A is activated, and the home screen 100 is displayed on the display 20.

  The lock application 38B is an application that implements a screen lock function (including a security lock function) that accepts only a predetermined operation. Specific examples of the predetermined operation include an operation for performing an emergency notification and an operation for releasing the lock state. In the locked state, the display 20 displays a lock screen. FIG. 4 is a view showing a specific example of the lock screen of the present embodiment. As shown in FIG. 4, the lock screen 102 according to the present embodiment indicates the locked state, and an icon 110 (described in detail later) of the application is displayed on the lock screen 102.

  The peep prevention application 38C is an application for realizing a function of preventing a peep on the display 20 by a third party other than the user. Specifically, the peeping prevention application 38C displays a peeping prevention filter on the screen. FIG. 5 is a view for explaining a specific example of the peeping filter of the present embodiment. As shown in FIG. 5, the peeping prevention filter 106 is a semitransparent filter, and by displaying it on the display layer in front of the display screen, the screen of the lower layer from an oblique angle to the screen (for example, the application screen 104 ) Can be hard to see. By displaying the peeping prevention filter 106, it is difficult for the screen to be viewed from an oblique angle with respect to the display 20, so that the contents of the screen displayed on the display 20 can be viewed from a third party different from the user. Can be prevented.

  The peep prevention application 38C according to the present embodiment also has a function of adjusting the difficulty of seeing (ease of view) by setting the pattern of the peep prevention filter 106 or changing the transparency of the filter. .

  In the present embodiment, the control for displaying the peeping prevention filter 106 on the screen of the display 20 realizes the function for preventing peeping, but the method for realizing the function for preventing peeping is limited to this. Absent. The function to prevent peeping may be realized, for example, by adjusting the brightness (brightness) of the display 20, or when the display 20 is a liquid crystal, controls the emission direction of the light transmitted through the liquid crystal and emitted. It may be realized by doing. Further, the function of preventing a peep may be realized by combining the above-mentioned respective controls.

  The other application 38D is an application other than the home application 38A, the lock application 38B, and the peeping prevention application 38C installed in advance in the mobile information terminal device 10 or installed (downloaded) by the user. While the other application 38D is being executed, an application screen 104 corresponding to the execution of the other application 38D is displayed on the display 20. In FIG. 6, an example of the application screen 104 of this embodiment is shown.

  The screen control unit 40 has a function of controlling a screen (including a layer) displayed on the display 20. Here, management of the application in the application management unit 36 of the present embodiment and control of the display screen in the screen control unit 40 will be described. FIG. 7 is a diagram for explaining management of the application in the application management unit 36 and control of the display screen in the screen control unit 40.

  The screen displayed on the display 20 of the portable information terminal device 10 changes in accordance with the state of the application. In the present embodiment, a plurality of (three as a specific example) states exist as the states of the application, and by performing the state change, display and non-display of the screen are realized.

  In the present embodiment, there are two states of running application and running, and stopped. Among the active applications, the state of the so-called foreground application whose screen (application screen 104) corresponding to the execution is displayed on the front of the display 20 is referred to as executing.

  In addition, among the active applications, the state of the application in a non-display (background) state on the display 20 is referred to as being suspended. In the present embodiment, the stopped state includes the case of being executed in the background.

  On the other hand, the state of an application that has not been started is called "end".

  Although FIG. 7 illustrates the case where one application is being executed, there may be a plurality of applications being executed. In this case, a plurality of screens corresponding to the plurality of applications being executed are displayed on the display 20. In addition, the screen may differ depending on the application being executed.

  When the peeping prevention application 38C is activated, the peeping prevention filter 106 is displayed on the foremost layer.

  An application being activated has a priority, and as an example, the execution time (as a specific example, the time when the execution is started) becomes higher in the order of newness.

  For example, when an application is newly activated, the application management unit 36 sets the priority of the newly activated application as the first. Then, the application management unit 36 lowers the priority of the application which has displayed the screen on the display 20 so far, and moves it to the top of the stopped applications (highest among the stopped applications). . The screen control unit 40 causes the display 20 to display the application screen 104 of the application with the first priority (the newly activated application). Further, the screen control unit 40 hides the application screen 104 of the application because the application whose priority is lowered is in the stop state (background).

  On the other hand, when the foreground (in execution) application ends, the application management unit 36 sets the priority of the application at the top of the stopped application group (background application group) to first. Further, the screen control unit 40 displays the application screen 104 of the application on the display 20.

  The lock application 38B is being executed (foreground) when the screen changes to the on (lighting) state after the screen 20 is turned off (turned off), and the lock application 38B is ended after releasing the locked state.

  Further, since the home application 38A is initially activated when the portable information terminal device 10 is powered on, the home application 38A is basically located at the lowest priority position of the background application group. However, when the home button 16 is operated (depressed) by the user, the home application 38A is raised in priority at once, and becomes the foreground (during execution).

  In the present embodiment, the background (during stop) application is activated until the user explicitly terminates it or the memory (see memory 54 in FIG. 8) is exhausted and is forcibly terminated by the operating system. to continue.

  The timer 42 may be a so-called software timer or a hardware timer.

  The portable information terminal device 10 of the present embodiment can be realized, for example, by the hardware shown in FIG.

  The portable information terminal device 10 includes a display unit 20A, a touch panel 20B, a CPU (Central Processing Unit) 52, a memory 54, a non-volatile storage unit 56, a wireless I / F (Interface) 58, and a hard key group 60.

  The display 20A, the display 20B, the memory 54, the storage unit 56, the wireless I / F 58, and the hard key group 60 are connected to the CPU 52 via a bus, an I / F or the like (not shown).

  The storage unit 56 can be realized by a hard disk drive (HDD), a flash memory, or the like. A display control program 66 is stored in the storage unit 56 as a storage medium. The CPU 52 reads the display control program 66 from the storage unit 56 and develops it in the memory 54, and executes the process possessed by the display control program 66.

  The display control program 66 has a terminal state management process 68, a touch sensor control process 70, a hard key control process 72, an application management process 74, and a peep prevention application storage area 86.

  The CPU 52 operates as the terminal state management unit 30 by executing the terminal state management process 68. Further, the CPU 52 operates as the touch sensor control unit 32 by executing the touch sensor control process 70. Further, the CPU 52 operates as the hard key control unit 34 by executing the hard key control process 72. In addition, the CPU 52 operates as the application management unit 36 by executing the application management process 74. Further, the CPU 52 operates as the screen control unit 40 by executing the screen control process 76.

  The home application storage area 82 of the various application storage area 80 in the storage unit 56 functions as a storage area in which the home application 38A is stored. The lock application storage area 84 of the various application storage area 80 in the storage unit 56 functions as a storage area in which the lock application 38B is stored. The peeping prevention application storage area 86 of the various application storage areas 80 in the storage unit 56 functions as a storage area in which the peeping prevention application 38C is stored. Further, the other application storage area 88 of the various application storage area 80 in the storage unit 56 functions as a storage area in which the other application 38D is stored.

  Next, the operation of the portable information terminal device 10 according to the present embodiment will be described.

  The display control process executed by the portable information terminal device 10 of the present embodiment includes two processes of a first process and a second process.

  In the portable information terminal device 10 of the present embodiment, when the user operation is not performed within a predetermined time, the state is shifted to the sleep state, and the screen of the display 20 is turned off (turned off). The display control process executed when the screen shifts to the off (off) state as described above is the first process.

  In the sleep state, when the activation request is detected according to the user operation, the sleep state is returned to the normal state, and the screen of the display 20 is turned on (lit) and is in the lock state. As described above, the second process is a display control process that is executed when the locked state is released after the screen is turned on (lit) and in the locked state when returning from the sleep state.

  Further, in the mobile information terminal device 10 of the present embodiment, when releasing the locked state, the screen displayed on the display 20 is switched according to the user's operation. As a specific example, in the present embodiment, after releasing the lock state in response to the user operation instructing switching of the screen, which is performed concomitantly with the operation requesting release of the lock state (hereinafter referred to as “release operation”). The screen displayed on the display 20 is switched. In the present embodiment, “attachment to release operation” may be a period during which the lock screen 102 is displayed on the display 20, and in addition to the case where it is simultaneous with the release operation, It also includes the case of being within a predetermined time.

  Further, in the following, as a specific example of the user operation instructing switching of the screen, the case of operating the volume button 12 or the volume button 13 will be described. When neither the volume button 12 nor the volume button 13 is operated, the application screen 104 (see FIG. 6) is displayed after the release of the lock state. On the other hand, when the volume button 12 is operated, the home screen 100 (see FIG. 3) is switched to be displayed after the lock state is released. When the volume button 13 is operated, the application screen 104 and the peeping prevention filter 106 (see FIG. 5 (2)) are switched to be displayed after the lock state is released.

  First, the first process of the display control process will be described. FIG. 9 shows a flowchart of an example of a first process of the display control process executed by the portable information terminal device 10.

  The first process shown in FIG. 9 is performed in the normal state (the state which is not the sleep state).

  In step S100, the terminal state management unit 30 determines whether a user operation has been performed within a predetermined time. Specifically, the non-operation time during which the user operation is not performed is measured by the timer 42, and the lock application 38B determines whether the measured non-operation time exceeds a predetermined time. When the non-operation time exceeds a predetermined time, the terminal state management unit 30 is notified. If the non-operation time does not exceed the predetermined time, the user operation is performed within the predetermined time, and thus the determination is affirmative, and the non-operation time measured by the timer 42 is reset to enter the standby state. On the other hand, when the non-operation time exceeds the predetermined time, the user operation is not performed within the predetermined time, and thus the determination is negative and the process proceeds to step S102.

  In step S102, the terminal state management unit 30 shifts the portable information terminal device 10 to the sleep state. Specifically, the state of the application being executed is being suspended. At this time, the priority of the application does not change (see FIG. 12 (1) and FIG. 13 (1)).

  After the screen control unit 40 turns off the screen of the display 20 in the next step S104, the screen control unit 40 ends the first process. Specifically, the terminal state management unit 30 outputs, to the screen control unit 40, a control instruction to turn off the screen. The screen control unit 40 turns off the screen of the display 20 in response to the control command. FIG. 10 shows a specific example when the screen of the display 20 is turned off in the portable information terminal device 10 of the present embodiment. By the execution of this step, the screen of the display 20 changes from the state where the application screen 104 was displayed (see FIG. 6) to the off (off) state (see FIG. 10).

  Thus, when the first process ends, the portable information terminal device 10 executes the second process.

  FIG. 11 shows a flowchart of an example of a second process of the display control process performed by the portable information terminal device 10.

  In step S200, the terminal state management unit 30 determines whether a start request has been detected.

  When the user wants to bring the portable information terminal device 10 back from the sleep state, the user operates it by operating any of the power button 14, the home button 16, and the hard keys (hard key group 60) such as the fingerprint authentication button 24. Make a request. Therefore, the terminal state management unit 30 determines whether the hard key control unit 34 has detected a start request.

  The user operation for requesting return from the sleep state is not limited to the above. For example, the touch (including tap, flick, and swipe) operation of the display 20 or the portable information terminal device 10 may be used. It may be a gripping action.

  If the hard key control unit 34 does not detect the activation request, the determination is negative and the standby state is established. On the other hand, when the activation request is detected, the determination is affirmative and the process proceeds to step S202. When the hard key control unit 34 detects a start request, the terminal state management unit 30 of the present embodiment outputs a start instruction to the application management unit 36.

  In step S202, the application management unit 36 acquires the icon 110 of the application having the first priority according to the start command. At the time of this step, the priorities of the applications are the same as in the sleep state shown in FIG. 12 (1) and FIG. 13 (1). Also, the priority of the application in the sleep state is the same as the priority of the application before the transition to the sleep state. Therefore, the application with the highest priority here is the application that was being executed when shifting to the sleep state.

  In the next step S204, the application management unit 36 moves the priority of the lock application 38B to the first place. The application management unit 36 also lowers the priority of the other applications one by one. By these processes, the priorities of the applications are in the states shown in FIG. 12 (2) and FIG. 13 (2).

  In the next step S206, the lock application 38B arranges the icon 110 on the lock screen 102. Specifically, the lock application 38B receives the icon 110 acquired in step S204 from the application management unit 36. Then, the lock application 38B arranges the icon 110 on the lock screen 102. The position at which the icon 110 is arranged may be determined in advance, and may not overlap with another display (for example, a display indicating a locked state, etc.) displayed on the lock screen 102. At this stage, the icon 110 is arranged on the lock screen 102, but the lock screen 102 is not yet displayed on the display 20, and the screen remains in the off (dark) state.

  In the next step S208, the screen control unit 40 turns on (lights up) the screen of the display 20. In addition, the screen control unit 40 controls the display 20 to display the screen of the application having the first priority. As shown in FIGS. 12 (2) and 13 (2), the application with the first priority is the lock application 38B. Therefore, the lock application 38B is being executed, and the screen control unit 40 displays the lock screen 102 (see FIG. 4) of the lock application 38B on the display 20.

  In the next step S210, the terminal state management unit 30 determines whether or not the user operation has been performed within a predetermined time. Specifically, the timer 42 measures the no-operation time during which no user operation is performed, and the lock application 38B determines whether the measured no-operation time exceeds a predetermined time, and the no-operation time remains constant. If exceeded, the terminal state management unit 30 is notified.

  If the non-operation time exceeds the predetermined time, the user operation is not performed within the predetermined time, so the determination is negative and the process proceeds to step S212. In step S212, the terminal state management unit 30 ends the lock application 38B, and shifts the portable information terminal device 10 to the sleep state, as in step S102 of the first process (see FIG. 9).

  Then, in the next step S214, the screen control unit 40 turns off the screen of the display 20 (off) as in the process of step S104 in the first process (see FIG. 9), and then returns to step S200. Repeat the process.

  On the other hand, when the non-operation time does not exceed the predetermined time, the user operation is performed within the predetermined time, and thus the determination is affirmative, and the process proceeds to step S216.

  In step S216, the terminal state management unit 30 determines whether a release operation has been detected. In the present embodiment, when the user wants to release the lock state, the user requests release of the lock state by operating the hard key (hard key group 60). The release operation is not limited to the operation of the hard key. For example, any of touch operations such as tapping on the screen of the display 20, swipe, pattern, password input, and password input may be used. For example, biometric authentication such as face authentication using the in-camera 18, fingerprint authentication using the fingerprint authentication button 24, and iris authentication using the in-camera 18 or an infrared camera (not shown) may be used.

  In the present embodiment, as a specific example, the lock application 38B determines whether the release operation has been performed based on the detection result of the hard key control unit 34. When the release operation is detected, the terminal state management unit 30 is notified.

  If the release operation has not been detected, a negative determination is made, and the process returns to step S210. On the other hand, when the release operation is detected, an affirmative determination is made, and the process proceeds to step S218.

  In step S218, the terminal state management unit 30 determines whether the volume button 12 or the volume button 13 has been operated. Specifically, the terminal state management unit 30 inquires the hard key control unit 34 whether or not the volume button 12 or the volume button 13 has been operated in addition to the release operation.

  If neither the volume button 12 nor the volume button 13 is operated, the determination is negative and the process proceeds to step S226. On the other hand, when one of the volume button 12 and the volume button 13 is operated, the determination is affirmative, and the process proceeds to step S220.

  In step S220, the terminal state management unit 30 determines whether the volume button 12 for increasing the volume has been operated. When the volume button 12 is operated, the determination is affirmative, and the process proceeds to step S222. After changing the priority of the home application 38A to the first place in step S222, the application management unit 36 proceeds to step S226. By the process, the priority of the application is in the state shown in FIG. 12 (3). In the present embodiment, when displaying the home screen 100 after releasing the lock state, the application (application a in FIG. 12 (3)) being executed before the transition to the sleep state is stopped, but the process is ended. You may

  On the other hand, when the volume button 12 is not operated, that is, when the volume button 13 is operated, the determination is negative and the process proceeds to step S224. In step S224, the application management unit 36 instructs the peep prevention application 38C to display the peep prevention filter on the screen (the foremost layer) of the display 20, and then proceeds to step S226.

  In step S226, the application management unit 36 terminates the lock application 38B. With the termination of the lock application 38B, the application management unit 36 raises the priority of the active application one by one. When the process proceeds from step S222 to step S226, the order of the applications is as shown in FIG. 12 (3), and the home application 38A is ranked first. On the other hand, when the process proceeds from step S218 or step S224 to step S226, the order of the applications is as shown in FIG. 13 (3), and the application that is executing before transitioning to the sleep state and has acquired the icon 110 The priority of is 1st.

  In the next step S228, the screen control unit 40 causes the display 20 to display a screen corresponding to the application with the first priority, and then ends the second process.

Second Embodiment
In the first embodiment, the application screen 104 displayed on the display 20 after release of the lock state is suggested by displaying the icon 110 of the application that was being executed before transitioning to the sleep state on the lock screen 102. Was. In the present embodiment, a case different from the first embodiment will be described in which the application screen 104 displayed on the display 20 is indicated after the lock state is released during the lock state (display of the lock screen 102).

  In the present embodiment, by displaying the captured image of the application that was being executed before the transition to the sleep state while the lock screen 102 is displayed, the application screen 104 displayed on the display 20 after releasing the lock state is suggested. Do.

  FIG. 14 is a diagram for describing a user operation for displaying a capture image while the lock screen 102 is displayed.

  When the portable information terminal device 10 of the present embodiment has the case 11 tilted so that the distance to the user is closer to the user's head than to the legs as shown in FIG. The capture image of the application is displayed on the display 20 according to the tilt angle.

  In FIG. 14 (2), the side on which the in-camera 18 is provided is the upper side, the side on which the home button 16 is provided is the lower side, the upper side corresponds to the head side of the user, and the lower side is the leg side The specific example of how to incline the portable information terminal device 10 in the case corresponding to FIG. As shown in FIG. 14 (2), when the upper side moves in the arrow A direction, the lower side moves in the arrow B direction, and in both cases, it is detected that the portable information terminal device 10 is inclined. The captured image of the application is displayed on the display 20.

  The direction in which the portable information terminal device 10 is tilted in order to display the capture image 105 on the display 20 while in the locked state is not particularly limited. However, by tilting the portable information terminal device 10 as shown in FIG. 14, it is preferable to make the captured image 105 harder to see from a third party present around the user.

  FIG. 15 is a diagram for explaining a specific example of the lock screen 102 and the display of the captured image. FIG. 15A shows a screen displayed on the display 20 in a state in which the portable information terminal device 10 is not inclined in the above direction. As shown in FIG. 15 (1), when the portable information terminal device 10 is not inclined in the above direction, only the lock screen 102 is displayed on the display 20.

  On the other hand, FIG. 15 (2) shows a screen displayed on the display 20 in a state where the portable information terminal device 10 is inclined in the above-mentioned direction. As shown in FIG. 15 (2), the display 20 displays the lock screen 102 which has been slightly deformed in the vertical direction according to the tilt angle. Due to the small deformation, an image of a layer lower than the layer of the lock screen 102 is displayed above the screen area of the display 20. Therefore, by setting the layer of the capture image 105 below the layer of the lock screen 102, as shown in FIG. 14 (2), the capture image 105 is displayed in the display area where the lock screen 102 is not displayed. . In the portable information terminal device 10 of the present embodiment, the larger the inclination angle (the closer the portable information terminal device 10 is to the user, or the more the portable information terminal device 10 is to the horizontal with respect to the user). The display area of the image 105 is enlarged.

  The larger the inclination angle, the larger the display area of the captured image 105 of the lower layer, and the specific state of the lock screen 102 and the captured image 105 displayed on the display 20 is not particularly limited. For example, at least one of the lock screen 102 and the capture image 105 may be compressed and displayed according to the tilt angle (the size of the display area).

  Further, although the area for displaying the captured image 105 is increased according to the tilt angle of the portable information terminal device 10 as described above, it is preferable to set the upper limit of the size.

  FIG. 16 is a block diagram showing an example of a schematic configuration relating to functions related to display control processing in the portable information terminal device 10 of the present embodiment. Further, FIG. 17 shows a schematic configuration diagram of hardware for realizing the portable information terminal device 10 of the present embodiment.

  As shown in FIG. 16, the portable information terminal device 10 of this embodiment is different from the portable information terminal device 10 of the first embodiment (see FIG. 2), and further includes a gyro sensor control unit 35. The gyro sensor control unit 35 has a function of detecting the tilt of the portable information terminal device 10 by the gyro sensor 62 and outputting the information.

  Therefore, as shown in FIG. 17, the hardware for realizing the portable information terminal device 10 of the present embodiment is different from the hardware of the portable information terminal device 10 of the first embodiment (see FIG. 8). Equipped with The display control program 66 stored in the storage unit 56 further includes a gyro sensor control process 77. The CPU 52 operates as the gyro sensor control unit 35 by executing the gyro sensor control process 77.

  Next, the operation of the portable information terminal device 10 according to the present embodiment will be described.

  Similarly to the display control process executed by the portable information terminal device 10 of the first embodiment, the display control process executed by the portable information terminal device 10 of the present embodiment includes two processes of the first process and the second process. Including. In each of the first process and the second process, the steps performing the same process as in the first embodiment are given the same reference numerals, and the description thereof is omitted.

  First, the first process of the present embodiment will be described. FIG. 18 shows a flowchart of an example of a first process of the display control process performed by the portable information terminal device 10 of the present embodiment. As shown in FIG. 18, in the first process of the present embodiment, the process of step S101 is provided between step S100 and step S102 of the first process (see FIG. 9) of the first embodiment.

  When the terminal state management unit 30 determines in step S100 that the user operation has been performed within a predetermined time, the determination is positive and the process proceeds to step S101.

  After capturing the screen being displayed on the display 20 in step S101, the screen control unit 40 proceeds to step S102. Specifically, the screen control unit 40 captures the application screen 104 displayed according to the application currently being executed.

  Therefore, in the first process of the present embodiment, after capturing the application screen 104, the state is shifted to the sleep state, and the screen of the display 20 is turned off (turned off).

  Note that the timing of capturing the application screen 104 is not limited to immediately before shifting to the sleep state as described above. For example, the application screen 104 may be acquired in advance for each application installed in the portable information terminal device 10.

  Next, the second process of the present embodiment will be described. FIG. 19 shows a flowchart of an example of a second process of the display control process performed by the portable information terminal device 10 of the present embodiment. As shown in FIG. 19, in the second process of the present embodiment, a step S203 is provided instead of step S202 of the second process (see FIG. 11) of the first embodiment. Moreover, step S206 of the second process of the first embodiment is not provided in the second process of the present embodiment, and step S208A is provided instead of step S208. Further, in the second process of the present embodiment, steps S209A, S209B, and S209C are provided between step S208 and step S210.

  When the terminal state management unit 30 detects the activation request in step S200, the determination is positive and the process proceeds to step S203.

  In step S203, the screen control unit 40 acquires a capture image of an application captured before transitioning to the sleep state (see FIG. 18, step S101), and then proceeds to step S204.

  In step S204, the application management unit 36 moves the priority of the lock application 38B to the first place, and then moves to step S208A. After the screen control unit 40 turns on (turns on) the screen of the display 20 in step S208A, the process proceeds to step S209A.

  In step S209A, the gyro sensor control unit 35 determines whether the tilt has changed in a predetermined direction. In the present embodiment, the gyro sensor control unit 35 detects whether or not the inclination is desired to change in the above-described direction described with reference to FIG. 14 as the predetermined direction. If the inclination has not changed, the determination is negative and the process proceeds to step S210. On the other hand, when the inclination has changed, the determination is affirmative and the process proceeds to step S209B.

  In step S209B, the screen control unit 40 processes the capture image 105 and the lock screen 102 in accordance with the inclination (angle) detected by the gyro sensor control unit 35 (see FIG. 15 (2)).

  After the screen control unit 40 causes the display 20 to display the processed screen in the next step S209C, the process proceeds to step S210. Specifically, as described above, the screen control unit 40 causes the display 20 to display the lock screen 102 and the capture image 105 by arranging the capture image 105 in the layer under the lock screen 102.

  In the second process of the present embodiment, when a negative determination is made in step S216, the process proceeds to step S209A unlike the second process (see FIG. 11) of the first embodiment.

  Therefore, in the second process of the present embodiment, the captured image 105 is displayed on the display 20 according to the inclination of the portable information terminal device 10 while the lock screen 102 is displayed.

  As described above, in the portable information terminal device 10 according to each of the above-described embodiments, when the user operation is not performed within a predetermined period, the state shifts to the sleep state and the screen of the display 20 is turned off (lights off). Then, when the terminal state management unit 30 detects the activation request, the terminal state management unit 30 returns from the sleep state and enters the lock state. In the locked state, the screen control unit 40 displays information (icon 110, captured image 105) representing the application screen 104 displayed before transition to the sleep state on the lock screen 102 or together with the lock screen 102. .

  In response to the user operation detected by the touch sensor control unit 32 or the hard key control unit 34 accompanying the release operation (during display of the lock screen 102), the terminal state management unit 30 causes the display 20 to be released after the lock state is released. Switch the screen to be displayed. In the above embodiments, the terminal state management unit 30 switches so that one of the home screen 100, the application screen 104, the application screen 104, and the peeping prevention filter 106 is displayed.

  If the user does not remember the application that was being executed before the transition to the lock state, there is a concern that a screen unintended by the user may be displayed after the release of the lock state.

  For example, the game may be displayed during the work break time, and the game may shift to the locked state, and the game screen may be displayed when the locked state is released during the working time. Also, for example, when there is no third party in the vicinity, the locked state after viewing a screen (e-mail with private content, a photo, a browser, etc.) or confidential information (in-house information, etc.) that you do not want to disclose And may be unlocked in public places.

  On the other hand, in the portable information terminal device 10 of the present embodiment, the screen displayed on the display 20 may be switched after releasing the lock state by the user operation while the lock screen is displayed (in connection with the release operation). it can.

  Therefore, it is possible to prevent a screen not intended by the user from being displayed on the display 20 after the lock state is released. Thereby, in the portable information terminal device 10 of the present embodiment, it is possible to prevent the display 20 from disclosing a screen (information) which the user does not want to disclose to a third party.

  Further, in the portable information terminal device 10 according to each of the above embodiments, the application screen 104 of the application being executed (displayed) before the transition of the sleep state is displayed on the lock screen 102 or together with the lock screen 102. Display information

  Therefore, since the user can know the application screen 104 of the application that was being executed (displayed) in the locked state before the transition to the sleep state, a screen not intended by the user is displayed on the display 20. Can be prevented.

  In addition, the method of suggesting the application screen 104 (displayed after releasing the lock state) displayed before shifting to the sleep state is not limited to the above embodiments, and information representing the application (application screen 104) If it is

  For example, as in the second embodiment, the capture image 105 may be captured before shifting to the sleep state, and the capture image 105 may be processed and displayed on the lock screen 102 so that the content is not known from a third party. Good. For example, the captured image 105 may be processed into a thumbnail image, and the thumbnail image may be displayed on the lock screen 102 instead of the icon 110 of the first embodiment. Further, for example, the captured image 105 may be displayed on the lock screen 102 by deforming it or blurring it by activating the peeping prevention filter 106 or the like. Also, the file name of the file opened on the application screen 104 may be displayed as characters.

  Further, as in the second embodiment, the capture image 105 is set in the lower layer of the lock screen 102, and the display degree (area, size, appearance, etc.) of the capture image 105 according to the user operation. There is no limitation on the method of changing the For example, when a user operation of swiping or pressing the screen of the display 20 is performed, the lock screen 102 of the touched (touched) portion is transmitted, and an image of the lower layer (captured image 105) is displayed. Good. In addition, as the user swipes the screen of the display 20, the transmittance of part or all of the lock screen 102 may be gradually increased to gradually display the image of the lower layer (captured image 105).

  Further, for example, an identifier of an application, a name, and the like may be displayed on the lock screen 102.

  It goes without saying that, for example, the icon 110, the captured image 105, the thumbnail image, the identifier of the application, the name and the like may be displayed in combination with the lock screen 102 or the lock screen 102.

  The application that displays the icon 110 or the like in the locked state is not limited to the application with the first priority. For example, the display is switched to the icon of another application being activated each time a specific first operation is performed in a state where the icon 110 is displayed. Then, when a specific second operation is performed, the screen of the application corresponding to the icon displayed at that time may be displayed.

  In the above embodiments, the screen displayed on the display 20 after releasing the lock state depending on whether the user operates the volume button 12 or the volume button 13 while the lock screen 102 is being displayed (in addition to the release operation). Was switching. However, the method of switching the screen displayed on the display 20 after the release of the locked state (the method instructed by the user) is not limited to this.

  For example, a screen to be displayed on the display 20 after the lock state is released according to the position on the lock screen 102 displayed on the display 20 where the user touches (contacts) or the type of touch (touch, tap, swipe, etc.) You may switch.

  As a specific example, a method of switching the screen displayed on the display 20 after the release of the lock state will be described according to the presence or absence of a touch (contact) on a specific part on the lock screen 102. As such a specific part, when there is an image or character displayed on the lock screen 102, for example, a part such as the image or character or a specific part corresponding to a specific position can be mentioned. When the icon 110 is displayed on the lock screen 102 as in the first embodiment, the portion where the icon 110 is displayed may be set as the specific portion.

  FIG. 20 shows a flowchart of a second process in the case where the screen displayed on the display 20 is switched after the release of the locked state according to the presence or absence of a touch (contact) on a specific part. FIG. 20A shows the case of switching to either the home screen 100 or the application screen 104. FIG. 20 (2) shows the case of switching to any one of the home screen 100, the application screen 104, the application screen 104, and the peeping prevention filter 106. In addition, about the process similar to the 2nd process of said each embodiment, the same code | symbol is attached | subjected and description is abbreviate | omitted.

  FIG. 20A shows the case where the application screen 104 is displayed when a specific part on the lock screen 102 is touched, and the home screen 100 is displayed when another area is touched.

  In the case shown in FIG. 20A, step S219 is provided instead of step S218 of each of the second processes (see FIGS. 11 and 19).

  In step S219, the terminal state management unit 30 determines whether the specific part on the lock screen 102 is touched. Specifically, the terminal state management unit 30 determines whether the touch sensor control unit 32 recognizes that the specific part is touched.

  When the specific part is touched, the determination is affirmative and the process proceeds to step S226. In this case, the application screen 104 is displayed on the display 20 after releasing the lock state.

  On the other hand, when the specific part is not touched (when the area of the display 20 other than the specific part is touched), the determination is negative and the process proceeds to step S222. In this case, the home screen 100 is displayed on the display 20 after releasing the lock state.

  On the other hand, in the case shown in FIG. 20 (2), the process in the case of a negative determination in S219 shown in FIG. 20 (1) is different.

  As shown in FIG. 20 (2), when a negative determination is made in step S219, the process proceeds to step S221. In step S221, the terminal state management unit 30 determines whether the area touched by the user is the upper area of the lock screen 102 (display 20) based on the recognition result of the touch sensor control unit 32. Here, the upper side of the display 20 refers to the area in the direction in which the in-camera 18 is provided from the center of the display 20, and the lower side refers to the area in the direction in which the home button 16 is provided from the center of the display 20. . In step S221, the determination of the area touched by the user is an area excluding the specific part on the lock screen 102.

  If the upper side of the lock screen 102 is touched, the determination is affirmative and the process proceeds to step S22. In this case, the home screen 100 is displayed on the display 20 after releasing the lock state.

  On the other hand, when the lower side is touched, the determination is negative and the process proceeds to step S224. In this case, the application screen 104 and the peeping prevention filter 106 are displayed on the display 20 after the lock state is released.

  Further, the present invention is not limited to the example of the second processing, but, for example, the lock state is released after tapping a specific area (such as an application icon or thumbnail image) on the lock screen 102, and the screen is displayed according to the number of taps You may switch.

  Further, for example, a screen to be displayed after the release may be determined according to the manner of holding (inclination) of the portable information terminal device 10 when the lock state is released. For example, as shown in FIGS. 21 (1) and 21 (2), when the portable information terminal device 10 is in landscape orientation and as shown in FIG. The screens to be displayed on the display 20 are associated in advance. Then, the screen control unit 40 may switch the screen in accordance with the inclination of the portable information terminal device 10 detected in the gyro sensor control unit 35 (the first embodiment, see FIG. 16).

  Further, for example, by detecting an operation of swinging the portable information terminal device 10 left and right before releasing the lock state, a screen to be displayed after the release may be determined.

  Also, for example, a plurality of release keys (fingerprint, pattern, password, etc.) for releasing the lock state are registered in advance, and a screen is set for each type of the release key, thereby setting the release key. Accordingly, the screen to be displayed after cancellation may be determined.

  Also, for example, in the case of releasing the lock state by swipe, the screen to be displayed after the release may be determined according to the swipe direction. As a specific example, the home screen 100 is displayed when the swipe direction is the right direction as viewed from the user, the application screen 104 is displayed in the upper direction, and the application screen 104 and the peeping prevention filter 106 in the left direction. You may decide to display it.

  Further, a method (a user operation) for switching the screen displayed on the display 20 after the release of the locked state may be displayed on the lock screen 102.

  In each of the above embodiments, the case where the screen of the display 20 is turned off (turned off) when transitioning to the sleep state has been described, but the display state of the display 20 is not limited to this. For example, a predetermined screen (image) such as a screen saver may be displayed on the display 20. Alternatively, for example, the lock screen 102 may be displayed on the display 20 after transitioning to the sleep state and transition to the locked state in which the lock application 38B is activated.

  Further, for example, the screen displayed on the display 20 after waking up from the sleep state may be switched according to the user operation detected accompanying the start request (restoration from the sleep state) without shifting to the lock state.

  In addition, what is necessary is just to perform the 2nd process of said each embodiment according to the changed priority, when the priority of an application changes during a sleep state.

  In the above embodiments, the home screen 100, the application screen 104, the application screen 104, and the peep prevention filter 106 are exemplified as the screens displayed after releasing the lock state, but the present invention is not limited thereto. . Other than the application screen 104, any screen may be used. Note that the application screen 104 at this time is not limited to the application screen 104 that was being executed before the transition of the lock state. For example, if the priority changes during the sleep state, the changed priority may be followed. For example, it may be the application screen 104 of the application instructed according to the user operation during the locked state (for example, the application instructed to be executed after releasing the locked state). Also, there may be two types of screens, or four or more types.

  In each of the above embodiments, the electronic device of the disclosed technology is a smartphone, but the electronic device is not limited to this. For example, other PDAs (Personal Digital Assistants) represented by a tablet terminal or the like may be used. Also, for example, so-called desktop personal computers or laptop personal computers may be used.

  In each of the above embodiments, the display control program 66 has been described as being stored (installed) in the storage unit 56 of the portable information terminal device 10 in advance. However, it is also possible to provide the display control program 66 in the form of being recorded on a storage medium. Examples of the storage medium include a compact disc read only memory (CD-ROM), a digital versatile disc read only memory (DVD-ROM), and a universal serial bus (USB) memory. It is also possible to download the display control program 66 from an external device or the like via a communication line such as the Internet.

  Further, the following appendices will be disclosed regarding the above embodiment.

(Supplementary Note 1)
A display unit,
A detection unit that detects a lighting instruction of the display unit when the display unit is turned off;
When the detection unit detects the lighting instruction, the presence or absence of an additional operation other than the lighting instruction is determined, and the application screen displayed on the display unit when transitioning to the light off state, and the application screen other than the application screen In the determination of which of the following screens is to be displayed on the display unit when transitioning to the lighting state of the display unit or transition from the lock release screen displayed after transitioning to the lighting state: A control unit determined according to the result;
Electronic equipment equipped with

(Supplementary Note 2)
The control unit causes the display unit to display information representing application software corresponding to the application screen on the lock release screen.
The electronic device according to Appendix 1.

(Supplementary Note 3)
Equipped with a touch panel,
The control unit determines a screen to be displayed on the display unit according to a touch position on the touch panel.
The electronic device according to appendix 2.
(Supplementary Note 4)
The information representing the application software is a captured image of the application screen,
The apparatus further comprises an inclination detection unit that detects an inclination angle of the own device,
The control unit causes the capture image to be displayed in an area having a size according to the tilt angle detected by the tilt detection unit of the display unit while the lock release screen is displayed.
The electronic device according to Supplementary Note 2 or 3.

(Supplementary Note 5)
The information representing the application software is at least one of an icon of the application software and a captured image of the application screen.
The electronic device according to any one of Appendixes 2 to 4.

(Supplementary Note 6)
The control unit turns off the display unit when the operation is not performed within a predetermined time.
The electronic device according to any one of supplementary notes 1 to 5.

(Appendix 7)
On the computer
While the display unit is turned off, a lighting instruction of the display unit is detected;
When the lighting instruction is detected, it is determined whether or not an additional operation other than the lighting instruction is performed, and an application screen displayed on the display unit when transitioning to the light off state, and a screen other than the application screen, According to the result of the determination, which of the above is to be displayed on the display unit when transitioning to the lighting state of the display unit or transition from the lock release screen displayed after transitioning to the lighting state decide,
Control program to execute processing including
(Supplementary Note 8)
Displaying on the display unit information representing application software corresponding to the application screen on the lock release screen;
The display control program according to appendix 7.

(Appendix 9)
Determine a screen to be displayed on the display unit according to the touch position on the touch panel;
The display control program according to appendix 8.

(Supplementary Note 10)
The information representing the application software is a captured image of the application screen,
Detect the inclination angle of your own device,
While the lock release screen is displayed, the capture image is displayed in an area having a size corresponding to the tilt angle of the display unit.
The display control program according to Appendix 8 or 9.

(Supplementary Note 11)
The information representing the application software is at least one of an icon of the application software and a captured image of the application screen.
The display control program according to any one of Appendixes 8 to 10.

(Supplementary Note 12)
When the operation is not performed within a predetermined time, the display unit is turned off,
The display control program according to any one of Appendixes 7 to 11.

DESCRIPTION OF SYMBOLS 10 Personal digital assistant device 20 Display 30 terminal state management part 32 Touch sensor control part 34 Hard key control part 35 Gyro sensor control part 36 Application management part 40 Screen control part 52 CPU
54 memory 56 storage unit 60 hard key group 66 display control program

Claims (4)

An inclination detection unit that detects an inclination angle of the own device;
A display unit,
A detection unit that detects a lighting instruction of the display unit when the display unit is turned off;
When the lock release operation is detected when the lock release screen displayed after the transition to the lighting state of the display unit is displayed on the display unit after the detection unit detects the lighting instruction The presence or absence of an incidental operation incidental to the lock release operation other than the lighting instruction is determined, and when transitioning from the lock release screen , the display unit displays when transitioning to the light off state according to the result of the determination. and app screen is a control unit for displaying on the display unit one of the screen other than the application screen,
Equipped with
The control unit causes the capture image of the application screen to be displayed in a variable area of a size corresponding to the tilt angle detected by the tilt detection unit of the display unit while the lock release screen is displayed.
Electronics. The captured image is an image that has been degraded so as not to be easily understood by a third party.
The electronic device according to claim 1. Equipped with a touch panel,
The control unit determines a screen to be displayed on the display unit after transitioning from the lock release screen according to a touch position on the touch panel.
The electronic device of Claim 1 or Claim 2. On the computer
Detect the inclination angle of your own device,
While the display unit is turned off, a lighting instruction of the display unit is detected;
When a lock release operation is detected when the lock release screen displayed after the transition to the lighting state of the display unit is displayed on the display unit after the lighting instruction is detected, other than the lighting instruction The application that has been displayed on the display unit when transitioning to the light-off state according to the result of the determination when it is determined whether or not there is an incidental operation incidental to the lock release operation and transitioning from the lock release screen and the screen, is displayed on the display unit one of the screen other than the application screen,
While the lock release screen is displayed, the capture image of the application screen is displayed in a variable area of a size corresponding to the tilt angle of the display unit.
Control program to execute processing including