CN107765775B

CN107765775B - Terminal control method, device and storage medium

Info

Publication number: CN107765775B
Application number: CN201711081593.9A
Authority: CN
Inventors: 李鸿
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2017-11-07
Filing date: 2017-11-07
Publication date: 2019-12-31
Anticipated expiration: 2037-11-07
Also published as: CN107765775A

Abstract

The application discloses a terminal control method, a terminal control device and a storage medium, and belongs to the technical field of electronics. For an exterior folder terminal, the method comprising: after the external folding terminal is in a non-unfolding state, determining a first split screen, and keeping the first split screen lightened; acquiring an environment image of a second split screen; and keeping the second split screen to be extinguished or lightened according to whether the environment image comprises a face image or not. This application is located the environmental image of the demonstration side of second split screen through gathering, when the environmental image does not include facial image, keep the second split screen to extinguish, when the environmental image includes facial image, keep the second split screen to light, in the correlation technique of having solved, after two split screens at outer folding terminal light simultaneously, the user probably only can be operated one of them split screen and another split screen still keeps lighting always, lead to the extravagant condition of electric quantity, the effect of effectively saving the terminal electric quantity has been reached.

Description

Terminal control method, device and storage medium

Technical Field

The present application relates to the field of electronic technologies, and in particular, to a method and an apparatus for controlling a terminal, and a storage medium.

Background

With the development of electronic technology, the display screen of the terminal is becoming larger and larger, and in order to facilitate carrying of the terminal, the terminal with the foldable display screen is produced, and the terminal can also be called as a foldable terminal.

In the folded state, the folded terminal in which the display screen is completely exposed is referred to as an outer folded terminal, and the exposed display screen includes a first sub-screen and a second sub-screen which are exposed. After the outer folding terminal is unfolded, the first split screen and the second split screen of the outer folding terminal can be simultaneously lightened for the user to use.

However, in the related art, after the first split screen and the second split screen of the external folder terminal are simultaneously lit up, a user may only operate one of the split screens, for example, when the user folds the external folder terminal on a desktop, one of the split screens faces the user for use, and the other split screen faces the opposite direction, in which case, the lighting up of the other split screen may cause a waste of power.

Disclosure of Invention

The embodiment of the application provides a terminal control method, a terminal control device and a storage medium, which can solve the problems in the related art. The technical scheme is as follows:

in a first aspect, a control method of a terminal is provided, where the terminal is used for an external folding terminal, the external folding terminal has a foldable display screen, and when the external folding terminal is folded, a display side of the display screen faces outwards; the display screen is divided into two sub-screens according to a preset folding line, and the method comprises the following steps:

after the outer folding terminal is in a non-unfolding state, determining a first split screen acted by a trigger operation in the two split screens, and keeping the first split screen lightened;

acquiring an environment image on a display side of a second split screen, wherein the second split screen is the split screen except the first split screen in the two split screens;

when the acquired environment image does not comprise a face image, keeping the second split screen off;

and when the acquired environment image comprises a face image, keeping the second split screen to be lightened.

In a second aspect, a control device for a terminal is provided, which is used for an external folding terminal, the external folding terminal has a foldable display screen, and when the external folding terminal is folded, the display side of the display screen faces outwards; the display screen divides into two according to predetermined folding line and divides the screen, controlling means includes:

the determining module is used for determining a first split screen acted by a trigger operation in the two split screens and keeping the first split screen lightened after the outer folding terminal is in a non-unfolding state;

the acquisition module is used for acquiring an environment image positioned on a display side of a second split screen, wherein the second split screen is the split screen except the first split screen in the two split screens;

the first holding module is used for keeping the second split screen to be extinguished when the acquired environment image does not comprise a face image;

and the second holding module is used for holding the second split screen to be lightened when the acquired environment image comprises a face image.

In a third aspect, a terminal is provided, where the terminal includes:

a processor;

a memory for storing executable instructions of the processor;

the foldable display screen is characterized by comprising a foldable display screen, wherein the display side of the display screen faces outwards when the foldable display screen is folded, and the display screen is divided into two sub-screens according to a preset folding line;

wherein the processor is configured to:

In a fourth aspect, there is provided a storage medium having stored therein instructions that, when executed on a processor of a computer, enable the processor to perform the method of controlling the terminal of the first aspect.

In a fifth aspect, there is provided a computer program product containing instructions which, when run on a computer, cause the computer to perform the method of controlling a terminal according to any one of the first aspect.

The technical scheme provided by the embodiment of the application has the following beneficial effects:

after the outer folding terminal is in a non-unfolding state, the first split screen acted by the trigger operation in the two split screens is determined, the first split screen is kept lighted, then the environment image on the display side of the second split screen is collected, when the collected environment image does not comprise a face image, the second split screen is kept turned off, when the collected environment image comprises the face image, the second split screen is kept lighted, the problem in the related art is solved, after the two split screens of the outer folding terminal are simultaneously lighted, a user can only operate one split screen and the other split screen is kept lighted all the time, the condition of electric quantity waste is caused, and the effect of effectively saving the electric quantity of the terminal is achieved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1-1 is a block diagram of a terminal according to an embodiment of the present disclosure;

fig. 1-2 are block diagrams illustrating structures of another terminal according to an embodiment of the present disclosure;

fig. 1-3 are schematic structural diagrams of a terminal provided in an embodiment of the present application;

fig. 1-4 are schematic structural diagrams of another terminal provided in an embodiment of the present application;

fig. 1-5 are schematic structural diagrams of another terminal provided in an embodiment of the present application;

fig. 1-6 are schematic structural diagrams of another terminal provided in an embodiment of the present application;

fig. 1 to 7 are flowcharts illustrating a control method of a terminal according to an embodiment of the present disclosure;

fig. 2-1 is a flowchart of another terminal control method provided in an embodiment of the present application;

fig. 2-2 is a schematic structural diagram of another terminal provided in the embodiment of the present application;

2-3a are schematic diagrams of a terminal provided by an embodiment of the present application being placed on a placement surface;

2-3b are schematic views of another terminal provided by the embodiment of the present application placed on a placement surface;

fig. 3 is a schematic structural diagram of a terminal controllable device according to an embodiment of the present application;

fig. 4 is a schematic structural diagram of another terminal controllable device provided in the embodiment of the present application.

With the above figures, there are shown specific embodiments of the present application, which will be described in more detail below. These drawings and written description are not intended to limit the scope of the inventive concepts in any manner, but rather to illustrate the inventive concepts to those skilled in the art by reference to specific embodiments.

Detailed Description

To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.

Fig. 1-1 and fig. 1-2 are diagrams illustrating a control method of a terminal according to an embodiment of the present application, which show a block diagram of a terminal 100 corresponding to the control method provided by an exemplary embodiment of the present application. The terminal 100 may be a smart phone, a tablet computer, an e-book, and the like. The terminal 100 in the present application may include one or more of the following components: a processor 110, a memory 120, and a touch display screen 130.

Processor 110 may include one or more processing cores. The processor 110 connects various parts within the overall terminal 100 using various interfaces and lines, and performs various functions of the terminal 100 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 120 and calling data stored in the memory 120. Alternatively, the processor 110 may be implemented in hardware using at least one of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The processor 110 may integrate one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), a modem, and the like. Wherein, the CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing the content to be displayed by the touch display screen 130; the modem is used to handle wireless communications. It is understood that the modem may not be integrated into the processor 110, but may be implemented by a single chip.

The Memory 120 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). Optionally, the memory 120 includes a non-transitory computer-readable medium. The memory 120 may be used to store instructions, programs, code sets, or instruction sets. The memory 120 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like; the storage data area may store data (such as audio data, a phonebook) created according to the use of the terminal 100, and the like.

Taking an operating system as an Android (Android) system as an example, programs and data stored in the memory 120 are shown in fig. 1-1, and a Linux kernel layer 220, a system runtime library layer 240, an application framework layer 260, and an application layer 280 are stored in the memory 120. The Linux kernel layer 220 provides underlying drivers for various hardware of the terminal 100, such as a display driver, an audio driver, a camera driver, a bluetooth driver, a Wi-Fi driver, power management, and the like. The system runtime library layer 240 provides the main feature support for the Android system through some C/C + + libraries. For example, the SQLite library provides support for a database, the OpenGL/ES library provides support for 3D drawing, the Webkit library provides support for a browser kernel, and the like. Also provided in the system Runtime layer 240 is an Android Runtime library (Android Runtime), which mainly provides some core libraries that can allow developers to write Android applications using the Java language. The application framework layer 260 provides various APIs that may be used in building applications, and developers may build their own applications by using these APIs, such as activity management, window management, view management, notification management, content provider, package management, session management, resource management, and location management. At least one application program runs in the application layer 280, and the application programs may be a contact program, a short message program, a clock program, a camera application, etc. of the operating system; or an application program developed by a third-party developer, such as an instant messaging program, a photo beautification program, and the like.

Taking an operating system as an IOS system as an example, programs and data stored in the memory 120 are shown in fig. 1-2, and the IOS system includes: a Core operating system Layer 320(Core OS Layer), a Core Services Layer 340(Core Services Layer), a Media Layer 360(Media Layer), and a touchable Layer 380(Cocoa Touch Layer). The kernel operating system layer 320 includes an operating system kernel, drivers, and underlying program frameworks that provide functionality closer to hardware for use by program frameworks located in the kernel services layer 340. The core services layer 340 provides system services and/or program frameworks, such as a Foundation framework, an account framework, an advertisement framework, a data storage framework, a network connection framework, a geographic location framework, a motion framework, and so forth, that are needed by the application. The media layer 360 provides audiovisual interfaces for applications, such as graphics-related interfaces, audio-related interfaces, video-related interfaces, and audio/video transmission technology wireless broadcast (AirPlay) interfaces. The touchable layer 380 provides various common interface-related frameworks for application development, and the touchable layer 380 is responsible for user touch interaction operations on the terminal 100. Such as a local notification service, a remote push service, an advertising framework, a game tool framework, a messaging User Interface (UI) framework, a User Interface UIKit framework, a map framework, and so forth.

Among the frameworks illustrated in FIGS. 1-2, the frameworks associated with most applications include, but are not limited to: a base framework in the core services layer 340 and a UIKit framework in the touchable layer 380. The base framework provides many basic object classes and data types, provides the most basic system services for all applications, and is UI independent. While the class provided by the UIKit framework is a basic library of UI classes for creating touch-based user interfaces, iOS applications can provide UIs based on the UIKit framework, so it provides an infrastructure for applications for building user interfaces, drawing, processing and user interaction events, responding to gestures, and the like.

The touch display screen 130 is used for receiving a touch operation of a user on or near the touch display screen using any suitable object such as a finger, a touch pen, or the like, and displaying a user interface of each application program. The touch display 130 is generally provided at a front panel of the terminal 100.

As shown in fig. 1 to 3, the terminal 100 includes a first housing 41, a second housing 42, and a connecting assembly 43 connected between the first housing 41 and the second housing 42, and the first housing 41 and the second housing 42 are folded by the connecting assembly 43.

The first housing 41 includes a first supporting surface connected to the back surface of the touch display screen and a first back surface opposite to the first supporting surface, and the second housing 42 includes a second supporting surface connected to the back surface of the touch display screen and a second back surface opposite to the second supporting surface. Accordingly, the touch display screen includes a first display area 131, a second display area 132 and a third display area 133, wherein the first display area 131 corresponds to the position of the first housing 41, the second display area 132 corresponds to the position of the second housing 42, and the third display area 133 corresponds to the position of the connecting assembly 43. In one implementation, the first display region 131, the second display region 132 and the third display region 133 are made of flexible materials and have a certain expansion and contraction ductility; in another implementation, only the third display region 133 is made of a flexible material, and the first and second display regions 131 and 132 are made of a non-flexible material.

In an alternative implementation, the connection assembly 43 of the terminal 100 is of a manual construction. When the user manually separates the first casing 41 and the second casing 42, the terminal 100 is changed from the folded state to the unfolded state; when the user manually closes the first housing 41 and the second housing 42, the terminal 100 changes from the unfolded state to the folded state.

In an alternative implementation, the connection assembly 43 of the terminal 100 is of an electric construction, for example, the connection assembly 43 is provided with an electric rotating member such as an electric motor. Under the driving of the electric rotating component, the first housing 41 and the second housing 42 automatically close or separate, so that the terminal 100 has two states of unfolding and folding.

The terminal 100 may be divided into an outer folder terminal and an inner folder terminal according to whether the touch display screen is exposed in a folded state. Wherein:

external folding screen terminal

The outer folding screen terminal is a terminal which has a folding angle of 180 degrees and is completely exposed out of the touch display screen in a folding state. As shown in fig. 1-3, the terminal 100 is an exterior folding screen terminal. In the unfolded state, the first supporting surface of the first casing 41 of the terminal 100 is flush with the second supporting surface of the second casing 42 (i.e. the angle from the first supporting surface to the second supporting surface is 180 °), and the first display area 131, the second display area 132 and the third display area 133 of the touch display screen are located on the same placing surface; in the process of the terminal 100 changing from the unfolded state to the folded state, as shown in fig. 1 to 3, the first back surface of the first housing 41 and the second back surface of the second housing 42 are brought together, and the angle from the first supporting surface to the second supporting surface is changed from 180 ° to 0 °; in the folded state, as shown in fig. 1 to 4, the first supporting surface of the first housing 41 of the terminal 100 is parallel to the second supporting surface of the second housing 42 (the angle from the first supporting surface to the second supporting surface is 0 °), so that the touch display screen is in a U-shaped folded state in which the third display area 133 of the touch display screen forms an exposed U-shaped arc surface.

In an alternative implementation, in the folded state, all or part of the display area of the touch display screen is used for displaying the user interface. For example, as shown in fig. 1-4, in the collapsed state, only the second display region 132 is used to display the user interface, or only the third display region 133 is used to display the user interface.

It should be noted that, in practical applications, the outer folding screen terminal has an unfolded state and a non-unfolded state, wherein the non-unfolded state includes the folded state and an intermediate state between the unfolded state and the folded state, for example, the intermediate state is a state in which an angle from the first supporting surface to the second supporting surface is 30 °.

Terminal with internal folding screen

The inner-folding-screen terminal refers to a terminal that can be folded at an angle of 180 ° and in a folded state, the touch display screen is (entirely or partially) converged. As shown in fig. 1-5, the terminal 100 is an inner folder screen terminal. In the unfolded state, the first supporting surface of the first casing 41 of the terminal 100 is flush with the second supporting surface of the second casing 42 (i.e., the angle from the first supporting surface to the second supporting surface is 180 °), so that the touch display screen is in the placing surface unfolded state (the first display area 131, the second display area 132, and the third display area 133 are on the same placing surface); in the process of the terminal 100 changing from the unfolded state to the folded state, as shown in fig. 1 to 5, the first supporting surface of the first housing 41 and the second supporting surface of the second housing 42 are close to each other, that is, the angle from the first supporting surface to the second supporting surface is changed from 180 ° to 0 °; in the folded state, the first supporting surface of the first housing 41 of the terminal 100 is parallel to the second supporting surface of the second housing 42, so that the touch display screen is in a U-shaped folded state in which the third display area 133 of the touch display screen forms a U-shaped arc surface that is inwardly converged. In an alternative implementation, in the folded state, no user interface is displayed in all display areas of the touch display screen.

In addition to providing a touch display screen on the support surface of the housing, a touch display screen may also be provided on the first back surface of the first housing 41 and/or the second back surface of the second housing 42. When the inner folding screen terminal is in a folding state, the touch display screen arranged on the back face of the shell is used for displaying a user interface, and the user interface is the same as or different from the user interface displayed by the touch display screen in an unfolding state.

In other possible implementations, the foldable angle of the terminal 100 may also be 360 ° (both inward and outward), and in the folded state, the touch display screen is exposed or converged on the terminal, which is not limited in this embodiment.

In the terminal 100 shown in fig. 1-3 through 1-5, the first housing 41 and the second housing 42 are the same or similar in size, and the manner in which the terminal 100 is folded is referred to as a symmetrical fold. In other possible implementations, the terminal 100 may also be folded asymmetrically. When the asymmetric folding is adopted, the sizes of the first casing 41 and the second casing 42 may be different or different by more than a threshold (for example, 50% or 60% or 70%), and accordingly, the area of the first display region 131 in the touch display screen is different from the area of the second display region 132 by more than a threshold.

Illustratively, as shown in fig. 1-6, the terminal 100 is an asymmetrically folded outer folded screen terminal, with the first housing 41 having a larger size than the second housing 42. In the folded state, the area of the first display region 131 is larger than that of the second display region 132.

In fig. 1-3 to fig. 1-6, only the terminal 100 includes two parts of a housing and a connecting assembly for connecting the housing for illustration (the terminal is in a two-fold structure), in other possible implementations, the terminal 100 may include n parts of the housing and n-1 connecting assemblies, and accordingly, the touch display screen of the terminal 100 includes 2n-1 display areas, and the n-1 display areas corresponding to the connecting assemblies are made of a flexible material, so as to implement the terminal in an n-fold structure, which is not limited in this embodiment.

At least one other component is also provided in the terminal 100, the at least one other component including: cameras, fingerprint sensors, proximity light sensors, distance sensors, etc. In some embodiments, at least one other component is disposed on the front, side, or back of the terminal 100, such as a fingerprint sensor disposed on the back or side of the housing, a camera disposed above the touch display screen 130.

In other embodiments, at least one other component may be integrated within or below the touch screen display 130. In some embodiments, a bone conduction earpiece is provided inside the terminal 100; other components on the front panel of the conventional terminal are integrated in the whole area or a partial area of the touch display screen 130, for example, after a photosensitive element in the camera is split into a plurality of photosensitive pixels, each photosensitive pixel is integrated in a black area in each display pixel in the touch display screen 130, so that the touch display screen 130 has an image capturing function. The terminal 100 has a higher screen occupation ratio due to the integration of at least one other component within or under the touch display screen 130.

In some optional embodiments, an edge touch sensor is disposed on a single side, or two sides (e.g., two left and right sides), or four sides (e.g., four upper, lower, left and right sides) of the middle frame of the terminal 100, and is configured to detect at least one of a touch operation, a click operation, a press operation, a slide operation, and the like of a user on the middle frame. The edge touch sensor may be any one of a touch sensor, a thermal sensor, a pressure sensor, and the like. The user may apply operations on the edge touch sensor to control the application in the terminal 100.

In addition, those skilled in the art will appreciate that the configuration of terminal 100 as illustrated in the above-described figures is not intended to be limiting of terminal 100, and that terminals may include more or less components than those illustrated, or some components may be combined, or a different arrangement of components. For example, the terminal 100 further includes a radio frequency circuit, an input unit, a sensor, an audio circuit, a Wireless Fidelity (WiFi) module, a power supply, a bluetooth module, and other components, which are not described herein again.

The present embodiment is exemplified by the application of the control method to an external folder terminal. With continued reference to fig. 1 to 3, the external folding terminal 100 has a foldable display screen, which is divided into two sub-screens according to a preset folding line, for example, the display screen may be the touch display screen, the two sub-screens correspond to the first display area 131 and the second display area 132 in fig. 1 to 3 respectively, the two sub-screens are main display screens of the external folding terminal, and of course, the external folding terminal may further include a third sub-screen corresponding to the third display area 133, and the embodiment of the present application does not limit the state of the third sub-screen, and the preset folding line is generally located in the third display area. As shown in fig. 1 to 7, the control method may include:

step 101, after the external folding terminal is in a non-unfolding state, determining a first split screen acted by a trigger operation in the two split screens, and keeping the first split screen lightened.

And 102, acquiring an environment image on the display side of a second split screen, wherein the second split screen is the split screen except the first split screen in the two split screens.

And 103, when the acquired environment image does not comprise the face image, keeping the second split screen off.

And step 104, when the acquired environment image comprises a face image, keeping the second split screen to be lightened.

To sum up, according to the control method of the terminal provided in the embodiment of the present application, after the external folding terminal is in the non-expansion state, the first split screen that is triggered to operate in the two split screens is determined, and the first split screen is kept lit, then the environment image on the display side of the second split screen is collected, when the collected environment image does not include a face image, the second split screen is kept off, and when the collected environment image includes a face image, the second split screen is kept lit, so that in the related art, after the two split screens of the external folding terminal are simultaneously lit, a user may only operate one split screen and the other split screen is kept lit all the time, thereby causing the situation of electric quantity waste, and achieving the effect of effectively saving the electric quantity of the terminal.

Further, please refer to fig. 2-1, which shows a flowchart of another terminal control method according to an embodiment of the present application.

Step 201, after the external folding terminal is in the non-unfolding state, keeping two split screens off.

The non-unfolded state includes a state where an angle of the outer folder terminal from the first split screen to the second split screen is less than 180 degrees. After this outer folding terminal detects that the angle from first split screen to second split screen is less than 180 degrees, keep two split screens to extinguish, wherein, this method of detecting the angle that first split screen to second split screen can be multiple, the example, can set up distance sensor at certain split screen in two split screens, through the distance between two fixed positions on two split screens of real-time detection, compare this distance and preset distance, judge the angle that first split screen to second split screen, can specifically refer to correlation technique, this application embodiment does not do this and does not describe repeatedly here.

In practical applications, before the outer folding terminal is in the non-unfolded state, the two split screens of the outer folding terminal may respectively be in the extinguished state or the lit state (for example, the two split screens are synchronously in the extinguished state or the lit state, or one is in the lit state and the other is in the extinguished state), and after the outer folding terminal is in the non-unfolded state, the outer folding terminal may also respectively be in the extinguished state or the lit state (for example, the two split screens are synchronously in the extinguished state or the lit state, or one is in the lit state and the other is in the extinguished state). Wherein, keep two split screens all to extinguish after this outer folding terminal is in the non-state of expanding at first, folding terminal electric quantity outside saving that can be better avoids causing the electric quantity to waste. Therefore, in the embodiment of the present application, the outer folding terminal is in the non-unfolded state, and then two split screens are kept turned off.

Step 202, when a trigger operation for a certain split screen of the two split screens is detected, determining a first split screen acted by the trigger operation, and keeping the first split screen lighted.

The triggering operation may be a touch operation performed directly on a certain sub-screen by a finger of a user, or a pressing operation performed by a user through an entity key correspondingly arranged on a certain sub-screen, and in addition, the triggering operation may also be a voice control operation, for example, the user performs the triggering operation by dictating an instruction to the foldable terminal, which is not limited herein. And after the outer folding terminal detects the trigger operation and determines the split screen (namely the first split screen) acted by the trigger operation, lightening the first split screen.

And 203, acquiring an environment image on the display side of a second split screen, wherein the second split screen is the split screen except the first split screen in the two split screens.

After the first split screen is lightened, or at the same time when the first split screen is lightened, a camera component of the other split screen (namely, the second split screen) in the two split screens is triggered to acquire an image, and the camera component can comprise a camera. In practical applications, there are various ways to trigger the camera module, and in the embodiment of the present application, the placement posture of the external folder terminal is used as a trigger condition for explanation, and further, step 203 may include:

and S1, detecting whether the outer folding terminal is placed on the placing surface in a preset posture.

Alternatively, for convenience of describing the posture, the two split screens of the outer folder terminal are in an unfolded state, as shown in fig. 2-2, that is, the angle from the first split screen 200a to the second split screen 200b is 180 degrees. At this time, the external folding terminal 200 in the unfolded state may be regarded as a cubic structure, and the external folding terminal 200 includes two opposite surfaces, i.e., an a surface and a B surface, wherein the a surface includes the surfaces of the first split screen 200a and the second split screen 200B, the B surface is located on the other side of the external folding terminal with respect to the first split screen 200a and the second split screen 200B, and four side surfaces perpendicular to the two surfaces correspond to the C surface, the D surface, the E surface, and the F surface in fig. 2-2, respectively. Then, the preset gesture may be: 1) a posture in which the outer folder terminal is placed on the placing surface G through the D-plane shown in fig. 2-2, as shown in fig. 2-3 a; 2) the outer folding terminal is placed in a posture on the mounting surface through both sides as shown in fig. 2 to 3b, in which the outer folding terminal is placed on the mounting surface G through the C-side and the E-side in fig. 2 to 2. The postures shown in fig. 2-3a and fig. 2-3b can make the external folding terminal stably placed on the placing surface, so that a user can watch videos and the like on the external folding terminal without holding the external folding terminal, and the use requirements of the user are met.

It should be noted that the placing surface may be a surface of a table or a surface of a bed, for example, when the surface is similar to a horizontal plane and the outer folding terminal can be stably placed on the surface in a preset posture, the surface may be referred to as the placing surface.

In practical applications, there are various ways to detect the posture of the external folding terminal, for example, a sensor assembly may be disposed on the external folding terminal, the sensor assembly includes one or more sensors, the sensor may be a gravity sensor, an angle sensor, a contact sensor, or the like, wherein the contact sensor may be an optical sensor, a pressure sensor, or the like. The posture in which the outer folding terminal is placed is detected by the sensor assembly. The gravity sensor and the angle sensor may be provided at designated positions of the outer folding terminal, the contact sensor may be provided on any designated face of the outer folding terminal, the designated face may be a side face of the outer folding terminal, for example, each side face is provided with at least one contact sensor, or the designated face is at least one of two opposite surfaces (i.e., a-face or B-face in 2-2) of the outer folding terminal. The gravity sensor is a sensor for calculating an inclination angle of the terminal with respect to a horizontal plane by measuring acceleration due to gravity, and inclination angle data determined by the gravity sensor is used to reflect the inclination angle of the terminal. Further, the angle sensor and the contact sensor cooperate to detect the posture of the external folding terminal placed on the placing surface, for example, the angle sensor detects the angle from the first split screen to the second split screen, the contact sensor detects the contact surface between the external folding terminal and the placing surface, the contact surface is in surface contact or line contact with the placing surface, when the angle detected by the angle sensor is within a preset angle range, and the contact surface detected by the contact sensor is a preset side surface, the posture of the external folding terminal placed can be determined to be the two preset postures.

For example, assume that the preset duration corresponding to the gravity sensor is 2 seconds, the preset angle range corresponding to the angle sensor is 0 degrees to 180 degrees, the contact sensor is an optical sensor, and the preset side surfaces are the D surface, the C surface, and the E surface shown in fig. 2-2. After the outer folding terminal is placed on the placing surface in one posture, if the gravity sensor detects that the outer folding terminal keeps an inclination angle of 5 degrees (the included angle between the placing surface and the horizontal plane is 5 degrees) for more than 2 seconds, it can be determined that the outer folding terminal is stably placed on the placing surface, the angle from the first split screen to the second split screen is detected by the angle sensor to be 60 degrees, the angle is within a preset angle range, meanwhile, the light which can be detected by the optical sensor on the D surface of the outer folding terminal is smaller than a preset light threshold value, for example, the light is approximately zero (indicating that the optical sensor is blocked), it can be determined that the outer folding terminal is placed on the placing surface in a preset posture as shown in fig. 2-3 a.

Alternatively, when the outer folder terminal is placed on the placement surface in one posture, it is detected by the gravity sensor that the inclination angle of the outer folder terminal with 5 degrees is maintained for more than 2 seconds, and it is detected by the angle sensor that the first angle from the first split screen to the second split screen is 60 degrees, and the light detected by the light sensors on the C-plane and the F-plane of the outer folder terminal are both smaller than a preset light threshold, for example, approximately zero, it can be determined that the outer folder terminal is placed on the placement surface in the preset posture as shown in fig. 2 to 3 b.

The above embodiment is described by taking a cube as an example when the outer folding terminal is unfolded, and in practical applications, the outer folding terminal may also be in a structure with other shapes, such as a circular or oval structure when being unfolded. The practical shape of the external folding terminal when unfolded is not limited, and when the external folding terminal is not in a cubic structure, any side surface of the external folding terminal can be stably placed on the placing surface as long as the external folding terminal is in a non-unfolded state, and the external folding terminal is protected by the embodiment of the application.

And S2, when the outer folding terminal is placed on the placing surface in a preset posture, acquiring an environment image on the display side of the second split screen.

When the outer folding terminal detects that the outer folding terminal is placed on the placing surface in a preset posture, the camera shooting assembly is started, and the environment image on the display side of the second split screen is collected.

Optionally, this outer folding terminal can set up two sets of subassemblies of making a video recording respectively (this two sets of subassemblies of making a video recording are located first branch screen and second branch screen respectively promptly) in the demonstration side of display screen, and in practical application, these two subassemblies of making a video recording can comprise wide-angle camera and non-wide-angle camera, and this application embodiment does not do the restriction. Each camera assembly is disposed on a side of each split screen away from the other split screen, and therefore, in step S2, acquiring the environment image on the display side of the second split screen may be: and acquiring an environment image on the display side of the second split screen through a camera shooting assembly arranged on one side of the second split screen, which is far away from the first split screen.

And step 204, when the acquired environment image does not comprise the face image, keeping the second split screen to be extinguished.

After the environment image opposite to the display side of the second split screen is collected through the camera shooting assembly, face analysis is carried out on the environment image, and whether the environment image comprises a face or not is judged. The method for analyzing the face may be various, for example, edge detection may be performed on the environment image, an edge contour of an object appearing in the environment image may be detected through the edge detection, and then the edge contour is compared with a preset face contour, when a similarity between the edge contour of the object in the environment image and the preset face contour is greater than or equal to a preset threshold, it may be determined that the object is a face, and correspondingly, when the similarity is smaller than the preset threshold, it may be determined that the object is not a face. The specific judgment process and other judgment methods can refer to the related art, and the embodiments of the present application are not limited herein.

When the collected environment image is judged not to include the face image, it can be shown that at the current moment, the user only operates the first split screen of the external folding terminal, and at the moment, the second split screen can be kept to be turned off, so that the waste of electric quantity is avoided.

It should be noted that, in step 204, the determination result may be inaccurate, for example, a user may operate the display side of the second split screen, but when the camera assembly is capturing an environment image, the user does not appear in the capture area of the camera assembly. In order to avoid the occurrence of the similar situation, the camera shooting assembly can acquire the environment image for multiple times at a preset frequency and analyze the environment image.

And step 205, when the acquired environment image comprises a face image, keeping the second split screen to be lightened.

After the acquired environment image is analyzed (the analysis process may refer to step 204, which is not described herein), it is determined that the environment image includes a face image, and the second split screen may be kept lighted.

To describe the execution of step 205 further more accurately, step 205 can be executed in the following three cases:

in the first case, whether the second split screen is kept lighted is determined by judging whether the face image is the face of the specified user.

Illustratively, when the acquired environment image comprises a face image, the face image is recognized; and when the face image is the face of the specified user, keeping the second split screen to be lightened.

In practical applications, there are various methods for determining whether the face image is the face image of the designated user, for example, the external folding terminal may collect the face image of the designated user in advance through the camera module (or directly input the picture of the face image of the designated user to the external folding terminal), analyze the feature parameters of the face image of the designated user through a preset algorithm, and record the feature parameters. When the acquired environment image includes a face image, analyzing feature parameters of the face image in the acquired environment image through the preset algorithm, comparing the feature parameters with pre-recorded feature parameters, and identifying whether the face image in the acquired environment image is the face image of the designated user according to a comparison result. In practical application, when the face image of the designated user is not the face image, the second split screen can be kept turned off.

In the first case, the face image in the environment image may be further processed, whether the face image is the face image of the specified user is determined according to the processing result, and when the face image in the environment image is the face image of the specified user, the second split screen is kept lit. Therefore, the second split screen lightening opportunity can be refined, the effect of avoiding electric quantity waste is achieved, the face recognition function and the split screen control are combined, and the function of the external folding terminal is enriched.

In the second case, whether the second split screen is kept lighted is determined by judging whether the face image is the face of the specified user, and a different user interface is displayed on the second split screen by judging whether the face image is the face of the specified user.

Illustratively, when the acquired environment image comprises a face image, the face image is recognized; when the face image is the face of the designated user, displaying a first user interface on a second split screen; or when the face image is not the face of the specified user, displaying a second user interface on the second split screen.

In the second case, the privacy priority of the first user interface is higher than that of the second user interface, for example, the first user interface may include information that is related to the specified user privacy by more than a preset threshold, and the security and privacy of the information need to be protected, optionally, the information is an entry of application software (hereinafter, referred to as an application entry), which is usually embodied in the form of an application icon, for example, the application entry is an entry of payment software or an entry of chat software, and the like, while the second user interface may include information that is related to the privacy by less than a preset threshold, and the security and privacy need is not high, and the information is also available to other users, for example, the information is an application entry, for example, the application entry is an entry of video software, an entry of music playing software, an entry of a phone book, and the like.

The second condition is that on the basis of the first condition, the face recognition function is further enriched, different user interfaces are set for different appointed users to use, and the use habits of the users are better fitted.

It should be noted that the content of the first user interface and the content of the second user interface may be preset, for example, set when the external folding terminal leaves a factory, or may be set by a user in a user-defined manner after the user owns the external folding terminal, or may be set by a user in a user-defined manner, or may be set by a part of the content in advance and a part of the content in a user-defined manner. For example, the user may input, for the first user interface, a picture of a facial image of a specified user, the specified user being a user who may use the first user interface. And the external folding terminal obtains the characteristic parameters of the face image by analyzing the face image of the designated user and then records the characteristic parameters. When the external folding terminal acquires the environment image, the external folding terminal can judge whether the face corresponding to the face image in the environment image is the face of the specified user by analyzing and comparing the characteristic parameters of the face image in the environment image with the characteristic parameters corresponding to the face image of the specified user. When the face corresponding to the face image in the environment image is the face of the designated user, the second split screen can keep being lightened and display the first user interface, and when the face corresponding to the face image in the environment image is not the face of the designated user, the second split screen can keep being lightened and display the second user interface.

In addition, the user can also set a blacklist, the blacklist records the characteristic parameters of the specific face image, the user corresponding to the specific face image is a user who forbids using the terminal, and the user can not use the first user interface or the second user interface. The external folding terminal may establish the blacklist by using a blacklist picture input by a user, where the blacklist picture is a picture including a face image of the user who is prohibited from using the blacklist picture, for example, the external folding terminal may analyze the blacklist picture to obtain a feature parameter of the face image in the blacklist picture, and then record the feature parameter, and when the external folding terminal acquires an environment image, the external folding terminal may determine whether a face corresponding to the face image in the environment image is a face of the user who is prohibited from using the terminal by analyzing and comparing the feature parameter of the face image in the environment image with the feature parameter of the face image recorded in the blacklist. When the face corresponding to the face image in the environment image is the face of a user who prohibits using the terminal, the second split screen can be kept in a blanking state or a locking state.

And in the third situation, whether the second split screen is kept lighted or not is determined by judging the distance between the face corresponding to the face image and the display side of the second split screen. As an example, the third case may include the following two steps:

and S1, when the acquired environment image comprises a face image, judging whether the distance between the face corresponding to the face image and the display side of the second split screen is smaller than a specified distance.

In step S1, when the acquired environment image includes a face image, measuring a distance between a face corresponding to the face image and a plane on which a display side of the second split screen is located, and then comparing the distance with a specified distance to determine whether the distance between the face corresponding to the face image and the display side of the second split screen is smaller than the specified distance. The implementation manner of the distance measurement may be various, for example, the shortest distance between the face and the plane where the display side of the second split screen is located may be measured by setting a distance sensor on the external folding terminal, and the shortest distance is compared with the preset distance, and the process may refer to related technologies, for example, the two camera modules are used to collect the environment image, and the depth of the face image in the environment image is calculated based on a binocular stereo vision algorithm, and the depth is used as the distance between the face corresponding to the face image and the display side of the second split screen, which is not described herein again in this application embodiment.

According to the embodiment of the application, the distance between the face corresponding to the face image and the display side of the second split screen is determined according to the proportion of the face image in the acquired environment image in the whole image, so that whether the second split screen is kept lighted is judged.

Optionally, step S1 may further include:

and S11, acquiring the area ratio of the face image to the whole image in the acquired environment image.

The step can ensure that the face image in the acquired environment image is the face image of the user using the second split screen, and is not the face image acquired by mistake.

And S12, when the area ratio is larger than the specified ratio, determining that the distance between the face corresponding to the face image and the display side of the second split screen is smaller than the specified distance.

Optionally, the specific ratio may be fifty percent, and when the area of the face image occupies more than fifty percent of the area of the whole image, it may be determined that the distance between the face corresponding to the face image and the display side of the second split screen is less than the specific distance.

And S13, when the area ratio is not larger than the specified ratio, determining that the distance between the face corresponding to the face image and the display side of the second split screen is not smaller than the specified distance.

When the area of the face image accounts for the area of the whole image and is not larger than the specified ratio, it is determined that the distance between the face corresponding to the face image and the display side of the second split screen is not smaller than the specified distance, namely the distance between the face and the display side of the second split screen is relatively far, it can be determined that the user corresponding to the face does not use the second split screen, and the second split screen can be kept turned off at the moment.

And S2, when the distance between the face corresponding to the face image and the display side of the second split screen is smaller than the specified distance, keeping the second split screen lighted.

When the distance between the face corresponding to the face image and the display side of the second split screen is smaller than the specified distance, it can be stated that the user corresponding to the face is using or preparing to use the second split screen, and therefore the second split screen can be kept lighted.

To sum up, according to the control method of the terminal provided in the embodiment of the present application, after the external folding terminal is in the non-expansion state, the first split screen that is triggered to operate in the two split screens is determined, and the first split screen is kept lit, then the environment image of the display side of the second split screen is collected, when the collected environment image does not include a face image, the second split screen is kept off, and when the collected environment image includes a face image, the second split screen is kept lit, so that in the related art, after the two split screens of the external folding terminal are simultaneously lit, a user may only operate one split screen and the other split screen is kept lit all the time, thereby causing the situation of electric quantity waste, and achieving the effect of effectively saving the electric quantity of the terminal.

Fig. 3 is a schematic structural diagram of a control device of a terminal according to an embodiment of the present application, where the control device is used for an external folding terminal, the external folding terminal has a foldable display screen, and when the external folding terminal is folded, a display side of the display screen faces outward, the display screen is divided into two sub-screens according to a preset folding line, and the control device 30 of the terminal may include:

the determining module 301 is configured to determine a first split screen acted by a trigger operation in the two split screens after the external folding terminal is in a non-unfolded state, and keep the first split screen lighted;

the acquisition module 302 is configured to acquire an environment image on a display side of a second split screen, where the second split screen is a split screen of the two split screens except the first split screen;

the first holding module 303 is configured to keep the second split screen off when the acquired environment image does not include a face image;

and the second keeping module 304 is configured to keep the second split screen lit when the acquired environment image includes a face image.

To sum up, the control device of a terminal that this application embodiment provided, after being in the non-expansion state through folding terminal outward, confirm two first branch screens that trigger operation and act on in the branch screen, and keep first branch screen and light, then gather the environmental image that is located the display side of second branch screen, when the environmental image who gathers does not include face image, keep the second branch screen to extinguish, when the environmental image who gathers includes face image, keep the second branch screen to light, solved among the relevant technology, after two branch screens of folding terminal outward are lighted simultaneously, the user probably only can operate one of them branch screen and another branch screen keeps lighting always, thereby lead to the extravagant condition of electric quantity to take place, reached the effect of effective terminal electric quantity of saving.

Optionally, the outer folding terminal is provided with two camera assemblies on the display side of the display screen, and each camera assembly is arranged on one side of each split screen away from the other split screen, and the acquisition module 302 is used for:

and acquiring an environment image on the display side of the second split screen through a camera shooting assembly arranged on one side of the second split screen, which is far away from the first split screen.

Optionally, the acquisition module 302 is further configured to:

detecting whether the outer folding terminal is placed on a placing surface in a preset posture;

when the outer folding terminal is placed on the placing surface in a preset posture, the environment image on the display side of the second split screen is collected.

Optionally, the outer folding terminal includes two opposite surfaces, and four sides perpendicular to both the two surfaces, and the preset posture is: the outer folding terminal is placed on the placing surface through one side surface; alternatively, the outer folding terminal is placed in a posture on the placing surface through both sides.

Optionally, the second holding module 304 is configured to:

when the acquired environment image comprises a face image, identifying the face image;

and when the face image is the face of the specified user, keeping the second split screen to be lightened.

Optionally, the second holding module 304 is further configured to:

when the face image is the face of the designated user, displaying a first user interface on a second split screen;

when the face image is not the face of the designated user, displaying a second user interface on a second split screen; wherein the privacy priority of the first user interface is greater than the privacy priority of the second user interface.

Optionally, as shown in fig. 4, the second holding module 304 includes:

the judging submodule 3041 is configured to, when the acquired environment image includes a face image, judge whether a distance between a face corresponding to the face image and a display side of the second split screen is smaller than a specified distance;

the holding sub-module 3042 is configured to, when the distance between the face corresponding to the face image and the display side of the second split screen is smaller than the specified distance, keep the second split screen lit.

Optionally, the determining submodule 3041 is configured to:

acquiring the area ratio of a face image to an overall image in the acquired environment image;

when the area ratio is larger than the specified ratio, determining that the distance between the face corresponding to the face image and the display side of the second split screen is smaller than the specified distance;

and when the area ratio is not larger than the specified ratio, determining that the distance between the face corresponding to the face image and the display side of the second split screen is not smaller than the specified distance.

Alternatively, the ratio is specified as fifty percent.

Optionally, the determining module 301 is configured to:

keeping the two split screens off after the external folding terminal is in a non-unfolding state;

when a trigger operation for one of the two split screens is detected, the first split screen acted by the trigger operation is determined.

An embodiment of the present application provides a storage medium, where instructions are stored, and when the instructions are executed on a processor of a computer, the instructions enable the processor to execute the control method of the terminal provided in the present application. The storage medium is a computer-readable storage medium, which is a non-volatile storage medium.

Embodiments of the present application further provide a computer program product containing instructions, which, when run on a computer, causes the computer to execute the control method of the terminal according to any one of the embodiments of the present application.

It should be noted that, the method embodiments provided in the embodiments of the present application can be mutually referred to corresponding apparatus embodiments, and the embodiments of the present application do not limit this. The sequence of the steps of the method embodiments provided in the embodiments of the present application can be appropriately adjusted, and the steps can be correspondingly increased or decreased according to the situation, and any method that can be easily conceived by those skilled in the art within the technical scope disclosed in the present application shall be covered by the protection scope of the present application, and therefore, the details are not repeated.

The above description is only exemplary of the present application and should not be taken as limiting, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

In this application, the terms "first," "second," "third," and "fourth" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. The term "plurality" means two or more unless expressly limited otherwise.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims

1. The terminal control method is used for an external folding terminal, the external folding terminal is provided with a foldable display screen, and when the external folding terminal is folded, the display side of the display screen faces outwards; the display screen is divided into two sub-screens according to a preset folding line, and the control method comprises the following steps:

when the acquired environment image comprises a face image, keeping the second split screen lightened;

wherein, when the acquired environment image comprises a face image, keeping the second split screen lighted up, comprising:

when the face image is the face of a designated user, displaying a first user interface on the second split screen, wherein the first user interface comprises information that the privacy correlation with the designated user is greater than a preset threshold value;

when the face image is not the face of the designated user, displaying a second user interface on the second split screen, wherein the second user interface comprises information that the privacy correlation with the designated user is smaller than a preset threshold value; wherein the privacy priority of the first user interface is greater than the privacy priority of the second user interface.

2. The method according to claim 1, wherein the outer folding terminal is provided with two camera assemblies on the display side of the display screen, each camera assembly being provided on a side of each of the split screens remote from the other split screen;

the acquiring of the environment image on the display side of the second split screen includes:

3. The method of claim 1,

and when the outer folding terminal is placed on the placing surface in a preset posture, acquiring an environment image on the display side of the second split screen.

4. The method of claim 3, wherein the outer fold terminal comprises two opposing surfaces, and four sides perpendicular to both of the two surfaces,

the preset posture is as follows: a posture in which the outer folding terminal is placed on the placing face through one of the side faces; alternatively, the outer folding terminal may be placed in a posture on the placing face through both side faces.

5. The method according to any one of claims 1 to 4,

when the acquired environment image comprises a face image, keeping the second split screen lighted, and further comprising:

and when the face image is the face of the appointed user, keeping the second split screen to be lightened.

6. The method according to any one of claims 1 to 4,

when the acquired environment image comprises a face image, judging whether the distance between the face corresponding to the face image and the display side of the second split screen is smaller than a specified distance;

and when the distance between the face corresponding to the face image and the display side of the second split screen is smaller than the specified distance, keeping the second split screen lightened.

7. The method of claim 6,

the judging whether the distance between the face corresponding to the face image and the display side of the second split screen is smaller than a specified distance includes:

when the area ratio is larger than a specified ratio, determining that the distance between the face corresponding to the face image and the display side of the second split screen is smaller than a specified distance;

and when the area ratio is not larger than a specified ratio, determining that the distance between the face corresponding to the face image and the display side of the second split screen is not smaller than a specified distance.

8. The method of claim 1,

after the outer folding terminal is in the non-unfolded state, determining a first split screen acted by a trigger operation in the two split screens includes:

keeping the two split screens off after the outer folding terminal is in a non-unfolding state;

when a trigger operation for one of the two split screens is detected, determining the first split screen acted by the trigger operation.

9. The control device of the terminal is used for externally folding the terminal, wherein the externally folding terminal is provided with a foldable display screen, and when the externally folding terminal is folded, the display side of the display screen faces outwards; the display screen divides into two according to predetermined folding line and divides the screen, controlling means includes:

the second holding module is used for keeping the second split screen to be lightened when the acquired environment image comprises a face image;

wherein the second holding module is configured to: when the acquired environment image comprises a face image, identifying the face image;

10. A terminal is characterized in that the terminal is an external folding terminal, the terminal is provided with a foldable display screen, and when the terminal is folded, the display side of the display screen faces outwards; the display screen divides into two according to predetermined folding line and divides the screen, the terminal includes:

a processor;

a memory for storing executable instructions of the processor;

wherein the processor is configured to:

11. A storage medium having stored therein instructions that, when run on a processor of a computer, enable the processor to execute the control method of any one of claims 1 to 8.