CN111885265A - Screen interface adjusting method and related device - Google Patents
Screen interface adjusting method and related device Download PDFInfo
- Publication number
- CN111885265A CN111885265A CN202010765807.XA CN202010765807A CN111885265A CN 111885265 A CN111885265 A CN 111885265A CN 202010765807 A CN202010765807 A CN 202010765807A CN 111885265 A CN111885265 A CN 111885265A
- Authority
- CN
- China
- Prior art keywords
- screen
- screen interface
- state
- interface state
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W52/00—Power management, e.g. TPC [Transmission Power Control], power saving or power classes
- H04W52/02—Power saving arrangements
- H04W52/0209—Power saving arrangements in terminal devices
- H04W52/0251—Power saving arrangements in terminal devices using monitoring of local events, e.g. events related to user activity
- H04W52/0254—Power saving arrangements in terminal devices using monitoring of local events, e.g. events related to user activity detecting a user operation or a tactile contact or a motion of the device
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Abstract
The embodiment of the application discloses a screen interface adjusting method and a related device, comprising the following steps: acquiring a current body rotation signal of electronic equipment, wherein the screen interface state of interface content displayed in a display screen of the electronic equipment is a first screen interface state, and the screen interface state refers to the relative position state of the interface content relative to the display screen; when the fact that the body rotation signal meets a preset condition is detected, starting the camera; acquiring a scene image in a current viewing range; carrying out face detection and angle calculation on the scene image to obtain an angle value between a face of a user and the electronic equipment; and adjusting the screen interface state of the interface content displayed in the display screen from the first screen interface state to a second screen interface state according to the angle value, and closing the camera. The method and the device are beneficial to avoiding the adjustment of the screen interface state by false triggering.
Description
Technical Field
The present application relates to the field of screen interface adjustment technologies, and in particular, to a screen interface adjustment method and a related apparatus.
Background
In technologies supporting screen interface adjustment, such as a mobile phone and the like, a low-power-consumption camera is mainly used for continuously detecting the rotation direction of a face, when the direction of the face rotates to a threshold value, the display content of a screen is rotated, the display content of the screen is matched with the direction of the face, and a user can conveniently check the screen. However, if the low-power-consumption camera continuously runs in the background, frequent rotation of the screen is easily triggered, the requirement on hardware power consumption is high, the rotation of the screen is frequently triggered, the probability of mistakenly triggering the rotation of the screen is increased, and how to realize the rotation of the intelligent trigger screen is a hot problem which needs to be researched at present.
Disclosure of Invention
The embodiment of the application provides a screen interface adjusting method and a related device, which are beneficial to avoiding the adjustment of the state of a screen interface triggered by mistake.
In a first aspect, an embodiment of the present application provides a screen interface adjusting method, which is applied to an electronic device, where the electronic device includes a camera, and the method includes:
acquiring a current body rotation signal of electronic equipment, wherein the screen interface state of interface content displayed in a display screen of the electronic equipment is a first screen interface state, and the screen interface state refers to the relative position state of the interface content relative to the display screen;
when the fact that the body rotation signal meets a preset condition is detected, starting the camera;
acquiring a scene image in a current viewing range;
carrying out face detection and angle calculation on the scene image to obtain an angle value between a face of a user and the electronic equipment;
and adjusting the screen interface state of the interface content displayed in the display screen from the first screen interface state to a second screen interface state according to the angle value, and closing the camera.
In a second aspect, an embodiment of the present application provides a screen interface adjusting apparatus, which includes an obtaining unit, a start determining unit, a collecting unit, a detecting unit, and an adjusting unit,
the acquisition unit is used for acquiring a current body rotation signal of the electronic equipment, wherein the screen interface state of interface content displayed in a display screen of the electronic equipment is a first screen interface state, and the screen interface state refers to a relative position state of the interface content relative to the display screen;
the starting unit is used for starting the camera when the rotation signal of the camera body is detected to meet a preset condition;
the acquisition unit is used for acquiring a scene image in the current framing range;
the detection unit is used for carrying out face detection and angle calculation on the scene image to obtain an angle value between the face of the user and the electronic equipment;
and the adjusting unit is used for adjusting the screen interface state of the interface content displayed in the display screen from the first screen interface state to a second screen interface state according to the angle value, and closing the camera.
In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing the steps in any of the methods of the first aspect of the embodiment of the present application.
In a fourth aspect, an embodiment of the present application provides a chip, including: and the processor is used for calling and running the computer program from the memory so that the device provided with the chip executes part or all of the steps described in any method of the first aspect of the embodiment of the application.
In a fifth aspect, this application provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program makes a computer perform some or all of the steps as described in any one of the methods of the first aspect of this application.
In a sixth aspect, the present application provides a computer program, wherein the computer program is operable to cause a computer to perform some or all of the steps as described in any of the methods of the first aspect of the embodiments of the present application. The computer program may be a software installation package.
It can be seen that, in the embodiment of the present application, the electronic device first obtains the current body rotation signal of the electronic device, the screen interface state of the interface content displayed in the display screen of the electronic device is a first screen interface state, the screen interface state refers to a relative position state of the interface content with respect to the display screen, secondly, when detecting that the fuselage rotation signal meets the preset conditions, starting the camera, then acquiring the scene image in the current viewing range, and then, face detection and angle calculation are carried out on the scene image to obtain an angle value between the face of the user and the electronic equipment, and finally, and adjusting the screen interface state of the interface content displayed in the display screen from the first screen interface state to a second screen interface state according to the angle value, and closing the camera. The camera is started when the body rotation signal is detected to meet the preset condition, and the camera is closed after the screen interface state is adjusted from the first screen interface state to the second screen interface state, so that the camera does not need to run continuously at the background, frequent triggering of adjustment of the screen interface state is avoided, and power consumption of the electronic equipment is reduced.
Drawings
Reference will now be made in brief to the drawings that are needed in describing embodiments or prior art.
Fig. 1A is a block diagram of an electronic device 10 according to an embodiment of the present disclosure;
fig. 1B is a schematic architecture diagram of a software and hardware system provided with an Android system according to an embodiment of the present application;
fig. 1C is an architecture diagram of an electronic device 10 according to an embodiment of the present application;
fig. 2A is a schematic flowchart of a screen interface adjusting method according to an embodiment of the present disclosure;
fig. 2B is a schematic view of an application scenario of screen interface adjustment according to an embodiment of the present application;
fig. 2C is a schematic view of an application scenario of another screen interface adjustment provided in the embodiment of the present application;
fig. 2D is a schematic diagram of an application scenario for adjusting a screen interface state according to an embodiment of the present application;
FIG. 2E is a schematic diagram of another application scenario for adjusting a screen interface state according to an embodiment of the present application;
FIG. 2F is a schematic diagram of another application scenario for adjusting a screen interface state according to an embodiment of the present application;
FIG. 2G is a schematic diagram of another application scenario for adjusting a screen interface state according to an embodiment of the present application;
fig. 2H is an exemplary diagram of a face detection model provided in an embodiment of the present application;
FIG. 2I is an exemplary diagram of another face detection model provided in an embodiment of the present application;
fig. 2J is a partial diagram of a face detection model according to an embodiment of the present application;
fig. 3 is a block diagram illustrating functional units of a screen interface adjusting apparatus according to an embodiment of the present disclosure;
fig. 4 is a block diagram illustrating functional units of another screen interface adjusting apparatus according to an embodiment of the present disclosure.
Detailed Description
In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
Referring to fig. 1A, a block diagram of an electronic device 10 according to an exemplary embodiment of the present application is shown. The electronic device 10 may be a communication-capable electronic device that may include various wireless communication-capable handheld devices, vehicle-mounted devices, wearable devices, computing devices, or other processing devices connected to a wireless modem, as well as various forms of User Equipment (UE), Mobile Stations (MS), electronic devices (terminal device), and so forth. The electronic device 10 in the present application may include one or more of the following components: a processor 110, a memory 120, and an input-output device 130.
It is to be understood that the processor 110 may be mapped to a System On Chip (SOC) in an actual product, and the processing unit and/or the interface may not be integrated into the processor 110, and the corresponding functions may be implemented by a communication Chip or an electronic component alone. The above-described interfacing relationship between the modules is merely illustrative and does not constitute a unique limitation on the structure of the electronic device 10.
The Memory 120 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). Optionally, the memory 120 includes a non-transitory computer-readable medium. The memory 120 may be used to store instructions, programs, code sets, or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like, and the operating system may be an Android (Android) system (including a system based on Android system depth development), an IOS system developed by apple inc (including a system based on IOS system depth development), or other systems. The stored data area may also store data created during use by the electronic device 10 (e.g., phone books, audio-visual data, chat log data), and the like.
The software system of the electronic device 10 may employ a hierarchical architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The embodiment of the present application exemplifies a software architecture of the electronic device 10 by taking an Android system and an IOS system of a hierarchical architecture as examples.
As shown in fig. 1B, the memory 120 may store a Linux kernel layer 220, a system runtime library layer 240, an application framework layer 260, and an application layer 280, wherein the layers communicate with each other through a software interface, and the Linux kernel layer 220, the system runtime library layer 240, and the application framework layer 260 belong to an operating system space.
The application layer 280 belongs to a user space, and at least one application program runs in the application layer 280, and the application programs may be native application programs carried by an operating system, or third-party application programs developed by third-party developers, and specifically may include application programs such as passwords, eye tracking, cameras, gallery, calendar, call, map, navigation, WLAN, bluetooth, music, video, short messages, and the like.
The application framework layer 260 provides various APIs that may be used by applications that build the application layer, and developers may also build their own applications by using these APIs, such as a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, a message manager, an activity manager, a package manager, and a location manager. The window manager is used for managing window programs. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like. The content provider is used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The view system includes visual controls such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures. The phone manager is used to provide communication functions for the electronic device 10. Such as management of call status (including on, off, etc.). The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and the like. The notification manager enables the application to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a short dwell, and does not require user interaction. Such as a notification manager used to inform download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scroll bar text at the top status bar of the system, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, prompting text information in the status bar, sounding a prompt tone, vibrating the electronic device, flashing an indicator light, etc. The message manager can be used for storing the data of the messages reported by the APPs and processing the data reported by the APPs.
The system runtime library layer 240 provides the main feature support for the Android system through some C/C + + libraries. For example, the SQLite library provides support for a database, the OpenGL/ES library provides support for 3D drawing, the Webkit library provides support for a browser kernel, and the like. Also provided in the system Runtime layer 240 is an Android Runtime library (Android Runtime), which mainly provides some core libraries that can allow developers to write Android applications using the Java language.
The Linux kernel layer 220 provides the underlying drivers for the various hardware of the electronic device 10, such as a display driver, an audio driver, a camera driver, a Bluetooth driver, a Wi-Fi driver, power management, and the like.
It should be understood that the interface display method described in the embodiment of the present application may be applied to an android system, and may also be applied to other operating systems, such as an IOS system, and the interface display method is only described by taking the android system as an example, but is not limited thereto.
In the following, a conventional electronic device will be described in detail with reference to fig. 1C, and it should be understood that the configuration illustrated in the embodiment of the present application is not intended to specifically limit the electronic device 10. In other embodiments of the present application, the electronic device 10 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
An embodiment of the present application provides an electronic device 10, as shown in fig. 1C, the electronic device 10 includes a camera head 100, a camera serial interface decoder 200, an image signal processor 300, a digital signal processor 400, and a camera head 500, the image signal processor 300 includes a lightweight image front end 310 and an image front end 320, where the camera head 100 is connected to the camera serial interface decoder 200, the camera serial interface decoder 200 is connected to the lightweight image front end 310 of the image signal processor 300, and the lightweight image front end 310 is connected to the digital signal processor 400;
the digital signal processor 400 is configured to receive a scene image acquired by the camera 100 through the camera serial interface decoder 200 and the lightweight image front end 310, and call a face detection model and an angle regression model to perform face recognition and angle recognition on image data of the scene image to obtain an angle value between a face of a user and an electronic device, where the image front end 320 is configured to transmit image data acquired by the camera 500 of the electronic device 10, or the image front end 320 is configured to transmit image data of the scene image acquired by the camera 100.
Wherein the camera head 500 is represented in fig. 1B by a dashed box as an optional implementation.
The image data of the scene image may be MIPI RAW image data or YUV image data.
After the image data of the scene image is input into the face detection model, the face matting can be output, and then the image data of the face matting is input into the angle regression model, so that the angle value between the face of the user in the scene image and the electronic equipment can be output. Although the camera 100 transmits the image data of the scene image through the lightweight image front end 310 of the image signal processor 300, the image signal processor 300 does not further process the image data of the scene image, and the image signal processor 300 only processes the image data transmitted through the image front end 320. Also, since the lightweight image front end 310 is only responsible for interfacing inputs and does not do anything else, its power consumption is relatively low relative to prior solutions that enable the image front end 320 to transfer image data (which would require enabling other modules of the image signal processor 300 for processing of the image data).
The camera 100 may be a low power consumption image sensor, for example, a front camera disposed at a front end of a screen of an electronic device, or a rotary camera, and the electronic device implementing the context-aware-based application function through the camera 100 includes at least one of the following:
1. privacy protection, for example, a social application APP receives a new message from a girl friend, a bank sends a wage account new short message, privacy information in the new short message is not expected to be seen by others, and the electronic device can detect that the screen is dark when the eyes of a stranger watch the screen of a mobile phone of a householder through the camera 100.
2. And (3) performing an air-separating operation, namely, a user is cooking, and places a mobile phone beside to check the menu, at this time, an important call is called in, the hand of the user is full of oil stain, the mobile phone is inconvenient to directly operate, and the electronic equipment can detect the air-separating gesture of the user through the camera 100 and execute the operation corresponding to the air-separating gesture.
3. The electronic equipment can detect that a user still watches the screen through the camera 100, and then the automatic screen-off function is not started.
At present, in the screen interface adjusting technology supported by mobile phones and the like, the direction of a face of a user relative to a mobile phone screen is continuously detected through a camera, when the direction of the face rotates to a threshold value, the screen is rotated to be consistent with the direction of the face, but the camera continuously runs at the background of an electronic device, the rotation of the screen is easily and frequently triggered, the power consumption requirement on the electronic device is higher, the camera cannot be started for a long time through the screen interface adjusting method provided by the application, so the power consumption is lower, in addition, the face is deeply learned through a face detection model and an angle regression model, the angle of the current user relative to the electronic device can be effectively judged, and the intelligent adjustment of the screen is realized.
In view of the above problems, an embodiment of the present application provides a method for adjusting a screen interface, which is described in detail below with reference to the accompanying drawings.
Referring to fig. 2A, fig. 2A is a schematic flowchart of a screen interface adjustment method according to an embodiment of the present application, where as shown in the figure, the method includes:
step 201, an electronic device acquires a current body rotation signal, a screen interface state of interface content displayed in a display screen of the electronic device is a first screen interface state, and the screen interface state refers to a relative position state of the interface content relative to the display screen.
As shown in fig. 2B, in general, the camera continuously works in the background, and the angle value between the face of the user and the electronic device is determined by obtaining a scene image, so as to determine whether to adjust the screen interface state, if the angle value is greater than a first preset threshold, the screen interface state is to be adjusted, that is, the position state of the interface content on the screen is adjusted, and if the angle value is not greater than the first preset threshold, the screen interface state is not adjusted, that is, the position state of the interface content on the screen is kept unchanged. The screen interface adjusting method provided by the application, as shown in fig. 2C, the camera is in a closed state by default, a body rotation signal of the electronic device can be detected through the acceleration sensor, when the body rotation signal is acquired, and the body rotation signal is detected to meet a preset condition, the camera is started, at this time, an angle value between a face of a user and the electronic device is acquired through the camera, so that whether the screen interface state needs to be adjusted or not is determined, if the angle value is greater than a first preset threshold value, the screen interface state needs to be adjusted, the camera is closed after the position state of the interface content is adjusted, if the angle value is not greater than the first preset threshold value, the screen interface state is not adjusted, and the camera can be directly closed.
Wherein the body rotation signal includes a current rotation angle of the electronic device body, including rotation of the body in any direction and any angle, such as rotation of the display screen to the right, rotation of the display screen to the left, and vertical turning of the display screen, and the like, and further, the screen interface state of the interface content displayed on the display screen of the electronic device is a first screen interface state, which refers to a relative position state of the interface content corresponding to the display screen, including a conventional landscape screen state and a portrait screen state, as shown in fig. 2D, the first screen interface state may be a portrait screen state, or, as shown in fig. 2E, the first screen interface state may be a landscape screen state, and further, the screen interface state may also include a screen interface state at any angle, for example, when an angle between a human face and the display screen is 30 degrees or any other angle, the display content may be adjusted correspondingly, as shown in fig. 2F, in the case that the screen is rotated and the face is not rotated, the angle between the rotated screen and the face is 30 degrees, and only the screen may be rotated, and the display content of the screen remains in the vertical display state, as shown in fig. 2G, the face is rotated, and in the case that the screen is not rotated, the angle between the rotated face and the screen is 30 degrees, and at this time, the screen does not change, but the display content of the screen may be rotated correspondingly with the rotation of the face. When the electronic equipment is a mobile phone, the screen interface state is a horizontal screen state when the included angle between the horizontal line of the human eyes and the length direction of the body is 0 degree, and the screen interface state is a vertical screen state when the included angle is 90 degrees. In addition, when the included angle between the horizontal line of the human eyes and the length direction of the mobile phone body is a special angle, for example, 45 degrees or 60 degrees, the special angle corresponds to a specific screen interface state, and the specific screen interface state can adapt to the interface content, so that the watching experience of a user can be improved.
Step 202, the electronic device starts the camera when detecting that the body rotation signal meets a preset condition.
The camera can be started when the camera body rotation signal is acquired and the camera body rotation signal is detected to meet the preset condition, so that a scene image is acquired through the camera, the angle between the face of a user and the electronic equipment is detected, and whether the screen needs to be rotated or not is determined.
The first posture and the second posture comprise any posture of the electronic equipment, and the camera can be started after the electronic equipment is detected to be switched from the first posture to the second posture, or the camera is started when the electronic equipment is detected to be switched from the first posture to the second posture, namely in the switching process.
In this possible example, the starting the camera when it is detected that the body rotation signal satisfies a preset condition includes: determining the attitude of the electronic equipment according to the body rotation signal; when the electronic equipment is detected to be switched from a first posture to a second posture, starting the camera; or when the electronic equipment is detected to be in the third posture, starting the camera; the first posture is used for representing a posture of the electronic device before rotation, the third posture is used for representing a posture of the electronic device after rotation, the second posture is any posture in the process that the electronic device rotates from the first posture to the third posture, and the rotation angle of the electronic device when the electronic device rotates from the first posture to the third posture is larger than a second preset threshold value.
Wherein, the current posture of the electronic device can be determined according to the body rotation signal, the posture can be a first posture or a third posture, the first posture is used for representing the posture of the electronic device before rotation, the third posture is used for representing the posture of the electronic device after rotation, the second posture is used for representing an intermediate posture between the first posture and the third posture, and the angle of the electronic device rotation is larger than a second preset threshold value, for example, the second preset threshold value is 45 degrees, and when the angle of the electronic device rotation is larger than 45 degrees, the preset condition is considered to be satisfied. For example, a body rotation signal 0 indicates that the screen is in a horizontal state, a body rotation signal 1 indicates that the screen is in a vertical state, a body rotation signal 2 indicates that the screen is in a right turn state, a body rotation signal 3 indicates that the screen is in a left turn state, a body rotation signal 4 indicates that the screen is in a flip-up state, the camera is activated when the body rotation signal is detected to be switched from 0 to 1, or the camera is activated when the body rotation signal is detected to be switched from 0 to 1 in a middle state,
therefore, in this example, when the body rotation signal is detected to meet the preset condition, the camera is started, the starting time of the camera can be advanced, the camera starts to work in the middle state of obtaining the body rotation signal, and the camera does not wait until the final body rotation signal works, so that the camera can effectively start to work in advance, and the sensitivity of screen interface adjustment is improved.
In this possible example, the electronic device includes a first power consumption state and a second power consumption state, the electronic device having a lower power consumption in the first power consumption state than in the second power consumption state; the starting the camera includes: detecting whether the electronic device is in the first power consumption state; if yes, the camera is started, and a preset power consumption strategy for the electronic equipment is started, wherein the preset power consumption strategy comprises reducing the screen brightness of the display screen and closing background application.
After the camera is started, the power consumption of the electronic equipment is correspondingly increased, at the moment, whether the electronic equipment is in a low power consumption state or not needs to be detected, if yes, in order to reduce the power consumption of the electronic equipment, after the camera is started, a preset power consumption strategy preset by a user can be correspondingly started, after the preset power consumption strategy is started, the power consumption of the electronic equipment can be reduced through reducing the screen brightness of a display screen or closing background application and other modes, and meanwhile, the user can be reminded that the camera is started at the moment through the modes. In the low power consumption state, the power consumption does not exceed a preset power consumption value, for example, not more than 1 watt.
As can be seen, in this example, in order to reduce the power consumption of the electronic device, after the camera is started, the preset power consumption policy may also be started, and in other ways, the power consumption of the electronic device is not significantly increased after the camera is started.
Step 203, the electronic device acquires a scene image in the current viewing range.
The camera can be used for acquiring scene images within a current view finding range, and specific scenes comprise use scenes of various specific applications such as video applications and navigation applications, and scenes such as indoor scenes, outdoor scenes, strong light scenes, normal light scenes and dark light scenes. The scene image includes a face image of a user currently using the electronic device.
And 204, the electronic equipment performs face detection and angle calculation on the scene image to obtain an angle value between the face of the user and the electronic equipment.
The face detection is performed on the scene image, then the angle calculation is performed, the face cutout can be obtained from the scene image, and the angle value between the user and the electronic equipment is determined according to the face cutout. In the specific implementation, a scene image is input into a face detection model, a face cutout in the scene image is output, the face cutout is input into an angle regression model, and an angle value between a user face in the scene image and the electronic equipment is output.
In this possible example, the performing face detection and angle calculation on the scene image to obtain an angle value between a face of a user and the electronic device includes: inputting the scene image into a face detection model, and outputting to obtain a face sectional image; and inputting the face matting into an angle regression model, and outputting to obtain an angle value between the face of the user in the scene image and the electronic equipment.
The face detection model is mainly used for detecting the position of a face in a scene image, the coordinate point of a face frame can be returned, the face frame is framed according to the coordinate point of the face frame, the angle regression model is used for matting the face according to the input face, the angle of the face is output, the face detection model comprises a turning angle, a pitch angle and a yaw angle, after the face detection model detects the face position in the scene image, the face frame is used for matting the face to obtain face matting, the face matting is input into the angle regression model, the face angle is output, the face detection model and the angle regression model are matched for use, so that any scene image with the face of a user is input, and the face angle of the user can be output.
Therefore, in the example, the face detection model and the angle regression model are added, so that the angle between the face of the user in the scene image and the electronic equipment can be accurately detected, and the condition that whether the screen interface state needs to be adjusted is favorably determined.
In this possible example, the method further comprises: and carrying out lightweight processing on the face detection model and the angle regression model.
The face detection model and the angle regression model are both based on deep learning, common models of the face detection model include MTCNN, faceBox, RetinaFace and the like, the electronic equipment can adopt a light-weight face detection model, for example, a backbone network of the RetinaFace is changed into a small model, the number of channels is reduced and the like, and a light-weight RetinaFace is trained for the camera, so that the detection requirement of the electronic equipment can be met, and the power consumption is low. Similarly, the angle regression model can also be trained by using small networks such as mobilene V1 and mobilene V2, the flip angle of the face is output to be used for judging the angle between the face and the electronic device, and the angle is reported to determine whether the screen interface state needs to be adjusted.
The face detection model and the angle regression model can be subjected to optimization testing aiming at various scenes, so that the face detection results under various scenes can reach 96% of detection accuracy, for example, under the conditions that outdoor, indoor, bright light, normal light, dim light not less than 5lux and the like are obtained, and under the condition that a user holds an electronic device by a hand and the distance is 20-70 cm, scene images obtained by a camera are obtained, the face detection model and the angle regression model are trained and deeply learned, and the detection accuracy of the models is improved.
For example, taking human face detection as an example, the Retinaface model uses a 4-layer pyramid structure as shown in fig. 2H, the human face with a size that does not pass through is detected from small to large from P2 to P6, the P6 layer is optional, the model itself is large and cannot be directly used at the mobile phone end, in order to be transplanted to the mobile phone end, the model structure needs to be simplified, first, 3 layers are used in the pyramid structure, and the P2 layer and the P6 layer are removed, as shown in fig. 2I, the block part in fig. 2I is a part 20 in fig. 2H, 20 corresponds to a context module in the Retinaface model, and the block part is reduced to one fourth of the original block part as shown in fig. 2J.
Therefore, in the example, the electronic equipment can better operate and the operation load of the electronic equipment is reduced by performing light weight processing on the face detection model and the angle regression model.
Step 205, the electronic device adjusts the screen interface state of the interface content displayed in the display screen from the first screen interface state to a second screen interface state according to the angle value, and closes the camera.
The method comprises the steps of determining whether the display content in the display screen is adjusted from a first screen interface state to a second screen interface state according to an angle value, wherein the first screen interface state and the second screen interface state can be the same screen interface state or different screen interface states, and after the screen interface state is adjusted from the first screen interface state to the second screen interface state, the camera can be closed.
In this possible example, the adjusting the screen interface state of the interface content displayed in the display screen from the first screen interface state to the second screen interface state according to the angle value and turning off the camera includes: detecting whether the angle value is larger than a first preset threshold value or not; if so, the first screen interface state and the second screen interface state are different screen interface states; and if not, the first screen interface state and the second screen interface state are the same screen interface state.
When the angle value is detected to be smaller than the first preset threshold value, the first screen interface state and the second screen interface state are different screen interface states, the first screen interface state is adjusted to be the second screen interface state, that is, the current screen interface state is changed, for example, the horizontal screen state is changed to be the vertical screen state, when the angle value is detected to be smaller than the first preset threshold value, the first screen interface state and the second screen interface state are the same state, the first screen interface state is adjusted to be the second screen interface state, that is, the current screen interface state is not changed, for example, the current horizontal screen state is maintained, and the first preset threshold value can be set by a user, for example, 45 degrees or 60 degrees.
It can be seen that, in this example, whether to change the current screen interface state of the screen of the electronic device is determined according to the angle value between the face of the user and the electronic device, when the angle value is greater than the first preset threshold, the screen interface state is changed, and when the angle value is less than the first preset threshold, the screen interface state is kept unchanged, so that the user can conveniently check the display content of the display screen.
In this possible example, the scene image is a video scene image; the adjusting the screen interface state of the interface content displayed in the display screen from the first screen interface state to a second screen interface state according to the angle value includes: when the angle value is detected to be larger than a first preset threshold value, adjusting the video picture displayed by the display screen from the horizontal screen display state to the vertical screen display state, or adjusting the video picture displayed by the display screen from the vertical screen display state to the horizontal screen display state.
When the scene image is a video scene image, namely, when a user watches a video scene, when it is detected that the electronic equipment rotates and the rotation signal meets a preset condition, the camera is started to acquire the video scene image, and whether the detection angle value is greater than a preset threshold value or not is detected, if so, the current screen interface state is a landscape screen display state, the current screen interface state is adjusted to a portrait screen display state, or the current screen interface state is a portrait screen display state, the current screen interface state is adjusted to a landscape screen display state.
As can be seen, in this example, in a scene where a user watches a video, if the electronic device rotates and the body rotation signal meets the preset condition, the screen interface state needs to be adjusted in time, so that the user's viewing experience can be improved.
It can be seen that, in this example, the electronic device first obtains a current body rotation signal of the electronic device, a screen interface state of interface content displayed in a display screen of the electronic device is a first screen interface state, where the screen interface state refers to a relative position state of the interface content with respect to the display screen, then, when it is detected that the body rotation signal meets a preset condition, the camera is started, then, a scene image within a current view range is acquired, then, face detection and angle calculation are performed on the scene image to obtain an angle value between a face of a user and the electronic device, and finally, the screen interface state of the interface content displayed in the display screen is adjusted from the first screen interface state to a second screen interface state according to the angle value, and the camera is closed. The camera is started when the body rotation signal is detected to meet the preset condition, and the camera is closed after the screen interface state is adjusted from the first screen interface state to the second screen interface state, so that the camera does not need to run continuously at the background, frequent triggering of adjustment of the screen interface state is avoided, and power consumption of the electronic equipment is reduced.
The embodiment of the application provides a screen interface adjusting device, which can be an electronic device. Specifically, the screen interface adjusting device is used for executing steps executed by the electronic device in the screen interface adjusting method. The screen interface adjusting device provided by the embodiment of the application can comprise modules corresponding to the corresponding steps.
In the embodiment of the present application, the screen interface adjusting device may be divided into the functional modules according to the method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The division of the modules in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.
Fig. 3 shows a schematic diagram of a possible structure of the screen interface adjusting apparatus according to the above embodiment, in a case where each function module is divided according to each function. As shown in fig. 3, the screen interface adjusting apparatus includes an acquiring unit 30, a starting unit 31, a collecting unit 32, a detecting unit 33 and an adjusting unit 34,
the acquiring unit 30 is configured to acquire a current body rotation signal of an electronic device, where a screen interface state of interface content displayed in a display screen of the electronic device is a first screen interface state, and the screen interface state refers to a relative position state of the interface content with respect to the display screen;
the starting unit 31 is configured to start the camera when detecting that the body rotation signal meets a preset condition;
the acquisition unit 32 is configured to acquire a scene image within a current viewing range;
the detection unit 33 is configured to perform face detection and angle calculation on the scene image to obtain an angle value between a face of a user and the electronic device;
the adjusting unit 34 is configured to adjust the screen interface state of the interface content displayed in the display screen from the first screen interface state to a second screen interface state according to the angle value, and close the camera.
In a possible example, in terms of performing face detection and angle calculation on the scene image to obtain an angle value between the face of the user and the electronic device, the detecting unit 33 is specifically configured to: inputting the scene image into a face detection model, and outputting to obtain a face sectional image; and the face matting module is used for inputting the face matting into an angle regression model and outputting to obtain an angle value between the face of the user in the scene image and the electronic equipment.
In a possible example, the detection unit 33 is further configured to perform a weight reduction process on the face detection model and the angle regression model.
In one possible example, in terms of adjusting the screen interface state of the interface content displayed in the display screen from the first screen interface state to the second screen interface state according to the angle value, the adjusting unit 34 is specifically configured to: detecting whether the angle value is larger than a first preset threshold value or not; if so, the first screen interface state and the second screen interface state are different screen interface states; and if not, the first screen interface state and the second screen interface state are the same screen interface state.
In one possible example, the scene image is a video scene image; in the aspect that the screen interface state of the interface content displayed in the display screen is adjusted from the first screen interface state to a second screen interface state according to the angle value, the adjusting unit 34 is specifically configured to: when the angle value is detected to be larger than a first preset threshold value, adjusting the video picture displayed by the display screen from the horizontal screen display state to the vertical screen display state, or adjusting the video picture displayed by the display screen from the vertical screen display state to the horizontal screen display state.
In a possible example, in the aspect of starting the camera when the body rotation signal is detected to meet a preset condition, the starting unit 31 is specifically configured to: determining the attitude of the electronic equipment according to the body rotation signal; when the electronic equipment is detected to be switched from a first posture to a second posture, starting the camera; or when the electronic equipment is detected to be in the third posture, starting the camera; the first posture is used for representing a posture of the electronic device before rotation, the third posture is used for representing a posture of the electronic device after rotation, the second posture is any posture in the process that the electronic device rotates from the first posture to the third posture, and the rotation angle of the electronic device when the electronic device rotates from the first posture to the third posture is larger than a second preset threshold value.
In one possible example, the electronic device includes a first power consumption state and a second power consumption state, the electronic device having a lower power consumption in the first power consumption state than in the second power consumption state; in terms of the starting of the camera, the starting unit 31 is specifically configured to: detecting whether the electronic device is in the first power consumption state; if yes, the camera is started, and a preset power consumption strategy for the electronic equipment is started, wherein the preset power consumption strategy comprises reducing the screen brightness of the display screen and closing background application.
All relevant contents of each step related to the above method embodiment may be referred to the functional description of the corresponding functional module, and are not described herein again.
In the case of using an integrated unit, a schematic structural diagram of the screen interface adjusting device provided in the embodiment of the present application is shown in fig. 4. In fig. 4, the screen interface adjusting apparatus 4 includes: a processing module 40 and a communication module 41. The processing module 40 is used for controlling and managing the actions of the screen interface adjusting device, such as the steps performed by the acquiring unit 30, the starting unit 31, the acquiring unit 32, the detecting unit 33 and the adjusting unit 34, and/or other processes for performing the techniques described herein. The communication module 41 is used to support the interaction between the screen interface adjusting device and other devices. As shown in fig. 4, the screen interface adjusting apparatus may further include a storage module 42, and the storage module 42 is used for storing program codes and data of the screen interface adjusting apparatus, such as the angle value calculated by the detecting unit 32.
The processing module 40 may be a Processor or a controller, and may be, for example, a Central Processing Unit (CPU), a general-purpose Processor, a Digital Signal Processor (DSP), an ASIC, an FPGA or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or perform the various illustrative logical blocks, modules, and circuits described in connection with the disclosure. The processor may also be a combination of computing functions, e.g., comprising one or more microprocessors, DSPs, and microprocessors, among others. The communication module 41 may be a transceiver, an RF circuit or a communication interface, etc. The storage module 42 may be a memory.
All relevant contents of each scene related to the method embodiment may be referred to the functional description of the corresponding functional module, and are not described herein again. The screen interface adjusting device 3 and the screen interface adjusting device 4 can both perform the steps performed by the electronic device in the screen interface adjusting method shown in fig. 2A.
Embodiments of the present application further provide a chip, where the chip includes a processor, configured to call and run a computer program from a memory, so that a device in which the chip is installed performs some or all of the steps described in the electronic device in the above method embodiments.
The present application also provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program makes a computer perform some or all of the steps described in the electronic device in the above method embodiments.
The embodiment of the present application further provides a computer-readable storage medium, where the computer-readable storage medium stores a computer program for electronic data exchange, where the computer program causes a computer to perform some or all of the steps described in the above method embodiment for a network-side device.
Embodiments of the present application further provide a computer program product, where the computer program product includes a computer program operable to cause a computer to perform some or all of the steps described in the electronic device in the above method embodiments. The computer program product may be a software installation package.
The steps of a method or algorithm described in the embodiments of the present application may be implemented in hardware, or may be implemented by a processor executing software instructions. The software instructions may be comprised of corresponding software modules that may be stored in Random Access Memory (RAM), flash Memory, Read Only Memory (ROM), Erasable Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), registers, a hard disk, a removable disk, a compact disc Read only Memory (CD-ROM), or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. Of course, the storage medium may also be integral to the processor. The processor and the storage medium may reside in an ASIC. Additionally, the ASIC may reside in an access network device, a target network device, or a core network device. Of course, the processor and the storage medium may reside as discrete components in an access network device, a target network device, or a core network device.
Those skilled in the art will appreciate that in one or more of the examples described above, the functionality described in the embodiments of the present application may be implemented, in whole or in part, by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the application to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website, computer, server, or data center to another website, computer, server, or data center via wire (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., a floppy Disk, a hard Disk, a magnetic tape), an optical medium (e.g., a Digital Video Disk (DVD)), or a semiconductor medium (e.g., a Solid State Disk (SSD)), among others.
The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the embodiments of the present application in further detail, and it should be understood that the above-mentioned embodiments are only specific embodiments of the present application, and are not intended to limit the scope of the embodiments of the present application, and any modifications, equivalent substitutions, improvements and the like made on the basis of the technical solutions of the embodiments of the present application should be included in the scope of the embodiments of the present application.
Claims (10)
1. A screen interface adjusting method is applied to electronic equipment, the electronic equipment comprises a camera, and the method comprises the following steps:
acquiring a current body rotation signal of electronic equipment, wherein the screen interface state of interface content displayed in a display screen of the electronic equipment is a first screen interface state, and the screen interface state refers to the relative position state of the interface content relative to the display screen;
when the fact that the body rotation signal meets a preset condition is detected, starting the camera;
acquiring a scene image in a current viewing range;
carrying out face detection and angle calculation on the scene image to obtain an angle value between a face of a user and the electronic equipment;
and adjusting the screen interface state of the interface content displayed in the display screen from the first screen interface state to a second screen interface state according to the angle value, and closing the camera.
2. The method of claim 1, wherein the performing face detection and angle calculation on the scene image to obtain an angle value between a face of a user and the electronic device comprises:
inputting the scene image into a face detection model, and outputting to obtain a face sectional image;
and inputting the face matting into an angle regression model, and outputting to obtain an angle value between the face of the user in the scene image and the electronic equipment.
3. The method of claim 2, further comprising:
and carrying out lightweight processing on the face detection model and the angle regression model.
4. The method according to claim 1 or 2, wherein the adjusting the screen interface state of the interface content displayed in the display screen from the first screen interface state to a second screen interface state according to the angle value and turning off the camera comprises:
detecting whether the angle value is larger than a first preset threshold value or not;
if so, the first screen interface state and the second screen interface state are different screen interface states;
and if not, the first screen interface state and the second screen interface state are the same screen interface state.
5. The method according to claim 1 or 2, wherein the scene image is a video scene image; the adjusting the screen interface state of the interface content displayed in the display screen from the first screen interface state to a second screen interface state according to the angle value includes:
when the angle value is detected to be larger than a first preset threshold value, adjusting the video picture displayed by the display screen from the horizontal screen display state to the vertical screen display state, or adjusting the video picture displayed by the display screen from the vertical screen display state to the horizontal screen display state.
6. The method of claim 1, wherein the activating the camera upon detecting that the body rotation signal satisfies a preset condition comprises:
determining the attitude of the electronic equipment according to the body rotation signal;
when the electronic equipment is detected to be switched from a first posture to a second posture, starting the camera; alternatively, the first and second electrodes may be,
when the electronic equipment is detected to be in the third posture, starting the camera; the first posture is used for representing a posture of the electronic device before rotation, the third posture is used for representing a posture of the electronic device after rotation, the second posture is any posture in the process that the electronic device rotates from the first posture to the third posture, and the rotation angle of the electronic device when the electronic device rotates from the first posture to the third posture is larger than a second preset threshold value.
7. The method of claim 1, wherein the electronic device comprises a first power consumption state and a second power consumption state, wherein the electronic device has a lower power consumption in the first power consumption state than in the second power consumption state; the starting the camera includes:
detecting whether the electronic device is in the first power consumption state;
if yes, the camera is started, and a preset power consumption strategy for the electronic equipment is started, wherein the preset power consumption strategy comprises reducing the screen brightness of the display screen and closing background application.
8. A screen interface adjusting device is characterized by being applied to electronic equipment and comprising an acquisition unit, a start determining unit, a collecting unit, a detecting unit and an adjusting unit,
the acquisition unit is used for acquiring a current body rotation signal of the electronic equipment, wherein the screen interface state of interface content displayed in a display screen of the electronic equipment is a first screen interface state, and the screen interface state refers to a relative position state of the interface content relative to the display screen;
the starting unit is used for starting the camera when the rotation signal of the camera body is detected to meet a preset condition;
the acquisition unit is used for acquiring a scene image in the current framing range;
the detection unit is used for carrying out face detection and angle calculation on the scene image to obtain an angle value between the face of the user and the electronic equipment;
and the adjusting unit is used for adjusting the screen interface state of the interface content displayed in the display screen from the first screen interface state to a second screen interface state according to the angle value, and closing the camera.
9. An electronic device comprising a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of any of claims 1-7.
10. A computer-readable storage medium, characterized in that a computer program for electronic data exchange is stored, wherein the computer program causes a computer to perform the method according to any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010765807.XA CN111885265B (en) | 2020-07-31 | 2020-07-31 | Screen interface adjusting method and related device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010765807.XA CN111885265B (en) | 2020-07-31 | 2020-07-31 | Screen interface adjusting method and related device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111885265A true CN111885265A (en) | 2020-11-03 |
| CN111885265B CN111885265B (en) | 2022-06-24 |
Family
ID=73205182
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010765807.XA Active CN111885265B (en) | 2020-07-31 | 2020-07-31 | Screen interface adjusting method and related device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111885265B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112363611A (en) * | 2020-11-27 | 2021-02-12 | Oppo（重庆）智能科技有限公司 | Power consumption adjusting method and device, electronic equipment and readable storage medium |
| CN112363659A (en) * | 2020-11-09 | 2021-02-12 | 平安普惠企业管理有限公司 | APP interface operation method and device, electronic equipment and storage medium |
| CN113190313A (en) * | 2021-04-29 | 2021-07-30 | 北京小米移动软件有限公司 | Display control method and device, electronic equipment and storage medium |
| CN113194165A (en) * | 2021-04-13 | 2021-07-30 | Oppo广东移动通信有限公司 | Method for determining direction of electronic equipment, electronic equipment and readable storage medium |
| CN114285985A (en) * | 2021-08-06 | 2022-04-05 | 海信视像科技股份有限公司 | Method for determining preview direction of camera and display equipment |
| CN115033193A (en) * | 2021-03-08 | 2022-09-09 | 华为技术有限公司 | Screen rotation processing method, screen rotation processing device, screen rotation processing medium and electronic equipment |
| WO2022242704A1 (en) * | 2021-05-19 | 2022-11-24 | 闪耀现实(无锡)科技有限公司 | Method for refreshing screen of head-mounted display device and head-mounted display device |
| WO2023130928A1 (en) * | 2022-01-10 | 2023-07-13 | 荣耀终端有限公司 | Always-on display control method, electronic device and medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101877736A (en) * | 2009-04-30 | 2010-11-03 | 深圳富泰宏精密工业有限公司 | Automatic adjusting system and method for user interface of mobile terminal |
| US20140062860A1 (en) * | 2012-08-28 | 2014-03-06 | Samsung Electronics Co., Ltd. | Smart screen rotation based on user orientation |
| US20140320624A1 (en) * | 2013-04-29 | 2014-10-30 | Hon Hai Precision Industry Co., Ltd. | Electronic device and method for regulating images displayed on display screen |
| CN104375648A (en) * | 2014-11-26 | 2015-02-25 | 三星电子（中国）研发中心 | Wrist type device and using method thereof |
| CN104935823A (en) * | 2015-06-23 | 2015-09-23 | 上海卓易科技股份有限公司 | Method and device for entering shooting status and intelligent terminal |
| CN106125933A (en) * | 2016-06-28 | 2016-11-16 | 维沃移动通信有限公司 | The method of a kind of display interface rotation and mobile terminal |
| US9519769B2 (en) * | 2012-01-09 | 2016-12-13 | Sensible Vision, Inc. | System and method for disabling secure access to an electronic device using detection of a predetermined device orientation |
| CN107102801A (en) * | 2017-03-28 | 2017-08-29 | 北京小米移动软件有限公司 | Terminal screen spinning solution and device |
| CN108614634A (en) * | 2016-12-09 | 2018-10-02 | 北京视联动力国际信息技术有限公司 | A kind of mobile device shows the method and mobile device of screen rotation |
| CN110309813A (en) * | 2019-07-10 | 2019-10-08 | 南京行者易智能交通科技有限公司 | A kind of model training method, detection method, device, mobile end equipment and the server of the human eye state detection based on deep learning |
| CN110647865A (en) * | 2019-09-30 | 2020-01-03 | 腾讯科技（深圳）有限公司 | Face gesture recognition method, device, equipment and storage medium |
-
2020
- 2020-07-31 CN CN202010765807.XA patent/CN111885265B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101877736A (en) * | 2009-04-30 | 2010-11-03 | 深圳富泰宏精密工业有限公司 | Automatic adjusting system and method for user interface of mobile terminal |
| US9519769B2 (en) * | 2012-01-09 | 2016-12-13 | Sensible Vision, Inc. | System and method for disabling secure access to an electronic device using detection of a predetermined device orientation |
| US20140062860A1 (en) * | 2012-08-28 | 2014-03-06 | Samsung Electronics Co., Ltd. | Smart screen rotation based on user orientation |
| US20140320624A1 (en) * | 2013-04-29 | 2014-10-30 | Hon Hai Precision Industry Co., Ltd. | Electronic device and method for regulating images displayed on display screen |
| CN104375648A (en) * | 2014-11-26 | 2015-02-25 | 三星电子（中国）研发中心 | Wrist type device and using method thereof |
| CN104935823A (en) * | 2015-06-23 | 2015-09-23 | 上海卓易科技股份有限公司 | Method and device for entering shooting status and intelligent terminal |
| CN106125933A (en) * | 2016-06-28 | 2016-11-16 | 维沃移动通信有限公司 | The method of a kind of display interface rotation and mobile terminal |
| CN108614634A (en) * | 2016-12-09 | 2018-10-02 | 北京视联动力国际信息技术有限公司 | A kind of mobile device shows the method and mobile device of screen rotation |
| CN107102801A (en) * | 2017-03-28 | 2017-08-29 | 北京小米移动软件有限公司 | Terminal screen spinning solution and device |
| CN110309813A (en) * | 2019-07-10 | 2019-10-08 | 南京行者易智能交通科技有限公司 | A kind of model training method, detection method, device, mobile end equipment and the server of the human eye state detection based on deep learning |
| CN110647865A (en) * | 2019-09-30 | 2020-01-03 | 腾讯科技（深圳）有限公司 | Face gesture recognition method, device, equipment and storage medium |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112363659A (en) * | 2020-11-09 | 2021-02-12 | 平安普惠企业管理有限公司 | APP interface operation method and device, electronic equipment and storage medium |
| CN112363611A (en) * | 2020-11-27 | 2021-02-12 | Oppo（重庆）智能科技有限公司 | Power consumption adjusting method and device, electronic equipment and readable storage medium |
| CN112363611B (en) * | 2020-11-27 | 2023-11-10 | Oppo（重庆）智能科技有限公司 | Power consumption adjustment method and device, electronic equipment and readable storage medium |
| CN115033193A (en) * | 2021-03-08 | 2022-09-09 | 华为技术有限公司 | Screen rotation processing method, screen rotation processing device, screen rotation processing medium and electronic equipment |
| CN113194165A (en) * | 2021-04-13 | 2021-07-30 | Oppo广东移动通信有限公司 | Method for determining direction of electronic equipment, electronic equipment and readable storage medium |
| CN113190313A (en) * | 2021-04-29 | 2021-07-30 | 北京小米移动软件有限公司 | Display control method and device, electronic equipment and storage medium |
| WO2022242704A1 (en) * | 2021-05-19 | 2022-11-24 | 闪耀现实(无锡)科技有限公司 | Method for refreshing screen of head-mounted display device and head-mounted display device |
| CN114285985A (en) * | 2021-08-06 | 2022-04-05 | 海信视像科技股份有限公司 | Method for determining preview direction of camera and display equipment |
| CN114285985B (en) * | 2021-08-06 | 2023-08-22 | 海信视像科技股份有限公司 | Method for determining preview direction of camera and display device |
| WO2023130928A1 (en) * | 2022-01-10 | 2023-07-13 | 荣耀终端有限公司 | Always-on display control method, electronic device and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111885265B (en) | 2022-06-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111885265B (en) | Screen interface adjusting method and related device | |
| CN114397979B (en) | Application display method and electronic equipment | |
| CN110910872B (en) | Voice interaction method and device | |
| US11914446B2 (en) | Electronic device control method and apparatus, and electronic device | |
| CN110839096B (en) | Touch method of equipment with folding screen and folding screen equipment | |
| CN111782102B (en) | Window display method and related device | |
| CN110543289B (en) | Method for controlling volume and electronic equipment | |
| US20160247034A1 (en) | Method and apparatus for measuring the quality of an image | |
| WO2021000841A1 (en) | Method for generating user profile photo, and electronic device | |
| CN111866393B (en) | Display control method, device and storage medium | |
| CN108965981B (en) | Video playing method and device, storage medium and electronic equipment | |
| CN110673783B (en) | Touch control method and electronic equipment | |
| CN111694475B (en) | Terminal control method and device and terminal equipment | |
| CN113132526B (en) | Page drawing method and related device | |
| WO2019019818A1 (en) | Method and apparatus for accelerating black screen gesture processing, storage medium, and mobile terminal | |
| CN112835495B (en) | Method and device for opening application program and terminal equipment | |
| WO2022161119A1 (en) | Display method and electronic device | |
| US20230359283A1 (en) | Method for gesture control and related devices | |
| CN111880714B (en) | Page control method and related device | |
| WO2023130990A1 (en) | Image processing method and apparatus, device, storage medium, and program product | |
| CN111813321A (en) | Gesture control method and related device | |
| US11785101B1 (en) | Allowance of application communication based on context | |
| CN116185245B (en) | Page display method and electronic equipment | |
| CN115933952B (en) | Touch sampling rate adjusting method and related device | |
| CN116688494B (en) | Method and electronic device for generating game prediction frame |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |