WO2020187170A1 - 一种保护电子设备可活动部分的方法及电子设备 - Google Patents
一种保护电子设备可活动部分的方法及电子设备 Download PDFInfo
- Publication number
- WO2020187170A1 WO2020187170A1 PCT/CN2020/079380 CN2020079380W WO2020187170A1 WO 2020187170 A1 WO2020187170 A1 WO 2020187170A1 CN 2020079380 W CN2020079380 W CN 2020079380W WO 2020187170 A1 WO2020187170 A1 WO 2020187170A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- electronic device
- data
- mobile phone
- sensor
- acceleration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0338—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of limited linear or angular displacement of an operating part of the device from a neutral position, e.g. isotonic or isometric joysticks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
- H04M1/0264—Details of the structure or mounting of specific components for a camera module assembly
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
- H04M1/0266—Details of the structure or mounting of specific components for a display module assembly
- H04M1/0268—Details of the structure or mounting of specific components for a display module assembly including a flexible display panel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
Definitions
- the embodiments of the present application relate to the field of electronic technology, and in particular, to a method for protecting movable parts of an electronic device and an electronic device.
- the purpose of the embodiments of the present application includes proposing a method for protecting movable parts of electronic equipment and electronic equipment, which are used to accurately identify that the electronic equipment is in a state of complete weightlessness when the movable part of the electronic equipment is in an unsafe position. Predict the imminent strong vibration and collision of electronic equipment, and take corresponding measures to reduce the possibility and degree of damage to the movable part of the electronic equipment when experiencing strong vibration and collision.
- a method for protecting movable parts of an electronic device including:
- the electronic device According to the sensor data acquired multiple times within a preset time, it is determined that the electronic device is in a state of complete weightlessness.
- the movable part of the electronic device is moved to the second position.
- the sensor data acquired multiple times within the preset time can reduce the false recognition rate of recognizing a normal use scene as a completely weightless state compared to the sensor data acquired in a single time.
- a possible implementation manner of the first aspect is that the acquiring sensor data of the electronic device includes data of an acceleration sensor and data of a gyroscope sensor.
- a possible implementation of the first aspect is that the determining that the electronic device is in a completely weightless state according to the sensor data acquired multiple times within a preset time includes:
- the electronic device is in a completely weightless state according to the data of the acceleration sensor and the data of the gyroscope sensor acquired multiple times within the preset time.
- a possible implementation of the first aspect is to determine that the electronic device is in a state of complete weightlessness based on the data of the acceleration sensor and the data of the gyroscope sensor acquired multiple times within a preset time through a neural network, including:
- noise interference can be reduced, and the influence of the rotation movement of the electronic device on the recognition rate of the complete weightless state can be reduced, and it can also be adapted to more complex dangerous scenes including the complete weightless state, and the response time can be shortened.
- a possible implementation of the first aspect is that before the method determines that the electronic device is in a state of complete weightlessness based on the acceleration sensor data and the gyroscope sensor data acquired multiple times within a preset time through the neural network, Including: According to the data of the gyroscope sensor acquired multiple times within the preset time, the calculated angular velocity is not zero.
- a possible implementation of the first aspect is that the acquiring sensor data of the electronic device includes data of an acceleration sensor.
- a possible implementation of the first aspect is that the determining that the electronic device is in a state of complete weightlessness based on the sensor data acquired multiple times within a preset time includes:
- the acceleration of the electronic device is calculated according to the data of the acceleration sensor acquired multiple times within the preset time, which is equal to the acceleration of gravity, and it is determined that the electronic device is in a state of complete weightlessness.
- a possible implementation of the first aspect is that the acquiring sensor data of the electronic device includes data of a gyroscope sensor.
- a possible implementation of the first aspect is that the determining that the electronic device is in a state of complete weightlessness based on the sensor data acquired multiple times within a preset time includes:
- the angular velocity of the electronic device is calculated according to the data of the gyroscope sensor acquired multiple times within the preset time, and the angular velocity is the same value greater than zero, and the electronic device is determined to be in a state of complete weightlessness.
- a possible implementation of the first aspect is that the movable part of the electronic device includes a camera module.
- a possible implementation of the first aspect is that the camera module is a telescopic camera, the telescopic camera is in the first position when it extends out of the housing of the electronic device, and the telescopic camera is in the first position when it is retracted in the housing of the electronic device. Two positions.
- a possible implementation of the first aspect is that the movable part of the electronic device includes a movable display screen.
- a possible implementation of the first aspect is that after the electronic device is in a state of complete weightlessness, the speed at which the movable part of the electronic device is moved to the second position is the first speed, and the electronic device is in a state of complete weightlessness Previously, the speed at which the movable part of the electronic device is moved to the second position is the second speed, and the first speed is greater than the second speed.
- an electronic device in a second aspect, includes a touch screen, a memory, one or more processors, multiple application programs, and one or more programs; wherein the one or more programs are stored in the memory; It is characterized in that, when the one or more processors execute the one or more programs, the electronic device implements the first aspect, or any one of the implementation methods of the first aspect above.
- a computer-readable storage medium includes instructions that, when the instructions run on an electronic device, cause the electronic device to execute the first aspect or any one of the implementation methods of the first aspect above.
- a computer program product containing instructions, when the computer program product runs on an electronic device, causes the electronic device to execute the first aspect or any one of the implementation methods of the first aspect above.
- FIG. 1 is an outline view of a camera module of a mobile phone according to an embodiment of the application after being extended.
- FIG 2 is an outline view of the mobile phone 100 after the camera module is retracted into the housing 103 according to an embodiment of the application.
- FIG. 3 is a schematic structural diagram of a mobile phone 100 according to an embodiment of the application.
- FIG. 4 is a schematic diagram of a telescopic camera according to an embodiment of the application.
- FIG. 5 is a schematic diagram of a sliding cover camera according to an embodiment of the application.
- FIG. 6 is a schematic diagram of a flip-type camera according to an embodiment of the application.
- Fig. 7 is a software structure block diagram of a mobile phone 100 according to an embodiment of the present application.
- FIG. 8 is a method for protecting movable parts of the mobile phone 100 according to an embodiment of the present application.
- Fig. 9 is a schematic diagram of a mechanical part of a telescopic camera according to an embodiment of the present application.
- FIG. 10 is a schematic diagram of a mechanical part of a folding screen according to an embodiment of the present application.
- FIG. 11 is a method for protecting movable parts of the mobile phone 100 according to an embodiment of the present application.
- Fig. 12(a) and Fig. 12(b) are schematic diagrams of two mobile phones 100 in a state of complete weightlessness according to an embodiment of the present application.
- FIG. 13(a) and FIG. 13(b) are schematic diagrams of two types of mobile phones 100 in a common usage scenario state according to an embodiment of the present application.
- FIG. 14 is a schematic diagram of a mobile phone 100 in a dropped state according to an embodiment of the present application.
- FIG. 15 is a method for protecting movable parts of the mobile phone 100 through a neural network according to an embodiment of the present application.
- FIG. 16 is an architecture diagram of a possible neural network according to an embodiment of the present application.
- the electronic device in the embodiments of the present application takes a mobile phone as an example.
- the electronic device can also be a smart watch, a tablet computer, a personal digital assistant (PDA), a point of sales (POS), Vehicle-mounted computers, desktop computers, notebook computers, smart TVs, etc., which are not limited in the embodiments of the present application.
- PDA personal digital assistant
- POS point of sales
- Vehicle-mounted computers desktop computers, notebook computers, smart TVs, etc., which are not limited in the embodiments of the present application.
- FIG. 1 is an outline view of a camera module of a mobile phone according to an embodiment of the application after being extended.
- the mobile phone 100 includes a camera module 101, a display screen 120 and a housing 103.
- the camera module 101 is a telescopic camera module, which can be used as the front camera module of the mobile phone 100 and is arranged on the top of the casing 103, thereby saving the area occupied by the front camera module on the side of the mobile phone 100 containing the display 120 To increase the screen-to-body ratio.
- the housing 103 may include the middle frame and the front and rear panels of the mobile phone 100, and may be made of different materials, such as aluminum alloy, glass, etc., and may contain a buffer layer inside to reduce the possibility of damage or reduce the possibility of damage in the case of strong vibration and collision of the mobile phone 100 The degree of damage.
- the camera module 101 extends out of the housing 103 in FIG. 1, and is in an unsafe position at this time.
- the camera module 101 may be arranged on the side or bottom of the mobile phone 100.
- FIG 2 is an outline view of the mobile phone 100 after the camera module is retracted into the housing 103 according to an embodiment of the present application. It can be seen that after the camera module 101 is retracted, the mobile phone 100 is integrated, simple and beautiful, and the camera module 101 is in an unsafe position.
- FIG. 3 shows a schematic diagram of the structure of the mobile phone 100.
- the internal structure of the mobile phone 100 is described in detail below.
- the mobile phone 100 may include a processor 110, a display screen 120, a communication module 130, a memory 140, a sensor module 150 and a camera module 101.
- the sensor module 150 may include an acceleration sensor 151 and a gyroscope sensor 152.
- the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the mobile phone 100.
- the mobile phone 100 may include more or fewer components than shown, or combine certain components, or split certain components, or arrange different components.
- the illustrated components can be implemented in hardware, software, or a combination of software and hardware.
- the processor 110 may include one or more processing units.
- the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU), etc.
- AP application processor
- modem processor modem processor
- GPU graphics processing unit
- image signal processor image signal processor
- ISP image signal processor
- controller video codec
- digital signal processor digital signal processor
- DSP digital signal processor
- NPU neural-network processing unit
- the different processing units may be independent devices or integrated in one or more processors.
- the display screen 120 is used to display images, videos, etc., and can be set on the front panel of the mobile phone 100.
- the display screen 120 includes a display panel.
- the display panel can adopt liquid crystal display (LCD), organic light-emitting diode (OLED), active-matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode).
- LCD liquid crystal display
- OLED organic light-emitting diode
- active-matrix organic light-emitting diode active-matrix organic light-emitting diode
- AMOLED flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc.
- the mobile phone 100 may include one or more display screens 120.
- the communication module 130 may provide a wireless communication solution including 2G/3G/4G/5G and the like applied on the mobile phone 100.
- the communication module 130 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc.
- the communication module 130 may receive electromagnetic waves through an antenna, perform processing such as filtering and amplifying the received electromagnetic waves, and transmit them to a modem processor for demodulation.
- the communication module 130 can also amplify the signal modulated by the modem processor, and convert it into electromagnetic waves for radiation through the antenna.
- at least part of the functional modules of the communication module 130 may be provided in the processor 110.
- at least part of the functional modules of the communication module 130 and at least part of the modules of the processor 110 may be provided in the same device.
- the memory 140 may be used to store computer executable program code, where the executable program code includes instructions.
- the memory 140 may include a program storage area and a data storage area.
- the storage program area can store an operating system, at least one application program (such as a sound playback function, an image playback function, etc.) required by at least one function.
- the data storage area can store data (such as audio data, phone book, etc.) created during the use of the mobile phone 100.
- the memory 140 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.
- the processor 110 executes various functional applications and data processing of the mobile phone 100 by running instructions stored in the memory 140 and/or instructions stored in a memory provided in the processor.
- the acceleration sensor 151 can detect the magnitude of the acceleration of the mobile phone 100 in various directions (generally three-axis). When the mobile phone 100 is stationary, the magnitude of acceleration in all directions remains stable, and the magnitude of the acceleration is the acceleration of gravity, so that the magnitude and direction of gravity can be inferred.
- the gyroscope sensor 152 may be used to determine the movement posture of the mobile phone 100.
- the angular velocity of the mobile phone 100 around three axes ie, the X axis, the Y axis, and the Z axis
- the gyroscope sensor 152 can be determined by the gyroscope sensor 152, where the X axis, the Y axis and the Z axis are perpendicular to each other, such as As shown in FIG. 1, the gyroscope sensor 152 is arranged in the mobile phone 100 according to the positive direction of the Z axis, which is the direction the mobile phone screen faces.
- the camera module 101 is used to capture still images or videos.
- the object generates an optical image through the lens and projects it to the photosensitive element.
- the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
- CMOS complementary metal-oxide-semiconductor
- the photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
- ISP outputs digital image signals to DSP for processing.
- DSP converts digital image signals into standard RGB, YUV and other formats.
- the mobile phone 100 may include one or more camera modules 101.
- the camera module 101 may be a front camera module.
- some front camera modules are made into other forms, as shown in Figure 4 retractable (and Figure 1 and Figure 2 The telescopic type is the same), the sliding type of FIG. 5, the folding type of FIG. 6, and so on. In these forms, the camera module 101 becomes the movable part of the mobile phone 100.
- the movable part of the mobile phone 100 refers to a spatial change such as expansion, sliding, folding, etc., according to expected settings.
- the mobile phone 100 may include one or more movable parts.
- the relative position of the movable part with respect to the other parts of the mobile phone 100 except the movable part will change, as described in the embodiment of the present application
- the position of the movable part refers to this relative position. It should be noted that, in some embodiments, in other parts of the mobile phone 100 except for the movable part, some areas may also occur at the same time after the movable part of the mobile phone 100 undergoes expansion, sliding, folding and other expected spatial changes. Changes, such as a three-sided folding screen mobile phone. When the first screen changes, the second screen may also change simultaneously.
- the position of the movable part of the mobile phone 100 described in the embodiment of this application is referred to It only selects the other parts of the mobile phone 100 except for the movable part.
- the movable part of the mobile phone 100 undergoes an expected change, there is no change.
- the position of the movable part includes a safe position and a non-safe position.
- the safe position is relative to the non-safe position.
- the positions of the camera module 101 shown in Figure 1, Figure 4 B, Figure 5 B, and Figure 6 B are all safe positions. It can be seen that the camera module 101 in the safe position is more integrated with the mobile phone 100
- the camera module 101 shown in Figure 2, Figure 4A, Figure 5A, and Figure 6A is in a non-safe position.
- the structure of the complete housing 103 can bear more mobile
- the contact area with the housing 103 may be larger, which is more secure and firm. Therefore, when the camera module 101 is in the safe position, the mobile phone 100 is subjected to strong vibrations. In a collision, the camera module 101 and the connection between the camera module 101 and the housing 103 will bear less drop impact force, and the possibility and degree of damage to the movable part of the camera module 101 will be smaller than the camera module 101 in an unsafe position.
- the software system of the mobile phone 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.
- the embodiment of the present application takes the layered Android system as an example to illustrate the software structure of the mobile phone 100.
- Fig. 7 is a software structure block diagram of a mobile phone 100 according to an embodiment of the present application.
- the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Communication between layers through software interface.
- the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.
- the application layer can include a series of application packages.
- the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.
- the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
- the application framework layer includes some predefined functions.
- the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, and a notification manager.
- the window manager is used to manage window programs.
- the window manager can obtain the size of the display, determine whether there is a status bar, lock the screen, take a screenshot, etc.
- the content provider is used to store and retrieve data and make these data accessible to applications.
- the data may include video, image, audio, phone calls made and received, browsing history and bookmarks, phone book, etc.
- the view system includes visual controls, such as controls that display text and controls that display pictures.
- the view system can be used to build applications.
- the display interface can be composed of one or more views.
- a display interface that includes a short message notification icon may include a view that displays text and a view that displays pictures.
- the phone manager is used to provide the communication function of the mobile phone 100. For example, the management of the call status (including connecting, hanging up, etc.).
- the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc.
- the notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and it can disappear automatically after a short stay without user interaction.
- the notification manager is used to notify the download completion, message reminder, etc.
- the notification manager can also be a notification that appears in the status bar at the top of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window.
- the status bar prompts text messages, sounds prompts, vibrates, flashes lights, etc.
- Android Runtime includes core libraries and virtual machines. Android runtime is responsible for the scheduling and management of the Android system.
- the core library consists of two parts: one part is the function functions that the java language needs to call, and the other part is the core library of Android.
- the application layer and the application framework layer run in a virtual machine.
- the virtual machine executes the java files of the application layer and the application framework layer as binary files.
- the virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
- the system library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), three-dimensional graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.
- the surface manager is used to manage the display subsystem and provides a combination of 2D and 3D layers for multiple applications.
- the media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files.
- the media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
- the 3D graphics processing library is used to realize 3D graphics drawing, image rendering, synthesis, and layer processing.
- the 2D graphics engine is a drawing engine for 2D drawing.
- the hardware abstraction layer provides a standard interface to display the hardware functions of the device to the higher-level application framework layer.
- the hardware abstraction layer contains multiple library modules, each of which implements an interface for a specific type of hardware component, such as Bluetooth library module, camera library module, sensor library module, etc.
- the Android system When the application framework layer requires access to the device hardware, the Android system will load the corresponding library module for the hardware component.
- the kernel layer is the layer between hardware and software.
- the kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
- Step 101 Obtain sensor data of the mobile phone 100 for detecting a state of complete weightlessness.
- some movable parts of the mobile phone 100 can be controlled by a driver to move between a non-safe position and a safe position. Only after the movable part of the mobile phone 100 is controlled to enter the non-safe position, the sensor data of the mobile phone 100 can be acquired and executed. Next steps.
- the driver controls the telescopic camera 101 to extend out of the fuselage.
- the telescopic camera 101 is in a non-secure position, start to acquire the sensor data of the mobile phone 100 and perform subsequent steps, for example, other applications
- Programs such as real-time communication applications, during video chat, will also call the camera driver to make the telescopic camera 101 extend out of the fuselage.
- the telescopic camera 101 is in a non-secure position, and it starts to acquire the sensor data of the mobile phone 100 and execute the follow-up step.
- some movable parts of the mobile phone 100 can not only be controlled by the driver to enter the safe position from the non-safe position, but also can be moved between the non-safe position and the safe position by external force.
- the mobile phone 100 can be moved through the sensor (for example, The magnetometer senses that the movable part is in an unsafe position and starts to acquire sensor data of the mobile phone 100 and perform subsequent steps.
- the movable part can be moved manually by sliding a slide camera.
- the movable part of the mobile phone 100 can be controlled by the driver to move between the non-safe position and the safe position.
- the execution of acquiring the sensor data of the mobile phone 100 and performing the subsequent steps can be terminated.
- a sensor such as a magnetometer
- the execution of acquiring the sensor data of the mobile phone 100 and the subsequent steps are terminated.
- the sensor data of the mobile phone 100 and the subsequent steps are executed, which can reduce the waste of computing resources of the processor 110 and reduce the power consumption.
- the telescopic camera 101 before acquiring the sensor data of the mobile phone 100, it is possible to first detect whether the movable part of the telescopic camera 101 is still in an unsafe position, and if the telescopic camera 101 is not in an unsafe position, stop the complete weightless state detection.
- the sensor When acquiring sensor data, the sensor may be an acceleration sensor 151, a gyroscope sensor 152, etc., and a more detailed solution will be described in the following specific application embodiments.
- Step 102 Determine that the mobile phone 100 is in a completely weightless state according to the sensor data acquired multiple times within a preset time.
- Step 103 When the mobile phone 100 is determined to be in a state of complete weightlessness, move the movable part of the mobile phone 100 from an unsafe position to a safe position.
- the retractable camera module 101 is used as the movable part of the mobile phone 100.
- the mobile phone 100 When the mobile phone 100 is in state A, the movable part of the camera module 101 is in an unsafe position, and when the mobile phone 100 is in the state B, the movable part of the camera module 101 is In the safe mode, when the mobile phone 100 is determined to be in a state of complete weightlessness, the mobile phone 100 provides pulses to the stepping motor 105 to rotate the stepping motor 105, driving the gear 106 to rotate, thereby driving the movable part of the camera module 101 to move from the non-safe position To a safe location.
- the foldable display screen 107 As shown in Figure 10, the foldable display screen 107, as the movable part of the mobile phone 100, is a movable display screen that is opened and closed by a stepping motor driving a gear 106 and a rotating shaft 108.
- a stepping motor driving a gear 106 and a rotating shaft 108.
- the mobile phone 100 When the mobile phone 100 is in state A, it can be moved Part of the foldable display screen 107 is in a non-safe position.
- the movable part of the foldable display screen 107 is in a safe mode.
- the mobile phone 100 When the mobile phone 100 is determined to be in a state of complete weightlessness, the mobile phone 100 provides the stepping motor 105 The pulse causes the stepping motor 105 to rotate and drives the gear 106 to rotate, thereby driving the rotating shaft 108, so that the movable part of the foldable display screen 107 moves from the non-safe position to the safe position.
- the movable part when the mobile phone 100 is determined to be in a state of complete weightlessness, can be moved from a safe position to an unsafe position in a faster manner than when it is not in a state of complete weightlessness, thereby shortening the safety response.
- the mobile phone 100 in Figure 9 and Figure 10 can provide higher frequency pulses to the stepping motor 105, making the stepping motor 105 output faster, so that the movable part of the camera module 101 returns to a safe position faster .
- step 101 to step 103 Two specific application embodiments are introduced below, and the parts that are the same as the method of step 101 to step 103 will not be repeated.
- Step 201 Obtain sensor data of the mobile phone 100 for detecting a state of complete weightlessness.
- the sensor data may be acquired at a fixed frequency, and the acquired data may be processed by the processor 110 for calculation, and the processing result may be stored in the memory 140.
- the setting of the fixed frequency may be determined according to The length of the minimum data queue for complete weightlessness detection and the requirements for detection response time, while also taking into account the power consumption and the occupation of the processor 110 resources.
- the fixed frequency for acquiring sensor data can be 100 Hz.
- the response time can be estimated to be about 20 milliseconds by multiplying the acquisition period by the queue length.
- all or part of the acquired sensor data can also be saved in the memory 140 together with the processing result.
- the senor can be an acceleration sensor 151, which can output acceleration data in three directions perpendicular to each other.
- the acceleration in all directions remains stable, and the acceleration is the gravitational acceleration. , Which can infer the magnitude and direction of gravity.
- the senor may be a gyroscope sensor 152, and the gyroscope sensor 152 may output angular velocity data in three directions perpendicular to each other.
- the acquired data of the gyroscope sensor 152 is actually output.
- the theoretical value of the angular velocity of the mobile phone 100 is calculated to be 0.
- the acceleration calculated from the acceleration data in the three-axis directions is a fixed value.
- sensor data can also be acquired through software-based sensors.
- Software-based sensors refer to hardware-based sensors simulated by software.
- the Android application framework layer allows applications to access multiple types of sensors.
- Some sensors are hardware-based, and some are software-based.
- Hardware-based sensors are physical components built into mobile phones or tablet devices. They are obtained by directly measuring specific environmental attributes (such as acceleration, geomagnetic field strength, or angle changes) Data, for example, the acceleration data is directly obtained by the acceleration sensor 151, while the software-based sensor is not a physical device. It obtains its data from one or more hardware-based sensors and then processes the result output by software, sometimes called a virtual sensor or Synthetic sensors, for example, linear acceleration sensors and gravity sensors are common software-based sensors.
- the preliminary screening condition may be that the magnitude of the acceleration is less than half of the magnitude of the gravity acceleration.
- Step 202 Determine whether the mobile phone 100 is in a completely weightless state according to whether the sensor data acquired multiple times within a preset time meets the preset conditions.
- the preset condition may be that it is calculated based on the acquired acceleration sensor 151 data that the acceleration characteristic of the mobile phone 100 meets the complete weightless state, that is, the acceleration sensor data acquired multiple times within the preset time meets the complete weightless state. It is determined that the mobile phone 100 is in a completely weightless state.
- the acquired acceleration sensor 151 data meets the characteristics of a complete weightlessness state, and may include the acceleration of the mobile phone 100 calculated by the acceleration sensor 151 data equal to the acceleration of gravity, that is, the mobile phone is calculated based on the acceleration sensor data acquired multiple times within a preset time If the acceleration of 100 is equal to the acceleration of gravity, it is determined that the mobile phone 100 is in a completely weightless state.
- each axis of the X, Y, and Z axis outputs The acceleration data is 0.
- whether the data of the acceleration sensor 151 meets the characteristics of complete weightlessness can also be determined by combining the historical data of the previous acceleration sensor 151 or other sensors.
- the direction of the gravity acceleration of the mobile phone 100 is first determined according to the historical data, and then according to The acceleration sensor 151 data is calculated to obtain the component of acceleration in the direction of the gravitational acceleration. If the component is equal to the gravitational acceleration, the acceleration sensor 151 data conforms to the characteristics of a complete weightless state.
- the preset condition may also be that the acquired data of the gyroscope sensor 152 calculates that the angular velocity of the mobile phone 100 is a fixed value greater than zero and the direction does not change, that is, it may be acquired multiple times within a preset time.
- the data of the gyroscope sensor calculates that the angular velocity of the mobile phone 100 is the same value greater than zero, and it is determined that the mobile phone 100 is in a completely weightless state.
- the mobile phone 100 will be affected by external forces other than gravity, and it is difficult to maintain a fixed angular speed rotation. In most cases of daily use, the mobile phone 100 is only in complete condition without external forces other than gravity.
- the angular velocity calculated from the data of the gyroscope sensor 152 in this embodiment of the application should be a fixed value greater than zero, which can be used as a A preset condition for judging the state of complete weightlessness, that is, the angular velocity calculated from the data of the gyroscope sensor 152 acquired multiple times within the preset time is a fixed value greater than zero and the direction is unchanged, and the judgment is The mobile phone 100 is in a completely weightless state.
- the preset conditions are "equal to gravitational acceleration", "a fixed value greater than zero", etc. In the implementation, it can fluctuate within a certain range.
- the preset condition can be that the acceleration calculated by the acquired three-axis acceleration data of the acceleration sensor 151 is less than 0.1, and the unit is meter per second.
- the preset condition can be For the acquired data of the gyroscope sensor 152, it is calculated that the angular velocity of the mobile phone 100 is a fixed value greater than 0.2, the amplitude of fluctuation may be less than 0.1, the unit is radians per second, and the range of direction changes in space is less than 0.1 degrees.
- the preset time may be 20 milliseconds.
- 20 times of acceleration sensor 151 data acquired at a frequency of 100 Hz the calculated acceleration is all 0, that is, the actual mobile phone 100
- the acceleration is equal to the gravitational acceleration; for another example, in some embodiments, the data of the gyroscope sensor 152 acquired 20 consecutive times (that is, for 20 milliseconds) at a frequency of 100 Hz calculates that the angular velocity of the mobile phone 100 is greater than zero and the direction remains unchanged The fixed value.
- the sensor data may meet the preset conditions.
- the human hand moves or swings in various directions. Setting the time limit can reduce the possibility of misjudgment as complete weightlessness in normal use and reduce the probability of misrecognition.
- the sensor data acquired within the preset time may have a small percentage of abnormal values that do not meet the preset conditions. For example, when collecting at a frequency of 100 Hz, 19 of the 20 consecutive times meet the preset conditions, but There is a numerical anomaly. For example, 19 out of 20 consecutive times, the calculated acceleration from the accelerometer 151 is 0, but in the fifth acquisition, the calculated acceleration is 3.13 meters per second squared. This may be due to the interference of environmental noise and other factors, or it may be the scene shown in Figure 14, where the mobile phone 100 is completely weightless from time T1, and when it falls to time T2, it rubs against the table 104. In a short period of time, the state of complete weightlessness is not met, and then it continues to fall to T3 time. Therefore, for safety priority considerations, a small number of abnormal values that do not meet the preset conditions can be ignored, and only the obtained data meets the preset conditions. The mode of the condition determines that the mobile phone 100 is in a completely weightless state.
- different acquired sensor data can be acquired by acquiring sensor data, and among sensor data acquired within a preset time, at least one sensor data that meets the preset condition each time the sensor data is acquired can determine that the mobile phone 100 is complete.
- Weightlessness for example, collected at a frequency of 100 Hz for 20 consecutive times, among which the data of the acceleration sensor 151 and the data of the gyroscope sensor 152 are acquired in a single time. As long as one of the data meets the preset condition, it can be determined that the mobile phone 100 is completely weightless State, thereby increasing the reliability of the detection of the mobile phone 100's complete weightlessness state.
- the acquired sensor data it is determined whether the acquired sensor data meets the preset conditions, wherein the sensor data can be equivalently replaced.
- the acquired acceleration sensor 151 data can be used to determine whether the acquired sensor data meets the complete weightless state, which can be replaced by
- the linear acceleration sensor is used to determine whether the mobile phone 100 has acceleration other than the gravitational acceleration. This is because the linear acceleration sensor is a software-based sensor whose data comes from the acceleration sensor 151, and part of the data can also be processed by the sensor For example, calculation of acceleration, conversion of coordinates, etc., should fall within the protection scope of the claims of the embodiments of the present application.
- Step 203 After the mobile phone 100 is determined to be in a state of complete weightlessness, move the movable part of the mobile phone 100 from an unsafe position to a safe position.
- the mobile phone 100 when the movable part of the mobile phone 100 is in a non-safe position, the mobile phone 100 performs complete weightlessness detection by acquiring sensor data. According to whether the data meets the preset conditions for a preset time, it is determined that the mobile phone 100 is in Complete weightlessness, and move the movable part of the mobile phone 100 to a safe position in time to reduce the possibility and degree of damage to the movable part of the mobile phone 100 that may be impacted by strong vibration or fall, and reduce the damage to the normal use scene The probability of misrecognition.
- FIG. 15 is a method for protecting movable parts of a mobile phone 100 based on a neural network.
- the parts similar to the embodiment of the first application will not be repeated here. You can refer to the embodiment of the first application:
- Step 301 Obtain sensor data of the mobile phone 100 for detecting a complete weightlessness state.
- acquiring sensor data of the mobile phone 100 may include data of the acceleration sensor 151 and data of the gyroscope sensor 152.
- the processing of the obtained sensor data is to calculate the acceleration based on the data of the acceleration sensor 151, calculate the angular velocity based on the data of the gyroscope sensor 152, and save the processing result, the angular velocity and acceleration, and further processing
- the result can also include Z-axis acceleration data in the data of the acceleration sensor 151
- Step 302 Determine whether the mobile phone 100 is in a state of complete weightlessness based on the sensor data acquired multiple times within a preset time through the neural network.
- the neural network refers to artificial neural network (Artificial Neural Network, or ANN), which abstracts the human brain neuron network from the perspective of information processing, establishes a certain simple model, and forms different networks according to different connection methods .
- artificial neural network Artificial Neural Network, or ANN
- a neural network is a computing model, which is composed of a large number of nodes (or neurons) interconnected. Each node represents a specific output function, called an activation function. Each connection between two nodes represents a weighted value for the signal passing through the connection, called the weight, which is equivalent to the memory of an artificial neural network.
- the output of the network varies according to the connection method of the network, the weight value and the activation function.
- the network itself is usually an approximation of a certain algorithm or function in nature, or it may be an expression of a logic strategy.
- the research work of artificial neural networks has been deepened and great progress has been made. It has successfully solved many problems in the fields of pattern recognition, intelligent robots, automatic control, predictive estimation, biology, medicine, and economics. Practical problems that modern computers are difficult to solve show good intelligence.
- the neural network can use a BPNN backward propagation neural network, and use the output feedback combined with the gradient descent method to realize the nonlinear mapping of input and output.
- the input layer of the neural network may be the preprocessed value of the sensor data acquired multiple times within a preset time, for example, the data of the acceleration sensor 151 and the data of the gyroscope angular velocity 152 obtained each time are calculated.
- the reason for choosing the Z-axis acceleration data is that due to the mobile phone structure and the installation position of the acceleration sensor in the mobile phone, the X, Y, and Z three-axis torques are different, resulting in a large difference in the three-axis data characteristics of the sensor.
- the characteristics of the X and Y axis are more obvious.
- the data input dimension can be reduced, the model complexity can be reduced, and the conversion of the data from the original sensor data to the preprocessing result can be omitted, so that the learning direction of the neural network can be focused on the judgment of the processing result to the complete weightless state. , To reduce the burden of neural networks.
- the neural network may include two hidden layers, hidden layer 1, hidden layer 2, the activation function used by the hidden layer may be tanh, and the output layer of the neural network may be sigmoid.
- the acceleration and angular velocity calculated from the acquired sensor data are input to the neural network, and the neural network determines whether the mobile phone 100 is in a state of complete weightlessness according to the input sensor data .
- step 301 is continued to obtain updated sensor data of the mobile phone 100.
- the neural network can collect data of the specific user for training when the specific user uses the mobile phone 100, which can make the determination of the complete weightlessness of the mobile phone 100 more suitable for the usage habits of the specific user, so as to reduce the possibility of misjudgment.
- pre-screening can be performed based on the sensor data acquired multiple times for a certain period of time to determine whether to pass the neural network.
- the angular velocity can be calculated based on the data of the gyroscope sensor 152 to determine whether the mobile phone 100 has an angular velocity. Stable rotation within a certain threshold:
- the complete weightlessness can be determined through the neural network
- the method in the first embodiment of the application can be used to determine whether the mobile phone 100 is in a state of complete weightlessness, which can effectively reduce the computational complexity of the neural network and achieve better performance and power consumption.
- the neural network method can reduce the influence of sensor device noise, environmental noise and other noise on the state of mobile phone 100;
- the data output by the gyroscope sensor 152 may have complex fluctuations, even if it passes
- the way of setting the threshold is limited, and the effect of removing noise and reducing the false positive rate is also relatively limited.
- the data of the acceleration sensor 151 will also be affected.
- the acceleration sensor 151 not only changes at T2 when it is bumped at T2 while falling.
- the neural network can more accurately identify the gravity characteristics and determine the complete weightlessness of the mobile phone 100;
- the mobile phone 100 can be trained to recognize more complex scenes. For example, it can be combined with the sensor data before the mobile phone 100 enters the state of complete weightlessness. After the mobile phone 100 enters the state of complete weightlessness, it can be determined that the mobile phone 100 is included More complex dangerous scenes in a state of complete weightlessness, such as a fall scene as shown in FIG. 14, or a scene such as a mobile phone 100 slipping from the user's hand before the fall, shortens the response time for determining whether the mobile phone 100 is in a state of complete weightlessness.
- More complex dangerous scenes in a state of complete weightlessness such as a fall scene as shown in FIG. 14, or a scene such as a mobile phone 100 slipping from the user's hand before the fall, shortens the response time for determining whether the mobile phone 100 is in a state of complete weightlessness.
- Step 303 When the mobile phone 100 is determined to be in a state of complete weightlessness, move the movable part of the electronic device 100 from an unsafe position to a safe position.
- the above-mentioned second application embodiment provides a more accurate method for judging the complete weightlessness of the mobile phone 100 through the use of a neural network, so as to make timely operations to protect the movable parts of the mobile phone 100 and reduce the reliability of the mobile phone 100.
- the computer software product can be stored in a storage medium, such as read-only memory (English: read-only memory, ROM)/RAM, magnetic disk, An optical disc, etc., includes a number of instructions to enable a computer device (which may be a personal computer, a server, or a network communication device such as a router) to execute the method described in each embodiment of the application or some parts of the embodiment.
- a computer device which may be a personal computer, a server, or a network communication device such as a router
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Environmental & Geological Engineering (AREA)
- Computer Networks & Wireless Communication (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Telephone Function (AREA)
Abstract
本申请实施例公开了一种保护电子设备可活动部分的方法及电子设备,在电子设备的可活动部分处于非安全位置时,根据预设时间内多次获取的传感器数据,识别出电子设备处于完全失重状态,从而使电子设备的可活动部分移动至安全位置,在强烈震动碰撞保护电子设备可活动部分。
Description
本申请要求在2019年3月19日提交中国国家知识产权局、申请号为201910209157.8、发明名称为“一种保护电子设备可活动部分的方法及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请实施例涉及电子技术领域,尤其涉及一种保护电子设备可活动部分的方法及电子设备。
随着电子技术的发展,出于便携性、美观等目的,一些电子设备装设有可活动部分,如全面屏手机上的可伸缩、翻折或滑动的摄像头模块,或者柔性屏手机中可折叠的部分屏幕等,但是,当这些电子设备的可活动部分处于非安全位置时,在经受强烈震动碰撞时更容易造成损坏,本领域技术人员致力于更准确地预测电子设备是否即将发生强烈震动碰撞。
发明内容
本申请实施例的目的包括提出一种保护电子设备可活动部分的方法及电子设备,用于在电子设备的可活动部分处于非安全位置时,通过准确地识别出电子设备处于完全失重状态,来预测电子设备即将发生强烈震动碰撞,并采取相应措施,减少电子设备的可活动部分在经历强烈震动碰撞时所发生损坏的可能性及损坏的程度。
上述目的将通过独立权利要求中的特征来达成。其他目的和进一步的实现方式在从属权利要求、说明书和附图中体现。
第一方面,提供一种保护电子设备的可活动部分的方法,包括:
在所述电子设备的可活动部分处于第一位置时,获取电子设备的传感器数据,所述传感器数据与确定所述电子设备是否处于完全失重状态有关;
根据预设时间内多次获取的所述传感器数据确定电子设备处于完全失重状态。
将所述电子设备的可活动部分移动至第二位置。
这样通过预设时间内多次获取的所述传感器数据,相对于单次获取的所述传感器数据,可以降低将正常使用场景的识别为完全失重状态的误识别率。
第一方面的一种可能实现方式是,所述获取电子设备的传感器数据包括,加速度传感器的数据和陀螺仪传感器的数据。
第一方面的一种可能实现方式是,所述根据预设时间内多次获取的所述传感器数据确定电子设备为完全失重状态,包括:
通过神经网络,根据预设时间内多次获取的加速度传感器的数据和陀螺仪传感器的数据确定电子设备为完全失重状态。
第一方面的一种可能实现方式是,通过神经网络,根据预设时间内多次获取的加速度传感器的数据和陀螺仪传感器的数据确定电子设备为完全失重状态,包括:
根据预设时间内多次获取的加速度传感器的数据和陀螺仪传感器的数据,得到电子设备的加速度、角速度和Z轴加速度;
通过神经网络,根据所述得到电子设备的加速度、角速度和Z轴加速度,确定电子设备为完全失重状态。
通过这样的方式,可以减少受到噪声干扰,并且降低电子设备的转动运动对完全失重状态识别率的影响,还可以适应包括完全失重状态的更加复杂的危险场景,缩短响应时间。
第一方面的一种可能实现方式是,在所述通过神经网络,根据预设时间内多次获取的加速度传感器的数据和陀螺仪传感器的数据确定电子设备为完全失重状态之前,所述方法还包括:根据预设时间内多次获取的陀螺仪传感器的数据,所计算得到的角速度均不为零。
这样,可以有效降低神经网络的运算量。
第一方面的一种可能实现方式是,所述获取电子设备的传感器数据,包括加速度传感器的数据。
第一方面的一种可能实现方式是,所述根据预设时间内多次获取的所述传感器数据确定电子设备处于完全失重状态,包括:
根据预设时间内多次获取的加速度传感器的数据计算出电子设备的加速度,均等于重力加速度,确定电子设备处于完全失重状态。
第一方面的一种可能实现方式是,所述获取电子设备的传感器数据,包括陀螺仪传感器的数据。
第一方面的一种可能实现方式是,所述根据预设时间内多次获取的所述传感器数据确定电子设备处于完全失重状态,包括:
根据预设时间内多次获取的陀螺仪传感器的数据计算出电子设备的角速度,均为相同的大于零的值,确定电子设备处于完全失重状态。
第一方面的一种可能实现方式是,所述电子设备的可活动部分包括摄像头模块。
第一方面的一种可能实现方式是,所述摄像头模块是伸缩式摄像头,伸缩式摄像头伸出到电子设备的壳体外时处于第一位置,伸缩式摄像头收缩在电子设备的壳体内时处于第二位置。
第一方面的一种可能实现方式是,所述电子设备的可活动部分包括可活动的显示屏。
第一方面的一种可能实现方式是,所述电子设备处于完全失重状态后,将所述电子设备的可活动部分移动至第二位置的速度为第一速度,所述电子设备处于完全失重状态前,将所述电子设备的可活动部分移动至第二位置的速度为第二速度,所述第一速度大于所述第二速度。
第二方面,一种电子设备,包括触摸屏,存储器,一个或多个处理器,多个应用程序,以及一个或多个程序;其中所述一个或多个程序被存储在所述存储器中;其特征在于,所述一个或多个处理器在执行所述一个或多个程序时,使得所述电子设备实现第一方面,或以上第一方面的任意一种实现方式的方法。
第三方面,一种计算机可读存储介质,包括指令,当所述指令在电子设备上运行时,使得所述电子设备执行第一方面,或以上第一方面的任意一种实现方式的方法。
第四方面,一种包含指令的计算机程序产品,当所述计算机程序产品在电子设备上运行时,使得所述电子设备执行第一方面,或以上第一方面的任意一种实现方式的方法。
图1为本申请实施例一种手机的摄像头模块伸出后的外形图。
图2为本申请实施例一种摄像头模块缩回壳体103之后的手机100外形图。
图3为本申请实施例一种手机100的结构示意图。
图4为本申请实施例一种伸缩式摄像头示意图。
图5为本申请实施例一种滑盖式摄像头示意图。
图6为本申请实施例一种翻盖式摄像头示意图。
图7是本申请实施例的一种手机100的软件结构框图。
图8是本申请实施例的一种保护手机100可活动部分的方法。
图9是本申请实施例的一种伸缩式摄像头的机械部分示意图。
图10是本申请实施例的一种折叠屏幕的机械部分示意图。
图11是本申请实施例的一种保护手机100可活动部分的方法。
图12(a)、图12(b)是本申请实施例的两种手机100处于完全失重状态时的示意图。
图13(a)、图13(b)是本申请实施例的两种手机100处于常见使用场景状态时的示意图。
图14是本申请实施例的一种手机100跌落状态的示意图。
图15是本申请实施例的一种通过神经网络保护手机100可活动部分的方法。
图16是本申请实施例的一种可能的神经网络的架构图。
下面提出几种保护电子设备可活动部分的方法。
需要说明的是,本申请实施例中的电子设备以手机为例,电子设备还可以是智能手表、平板电脑、个人数字助理(personal digital assistant,PDA)、销售终端(point of sales,POS)、车载电脑、台式电脑、笔记本电脑、智能电视等,本申请实施例对此不做限定。
图1为本申请实施例一种手机的摄像头模块伸出后的外形图。
手机100包括摄像头模块101、显示屏120和壳体103。
摄像头模块101是一种伸缩式摄像头模块,可作为手机100的前置摄像头模块,设置于壳体103顶部,从而可以节省手机100含有显示屏120一侧上原本由前置摄像头模块所占用的面积,增大屏占比。
壳体103可以包括手机100的中框和前后面板,可以由不同材质构成,如铝合金、玻璃等,内部可以含有缓冲层,用于在手机100的强烈震动碰撞的降低损坏的可能性或减少损坏的程度。
摄像头模块101作为手机100的可活动部分,在图1时伸出壳体103,此时处于非安全位置。
在一些实施例中,摄像头模块101可以设置于手机100的侧部或者底部。
图2是本申请实施例一种摄像头模块缩回壳体103之后的手机100外形图,可见摄像头模块101缩回后,手机100整体性强,简洁美观,此时摄像头模块101处于非安全位置。
图3示出了手机100的结构示意图,下面详细介绍一种手机100的内部结构。
手机100可以包括处理器110,显示屏120,通信模块130,存储器140,传感器模块150和摄像头模块101。其中,传感器模块150可以包括加速度传感器151和陀螺仪传感器152。
可以理解的是,本申请实施例示意的结构并不构成对手机100的具体限定。在本申请另一些实施例中,手机100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
显示屏120用于显示图像,视频等,可设置于手机100的前面板。显示屏120包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot light emitting diodes,QLED)等。在一些实施例中,手机100可以包括一个或多个显示屏120。
通信模块130可以提供应用在手机100上的包括2G/3G/4G/5G等无线通信的解决方案。通信模块130可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。通信模块130可以通过天线接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。通信模块130还可以对经调制解调处理器调制后的信号放大,通过天线转为电磁波辐射出去。在一些实施例中,通信模块130的至少部分功能模块可以被设置于处理器110中。在一些实施例中,通信模块130的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
存储器140可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。存储器140可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储手机100使用过程中所创建的数据(比如音频数据,电话本等)等。此外,存储器140可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。处理器110通过运行存储在存储器140的指令,和/或存储在设置于处理器中的存储器的指令,执行手机100的各种功能应用以及数据处理。
加速度传感器151可检测手机100在各个方向上(一般为三轴)加速度的大小。当手机100静止时,其各个方向上的加速度大小保持稳定,加速度大小为重力加速度,从而可推测出重力的大小及方向。
陀螺仪传感器152可以用于确定手机100的运动姿态。在一些实施例中,可以通过陀螺仪传感器152确定手机100围绕三个轴(即,X轴,Y轴和Z轴)的角速度,其中X轴,Y轴和Z轴之间两两垂直,如图1所示,陀螺仪传感器152按照Z轴正方向为手机屏幕朝向的方向, 设置于手机100之内。
摄像头模块101用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例中,手机100可以包括一个或多个摄像头模块101。
摄像头模块101可以是前置摄像头模块,在现有技术中,为了提升手机100前面板的屏占比,一些前置摄像头模块做成了其他形式,如图4伸缩式(与图1和图2的伸缩式相同)、图5滑盖式、图6翻折式等等,这些形式中,摄像头模块101成为了手机100的可活动部分。
手机100的可活动部分是指可以按照预期设定进行空间上的变化,如伸缩、滑动、翻折等,手机100可以包含一个或多个可活动部分。
手机100的可活动部分通过伸缩、滑动、翻折等预期的空间变化后,可活动部分对于手机100除了可活动部分之外的其他部分的相对位置会发生改变,而本申请实施例中所述的可活动部分的位置,都是指这种相对位置。需要说明的是,一些实施例中,手机100除了可活动部分之外的其他部分中,可能有部分区域在手机100的可活动部分通过伸缩、滑动、翻折等预期的空间变化后也同时发生变化,例如三面折叠屏手机,其第一面屏在变化时,第二面屏可能也在同步发生变化,所以为了清楚起见,本申请实施例所描述的手机100的可活动部分的位置的参照物,只选取手机100除了可活动部分之外的其他部分中,在手机100的可活动部分进行预期的变化时,没有发生变化的部分。
可活动部分的位置包括安全位置和非安全位置,其中,安全位置相对于非安全位置,在手机100在受到强烈震动碰撞,手机100的可活动部分或者对于手机100其他部分发生损坏的可能性和程度都更小。举例说明,图1、图4的B、图5的B、图6的B中所示的摄像头模块101的位置都属于安全位置,可以看出处于安全位置的摄像头模块101与手机100更具整体性,而图2、图4的A、图5的A、图6的A中所示的摄像头模块101所处位置为非安全位置,这是由于完整的壳体103的结构可以承担比可活动部分更大的冲击,同时可活动部分摄像头模块101处于安全位置时与壳体103的接触面积也可能更大,从而更加安全牢固,所以摄像头模块101处于安全位置时,在手机100在受到强烈震动碰撞,摄像头模块101以及摄像头模块101与壳体103连接处会承担能更少的跌落冲击力,可活动部分摄像头模块101受到损坏的可能性和程度都会摄像头模块101处于非安全位置比更小。
手机100的软件系统可以采用分层架构,事件驱动架构,微核架构,微服务架构,或云架构。本申请实施例以分层架构的Android系统为例,示例性说明手机100的软件结构。
图7是本申请实施例的一种手机100的软件结构框图。
分层架构将软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,将Android系统分为四层,从上至下分别为应用程序层,应用程序框架层,安卓运行时(Android runtime)和系统库,以及内核层。
应用程序层可以包括一系列应用程序包。
如图7所示,应用程序包可以包括相机,图库,日历,通话,地图,导航,WLAN,蓝牙,音乐,视频,短信息等应用程序。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。
如图7所示,应用程序框架层可以包括窗口管理器,内容提供器,视图系统,电话管理器,资源管理器,通知管理器等。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小,判断是否有状态栏,锁定屏幕,截取屏幕等。
内容提供器用来存放和获取数据,并使这些数据可以被应用程序访问。所述数据可以包括视频,图像,音频,拨打和接听的电话,浏览历史和书签,电话簿等。
视图系统包括可视控件,例如显示文字的控件,显示图片的控件等。视图系统可用于构建应用程序。显示界面可以由一个或多个视图组成的。例如,包括短信通知图标的显示界面,可以包括显示文字的视图以及显示图片的视图。
电话管理器用于提供手机100的通信功能。例如通话状态的管理(包括接通,挂断等)。
资源管理器为应用程序提供各种资源,比如本地化字符串,图标,图片,布局文件,视频文件等等。
通知管理器使应用程序可以在状态栏中显示通知信息,可以用于传达告知类型的消息,可以短暂停留后自动消失,无需用户交互。比如通知管理器被用于告知下载完成,消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知,例如后台运行的应用程序的通知,还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息,发出提示音,振动,指示灯闪烁等。
Android Runtime包括核心库和虚拟机。Android runtime负责安卓系统的调度和管理。
核心库包含两部分:一部分是java语言需要调用的功能函数,另一部分是安卓的核心库。
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理,堆栈管理,线程管理,安全和异常的管理,以及垃圾回收等功能。
系统库可以包括多个功能模块。例如:表面管理器(surface manager),媒体库(Media Libraries),三维图形处理库(例如:OpenGL ES),2D图形引擎(例如:SGL)等。
表面管理器用于对显示子系统进行管理,并且为多个应用程序提供了2D和3D图层的融合。
媒体库支持多种常用的音频,视频格式回放和录制,以及静态图像文件等。媒体库可以支持多种音视频编码格式,例如:MPEG4,H.264,MP3,AAC,AMR,JPG,PNG等。
三维图形处理库用于实现三维图形绘图,图像渲染,合成,和图层处理等。
2D图形引擎是2D绘图的绘图引擎。
硬件抽象层提供标准界面,向更高级别的应用程序框架层显示设备硬件功能。硬件抽象层包含多个库模块,其中每个模块都为特定类型的硬件组件实现一个界面,例如蓝牙库模块,摄像头库模块,传感器库模块等。当应用程序框架层要求访问设备硬件时,Android系统将为该硬件组件加载对应的库模块。
内核层是硬件和软件之间的层。内核层至少包含显示驱动,摄像头驱动,音频驱动,传感器驱动。
通过上述对手机100硬件、软件框架的介绍,为实现本申请实施例实现提供了运行基础,下面通过具体方法介绍具体的手机100如何在受到强烈震动碰撞保护可活动部分。
如图8,提出一种通过检测完全失重状态的保护手机100可活动部分的方法:
步骤101、获取手机100的用于检测完全失重状态的传感器数据。
在一些实施例中,一些手机100可活动部分可以由驱动程序控制在非安全位置和安全位置之间移动,当控制手机100可活动部分进入非安全位置后才开始获取手机100的传感器数据及执行后续步骤。
例如,打开前置相机应用,由驱动程序控制伸缩式摄像头101伸出机身后,此时伸缩式摄像头101处于非安全位置,启动获取手机100的传感器数据及执行后续步骤,再例如,其他应用程序例如实时通讯应用,在进行视频聊天时,也会调用摄像头驱动程序,使得伸缩式摄像头101伸出机身,此时伸缩式摄像头101处于非安全位置,开始获取手机100的传感器数据及执行后续步骤。
在另一些实施例中,一些手机100可活动部分不仅可以由驱动程序控制从非安全位置进入安全位置,还可以由外力作用在非安全位置和安全位置之间移动,手机100可以通过传感器(例如磁力计)感知到可活动部分处于非安全位置,开始获取手机100的传感器数据及执行后续步骤,例如,图5可以由用户手动滑动来移动的可活动部分滑盖式摄像头。
类似的,手机100可活动部分可以由驱动程序控制在非安全位置和安全位置之间移动,当控制手机100可活动部分进入安全位置时,终止执行获取手机100的传感器数据及执行后续步骤,可选的,由传感器(例如磁力计)感测到手机100的可活动部分回到安全位置后,再终止执行获取手机100的传感器数据及执行后续步骤。
上述实施例,只在手机100的可活动部分处于非安全位置时,才获取手机100的传感器数据及执行后续步骤,这样可以减少处理器110计算资源的浪费,降低功耗。
可选的,在获取手机100的传感器数据之前,可以先检测可活动部分伸缩式摄像头101是否仍处于非安全位置,若伸缩式摄像头101未处于非安全位置,则停止完全失重状态检测。
在一些实施例中,在获取手机100的传感器数据及执行后续步骤时,若手机100的可活动部分伸缩式摄像头101回到安全位置,则停止获取手机100的传感器数据及执行后续步骤,例如,相机应用的关闭、结束视频聊天或者外部机械导致伸缩式摄像头101回到安全位置。
获取传感器数据时,传感器可以是加速度传感器151和陀螺仪传感器152等,更详细的方案将在下述具体申请实施例中进行描述。
步骤102、根据预设时间内多次获取的传感器数据判定手机100为完全失重状态。
通过在预设时间内多次获取传感器数据,根据过程数据进行分析,相比较单次获取传感器数据进行判断,可以更加准确地判定手机100的完全失重状态,具体原因和过程将在下述具体申请实施例中进行描述。
步骤103、当手机100被判定为处于完全失重状态后,将手机100的可活动部分从非安全位置移动至安全位置。
如图9所示,伸缩式摄像头模块101作为手机100可活动部分,当手机100为状态A时,可活动部分摄像头模块101处于非安全位置,手机100为状态B时,可活动部分摄像头模块101处于安全模式,当手机100被判定为处于完全失重状态后,手机100给步进电机105提供脉冲使得步进电机105转动,带动齿轮106转动,从而驱动可活动部分摄像头模块101从非安全位置移动至安全位置。
如图10所示,可折叠显示屏107作为手机100可活动部分,是一种由步进电机驱动齿轮106和转轴108来控制开合的活动显示屏,当手机100为状态A时,可活动部分可折叠显示屏107处于非安全位置,手机100为状态B时,可活动部分可折叠显示屏107处于安全模式,当手机100被判定为处于完全失重状态后,手机100给步进电机105提供脉冲使得步进电机105转动,带动齿轮106转动,从而驱动转轴108,使得可活动部分可折叠显示屏107从非安全位置移动至安全位置。
需要说明的是,本申请实施例中的附图中,标号一致用于示意同一类型,例如图9和图10中齿轮106,不代表其规格和数量一致,其他地方不再赘述。
在一些实施例中,当手机100被判定为处于完全失重状态后,可以通过相对于未处于完全失重状态时更加快速的方式使可活动部分从安全位置移动至非安全位置,从而可以缩短安全响应时间,例如图9、图10中手机100可以给步进电机105提供更高频率的脉冲,使得步进电机105输出的转速更快,从而使得可活动部分摄像头模块101更快的回到安全位置。
下面介绍两种具体的申请实施例,其中与步骤101至步骤103方法相同的部分不再赘述。
第一申请实施例:
如图11所示的一种保护手机100可活动部分的方法:
步骤201、获取手机100的用于检测完全失重状态的传感器数据。
在一些实施例中,可以按照固定频率获取传感器数据,并将得到的数据,经过处理器110的计算处理,并将处理结果保存到存储器140中,其中,对于固定频率的设定,可以根据满足完全失重状态检测的最低数据队列的长度和检测响应时间的要求,同时也可以兼顾功耗和对处理器110的资源的占用,可选的,获取传感器数据的固定频率可以为100赫兹,当队列长度为20时,此时可以根据获取周期乘以队列长度推算出响应时间约为20毫秒。
可选的,所获取的传感器数据的全部或部分数据也可以与处理结果一同保存到存储器140中。
在一些实施例中,传感器可以为加速度传感器151,加速度传感器151可以输出互相垂直的三轴方向上的加速度数据,当手机100静止时,其各个方向上的加速度大小保持稳定,加速度大小为重力加速度,从而可推测出重力的大小及方向。
在一些实施例中,传感器可以为陀螺仪传感器152,陀螺仪传感器152可以输出互相垂直的三轴方向上的角速度数据,当手机100没有任何旋转时,获取的陀螺仪传感器152的据实际输出数据计算得到手机100的角速度理论值为0,当手机100存在旋转时,且当手机100处于完全失重状态时,三轴方向上的加速度数据计算得到的加速度为一固定值。
在其他一些实施例中,也可以通过基于软件的传感器获取传感器数据,基于软件的传感器是指软件模拟的基于硬件的传感器,例如,安卓应用程序框架层允许应用程序访问多种类型的传感器,其中一些传感器是基于硬件的,一些是基于软件的,其中基于硬件的传感器是内置于手机或平板设备中的物理组件,通过直接测量特定的环境属性(例如加速度,地磁场强度或角度变化)来获取数据,例如直接通过加速度传感器151获取加速度数据,而基于软件的传感器不是物理设备,是从一个或多个基于硬件的传感器获取其数据后,经过软件处理 得到结果输出,有时也称为虚拟传感器或合成传感器,例如,线性加速度传感器和重力传感器就是常见的基于软件的传感器。
进一步的,当手机100的加速度不满足初步筛选条件时,可以把已获取的数据丢弃,其中,初步筛选条件可以为,加速度的大小小于重力加速度大小的一半。
步骤202、根据预设时间内多次获取的传感器数据是否均符合预设条件,判定手机100为完全失重状态。
在一些实施例中,预设条件可以为,根据获取的加速度传感器151数据计算出手机100在加速度特征符合完全失重状态,即根据预设时间内多次获取的加速度传感器的数据符合完全失重状态来确定手机100处于完全失重状态。
可选的,获取的加速度传感器151数据符合完全失重状态的特征,可以包括加速度传感器151数据所计算出手机100加速度等于重力加速度,即根据预设时间内多次获取的加速度传感器的数据计算出手机100的加速度,均等于重力加速度,则确定手机100处于完全失重状态。
一些实施例中,根据加速度传感器151的原理,当手机100加速度等于重力加速度时,即只受重力作用,即如图12(a)所示,此时X、Y、Z三轴每个轴输出的加速度数据为0。
可选的,加速度传感器151数据是否符合完全失重状态的特征还可以结合之前的加速度传感器151或者其他传感器的历史数据进行判定,如先根据历史数据判定出手机100的重力加速度的方向后,然后根据加速度传感器151数据计算得到加速度在重力加速度的方向上的分量,若该分量等于重力加速度,则加速度传感器151数据符合完全失重状态的特征。
在一些实施例中,预设条件还可以为,获取的陀螺仪传感器152的数据计算出手机100的角速度为一个大于零且方向不变的定值,即可以根据预设时间内多次获取的陀螺仪传感器的数据计算出手机100的角速度,均为相同的大于零的值,确定手机100处于完全失重状态。对于日常使用中常见的场景,手机100会受重力之外的外力作用,难以维持固定的角速度旋转,而在日常使用的大多数情况中只有当手机100不受重力之外的外力作用而处于完全失重状态时,才可以维持固定的角速度旋转,如图12(b)所示,所以本申请实施例中将陀螺仪传感器152的数据计算出的角速度应当为一个大于零的定值,可以作为一种判定完全失重状态的预设条件,也就是说,可以根据预设时间内多次获取的所述陀螺仪传感器152的数据计算出的角速度均为一个大于零且方向不变的定值,判定手机100为完全失重状态。
需要说明的是,本申请实施例中,由于传感器的输出通常存在一定误差波动,可能是由于器件噪声引入,所以预设条件所述的“等于重力加速度”、“一个大于零的定值”等,在实施中,可以在一定范围内波动,如,预设条件可以为获取的加速度传感器151的三轴加速度数据计算出的加速度小于0.1,单位是米每平方秒,再比如,预设条件可以为获取的陀螺仪传感器152的数据计算出手机100的角速度为一个大于0.2的定值,波动幅度可以为小于0.1,单位是弧度每秒,方向在空间中变化范围小于0.1度。
在一些实施例中,预设时间可以是20毫秒,例如,在20毫秒内,按照100赫兹的频率获取的20次加速度传感器151的数据,所计算出的加速度均为0,即手机100的实际加速度等于重力加速度;再比如,在一些实施例中,按照100赫兹的频率连续20次(即持续20毫秒)获取的陀螺仪传感器152的数据计算出手机100的角速度为一个大于零且方向不变的定值。
对于在某个时刻,其传感器数据可能是符合预设条件的,如图13(a)或者图13(b)中的常见使用场景,人的手做各种方向的移动或摇摆,所以通过预设时间的限定,可以减少正常使用中的误判为完全失重状态的可能性,降低了误识别概率。
需要说明的是,预设时间内获取的传感器数据可能存在较少比例的不符合预设条件的异常数值,如按照100赫兹频率采集,连续20次中,有19次都符合预设条件,但是有一次数值异常,例如连续20次中有19次从获取的加速度传感器151的数据,所计算出的加速度均为0,但是其中第5次采集,所计算出的加速度为3.13米每平方秒,这可能是由于环境噪声等因素的干扰,也可能是如图14所示的场景,其中手机100从T1时刻开始处于完全失重状态,在下落到T2时刻,与桌子104发生擦碰,此时会在短暂时间内不符合完全失重状态,而之后又继续下落至T3时刻,所以出于安全性优先的考虑,可以忽视少数不符合预设条件的异常数值,只考虑获取的数据中的符合预设条件的众数,来判定手机100处于完全失重状态。
在一些实施例中,获取传感器数据可以获取到不同的获取的传感器数据,而预设时间内采集的传感器数据中,每次获取传感器数据至少一个传感器数据满足预设条件即可判定手机100为完全失重状态,例如按照100赫兹频率采集,连续20次中,其中单次的获取的加速度传感器151的数据和陀螺仪传感器152的数据,只要有一个数据符合预设条件即可判定手机100为完全失重状态,从而增加对手机100的完全失重状态检测的可靠性。
还需要说明的是,本申请实施例中判定获取的传感器数据是否符合预设条件,其中可以对传感器数据进行等效替代,例如,根据获取加速度传感器151数据判定是否符合完全失重状态,可以替代为根据线性加速度传感器来判定手机100是否存在重力加速度之外的加速度,这是因为线性加速度传感器作为一种基于软件的传感器,其数据来源于加速度传感器151,还可以将一部分数据的处理由传感器来完成,例如对加速度的计算、坐标的换算等,这些都应当落入本申请实施例的权利要求的保护范围。
步骤203、当手机100被判定为处于完全失重状态后,将手机100的可活动部分从非安全位置移动至安全位置。
通过上述申请实施例的方法,手机100的可活动部分处于非安全位置时,手机100通过获取传感器数据进行完全失重状态检测,根据数据是否符合预设条件并持续预设时间,判定出手机100处于完全失重状态,并及时将手机100的可活动部分移动至安全位置,以减少手机100的可活动部分可能在强烈震动碰撞或者发生跌落的损坏可能性和损坏程度,并减少了对正常使用场景的误识别概率。
第二申请实施例:
如图15所示是一种基于神经网络的保护手机100可活动部分的方法,其中与第一申请实施例相似的部分不再赘述,可以参考第一申请实施例:
步骤301、获取手机100的用于检测完全失重状态的传感器数据。
在一些实施例中,获取手机100的传感器数据可以包括加速度传感器151的数据和陀螺仪传感器152的数据。
在一些实施例中,对所获得的传感器数据处理是,根据加速度传感器151的数据计算出加速度,根据陀螺仪传感器152的数据计算出角速度,并将处理结果角速度和加速度进行保存,进一步的,处理结果还可以包括由加速度传感器151的数据中的Z轴加速度数据
步骤302、通过神经网络,根据预设时间内多次获取的传感器数据判断手机100是否处于为完全失重状态。
本申请实施例中神经网络是指人工神经网络(Artificial Neural Network,即ANN),它从信息处理角度对人脑神经元网络进行抽象,建立某种简单模型,按不同的连接方式组成不同的网络。在工程与学术界也常直接简称为神经网络或类神经网络。神经网络是一种运算模型,由大量的节点(或称神经元)之间相互联接构成。每个节点代表一种特定的输出函数,称为激励函数(activation function)。每两个节点间的连接都代表一个对于通过该连接信号的加权值,称之为权重,这相当于人工神经网络的记忆。网络的输出则依网络的连接方式,权重值和激励函数的不同而不同。而网络自身通常都是对自然界某种算法或者函数的逼近,也可能是对一种逻辑策略的表达。最近十多年来,人工神经网络的研究工作不断深入,已经取得了很大的进展,其在模式识别、智能机器人、自动控制、预测估计、生物、医学、经济等领域已成功地解决了许多现代计算机难以解决的实际问题,表现出了良好的智能特性。
如图16所示,是一种可能的神经网络的架构图,其中,神经网络可以使用BPNN后向传播神经网络,利用输出的反馈结合梯度下降法实现输入输出的非线性映射。
在一些实施例中,神经网络的输入层可以是预设时间内多次获取的传感器数据经过预处理之后的值,例如,每次获得的加速度传感器151的数据和陀螺仪角速度152的数据计算得到的加速度、角速度和Z轴加速度作为一组数据XN、YN、ZN(设一共采集了10次,其中N为从1到10的整数),其中,Z轴加速度是指图1中的Z轴方向上的加速度数据,选择Z轴加速度数据的原因是,出于手机结构和加速度传感器在手机中的安装位置,X,Y,Z三轴力矩不同,导致传感器三轴数据特性差异较大,Z轴数据在失重时相对X,Y轴特征更为明显。通过如上的预处理,可以减少数据输入维度,降低模型复杂度,并且省略数据从原始传感器数据到预处理结果的转换,可以使神经网络学习的方向专注于对处理结果到完全失重状态的判定上,减少神经网络的负担。
在一些实施例中,神经网络可以包括两层隐层,隐层1、隐层2,隐层使用的激活函数可以为tanh,神经网络的输出层可以选用sigmoid。
在一些实施例中,当保存的数据满足达到预设数量时,将获取的传感器数据所计算得到的加速度和角速度输入至神经网络,由神经网络根据输入的传感器数据判定手机100是否处于完全失重状态。
在一些实施例中,若神经网络判定手机100为非完全失重状态,可以丢弃最早一次的数据,继续执行步骤301,获取更新的手机100的传感器数据。
在一些实施例中,需要提前经过实验室中手机100的各种完全失重状态和非完全失重状态的场景下,将获取的传感器数据和实际的危险或非完全失重状态作为训练数据对神经网络进行训练,进一步的,通过使用手机100处于完全失重状态时的数据训练神经网络,从而可以使神经网络根据获取的传感器数据判定的手机100状态是否是完全失重状态中的完全失重状态。
进一步的,神经网络可以在特定用户使用手机100时,收集特定用户的数据进行训练, 这样可以使得对于手机100的完全失重状态的判定更加适应特定用户的使用习惯,以减少误判的可能性。
在一些实施例中,可以根据预先根据持续一定时间多次获取的传感器数据进行预筛选,决定是否通过神经网络,例如,可以先根据陀螺仪传感器152的数据计算出角速度,判断手机100是否有角速度稳定在一定阈值内的旋转:
如果角速度稳定在预设阈值内,则可以通过神经网络进行完全失重状态判定;
否则,不通过神经网络,而可以采用申请实施例一中的方法来判定手机100是否处于完全失重状态,这样可以有效降低神经网络的运算量,性能和功耗更优。
通过使用神经网络来判定手机100的完全失重状态,主要有如下有益效果:
1、神经网络的方式可以降低传感器的器件噪声、环境噪声等噪声的对手机100的状态判定的影响;
2、对于一些传感器,如陀螺仪传感器152,由于其噪声及结构特点,在手机100处于完全失重状态并且存在转动运动时,其陀螺仪传感器152输出的数据可能会存在复杂的波动变化,即使通过设定阈值的方式进行限定,对于在去除噪声和降低误判率的效果也比较有限,而通过引入神经网络对这种变化进行学习,可以大幅提高识别完全失重状态的准确率。
3、手机100在磕碰或者转动时对加速度传感器151的数据也会产生影响,例如图14所示的场景,在下落中在T2时刻受到磕碰导致发生转动,其加速度传感器151不仅在T2时刻存在改变,同时也会受到转动带来的影响,而通过对这些场景的训练,神经网络可以更加准确的识别重力特征,判定手机100的完全失重状态;
4、可以通过训练识别手机100识别更加复杂的场景,例如可以结合手机100进入完全失重状态之前的传感器数据,在手机100进入完全失重状态后根据更少的传感器数据即可判定出手机100处于包括完全失重状态的更加复杂的危险场景,如图14的跌落场景,或者例如跌落之前手机100从用户手中滑落等场景,这样缩短了判定手机100是否处于完全失重状态的响应时间。
步骤303、当手机100被判定为处于完全失重状态后,将电子设备100的可活动部分从非安全位置移动至安全位置。
上述第二申请实施例通过使用神经网络,提供了一种更加准确的方法,用于判断出手机100的完全失重状态,从而及时做出保护手机100的可活动部分的操作,降低手机100的可活动部分的受到强烈震动碰撞的损坏可能性和损坏程度。
通过以上的实施方式的描述可知,本领域的技术人员可以清楚地了解到上述实施例方法中的全部或部分步骤可借助软件加通用硬件平台的方式来实现。基于这样的理解,本申请的技术方案可以以软件产品的形式体现出来,该计算机软件产品可以存储在存储介质中,如只读存储器(英文:read-only memory,ROM)/RAM、磁碟、光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者诸如路由器等网络通信设备)执行本申请各个实施例或者实施例的某些部分所述的方法。
本说明书中的各个实施例均采用递进的方式描述,各个实施例之间相同相似的部分互相参见即可,每个实施例重点说明的都是与其他实施例的不同之处。以上所描述的实施例仅仅 是示意性的,其中作为分离部件说明的模块可以是或者也可以不是物理上分开的,作为模块显示的部件可以是或者也可以不是物理模块,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性劳动的情况下,即可以理解并实施。
以上所述仅是本申请示例性的实施方式,并非用于限定本申请的保护范围。
Claims (16)
- 一种保护电子设备的可活动部分的方法,包括:在所述电子设备的可活动部分处于第一位置时,获取电子设备的传感器数据,所述传感器数据与确定所述电子设备是否处于完全失重状态有关;根据预设时间内多次获取的所述传感器数据确定电子设备处于完全失重状态;将所述电子设备的可活动部分移动至第二位置。
- 根据权利要求1所述的方法,其特征在于:所述获取电子设备的传感器数据包括,加速度传感器的数据和陀螺仪传感器的数据。
- 根据权利要求2所述的方法,其特征在于:所述根据预设时间内多次获取的所述传感器数据确定电子设备为完全失重状态,包括:通过神经网络,根据预设时间内多次获取的加速度传感器的数据和陀螺仪传感器的数据确定电子设备为完全失重状态。
- 根据权利要求3所述的方法,其特征在于:通过神经网络,根据预设时间内多次获取的加速度传感器的数据和陀螺仪传感器的数据确定电子设备为完全失重状态,包括:根据预设时间内多次获取的加速度传感器的数据和陀螺仪传感器的数据,得到电子设备的加速度、角速度和Z轴加速度;通过神经网络,根据所述得到的电子设备的加速度、角速度和Z轴加速度,确定电子设备为完全失重状态。
- 根据权利要求3所述的方法,其特征在于,在所述通过神经网络,根据预设时间内多次获取的加速度传感器的数据和陀螺仪传感器的数据确定电子设备为完全失重状态之前,所述方法还包括:根据预设时间内多次获取的陀螺仪传感器的数据,所计算得到的角速度均不为零。
- 根据权利要求1所述的方法,其特征在于:所述获取电子设备的传感器数据,包括加速度传感器的数据。
- 根据权利要求6所述的方法,其特征在于:所述根据预设时间内多次获取的所述传感器数据确定电子设备处于完全失重状态,包括:根据预设时间内多次获取的加速度传感器的数据计算出电子设备的加速度,均等于重力加速度,确定电子设备处于完全失重状态。
- 根据权利要求1所述的方法,其特征在于:所述获取电子设备的传感器数据,包括陀螺仪传感器的数据。
- 根据权利要求8所述的方法,其特征在于:所述根据预设时间内多次获取的所述传感器数据确定电子设备处于完全失重状态,包括:根据预设时间内多次获取的陀螺仪传感器的数据计算出电子设备的角速度,均为相同的大于零的值,确定电子设备处于完全失重状态。
- 根据权利要求1至9任一项所述的方法,其特征在于:所述电子设备的可活动部分包括摄像头模块。
- 根据权利要求10所述的方法,其特征在于:所述摄像头模块是伸缩式摄像头,伸缩式摄像头伸出到电子设备的壳体外时处于第一位置,伸缩式摄像头收缩在电子设备的壳体内时处于第二位置。
- 根据权利要求1至9任一项所述的方法,其特征在于:所述电子设备的可活动部分包括可活动的显示屏。
- 根据权利要求1至12任一项所述的方法,其特征在于:所述电子设备处于完全失重状态后,将所述电子设备的可活动部分移动至第二位置的速度为第一速度,所述电子设备处于完全失重状态前,将所述电子设备的可活动部分移动至第二位置的速度为第二速度,所述第一速度大于所述第二速度。
- 一种电子设备,包括触摸屏,存储器,一个或多个处理器,多个应用程序,以及一个或多个程序;其中所述一个或多个程序被存储在所述存储器中;其特征在于,所述一个或多个处理器在执行所述一个或多个程序时,使得所述电子设备实现如权利要求1至13任一项所述的方法。
- 一种计算机可读存储介质,包括指令,其特征在于,当所述指令在电子设备上运行时,使得所述电子设备执行如权利要求1至13中任一项所述的方法。
- 一种包含指令的计算机程序产品,其特征在于,当所述计算机程序产品在电子设备上运行时,使得所述电子设备执行如权利要求1至13中任一项所述的方法。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910209157.8 | 2019-03-19 | ||
| CN201910209157.8A CN110035147A (zh) | 2019-03-19 | 2019-03-19 | 一种保护电子设备可活动部分的方法及电子设备 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2020187170A1 true WO2020187170A1 (zh) | 2020-09-24 |
Family
ID=67236331
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2020/079380 Ceased WO2020187170A1 (zh) | 2019-03-19 | 2020-03-14 | 一种保护电子设备可活动部分的方法及电子设备 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110035147A (zh) |
| WO (1) | WO2020187170A1 (zh) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113286024A (zh) * | 2021-05-20 | 2021-08-20 | 维沃移动通信有限公司 | 电子设备 |
| CN116668828A (zh) * | 2022-12-12 | 2023-08-29 | 荣耀终端有限公司 | 摄像头模组的控制方法及相关设备 |
| CN116781809A (zh) * | 2021-11-19 | 2023-09-19 | 荣耀终端有限公司 | 合页角度的检测方法及相关设备 |
| CN117135434A (zh) * | 2023-02-22 | 2023-11-28 | 荣耀终端有限公司 | 马达的控制方法、摄像头模组、电子设备和芯片系统 |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110035147A (zh) * | 2019-03-19 | 2019-07-19 | 华为技术有限公司 | 一种保护电子设备可活动部分的方法及电子设备 |
| CN111143033B (zh) * | 2019-12-20 | 2024-03-22 | 青岛海尔科技有限公司 | 基于可伸缩操作系统的操作执行方法及装置 |
| CN111367360A (zh) * | 2020-02-28 | 2020-07-03 | 维沃移动通信有限公司 | 一种功能模组的控制方法、装置及电子设备 |
| CN111787200B (zh) * | 2020-06-23 | 2022-03-01 | 上海源涛信息科技有限公司 | 一种镜头的防摔保护系统、保护方法及影像采集设备 |
| CN112700725B (zh) * | 2021-01-08 | 2022-03-08 | 武汉华星光电半导体显示技术有限公司 | 显示装置 |
| CN114141145B (zh) | 2021-12-01 | 2022-11-04 | 武汉华星光电半导体显示技术有限公司 | 显示面板及移动终端 |
| CN114416389B (zh) * | 2021-12-01 | 2023-03-03 | 荣耀终端有限公司 | 一种活动识别方法以及相关设备 |
| WO2023245347A1 (en) * | 2022-06-20 | 2023-12-28 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Imaging device and imaging device control method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150311941A1 (en) * | 2014-03-04 | 2015-10-29 | Michael Sorrentino | Mobile device case with movable camera cover |
| CN107872582A (zh) * | 2017-11-20 | 2018-04-03 | 上海理工大学 | 一种手机防摔自保护装置和方法 |
| CN108924914A (zh) * | 2018-04-27 | 2018-11-30 | Oppo广东移动通信有限公司 | 跌落检测方法及相关产品 |
| CN110035147A (zh) * | 2019-03-19 | 2019-07-19 | 华为技术有限公司 | 一种保护电子设备可活动部分的方法及电子设备 |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002354082A (ja) * | 2001-05-23 | 2002-12-06 | Sharp Corp | カメラ付携帯電話機 |
| CN108259670B (zh) * | 2018-01-22 | 2021-03-05 | Oppo广东移动通信有限公司 | 电子装置、跌落处理方法及相关产品 |
-
2019
- 2019-03-19 CN CN201910209157.8A patent/CN110035147A/zh active Pending
-
2020
- 2020-03-14 WO PCT/CN2020/079380 patent/WO2020187170A1/zh not_active Ceased
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150311941A1 (en) * | 2014-03-04 | 2015-10-29 | Michael Sorrentino | Mobile device case with movable camera cover |
| CN107872582A (zh) * | 2017-11-20 | 2018-04-03 | 上海理工大学 | 一种手机防摔自保护装置和方法 |
| CN108924914A (zh) * | 2018-04-27 | 2018-11-30 | Oppo广东移动通信有限公司 | 跌落检测方法及相关产品 |
| CN110035147A (zh) * | 2019-03-19 | 2019-07-19 | 华为技术有限公司 | 一种保护电子设备可活动部分的方法及电子设备 |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113286024A (zh) * | 2021-05-20 | 2021-08-20 | 维沃移动通信有限公司 | 电子设备 |
| CN113286024B (zh) * | 2021-05-20 | 2024-01-30 | 维沃移动通信有限公司 | 电子设备 |
| CN116781809A (zh) * | 2021-11-19 | 2023-09-19 | 荣耀终端有限公司 | 合页角度的检测方法及相关设备 |
| CN116668828A (zh) * | 2022-12-12 | 2023-08-29 | 荣耀终端有限公司 | 摄像头模组的控制方法及相关设备 |
| CN117135434A (zh) * | 2023-02-22 | 2023-11-28 | 荣耀终端有限公司 | 马达的控制方法、摄像头模组、电子设备和芯片系统 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110035147A (zh) | 2019-07-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110035147A (zh) | 一种保护电子设备可活动部分的方法及电子设备 | |
| US20240289930A1 (en) | Deep learning-based real-time detection and correction of compromised sensors in autonomous machines | |
| US11009716B2 (en) | Transitioning into a VR environment and warning HMD users of real-world physical obstacles | |
| US20240104815A1 (en) | Augmented expression system | |
| EP3807846B1 (en) | Method and system for real-time animation generation using machine learning | |
| US10282623B1 (en) | Depth perception sensor data processing | |
| US11024041B2 (en) | Depth and motion estimations in machine learning environments | |
| US11526713B2 (en) | Embedding human labeler influences in machine learning interfaces in computing environments | |
| US11031005B2 (en) | Continuous topic detection and adaption in audio environments | |
| CN110832433B (zh) | 基于传感器的组件激活 | |
| US9235278B1 (en) | Machine-learning based tap detection | |
| US20210055545A1 (en) | Pose prediction with recurrent neural networks | |
| KR102433931B1 (ko) | 움직임 인식 방법 및 움직임 인식 장치 | |
| WO2020018214A1 (en) | Modifiable simulation of physical object behavior | |
| WO2021223611A1 (zh) | 一种机器人的控制方法、装置、机器人以及存储介质 | |
| US12223657B2 (en) | Image segmentation system | |
| US10049625B1 (en) | Context-based rendering | |
| KR20240162166A (ko) | 퓨샷 개방-세트 인식을 위한 태스크 애그노스틱 개방-세트 프로토타입 | |
| EP3918448A1 (en) | Interactive augmented reality system | |
| US20250068326A1 (en) | Gesture-based keyboard text entry | |
| CN119856478A (zh) | 窗口显示方法和相关装置 | |
| EP4581454A1 (en) | Wrist rotation manipulation of virtual objects | |
| CN111524528B (zh) | 防录音检测的语音唤醒方法及装置 | |
| EP4540807A1 (en) | Ar assisted safe cycling | |
| US20250232451A1 (en) | Detecting moving objects |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20774056 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 20774056 Country of ref document: EP Kind code of ref document: A1 |