CN108966094B

CN108966094B - Sound production control method and device, electronic device and computer readable medium

Info

Publication number: CN108966094B
Application number: CN201810745854.0A
Authority: CN
Inventors: 张海平
Original assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Current assignee: Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date: 2018-07-09
Filing date: 2018-07-09
Publication date: 2020-09-22
Anticipated expiration: 2038-07-09
Also published as: CN108966094A

Abstract

The embodiment of the application provides a sound production control method and device, an electronic device and a computer readable medium, and relates to the technical field of electronic devices. The method comprises the following steps: when the electronic device is in a screen locking state and is not in a screen vibration sound production mode, acquiring vibration information of the screen, which is acquired by the vibration monitoring device; judging whether the vibration information meets a preset standard or not; and if the preset standard is met, controlling the electronic device to unlock. Therefore, the user does not need extra operation, when the electronic device locks the screen, the electronic device can be unlocked by speaking the voice for unlocking towards the screen, user operation is reduced, and user experience is improved.

Description

Sound production control method and device, electronic device and computer readable medium

Technical Field

The present disclosure relates to the field of electronic devices, and more particularly, to a method and an apparatus for controlling sound generation, an electronic device, and a computer readable medium.

Background

At present, the screen of an electronic device, such as a mobile phone, a tablet computer, etc., may be locked, that is, the electronic device may enter a screen locking state, and a user may unlock the electronic device by inputting an authentication code. However, when unlocking, the unlocking key is often required to be pressed down, or a finger is required to be placed on the fingerprint module for a certain time to unlock, so that the operation is complex.

Disclosure of Invention

The application provides a sound production control method, a sound production control device, an electronic device and a computer readable medium, so as to overcome the defects.

In a first aspect, an embodiment of the present application provides a sound production control method, which is applied to an electronic device including a screen and a vibration monitoring device for monitoring vibration of the screen. The method comprises the following steps: when the electronic device is in a screen locking state and is not in a screen vibration sound production mode, acquiring vibration information of the screen, which is acquired by the vibration monitoring device; judging whether the vibration information meets a preset standard or not; and if the preset standard is met, controlling the electronic device to unlock.

In a second aspect, an embodiment of the present application further provides a sound production control device, which is applied to an electronic device, where the electronic device includes a screen and a vibration monitoring device for monitoring vibration of the screen. The sound production control device includes: the device comprises an acquisition unit, a judgment unit and an unlocking unit. And the acquisition unit is used for acquiring the vibration information of the screen, which is acquired by the vibration monitoring device, when the electronic device is in a screen locking state and is not in a screen vibration sound production mode. And the judging unit is used for judging whether the vibration information meets a preset standard or not. And the unlocking unit is used for controlling the electronic device to unlock if the preset standard is met.

In a third aspect, an embodiment of the present application further provides an electronic device, which includes a screen, a vibration monitoring device for monitoring vibration of the screen, and a processor. The vibration monitoring device is used for acquiring the vibration information of the screen collected by the vibration monitoring device when the electronic device is in a screen locking state and is not in a screen vibration sound production mode, and sending the vibration information to the processor. The processor is used for judging whether the vibration information meets a preset standard or not, and controlling the electronic device to unlock if the vibration information meets the preset standard.

In a fourth aspect, an embodiment of the present application further provides an electronic device, which includes a screen and a vibration monitoring device for monitoring vibration of the screen. The electronic device also includes a memory and a processor, the memory coupled with the processor. The memory stores instructions that, when executed by the processor, perform the above-described method.

In a fifth aspect, the present application also provides a computer-readable medium having program code executable by a processor, where the program code causes the processor to execute the above method.

According to the sound production control method, the sound production control device, the electronic device and the computer readable medium, when the electronic device is in a screen locking state and is not in a screen vibration sound production mode, the vibration information of the screen collected by the vibration monitoring device can be acquired, and if the vibration information meets a preset standard, the electronic device is controlled to be unlocked. Therefore, the user does not need extra operation, when the electronic device locks the screen, the electronic device can be unlocked by speaking the voice for unlocking towards the screen, user operation is reduced, and user experience is improved.

Additional features and advantages of embodiments of the present application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by the practice of embodiments of the present application. The objectives and other advantages of the embodiments of the application may be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 illustrates a schematic structural diagram of an electronic device provided in an embodiment of the present application from a first viewing angle;

fig. 2 is a schematic structural diagram of an electronic device according to an embodiment of the present application from a second viewing angle;

FIG. 3 is a flow chart of a method of controlling sound production according to an embodiment of the present application;

fig. 4 is a schematic diagram illustrating an unlocking process provided by an embodiment of the present application;

FIG. 5 is a flow chart of a method of controlling speech provided by another embodiment of the present application;

FIG. 6 is a flow chart of a method of controlling speech provided by a further embodiment of the present application;

fig. 7 shows a block diagram of a sound emission control device provided in an embodiment of the present application;

FIG. 8 illustrates a block diagram of an electronic device provided by an embodiment of the present application;

FIG. 9 illustrates a block diagram of an electronic device provided by another embodiment of the present application;

fig. 10 shows a block diagram of an electronic device for performing the method provided by the embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.

The display screen generally plays a role in an electronic device such as a mobile phone or a tablet computer to display text, pictures, icons, or video. With the development of touch technologies, more and more display screens arranged in electronic devices are touch display screens, and when a user is detected to perform touch operations such as dragging, clicking, double clicking, sliding and the like on the touch display screen, the touch operations of the user can be responded under the condition of arranging the touch display screens.

As the user demands higher definition and higher fineness of the displayed content, more electronic devices employ touch display screens with larger sizes. However, in the process of setting a touch display screen with a large size, it is found that functional devices such as a front camera, a proximity optical sensor, and a receiver, which are disposed at the front end of the electronic device, affect an area that the touch display screen can extend to.

Generally, an electronic device includes a front panel, a rear cover, and a bezel. The front panel includes a top area, a middle screen area and a lower key area. Generally, the forehead area is provided with a sound outlet of a receiver and functional devices such as a front camera, the middle screen area is provided with a touch display screen, and the lower key area is provided with one to three physical keys. With the development of the technology, the lower key area is gradually cancelled, and the physical keys originally arranged in the lower key area are replaced by the virtual keys in the touch display screen.

The earphone sound outlet holes arranged in the forehead area are important for the function support of the mobile phone and are not easy to cancel, so that the difficulty in expanding the displayable area of the touch display screen to cover the forehead area is high. After a series of researches, the inventor finds that sound can be emitted by controlling the screen, the frame or the rear cover of the mobile phone to vibrate, so that the arrangement of the sound outlet hole of the receiver can be eliminated.

Referring to fig. 1 and 2, an electronic device 100 according to an embodiment of the present application is shown. Fig. 1 is a front view of the electronic device, and fig. 2 is a side view of the electronic device.

The electronic device 100 comprises an electronic body 10, wherein the electronic body 10 comprises a housing 12 and a screen 120 disposed on the housing 12, the housing 12 comprises a front panel 125, a rear cover 127 and a bezel 126, the bezel 126 is used for connecting the front panel 125 and the rear cover 127, and the screen 120 is disposed on the front panel 125.

The electronic device further comprises an exciter 131, wherein the exciter 131 is used for driving a vibration component of the electronic device to vibrate, specifically, the vibration component is at least one of the screen 120 or the housing 12 of the electronic device, that is, the vibration component can be the screen 120, the housing 12, or a combination of the screen 120 and the housing 12. As an embodiment, when the vibration member is the housing 12, the vibration member may be a rear cover of the housing 12.

In the embodiment of the present application, the vibration component is the screen 120, and the exciter 131 is connected to the screen 120 for driving the screen 120 to vibrate. In particular, the actuator 131 is attached below the screen 120, and the actuator 131 may be a piezoelectric driver or a motor. In one embodiment, actuator 131 is a piezoelectric actuator. The piezoelectric actuator transmits its own deformation to the screen 120 by a moment action, so that the screen 120 vibrates to generate sound. The screen 120 includes a touch screen 109 and a display panel 111, the display panel 111 is located below the touch screen 109, and the piezoelectric driver is attached below the display panel 111, i.e., a side of the display panel 111 away from the touch screen 109. The piezoelectric driver includes a plurality of piezoelectric ceramic sheets. When the multilayer piezoelectric ceramic piece produces sound and expands and contracts, the screen is driven to bend and deform, and the whole screen forms bending vibration repeatedly, so that the screen can push air and produce sound.

In addition, the electronic device also includes a vibration monitoring device 132. The vibration monitoring device is used for monitoring the vibration of the screen 120, so that the vibration change of the screen 120 can be detected, and the sound collection can be realized. In particular, the vibration monitoring device 132 may be attached below the screen 120. This vibration monitoring devices 132 can be made up of coil, magnet and amplifier, and the vibration of screen 120 can drive the motion of attached coil on screen 120, and there is magnet coil periphery, because vibrations make the coil cut the magnetic line of force in the magnetic field, produces the electric current to be provided with the amplifier and amplify the signal of telecommunication that produces, thereby accomplish the collection of sound. Of course, the vibration monitoring device 132 may be other components capable of monitoring the vibration variation of the screen and converting the vibration variation into an electrical signal, such as a displacement sensor.

As an embodiment, the electronic device 100 includes a detection circuit for detecting whether the screen sound emission area is in an abnormal state, and adjusting the vibration parameter of the screen sound emission area when the screen sound emission area is determined to be in the abnormal state, and a driving circuit. The exciter 131 is connected to a driving circuit of the electronic device, and the driving circuit is configured to input a control signal value according to the vibration parameter to the exciter 131, so as to drive the exciter 131 to vibrate, thereby driving the vibrating component to vibrate. In particular, the driving circuit may be a processor of the electronic device, or may be an integrated circuit capable of generating a driving voltage or current within the electronic device. The driving circuit outputs a high-low level driving signal to the exciter 131, the exciter 131 vibrates according to the driving signal, and the different electrical parameters of the driving signal output by the driving circuit may cause the different vibration parameters of the exciter 131, for example, the duty ratio of the driving signal corresponds to the vibration frequency of the exciter 131, and the amplitude of the driving signal corresponds to the vibration amplitude of the exciter 131.

In the embodiment of the present application, the plurality of actuators 131 may be uniformly distributed on the screen 120, so that the screen 120 is divided into a plurality of areas for sounding independently. For example, if the number of the actuators is 4, the screen may be divided into 4 square areas along the center line in the vertical direction and the center line in the horizontal direction, the 4 actuators are disposed below the 4 square areas, and the 4 actuators correspond to the 4 square areas one by one. Of course, the number of actuators is not limited in the embodiments of the present application.

The inventor finds in research that when the electronic device locks the screen, if a user needs to unlock the electronic device, the user needs to press an unlock key, then lights the screen and then unlocks the screen by means of face recognition or unlocking password input, or, when the screen is locked, a finger is placed on a fingerprint module to input a fingerprint to unlock the screen, even if the existing voiceprint is unlocked, on one hand, the user needs to align to a specific position, for example, a microphone to input voice, or the user needs to wake up a voice input function when the screen is lighted, so that the user operation is increased, and the user experience is reduced.

Therefore, in order to solve the technical problem, an embodiment of the present application provides a sound emission control method, please refer to fig. 3, for enabling a user to unlock the electronic device by a method of inputting a voice on a screen when the electronic device is unlocked, so as to improve user experience, specifically, the method includes: s301 to S303.

S301: and when the electronic device is in a screen locking state and is not in a screen vibration sound production mode, acquiring the vibration information of the screen collected by the vibration monitoring device.

The mobile terminal comprises a screen locking state and a screen unlocking state, and the screen of the mobile terminal comprises a screen extinguishing state and a screen lightening state. Specifically, the SCREEN-OFF state and the SCREEN-ON state of the SCREEN may be detected by a program module in the system of the mobile terminal, for example, by an isScreenOn function of PowerManager, and the broadcast of the content.action _ SCREEN _ ON and content.action _ SCREEN _ OFF may be received by broadcastrechiveriveriveriveriveriver, so that it may be determined whether the mobile terminal is in the SCREEN-locked state or the SCREEN-unlocked state.

When the electronic device is in a screen locking state, whether the electronic device is in a screen vibration sound production mode is judged, namely whether the screen of the electronic device is in the screen vibration sound production mode is judged. Specifically, it may be determined whether an application program of the electronic device, which is capable of playing voice, such as music playing software or a call application, is currently in a vibration sound production mode by detecting an operation of the application program by a user. Specifically, the electronic device is in a vibration sound production mode, and may receive a sound production request. The sound production request indicates the mobile terminal for the user, and the information that the screen needs to be controlled to vibrate and produce sound is required. As an implementation mode, the sound production request can be reminding information or a voice playing request

The reminding information comprises information for reminding a user that some events are triggered, such as call reminding information, short message reminding information, alarm reminding information and the like. For example, the call reminding information is used for reminding the user that there is an incoming call currently, and the electronic device may enter the vibration sound production mode after the reminding information is acquired and before the sound production is not performed, that is, the electronic device is in a state of waiting for sound production at this time. Then, after the vibration parameters are acquired, at least one of the screen or the rear cover is controlled to vibrate and sound, so that a sound for reminding, such as a ring tone, is emitted.

As another embodiment, the utterance request may be a request to play a voice every time during the utterance of the mobile terminal. The method provided by the embodiment of the application is used for collecting the environmental noise to adjust the vibration of the vibration component in the sound production process of the mobile terminal, so as to adjust the sound production.

For example, a user clicks a play button of a certain video APP, and the electronic device is not currently in a mute state, and when it is detected that the play button is triggered, at least one vibration sound production mode in the screen or the rear cover is entered, and the video voice is played through vibration of the screen.

Therefore, as described above, it can be determined that the screen vibration sound emission mode is not currently being used without acquiring the vibration sound emission mode and without the application being playing audio.

The vibration of the screen can be driven by the vibration of the air brought by the sound around the electronic device, and the vibration of the screen can be collected by the vibration monitoring device.

Therefore, when the electronic device is in a screen locking state and is not in a screen vibration sound production mode, the vibration information of the screen collected by the vibration monitoring device is acquired. Specifically, a processor of the electronic device sends a data acquisition request to the vibration monitoring device at regular intervals, so that the vibration monitoring device sends the acquired vibration information to the processor.

Of course, the electronic device may send an enable signal, for example, the enable signal may be a clock signal with a high level or a low level, after the vibration monitoring device acquires the enable signal, the vibration monitoring device is switched from a low power consumption standby state or an off state to an on state, and the vibration monitoring device is turned on, collects the vibration information of the screen, and sends the collected vibration information to the processor. Specifically, the vibration information of the capture screen may be detected at a preset sampling time, and then the captured vibration information may be transmitted to the processor.

S302: and judging whether the vibration information meets a preset standard.

The vibration information may be parameters such as vibration frequency, vibration intensity, or vibration phase. Different audio signals correspond to different vibration information, and through the screening of the vibration information meeting the preset standard, the audio signals corresponding to different vibration information can be screened, namely the audio signals meeting the preset standard are selected to serve as the audio signals of the target user.

Specifically, the preset criterion is a condition set by the user according to actual use, for example, an audio signal whose vibration information satisfies a certain condition, for example, an audio signal whose vibration intensity is greater than a certain value is taken as an audio signal satisfying the preset criterion, that is, an audio signal of the target user.

In addition, because the speaking tone of each user is different, the vibration frequency of the screen is different when the external sound vibrates, and the different frequencies can correspond to different audio frequencies, therefore, because the audio frequencies corresponding to each audio signal are different, it is indicated that each audio signal can correspond to different user identities, and the audio signals can be searched for meeting preset conditions according to the user identity corresponding to each audio signal, specifically, the identity information corresponding to each audio signal in the alternative audio signals is determined according to the corresponding relationship between the preset audio signals and the identity information.

Different users record audio signals in the mobile terminal in advance, for example, the audio signals input through a microphone, and then the electronic device can analyze and obtain the vibration frequency corresponding to the audio signals, so that the electronic device establishes the corresponding relationship between the preset vibration frequency and the identity information.

Therefore, the identity information corresponding to the acquired vibration frequency is determined according to the preset corresponding relation between the vibration frequency and the identity information.

Because the vibration frequency can correspond to one identity information, the specific implementation manner of judging whether the vibration information meets the preset standard may be: acquiring identity information corresponding to the vibration information; if the identity information is matched with preset identity information, judging that the vibration information meets a preset standard; and if the identity information is not matched with preset identity information, judging that the vibration information does not meet a preset standard.

The preset identity information is identity information preset in the electronic device, for example, each electronic device corresponds to a manager, the manager is generally a user of the electronic device, and the corresponding telephone number is generally a number of a SIM card in the electronic device. A preset identity information list is preset in the electronic device, and preset identity information is stored in the preset identity information list and is the identity information set by the administrator.

The preset identity information may be all the identity information in the corresponding relationship stored in the electronic device, or several identity information randomly selected from the preset identity information, or identity information with a high frequency of use for the electronic device.

In other embodiments, the determining whether the vibration information meets the preset criterion may further include: acquiring the priority of the identity information corresponding to the vibration information, judging whether the priority meets a preset priority standard, if so, judging that the vibration information meets the preset standard, and if not, judging that the vibration information does not meet the preset standard.

Specifically, the electronic device is preset with a priority corresponding to each identity information, for example, the priority may be stored in a correspondence table between the identity information and the priority, and the correspondence table stores a plurality of identity information and the priority corresponding to each identity information.

And judging whether the priority of the identity information is above a preset level when the priority of the identity information corresponding to the vibration information is acquired, wherein the preset level means that the preset level and the identity information higher than the preset level meet a preset priority standard. For example, if the preset level is level 4, the vibration information corresponding to the identity information of level 4 and higher than level 4 satisfies the preset criterion.

S303: and controlling the electronic device to unlock.

If the vibration information meets the preset standard, the sound collected by the screen is voice capable of being unlocked, for example, the sound of a user of the electronic device or a user having the authority of unlocking the electronic device is the sound of the user, and the electronic device enters the unlocking state in the screen locking state.

Specifically, as shown in fig. 4, when the electronic device is in a screen-locked state and the screen of the electronic device is not in a vibration sound-producing mode, a user inputs a voice to the screen of the electronic device, and the screen vibrates due to air vibration caused by the voice, so that the voice is collected by the vibration monitoring device. It should be noted that the user can input voice to any position of the screen without being limited to a specific position, and if the number of the vibration monitoring devices arranged under the screen is multiple and is uniformly distributed in different areas, that is, corresponding to different areas of the screen, the user can accurately acquire the vibration parameters of the voice input to any position of the screen.

After the vibration parameters meet the preset marks, the electronic device unlocks the screen, so that the user can enter a system desktop interface, the user can enter the electronic device setting interface in the interface, the vibration monitoring device is closed, and the monitoring of the vibration of the screen is stopped. Specifically, after the electronic device is unlocked, whether a closing request is acquired is judged, if the closing request is acquired, the vibration monitoring device is closed, when the electronic device is detected to enter a screen locking state and the screen does not vibrate and sound, the vibration monitoring device is started, power consumption can be saved, and adverse effects caused by the vibration monitoring device can be avoided when the screen vibrates and sounds.

In addition, the vibration monitoring device of the electronic device collects vibration information meeting preset standards, but if the user is far away from the electronic device, the user may be near the electronic device but does not have a requirement for unlocking the electronic device, and therefore the vibration information further includes vibration intensity; if the preset standard is met, the electronic device is controlled to be unlocked, and the method comprises the following steps:

if the preset standard is met, judging whether the vibration intensity is greater than a preset value; and if so, controlling the electronic device to unlock.

Wherein, the preset value is a value set by a user, or a value set by the electronic device according to a user requirement, the vibration intensity is greater than the preset value, which indicates that the user is closer to the electronic device, and is less than or equal to the preset value, which indicates that the user is farther from the electronic device, therefore, the preset value is set according to the operation distance of the user using the electronic device, for example, the distance corresponding to the vibration intensity of the preset value is L, which may be the length of the arm of the user, therefore, the preset values corresponding to different vibration frequencies are different, and when the user inputs his own voice in the electronic device, the preset value corresponding to his own operation distance is input, and after determining the vibration frequency of the screen collected by the vibration monitoring device, the preset value corresponding to the vibration frequency is determined, then, and then determining whether the vibration intensity is greater than a preset value. And if the vibration information is larger than the preset vibration information, unlocking, and if the vibration information is smaller than or equal to the preset vibration information, keeping the screen locking state and returning to execute the operation of acquiring the vibration information of the screen collected by the vibration monitoring device.

In addition, when the screen of the electronic device vibrates due to external sound, a user may not aim at the screen, which means that the user does not unlock the electronic device, and if the user still obtains the vibration information of the screen collected by the vibration monitoring device and performs subsequent operations, the electronic device is unlocked due to misoperation and resources are wasted, and further, in order to solve the problem, please refer to fig. 5, which shows that the embodiment of the present application provides a sound production control method, specifically, the method includes: s501 to S505.

S501: and when the electronic device is in a screen locking state and is not in a screen vibration sound production mode, acquiring the image acquired by the camera.

And when the electronic device is in a screen locking state and is not in a screen vibration sound production mode, starting the camera and starting an image acquisition function so as to acquire an image acquired by the camera.

As an embodiment, it is determined whether a person exists in the captured image, specifically, the image captured by the camera is obtained, a head contour is extracted from the captured image, a contour area of the head contour is determined, and if the area is greater than a preset value, it indicates that the user corresponding to the area is closer to the screen, S502 is performed.

S502: and judging whether the collected image has a face image.

As an implementation mode, an image acquired by a camera is a two-dimensional image, whether a human face image is acquired can be determined by searching whether the image has facial feature points or not, and if the image is acquired, the acquired human face image is sent to a processor of the mobile terminal, so that the processor can analyze the human face image and execute screen unlocking operation. As another embodiment, the camera includes structured light, and determines whether human face three-dimensional information exists according to three-dimensional information collected by the structured light, and if so, sends the collected image to the processor of the mobile terminal.

Further, after it is determined that the image acquired by the camera includes the face image, it may be determined whether the face image includes the mouth image, specifically, features of all contours in the face image may be extracted to fit all contour lines, and if the mouth contour is included, it is determined that the face image includes the mouth image, an operation of acquiring the vibration information of the screen acquired by the vibration monitoring device may be performed.

S503: and acquiring the vibration information of the screen collected by the vibration monitoring device.

S504: and judging whether the vibration information meets a preset standard.

S505: and controlling the electronic device to unlock.

It should be noted that, for the parts not described in detail in the above steps, reference may be made to the foregoing embodiments, and details are not described herein again.

In addition, referring to fig. 6, it is shown that the embodiment of the present application provides a sound production control method, specifically, the method includes: s601 to S605

S601: and when the electronic device is in a screen locking state and is not in a screen vibration sound production mode, acquiring an operation gesture acted on a screen.

In one embodiment, when the screen is in the screen locking state, the touch screen of the screen is in the working state, and the backlight screen is turned off, the user can input an operation gesture on the screen and the operation gesture is collected by the screen.

As another embodiment, the user lights up the screen, and after the screen is lighted up, although the electronic device is in the screen locking state, the electronic device can still detect the operation gesture input when the user operates the screen, that is, obtain the operation gesture currently acting on the screen, and in particular, the operation gesture currently acting on the screen can be detected by a program module in a system of the electronic device, for example, in the framework of Android, the operation gesture acted on the screen by the user is obtained by a geturedetector function.

S602: and judging whether the operation gesture is a preset operation gesture or not.

The preset operation gesture is pre-stored in the electronic device, and may be a gesture set by a user according to actual use, as one embodiment, a sliding gesture with a certain curve, such as a circle, a triangle, or a straight line, and as another embodiment, a sliding direction, such as sliding from the bottom to the top of the screen, or sliding from the top to the bottom, and specifically, different preset operation gestures may be set in combination with different hardware forms of the electronic device.

Illustratively, the preset operation gesture can be sliding along the top of the screen to the bottom, and can also be sliding along the bottom of the screen to the top.

S603: and acquiring the vibration information of the screen collected by the vibration monitoring device.

In one embodiment, the vibration monitoring device is in a turned-off state when the preset operation gesture is acquired, and the vibration monitoring device is turned on only when S602 is satisfied.

That is to say, when the electronic device is in a screen locking state and is not in a screen vibration sound production mode, whether a preset operation gesture is detected on the screen or not is judged, and if the preset operation gesture is detected, the vibration information of the screen collected by the vibration monitoring device is acquired.

It should be noted that the detection of the face image and the detection of the preset operation gesture may be used as a precondition for acquiring the vibration information of the screen acquired by the vibration monitoring device, that is, when the electronic device is in a screen-locked state and is not in a screen vibration sound-producing mode, the image acquired by the camera may be acquired; judging whether the collected image has a face image or not; if so, acquiring an operation gesture acting on the screen, judging whether the operation gesture is a preset operation gesture or not, and if so, acquiring the vibration information of the screen, which is acquired by the vibration monitoring device.

Of course, when the electronic device is in a screen locking state and is not in a screen vibration sound production mode, acquiring an operation gesture acting on a screen, and if the operation gesture is judged to be a preset operation gesture, acquiring an image acquired by the camera if the operation gesture is the preset operation gesture; judging whether the collected image has a face image or not; and if so, acquiring the vibration information of the screen, which is acquired by the vibration monitoring device.

S604: and judging whether the vibration information meets a preset standard.

S605: and controlling the electronic device to unlock.

Referring to fig. 7, an embodiment of the present application provides a sound control apparatus 700, specifically, the apparatus includes: an acquisition unit 701, a judgment unit 702, and an unlocking unit 703.

The obtaining unit 701 is configured to obtain the vibration information of the screen collected by the vibration monitoring device when the electronic device is in a screen locking state and is not in a screen vibration sound production mode.

A determining unit 702, configured to determine whether the vibration information meets a preset criterion.

The unlocking unit 703 is configured to control the electronic device to unlock if a preset criterion is met.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

Referring to fig. 8, an electronic device provided by an embodiment of the present application is shown, which includes a screen 120 and a vibration monitoring device 132 for monitoring vibration of the screen. The electronic device further includes: a processor 102.

The vibration monitoring device 132 is configured to, when the electronic device is in a screen-locking state and is not in a screen vibration sound production mode, acquire vibration information of the screen acquired by the vibration monitoring device, and send the vibration information to the processor;

the processor 102 is configured to determine whether the vibration information meets a preset standard, and if the vibration information meets the preset standard, control the electronic device to unlock.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and further description is omitted here

Referring to fig. 9, an electronic device 100 provided in the embodiment of the present application is shown, including: a memory 104 and a processor 102, the memory 104 coupled with the processor 102; the memory 104 stores instructions that, when executed by the processor 102, cause the processor 102 to perform the above-described method.

Referring to fig. 1 and 2, based on the above method and apparatus, the embodiment of the present application further provides an electronic apparatus 100, and the electronic apparatus 100 may be any of various types of computer system devices (only one form is exemplarily shown in fig. 1 and 2) that is mobile or portable and performs wireless communication. Specifically, the electronic apparatus 100 may be a mobile phone or a smart phone (e.g., an iPhone (TM) based phone), a Portable game device (e.g., Nintendo DS (TM), PlayStation Portable (TM), game Advance (TM), iPhone (TM)), a laptop computer, a PDA, a Portable internet device, a music player, and a data storage device, other handheld devices, and a head-mounted device (HMD) such as a watch, a headset, a pendant, a headset, and the like, and the electronic apparatus 100 may also be other wearable devices (e.g., a head-mounted device (HMD) such as electronic glasses, electronic clothes, an electronic bracelet, an electronic necklace, an electronic tattoo, an electronic device, or a smart watch).

The electronic apparatus 100 may also be any of a number of electronic devices including, but not limited to, cellular phones, smart phones, other wireless communication devices, personal digital assistants, audio players, other media players, music recorders, video recorders, cameras, other media recorders, radios, medical devices, vehicle transportation equipment, calculators, programmable remote controllers, pagers, laptop computers, desktop computers, printers, netbook computers, Personal Digital Assistants (PDAs), Portable Multimedia Players (PMPs), moving Picture experts group (MPEG-1 or MPEG-2) Audio layer 3(MP3) players, portable medical devices, and digital cameras, and combinations thereof.

In some cases, electronic device 100 may perform multiple functions (e.g., playing music, displaying videos, storing pictures, and receiving and sending telephone calls). If desired, the electronic apparatus 100 may be a portable device such as a cellular telephone, media player, other handheld device, wrist watch device, pendant device, earpiece device, or other compact portable device.

The electronic device 100 includes an electronic main body 10, and the electronic main body 10 includes a housing 12 and a main display 120 disposed on the housing 12. The housing 12 may be made of metal, such as steel or aluminum alloy. In this embodiment, the main display 120 generally includes a display panel 111, and may also include a circuit or the like for responding to a touch operation performed on the display panel 111. The Display panel 111 may be a Liquid Crystal Display (LCD) panel, and in some embodiments, the Display panel 111 is a touch screen 109.

Referring to fig. 10, in an actual application scenario, the electronic device 100 may be used as a smartphone terminal, in which case the electronic body 10 generally further includes one or more processors 102 (only one is shown in the figure), a memory 104, an RF (Radio Frequency) module 106, an audio circuit 110, a sensor 114, an input module 118, and a power module 122. It will be understood by those skilled in the art that the structure shown in fig. 10 is merely illustrative and is not intended to limit the structure of the electronic body 10. For example, the electronics body section 10 may also include more or fewer components than shown in fig. 10, or have a different configuration than shown in fig. 1 and 2.

Those skilled in the art will appreciate that all other components are peripheral devices with respect to the processor 102, and the processor 102 is coupled to the peripheral devices through a plurality of peripheral interfaces 124. The peripheral interface 124 may be implemented based on the following criteria: universal Asynchronous Receiver/Transmitter (UART), General Purpose Input/Output (GPIO), Serial Peripheral Interface (SPI), and Inter-Integrated Circuit (I2C), but the present invention is not limited to these standards. In some examples, the peripheral interface 124 may comprise only a bus; in other examples, the peripheral interface 124 may also include other elements, such as one or more controllers, for example, a display controller for interfacing with the display panel 111 or a memory controller for interfacing with a memory. These controllers may also be separate from the peripheral interface 124 and integrated within the processor 102 or a corresponding peripheral.

The memory 104 may be used to store software programs and modules, and the processor 102 executes various functional applications and data processing by executing the software programs and modules stored in the memory 104. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to the electronic body portion 10 or the primary display 120 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The RF module 106 is configured to receive and transmit electromagnetic waves, and achieve interconversion between the electromagnetic waves and electrical signals, so as to communicate with a communication network or other devices. The RF module 106 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a Subscriber Identity Module (SIM) card, memory, and so forth. The RF module 106 may communicate with various networks such as the internet, an intranet, a wireless network, or with other devices via a wireless network. The wireless network may comprise a cellular telephone network, a wireless local area network, or a metropolitan area network. The Wireless network may use various Communication standards, protocols and technologies, including, but not limited to, Global System for Mobile Communication (GSM), Enhanced Mobile Communication (Enhanced Data GSM Environment, EDGE), wideband Code division multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Wireless Fidelity (WiFi) (e.g., IEEE802.1 a, IEEE802.11 b, IEEE802.1 g and/or IEEE802.11 n), Voice over internet protocol (VoIP), world wide mail Access (Microwave for Wireless Communication), Wi-Max, and other short message Communication protocols, as well as any other suitable communication protocols, and may even include those that have not yet been developed.

The audio circuitry 110, sound jack 103, microphone 105 collectively provide an audio interface between a user and the electronic body portion 10 or the main display 120. Specifically, the audio circuit 110 may be used as the driving circuit described above if the audio circuit 110 receives sound data from the processor 102, converts the sound data into an electrical signal, and transmits the electrical signal to the exciter 131. The electric signal is used as a driving signal of the exciter 131, and the exciter 131 controls the vibration of the vibration part according to the electric signal, thereby converting the sound data into sound waves audible to human ears. The audio circuitry 110 also receives electrical signals from the microphone 105, converts the electrical signals to sound data, and transmits the sound data to the processor 102 for further processing. Audio data may be retrieved from the memory 104 or through the RF module 106. In addition, audio data may also be stored in the memory 104 or transmitted through the RF module 106.

The sensor 114 is disposed in the electronic body portion 10 or the main display 120, examples of the sensor 114 include, but are not limited to: light sensors, pressure sensors, acceleration sensors 114F, proximity sensors 114J, and other sensors.

In particular, the light sensor may comprise a light line sensor. The light sensor can adjust the brightness of the screen according to the light of the environment where the mobile terminal is located. For example, in a well-lit area, the screen may be bright, whereas in a dark area, the screen may be dark (depending on the brightness setting of the screen), which both protects the eyes and saves power.

Among them, the pressure sensor may detect a pressure generated by pressing on the electronic device 100. That is, the pressure sensor detects pressure generated by contact or pressing between the user and the mobile terminal, for example, contact or pressing between the user's ear and the mobile terminal. Thus, the pressure sensor may be used to determine whether contact or pressure has occurred between the user and the electronic device 100, as well as the magnitude of the pressure.

Referring to fig. 1 and 2 again, in particular, in the embodiment shown in fig. 1 and 2, the light sensor and the pressure sensor are disposed adjacent to the display panel 111. The light sensor may turn off the display output by the processor 102 when an object is near the main display 120, for example, when the electronic body portion 10 is moved to the ear.

As one of the motion sensors, the acceleration sensor 114F can detect the magnitude of acceleration in various directions (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping) and the like for recognizing the attitude of the electronic device 100. In addition, the electronic body 10 may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer and a thermometer, which are not described herein,

in this embodiment, the input module 118 may include the touch screen 109 disposed on the main display 120, and the touch screen 109 may collect touch operations of the user (for example, operations of the user on or near the touch screen 109 using any suitable object or accessory such as a finger, a stylus, etc.) and drive the corresponding connection device according to a preset program. Optionally, the touch screen 109 may include a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 102, and can receive and execute commands sent by the processor 102. In addition, the touch detection function of the touch screen 109 may be implemented by various types, such as resistive, capacitive, infrared, and surface acoustic wave.

The main display 120 is used to display information input by a user, information provided to the user, and various graphic user interfaces of the electronic body section 10, which may be composed of graphics, text, icons, numbers, video, and any combination thereof, and in one example, the touch screen 109 may be provided on the display panel 111 so as to be integrated with the display panel 111.

The power module 122 is used to provide power supply to the processor 102 and other components. Specifically, the power module 122 may include a power management system, one or more power sources (e.g., batteries or ac power), a charging circuit, a power failure detection circuit, an inverter, a power status indicator light, and any other components associated with the generation, management, and distribution of power within the electronic body portion 10 or the primary display 120.

The electronic device 100 further comprises a locator 119, the locator 119 being configured to determine an actual location of the electronic device 100. In this embodiment, the locator 119 uses a positioning service to locate the electronic device 100, and the positioning service is understood to be a technology or a service for obtaining the position information (e.g. longitude and latitude coordinates) of the electronic device 100 by a specific positioning technology and marking the position of the located object on the electronic map.

The electronic device 100 also includes a camera 132, and the camera 132 may be any device capable of capturing an image of an object within its field of view. The camera 132 may include an image sensor. The image sensor may be a CMOS (complementary metal Oxide Semiconductor) sensor, or a CCD (Charge-coupled device) sensor, or the like. The camera 132 may communicate with the processor 102 and send image data to the processor 102. The camera 132 may also receive command signals from the processor 102 to set parameters for capturing images. Exemplary parameters for capturing the image may include, among others, parameters for setting exposure time, aperture, image resolution/size, field of view (e.g., zoom in and out), and/or color space of the image (e.g., color or black and white), and/or for performing other types of known functions of the camera. The processor 102 may acquire the image captured by the camera 132, and may process the image, for example, to extract features in the image or perform image processing on the original image to eliminate the effect of speckle-like patterns formed by other objects. The camera 132 and the processor 102 may be connected via a network connection, bus, or other type of data link (e.g., hard wire, wireless (e.g., Bluetooth (TM)), or other connection known in the art).

To sum up, according to the sound production control method, the sound production control device, the electronic device and the computer readable medium provided by the embodiment of the application, when the electronic device is in the screen locking state and is not in the screen vibration sound production mode, the vibration information of the screen collected by the vibration monitoring device can be acquired, and if the vibration information meets the preset standard, the electronic device is controlled to be unlocked. Therefore, the user does not need extra operation, when the electronic device locks the screen, the electronic device can be unlocked by speaking the voice for unlocking towards the screen, user operation is reduced, and user experience is improved.

It should be understood that portions of the present application may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.

It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments. In addition, functional units in the embodiments of the present application may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.

The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc. Although embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application, and that variations, modifications, substitutions and alterations may be made to the above embodiments by those of ordinary skill in the art within the scope of the present application.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims

1. A sound production control method is applied to an electronic device, wherein the electronic device comprises a screen and a vibration monitoring device for monitoring the vibration of the screen, and the method comprises the following steps:

when the electronic device is in a screen locking state and is not in a screen vibration sound production mode, acquiring vibration information of the screen, which is acquired by the vibration monitoring device, wherein the vibration information comprises vibration intensity;

acquiring identity information corresponding to the vibration information;

if the identity information is matched with preset identity information, judging whether the vibration intensity is larger than a preset value, wherein the preset value is the vibration intensity corresponding to the sound of the user collected by the electronic device when the user corresponding to the identity information of the vibration information is at a specified distance from the electronic device, and the specified distance is the arm length of the user;

and if the unlocking time is greater than the preset value, controlling the electronic device to unlock.

2. The method of claim 1, wherein the vibration information further comprises a vibration frequency; the acquiring of the identity information corresponding to the vibration information includes:

and determining the identity information corresponding to the acquired vibration frequency according to the corresponding relation between the preset vibration frequency and the identity information.

3. The method of claim 1, wherein the electronic device further comprises a camera, and the camera and the screen are disposed on a same side of the electronic device; when the electronic device is in a screen locking state and is not in a screen vibration sound production mode, acquiring vibration information of the screen collected by the vibration monitoring device, including:

when the electronic device is in a screen locking state and is not in a screen vibration sound production mode, acquiring an image acquired by the camera;

judging whether the collected image has a face image or not;

and if so, acquiring the vibration information of the screen, which is acquired by the vibration monitoring device.

4. The method of claim 1, wherein obtaining the vibration information of the screen collected by the vibration monitoring device when the electronic device is in a screen-locked state and is not in a screen vibration sound-producing mode comprises:

when the electronic device is in a screen locking state and is not in a screen vibration sound production mode, judging whether a preset operation gesture is detected on the screen or not;

5. The sound production control device is applied to an electronic device, wherein the electronic device comprises a screen and a vibration monitoring device for monitoring the vibration of the screen; the sound production control device includes:

the acquisition unit is used for acquiring the vibration information of the screen, which is acquired by the vibration monitoring device, when the electronic device is in a screen locking state and is not in a screen vibration sound production mode, wherein the vibration information comprises vibration intensity;

the judging unit is used for acquiring identity information corresponding to the vibration information; if the identity information is matched with preset identity information, judging whether the vibration intensity is larger than a preset value, wherein the preset value is the vibration intensity corresponding to the sound of the user collected by the electronic device when the user corresponding to the identity information of the vibration information is at a specified distance from the electronic device, and the specified distance is the arm length of the user;

and the unlocking unit is used for controlling the electronic device to unlock if the unlocking time is greater than a preset value.

6. An electronic device comprising a screen and a vibration monitoring device for monitoring vibration of the screen and a processor;

the vibration monitoring device is used for acquiring vibration information of the screen, which is acquired by the vibration monitoring device and comprises vibration intensity, when the electronic device is in a screen locking state and is not in a screen vibration sound production mode, and sending the vibration information to the processor;

the processor is used for acquiring identity information corresponding to the vibration information; if the identity information is matched with preset identity information, judging whether the vibration intensity is larger than a preset value, wherein the preset value is the vibration intensity corresponding to the sound of the user collected by the electronic device when the user corresponding to the identity information of the vibration information is at a specified distance from the electronic device, and the specified distance is the arm length of the user; and if the unlocking time is greater than the preset value, controlling the electronic device to unlock.

7. An electronic device comprising a screen and vibration monitoring means for monitoring vibration of the screen; further comprising a memory and a processor, the memory coupled with the processor; the memory stores instructions that, when executed by the processor, cause the processor to perform the method of any of claims 1-4.

8. A computer-readable medium having program code executable by a processor, wherein the program code causes the processor to perform the method of any one of claims 1-4.