CN113660512A

CN113660512A - Audio processing method, device, server and computer readable storage medium

Info

Publication number: CN113660512A
Application number: CN202110939181.4A
Authority: CN
Inventors: 朱晓东
Original assignee: Guangzhou Boguan Information Technology Co Ltd
Current assignee: Guangzhou Boguan Information Technology Co Ltd
Priority date: 2021-08-16
Filing date: 2021-08-16
Publication date: 2021-11-16
Anticipated expiration: 2041-08-16
Also published as: CN113660512B

Abstract

The embodiment of the application discloses an audio processing method, an audio processing device, a server and a computer readable storage medium; acquiring a current user position, a target historical user position and user state information; determining the current position state of the user according to the current user position and the target historical user position; determining a user anti-disturbance state according to the current position state and the user state information; adjusting the amplitude of the original audio based on the user anti-disturbance state to obtain a processed audio; and transmitting the processed audio. In the embodiment of the application, the user anti-disturbance state is determined based on the current user position, the target historical user position and the user state information, audio frequencies with different amplitudes are pushed according to the user anti-disturbance state difference, disturbance to users is avoided, and the user viscosity is improved.

Description

Audio processing method, device, server and computer readable storage medium

Technical Field

The present application relates to the field of audio processing technologies, and in particular, to an audio processing method, an audio processing apparatus, a server, and a computer-readable storage medium.

Background

In recent years, with the rise of the network live broadcast industry, live broadcast content is rich and diversified, more and more users use terminals such as mobile phones to watch online live broadcast videos, and especially, many users watch live broadcast before sleep or during work and rest time.

However, the live broadcast is played before sleep and during work rest time, which is likely to disturb the rest of the user, cause the user to feel dislike, reduce the user viscosity, and even lead the user to uninstall the live broadcast system.

Disclosure of Invention

The embodiment of the application provides an audio processing method and device, computer equipment and a storage medium, which can determine a user anti-disturbance state according to a current user position, a target historical user position and user state information, push audio frequencies with different amplitudes according to the user anti-disturbance state difference, avoid disturbing users and improve user viscosity.

The embodiment of the application provides an audio processing method, which is suitable for a server and comprises the following steps: acquiring a current user position, a target historical user position and user state information; determining the current position state of the user according to the current user position and the target historical user position; determining a user anti-disturbance state according to the current position state and the user state information; adjusting the amplitude of the original audio based on the user anti-disturbance state to obtain a processed audio; and transmitting the processed audio.

An embodiment of the present application further provides an audio processing apparatus, including: the first acquisition module is used for acquiring the current user position, the target historical user position and the user state information; the first processing module is used for determining the current position state of the user according to the current user position and the target historical user position; the second processing module is used for determining the user anti-disturbance state according to the current position state and the user state information; the first execution module is used for adjusting the amplitude of the original audio based on the user anti-disturbance state to obtain the processed audio; and the sending module is used for sending the processed audio.

The embodiment of the application also provides a server, which comprises a memory and a server, wherein the memory stores a plurality of instructions; the processor loads instructions from the memory to execute the steps of any audio processing method provided by the embodiment of the application.

The embodiment of the present application further provides a computer-readable storage medium, where a plurality of instructions are stored, and the instructions are suitable for being loaded by a processor to perform the steps in any one of the audio processing methods provided in the embodiment of the present application.

The method comprises the steps of obtaining a current user position, a target historical user position and user state information; determining the current position state of the user according to the current user position and the target historical user position; determining a user anti-disturbance state according to the current position state and the user state information; adjusting the amplitude of the original audio based on the user anti-disturbance state to obtain a processed audio; and transmitting the processed audio. Therefore, the user anti-disturbance state is determined based on the current user position, the target historical user position and the user state information, audio frequencies with different amplitudes are pushed according to the user anti-disturbance state difference, disturbance to the user is avoided, and the user viscosity is improved. The current position state of the user is determined according to the current position of the user and the target historical position of the user, so that the historical position is added as one of the judgment elements when the current position state is determined, the user anti-disturbance state is associated with the historical position of the user, the user anti-disturbance state is more in line with the past behavior habit of the user, and the user viscosity is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1a is a schematic view of a scene of an audio processing method provided in an embodiment of the present application;

fig. 1b is a schematic flowchart of an audio processing method provided in an embodiment of the present application;

FIG. 2 is a schematic flow chart diagram of an audio processing method according to another embodiment of the present application;

fig. 3 is a schematic flowchart illustrating a process of determining an anti-disturbance state of a user when a current location state is a first state according to an embodiment of the present application;

fig. 4 is a schematic flowchart of determining an anti-disturbance state of a user when a current location state is a second state according to an embodiment of the present application.

Fig. 5 is a schematic flowchart of a method for adjusting a working mode according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of an audio processing adjustment apparatus according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of an operation mode adjustment apparatus according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of a server according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The embodiment of the application provides an audio processing method, an audio processing device, a server and a storage medium.

The audio processing apparatus may be specifically integrated in an electronic device, and the electronic device may be a terminal, a server, or the like. The terminal can be a mobile phone, a tablet Computer, an intelligent bluetooth device, a notebook Computer, or a Personal Computer (PC), and the like; the server may be a single server or a server cluster composed of a plurality of servers.

In some embodiments, the audio processing apparatus may also be integrated in a plurality of electronic devices, for example, the audio processing apparatus may be integrated in a plurality of servers, and the audio processing method of the present application is implemented by the plurality of servers.

In some embodiments, the server may also be implemented in the form of a terminal.

For example, referring to fig. 1a, in some embodiments, an audio processing system is provided, which may include a terminal 1000, a server 700, a database 3000, and a network 4000, wherein an audio processing device is integrated in the server 700 and an operation mode adjustment device is integrated in the terminal 1000. The server 700 and the terminal 1000 can perform data interaction through the network 4000, and the server 700 and the database 3000 can perform data interaction through the network 4000.

The server 700 may obtain a current user location, a target historical user location, and user status information; determining the current position state of the user according to the current user position and the target historical user position; determining a user anti-disturbance state according to the current position state and the user state information; adjusting the amplitude of the original audio based on the user anti-disturbance state to obtain a processed audio; and transmitting the processed audio. The terminal 1000 can obtain the working mode adjusting instruction from the server; and adjusting the working mode into a do-not-disturb mode in response to the working mode adjusting instruction. Database 3000 may be used to store user information, among other things. The network 4000 is used for data transmission between the server 700 and the terminal 1000, and between the server 700 and the database 3000, and the network 4000 may be a wireless network or a wired network, for example, the wireless network is a Wireless Local Area Network (WLAN), a Local Area Network (LAN), a cellular network, a 2G network, a 3G network, a 4G network, a 5G network, and the like.

The following are detailed below. The numbers in the following examples are not intended to limit the order of preference of the examples.

In this embodiment, an audio processing method is provided, and the method is applicable to a server, as shown in fig. 1b, a specific flow of the audio processing method may be as follows:

110. and acquiring the current user position, the target historical user position and the user state information.

The current user position refers to a geographical position where the user is located at the current moment, and is used for representing the current position of the user.

The target historical user location may refer to one or more target locations determined from historical geographic locations for characterizing the user historical location, where the historical geographic location refers to a geographic location at which the user was located at a historical time, which is a time prior to the current time. The target historical user location may also be a user-preset geographic location, such as a user-entered geographic location as the target historical user location, a user-entered geographic location may be a geographic location of a house, a geographic location of a company, and so on.

The user state information is used for representing the user state, and may include one or more of time information, operation behavior information, and interaction information, but is not limited to these three kinds of information. The time information refers to the time when the user uses the client at the current moment, the operation behavior information refers to the operation behavior of the user at the client, the operation behavior information can comprise clicking, volume adjustment through key pressing, voice input and the like, the interaction information is information generated when the user interacts with the live main broadcast, and the interaction information can comprise appreciation, praise, comments and the like.

In some embodiments, the current user location and the user status information may be reported to the server by the client. The target historical user position can be reported to the server after being locally determined by the client, or the target historical geographic position can be determined by the server after the historical geographic position is reported to the server by the client. The current user position, the target historical user position, the user state information and the target historical user anti-disturbance time are acquired in no fixed sequence, and can be acquired simultaneously or in a random sequence.

In some embodiments, when the user watches live historically, historical geographic locations of the user at the same time on a plurality of historical dates may be obtained, historical geographic locations of the user at one or more moments within one historical date may also be obtained, and the like. When determining the historical user positions, a position with the highest frequency of occurrence may be selected from all the obtained historical geographic positions as a target historical user position, one or more historical geographic positions obtained closest to the current time may also be selected as target historical user positions, the historical user position that remains unchanged for a preset time or longer than the preset time may also be selected as a target historical user position, the historical user position that lasts for the longest time may also be selected as a target historical user position, and the like.

120. And determining the current position state of the user according to the current user position and the target historical user position.

The current position state is used for representing the current position of the user, the current position state of the user can be the current position of the user in the target historical user, or the current position state of the user not in the target historical user, and the method for determining the current position state of the user can be to compare whether the current position of the user is the same as the target historical user.

In some embodiments, a location identification may be set for the target historical user location, such as a home or a company, and thus the current location status of the user may be whether at home or at the company, such that when the current user location is the same as the target user location, the current location status of the user is at home or at the company, and when the current user location is different from the target user location, the current location status of the user is not at home or at the company.

In some embodiments, the target historical user location may also be a user-preset geographic location, and the user may input a plurality of geographic locations and set a location identifier for the input geographic locations according to various application scenarios, for example, the user inputs geographic location 1 and geographic location 2, and the location identifiers of geographic location 1 and geographic location 2 are respectively labeled as a house and a company. Wherein the application scene may include that the user watches the live broadcast before going to sleep and that the user watches the live broadcast during the work break time, etc. And in step 120, the geographic location corresponding to the current application scene is taken as the target historical user location, for example, when the user watches live broadcast before going to sleep, the geographic location 1 is taken as the target historical user location.

130. And determining the user anti-disturbance state according to the current position state and the user state information.

The user disturbance prevention state can be a disturbance-free state or a non-disturbance state. When the user is in the anti-disturbance state, the user is in a state that disturbance of disturbance items is not allowed, wherein the disturbance items can be sounds, light rays and the like; when the user is in a state of being capable of being disturbed, the user is in a state of allowing the disturbance item to be disturbed; for example, the distracter is sound, and when the user is in the anti-disturbance state, i.e., the user does not allow the sound to be disturbed, the user can be prevented from being disturbed by the sound by reducing the loudness of the sound. The user anti-disturbance state can be determined by combining different current position states with part or all of the user state information respectively. For example, the current location state includes both the case of presence and absence of a house, and the user state information includes time information, operation behavior information, and interaction information, so that a plurality of determination rules can be established, each rule containing a different current location state and different user state information, for example, combining the presence and time information, or combining the absence and time information and operation behavior information, or combining the presence and operation behavior information and interaction information, or combining the absence and time information, operation behavior information, and interaction information, and the user disturbance prevention state is determined to be a disturbance-capable state or a disturbance-free state according to one or more of these rules.

140. And adjusting the amplitude of the original audio based on the anti-disturbance state of the user to obtain the processed audio.

The original audio is the audio sent to the client by the server, and may include the sound of the anchor, the sound effects of the applause, the whistle, the background music, and the like. The original live video can be separated into original audio and video with the audio separated out to obtain the original audio, and audio data can also be obtained. Adjusting the amplitude of the original audio may be to increase or decrease the amplitude of the original audio. The amplitude of the audio represents loudness, the loudness is larger when the amplitude is larger, the loudness is smaller when the amplitude is smaller, and the volume can be adjusted by adjusting the amplitude of the audio. For example, when the user's anti-disturbance state is the state of can disturbing, with original audio amplitude increase, improve the live volume, the user of being convenient for watches live, when the user's anti-disturbance state is the state of not disturbing, reduces original audio amplitude, reduces the live volume, avoids disturbing the user.

150. And transmitting the processed audio.

The server adjusts the original audio and sends the processed audio to the client, wherein the processed audio can be sent to the client independently and locally synthesized by the client, or the processed audio and the video separated from the audio can be sent to the client after being combined.

The audio processing scheme provided by the embodiment of the application can be applied to various scenes in which a user watches live broadcast. For example, taking a scene that a user watches live broadcasting before sleeping as an example, the user watches live broadcasting before sleeping through a client, a server acquires a current user position, a target historical user position and user state information, determines a current position state of the user, such as whether the user is in a house or not, according to the current user position and the target historical user position, determines an anti-disturbance state of the user according to the current position state and the user state information, adjusts the amplitude of original audio based on the anti-disturbance state of the user, obtains processed audio, and sends the processed audio. By adopting the scheme provided by the embodiment of the application, the current position state of the user can be determined according to the current user position and the target historical user position, so that the historical position is added as one of the judgment elements when the current position state is determined, the user anti-disturbance state is associated with the historical position of the user, the user anti-disturbance state is more consistent with the past behavior habit of the user, meanwhile, the user anti-disturbance state is determined according to the current user position, the target historical user position and the user state information, different amplitudes of audio are pushed according to the user anti-disturbance state difference, the user is prevented from being disturbed, and the user viscosity is improved.

The method described in the above embodiments is further described in detail below.

As shown in fig. 2, a specific flow of an audio processing method is as follows:

210. and acquiring the current user position, the target historical user position and the user state information.

In some embodiments, step 210 may include steps 211 and 212, as follows:

211. and acquiring the current time.

212. And when the current time is within a preset second disturbance prevention time period, acquiring the current user position, the target historical user position and the user state information.

The current time refers to the time of the current time, and when the server acquires the current time, the server may acquire the current time from the client, or the server may acquire the current time locally, or the like.

The preset second disturbance prevention period refers to a preset period of time during which the user may want to enter a do-not-disturb state. For example, when the application scenario is that the user watches live broadcasting before falling asleep, the user anti-disturbance state may be whether the user falls asleep, and the no-disturbance state is that the user has fallen asleep, and the preset second anti-disturbance time period may be a user sleep time period; when the application scene is that the user watches the live broadcast in the work rest time, the user anti-disturbance state can be whether the user starts working, the no-disturbance state is that the user starts working, and the preset second anti-disturbance time period can be the user working time period. The preset second disturbance prevention time period may be set manually by a user or automatically by a system, which is not limited in the embodiment of the present application.

In some embodiments, the preset second anti-disturb time period may be a time period within a day or a time period across days.

In some embodiments, when the current user position is obtained within the preset second disturbance prevention time period, when the client accesses the server within the preset second disturbance prevention time period, the current user position is obtained from the access time, and when the client accesses the server before the preset second disturbance prevention time period, the current user position is obtained from the start time of the second disturbance prevention time period.

In some embodiments, obtaining the current user location, the target historical user location, and the user status information in step 212 may include steps a and B, as follows:

A. acquiring a current user position;

B. and when the current user position is the effective current user position, acquiring the target historical user position and the user state information.

The valid current user position may be a user position at the current moment, or may also be a current user position that is unchanged for a period of time, for example, when the current user position is obtained, a continuously same current user position in the current user position is determined, and the continuously same current user position is taken as the valid current position. And when the obtained current position is the effective current user position, executing the operation of obtaining the target historical user position and the user state information, and taking the effective current user position as the current user position in the subsequent step. All the mentioned locations in this embodiment may be IP positioning locations, or may be GPS locations.

In some embodiments, step B may comprise steps (1.1) to (1.3), as follows:

(1.1) determining continuously identical current user positions among the current user positions;

(1.2) determining the earliest acquisition time and the latest acquisition time corresponding to the continuously same current user positions, and calculating a second time difference value between the earliest acquisition time and the latest acquisition time;

and (1.3) when the second time difference is greater than or equal to a preset second difference, determining the continuous same current user position as an effective current user position, and acquiring the target historical user position and the user state information.

The position that stops for a certain duration with the user is effective current user position, no matter use before just sleeping or work rest time, increases the judgement to user stop certain position time, more can match the action that the user did not disturb constantly in history, promotes user experience and feels, increases user's viscosity, has also reduced the user simultaneously and has temporarily stopped unnecessary judgement process when a certain position.

In some embodiments, the target historical user location is obtained, which may be a preset location for the server or the user, or determined according to the historical location, or a stored target historical user location is obtained from the server, and so on.

In some embodiments, a place identifier may be set for the target historical user location according to the application scenario, for example, when the application scenario is that the user watches live broadcasting before sleeping, the place identifier of the target historical user location may be marked as a house or a non-house, and when the application scenario is that the user watches live broadcasting at work rest time, the place identifier of the target historical user location may be marked as a company or a non-company.

In some embodiments, the method for obtaining the historical user location of the target in step 210 may include steps (2.1) and (2.2), as follows:

and (2.1) acquiring the candidate historical geographic position.

In some implementations, the candidate historical geographic locations include at least one of a location where the user was located at a time of the client historical turn-off, a location where the user was located at a time of the client historical screen-blanking, and a valid historical user location.

The position of the user at the time of historical closing of the client and the position of the user at the time of historical information screen of the client can represent the position of the user at the time of finishing watching the live broadcast, and the time can represent that the user enters or will enter a do-not-disturb state. The effective historical user position can be preset by a server or a user, and can also be determined according to the historical position.

In some embodiments, the valid historical user locations are obtained by:

a. acquiring the position of a user in a historical preset first disturbance prevention time period;

b. determining continuous same user positions in the obtained user positions;

c. determining the earliest acquisition time and the latest acquisition time corresponding to the same continuous user positions, and calculating a first time difference value between the earliest acquisition time and the latest acquisition time;

d. and when the first time difference value is greater than or equal to a preset first difference value, determining the continuously same user position as the effective historical user position.

The historical preset first disturbance prevention time period may refer to a preset first disturbance prevention time period within a historical date, or may refer to a preset first disturbance prevention time period before the current time, that is, the preset first disturbance prevention time period within the historical date and the time period within the preset first disturbance prevention time period and before the current time within the current date are included, and the like. The preset first disturbance prevention period of the historical preset first disturbance prevention periods refers to a preset period of time during which the user may want to enter a do-not-disturb state. For example, when the application scenario is that the user watches live broadcasting before falling asleep, the user anti-disturbance state may be whether the user falls asleep, and the no-disturbance state is that the user has fallen asleep, and the preset first anti-disturbance time period may be a user sleep time period; when the application scene is that the user watches the live broadcast in the work rest time, the user anti-disturbance state can be whether the user starts working, the no-disturbance state is that the user starts working, and the preset first anti-disturbance time period can be the user working time period.

Wherein to the position that the user stayed for a certain duration be effective historical user position, reduce the volume of the historical position of collecting on the one hand, reduce data processing volume, on the other hand, no matter use before sleeping or work rest time, increase the judgement that stops certain position time to the user, more can match the user and exempt from the behavioral habit of disturbing moment in history, promote user experience and feel, increase user's viscosity.

In some embodiments, the preset first anti-disturbance time period may be a time period within a day or a time period across days.

In some embodiments, obtaining the user location within a historical preset first anti-disturb time period comprises: and acquiring the user positions in the preset first disturbance prevention time period of all historical dates.

In some embodiments, obtaining the user location within a historical preset first anti-disturb time period comprises: and acquiring the user positions of the users in the first anti-disturbance time periods of all historical dates, and acquiring the user positions of the users at the historical moment in the preset first anti-disturbance time period of the current historical date.

In some embodiments, when the user location is obtained within the historical preset first disturbance prevention time period, the user location may be obtained at preset time intervals, and a plurality of user locations may be obtained. And if the plurality of acquired user positions do not exist, the subsequent judgment process is executed.

In some embodiments, the location of the user at the time of the historical closing of the client and the location of the user at the time of the historical screen-off of the client are obtained within a historical preset first disturbance prevention time period.

In some embodiments, the preset first anti-disturb time period and the preset second anti-disturb time period are the same time period.

And (2.2) determining the target historical user position according to the candidate historical geographic positions.

In some embodiments, the candidate historical geographic location that appears most frequently in all candidate historical geographies is determined to be the target historical user location.

220. And determining the current position state of the user according to the current user position and the target historical user position.

In some embodiments, a user watches live at work break, marks the target historical user location as corporate or non-corporate, and determines the current location status as corporate or non-corporate depending on the current user status.

In some embodiments, a user watches a live broadcast just before sleep, marks a target historical user location as residential or non-residential, and determines a current location status as residential or non-residential depending on a current user status.

In some embodiments, step 220 may include steps 221 and 222, as follows:

221. when the current user position is the same as the target historical user position, determining the current position state of the user as a first state;

222. and when the current user position is not the same as the target historical user position, determining the current position state of the user as a second state.

When the application scene is that the user watches the live broadcast before falling asleep, the first state is in the house, and the second state is not in the house. When the application scene is that the user watches the live broadcast in the work rest time, the first state is that the user is at the company, and the second state is that the user is not at the company.

In some embodiments, the same location means the same latitude and longitude of the location, and the different locations means the different latitude and longitude of the location.

230. And determining the user anti-disturbance state according to the current position state and the user state information.

The user anti-disturbance state comprises a plurality of judgment rules including a current position state and user state information, the judgment result of each judgment rule corresponds to one situation of the user anti-disturbance state, when the user anti-disturbance state is determined, the current position state is determined to be in which state, for example, in a house or not, and is cross-compared with specific information in the user state information, the current position state and the acquired user state information meet which judgment rule, and the situation meeting the user anti-disturbance state is determined according to the judgment result, so that the user anti-disturbance state is determined.

In some embodiments, the user status information in step 230 includes the current time, and step 230 may include steps 231-232 as follows:

231. and obtaining the anti-disturbance time of the target historical user.

The target historical user anti-disturbance time refers to the time when one or more users enter or are about to enter a do-not-disturb state, which is determined from the historical time, and is used for representing the user anti-disturbance time, for example, when an application scene is that the user watches live broadcast before falling asleep, the target historical user anti-disturbance time is used for representing the user falling asleep time; when the application scene is that the user watches the live broadcast at the work rest time, the target historical user anti-disturbance time is used for representing the work start time of the user.

The target historical user anti-disturbance time is obtained, and may be time preset for the server or the user, or may be determined according to the historical time, or may be the target historical user anti-disturbance time obtained from the server. For example, the server obtains the target historical user anti-disturbance time before step 230, and calls the target historical user anti-disturbance time stored in the server in step 230, such as obtaining the current user position, the target historical user position, the user status information, and the target historical user anti-disturbance time at the same time in step 210, or obtaining candidate historical anti-disturbance times, and determining the target historical user anti-disturbance time according to the candidate historical anti-disturbance times.

In some embodiments, step 231 may include steps (3.1) - (3.2), as follows:

(3.1) obtaining candidate historical disturbance prevention time, wherein the candidate historical disturbance prevention time comprises at least one of client historical closing time and client historical screen-off time;

and (3.2) determining the target historical user anti-disturbance time according to the candidate historical anti-disturbance time.

The candidate historical disturbance prevention time with the highest occurrence frequency in all the candidate historical disturbance prevention times can be determined as the target historical user disturbance prevention time, the median of the candidate historical disturbance prevention time can be determined as the target historical user disturbance prevention time, the time with a preset time interval from the median of the candidate historical disturbance prevention time can be used as the target historical disturbance prevention time, and the like.

232. And when the current position state is the first state, determining the user anti-disturbance state according to the current time and the target historical user anti-disturbance time.

In some embodiments, the current location state is at home or at a company, and determining whether the user has reached a sleep time or a work time based on the current time and a target historical user anti-disturb time to determine the user anti-disturb state.

In some embodiments, the user anti-disturb state includes a do-not-disturb state and a disturb-able state, and the determining the user anti-disturb state in step 231 based on the current time and the target historical user anti-disturb time may include steps (4.1) - (4.2) as follows:

(4.1) when the current time is not earlier than the target historical user anti-disturbance time, determining the user anti-disturbance state as a do-not-disturbance state;

and (4.2) when the current time is earlier than the target historical user anti-disturbance time, determining the user anti-disturbance state as a disturbance-capable state.

When the current position state is at home or at a company and the current time is not earlier than the target historical user disturbance prevention time, namely the sleep time is reached or the working time is reached, the user is in a disturbance-free state. And when the current time is earlier than the target historical user disturbance prevention time, namely the sleep time is not reached or the working time is not reached, the user is in a disturbance-capable state.

In some embodiments, the user status information in steps 231-232 further includes current user operation behavior.

In some embodiments, the user status information in step 230 includes the current time and the current user operation behavior, and step 230 may include steps 233-234 as follows:

233. and obtaining the anti-disturbance time of the target historical user.

The method for obtaining the anti-disturbance time of the target historical user in step 233 is the same as that in step 231, and is not described herein again.

234. And when the current position state is the second state, determining the user anti-disturbance state according to the current time, the target historical user anti-disturbance time, the current user operation behavior and the preset user operation behavior.

In some embodiments, when the current location state is not at home or not at a company, determining whether the user reaches the sleep time or the working time according to the current time, the target historical user anti-disturbance time, the current user operation behavior and the preset user operation behavior to determine the user anti-disturbance state. The user operation behavior may include at least one of clicking, adjusting volume by pressing a key, inputting voice, and the like, and the preset user operation behavior may be a user non-operation behavior in a preset time period, or a number of times that the user performs an operation behavior in the preset time period is lower than a number of times.

In some embodiments, the user anti-disturb state includes a do-not-disturb state and a disturb-able state, and the determining the user anti-disturb state in step 234 is based on the current time, the target historical user anti-disturb time, the current user action, and the preset user action, and may include steps (5.1) - (5.3) as follows:

(5.1) when the current time is not earlier than the target historical user disturbance prevention time and when the current user operation behavior is a preset user operation behavior, determining the user disturbance prevention state as a disturbance-free state;

(5.2) when the current time is not earlier than the target historical user disturbance prevention time and the current user operation behavior is not the preset user operation behavior, determining the user disturbance prevention state as a disturbance-allowable state;

and (5.3) when the current time is earlier than the target historical user anti-disturbance time, determining the user anti-disturbance state as a disturbance-capable state.

In some embodiments, the user is a do-not-disturb state when the current location state is no-home or no-business, and the current time does not reach the sleep time or the working time, and the user has no operation for a preset period of time or the number of operations is below a preset number. When the current position state is not at home or at a company, the current time reaches the sleep time or does not reach the working time, and the user has operation in a preset time period or the operation times are higher than the preset times, the user is in a state of being capable of being disturbed. When the current position state is not at home or at a company and the current time does not reach the sleep time or the working time, the user is in a state of being capable of being disturbed no matter whether the user has operation behaviors or not.

In some embodiments, in determining the user anti-disturb state from the current location state and the user state information, the decision process is not limited to the order of steps in step 220 and step 230.

240. And adjusting the amplitude of the original audio based on the anti-disturbance state of the user to obtain the processed audio.

The volume of the sound is influenced by the amplitude of the audio, the sound with different sizes and frequencies can be generated in the live broadcast room during live broadcast, and the volume of different sounds can be adjusted by adjusting the amplitude, so that the user is prevented from being disturbed.

In some embodiments, adjusting the amplitude of the original audio may be increasing or decreasing the amplitude of the original audio, and increasing or maintaining the amplitude of the original audio when the user is in a state of being harassment. When the user is in a do-not-disturb state, the amplitude of the original audio is reduced.

In some embodiments, adjusting the amplitude of the original audio may be adjusting the amplitude of the audio of the segment, adjusting the amplitude of the audio of the portion, and so on.

In some embodiments, step 240 may include step 241, as follows:

241. and when the user disturbance prevention state is a disturbance-free state, adjusting the amplitude of the original audio to obtain the processed audio.

In some embodiments, adjusting the amplitude of the original audio in step 241 to obtain the processed audio may include steps C and D, as follows:

C. the audio signal of the original audio is segmented to obtain a plurality of audio sub-signals.

D. And when the amplitude of the audio sub-signal is greater than the preset amplitude threshold, compressing the audio sub-signal exceeding the preset amplitude threshold to obtain the processed audio.

The original audio may be segmented according to a preset time period, a frame, a random time interval, and so on. The preset amplitude threshold may be a value preset by a server or a user.

In some embodiments, after the audio signal is segmented, the maximum amplitude of each audio sub-signal is obtained, and when the maximum amplitude exceeds a preset amplitude threshold, the audio sub-signal is compressed.

In some embodiments, when the user's anti-disturbance state is a disturbance-enabled state, the operation of adjusting the amplitude of the original audio to obtain the processed audio is not performed.

250. And transmitting the processed audio.

In some embodiments, the server may send the processed audio alone to the client, may send the processed audio to the client in combination with the video from which the audio was separated, and so on.

260. And generating an operating mode adjusting instruction.

In some embodiments, step 260 may include the steps of:

and when the user disturbance prevention state is a disturbance-free state, generating a working mode adjusting instruction.

In some embodiments, the operational mode adjustment instructions may include instructions to adjust the client operational mode to a do-not-disturb mode, the do-not-disturb mode including displaying a window on the client display interface for closing the do-not-disturb mode, the user closing the do-not-disturb mode by clicking on the window for closing the do-not-disturb mode, the operational mode adjustment instructions may also include instructions to close the client shake interface.

In some embodiments, step 260 may be performed after step 250, before step 250, simultaneously with step 250, and so on.

270. And sending the working mode adjusting instruction to the client so that the client can adjust the working mode into a do-not-disturb mode according to the working mode adjusting instruction.

In some embodiments, the server sends the working mode adjusting instruction to the client, and when the user anti-disturbance state is the do-not-disturbance state, the client adjusts the working mode to the do-not-disturbance mode.

In some embodiments, the do-not-disturb mode may be marked as a sleep-aid mode when the application scenario is that the user watches the live broadcast immediately before sleep, and the do-not-disturb mode may be marked as a working mode when the application scenario is that the user watches the live broadcast during a working rest time.

The audio processing scheme provided by the embodiment of the application determines whether the user is in a disturbing state or a non-disturbing state through the current position state and the user information state, and outputs the audio amplitude according to adjustment, so that the output audio volume is kept in a stable and low-loudness state through compressing the audio sub-signals which are output to the client audio and exceed the preset amplitude threshold value, the disturbance to the user is avoided, and the user viscosity is improved. Aiming at different application scenes and different user disturbance-free states, differentiated audio pushing is achieved, the working mode of the client is adjusted, the user work can be prevented from being disturbed under different situations, and the user viscosity is improved.

In this embodiment, the method of the embodiment of the present application will be described in detail by taking an example in which a user watches a live scene before going to sleep.

As shown in fig. 3 and 4, a specific flow of an audio processing method is as follows:

310. and acquiring the current time.

320. And when the current time is within a preset second disturbance prevention time period, acquiring the current user position, the target historical user position and the user state information. The user state information includes a current time and a current user operation behavior.

Wherein the second anti-disturb time period may be set manually by a user, may be set automatically by the system, and so on. For example, in this embodiment, the second anti-disturbance time period may be set to 23:00 to 6:00, and if the obtained current time is 24:00, it is determined that the current time is within the second anti-disturbance time period.

The method for acquiring the target historical user position in the step 320 can include steps 321-322 as follows:

321. candidate historical geographic locations within a historical preset first do not disturb time period are obtained.

The preset first anti-disturbance time and the preset second anti-disturbance time can be the same or different. In this embodiment, the preset first disturbance prevention time and the preset second disturbance prevention time may be set to any values according to the sleep pattern of the user. For example, the preset first anti-disturbance time and the preset second anti-disturbance time are set to be 23: 00-6: 00, the place identification of the target historical user position is recorded as a house, and the candidate historical geographic position obtained in the history is marked as a common house position.

The candidate historical geographic positions comprise the position of the user at the time of historical closing of the client, the position of the user at the time of historical screen turning-off of the client and the effective historical user position, wherein the position of the user is obtained in the historical preset first disturbance prevention time period.

In a historical preset first disturbance prevention time period, for example, when a client is closed or the client turns off the screen within 23: 00-6: 00, the user is about to sleep or just falls asleep, and therefore the position of the user at the time of historical closing of the client and the position of the user at the time of historical turning off of the client are also marked as a common residential position.

The effective historical user position is obtained by the following method:

b. determining continuous same user positions in the obtained user positions;

The multiple user positions may be obtained within a preset first disturbance prevention time period, for example, the sequence including the multiple user positions obtained according to the preset time interval is: position 1-position 2-position 1-position 3-position 2, determining position 1-position 1 as continuous same user positions, wherein the acquisition time of the first position 1 in position 1-position 1 is the earliest acquisition time, and the acquisition time of the last position 1 is the latest acquisition time.

In this embodiment, the preset first difference may be set to any value that satisfies the behavior rule of the user. For example, a preset first difference value is set to be 30min, and when the first time difference value of position 1-position 1 is 35min, position 1 can be determined as a valid historical user position.

322. And determining the position with the highest frequency in the candidate historical geographic positions as the target historical user position.

And counting all the candidate historical geographic positions, sorting according to the times from high to low or from low to high, selecting the position with the highest frequency as the position of the target user, and recording the place identification of the target historical user as the house. For example, when all candidate historical geographic positions are counted, position 1 appears 5 times, position 2 appears 10 times, and position 3 appears 1 time, and after the sequence, position 2, position 1, and position 3 are arranged in sequence, and the place identifier of position 2 is recorded as a house.

330. When the current user position is the same as the target historical user position, determining the current position state of the user as a first state, and executing steps 340-350;

in this embodiment, the current user location is the same as the target historical user location, i.e., the current user location is home, so the first state is that the user is in home.

340. And obtaining the anti-disturbance time of the target historical user.

Step 340 may include steps E-F, as follows:

E. obtaining candidate historical disturbance prevention time, wherein the candidate historical disturbance prevention time comprises at least one of historical closing time of a client and historical screen-off time of the client;

F. and determining the anti-disturbance time of the target historical user according to the median of the candidate historical anti-disturbance time.

In this embodiment, the median of the candidate historical anti-disturbance time may be determined as the target historical user anti-disturbance time, or a time having a preset time interval with the median of the candidate historical anti-disturbance time may be determined as the target historical anti-disturbance time, and so on. For example, the closing times of the clients of the users on different historical dates are obtained and are sorted from small to big: 23:50, 1:00, 1:30, 1:35 and 1:45, taking 1:30 as a median, taking 0:30 of the previous hour of 1:30 as the target historical user anti-disturbance time, and taking the average value of the middle two numbers in the ranking as the median when the acquired candidate historical anti-disturbance time is even.

In some embodiments, a time that is before the median of the candidate historical anti-disturb times and has a preset time interval from the time represented by the median is determined as the target historical anti-disturb time. When the client is closed or turned off, the user is likely to enter the sleep state, the time for the user to go to sleep can be set as the target historical disturbance prevention time through the preset time interval, and the situation that the target historical disturbance prevention time is set too late to cause disturbance to the user when the user falls asleep is avoided.

350. And determining the user anti-disturbance state according to the current time and the target historical user anti-disturbance time. The user anti-disturb state includes a do-not-disturb state and a disturb-able state.

Step 350 may include steps 351-352, as follows:

351. and when the current time is not earlier than the target historical user disturbance prevention time, determining the user disturbance prevention state as a disturbance-free state, and executing the steps G-K.

In this embodiment, if the current time is not earlier than the target historical user disturbance prevention time, it may be determined that the current time is within the user sleep time period, it may be determined that the user is about to fall asleep or has entered sleep, and the user disturbance prevention state may be determined as a do-not-disturb state.

G. Segmenting an audio signal of an original audio to obtain a plurality of audio sub-signals;

H. when the amplitude of the audio sub-signal is larger than a preset amplitude threshold value, compressing the audio sub-signal exceeding the preset amplitude threshold value to obtain a processed audio;

I. transmitting the processed audio;

J. generating a working mode adjusting instruction;

K. and sending the working mode adjusting instruction to the client so that the client can adjust the working mode into a do-not-disturb mode according to the working mode adjusting instruction.

If all the output audio signals are processed, the data processing amount is large, which may cause the audio signals to be sent to the client in a delayed manner, and cause the client to pause in the live broadcasting process. In this embodiment, therefore, the original audio signal is segmented and only the audio sub-signals exceeding the preset amplitude threshold are processed. For example, the original audio signal is divided into a plurality of audio sub-signals by 10ms each segment, the maximum amplitude of each segment of audio sub-signal is obtained, and when the maximum amplitude of a certain segment of audio sub-signal exceeds 30dB, the amplitude of the segment of audio sub-signal is compressed. Only the audio sub-signals exceeding the preset amplitude threshold are processed, the output audio volume can be kept in a stable state, and the stable and low sound is also beneficial to promoting the sleep of the user.

In this embodiment, the operating mode adjustment instruction may include adjusting the client operating mode to a do-not-disturb mode, the do-not-disturb mode including displaying a window on the client display interface for closing the do-not-disturb mode, and the user may close the do-not-disturb mode by clicking on the window for closing the do-not-disturb mode. A window for closing the do-not-disturb mode may be displayed in a lower right portion of the client display interface. The operating mode adjustment instructions may also include instructions to shut down the client shaking interface. When the user disturbance prevention state is determined to be a disturbance-free state, the server compresses the amplitude of the output audio and closes the vibration interface, so that huge sound generated suddenly in a live broadcast room is avoided, or a live broadcast platform triggers a vibration effect generated by certain feedback, and disturbance of the user is avoided. The embodiment is applied to the situation that the user watches live broadcast before falling asleep, and can mark the do-not-disturb mode as the sleep-aid mode.

352. And when the current time is earlier than the target historical user anti-disturbance time, determining the user anti-disturbance state as a disturbance-allowable state.

In this embodiment, if the current time is earlier than the target historical user disturbance prevention time, it may be determined that the user does not enter the sleep state, and the user disturbance prevention state may be determined as a disturbance-allowable state.

360. And when the current user position is different from the target historical user position, determining the current position state of the user as a second state, and executing steps 370-380.

In this embodiment, when the current user location is different from the target historical user location, that is, the current user location is not in the house, the first state is that the user is not in the house.

370. And obtaining the anti-disturbance time of the target historical user. The method for obtaining the anti-disturbance time of the target historical user in step 340 is the same as that in step 340, and is not described herein again to avoid repetition.

380. And determining the user anti-disturbance state according to the current time, the target historical user anti-disturbance time, the current user operation behavior and the preset user operation behavior. The user anti-disturb state includes a do-not-disturb state and a disturb-able state.

Step 380 may include steps 381 through 385 as follows:

381. and determining whether the current time is not earlier than the target historical user disturbance prevention time, executing steps 382-384 when the current time is not earlier than the target historical user disturbance prevention time, and executing step 385 when the current time is earlier than the target historical user disturbance prevention time.

382. And determining whether the current user operation behavior is a preset user operation behavior.

383. And when the current user operation behavior is the preset user operation behavior, determining the user anti-disturbance state as a do-not-disturb state, and executing the steps G-K.

384. And when the current user operation behavior is not the preset user operation behavior, determining the user anti-disturbance state as a disturbance-allowable state.

385. And when the current time is earlier than the target historical user anti-disturbance time, determining the user anti-disturbance state as a disturbance-allowable state.

When the user is not in the house, the user anti-disturbance state is determined by combining the current time, the target historical user anti-disturbance time, the current user operation behavior and the preset user operation behavior. The user operation behavior may include at least one of clicking, adjusting volume through a key, and voice input. For example, when the target historical user anti-disturbance time is 0:30, the preset user operation behavior is that the user does not click within 10min, when the current time is 1:00 and the user does not click within 10min, the user anti-disturbance state is determined as a do-not-disturbance state, when the current time is 1:00 and the user clicks within 10min, the user anti-disturbance state is determined as a disturbance-capable state, and when the current time is 24:00, the user anti-disturbance state is determined as a disturbance-capable state no matter whether the user clicks within 10min or not.

In some embodiments, the client automatically turns off the do-not-disturb mode when the client is turned off, and the server resumes executing the audio processing method provided by the embodiments of the present application when the client is turned back on.

In some embodiments, steps G-K are not performed when the user anti-disturb state is determined to be a disturb-able state in steps 350 and 370. The server sends the original audio to the client, and the client keeps the original working mode.

The audio processing scheme provided by the embodiment of the application takes the current position state as a front judgment condition after acquiring the current position state and the user information state of the user, determines whether the user is in a disturbing state or a do-not-disturb state according to the time and the operation behavior in the user information state as judgment bases, compresses the amplitude of audio output to the client when the user is in the do-not-disturb state, and adjusts the working mode of the client. Therefore, the scheme provided by the embodiment of the application can judge whether the user is in the house currently according to the current and historical user position information, and determines whether the audio is the audio differentially pushed by the user according to the current disturbance-free state of the user and the fact that the user is in the house currently, and adjusts the working mode of the client, so that the sleep of the user is prevented from being disturbed, and the user viscosity is improved. In addition, the historical geographic position is used as one of the judgment elements when the current position state is determined, and the element of the historical user anti-disturbance time is added when the user anti-disturbance state is determined, so that the obtained user anti-disturbance state integrates the historical behavior elements of the historical position and the historical anti-disturbance time, the obtained user anti-disturbance state is more in line with the past behavior habits of the user, the accuracy of judging the user state is improved, and the user viscosity can be improved. When the amplitude of the audio output to the client is compressed, only the audio sub-signals exceeding the preset amplitude threshold value are processed, the volume of the output audio can be kept in a stable state, and a sleep environment is created by pushing the stable and low-loudness audio to the client, so that the user is prevented from being disturbed, and the user viscosity is improved.

In this embodiment, a method for adjusting a working mode is provided, where the method is applicable to a client, and as shown in fig. 5, a specific process of the method for adjusting a working mode may be as follows:

410. and acquiring a working mode adjusting instruction.

In some embodiments, the client may receive the operating mode adjustment instruction and audio sent by the server.

420. And adjusting the working mode into a do-not-disturb mode in response to the working mode adjusting instruction.

In some embodiments, the client receives an operation mode adjustment instruction, and adjusts the operation mode of the client to a do-not-disturb mode according to the operation mode adjustment instruction.

In the embodiment of the application, the client receives the working mode adjusting instruction, the working mode is adjusted to be the no-disturbance mode, the situation that the playing content of the client disturbs a user during live broadcasting is avoided, and the user viscosity is improved.

In order to better implement the method, an embodiment of the present application further provides an audio processing apparatus, where the audio processing apparatus may be specifically integrated in an electronic device, and the electronic device may be a terminal, a server, or the like. The terminal can be a mobile phone, a tablet computer, an intelligent Bluetooth device, a notebook computer, a personal computer and other devices; the server may be a single server or a server cluster composed of a plurality of servers.

For example, in the present embodiment, the method of the present embodiment will be described in detail by taking an example in which an audio processing device is specifically integrated in an electronic device.

For example, as shown in fig. 6, the audio processing apparatus may include a first obtaining module 510, a first processing module 520, a second processing module 530, a first executing module 540, and a transmitting module 550. Wherein:

first obtaining module 510:

the method is used for acquiring the current user position, the target historical user position and the user state information.

In some embodiments, the first obtaining module 510 may be further configured to:

acquiring current time;

and when the current time is within a preset second disturbance prevention time period, acquiring the current user position, the target historical user position and the user state information.

In some embodiments, obtaining the current user location, the target historical user location, and the user status information comprises:

acquiring a current user position;

and when the current user position is the effective current user position, acquiring the target historical user position and the user state information.

In some embodiments, when the current user location is a valid current user location, obtaining the target historical user location and the user status information may include:

determining continuous same current user positions in the current user positions;

determining the earliest acquisition time and the latest acquisition time corresponding to the continuously same current user positions, and calculating a second time difference value between the earliest acquisition time and the latest acquisition time;

and when the second time difference is greater than or equal to a preset second difference, determining the continuously same current user position as an effective current user position, and acquiring the target historical user position and the user state information.

In some embodiments, the method for acquiring the target historical user location may include steps (6.1) to (6.2), as follows:

and (6.1) obtaining candidate historical geographic positions, wherein the candidate historical geographic positions comprise at least one of the position of the user at the moment when the client is in the historical closing state, the position of the user at the moment when the client is in the historical screen displaying state and the effective historical user position.

In some embodiments, the valid historical user locations are obtained by:

b. determining continuous same user positions in the obtained user positions;

And (6.2) determining the target historical user position according to the candidate historical geographic positions.

(ii) first processing module 520:

and the system is used for determining the current position state of the user according to the current user position and the target historical user position.

In some embodiments, the first processing module 520 may be configured to:

when the current user position is the same as the target historical user position, determining the current position state of the user as a first state;

and when the current user position is not the same as the target historical user position, determining the current position state of the user as a second state.

(iii) the second processing module 530:

and the user anti-disturbance state is determined according to the current position state and the user state information.

In some embodiments, the user status information includes the current time, and the second processing module 530 may be used for steps (7.1) - (7.2) as follows:

and (7.1) acquiring the target historical user anti-disturbance time.

In some embodiments, obtaining the target historical user anti-disturb time may include the steps of:

a. obtaining candidate historical disturbance prevention time, wherein the candidate historical disturbance prevention time comprises at least one of historical closing time of a client and historical screen-off time of the client;

b. and determining the target historical user anti-disturbance time according to the candidate historical anti-disturbance time.

And (7.2) when the current position state is the first state, determining the user anti-disturbance state according to the current time and the target historical user anti-disturbance time.

In some embodiments, the user anti-disturb state includes a do-not-disturb state and a disturb-able state, and determining the user anti-disturb state based on the current time and the target historical user anti-disturb time may include steps (8.1) - (8.2) as follows:

(8.1) when the current time is not earlier than the target historical user anti-disturbance time, determining the user anti-disturbance state as a do-not-disturbance state;

(8.2) determining the user anti-disturb state as the harassment capable state when the current time is earlier than the target historical user anti-disturb time.

In some embodiments, the user status information includes the current time and the current user operation behavior, and the second processing module 530 may be used in steps (9.1) - (9.2), as follows:

(9.1) obtaining the anti-disturbance time of the target historical user;

the method for obtaining the target historical user disturbance prevention time is the same as the method for obtaining the target historical user disturbance prevention time, and is not described herein again.

And (9.2) when the current position state is the second state, determining the user anti-disturbance state according to the current time, the target historical user anti-disturbance time, the current user operation behavior and the preset user operation behavior.

In some embodiments, the user anti-disturb state includes a do-not-disturb state and a disturb-able state, and the determining the user anti-disturb state based on the current time, the target historical user anti-disturb time, the current user operation behavior, and the preset user operation behavior may include steps (10.1) - (10.3) as follows:

(10.1) when the current time is not earlier than the target historical user anti-disturbance time and when the current user operation behavior is the preset user operation behavior, determining the user anti-disturbance state as a do-not-disturbance state;

(10.2) when the current time is not earlier than the target historical user disturbance prevention time and the current user operation behavior is not the preset user operation behavior, determining the user disturbance prevention state as a disturbance-allowable state;

(10.3) determining the user anti-disturb state as the harassment capable state when the current time is earlier than the target historical user anti-disturb time.

(IV) the first execution module 540:

and adjusting the amplitude of the original audio based on the user anti-disturbance state to obtain the processed audio.

In some embodiments, the first execution module 540 may be configured to:

and when the user disturbance prevention state is a disturbance-free state, adjusting the amplitude of the original audio to obtain the processed audio.

In some embodiments, adjusting the amplitude of the original audio to obtain the processed audio may include the following steps:

segmenting an audio signal of an original audio to obtain a plurality of audio sub-signals;

and when the amplitude of the audio sub-signal is greater than the preset amplitude threshold, compressing the audio sub-signal exceeding the preset amplitude threshold to obtain the processed audio.

(V) the transmitting module 550:

for transmitting the processed audio.

In some embodiments, the sending module 550 may be further configured to:

and generating an operating mode adjusting instruction.

And sending the working mode adjusting instruction to the client so that the client can adjust the working mode into a do-not-disturb mode according to the working mode adjusting instruction.

In some embodiments, generating the operating mode adjustment instruction may include the steps of:

In a specific implementation, the above units may be implemented as independent entities, or may be combined arbitrarily to be implemented as the same or several entities, and the specific implementation of the above units may refer to the foregoing method embodiments, which are not described herein again.

As can be seen from the above, the audio processing apparatus of this embodiment may obtain the current user position, the target historical user position, and the user state information, determine the current position state of the user according to the current user position and the target historical user position, determine the user anti-disturbance state according to the current position state and the user state information, adjust the amplitude of the original audio based on the user anti-disturbance state, obtain the processed audio, and send the processed audio. Therefore, the audio frequencies with different amplitudes are pushed according to the user anti-disturbance state difference, the user is prevented from being disturbed, and the user viscosity is improved.

In order to better implement the method, an embodiment of the present application further provides an operating mode adjusting device, where the audio processing device may be specifically integrated in an electronic device, and the electronic device may be a terminal, a server, or other devices. The terminal can be a mobile phone, a tablet computer, an intelligent Bluetooth device, a notebook computer, a personal computer and other devices; the server may be a single server or a server cluster composed of a plurality of servers.

For example, in this embodiment, the method of the embodiment of the present application is described in detail by taking an example of specifically integrating the operation mode adjustment in the electronic device.

For example, as shown in fig. 7, the operation mode adjusting apparatus may include a second obtaining module 610 and a second executing module 620. The second obtaining module 610 is configured to obtain a working mode adjustment instruction; the second executing module 620 is configured to adjust the operation mode to the do-not-disturb mode in response to the operation mode adjusting instruction.

Therefore, in the embodiment of the application, the second obtaining module receives the working mode adjusting instruction, and the second executing module adjusts the working mode to the do-not-disturb mode, so that the situation that the content played by the client terminal disturbs the user during live broadcasting is avoided, and the user viscosity is improved.

Correspondingly, the embodiment of the present application further provides a server, where the server may also be implemented in a terminal form, and the terminal may be a terminal device such as a smart phone, a tablet computer, a notebook computer, a touch screen, a game machine, a Personal computer, and a Personal Digital Assistant (PDA).

As shown in fig. 8, fig. 8 is a schematic structural diagram of a server according to an embodiment of the present application, where the server 700 includes a processor 710 having one or more processing cores, a memory 720 having one or more computer-readable storage media, and a computer program stored on the memory 720 and running on the processor. The processor 710 is electrically connected to the memory 720. Those skilled in the art will appreciate that the server architectures depicted in the figures are not meant to be limiting with respect to the servers, and may include more or fewer components than those illustrated, or some components may be combined, or a different arrangement of components.

Processor 710 is the control center of server 700, connects various parts of the entire server 700 using various interfaces and lines, performs various functions of server 700 and processes data by running or loading software programs and/or modules stored in memory 720, and calling data stored in memory 720, thereby performing overall monitoring of server 700.

In this embodiment, the processor 710 in the server 700 loads instructions corresponding to processes of one or more applications into the memory 720 according to the following steps, and the processor 710 executes the applications stored in the memory 720, so as to implement various functions:

acquiring a current user position, a target historical user position and user state information; determining the current position state of the user according to the current user position and the target historical user position; determining the user anti-disturbance state according to the current position state and the user state information; adjusting the amplitude of the original audio based on the user anti-disturbance state to obtain a processed audio; and transmitting the processed audio.

The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.

Optionally, as shown in fig. 8, the server 700 further includes: touch display 730, radio circuit 740, audio circuit 750, input unit 760 and power supply 770. The processor 710 is electrically connected to the touch display screen 730, the radio frequency circuit 740, the audio circuit 750, the input unit 760 and the power supply 770. Those skilled in the art will appreciate that the server architecture shown in FIG. 4 is not meant to be limiting, and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The touch display screen 730 can be used for displaying a graphical user interface and receiving an operation instruction generated by a user acting on the graphical user interface. The touch display screen 730 may include a display panel and a touch panel. The display panel may be used, among other things, to display information entered by or provided to the user and various graphical user interfaces of the server, which may be made up of graphics, text, icons, video, and any combination thereof. Alternatively, the Display panel may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. The touch panel may be used to collect touch operations of a user on or near the touch panel (for example, operations of the user on or near the touch panel using any suitable object or accessory such as a finger, a stylus pen, and the like), and generate corresponding operation instructions, and the operation instructions execute corresponding programs. Alternatively, the touch panel may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 710, and can receive and execute commands sent by the processor 710. The touch panel may overlay the display panel, and when the touch panel detects a touch operation thereon or nearby, the touch panel may transmit the touch operation to the processor 710 to determine the type of the touch event, and then the processor 710 may provide a corresponding visual output on the display panel according to the type of the touch event. In the embodiment of the present application, the touch panel and the display panel may be integrated into the touch display screen 730 to implement input and output functions. However, in some embodiments, the touch panel and the touch panel can be implemented as two separate components to perform the input and output functions. That is, the touch display screen 730 can also be used as a part of the input unit 760 to implement an input function.

The rf circuit 740 may be used for transceiving rf signals to establish wireless communication with a network device or other server via wireless communication, and for transceiving signals with the network device or other server.

The audio circuit 750 may be used to provide an audio interface between the user and the server through speakers, microphones. The audio circuit 750 may transmit the electrical signal converted from the received audio data to a speaker, and convert the electrical signal into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 750 and converted into audio data, which is then processed by the audio data output processor 710, and then sent to, for example, another server via the rf circuit 740, or output to the memory 720 for further processing. The audio circuit 750 may also include an earbud jack to provide communication of peripheral headphones with the server.

The input unit 760 may be used to receive input numbers, character information, or user characteristic information (e.g., fingerprint, iris, facial information, etc.), and generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control.

Power supply 770 is used to provide power to the various components of server 700. Optionally, the power supply 770 may be logically connected to the processor 710 through a power management system, so as to implement functions of managing charging, discharging, and power consumption management through the power management system. The power supply 770 may also include any component or components of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.

Although not shown in fig. 8, the server 700 may further include a camera, a sensor, a wireless fidelity module, a bluetooth module, etc., which are not described in detail herein.

In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

As can be seen from the above, the server provided in this embodiment may obtain the current user position, the target historical user position, and the user state information, determine the current position state of the user according to the current user position and the target historical user position, determine the user anti-disturbance state according to the current position state and the user state information, adjust the amplitude of the original audio based on the user anti-disturbance state, obtain the processed audio, and send the processed audio.

It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor.

To this end, embodiments of the present application provide a computer-readable storage medium, in which a plurality of computer programs are stored, and the computer programs can be loaded by a processor to execute the steps in any one of the audio processing methods provided by the embodiments of the present application. For example, the computer program may perform the steps of:

Wherein the storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.

Since the computer program stored in the storage medium can execute the steps in any audio processing method provided in the embodiments of the present application, the beneficial effects that can be achieved by any audio processing method provided in the embodiments of the present application can be achieved, and detailed descriptions are omitted here for the foregoing embodiments.

The foregoing detailed description has provided a method, an apparatus, a server and a computer-readable storage medium for audio processing provided by embodiments of the present application, and specific examples have been applied in the present application to explain the principles and implementations of the present application, and the descriptions of the foregoing embodiments are only used to help understand the method and the core ideas of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims

1. An audio processing method, adapted for a server, includes:

acquiring a current user position, a target historical user position and user state information;

determining the current position state of the user according to the current user position and the target historical user position;

determining a user anti-disturbance state according to the current position state and the user state information;

adjusting the amplitude of the original audio based on the user anti-disturbance state to obtain a processed audio;

and transmitting the processed audio.

2. The audio processing method of claim 1, wherein said determining a current location state of a user based on said current user location and said target historical user location comprises:

and when the current user position is different from the target historical user position, determining the current position state of the user as a second state.

3. The audio processing method of claim 2, wherein the user state information includes a current time, and wherein determining a user anti-disturb state based on the current location state and the user state information comprises:

obtaining the anti-disturbance time of a target historical user;

and when the current position state is the first state, determining the user anti-disturbance state according to the current time and the target historical user anti-disturbance time.

4. The audio processing method of claim 3, wherein the user anti-disturb state comprises a do-not-disturb state and a disturb-able state, and wherein determining the user anti-disturb state based on the current time and the target historical user anti-disturb time comprises:

when the current time is not earlier than the target historical user anti-disturbance time, determining the user anti-disturbance state as a do-not-disturbance state;

and when the current time is earlier than the target historical user anti-disturbance time, determining the user anti-disturbance state as a disturbance-allowable state.

5. The audio processing method of claim 2, wherein the user state information includes a current time and a current user operation behavior, and the determining a user anti-disturbance state from the current location state and the user state information comprises:

obtaining the anti-disturbance time of a target historical user;

and when the current position state is the second state, determining the user anti-disturbance state according to the current time, the target historical user anti-disturbance time, the current user operation behavior and a preset user operation behavior.

6. The audio processing method of claim 5, wherein the user anti-disturb state comprises a do-not-disturb state and a disturb-able state, and wherein determining the user anti-disturb state based on the current time, the target historical user anti-disturb time, the current user operational behavior, and a preset user operational behavior comprises:

when the current time is not earlier than the target historical user disturbance prevention time and the current user operation behavior is a preset user operation behavior, determining the user disturbance prevention state as a disturbance avoidance state;

when the current time is not earlier than the target historical user disturbance prevention time and the current user operation behavior is not a preset user operation behavior, determining a user disturbance prevention state as a disturbance-allowable state;

7. The audio processing method of claim 4 or 6, wherein the adjusting the amplitude of the original audio based on the user anti-disturbance state to obtain the processed audio comprises:

and when the user disturbance prevention state is the disturbance-free state, adjusting the amplitude of the original audio to obtain the processed audio.

8. The audio processing method of claim 3 or 5, wherein the obtaining a target historical user anti-disturb time comprises:

obtaining candidate historical disturbance prevention time, wherein the candidate historical disturbance prevention time comprises at least one of historical closing time of a client and historical screen-off time of the client;

and determining the disturbance prevention time of the target historical user according to the candidate historical disturbance prevention time.

9. The audio processing method of claim 1, wherein the method for obtaining the target historical user location comprises:

obtaining a candidate historical geographic position;

and determining the target historical user position according to the candidate historical geographic position.

10. The audio processing method of claim 9, wherein the candidate historical geographic locations comprise at least one of a location where the user was located at a time when the client history was turned off, and a valid historical user location, wherein the valid historical user location is obtained by:

acquiring the position of a user in a historical preset first disturbance prevention time period;

determining continuously identical user positions in the acquired user positions;

determining the earliest acquisition time and the latest acquisition time corresponding to the continuous same user positions, and calculating a first time difference value between the earliest acquisition time and the latest acquisition time;

and when the first time difference value is greater than or equal to a preset first difference value, determining the continuous same user position as an effective historical user position.

11. The audio processing method of claim 1, wherein said obtaining a current user location, a target historical user location, and user status information comprises:

acquiring current time;

and when the current time is within a preset second disturbance prevention time period, acquiring the current user position, the target historical user position and user state information.

12. The audio processing method of claim 1, wherein said obtaining a current user location, a target historical user location, and user status information comprises:

acquiring a current user position;

13. The audio processing method of claim 12, wherein the obtaining a target historical user location and user status information when the current user location is a valid current user location comprises:

determining the earliest acquisition time and the latest acquisition time corresponding to the continuous same current user position, and calculating a second time difference value between the earliest acquisition time and the latest acquisition time;

and when the second time difference is greater than or equal to a preset second difference, determining the continuous same current user position as an effective current user position, and acquiring a target historical user position and user state information.

14. The audio processing method of claim 1, wherein said adjusting the amplitude of the original audio to obtain the processed audio comprises:

and when the amplitude of the audio sub-signal is greater than a preset amplitude threshold value, compressing the audio sub-signal exceeding the preset amplitude threshold value to obtain a processed audio.

15. The audio processing method of claim 1, further comprising:

generating a working mode adjusting instruction;

16. An audio processing apparatus, comprising:

the first acquisition module is used for acquiring the current user position, the target historical user position and the user state information;

the first processing module is used for determining the current position state of the user according to the current user position and the target historical user position;

the second processing module is used for determining the user anti-disturbance state according to the current position state and the user state information;

the first execution module is used for adjusting the amplitude of the original audio based on the user anti-disturbance state to obtain the processed audio;

and the sending module is used for sending the processed audio.

17. A server comprising a processor and a memory, the memory storing a plurality of instructions; the processor loads instructions from the memory to perform the steps of the audio processing method according to any one of claims 1 to 15.

18. A computer readable storage medium storing instructions adapted to be loaded by a processor to perform the steps of the audio processing method according to any of claims 1 to 15.