CN111381801B

CN111381801B - Audio playing method based on double-screen terminal and communication terminal

Info

Publication number: CN111381801B
Application number: CN202010187023.3A
Authority: CN
Inventors: 陈晓思; 闫森; 石自民
Original assignee: Hisense Mobile Communications Technology Co Ltd
Current assignee: Hisense Mobile Communications Technology Co Ltd
Priority date: 2020-03-17
Filing date: 2020-03-17
Publication date: 2023-10-31
Anticipated expiration: 2040-03-17
Also published as: CN111381801A

Abstract

The application discloses an audio playing method based on a double-screen terminal and a communication terminal, and particularly discloses the method and the terminal: acquiring audio data corresponding to a first target application which is operated on a main screen and used for playing audio; acquiring audio data corresponding to a second target application running on the back screen and used for playing audio; the method comprises the steps of adjusting the initial playing volume of audio data corresponding to a first target application and/or audio data corresponding to a second target application, and simultaneously playing the audio data corresponding to the first target application and the audio data corresponding to the second target application by using different playing volumes, so that the problem of sound mixing caused by the fact that the playing volumes of two applications are the same when the audio data corresponding to the applications used for playing the audio and operated by a main screen and a back screen are played simultaneously is avoided, a communication terminal with double screens is more intelligent, and the use experience of a user is improved.

Description

Audio playing method based on double-screen terminal and communication terminal

Technical Field

The application relates to the technical field of terminal audio playing, in particular to an audio playing method based on a dual-screen terminal and a communication terminal.

Background

With the popularity of communication terminals, users may run applications for playing audio on the communication terminals, for example, users may watch video using video-type software, or may play music using music-type software.

However, in the current communication terminal having a dual screen, when an application program for playing audio is simultaneously run in a main back screen, there is not yet a method for managing audio.

Disclosure of Invention

The application provides an audio playing method based on a dual-screen terminal and a communication terminal, which are used for realizing that when an application for playing audio is simultaneously operated by a main back screen of the communication terminal, after initial playing volume is adjusted, audio data corresponding to the application operated by the main screen and audio data corresponding to the application operated by the back screen are simultaneously played by using different volumes.

According to an aspect in an exemplary embodiment, there is provided a communication terminal including:

a touch screen configured to receive a touch operation from a user;

a display screen configured to display a user interface;

a processor coupled to the touch screen and the display screen, respectively, the processor configured to:

Acquiring audio data corresponding to a first target application which is operated on a main screen and used for playing audio; acquiring audio data corresponding to a second target application running on the back screen and used for playing audio;

and adjusting the initial playing volume of the audio data corresponding to the first target application and/or the audio data corresponding to the second target application, and simultaneously playing the audio data corresponding to the first target application and the audio data corresponding to the second target application by using different playing volumes.

According to the embodiment of the application, the audio data which is operated on the main screen and used for playing the first target application and the audio data which is operated on the back screen and used for playing the second target application can be obtained, after the initial playing volume of the audio data is adjusted, the audio data which is operated on the main screen and used for playing the audio and the audio data which is operated on the back screen and used for playing the audio are simultaneously played by using different playing volumes, so that the problem of sound mixing caused by the same playing volume of the two applications is avoided, the communication terminal with the double screens is more intelligent, and the use experience of a user is improved.

In some exemplary embodiments, when adjusting the initial play volume of the audio data corresponding to the first target application and/or the audio data corresponding to the second target application, the processor is configured to:

adjusting the initial playing volume of the audio data corresponding to the first target application according to a first preset adjustment rule corresponding to the main screen, and/or adjusting the initial playing volume of the audio data corresponding to the second target application according to a second preset adjustment rule corresponding to the back screen;

the adjusted playing volume of the audio data corresponding to the first target application is larger than the initial playing volume, and the initial playing volume is larger than the adjusted playing volume of the audio data corresponding to the second target application.

In the embodiment of the application, the initial playing volume of the first target application running on the main screen can be adjusted to be larger than the first preset playing volume of the initial playing volume, and/or the initial playing volume of the second target application running on the back screen can be adjusted to be smaller than the second preset playing volume of the initial playing volume, so that the problem of mixing sound when the same playing volume is used for simultaneous playing is avoided, and when a user uses a function of double-screen display, related operation is generally executed on the main screen, so that the playing volume of the main screen is adjusted to be larger than the first preset playing volume of the initial playing volume, and the use experience of the user is improved.

In some exemplary embodiments, the processor is further configured to:

and determining that the application type of the first target application is the same as the application type of the second target application.

In the embodiment of the application, the initial playing volume of the audio can be adjusted according to the audio type, for example, when the user plays the music on the main screen and the back screen simultaneously, after the audio type is determined to be the same, the played music on the back screen can be silently played, so that the problem of mixing is avoided, and the use experience of the user is improved.

if the application type of the first target application is different from the application type of the second target application, determining an adjustment rule corresponding to the application type of the first target application according to the corresponding relation between the audio type and the adjustment rule, and adjusting the initial playing volume of the audio data corresponding to the first target application according to the adjustment rule corresponding to the audio type of the first target application; and/or, according to the corresponding relation between the audio type and the adjustment rule, determining the adjustment rule corresponding to the application type of the second target application, and according to the adjustment rule corresponding to the audio type of the second target application, adjusting the initial playing volume of the audio data corresponding to the second target application.

The embodiment of the application also provides a method for adjusting the playing volume according to the corresponding relation between the audio type and the adjustment rule, and because the adjustment rules corresponding to different applications can be different, for example, the adjustment rule corresponding to the navigation audio is to increase the playing volume by 50%, and the adjustment rule corresponding to the music audio is to decrease the playing volume by 50%, the user can clearly hear the sound of the navigation broadcasting while playing the music, and the use experience of the user is improved.

In some exemplary embodiments, the processor is further configured to:

and responding to an instruction of closing the double-screen display triggered by the user on the main screen, stopping running the second target application on the back screen, and stopping playing the audio data corresponding to the second target application.

When the user triggers the instruction of closing the double-screen display on the main screen, the second target application which runs on the back screen and is used for playing the audio can automatically stop running and stop playing the audio data corresponding to the second target application, so that the instruction of closing the second target application is not required to be triggered on the back screen when the user uses the main screen, and the operation of the user is simplified.

In some exemplary embodiments, the processor is further configured to:

and responding to an instruction triggered by a user on the main screen to start the second target application, stopping running the second target application on the back screen, running the second target application on the main screen and playing audio data corresponding to the second target application.

After the user triggers the instruction for starting the second target application on the main screen, the communication terminal can automatically stop running the second target application on the back screen, and automatically run the second target application on the main screen and play audio data corresponding to the second target application, so that the user does not need to trigger the instruction for starting the second target application from the main screen after the instruction for closing the second target application on the back screen when using the main screen, and the use experience of the user is improved.

According to another aspect in the exemplary embodiment, there is provided an audio playing method based on a dual-screen terminal, including:

at a communication terminal having a processor, a memory, a touch screen, and a display screen:

In some exemplary embodiments, when adjusting the initial playing volume of the audio data corresponding to the first target application and/or the audio data corresponding to the second target application, the method includes:

adjusting the initial playing volume of the audio data corresponding to the first target application to a first preset playing volume corresponding to the main screen, and/or adjusting the initial playing volume of the audio data corresponding to the second target application to a second preset playing volume corresponding to the back screen;

the first preset playing volume corresponding to the main screen is larger than the initial playing volume, and the initial playing volume is larger than the second preset playing volume corresponding to the back screen.

In some exemplary embodiments, the method further comprises:

if the application type of the first target application is different from the application type of the second target application, adjusting the initial playing volume of the audio data corresponding to the first target application to the playing volume corresponding to the audio type of the first target application according to the corresponding relation between the audio type and the playing volume; and/or the number of the groups of groups,

and adjusting the initial playing volume of the audio data corresponding to the second target application to the playing volume corresponding to the audio type of the second target application.

In some exemplary embodiments, the method further comprises:

According to yet another aspect of the exemplary embodiments, a computer storage medium is provided, in which computer program instructions are stored which, when run on a computer, cause the computer to perform the two-screen terminal based audio playback method as described above.

On the basis of conforming to the common knowledge in the field, the above preferred conditions can be arbitrarily combined to obtain the preferred embodiments of the present application.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it will be apparent that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic structural diagram of a communication terminal according to an embodiment of the present application;

fig. 2 is a schematic diagram schematically illustrating a software architecture of a communication terminal according to an embodiment of the present application;

fig. 3 schematically illustrates a user interface of a communication terminal according to an embodiment of the present application;

FIG. 4 is a schematic diagram of a first exemplary up-slide menu display interface according to an embodiment of the present application;

FIG. 5 is a schematic diagram of a hover ball display interface according to an embodiment of the application;

FIG. 6 is a schematic diagram illustrating a hint message interface according to an embodiment of the present application;

FIG. 7 illustrates a schematic diagram of a foreground running a first target application on a back screen in accordance with an embodiment of the present application;

FIG. 8 is a schematic diagram illustrating an application list capable of enabling a dual screen function according to an embodiment of the present application;

fig. 9 is a schematic diagram schematically illustrating a method for ejecting a foreground operation option of a target application in a back screen after a long-press of an icon corresponding to the target application according to an embodiment of the present application;

FIG. 10 schematically illustrates a back screen main interface according to an embodiment of the present application;

FIG. 11 is a schematic diagram of a second type of up menu display interface according to an embodiment of the present application;

FIG. 12 is a complete flowchart of an application processing method based on a dual-screen terminal according to an embodiment of the present application;

FIG. 13 is a schematic diagram of a third exemplary up-slide menu display interface according to an embodiment of the present application;

fig. 14 is a complete flowchart illustrating an audio playing method based on a dual-screen terminal according to an embodiment of the present application.

Detailed Description

The following description will be given in detail of the technical solutions in the embodiments of the present application with reference to the accompanying drawings. Wherein, in the description of the embodiments of the present application, unless otherwise indicated, "face shall mean or, for example, a/B may represent a or B; the text "and/or" is merely an association relation describing the associated object, and indicates that three relations may exist, for example, a and/or B may indicate: the three cases where a exists alone, a and B exist together, and B exists alone, and furthermore, in the description of the embodiments of the present application, "plural" means two or more than two.

The terms "first," "second," and the like, are used below for descriptive purposes only and are not to be construed as implying or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature, and in the description of embodiments of the application, unless otherwise indicated, the meaning of "a plurality" is two or more.

Some terms appearing hereinafter are explained:

1. in the embodiment of the application, the term "and/or" describes the association relation of the association objects, which means that three relations can exist, for example, a and/or B can be expressed as follows: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship.

A hardware configuration block diagram of the communication terminal 100 in accordance with an exemplary embodiment is exemplarily shown in fig. 1. As shown in fig. 1, the communication terminal 100 includes: radio Frequency (RF) circuitry 110, memory 120, display unit 130, display unit 140, camera 150, sensor 160, audio circuitry 170, wireless fidelity (Wireless Fidelity, wi-Fi) module 180, processor 190, bluetooth module 191, and power supply 1100.

The RF circuit 110 may be configured to receive and transmit signals during the process of receiving and transmitting information or communication, and may receive downlink data of the base station and then transmit the downlink data to the processor 190 for processing; uplink data may be sent to the base station. Typically, RF circuitry includes, but is not limited to, antennas, at least one amplifier, transceivers, couplers, low noise amplifiers, diplexers, and the like.

Memory 120 may be used to store software programs and data. The processor 190 performs various functions of the communication terminal 100 and data processing by executing software programs or data stored in the memory 120. Memory 120 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. The memory 120 stores an operating system that enables the communication terminal 100 to operate. The memory 120 of the present application may store an operating system and various application programs, and may also store code for performing the methods of the embodiments of the present application.

The display unit 130 may be used to receive input digital or character information, generate signal inputs related to user settings and function control of the communication terminal 100, and in particular, the display unit 130 may include a touch screen 131 provided at the front of the communication terminal 100, and may collect touch operations on or near the user, such as clicking buttons, dragging scroll boxes, and the like.

The display unit 130 may also be used to display information input by a user or information provided to the user and a graphical user interface (graphical user interface, GUI) of various menus of the terminal 100. Specifically, the display unit 130 may include a display 132 provided on the front surface of the communication terminal 100. The display 132 may be configured in the form of a liquid crystal display, light emitting diodes, or the like. The display unit 130 may be used to display various graphical user interfaces described in the present application.

The touch screen 131 may cover the display screen 132, or the touch screen 131 and the display screen 132 may be integrated to implement the input and output functions of the communication terminal 100, and the integrated touch screen may be simply referred to as a touch display screen. The display unit 130 may display the application program and the corresponding operation steps in the present application.

The display unit 140 may be used to receive input digital or character information, generate signal inputs related to user settings and function control of the communication terminal 100, and in particular, the display unit 140 may include a touch screen 141 provided at the back of the communication terminal 100, and may collect touch operations on or near the user, such as clicking buttons, dragging scroll boxes, and the like.

The display unit 140 may also be used to display information input by a user or information provided to the user and GUIs of various menus of the terminal 100. Specifically, the display unit 140 may include a display screen 142 provided on the back of the communication terminal 100. The display screen 142 may be configured in the form of a liquid crystal display, a light emitting diode, or the like. The display unit 140 may be used to display various graphical user interfaces described in the present application.

The touch screen 141 may cover the display screen 142, or the touch screen 141 and the display screen 142 may be integrated to implement the input and output functions of the communication terminal 100, and the integrated touch screen may be simply referred to as a touch display screen. The display unit 140 may display the application program and the corresponding operation steps in the present application.

The camera 150 may be used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive elements convert the optical signals to electrical signals, which are then transferred to the processor 190 for conversion to digital image signals.

The communication terminal 100 may further include at least one sensor 160 such as an acceleration sensor 161, a distance sensor 162, a fingerprint sensor 163, a temperature sensor 164. The communication terminal 100 may be further configured with other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, light sensors, motion sensors, and the like.

Audio circuitry 170, speaker 171, microphone 172 may provide an audio interface between a user and communication terminal 100. The audio circuit 170 may transmit the received electrical signal converted from audio data to the speaker 171, and convert the electrical signal into a sound signal to be output by the speaker 171. The communication terminal 100 may also be configured with a volume button for adjusting the volume of the sound signal. On the other hand, the microphone 172 converts the collected sound signals into electrical signals, which are received by the audio circuit 170 and converted into audio data, which are output to the RF circuit 110 for transmission to, for example, another terminal, or to the memory 120 for further processing. The microphone 172 of the present application may capture the voice of the user.

Wi-Fi belongs to a short-range wireless transmission technology, and the communication terminal 100 can help a user to send and receive e-mail, browse web pages, access streaming media and the like through the Wi-Fi module 180, so that wireless broadband internet access is provided for the user.

The processor 190 is a control center of the communication terminal 100, connects various parts of the entire terminal using various interfaces and lines, and performs various functions of the communication terminal 100 and processes data by running or executing software programs stored in the memory 120, and calling data stored in the memory 120. In some embodiments, processor 190 may comprise one or more processing units; processor 190 may also integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a baseband processor that primarily handles wireless communications. It will be appreciated that the baseband processor described above may not be integrated into processor 190. Processor 190 may run an operating system, an application program, a user interface display and a touch response, and a processing method according to an embodiment of the present application. In addition, processor 190 is coupled to display unit 130 and display unit 140.

The bluetooth module 191 is configured to interact with other bluetooth devices having a bluetooth module through a bluetooth protocol. For example, the communication terminal 100 may establish a bluetooth connection with a wearable electronic device (e.g., a smart watch) also provided with a bluetooth module through the bluetooth module 191, thereby performing data interaction.

The communication terminal 100 also includes a power supply 1100 (e.g., a battery) that provides power to the various components. The power supply may be logically connected to the processor 190 through a power management system, so that functions of managing charging, discharging, power consumption, etc. are implemented through the power management system. The communication terminal 100 may also be configured with a power button for power on and off, screen locking, etc. functions of the terminal.

Fig. 2 is a software configuration block diagram of the communication terminal 100 according to the embodiment of the present application.

The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun row (Android run) and system libraries, and a kernel layer, respectively.

The application layer may include a series of application packages.

As shown in fig. 2, the application package may include applications for cameras, gallery, calendar, phone calls, maps, navigation, WLAN, bluetooth, music, video, short messages, etc.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions.

As shown in FIG. 2, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.

The telephony manager is used to provide communication functions of the communication terminal 100. Such as the management of call status (including on, hung-up, etc.).

The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.

The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is presented in a status bar, a presentation sound is emitted, the communication terminal vibrates, and an indicator light blinks.

Android run time includes a core library and virtual machines. Android run time is responsible for scheduling and management of the Android system.

The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface manager (surface manager), media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL), etc.

The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

The workflow of the communication terminal 100 software and hardware is exemplified in connection with capturing a photo scene.

When the touch screen 131 receives a touch operation, a corresponding hardware interrupt is issued to the kernel layer. The kernel layer processes the touch operation into the original input event (including information such as touch coordinates, time stamp of touch operation, etc.). The original input event is stored at the kernel layer. The application framework layer acquires an original input event from the kernel layer, and identifies a control corresponding to the input event. Taking the touch operation as a touch click operation, taking a control corresponding to the click operation as an example of a control of a camera application icon, the camera application calls an interface of an application framework layer, starts the camera application, further starts a camera driver by calling a kernel layer, and captures a still image or video through the camera 150.

The communication terminal 100 in the embodiment of the application can be a mobile phone, a tablet computer, a wearable device, a notebook computer, a television and the like.

Fig. 3 is a schematic diagram for illustrating a user interface on a communication terminal, such as communication terminal 100 of fig. 1. In some implementations, a user may open a corresponding application by touching an application icon on the user interface, or may open a corresponding folder by touching a folder icon on the user interface.

The communication terminal related to the embodiment of the application can be provided with two display screens, and one optional mode is that the front surface of the communication terminal is a full-high-definition colorful display screen, and the back surface of the communication terminal is an electronic ink screen. Meanwhile, the communication terminal of the embodiment of the application also provides two screen display modes for a user, wherein one is a main screen display and the other is a back screen display;

when the user uses the home screen display or the back screen display, all functions provided in the communication terminal can be used simultaneously, and can be used for watching video, browsing news, browsing pictures, making and receiving calls, and the like.

Because the rear-mounted electronic ink screen relies on natural light reflection imaging, eyestrain is not easy to cause, electricity saving and eyesight protection are facilitated, the use experience of a user is improved, and the communication terminal is more intelligent.

On the basis that the communication terminal has a main screen display and a back screen display, the communication terminal in the embodiment of the application also provides a function of double-screen display, and after the user selects to start the function of double-screen display, the main screen display and the back screen display are simultaneously used, and different application programs are simultaneously operated in the foreground in the main screen and the back screen of the communication terminal.

In the communication terminal of the embodiment of the present application, as shown in fig. 4, in a system menu for sliding down or sliding up of the communication terminal, a control view for opening a dual-screen display function is provided, and a user may open the dual-screen display function by clicking the control view for opening the dual-screen display function in the menu after opening the system menu for sliding down by a sliding down gesture or opening the system menu for sliding up by a sliding up gesture;

in one possible implementation, in a hover ball of the communication terminal, a control view is provided that turns on a dual screen display function. As shown in fig. 5, when the user uses the hover ball function, the user may select to start the dual-screen display function by clicking a control view for starting the dual-screen display function in the hover ball of the communication terminal.

In implementation, when the communication terminal system is started, a system service EpdManagerService for managing the double-screen function is created, and the code structure is as follows:

EpdManager：Framework/base/core/java/com/hmct/epd

EpdManagerService:ramework/base/service/core/java/com/android/server/epd

The interface functions are shown in table 1:

table 1: interface function table.

When the dual-screen display function is started, in an application management service (Activity Manager Serv ice, AMS) of the communication terminal, an activitycisplay corresponding to a main screen is used for managing a main screen application stack (activitycast), and an activitycast corresponding to a back screen is used for managing a back screen activityctack; the application on the top of the home screen Activity Stack Stack is an application needing to be operated on the home screen in a foreground, and the application on the top of the back screen Activity Stack Stack is an application needing to be operated on the back screen in a foreground;

meanwhile, window management service (WindowManagerService, WMS) of the communication terminal also uses displaypontent corresponding to the main screen to manage the window size, position and placement logic of the display interface of the application running on the main screen, and uses displaypontent corresponding to the back screen to manage the window size, position and placement logic of the display interface of the application running on the back screen;

the displaypontent corresponding to the main screen corresponds to the displayid of the main screen, and the displayid of the back screen corresponding to the back screen displaypontent.

In the embodiment of the application, when the user starts the function of the dual-screen display for the first time, as shown in fig. 6, a prompt message interface of whether the function of the dual-screen display needs to be started is also displayed to the user, and after the user clicks the confirmation option, the function of the dual-screen display is started.

After a user triggers an instruction for starting the double-screen display, the communication terminal responds to the instruction for starting the double-screen display, which is triggered by the user, determines a first target application which needs to be operated on the back screen, and operates the first target application on the back screen in a foreground.

In the embodiment of the application, the first target application needing to run on the back screen can be determined by the following modes:

in the first mode, when a user triggers an instruction for starting the double-screen display, an application running on a foreground on a main screen is used as a first target application.

For example, as shown in fig. 7, when a video class application is running on a main screen, after a user triggers an instruction for starting a dual-screen display function on the main screen, the video class application currently running is used as a first target application to be run on a back screen.

After determining a first target application needing to run on the back screen, epdManager Service in the communication terminal sends a screen display type (mdisplay type) to an application management service (ActivityManagerService, AMS), AMS determines to start a double-screen display function after receiving the mdisplay type, moves application information of the first target application at the top of a stack in an activityiisplay corresponding to a main screen to an activityiisplay corresponding to the back screen, and sets a displayID (display ID; identity number: identity document, ID) corresponding to the main screen of the first target application as a displayID corresponding to the back screen;

In an optional implementation manner, the display ID corresponding to the main screen is 0, and the display ID corresponding to the back screen is 1;

and the AMS sets the running state in the application information of the first target application at the top of the ActivityStack stack in the ActivityDisplay corresponding to the back screen as a foreground running state (Resume).

After the display interface of the first target application is displayed to the user on the back screen and the first target application is run in the foreground on the back screen, an alternative embodiment is to display a main interface corresponding to the main screen in the main screen.

In another alternative embodiment, a display interface of an application which is set to run in the background last time is displayed in a display interface of a main screen, and the running state of the application is set to be the foreground running state.

And secondly, taking the target application which is selected by the user in the main screen and needs to run on the back screen as a first target application.

An alternative implementation manner is that an application program list which can be run on the back screen after the double-screen function is started is displayed on the main screen; the application program list can be automatically displayed in a display interface of the main screen after a user triggers an instruction for starting the double-screen display; or after the user triggers the instruction for starting the double-screen display, responding to the operation of the user, and displaying the application program list in the display interface of the main screen.

As shown in fig. 8, the user may select a target application that needs to be run on the back screen by clicking an icon corresponding to an application in the application list, and use the target application selected by the user as the first target application.

In another alternative implementation manner, as shown in fig. 9, after the dual-screen display function is started, the user may pop up, in the display interface of the main screen, an option of running the target application in the foreground in the back screen by long pressing an icon corresponding to the target application, and after the user clicks the option of running the foreground in the back screen, take the target application selected by the user as the first target application.

In implementation, after a user clicks an option running in a foreground in a back screen and takes a target application selected by the user as a first target application, an ActivityDisplay corresponding to the back screen in the AMS sets application information of the first target application selected by the user at a Stack top of an Activity Stack corresponding to the back screen, and sets a running state in the application information of the first target application as a result.

And thirdly, triggering an instruction for starting the target application on the back screen by the user, and taking the application started on the back screen by the user as a first target application.

In an alternative implementation manner, as shown in fig. 10, in response to an instruction of triggering and starting the dual-screen display by a user, the communication terminal sets the back screen to a bright screen state and displays a main interface of the back screen to the user; and the user can trigger an instruction for starting the target application by clicking an icon corresponding to the target application in a main interface of the back screen, and the user selects the started application on the back screen as a first target application.

In another alternative implementation manner, an ink intelligent key for starting a rear ink screen is arranged on the left side of the communication terminal, after a user triggers an instruction for starting double-screen display, the back screen can be set to be in a bright screen state by pressing the ink intelligent key, and a main interface corresponding to the back screen is displayed on the back screen; and the user can trigger an instruction for starting the target application by clicking an icon corresponding to the target application in a main interface of the back screen, and the user selects the started application on the back screen as a first target application.

After determining a first target application running on the back screen, the WMS obtains interface setting information of the first target application to generate placement position, size, display window level information, and the like of a first target application window, invokes a display synthesis system (surface flicker) to synthesize a display interface of the first target application, and displays the synthesized display interface on the back screen.

When the EpdManagerService sends the mDisplay Type to the AMS, the mDisplay Type is also sent to a surfaceflinger, after the surfaceflinger determines that the double-screen function is started according to the mDisplay Type, and after the display interface of the first target application is synthesized, the back screen is set to be in a bright screen state through the SurfaceControl setting PowerMode, and the display interface of the first target application is displayed to a user.

In an alternative implementation manner, when the first target application is determined by adopting the method in the first implementation manner, the sur faceflinger closes the back screen touch after determining that the dual screen function is turned on.

After the first target application is run on the back screen, in an optional implementation manner, when the main screen currently displays the main interface corresponding to the main screen, the user may trigger an instruction for starting the second target application on the main screen, and run the second target application on the front stage on the main screen.

In implementation, after a user triggers an instruction for starting a second target application on a main screen, an actigraphy corresponding to the main screen in the AMS sets application information of the second target application selected by the user at the Stack top of the main screen active Stack, and sets an running state in the application information of the second target application as a Resume.

When a display interface of a second target application is drawn on the main screen, the WMS acquires interface setting information of the second target application to generate placement position, size, display window level information and the like of a second target application window, invokes a surfaceflinger to synthesize the display interface of the second target application, and displays the synthesized display interface on the main screen.

According to the dual-screen display function provided by the communication terminal, a user can simultaneously run different applications in the front screen and the back screen, for example, when the user brushes a learning time, wants to simultaneously use other video playing software to watch videos, the dual-screen display function can be selectively started, the application related to learning is run in the front screen, the other video playing software is run in the front screen to watch videos, for example, when the user is watching a body-building video, the timer function provided by the communication terminal is started to start timing, the dual-screen display function can be selectively started, the timer is run in the front screen, and the body-building video is continuously played on the back screen, so that the effect that the body-building video can be continuously played on the back screen is achieved, the problem that only one application can be run in the front screen at the same time at present, when one application is run in the front screen, the other applications can only run in the back screen and stop functions such as video playing and timing can be greatly improved, and the user experience is greatly improved while the user requirements are met;

after the user turns on the function of the dual-screen display, the communication terminal according to the embodiment of the present application may also turn off the function of the dual-screen display according to the following manner:

The first mode is that a user triggers an instruction for starting a first target application on a main screen.

In an alternative implementation manner, a user clicks an icon of a first target application on a main screen display interface to trigger an instruction of starting the first target application, the communication terminal responds to the instruction triggered by the user, stops running the first target application on the back screen, sets the back screen to be in a screen-off state, and runs the first target application on a foreground on the main screen.

In the implementation, the communication terminal responds to an instruction triggered by a user on a main screen to start a first target application, an AMS in a communication terminal system moves application information of the first target application positioned at the top of an ActivityStack stack in an ActivityDisplay corresponding to a back screen to the top of the ActivityStack stack in the ActivityDisplay corresponding to the main screen, and sets a display ID of the back screen corresponding to the first target application as a display ID corresponding to the main screen and sets the running state of the first target application as a Resume;

the AMS sends mDisplayType, epdManagerService containing that the current terminal display state is the main screen display state to the EpdManagerService, after receiving the mDisplayType, the mDisplayType is sent to the WMS, so that the WMS calls the surfaceflinger to synthesize the display interface of the first target application, the display interface of the first target application is displayed on the main screen, and meanwhile, the back screen is set to be in a screen-off state through the surfaceControl.

And secondly, triggering an instruction for closing the double-screen display on the main screen by a user, stopping running the first target application on the back screen and setting the back screen to be in a screen-off state.

In the communication terminal of the embodiment of the present application, as shown in fig. 11, in a system menu for sliding down or sliding up of the communication terminal, a control view for closing the dual-screen display function is provided, and after the user opens the system menu for sliding down through a sliding down gesture or opens the system menu for sliding up through a sliding up gesture, the user may click on the control view for closing the dual-screen display function in the menu to close the dual-screen display function;

in one possible implementation, in a hover ball of the communication terminal, a control view is provided that closes the dual screen display function. When the user uses the hover ball function, the user can also select to close the dual-screen display function by clicking a control view for closing the dual-screen display function in the hover ball of the communication terminal.

In implementation, in response to an instruction triggered by a user to close the dual-screen display, the epc manager service in the communication terminal system sends mDisplayType, AMS and WMS, sufaceflinger including that the current terminal display state is the main screen display state to AMS, WMS, sufaceflinger, after receiving the mdisplay type, determines that the current display state of the communication terminal is in the main screen display, deletes information of the first target application, stops running and displaying the first target application on the back screen, and sets the back screen to the screen-off state.

As shown in fig. 12, taking an application running in the foreground on the home screen as a first target application as an example when a user triggers an instruction for dual-screen display, a complete flowchart of an application processing method based on a dual-screen terminal is shown, which includes the following steps:

step S1201, a first target application running in the foreground on the current main screen is determined in response to an instruction for starting double-screen display triggered by a user on the main screen;

step S1202, stopping running the first target application on the main screen, and displaying a main screen main page on the main screen;

step S1203, starting a first target application on a back screen, and setting the first target application as a foreground running state;

step S1204, responding to an instruction triggered by a user on the main screen to start a second target application, starting the second target application on the main screen, and setting the second target application to be in a foreground running state;

and step 1205, responding to an instruction of closing the double-screen display triggered by the user on the main screen, stopping running the first target application on the back screen, and setting the back screen to be in a screen-off state.

When a user starts a dual-screen display function and simultaneously runs an application for playing audio types on a main screen and a back screen of a communication terminal, the embodiment of the application also provides an audio playing method based on the dual-screen terminal, and the method is described in detail below with reference to specific embodiments:

When a user starts a double-screen display function, a first target application for playing audio is operated on a main screen, and a second target application for playing audio is operated on a back screen, the communication terminal determines that the first target application is operated in the main screen and the second target application is operated in the back screen according to an application identifier carried in audio data;

acquiring audio data corresponding to a first target application running on a main screen and used for playing audio, and acquiring audio data corresponding to a second target application running on a back screen and used for playing audio; after the initial playing volume of the audio data corresponding to the first target application and/or the audio data corresponding to the second target application for playing the audio is adjusted, the audio data corresponding to the first target application for playing the audio and the audio data corresponding to the second target application for playing the audio are played simultaneously by using different playing volumes.

According to the audio playing method provided by the embodiment of the application, if a user runs an application for playing audio on the main screen and the back screen at the same time; for example, the user runs the 'Goldmap' application on the main screen, runs the 'you ku video' application on the back screen, and can also play the audio data corresponding to the two applications simultaneously by using different play volumes after adjusting the play volumes of the audio data corresponding to the two audios, so that the user can navigate the route by using the 'Goldmap' broadcast while watching the video, the communication terminal with the double screens is more intelligent, and the use experience of the user is improved.

The initial playing volume of the audio data is the playing volume of the current communication terminal set by the user.

In implementation, after a dual-screen display function is started, a focus request (focus request) stack corresponding to a main screen and a focus request stack corresponding to a back screen are created in a media focus control (mediafocus control) of an Audio Service (Audio Service), when a first target application for playing Audio is operated on the main screen and a second target application for playing Audio is operated on the back screen, the first target application and the second target application can simultaneously acquire an Audio focus to perform Audio playing, an Audio Track can acquire pulse code modulation (Pulse Code Modulation) of which the first target application carries a corresponding application process identifier (Process Identification, PID) and PCM Audio data of which the second target application carries a corresponding application PID identifier, and when PCM Audio data corresponding to the first target application and PCM Audio data of the second target application are mixed, an Audio player can determine that the first target application is operated on the main screen according to a disc ID corresponding to the PID identifier, and play Audio data corresponding to the second target application is not set up on the Audio Track corresponding to the first target application and the second target application, and the Audio volume of the PCM data is adjusted by setting the Audio Track corresponding to the first target application and the second target application.

When the initial playing volume of the audio data corresponding to the first target application and the audio data corresponding to the second target application is adjusted, the embodiment of the application can adjust according to the preset adjustment rules respectively corresponding to the main screen and the back screen, and can also adjust the playing volume according to the audio types of the first target application and the second target application.

The following describes the two adjustment modes in detail with reference to specific embodiments:

and in the first mode, the adjustment is carried out according to preset adjustment rules respectively corresponding to the main screen and the back screen.

1. And adjusting the initial playing volume of the audio data corresponding to the first target application according to a first preset adjustment rule corresponding to the main screen.

In implementation, for example, assuming that the first preset adjustment rule corresponding to the home screen is to increase the initial play volume by 50%, the initial play volume of the audio data corresponding to the first target application is increased by 50%.

2. And adjusting the initial playing volume of the audio data corresponding to the second target application according to a second preset adjusting rule corresponding to the back screen.

In implementation, for example, assuming that the second preset adjustment rule corresponding to the back screen is to decrease the initial play volume by 100%, the initial play volume of the audio data corresponding to the second target application is decreased by 100%.

3. The initial playing volume of the audio data corresponding to the first target application is adjusted according to a first preset adjustment rule corresponding to the main screen, and the initial playing volume of the audio data corresponding to the second target application is adjusted according to a second preset adjustment rule corresponding to the back screen.

In implementation, for example, assuming that the first preset adjustment rule corresponding to the home screen is to increase the initial play volume by 60% and the second preset adjustment rule corresponding to the back screen is to decrease the initial play volume by 50%, the initial play volume of the audio data corresponding to the first target application is increased by 60% and the initial play volume of the audio data corresponding to the second target application is decreased by 50%.

In order to improve the use experience of the user, in the embodiment of the application, the play volume adjusted according to the first preset adjustment rule corresponding to the main screen is larger than the initial play volume, and the initial play volume is larger than the play volume adjusted according to the second preset adjustment rule corresponding to the back screen.

And secondly, adjusting the playing volume according to the audio types of the first target application and the second target application.

Wherein, the audio type includes: music, navigation, ringing, alarm clock, etc.

Here, it should be noted that, in the embodiment of the present application, the correspondence between the audio type and the adjustment rule is preset.

Before adjusting the playing volume, the communication terminal judges whether the audio type corresponding to the first target application is the same as the audio type corresponding to the second target application;

if the audio type corresponding to the first target application and the audio type corresponding to the second target application are the same, the method in the first mode can be adopted to adjust the playing volume;

if the audio type corresponding to the first target application and the audio type corresponding to the second target application are determined to be different:

1. and adjusting the initial playing volume of the audio data corresponding to the first target application according to the adjustment rule corresponding to the audio type of the first target application.

In implementation, for example, the audio type corresponding to the first target application "you ku video" running on the main screen by the user is music, and the audio type corresponding to the second target application "gahnder navigation" running on the back screen is navigation, and after determining that the audio types corresponding to the first target application and the second target application are different, assuming that the adjustment rule corresponding to the music class is to reduce the initial playing volume by 50%, the initial playing volume of the audio data corresponding to the first target application "you ku video" is reduced by 50%.

2. And adjusting the initial playing volume of the second target application according to the adjustment rule corresponding to the audio type of the second target application.

In implementation, for example, the audio type corresponding to the first target application "you ku video" running on the main screen by the user is music, the audio type corresponding to the second target application "gahnder navigation" running on the back screen is navigation, and after determining that the audio types corresponding to the first target application and the second target application are different, assuming that the adjustment rule corresponding to the navigation class is to increase the initial playing volume by 70%, the initial playing volume of the audio data corresponding to the second target application "gahnder navigation" is increased by 70%.

3. According to the adjustment rule corresponding to the audio type of the first target application, the initial play volume of the audio data corresponding to the first target application is adjusted, and according to the adjustment rule corresponding to the audio type of the second target application, the initial play volume of the second target application is adjusted.

In implementation, for example, the audio type corresponding to the first target application "goldhair navigation" running on the main screen by the user is navigation, the audio type corresponding to the second target application "you ku video" running on the back screen is music, after determining that the audio types corresponding to the first target application and the second target application are different, assuming that the adjustment rule corresponding to the navigation class is to increase the initial playing volume by 50%, the adjustment rule corresponding to the music class is to decrease the initial playing volume by 70%, the initial playing volume of the audio data corresponding to the first target application "goldhair navigation" is increased by 50%, and the initial playing volume of the audio data corresponding to the second target application "you ku video" is decreased by 70%.

When the user runs a first target application for playing audio on the main screen and runs a second target application for playing audio on the back screen, the playing volume of audio data corresponding to the second target application running on the back screen may need to be 0. The communication terminal of the embodiment of the application also provides a function of one-key mute back screen volume for the user, and the user can adjust the playing volume of the audio data corresponding to the second target application which is operated on the back screen and used for playing the audio to be 0 for playing after the mute is started. When the playing volume of the audio data corresponding to the second target application running on the back screen is not 0, the user can select to mute the audio data by himself, and the use experience of the user is improved.

In an alternative implementation manner, as shown in fig. 13, in a system menu of a downslide or upslide of a communication terminal, a control view for setting a back screen is provided, after a user opens the downslide system menu through a downslide gesture or opens the upslide system menu through an upslide gesture, the user clicks the control view for setting the back screen to open the setting menu, a control view for opening the back screen mute function is provided in the setting menu, and the user can click the control view for opening the back screen mute function to open the back screen mute function.

In the communication terminal provided by the embodiment of the application, when the user runs the first target application for playing the audio on the main screen and runs the second target application for playing the audio on the back screen, if the instruction for closing the double-screen display is triggered on the main screen, the user stops playing the audio data corresponding to the second target application while stopping running the second target application for playing the audio on the back screen.

An alternative implementation manner is that the first target application resumes the initial play volume corresponding to the play volume of the audio data.

If the user triggers an instruction for starting a second target application for playing the audio on the main screen, playing audio data corresponding to the second target application while stopping running the second target application on the back screen and running the second target application on the main screen.

An alternative implementation manner is that the playing volume of the audio data corresponding to the second target application resumes the initial playing volume.

As shown in fig. 14, taking an example that a user runs an application for playing audio in a foreground in a main screen and runs an application for playing audio in a foreground on a back screen, a complete flowchart of an audio playing method based on a dual-screen terminal is shown, which specifically includes the following steps:

Step S1401, determining a first target application for playing audio, which needs to be run on a back screen, in response to an instruction for starting the dual-screen display triggered by a user on the main screen;

step S1402, a first target application is operated on a back screen in a foreground;

step S1403, acquiring audio data corresponding to a second target application running on a front stage on a back screen;

step S1404, in response to an instruction triggered by the user on the home screen to start a second target application for playing audio, running the second target application on the home screen in the foreground;

step S1405, acquiring audio data corresponding to a second target application running in foreground on the home screen;

step S1406, the initial playing volumes of the audio data corresponding to the first target application and the second target application are adjusted, and the audio data corresponding to the first target application and the audio data corresponding to the second target application are played simultaneously with different playing volumes.

The embodiments of the present application also provide a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of any of the methods described above.

Since the communication terminal and the computer storage medium in the embodiments of the present application may be applied to the above-mentioned processing method, the technical effects that can be obtained by the communication terminal and the computer storage medium may also refer to the above-mentioned method embodiments, and the embodiments of the present application are not described herein again.

It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

It will be apparent to those skilled in the art that various modifications and variations can be made to the present application without departing from the spirit or scope of the application. Thus, it is intended that the present application also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.

Claims

1. A communication terminal, comprising:

a touch screen configured to receive a touch operation from a user;

a display screen configured to display a user interface;

adjusting the initial playing volume of the audio data corresponding to the first target application and/or the audio data corresponding to the second target application, and simultaneously playing the audio data corresponding to the first target application and the audio data corresponding to the second target application by using different playing volumes, wherein the initial playing volume of the audio data is the playing volume of the current communication terminal set by a user;

the processor is further configured to:

responding to an instruction of closing the double-screen display triggered by a user on the main screen, stopping running the second target application on the back screen, stopping playing the audio data corresponding to the second target application, and recovering the playing volume of the audio data corresponding to the first target application to the initial playing volume;

And responding to an instruction triggered by a user on the main screen to start the second target application, stopping running the second target application on the back screen and running the second target application on the main screen, playing the audio data corresponding to the second target application, and recovering the playing volume of the audio data corresponding to the second target application to the initial playing volume.

2. The communication terminal of claim 1, wherein when adjusting the initial play volume of the audio data corresponding to the first target application and/or the audio data corresponding to the second target application, the processor is configured to:

3. The communication terminal of claim 2, wherein the processor is further configured to:

it is determined whether the audio type of the first target application is the same as the audio type of the second target application.

4. The communication terminal of claim 3, wherein when adjusting the initial play volume of the audio data corresponding to the first target application and/or the audio data corresponding to the second target application, the processor is configured to:

if the audio type of the first target application is determined to be different from the audio type of the second target application, determining an adjustment rule corresponding to the audio type of the first target application according to the corresponding relation between the audio type and the adjustment rule, and adjusting the initial playing volume of the audio data corresponding to the first target application according to the adjustment rule corresponding to the audio type of the first target application; and/or, according to the corresponding relation between the audio type and the adjustment rule, determining the adjustment rule corresponding to the audio type of the second target application, and according to the adjustment rule corresponding to the audio type of the second target application, adjusting the initial playing volume of the audio data corresponding to the second target application.

5. An audio playing method based on a double-screen terminal is characterized by comprising the following steps:

6. The method of claim 5, wherein adjusting the initial play volume of the audio data corresponding to the first target application and/or the audio data corresponding to the second target application comprises:

7. The method of claim 6, wherein the adjusting the initial play volume of the audio data corresponding to the first target application and/or before adjusting the initial play volume of the audio data corresponding to the second target application according to the second preset adjustment rule corresponding to the back screen further comprises:

8. A computer storage medium having stored therein computer program instructions which, when run on a computer, cause the computer to perform the method of any of claims 5 to 7.