CN110278481B

CN110278481B - Picture-in-picture implementation method, terminal and computer readable storage medium

Info

Publication number: CN110278481B
Application number: CN201910555978.7A
Authority: CN
Inventors: 寇洪
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2019-06-25
Filing date: 2019-06-25
Publication date: 2022-06-10
Anticipated expiration: 2039-06-25
Also published as: CN110278481A

Abstract

The embodiment of the invention discloses a picture-in-picture realization method which is applied to a terminal and comprises the following steps: determining a target picture to be processed; acquiring a lowest resolution picture resource corresponding to the target picture based on the target picture; loading the lowest resolution picture resource, and generating a window to be processed based on the lowest resolution picture resource; and determining a scaling ratio, and scaling the window to be processed according to the scaling ratio. The invention also provides a terminal and a computer readable storage medium, which can realize the function of picture-in-picture without ensuring the loss of picture quality by implementing the scheme.

Description

Picture-in-picture implementation method, terminal and computer readable storage medium

Technical Field

The present invention relates to the field of electronic technologies, and in particular, to a picture-in-picture implementation method, a terminal, and a computer-readable storage medium.

Background

Currently, for the picture-in-picture function, system manufacturers (such as android google and IOS apples) do not provide an external interface, so terminal manufacturers can only perform deep customization modification on applications through a frame, and since a display window is small, application picture resources and the like are arranged according to a full screen, if the display window is forcibly reduced, various interfaces are abnormally displayed and incompletely displayed, so that a good picture-in-picture implementation scheme is not provided at present.

Disclosure of Invention

In view of this, embodiments of the present invention provide a picture-in-picture implementation method, a terminal and a computer storage medium, so that the terminal can implement a picture-in-picture function without losing display quality of an application picture.

In order to solve the above problem, the present invention provides a picture-in-picture implementation method, which is applied to a terminal, and the method includes: determining a target picture to be processed; acquiring a lowest resolution picture resource corresponding to the target picture based on the target picture; loading the lowest resolution picture resource, and generating a window to be processed based on the lowest resolution picture resource; and determining a scaling ratio, and scaling the window to be processed according to the scaling ratio.

Optionally, the step of determining the target picture to be processed specifically includes: sliding along a margin of the target frame to generate a closed area; and determining a target picture to be processed based on the closed area.

Optionally, the step of obtaining the lowest resolution picture resource corresponding to the target picture based on the target picture specifically includes: determining an application identifier of an application to which the target picture belongs based on the target picture; retrieving the application server based on the application identifier, and inquiring the lowest resolution picture resource corresponding to the target picture and sending the lowest resolution picture resource to the terminal by the application server; and receiving the lowest resolution picture resource corresponding to the target picture sent by the application server.

Optionally, the size of the window to be processed is the same as that of the currently applied display window.

Optionally, the step of determining the target picture to be processed further includes: and setting the activity attribute of the target picture to be processed as a free mode.

Optionally, the step of determining the scaling specifically includes: determining the optimal display window area corresponding to the lowest resolution picture resource corresponding to the target picture; and taking the ratio of the area of the optimal display window to the area of the application current display window as the scaling.

Optionally, the scaling the window to be processed according to the scaling ratio further includes: scaling the touch area of the application based on the scaling.

Optionally, the method further comprises: and when the action that the user releases the two fingers from spreading is detected, the zoomed target picture is restored to the normal display picture.

Further, the present invention also provides a terminal, and the terminal further includes: a memory, a communication bus, and a processor, wherein: the memory is used for storing the picture-in-picture realizing program; the communication bus is used for realizing connection communication between the processor and the memory; the processor is configured to execute the picture-in-picture implementation program stored in the memory to implement the steps described above.

Further, the present invention also provides a computer-readable storage medium storing one or more programs, which are executable by one or more processors to implement the steps of the picture-in-picture implementing method as described in any one of the above.

By implementing the scheme, the terminal can realize the picture-in-picture function on the premise of ensuring the display quality of the application picture when performing face recognition.

Drawings

In the drawings, which are not necessarily drawn to scale, like reference numerals may describe similar components in different views. Like reference numerals having different letter suffixes may represent different examples of similar components. The drawings illustrate generally, by way of example, but not by way of limitation, various embodiments discussed herein.

Fig. 1 is a schematic diagram of a hardware structure of a terminal implementing various embodiments of the present invention;

fig. 2 is a diagram of a communication network system architecture according to an embodiment of the present invention;

FIG. 3 is a flow chart of a picture-in-picture implementation method according to the present invention;

FIG. 4 is a block diagram of a terminal according to the present invention;

fig. 5 is a schematic view of a terminal assembly structure according to the present invention.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in itself. Thus, "module", "component" or "unit" may be used mixedly.

The terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a Personal Digital Assistant (PDA), a Portable Media Player (PMP), a navigation device, a terminal, a smart band, a pedometer, and the like, and a fixed terminal such as a Digital TV, a desktop computer, and the like.

While the terminal will be described as an example in the following description, those skilled in the art will appreciate that the configuration according to the embodiment of the present invention can be applied to a terminal of a fixed type, in addition to elements particularly used for moving purposes.

Referring to fig. 1, which is a schematic diagram of a hardware structure of a terminal for implementing various embodiments of the present invention, the terminal 100 may include: radio Frequency (RF) 101, WiFi module 102, audio output unit 103, a/V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the mobile terminal architecture shown in fig. 1 is not intended to be limiting of mobile terminals, and that a terminal may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The various components of terminal 100 are described in detail below with reference to fig. 1:

the radio frequency unit 101 may be configured to receive and transmit signals during information transmission and reception or during a call, and specifically, receive downlink information of a base station and then process the downlink information to the processor 110; in addition, the uplink data is transmitted to the base station. Typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with a network and other devices through wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access 2000(Code Division Multiple Access 2000, CDMA2000), Wideband Code Division Multiple Access (WCDMA), Time Division-Synchronous Code Division Multiple Access (TD-SCDMA), Frequency Division duplex Long Term Evolution (FDD-LTE), and Time Division duplex Long Term Evolution (TDD-LTE), etc.

WiFi belongs to short-distance wireless transmission technology, and the mobile terminal can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the WiFi module 102, and provides wireless broadband internet access for the user. Although fig. 1 shows the WiFi module 102, it is understood that it does not belong to the essential constitution of the mobile terminal, and may be omitted entirely as needed within the scope not changing the essence of the invention.

The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the terminal 100 is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

The a/V input unit 104 is used to receive audio or video signals. The a/V input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, the Graphics processor 1041 Processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 may receive sounds (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, or the like, and may be capable of processing such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

The terminal 100 also includes at least one sensor 105, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or a backlight when the terminal 100 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, further description is omitted here.

The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect a touch operation performed by a user on or near the touch panel 1071 (e.g., an operation performed by the user on or near the touch panel 1071 using a finger, a stylus, or any other suitable object or accessory), and drive a corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. In particular, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like, and are not limited to these specific examples.

Further, the touch panel 1071 may cover the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although the touch panel 1071 and the display panel 1061 are shown in fig. 1 as two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the terminal, and is not limited herein.

The interface unit 108 serves as an interface through which at least one external device is connected to the terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the terminal 100 or may be used to transmit data between the terminal 100 and the external device.

The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 110 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by operating or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the mobile terminal. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The terminal 100 may further include a power supply 111 (e.g., a battery) for supplying power to various components, and preferably, the power supply 111 may be logically connected to the processor 110 through a power management system, so as to manage charging, discharging, and power consumption management functions through the power management system.

Although not shown in fig. 1, the terminal 100 may further include a bluetooth module or the like, which is not described in detail herein.

In order to facilitate understanding of the embodiments of the present invention, a communication network system on which the terminal of the present invention is based is described below.

Referring to fig. 2, fig. 2 is an architecture diagram of a communication Network system according to an embodiment of the present invention, where the communication Network system is an LTE system of a universal mobile telecommunications technology, and the LTE system includes User Equipment (UE) 201, Evolved UMTS Terrestrial Radio Access Network (E-UTRAN) 202, Evolved Packet Core Network (EPC) 203, and IP service 204 of an operator, which are in communication connection in sequence.

Generally, the UE201 may be the terminal 100 described above, and is not described herein again.

The E-UTRAN202 includes eNodeB2021 and other eNodeBs 2022, among others. The eNodeB2021 may be connected with other eNodeB2022 via backhaul (e.g., X2 interface), the eNodeB2021 is connected to the EPC203, and the eNodeB2021 may provide the UE201 access to the EPC 203.

The EPC203 may include a Mobility Management Entity (MME) 2031, a Home Subscriber Server (HSS) 2032, other MMEs 2033, an SGW (Serving gateway) 2034, a PGW (PDN gateway) 2035, and a Policy and Charging Rules Function (PCRF) 2036, and the like. The MME2031 is a control node that handles signaling between the UE201 and the EPC203, and provides bearer and connection management. HSS2032 is used to provide some registers to manage functions such as home location register (not shown) and holds some user-specific information about service characteristics, data rates, etc. All user data may be sent through SGW2034, PGW2035 may provide IP address assignment for UE201 and other functions, and PCRF2036 is a policy and charging control policy decision point for traffic data flow and IP bearer resources, which selects and provides available policy and charging control decisions for a policy and charging enforcement function (not shown).

The IP services 204 may include the internet, intranets, IP Multimedia Subsystem (IMS) or other IP services, and the like.

Although the LTE system is described as an example, it should be understood by those skilled in the art that the present invention is not limited to the LTE system, but may also be applied to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems. Based on the above terminal hardware structure and communication network system, the present invention provides various embodiments of the method.

Fig. 3 is a flowchart illustrating a picture-in-picture implementation method according to an embodiment of the present invention, which is applied to a terminal. It is to be understood that the flow charts in the embodiments of the present method are not intended to limit the order in which the steps are performed.

As shown in fig. 3, the method comprises the steps of:

in step S300, a target screen to be processed is determined.

In this embodiment, the application running on the terminal generally includes multiple pages, such as flight video, including a video home page, a player window when playing, and other display frames. At this time, if the picture-in-picture function needs to be implemented, a target picture to be processed, such as a video playing picture of the Tencent video screen application, needs to be determined in advance. In this embodiment, the step of determining the target screen to be processed specifically includes: sliding along a margin of the target frame to generate a closed area; and determining a target picture to be processed based on the closed area. Namely, the user can slide along the display boundary of the target picture to form a closed area covering the target picture, and the closed area is used as the target picture to be processed.

In the present embodiment, after the target screen for the desired processing is determined, it is necessary to set the activity attribute of the target screen for the desired processing to free mode (free). Where Activity is the most basic module in an application, we call Activity, and in an application, an Activity is usually a single screen. Each activity is implemented as a separate class and is carried over from the activity base class, which displays the user interface with view controls and responds to events. As will be readily appreciated, Activity represents a screen that a user can see, primarily to handle the overall work of an application, such as listening to system events (key events, touch screen events, etc.), displaying a specified View for the user, launching other Activities, etc. The free mode is a free adjustment mode of a frame, and in this mode, the displayed frame can be scaled accordingly.

Step S302, acquiring the lowest resolution picture resource corresponding to the target picture based on the target picture.

In the embodiment of the invention, the application identifier of the application can be obtained through the determined target picture, the application server of the application is accessed according to the application identifier, the picture resources of the devices with different resolutions adapted to the corresponding application are stored on the application server, and at the moment, the picture resource with the lowest resolution corresponding to the target picture stored on the application server by the application server is obtained. And the application server acquires the picture resource with the lowest resolution corresponding to the target picture and sends the picture resource to the terminal for loading.

Step S304, loading the lowest resolution picture resource, and generating a window to be processed based on the lowest resolution picture resource.

In the embodiment of the present invention, the display size of the window to be processed is the same as the display size of the currently applied display screen, except that the display resolution of the window to be processed is lower than that of the other currently applied display screens. At this time, the display screen of the window to be processed may be superimposed on the other display screens of the current application.

Step S306, determining the scaling and scaling the window to be processed according to the scaling.

In this embodiment, the scaling may be determined as follows: determining the optimal display window area corresponding to the lowest resolution picture resource corresponding to the target picture; and taking the ratio of the area of the optimal display window to the area of the current display window of the application as the scaling. Specifically, each picture determined by the resolution has an adaptive optimal display window, and at this time, the area of the current display window is divided by the area of the optimal display window, so that a zoom factor or a scale can be obtained. In this embodiment, after the target screen is zoomed based on the zoom ratio, the touch area needs to be zoomed according to the determined zoom ratio, so as to ensure that normal operations, such as clicking, touching, and the like, can be performed on the zoomed screen.

In this embodiment, once the pip function is implemented, the pip function may be turned off by a preset gesture, thereby normalizing the display. Wherein the preferred gesture is a two-finger spread gesture. The opposite gesture double finger aggregation may be the gesture to turn on the picture-in-picture function.

By implementing the picture-in-picture realization method, the terminal can ensure the normalization of the display picture without influencing the display effect of the picture while realizing the picture-in-picture function.

Fig. 4 is a block diagram of a terminal according to the present invention. The terminal comprises a determining module 400, a resource obtaining module 402, a loading module 404, a scaling module 406, a memory 408 and a processor 410, wherein the program modules are stored in the memory 408 as hard program codes and executed by the processor 410 to implement the steps or the method of the above-mentioned embodiments.

The determination module 400 is used for determining a target picture to be processed.

In this embodiment, the application running on the terminal generally includes multiple pages, such as flight video, including a video home page, a player window when playing, and other display frames. At this time, if the picture-in-picture function needs to be implemented, a target picture to be processed, such as a video playing picture of the Tencent video screen application, needs to be determined in advance. In this embodiment, the step of determining the target screen to be processed specifically includes: sliding along a margin of the target frame to generate a closed area; and determining a target picture needing to be processed based on the closed area. Namely, the user can slide along the display boundary of the target picture to form a closed area covering the target picture, and the closed area is used as the target picture to be processed.

The resource obtaining module 402 is configured to obtain, based on the target picture, a lowest resolution picture resource corresponding to the target picture.

In the embodiment of the invention, the application identifier of the application can be obtained through the determined target picture, the application server of the application is accessed according to the application identifier, the picture resources of the devices with different resolutions adapted to the corresponding application are stored on the application server, and the picture resource with the lowest resolution corresponding to the target picture stored on the application server is obtained through the application server. And the application server acquires the picture resource with the lowest resolution corresponding to the target picture and sends the picture resource to the terminal for loading.

The loading module 404 is configured to load the lowest resolution picture resource and generate a window to be processed based on the lowest resolution picture resource.

In an embodiment of the present invention, a display size of the window to be processed is the same as a display size of a currently applied display screen, and a difference is that a display resolution of the window to be processed is lower than that of other display screens of the current application. At this time, the display screen of the window to be processed may be superimposed on the other display screens of the current application.

The scaling module 406 is configured to determine a scaling ratio and scale the window to be processed according to the scaling ratio.

In this embodiment, the scaling may be determined in the following manner, specifically: determining the optimal display window area corresponding to the lowest resolution picture resource corresponding to the target picture; and taking the ratio of the area of the optimal display window to the area of the current display window of the application as the scaling. Specifically, each picture determined by the resolution has an adaptive optimal display window, and at this time, the area of the current display window is divided by the area of the optimal display window, so that a zoom factor or a scale can be obtained. In this embodiment, after the target screen is zoomed based on the zoom ratio, the touch area needs to be zoomed according to the determined zoom ratio, so as to ensure that normal operations, such as clicking, touching, and the like, can be performed on the zoomed screen.

Fig. 5 is a schematic diagram of a composition structure of the terminal of the present invention. As shown in fig. 5, the terminal includes at least: a memory 501, a communication bus 502, and a processor 503. Wherein:

the memory 501 is used for storing a picture-in-picture implementation program;

the communication bus 502 is used for realizing connection communication between the processor and the memory;

the processor 503 is configured to execute a picture-in-picture implementation program stored in the memory to implement the following steps:

and determining a target picture to be processed.

And acquiring the lowest resolution picture resource corresponding to the target picture based on the target picture.

And loading the lowest resolution picture resource, and generating a window to be processed based on the lowest resolution picture resource.

And determining a scaling ratio, and scaling the window to be processed according to the scaling ratio.

In this embodiment, the scaling may be determined as follows: determining the optimal display window area corresponding to the lowest resolution picture resource corresponding to the target picture; and taking the ratio of the area of the optimal display window to the area of the application current display window as the scaling. Specifically, each picture determined by the resolution has an adaptive optimal display window, and at this time, the area of the current display window is divided by the area of the optimal display window, so that a zoom factor or a scale can be obtained. In this embodiment, after the target screen is zoomed based on the zoom ratio, the touch area needs to be zoomed according to the determined zoom ratio, so as to ensure that normal operations, such as clicking, touching, and the like, can be performed on the zoomed screen.

The invention also provides a computer readable storage medium. The computer readable storage medium has stored thereon a picture-in-picture implementation program which, when executed by a processor, implements the steps as described above.

It should be noted that the above description of the terminal embodiment is similar to the description of the method embodiment, and has similar beneficial effects to the method embodiment. For technical details not disclosed in the terminal embodiments of the present invention, reference is made to the description of the method embodiments of the present invention for understanding.

It should be noted that, in the embodiment of the present invention, if the above-mentioned picture-in-picture implementation method is implemented in the form of a software functional module and is sold or used as a stand-alone product, it may also be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present invention may be essentially implemented or a part contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computing device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a magnetic disk, or an optical disk. Thus, embodiments of the invention are not limited to any specific combination of hardware and software.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method described in the embodiments of the present invention.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

The above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention, and all equivalent structures or equivalent processes performed by the present invention or directly or indirectly applied to other related technical fields are also included in the scope of the present invention.

Claims

1. A picture-in-picture realization method is applied to a terminal, and is characterized in that the method comprises the following steps:

determining a target picture to be processed;

acquiring a lowest resolution picture resource corresponding to the target picture based on the target picture;

loading the lowest resolution picture resource, and generating a window to be processed based on the lowest resolution picture resource;

determining a scaling ratio, and scaling the window to be processed according to the scaling ratio;

the step of determining the target picture to be processed specifically includes:

sliding along a margin of the target frame to generate a closed area;

and determining a target picture needing to be processed based on the closed area.

2. The picture-in-picture implementation method of claim 1, wherein the step of obtaining the lowest resolution picture resource corresponding to the target picture based on the target picture specifically comprises:

determining an application identifier of an application to which the target picture belongs based on the target picture;

retrieving an application server based on the application identifier, and inquiring the lowest resolution picture resource corresponding to the target picture and sending the lowest resolution picture resource to the terminal by the application server;

and receiving the lowest resolution picture resource corresponding to the target picture sent by the application server.

3. The method of claim 1, wherein the size of the window to be processed is the same as a currently applied display window.

4. The picture-in-picture implementation method of claim 1, wherein the step of determining the target picture to be processed further comprises:

and setting the activity attribute of the target picture to be processed as a free mode.

5. The picture-in-picture implementation method of claim 1, wherein the step of determining the scaling specifically comprises:

determining the optimal display window area corresponding to the lowest resolution picture resource corresponding to the target picture;

and taking the ratio of the area of the optimal display window to the area of the application current display window as the scaling.

6. The method of claim 1, wherein the scaling the window to be processed further comprises:

scaling the touch area of the application based on the scaling.

7. The method of claim 1, wherein the method further comprises:

and when the action that the user releases the two fingers from spreading is detected, the zoomed target picture is restored to the normal display picture.

8. A terminal, characterized in that the terminal further comprises at least: a memory, a communication bus, and a processor, wherein:

the memory is used for storing the picture-in-picture realizing program;

the communication bus is used for realizing connection communication between the processor and the memory;

the processor is configured to execute a picture-in-picture implementation program stored in the memory to implement the steps of the picture-in-picture implementation method according to any one of claims 1 to 7.

9. A computer readable storage medium having stored thereon a picture-in-picture implementation program which, when executed by a processor, implements the steps of the picture-in-picture implementation method as claimed in any one of claims 1 to 7.