WO2023241009A1 - 投屏方法、装置、设备、系统及存储介质 - Google Patents

投屏方法、装置、设备、系统及存储介质 Download PDF

Info

Publication number
WO2023241009A1
WO2023241009A1 PCT/CN2022/143554 CN2022143554W WO2023241009A1 WO 2023241009 A1 WO2023241009 A1 WO 2023241009A1 CN 2022143554 W CN2022143554 W CN 2022143554W WO 2023241009 A1 WO2023241009 A1 WO 2023241009A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
duration
brightness
source device
event
Prior art date
Application number
PCT/CN2022/143554
Other languages
English (en)
French (fr)
Inventor
刘光磊
张伟
王琳
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Publication of WO2023241009A1 publication Critical patent/WO2023241009A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234Power saving characterised by the action undertaken
    • G06F1/325Power saving in peripheral device
    • G06F1/3265Power saving in display device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3206Monitoring of events, devices or parameters that trigger a change in power modality
    • G06F1/3228Monitoring task completion, e.g. by use of idle timers, stop commands or wait commands
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00Reducing energy consumption in communication networks
    • Y02D30/70Reducing energy consumption in communication networks in wireless communication networks

Definitions

  • the embodiments of the present application relate to the field of screen projection technology, and in particular to a screen projection method, device, equipment, system and storage medium.
  • the source device needs to keep the screen on at all times. Once it enters the screen-off state, the screen projection of the destination (sink) device will be interrupted, causing the user to cast the screen. The experience becomes worse, and the source device keeps the screen on, which will lead to an increase in power consumption of the source device.
  • Embodiments of the present application provide a screen projection method, device, equipment and storage medium.
  • the technical solutions are as follows:
  • embodiments of the present application provide a screen casting method, which is executed by a source device.
  • the method includes:
  • the screen-off duration is the duration for the source device to automatically enter the screen-off state, and the second duration is longer than the first duration;
  • an embodiment of the present application provides a screen projection device, which includes:
  • the duration setting module is used to set the screen-off duration from the first duration to the second duration in the screen projection state.
  • the screen-off duration is the duration for the source device to automatically enter the screen-off state.
  • the second duration is longer than the first duration;
  • a screen control module configured to control the screen to turn off when the target duration is reached, wherein the source device does not enter the screen-off state after the screen is turned off, and the target duration is less than the second duration
  • the data transmission module is configured to maintain the screen projection data stream transmission with the destination device when the screen is turned off and the second duration has not been reached.
  • embodiments of the present application provide a screen projection system, which includes a source device and a destination device;
  • the source device is configured to set the screen-off duration from a first duration to a second duration in the screen projection state.
  • the screen-off duration is the duration for the source device to automatically enter the screen-off state.
  • the third screen-off duration is greater than the first duration; when the target duration is reached, the screen is controlled to turn off, wherein the source device does not enter the screen-off state after the screen turns off, and the target duration is less than the second duration; When the screen is turned off and the second duration has not been reached, maintain screencast data stream transmission with the destination device;
  • the destination device is configured to receive the audio and video data stream transmitted by the source device while the screen projection data stream between the source device and the source device is maintained; and play the projection based on the audio and video data stream. screen content.
  • inventions of the present application provide a computer device.
  • the computer device includes a processor and a memory; the memory stores at least one instruction, and the at least one instruction is used to be executed by the processor to implement the following: The screen projection method described above.
  • embodiments of the present application provide a computer-readable storage medium in which at least one program code is stored, and the program code is loaded and executed by a processor to implement the above aspects. screencasting method.
  • inventions of the present application provide a computer program product.
  • the computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium.
  • the processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the screen projection method provided in various optional implementations of the above aspect.
  • Figure 1 shows a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application
  • Figure 2 shows a flow chart of a screen casting method provided by an exemplary embodiment of the present application
  • Figure 3 is an implementation schematic diagram of the screen extinguishing when the target duration is reached according to an exemplary embodiment of the present application
  • Figure 4 shows a flow chart of a screen casting method provided by another exemplary embodiment of the present application.
  • Figure 5 is a schematic diagram of an implementation of controlling screen brightness according to an exemplary embodiment of the present application.
  • Figure 6 is a work flow chart after the screen is turned off in the screen projection state provided by another exemplary embodiment of the present application.
  • Figure 7 is a flow chart for entering the screen lock and screen off state provided by another exemplary embodiment of the present application.
  • Figure 8 is a schematic diagram of the implementation of resuming screen projection data stream transmission after successful unlocking according to another exemplary embodiment of the present application.
  • Figure 9 is a work flow chart in a screen-locked and off-screen state during screencasting provided by another exemplary embodiment of the present application.
  • Figure 10 is a general workflow diagram of entering the screen casting state provided by another exemplary embodiment of the present application.
  • Figure 11 is a structural block diagram of a screen projection system provided by an exemplary embodiment of the present application.
  • Figure 12 is a structural block diagram of a screen projection device provided by an exemplary embodiment of the present application.
  • Figure 13 shows a structural block diagram of a computer device provided by an exemplary embodiment of the present application.
  • the "plurality” mentioned in this article means two or more than two.
  • “And/or” describes the relationship between related objects, indicating that there can be three relationships.
  • a and/or B can mean: A exists alone, A and B exist simultaneously, and B exists alone.
  • the character “/” generally indicates that the related objects are in an "or” relationship.
  • the source device needs to keep the screen on at all times. Once it enters the screen-off state, the source device will interrupt the connection with the destination device. End screen casting.
  • the source device In one possible scenario, during the process of mirroring the screen from the source device to the destination device, when the user operates the screen projection through the destination device instead of through the source device, the source device The end device still needs to keep the screen on. Once the source device enters the screen off state, the connection between the source device and the destination device will be interrupted, and the screen casting will fail. Therefore, during the screen casting process, the user needs to intermittently operate the source device (such as touch screen operation), or manually turn off the automatic screen-off function of the source device to prevent the source device from entering the screen-off state. However, keeping the screen on the source device will lead to increased power consumption and increase power consumption.
  • the source device automatically extends the screen-off time, and controls the screen to turn off when the extended screen-off time has not been reached, so that the screen is turned off without the screen being turned off. Without entering the screen-off state, the screen projection data stream transmission with the destination device can be maintained, which not only reduces the power consumption of the source device, but also avoids screen projection interruption caused by the source device automatically entering the screen-off state.
  • Figure 1 shows a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application.
  • the implementation environment includes a source device 101 and a destination device 102.
  • the source device 101 is an electronic device with a screen projection function, where the screen projection function may be a native application in the electronic device, or a function of a third-party application;
  • the destination device 102 is an electronic device with a screen projection display function, where , the screen projection display function can be a native application in the electronic device, or a function of a third-party application.
  • the electronic device may be a smartphone, a tablet computer, a personal computer, a wearable device or a vehicle-mounted terminal, etc.
  • the source device 101 is a smartphone and the destination device 102 is a television terminal for illustration. However, This does not constitute a limitation.
  • the source device 101 and the destination device 102 are located in the same local area network, and perform screencast data streaming through the local area network.
  • the source device 101 and the destination device 102 are connected to the same local area network provided by the router 103 at the same time, so that the screen projection data stream is transmitted through the router 103.
  • the source device 101 When the source device 101 casts the screen to the destination device 102, the source device 101 records the screen and collects device audio, thereby encoding the recorded images and audio to generate audio and video data streams, which are then passed through the router. 103 transmits the audio and video data stream to the destination device 102, and the destination device 102 decodes and plays the audio and video data stream.
  • the destination device 102 can transmit a reverse control instruction to the source device 101 through the router 103, and the source device 101 performs the corresponding reverse control operation according to the reverse control instruction.
  • the source device 101 and the destination device 102 are connected to the same local area network, which may be connected to the same router at the same time, or other possible ways, which are not limited in the embodiments of this application. Moreover, in other possible implementations, the source device 101 and the destination device 102 can also perform screencasting through the Internet, which is not limited in this embodiment.
  • the source device 101 can simultaneously transmit screen projection data streams to multiple destination devices 102 with screen casting functions (i.e., one-to-many projection), and the destination device 102 can also receive projections from multiple source devices 101 at the same time.
  • Screen data flow ie, many-to-one screen projection
  • the embodiment of the present application only takes one-to-one screen projection as an example for schematic description, but this is not a limitation.
  • Figure 2 shows a flow chart of a screen casting method provided by an exemplary embodiment of the present application.
  • This embodiment of the present application takes the method applied to the source device shown in Figure 1 as an example to illustrate. The method may include the following steps:
  • Step 201 In the screen casting state, set the screen-off duration from the first duration to the second duration.
  • the screen-off duration is the duration for the source device to automatically enter the screen-off state.
  • the second duration is longer than the first duration.
  • the source device Since the source device continues to keep the screen on when it has not received a screen-on operation (such as a touch screen operation) or an event (such as an incoming call notification) for a long time, it will cause an increase in power consumption. Therefore, in order to reduce power consumption, the source device The end device can set the screen-off duration, and will automatically enter the screen-off state when the screen-off duration is reached.
  • a screen-on operation such as a touch screen operation
  • an event such as an incoming call notification
  • the source device will reduce or turn off part of the voltage output, save running application data in the memory, monitor applications that switch to running in the background, turn off the screen, and keep the screen in the locked state. . Only after receiving the screen unlock operation can the source device light up the screen and continue running the application in the foreground.
  • the screen-off duration of the source device is set to the first duration. That is, in the non-screen-casting state, if no operation or event to keep the screen on is received within the first period of time, the source device automatically enters the screen-off state.
  • the screen duration is set from the first duration to the second duration, where the second duration is longer than the first duration.
  • the second duration may be the maximum value among the screen-off duration candidate values supported by the source device.
  • the second duration may be the maximum value of an integer (int).
  • the source device when the source device turns off the automatic screen-off function and sets the screen-off duration to the second duration, the source device will not enter the screen-off state, that is, the automatic screen-off function is turned off.
  • the screencasting state refers to the mirroring screencasting state.
  • the source device records the screen to obtain the screen recording, and displays the screen recording through the destination device.
  • the source device 301 automatically enters the screen-off state for 2 minutes.
  • the source device 301 Automatically extend the duration of entering the screen-off state to the maximum value of an integer (int), so that the source device 301 will not enter the screen-off state, that is, the automatic screen-off function is turned off.
  • Step 202 When the target duration is reached, control the screen to turn off, where the source device does not enter the screen-off state after the screen turns off, and the target duration is less than the second duration.
  • the screen of the source device is always on after extending the automatic screen-off time.
  • the source device in order to reduce the power consumption of the source device, on the premise of extending the screen-off duration, the source device can control the screen to turn off without entering the screen-off state when the target duration is reached, thereby reducing power consumption. Consumption.
  • the target duration is shorter than the second duration, which can be the first duration, or other duration that is shorter than the second duration.
  • the duration for controlling the screen to turn off is the same as the duration for the source device to automatically enter the screen-off state, thereby providing the user with a process of controlling the screen to turn off similar to entering the screen-off state, improving the user experience.
  • the process of turning off the screen of the source device is the same as the process of turning off the screen when entering the screen-off state.
  • the source device sets a countdown timer with a countdown time of a target time, and controls the screen to turn off after the countdown timer expires.
  • the source device since the screen-off duration of the source device is extended, the source device will not automatically enter the screen-off state before the second duration is reached. By reaching the target duration, the source device can control the screen to turn off, which not only avoids excessive power consumption of the source device, but also in terms of user experience, the process of turning off the screen of the source device is the same as when the screen enters the screen-off state. The extinguishing process is similar.
  • the method of controlling the screen extinguishing may be to adjust the screen brightness to zero, or to individually stop power supply to the screen, etc. This is not limited in the embodiments of the present application.
  • the source device controls the screen to turn off and does not enter the screen-off state.
  • the screen is in an unlocked state, and the source device maintains the screen recording and screencasting state.
  • Step 203 When the screen is turned off and the second duration has not been reached, the screen projection data stream transmission with the destination device is maintained.
  • the source device can maintain the screen-casting data stream transmission with the destination device, wherein the screen-casting data stream Including audio and video data streams sent by the source device to the destination device and reverse control instructions sent by the destination device to the source device.
  • the source device in the screen casting state, the source device will automatically enter the screen-off state from the first duration to the second duration, and when the target duration is reached, the screen will be controlled. Off, the target duration is less than the second duration. Since the source device only turns off the screen without entering the screen-off state before the second duration is reached, the source device can maintain the screen projection with the destination device. Data streaming.
  • the source device can automatically extend the screen-off time in the screen casting state, and maintain the screen-casting data flow with the destination device when the screen is off but does not enter the screen-off state. Transmission not only ensures normal screencasting between the source device and the destination device, but also avoids the increase in power consumption of the source device caused by keeping the screen on for a long time, helping to reduce the power consumption of the source device during the screencasting process. .
  • methods also include:
  • the screen brightness is adjusted from the first brightness to the second brightness, the third duration is less than the target duration, and the second brightness is less than the first brightness.
  • adjust the screen brightness from the first brightness to the second brightness including:
  • the brightness adjustment mode is set to the second adjustment mode.
  • the function of automatically adjusting the screen brightness based on the ambient light brightness is turned on.
  • the function of automatically adjusting screen brightness based on ambient light brightness is turned off;
  • the screen brightness is automatically adjusted from the first brightness to the second brightness.
  • methods also include:
  • the screen When a screen-on event is monitored, the screen is turned on.
  • the screen displayed after lighting is a non-lock screen screen, and the screen-on event is an event that triggers the screen to turn on;
  • the screen brightness is adjusted from the first brightness to the second brightness, including:
  • the screen brightness is adjusted from the first brightness to the second brightness.
  • the target event has the function of keeping the screen of the source device in a bright screen state;
  • Methods also include:
  • the screen brightness is adjusted to the first brightness.
  • control the screen to turn off when the target duration is reached including:
  • the target event has the function of keeping the screen of the source device in a bright screen state
  • Methods also include:
  • the countdown duration of the countdown timer is the target duration.
  • methods also include:
  • the screen When a screen lock event is detected within the target duration, the screen enters the screen-off state, in which the screen-casting data stream transmission between the source device and the destination device is interrupted in the screen-off state.
  • the screen when a lock screen event is detected within the target duration, the screen will be turned off, including:
  • methods also include:
  • the screen-on event is an event that triggers the screen to turn on
  • methods also include:
  • methods also include:
  • the process of the source device automatically changing from the screen on state to the screen off state includes the process of the screen changing from bright to dark and then off.
  • the process of the source device controlling the screen extinguishing can be consistent with the screen extinguishing process represented by the source device automatically entering the screen off state.
  • the following is a specific embodiment of the source device controlling the screen. The extinguishing process and the working status when the screen is extinguished are described in detail.
  • FIG. 4 shows a flow chart of a screen casting method provided by another exemplary embodiment of the present application.
  • This embodiment uses the method applied to the source device shown in Figure 1 as an example to illustrate.
  • the method may include the following steps:
  • Step 401 In the screen casting state, set the screen-off duration from the first duration to the second duration.
  • the screen-off duration is the duration for the source device to automatically enter the screen-off state.
  • the second duration is longer than the first duration.
  • step 201 For the implementation of this step, reference can be made to the above-mentioned step 201, which will not be described again in this embodiment.
  • Step 402 When the third duration is reached, adjust the screen brightness from the first brightness to the second brightness, the third duration is less than the target duration, and the second brightness is less than the first brightness.
  • the source device sets a third duration.
  • the source device adjusts the screen brightness from the first brightness to The second brightness simulates the process of the screen darkening when the source device automatically enters the screen-off state.
  • the difference between the third duration and the target duration is a fixed value.
  • the fixed value is 5 seconds.
  • the third duration is 55 seconds; when the target duration is 30 seconds, the third duration is 25 seconds.
  • the source device determines the third duration based on the target duration and the fixed value, thereby setting a countdown timer with a countdown duration of the third duration, and starts the countdown timer, so that after the countdown timer expires, the screen The brightness is adjusted from the first brightness to the second brightness.
  • users In order to ensure screen display effects under different environments, users generally set the brightness adjustment mode of the screen to the first adjustment mode (or automatic adjustment mode).
  • the first adjustment mode the function of automatically adjusting the screen brightness based on the ambient light brightness is turned on.
  • the source device automatically adjusts the screen brightness according to the ambient light brightness of its environment (which can be collected through the ambient light sensor). After the user manually adjusts the screen brightness, When the screen brightness is low, the source device will still adjust the screen brightness according to the ambient light brightness of its environment.
  • the brightness adjustment process may include the following steps:
  • the source device determines the current brightness adjustment mode. If the current brightness adjustment mode is the first adjustment mode, the brightness adjustment mode is modified to the second adjustment mode (or manual adjustment mode). In the second adjustment mode, the screen brightness is automatically adjusted based on the ambient light brightness. When turned off, the source device will not automatically adjust the screen brightness according to the ambient light brightness. When the user manually adjusts the screen brightness, the source device will not adjust the screen brightness according to the ambient light brightness of the environment in which it is located. If the current brightness adjustment mode is the second adjustment mode, the second adjustment mode is maintained.
  • the setting process of the brightness adjustment mode is automatically performed by the source device in the background and will not be perceived by the user side.
  • the source device automatically adjusts the screen brightness from the first brightness to the second brightness. Since the screen brightness will not change as the ambient light brightness changes in the second adjustment mode, the screen brightness will not change after being set to the second brightness.
  • the source device when the initial brightness adjustment mode of the source device is the second adjustment mode, the source device directly adjusts the first brightness to the second brightness.
  • the second brightness is a fixed value, and the second brightness is the brightness after the screen brightness is reduced before entering the screen-off state normally.
  • the second brightness is 50nit.
  • the source device sets the brightness adjustment mode to the second adjustment mode and adjusts the screen brightness from 1000nit to 50nit.
  • the source device monitors the target event.
  • the source device switches the screen to The brightness is adjusted from the first brightness to the second brightness, wherein the target event has the function of keeping the screen of the source device in a bright screen state.
  • the target event may be an incoming call notification, a message reminder, a touch screen operation, a voice control instruction, etc., which are not limited in the embodiments of the present application.
  • the source device responds to the target event and maintains the first brightness.
  • the source device sets a countdown timer with a countdown duration of a third duration, and starts the countdown timer. If the target event is not monitored during the countdown process, the screen brightness will be adjusted to the second brightness after the countdown timer expires; if the target event is monitored during the countdown process, the countdown timer will be reset when the target event is monitored, and Keep the screen brightness at first brightness.
  • the source device 501 sets the target duration to 1 minute and the third duration to 55 seconds.
  • the source device The device 501 adjusts the screen brightness from a first brightness of 1000 nit to a second brightness of 50 nit.
  • the source device adjusts the screen brightness to the first brightness.
  • the source device monitors the target event. In order to facilitate the user's subsequent operations, the source device restores the screen brightness to the first brightness.
  • the source device 501 when the source device 501 detects a touch screen operation, it adjusts the screen brightness from 50 nit to 1000 nit to facilitate the user's subsequent operations.
  • Step 403 When the target duration is reached and the target event is not monitored, the screen is controlled to turn off.
  • the target event has the function of keeping the screen of the source device in a bright screen state.
  • the source device sets a countdown timer with a countdown time of the target time and starts the countdown timer. If the target event is not monitored during the countdown, the control screen will turn off after the countdown timer expires.
  • the target event has the function of keeping the screen of the source device in a bright screen state.
  • the target event can be triggered by the user's operation on the source device, such as a touch event triggered by the user's touch screen operation on the source device. It can be triggered by a notification received by the source device, such as an incoming call notification received by the source device.
  • the source device 501 does not detect touch screen operations and incoming call notifications within the target duration, it controls the screen to turn off when the target duration is reached.
  • Step 404 When the target event is monitored within the target duration, the screen is kept on and the countdown timer is reset. The countdown duration of the countdown timer is the target duration.
  • the source device when the target event is monitored during the countdown process (the countdown duration of the countdown timer is the target duration), in order to facilitate the user's subsequent operation processing, the source device keeps the screen in the bright screen state, and Reset the countdown timer when the target event is heard.
  • the source device saves the current brightness adjustment mode and the first brightness. If the target event is monitored when the third duration is reached but the target duration is not reached, the source device restores the saved brightness adjustment mode and restores the screen brightness to the first brightness.
  • Step 405 When the screen is turned off and the second duration has not been reached, maintain screencast data stream transmission with the destination device.
  • step 203 For the implementation of this step, reference can be made to the above-mentioned step 203, which will not be described again in this embodiment.
  • Step 406 When the screen is turned off and the second duration has not been reached, receive a reverse control instruction sent by the destination device.
  • the reverse control instruction is used to perform reverse control of the source device.
  • the destination device When the screen is off and the second duration has not been reached, when the user operates on the screen projection screen through the destination device, the destination device sends the user operation to the source device in the form of a reverse control instruction. Further, The source device receives the reverse control instruction and performs the corresponding reverse control operation.
  • the destination device receives the user's operation instructions on the screen projection.
  • the destination device receives the user's touch operation on the screen, or through peripheral devices (such as mouse, keyboard, etc.) Receive operation instructions.
  • the destination device recognizes the operation instruction, converts it into a reverse control instruction for the source device, and sends the reverse control instruction to the source device.
  • the reverse control instruction includes the operation type and the corresponding operation parameters.
  • the reverse control instruction when the destination device receives a click operation from the mouse, the reverse control instruction includes the operation type "click", the click coordinates corresponding to the click operation, and the number of clicks for the click operation; when the destination device receives a sliding operation, The reverse control instruction includes the operation type "sliding" and the sliding trajectory coordinates of the sliding operation; when the destination device receives the long press operation, the reverse operation instruction includes the operation type "long press", the long press corresponding to the long press operation Coordinates and long press duration, etc.
  • the embodiments of the present application do not limit the specific parameters included in the reverse control instructions.
  • Step 407 Perform the reverse control operation indicated by the reverse control instruction.
  • the source device performs the reverse control operation indicated by the reverse control instruction.
  • the user can see the updated projection screen after the reverse control operation through the destination device.
  • the source device needs to perform coordinate transformation on the parameters in the reverse control instruction before performing the reverse control operation. In this embodiment, No further details will be given.
  • the screen of the source device remains off.
  • Step 408 When a screen-on event is detected, the screen is turned on.
  • the screen displayed after lighting is a non-lock screen screen, and the screen-on event is an event that triggers the screen to turn on.
  • the source device monitors the screen-on event when the screen is off, and lights the screen when it detects the screen-on event.
  • the screen brightening event is an event that triggers the screen to brighten.
  • the screen-on event can be an event triggered by pressing a physical button, an event triggered by a touch operation, a time triggered by a voice control command, or an event triggered by a specific notification (such as an incoming call notification). ), etc., the embodiments of the present application do not limit this.
  • the source device needs to register the screen bright event.
  • the source device will light the screen only when it detects the registered screen bright event.
  • the registered screen-on event may be the same as the event that wakes up the source device to exit the screen-off state, or may be different, which is not limited in the embodiments of the present application.
  • the registered screen-on events can include power button press events, screen click events, and notification events, or only power button press events.
  • incoming call notification events that is, notification events of specified types).
  • the source device When the source device is awakened to exit the screen-off state, since the screen is still locked, the source device lights up the screen and displays the lock screen interface, waiting for the unlock operation.
  • the source device in the screen casting state, since the source device only controls the screen to turn off and does not enter the screen-off state (it does not enter the screen-locking state), when a screen-on event is monitored, the source device Turn on the screen, and when it lights up, the screen will directly display the current projection screen instead of the lock screen interface.
  • the source device registers the pressing operation of the power button as a screen-on event.
  • the source device lights up the screen and directly displays the current screen projection without the need for Carry out unlocking operation.
  • the source device when the source device registers the incoming call notification as a screen-on event, when the incoming call notification is monitored, the source device lights up the screen and displays the incoming call interface. During the process of answering an incoming call, the source device first performs privacy processing on the screen recording, then encodes the screen recording, generates a data stream, and transmits it to the destination device.
  • the privacy processing method includes but is not limited to calling the caller ID. The number is mosaic processed.
  • Step 409 Set the screen brightness to the first brightness and set the brightness adjustment mode to the first adjustment mode.
  • the source device adjusts the brightness adjustment mode and the screen brightness. Therefore, in order to ensure the screen brightness after the screen is turned on and before the screen is turned off, As well as the consistency of the brightness adjustment mode, the source device sets the screen brightness to the first brightness and resets the brightness adjustment mode to the first adjustment mode.
  • Step 410 When exiting the screen projection state, set the screen-off duration to the first duration.
  • the source device Since the second duration is set to prevent the source device from quickly entering the screen-off state in the screen casting state, in order to reduce power consumption when exiting the screen casting state, the source device will adjust the screen-off duration by the second duration.
  • is the first duration that is, the duration for the source device to automatically enter the screen-off state after returning to normal use. It should be noted that if you exit the screen casting state while the screen is turned off, the source device needs to restore the brightness adjustment mode and screen brightness.
  • exiting the screen casting state can be triggered by the destination device.
  • the source device when receiving the exit screen casting command sent by the destination device, the source device exits the screen casting state; alternatively, exiting the screen casting state can also be triggered by the source device.
  • Device trigger for example, when receiving the screen casting exit operation, the source device exits the screen casting state; or, exiting the screen casting state can be automatically triggered when the screen casting link is disconnected, for example, the screen casting link is disconnected due to network reasons When disconnected, the source device exits the screencasting state.
  • the source device in the screen casting state, by setting the third duration and monitoring the target event, the source device can control the screen extinguishing process to be consistent with the screen extinguishing process when entering the screen off state, improving the user's comfort. user experience, and when a screen-on event is detected, the source device can directly display the interface where the screen-on event is located, omitting the step of unlocking the screen, making it convenient for users to perform follow-up processing in a timely manner.
  • the above embodiment is only one possible control logic.
  • the source device monitors the screen-on event and receives the reverse control sent by the destination device. Instructions can be executed simultaneously, and the embodiments of this application do not limit the specific control logic.
  • FIG. 6 shows a work flow chart after the screen is turned off in the screen projection state provided by another exemplary embodiment of the present application.
  • the source device 601 controls the screen to turn off in the screen casting state
  • the screen casting data stream transmission with the destination device 602 is maintained.
  • the source device 601 registers the call notification and the trigger operation of the power button as a screen-on event
  • the source device 601 judges the events in sequence. First, it judges whether a reverse control command is received.
  • the source device 601 After receiving the reverse control command, the source device 601 In the case of an instruction, the source device 601 performs the reverse control operation indicated by the reverse control instruction and keeps the screen off; if the reverse control instruction is not received, the source device 601 continues to determine whether the incoming call notification is monitored. In the case of an incoming call notification, the source device 601 lights up the screen and displays the incoming call notification; when no incoming call notification is detected, it continues to determine whether the volume key triggering operation is detected. In the case of the volume key triggering operation is detected, the source device 601 The terminal device 601 adjusts the volume according to the volume key triggering operation and keeps the screen off; when the volume key triggering operation is not monitored, it continues to determine whether the power button triggering operation is monitored. When the power button triggering operation is monitored, In this case, the source device 601 lights up the screen and directly displays the screen projection image. When the triggering operation of the power key is not monitored, the source device 601 keeps the screen off.
  • the source device can simultaneously receive reverse control instructions, monitor incoming call operations, and monitor volume key trigger operations. and monitoring the triggering operation of the power button for judgment. The judgment may also be made according to a judgment sequence different from that shown in FIG. 6 , which is not limited by the embodiment of the present application.
  • the destination device in response to the screen lock event of the source device, disconnects from the source device and exits the screencasting state. Casting again requires a new screencasting connection.
  • the destination device when the source device responds to the screen lock event and enters the screen-off state, the destination device maintains the connection state with the source device and displays a lock screen prompt screen to prompt the user that the source device is in The screen is locked and the screen is off. After the source device unlocks the screen, the destination device interface resumes displaying the screen projection screen.
  • the source device When a screen lock event is detected within the target duration, the source device enters the screen-off state, in which the screen-casting data stream transmission between the source device and the destination device is interrupted in the screen-off state.
  • the source device when a screen lock event is detected within the target duration, the source device enters the screen lock and screen-off state, stops recording the screen, and interrupts the screen projection with the destination device. Stream data and monitor applications running in the background.
  • the screen lock event may be an event triggered by a physical button (such as pressing the power button), or may be an event triggered by a voice control command, etc. This is not limited in the embodiments of the present application.
  • the process specifically includes the following steps:
  • Step 701 When a screen lock event is detected within a target duration, a screen lock message is sent to the destination device so that the destination device displays a screen lock prompt screen based on the screen lock message.
  • the source device when a screen lock event is detected within the target duration, the source device sends a screen lock message to the destination device, prompting the destination device that the screen projection data flow is interrupted and the screen is about to be locked and turned off. state.
  • the lock screen message can be an instruction in the screen mirroring data stream transmitted from the source device to the destination device, instructing the destination device to display a preset lock screen prompt screen; it can also be a lock screen message contained in the screen mirroring data stream. Screen prompt image, and the destination device displays the lock screen prompt screen based on the image. During the process of the destination device decoding the screen projection data stream and generating the screen projection image, when the destination device monitors the command or the lock screen prompt image, it receives that the source device is about to enter the screen lock and screen off state. lock screen message.
  • Step 702 Enter the screen-off state.
  • the source device enters the screen-off state and interrupts screencast data stream transmission with the destination device.
  • the destination device displays a screen lock prompt screen.
  • the source device 801 enters the screen-off state and interrupts the screen projection data stream transmission with the destination device 802. At the same time, the destination device 802 displays a screen lock prompt screen.
  • Step 703 In the screen-off state, when a screen-on event is detected, the screen is turned on and the lock screen interface is displayed.
  • the screen-on event is an event that triggers the screen to turn on.
  • the source device monitors the screen-on event, it lights up the screen and displays the lock screen to be unlocked interface. At this time, the screen brightness is set to the first brightness, and the source device continues to maintain communication with the destination device. Interruption of the screencast data stream.
  • the source device turns off the screen and continues to maintain the screen-off state, where the fourth duration is the screen-on duration waiting for the user to perform an unlocking operation.
  • the source device registers the incoming call notification as a screen-on event.
  • the source device lights up the screen and displays the incoming call screen.
  • the unlocking operation is detected, after the incoming call ends, the source device The screen of the source device remains on; after the incoming call ends and no unlocking operation is detected, the screen of the source device remains off.
  • Step 704 If the unlocking is successful, resume screencast data stream transmission with the destination device.
  • the source device when the unlocking is successful, continues to record the screen image and collect the device audio, thereby encoding the recorded image and audio, generating an audio and video data stream, and converting the generated Audio and video data streams are transmitted to the destination device.
  • the destination device After receiving the audio and video data stream, the destination device stops displaying the lock screen prompt screen and displays the screen projection screen again.
  • the source device receives the reverse control instruction from the destination device and performs the reverse control operation indicated by the reverse control instruction.
  • the source device 801 continues to record the screen, collect the device audio, and transmit the generated audio and video data stream to the destination device 802.
  • the device 802 directly displays the projected screen image.
  • the source device during the screencasting process, after the source device enters the screen-locked and screen-off state, it can maintain the connection with the destination device, and prompt the source device that the source device is in the screen-lock and screen-off state through the destination device. Helps users understand the status of source devices in a timely manner.
  • the source device can directly resume streaming data transmission with the destination device, which improves the convenience of operation during the screencasting process.
  • FIG. 9 shows a work flow chart in the screen lock and off state during screen casting provided by another exemplary embodiment of the present application.
  • the source device 901 interrupts the screen projection data stream transmission with the destination device 902, and the destination device 902 displays a lock screen prompt screen.
  • the source device 901 registers the incoming call notification and the trigger operation of the power button as a screen-on event, the source device 901 judges the events in sequence.
  • the source device 901 detects the incoming call notification, the source device 901 lights up the screen.
  • the source device 901 exits the lock screen and screen off state; if there is no successful unlocking operation, the source device 901 returns to the lock and screen off state; when no incoming call notification is monitored, In this case, continue to determine whether the triggering operation of the power key is monitored. When the triggering operation of the power key is monitored, the source device 901 lights up the screen. If there is a successful unlocking operation, the source device 901 exits the screen lock and screen off state. , resume screencast data stream transmission with the destination device 902. When the triggering operation of the power key is not monitored, the source device 901 remains in the screen-locked state.
  • the source device can simultaneously determine the triggering operation of monitoring incoming call notifications and monitoring the power button.
  • the embodiments of this application do not limit the specific execution sequence. .
  • FIG. 10 shows the overall workflow diagram of entering the screen casting state provided by another exemplary embodiment of the present application.
  • Step 1001 In the screen projection state, keep the screen on.
  • the source device keeps the screen on, and the screencasting data stream is transmitted between the source device and the destination device.
  • Step 1002 Determine whether there is a screen lock event.
  • the source device monitors the lock screen event and determines whether there is a lock screen event. If there is a lock screen event, proceed to step 1003; if there is no lock screen event, proceed to step 1004.
  • Step 1003 Enter the screen lock and screen off state.
  • the source device When a screen lock event is monitored, the source device sends a screen lock message to the destination device, the destination device displays a screen lock prompt screen, and the source device interrupts the screencast data stream transmission with the destination device.
  • Step 1004 Determine whether there is an incoming call notification or touch screen operation.
  • the source device monitors incoming call notifications and touch screen operations to determine whether there are incoming call notifications or touch screen operations. If there are incoming call notifications or touch screen operations, return to step 1001 and keep the screen on; if there are no incoming call notifications or touch screen operations, screen operation, proceed to step 1005.
  • Step 1005 adjust screen brightness.
  • the source device adjusts the screen brightness from the first brightness to the second brightness, and when the brightness adjustment mode is the first adjustment mode, adjusts the brightness adjustment mode to the second adjustment mode.
  • Step 1006 Continue to determine whether there is an incoming call notification or touch screen operation.
  • the source device continues to monitor incoming call notifications and touch screen operations to determine whether there are incoming call notifications or touch screen operations. If there are incoming call notifications or touch screen operations, return to step 1001 and keep the screen on; if there are no incoming call notifications or touch screen operations, For touch screen operation, proceed to step 1007.
  • Step 1007 Control the screen to turn off, monitor incoming call notifications and trigger operations on the power button.
  • the source device controls the screen to turn off and monitors incoming call notifications and triggering of the power button. At the same time, the source device maintains screencast data stream transmission with the destination device. The destination device The device keeps displaying the projected screen.
  • FIG 11 shows a structural block diagram of a screen projection system provided by an exemplary embodiment of the present application.
  • the screen projection system includes a source device 1101 and a destination device 1102.
  • the source device 1101 is used to set the screen-off duration from the first duration to the second duration in the screen casting state.
  • the screen-off duration is the duration for the source device 1101 to automatically enter the screen-off state.
  • the second duration is longer than the first duration. ;
  • control the screen to turn off where the source device does not enter the screen-off state after the screen turns off, and the target duration is less than the second duration; when the screen turns off and the second duration is not reached, maintain the same state as the purpose Screen projection data streaming between end devices 1102.
  • the destination device 1102 is configured to receive the audio and video data stream transmitted by the source device 1101 while the screen projection data stream with the source device 1101 is still being transmitted; and play the screen projection content based on the audio and video data stream.
  • the screen projection data stream transmitted between the source device 1101 and the destination device 1102 also includes reverse control instructions.
  • the destination device 1102 is configured to receive a reverse control operation on the screen projection content when the screen of the source device 1101 is turned off and has not reached the second duration; and sends a reverse control operation to the source device 1101 based on the reverse control operation. instruction.
  • the destination device 1102 When the destination device 1102 receives a reverse control operation on the screen projection content, the reverse control operation is converted into a corresponding reverse control instruction, where the reverse control instruction includes the operation type and the corresponding operation parameters. , so that the destination device 1102 sends the reverse control instruction to the source device 1101.
  • the source device 1101 is used to perform the reverse control operation indicated by the reverse control instruction.
  • the source device 1101 enters the screen-locked and screen-off state, and the screen projection data stream transmission between the source device 1101 and the destination device 1102 is interrupted.
  • the source device 1101 is used to enter the screen-off state and send a screen-lock message to the destination device 1102 when a screen lock event is detected within the target duration.
  • the source device 1101 and the destination device The screencast data stream transmission between 1102 is interrupted;
  • the destination device 1102 is configured to display a lock screen prompt screen based on the lock screen message when the source device 1101 enters the screen-off state.
  • the destination device 1102 displays a screen-lock prompt screen based on the received screen-lock message.
  • the source device 1101 is also used to light up the screen and display the lock screen interface when the screen is off and a screen-on event is detected.
  • the screen-on event is an event that triggers the screen to turn on; in the case of successful unlocking , resume screencast data stream transmission with the destination device 1102.
  • FIG. 12 shows a structural block diagram of a screen projection device provided by an exemplary embodiment of the present application.
  • the device may include the following structure:
  • the duration setting module 1201 is used to set the screen-off duration from the first duration to the second duration in the screen projection state.
  • the screen-off duration is the duration for the source device to automatically enter the screen-off state.
  • the second duration is greater than the first duration;
  • the screen control module 1202 is configured to control the screen to turn off when the target duration is reached, wherein the source device does not enter the screen-off state after the screen is turned off, and the target duration is less than the second duration;
  • the data transmission module 1203 is configured to maintain the screen projection data stream transmission with the destination device when the screen is turned off and the second duration has not been reached.
  • the screen control module 1202 is also configured to adjust the screen brightness from the first brightness to the second brightness when a third duration is reached, the third duration is less than the target duration, and the second brightness is less than the third brightness.
  • the screen control module 1202 is used for:
  • the brightness adjustment mode is set to the second adjustment mode, wherein in the first adjustment mode, the function of automatically adjusting the screen brightness based on the ambient light brightness is turned on, and the In the second adjustment mode, the function of automatically adjusting screen brightness based on ambient light brightness is turned off;
  • the screen brightness is automatically adjusted from the first brightness to the second brightness.
  • the screen control module 1202 is also configured to light the screen when a screen-on event is detected, wherein the screen displayed on the screen after lighting is a non-lock screen screen, and the screen-on event is an event that triggers the screen to turn on;
  • the screen brightness is set to the first brightness
  • the brightness adjustment mode is set to the first adjustment mode
  • the screen control module 1202 is used for:
  • the screen brightness is adjusted from the first brightness to the second brightness.
  • the target event has the function of keeping the screen of the source device bright. Screen status function;
  • the screen brightness is adjusted to the first screen brightness.
  • the screen control module 1202 is used for:
  • the target event has the function of keeping the screen of the source device in a bright screen state
  • the countdown duration of the countdown timer is the target duration.
  • the device also includes:
  • the screen-locking and screen-off module is configured to enter the screen-off state when a screen-lock event is monitored within the target duration, wherein the source device and the destination device are in the screen-off state.
  • the screencast data stream transmission is interrupted.
  • the screen lock and screen off module is used for:
  • the screen-on event is an event that triggers the screen to turn on
  • the data transmission module 1203 is also configured to resume screencast data stream transmission with the destination device if the unlocking is successful.
  • the data transmission module 1203 is also configured to receive a reverse control instruction sent by the destination device when the screen is turned off and the second duration is not reached.
  • the reverse control instruction is used to control the source device. perform reverse control;
  • An operation execution module is used to execute the reverse control operation indicated by the reverse control instruction.
  • the screen control module 1202 is also configured to set the screen off duration to the first duration when exiting the screen projection state.
  • the source device in the screen casting state, the source device will automatically enter the screen-off state from the first duration to the second duration, and when the target duration is reached, the screen will be controlled. Off, the target duration is less than the second duration. Since the source device only turns off the screen without entering the screen-off state before the second duration is reached, the source device can maintain the screen projection with the destination device. Data streaming.
  • the source device can automatically extend the screen-off time in the screen casting state, and maintain the screen-casting data flow with the destination device when the screen is off but does not enter the screen-off state. Transmission not only ensures normal screencasting between the source device and the destination device, but also avoids the increase in power consumption of the source device caused by keeping the screen on for a long time, helping to reduce the power consumption of the source device during the screencasting process. .
  • the source device can control the screen extinguishing process to be consistent with the screen extinguishing process when entering the screen off state, improving the user experience. And when a screen-on event is monitored, the source device can directly display the interface where the screen-on event is located, omitting the step of unlocking the screen, making it convenient for users to perform follow-up processing in a timely manner.
  • the device provided in the above embodiments is only exemplified by the division of the above functional modules.
  • the above function allocation can be completed by different functional modules as needed, that is, the internal structure of the device is divided into Different functional modules to complete all or part of the functions described above.
  • the apparatus and method embodiments provided in the above embodiments belong to the same concept, and the implementation process can be found in the method embodiments, which will not be described again here.
  • Computer device 1300 may include one or more of the following components: processor 1310, memory 1320, and display screen 1330.
  • Processor 1310 may include one or more processing cores.
  • the processor 1310 uses various interfaces and lines to connect various parts of the entire computer device 1300, and executes by running or executing instructions, programs, code sets or instruction sets stored in the memory 1320, and calling data stored in the memory 1320.
  • the processor 1310 can use at least one of digital signal processing (Digital Signal Processing, DSP), field-programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). implemented in hardware form.
  • DSP Digital Signal Processing
  • FPGA Field-Programmable Gate Array
  • PLA programmable logic array
  • the processor 1310 can integrate one or more of a central processing unit (Central Processing Unit, CPU), a graphics processor (Graphics Processing Unit, GPU), a neural network processor (Neural-network Processing Unit, NPU), a modem, etc.
  • a central processing unit Central Processing Unit, CPU
  • a graphics processor Graphics Processing Unit, GPU
  • a neural network processor Neural-network Processing Unit, NPU
  • the CPU mainly handles the operating system, user interface and applications
  • the GPU is used to render and draw the content that needs to be displayed on the touch screen
  • the NPU is used to implement artificial intelligence (Artificial Intelligence, AI) functions
  • the modem is used to process Wireless communication. It can be understood that the above-mentioned modem may not be integrated into the processor 1310 and may be implemented by a separate chip.
  • the memory 1320 may include random access memory (RAM) or read-only memory (Read-Only Memory, ROM). Optionally, the memory 1320 includes non-transitory computer-readable storage medium. Memory 1320 may be used to store instructions, programs, codes, sets of codes, or sets of instructions.
  • the memory 1320 may include a program storage area and a data storage area, where the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), Instructions, etc., used to implement each method embodiment described below; the storage data area may store data created according to the use of the computer device 1300 (such as audio data, phone book), etc.
  • the display screen 1330 is a component for displaying a screen.
  • the display screen 1330 also has a touch function, and the user can control the displayed content by performing touch operations on the display screen 1330 .
  • the display screen 1330 is a touch display screen of a smart phone, or the display screen 1330 is a non-touch display screen of a television terminal.
  • the structure of the computer device 1300 shown in the above figures does not constitute a limitation on the computer device.
  • the computer device may include more or less components than those shown in the figures, or a combination thereof. Certain parts, or different arrangements of parts.
  • the computer device 1300 also includes components such as a camera, a microphone, a speaker, a radio frequency circuit, an input unit, a sensor (such as an acceleration sensor, an angular velocity sensor, a light sensor, etc.), an audio circuit, a WiFi module, a power supply, a Bluetooth module, etc.
  • a sensor such as an acceleration sensor, an angular velocity sensor, a light sensor, etc.
  • an audio circuit such as a WiFi module, a power supply, a Bluetooth module, etc.
  • Embodiments of the present application also provide a computer-readable storage medium that stores at least one program code.
  • the program code is loaded and executed by the processor to implement the screen projection method described in the above embodiments. .
  • Embodiments of the present application provide a computer program product.
  • the computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium.
  • the processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the screen projection method provided in various optional implementations of the above aspect.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

一种投屏方法、装置、设备、系统及存储介质,属于投屏技术领域。该方法包括:投屏状态下,将熄屏时长由第一时长设置为第二时长,所述熄屏时长是所述源端设备自动进入熄屏状态的时长,所述第二时长大于所述第一时长(201);在达到目标时长的情况下,控制屏幕熄灭,其中,屏幕熄灭后所述源端设备未进入所述熄屏状态,所述目标时长小于所述第二时长(202);在屏幕熄灭且未达到所述第二时长的情况下,保持与目的端设备之间的投屏数据流传输(203)。

Description

投屏方法、装置、设备、系统及存储介质
本申请要求于2022年06月16日提交的申请号为202210684186.1、发明名称为“投屏方法、装置、设备、系统及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请实施例涉及投屏技术领域,特别涉及一种投屏方法、装置、设备、系统及存储介质。
背景技术
为了满足人们对投屏显示的需求,镜像投屏技术正在不断的发展。
相关技术中,在进行镜像投屏的过程中,源端(source)设备需要始终保持亮屏状态,一旦进入熄屏状态,目的端(sink)设备的投屏画面就会中断,导致用户投屏体验效果变差,而源端设备一直保持亮屏状态,又会导致源端设备功耗增加。
发明内容
本申请实施例提供了一种投屏方法、装置、设备及存储介质。所述技术方案如下:
一方面,本申请实施例提供了一种投屏方法,所述方法由源端设备执行,所述方法包括:
投屏状态下,将熄屏时长由第一时长设置为第二时长,所述熄屏时长是所述源端设备自动进入熄屏状态的时长,所述第二时长大于所述第一时长;
在达到目标时长的情况下,控制屏幕熄灭,其中,屏幕熄灭后所述源端设备未进入所述熄屏状态,所述目标时长小于所述第二时长;
在屏幕熄灭且未达到所述第二时长的情况下,保持与目的端设备之间的投屏数据流传输。
另一方面,本申请实施例提供了一种投屏装置,所述装置包括:
时长设置模块,用于投屏状态下,将熄屏时长由第一时长设置为第二时长,所述熄屏时长是所述源端设备自动进入熄屏状态的时长,所述第二时长大于所述第一时长;
屏幕控制模块,用于在达到目标时长的情况下,控制屏幕熄灭,其中,屏幕熄灭后所述源端设备未进入所述熄屏状态,所述目标时长小于所述第二时长;
数据传输模块,用于在屏幕熄灭且未达到所述第二时长的情况下,保持与目的端设备之间的投屏数据流传输。
另一方面,本申请实施例提供了一种投屏系统,所述投屏系统包括源端设备和目的端设备;
所述源端设备,用于在投屏状态下,将熄屏时长由第一时长设置为第二时长,所述熄屏时长是所述源端设备自动进入熄屏状态的时长,所述第二时长大于所述第一时长;在达到目标时长的情况下,控制屏幕熄灭,其中,屏幕熄灭后所述源端设备未进入所述熄屏状态,所述目标时长小于所述第二时长;在屏幕熄灭且未达到所述第二时长的情况下,保持与目的端设备之间的投屏数据流传输;
所述目的端设备,用于在与所述源端设备之间的投屏数据流保持传输的情况下,接收所述源端设备传输的音视频数据流;基于所述音视频数据流播放投屏内容。
另一方面,本申请实施例提供了一种计算机设备,所述计算机设备包括处理器和存储器;所述存储器存储有至少一条指令,所述至少一条指令用于被所述处理器执行以实现如上述方面所述的投屏方法。
另一方面,本申请实施例提供了一种计算机可读存储介质,所述计算机可读存储介质中存储有至少一条程序代码,所述程序代码由处理器加载并执行以实现如上述方面所述的投屏方法。
另一方面,本申请实施例提供了一种计算机程序产品,该计算机程序产品包括计算机指令,该计算机指令存储在计算机可读存储介质中。计算机设备的处理器从计算机可读存储介质读取该计算机指令,处理器执行该计算机指令,使得该计算机设备执行上述方面的各种可选实现方式中提供的投屏方法。
附图说明
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1示出了本申请一个示例性实施例提供的实施环境的示意图;
图2示出了本申请一个示例性实施例提供的投屏方法的流程图;
图3是本申请一个示例性实施例示出的达到目标时长屏幕熄灭的实施示意图;
图4示出了本申请另一个示例性实施例提供的投屏方法的流程图;
图5是本申请一个示例性实施例示出的控制屏幕亮度的实施示意图;
图6是本申请另一个示例性实施例提供的投屏状态下屏幕熄灭之后的工作流程图;
图7是本申请另一个示例性实施例提供的进入锁屏熄屏状态的流程图;
图8是本申请另一个示例性实施例示出的解锁成功后恢复投屏数据流传输的实施示意图;
图9是本申请另一个示例性实施例提供的投屏过程中锁屏熄屏状态下的工作流程图;
图10是本申请另一个示例性实施例提供的进入投屏状态的总工作流程图;
图11是本申请一个示例性实施例提供的投屏系统的结构框图;
图12是本申请一个示例性实施例提供的投屏装置的结构框图;
图13示出了本申请一个示例性实施例提供的计算机设备的结构方框图。
具体实施方式
为使本申请的目的、技术方案和优点更加清楚,下面将结合附图对本申请实施方式作进一步地详细描述。
在本文中提及的“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。
相关技术中,在源端设备向目的端设备进行投屏的过程中,源端设备需要始终保持亮屏工作状态,一旦进入熄屏状态,源端设备将中断与目的端设备之间的连接,结束投屏。
在一种可能的场景中,源端设备向目的端设备进行镜像投屏的过程中,在用户通过目的端设备对投屏画面进行操作,而不再通过源端设备进行操作的情况下,源端设备仍然需要保持亮屏状态,一旦源端设备进入熄屏状态,将会导致源端设备与目的端设备之间的连接中断,进而投屏失败。因此,在投屏过程中,用户需要间歇性地对源端设备进行操作(比如触屏操作),或者手动关闭源端设备的自动熄屏功能,以此来避免源端设备进入熄屏状态。然而,源端设备保持亮屏状态又会导致功耗增加,增大耗电量。
本申请实施例中,针对上述问题,在进行投屏的过程中,源端设备自动延长熄屏时长,并在未达到延长后熄屏时长的情况下,控制屏幕熄灭,使得在仅熄灭屏幕而不进入熄屏状态的情况下,能够保持与目的端设备之间的投屏数据流传输,既降低了源端设备的功耗,又避免因源端设备自动进入熄屏状态导致投屏中断。
图1示出了本申请一个示例性实施例提供的实施环境的示意图。该实施环境包括源端设备101和目的端设备102。
源端设备101是具有投屏功能的电子设备,其中,该投屏功能可以为电子设备中原生应用,或者,第三方应用的功能;目的端设备102是具有投屏显示功能的电子设备,其中,该 投屏显示功能可以为电子设备中原生应用,或者,第三方应用的功能。该电子设备可以是智能手机、平板电脑、个人计算机、可穿戴式设备或车载终端等等,图1中,以源端设备101为智能手机、目的端设备102为电视终端为例进行说明,但并不对此构成限定。
在一种可能的实施方式中,源端设备101和目的端设备102位于同一局域网下,并通过该局域网进行投屏数据流传输。
如图1所示,源端设备101和目的端设备102同时连接在路由器103提供的同一局域网下,从而通过路由器103进行投屏数据流传输。
在源端设备101向目的端设备102进行投屏的过程中,源端设备101对屏幕画面进行录制,并采集设备音频,从而对录制画面和音频进行编码,生成音视频数据流,进而通过路由器103将该音视频数据流传输至目的端设备102,由目的端设备102对音视频数据流进行解码播放。此外,当支持反向控制功能时,目的端设备102可以通过路由器103向源端设备101传输反向控制指令,源端设备101即根据该反向控制指令执行相应的反向控制操作。
需要说明的是,源端设备101和目的端设备102连接在同一局域网下的方式,可以是同时连接在同一路由器下,也可以是其他可能的方式,本申请实施例对此并不进行限定。并且,在其他可能的实施方式中,源端设备101和目的端设备102也可以通过互联网进行投屏,本实施例对此不作限定。
此外,源端设备101可以同时向多个具有投屏功能的目的端设备102传输投屏数据流(即一对多投屏),目的端设备102也可以同时接收多个源端设备101的投屏数据流(即多对一投屏),本申请实施例仅以一对一投屏为例进行示意性说明,但对此并不构成限定。
请参考图2,其示出了本申请一个示例性实施例提供的投屏方法的流程图。本申请实施例以该方法用于图1所示的源端设备为例进行说明,该方法可以包括如下步骤:
步骤201,投屏状态下,将熄屏时长由第一时长设置为第二时长,熄屏时长是源端设备自动进入熄屏状态的时长,第二时长大于第一时长。
由于源端设备在长时间没有接收到保持亮屏操作(比如触屏操作)或者事件(比如来电通知)的情况下,仍然保持屏幕点亮状态会导致功耗增加,因此为了降低功耗,源端设备可以设置熄屏时长,并在达到熄屏时长的情况下,自动进入熄屏状态。
在该熄屏状态下,源端设备将调低或者关闭一部分电压的输出,并将正在运行的应用数据保存在存储器中,对切换至后台运行的应用进行监听,熄灭屏幕并保持屏幕进入锁定状态。只有接收到对屏幕的解锁操作,源端设备才能点亮屏幕并在前台继续应用的运行。
可选的,非投屏状态下,源端设备的熄屏时长被设置为第一时长。即在非投屏状态下,若在第一时长内未接收到保持亮屏操作或者事件,源端设备自动进入熄屏状态。
为了避免在投屏状态下,在达到第一时长且未接收到保持亮屏操作或者事件的情况下,源端设备自动进入熄屏状态,源端设备在进入投屏状态的同时,自动将熄屏时长由第一时长设置为第二时长,其中,该第二时长大于第一时长。通过设置该第二时长,可以延长源端设备自动进入熄屏状态的时间,避免因源端设备短时间内进入熄屏状态导致的投屏中断问题。
可选的,第二时长可以是源端设备支持设置的熄屏时长候选值中的最大值,比如,该第二时长为整型(int)最大值。或者,在源端设备关闭自动熄屏功能的情况下,将熄屏时长设置为第二时长时,源端设备将不会进入熄屏状态,即自动熄屏功能关闭。
可选的,投屏状态指的是镜像投屏状态。源端设备通过对屏幕进行录制,得到录屏画面,并通过目的端设备显示该录屏画面。
示意性的,如图3所示,非投屏状态下,源端设备301自动进入熄屏状态的时长为2分钟,在开启投屏功能向目的端设备302进行投屏时,源端设备301自动将进入熄屏状态时长延长为整型(int)最大值,从而,源端设备301将不会进入熄屏状态,即自动熄屏功能关闭。
步骤202,在达到目标时长的情况下,控制屏幕熄灭,其中,屏幕熄灭后源端设备未进入熄屏状态,目标时长小于第二时长。
不同于相关技术中,源端设备在延长自动熄屏时长后,屏幕始终处于亮屏状态。本实施例中,为了降低源端设备的功耗,在延长熄屏时长的前提下,源端设备在达到目标时长的情况下,能够控制屏幕熄灭,而未进入熄屏状态,以此降低功耗。
可选的,目标时长小于第二时长,可以是第一时长,也可以是其他小于第二时长的时长。在目标时长为第一时长的情况下,控制屏幕熄灭的时长与源端设备自动进入熄屏状态的时长相同,从而给用户提供一种类似进入熄屏状态的控制屏幕熄灭的过程,就用户体验而言,源端设备屏幕熄灭的过程与进入熄屏状态时屏幕熄灭的过程一致。
在一种可能的实施方式中,源端设备设置倒计时时长为目标时长的倒计时器,并在倒计时器到时后,控制屏幕熄灭。
上述过程中,由于对源端设备的熄屏时长进行延长,因此在没有达到第二时长的情况下,源端设备将不会自动进入熄屏状态。而通过在达到目标时长的情况下,源端设备能够控制屏幕熄灭,不仅避免了源端设备功耗过大,而且就用户体验而言,源端设备屏幕熄灭的过程与进入熄屏状态时屏幕熄灭的过程相似。
可选的,控制屏幕熄灭的方式可以是将屏幕亮度调为零,也可以是对屏幕单独停止供电等,本申请实施例对此并不进行限定。
在一种可能的实施方式中,源端设备控制屏幕熄灭,且未进入熄屏状态,屏幕处于未锁定状态,同时源端设备保持录屏投屏状态。
示意性的,如图3所示,在2分钟内未接收到操作的情况下,源端设备301熄灭屏幕,且未进入熄屏状态,保持投屏状态。
步骤203,在屏幕熄灭且未达到第二时长的情况下,保持与目的端设备之间的投屏数据流传输。
在屏幕熄灭且未达到第二时长的情况下,由于源端设备并未进入熄屏状态,因此源端设备能够保持与目的端设备之间的投屏数据流传输,其中,该投屏数据流包括源端设备向目的端设备发送的音视频数据流和目的端设备向源端设备发送的反向控制指令。
示意性的,如图3所示,在未达到延长后的熄屏时长的情况下,源端设备301继续保持与目的端设备302之间的投屏数据流传输,目的端设备302继续对录屏画面进行显示。
综上所述,本申请实施例中,投屏状态下,源端设备将自动进入熄屏状态的熄屏时长由第一时长延长为第二时长,并在达到目标时长的情况下,控制屏幕熄灭,该目标时长小于第二时长,由于在未达到第二时长的情况下,源端设备仅将屏幕熄灭而未进入熄屏状态,因此源端设备能够保持与目的端设备之间的投屏数据流传输。采用本申请实施例提供的方案,源端设备能够在投屏状态下,自动延长熄屏时长,在屏幕熄灭但未进入熄屏状态的情况下,保持与目的端设备之间的投屏数据流传输,既保证了源端设备与目的端设备之间的正常投屏,又能够避免源端设备因长时间亮屏造成的功耗增加,有助于降低投屏过程中源端设备的功耗。
可选的,方法还包括:
在达到第三时长的情况下,将屏幕亮度由第一亮度调整为第二亮度,第三时长小于目标时长,第二亮度小于第一亮度。
可选的,将屏幕亮度由第一亮度调整为第二亮度,包括:
在亮度调节模式为第一调节模式的情况下,将亮度调节模式设置为第二调节模式,其中,第一调节模式下,基于环境光亮度自动调整屏幕亮度的功能开启,第二调节模式下,基于环境光亮度自动调整屏幕亮度的功能关闭;
在第二调节模式下,自动将屏幕亮度由第一亮度调整为第二亮度。
可选的,方法还包括:
在监听到亮屏事件的情况下,点亮屏幕,其中,点亮后屏幕显示的画面为非锁屏画面,亮屏事件为触发屏幕亮屏的事件;
将屏幕亮度设置为第一亮度,并将亮度调节模式设置为第一调节模式。
可选的,在达到第三时长的情况下,将屏幕亮度由第一亮度调整为第二亮度,包括:
在达到第三时长,且未监听到目标事件的情况下,将屏幕亮度由第一亮度调整为第二亮度,目标事件具有保持源端设备的屏幕处于亮屏状态的功能;
方法还包括:
在未达到目标时长,且监听到目标事件的情况下,将屏幕亮度调整为第一亮度。
可选的,在达到目标时长的情况下,控制屏幕熄灭,包括:
在达到目标时长,且未监听到目标事件的情况下,控制屏幕熄灭,目标事件具有保持源端设备的屏幕处于亮屏状态的功能;
方法还包括:
在目标时长内监听到目标事件的情况下,保持屏幕处于亮屏状态,并重置倒计时器,倒计时器的倒计时时长为目标时长。
可选的,方法还包括:
在目标时长内监听到锁屏事件的情况下,进入熄屏状态,其中,熄屏状态下源端设备与目的端设备之间的投屏数据流传输中断。
可选的,在目标时长内监听到锁屏事件的情况下,进入熄屏状态,包括:
在目标时长内监听到锁屏事件的情况下,向目的端设备发送锁屏消息,以便目的端设备基于锁屏消息显示锁屏提示画面;
进入熄屏状态。
可选的,方法还包括:
熄屏状态下,在监听到亮屏事件的情况下,点亮屏幕并显示锁屏界面,亮屏事件为触发屏幕亮屏的事件;
在解锁成功的情况下,恢复与目的端设备之间的投屏数据流传输。
可选的,方法还包括:
在屏幕熄灭且未达到第二时长的情况下,接收目的端设备发送的反向控制指令,反向控制指令用于对源端设备进行反向控制;
执行反向控制指令所指示的反向控制操作。
可选的,方法还包括:
在退出投屏状态的情况下,将熄屏时长设置为第一时长。
通常情况下,源端设备由亮屏状态自动进入熄屏状态的过程中,包含屏幕由亮变暗再到熄灭的过程。本申请实施例中,为了提升用户体验,源端设备控制屏幕熄灭的过程可以和源端设备自动进入熄屏状态所表现的屏幕熄灭过程保持一致,下面通过具体的实施例对源端设备控制屏幕熄灭的过程以及在屏幕熄灭情况下的工作状态进行详细说明。
请参考图4,其示出了本申请另一个示例性实施例提供的投屏方法的流程图。本实施例以该方法用于图1所示的源端设备为例进行说明,该方法可以包括如下步骤:
步骤401,投屏状态下,将熄屏时长由第一时长设置为第二时长,熄屏时长是源端设备自动进入熄屏状态的时长,第二时长大于第一时长。
本步骤的实施方式可以参考上述步骤201,本实施例在此不作赘述。
步骤402,在达到第三时长的情况下,将屏幕亮度由第一亮度调整为第二亮度,第三时长小于目标时长,第二亮度小于第一亮度。
按照通常情况下源端设备自动进入熄屏状态过程中所表现的屏幕熄灭过程,源端设备设置第三时长,在达到第三时长的情况下,源端设备将屏幕亮度由第一亮度调整为第二亮度,从而模拟出源端设备自动进入熄屏状态过程中屏幕变暗的过程。
可选的,第三时长与目标时长之间的差值为固定值。比如,该固定值为5秒,当目标时长为1分钟时,第三时长为55秒;当目标时长为30秒时,第三时长为25秒。在一种可能的实施方式中,源端设备基于目标时长和固定值确定第三时长,从而设置倒计时时长为第三时 长的倒计时器,并启动倒计时器,从而在倒计时器到时后,将屏幕亮度由第一亮度调整为第二亮度。
为了保证不同环境下的屏幕显示效果,用户一般会将屏幕的亮度调节模式设置为第一调节模式(或称为自动调节模式)。第一调节模式下,基于环境光亮度自动调整屏幕亮度的功能开启,源端设备根据其所处环境的环境光亮度(可以通过环境光传感器采集得到)对屏幕亮度进行自动调节,在用户手动调节屏幕亮度的情况下,源端设备依然会根据其所处环境的环境光亮度对屏幕亮度进行调节。而本申请实施例中,由于需要将屏幕亮度由第一亮度调整为第二亮度,因此为了保证屏幕亮度调整过程的正常执行(不会因第一调节模式导致调整后的第二亮度发生变化),在一种可能的实施方式中,亮度调整过程可以包括如下步骤:
1、在亮度调节模式为第一调节模式的情况下,将亮度调节模式设置为第二调节模式。
在一种可能的实施方式中,源端设备确定当前的亮度调节模式。若当前的亮度调节模式为第一调节模式,则将亮度调节模式修改为第二调节模式(或称为手动调节模式),其中,第二调节模式下,基于环境光亮度自动调整屏幕亮度的功能关闭,源端设备并不会根据环境光亮度自动调整屏幕亮度,在用户手动调节屏幕亮度的情况下,源端设备不会根据其所处环境的环境光亮度对屏幕亮度进行调节。若当前的亮度调节模式为第二调节模式,则保持第二调节模式。
需要说明的是,亮度调节模式的设置过程由源端设备在后台自动执行,用户侧并不会感知。
2、在第二调节模式下,自动将屏幕亮度由第一亮度调整为第二亮度。
进一步的,在第二调节模式下,源端设备自动将屏幕亮度由第一亮度调整为第二亮度。由于第二调节模式下,屏幕亮度不会随着环境光亮度改变而改变,因此屏幕亮度被设置为第二亮度后将不会发生变化。
需要说明的是,在源端设备的初始亮度调节模式为第二调节模式的情况下,源端设备直接将第一亮度调整为第二亮度。
在一些实施例中,第二亮度为固定值,且该第二亮度为正常进入熄屏状态前屏幕亮度降低后的亮度。比如,第二亮度为50nit。
在一个示意性的例子中,当目标时长为1分钟时,在达到55秒时,源端设备将亮度调节模式设置为第二调节模式,并将屏幕亮度由1000nit调整为50nit。
正常自动熄屏流程中,在进入熄屏状态前,若用户对设备进行操作或者设备接收到特定通知时,设备需要保持亮屏。为了模拟出这一效果,在一种可能的实施方式中,投屏状态下,源端设备进行目标事件监听,在达到第三时长,且未监听到目标事件的情况下,源端设备将屏幕亮度由第一亮度调整为第二亮度,其中,目标事件具有保持源端设备的屏幕处于亮屏状态的功能。
可选的,该目标事件可以是来电通知、消息提醒、触屏操作、语音控制指令等,本申请实施例对此并不进行限定。
可选的,若在未达到第三时长的情况下监听到目标事件,源端设备对目标事件进行响应,并保持第一亮度。
在一种可能的实施方式中,源端设备设置倒计时时长为第三时长的倒计时器,并启动该倒计时器。若在倒计时过程中未监听到目标事件,则倒计时器到时后,将屏幕亮度调整为第二亮度;若在倒计时过程中监听到目标事件,则在监听到目标事件时重置倒计时器,并保持屏幕亮度为第一亮度。
示意性的,如图5所示,源端设备501设置目标时长为1分钟,第三时长为55秒,在达到第三时长,且未监听到触控操作以及来电通知的情况下,源端设备501将屏幕亮度由第一亮度1000nit调整为第二亮度50nit。
在一种可能的实施方式中,在达到第三时长且未达到目标时长,且监听到目标事件的情况下,源端设备将屏幕亮度调整为第一亮度。
在达到第三时长,而未达到目标时长的情况下,源端设备监听到目标事件,为了便于用户进行后续操作处理,源端设备将屏幕亮度恢复为第一亮度。
示意性的,如图5所示,源端设备501监听到触屏操作的情况下,将屏幕亮度从50nit调整为1000nit,从而方便用户进行后续操作处理。
步骤403,在达到目标时长,且未监听到目标事件的情况下,控制屏幕熄灭,目标事件具有保持源端设备的屏幕处于亮屏状态的功能。
在一种可能的实施方式中,投屏状态下,源端设备设置倒计时时长为目标时长的倒计时器,并启动该倒计时器。若在倒计时过程中未监听到目标事件,则倒计时器到时后,控制屏幕熄灭。
其中,目标事件具有保持源端设备的屏幕处于亮屏状态的功能,该目标事件可以由用户对源端设备的操作触发,比如用户对源端设备的触屏操作所触发的触控事件,也可以由源端设备接收到的通知触发,比如源端设备接收到的来电通知。
示意性的,如图5所示,源端设备501若在目标时长内未监听到触屏操作以及来电通知,则在达到目标时长时控制屏幕熄灭。
步骤404,在目标时长内监听到目标事件的情况下,保持屏幕处于亮屏状态,并重置倒计时器,倒计时器的倒计时时长为目标时长。
在一种可能的实施方式中,在倒计时过程中(倒计时器的倒计时时长为目标时长)监听到目标事件的情况下,为了方便用户进行后续操作处理,源端设备保持屏幕处于亮屏状态,并在监听到目标事件时重置倒计时器。
在一种可能的实施方式中,若在第三时长内未监听到目标事件,源端设备对当前的亮度调节模式以及第一亮度进行保存。若在达到第三时长但未达到目标时长的情况下监听到目标事件,源端设备则恢复保存的亮度调节模式,并将屏幕亮度恢复为第一亮度。
步骤405,在屏幕熄灭且未达到第二时长的情况下,保持与目的端设备之间的投屏数据流传输。
本步骤的实施方式可以参考上述步骤203,本实施例在此不作赘述。
步骤406,在屏幕熄灭且未达到第二时长的情况下,接收目的端设备发送的反向控制指令,反向控制指令用于对源端设备进行反向控制。
在屏幕熄灭且未达到第二时长的情况下,当用户通过目的端设备在投屏画面上进行操作时,目的端设备将用户操作以反向控制指令的形式发送至源端设备,进一步的,源端设备接收该反向控制指令,从而执行相应的反向控制操作。
在一种可能的实施方式中,目的端设备接收用户在投屏画面上的操作指令,可选的,目的端设备接收用户对屏幕的触控操作,或者通过外设(比如鼠标、键盘等)接收操作指令。在接收到操作指令之后,目的端设备对该操作指令进行识别,转化为对源端设备的反向控制指令,并向源端设备发送该反向控制指令。
其中,反向控制指令中包含操作类型以及对应的操作参数。比如,当目的端设备接收到来自鼠标的点击操作时,反向控制指令包括操作类型“点击”、该点击操作对应点击坐标以及该点击操作的点击次数;当目的端设备接收到滑动操作时,反向控制指令包括操作类型“滑动”以及滑动操作的滑动轨迹坐标;当目的端设备接收到长按操作时,反向操作指令包括操作类型“长按”、该长按操作对应在的长按坐标以及长按时长等。本申请实施例并不对反向控制指令中包含的具体参数进行限定。
步骤407,执行反向控制指令所指示的反向控制操作。
进一步的,源端设备根据反向控制指令,执行其所指示的反向控制操作。相应的,用户通过目的端设备可以看到反向控制操作后更新的投屏画面。
需要说明的是,由于源端设备与目的端设备的屏幕尺寸可能存在差异,因此源端设备在执行反向控制操作前,需要对反向控制指令中的参数进行坐标转换,本实施例在此不作赘述。
并且,本实施例中,通过目的端设备对源端设备进行反向控制的过程中,源端设备的屏 幕保持熄灭。
步骤408,在监听到亮屏事件的情况下,点亮屏幕,其中,点亮后屏幕显示的画面为非锁屏画面,亮屏事件为触发屏幕亮屏的事件。
为了模拟出正常熄屏状态下源端设备点亮屏幕的过程,源端设备在屏幕熄灭的情况下,对亮屏事件进行监听,并在监听到亮屏事件的情况下,点亮屏幕。其中,该亮屏事件为触发屏幕亮屏的事件。
可选的,亮屏事件可以是通过按压物理按键触发的事件,也可以是触控操作所触发的事件,也可以是语音控制指令触发的时间,也可以是特定通知触发的事件(比如来电通知)等,本申请实施例对此并不进行限定。
需要说明的是,屏幕熄灭后,源端设备需要对亮屏事件进行注册,只有在监听到已经注册的亮屏事件的情况下,源端设备才会点亮屏幕。
可选的,注册的亮屏事件可以与唤醒源端设备退出熄屏状态的事件相同,也可以不同,本申请实施例对此并不进行限定。比如,当源端设备支持通过电源键、点击屏幕、消息通知来退出熄屏状态时,注册的亮屏事件可以包括电源键按压事件、屏幕点击事件以及通知事件,也可以仅包括电源键按压事件以及来电通知事件(即指定类型的通知事件)。
在唤醒源端设备退出熄屏状态的情况下,由于仍旧处于锁屏状态,因此源端设备点亮屏幕后会显示锁屏界面,等待解锁操作。而本申请实施例中,投屏状态下,由于源端设备仅控制屏幕熄灭,而未进入熄屏状态(并未进入锁屏状态),因此在监听到亮屏事件的情况下,源端设备将屏幕点亮,并且点亮后屏幕直接显示当前投屏画面,而非锁屏界面。
在一个示意性的例子中,源端设备将对电源键的按压操作注册为亮屏事件,响应于对电源键的按压操作,源端设备点亮屏幕,直接显示当前投屏画面,而不需要进行解锁操作。
在一个示意性的例子中,为了保证隐私安全,源端设备将来电通知注册为亮屏事件时,在监听到来电通知的情况下,源端设备点亮屏幕,显示来电通话界面。在接听来电的过程中,源端设备首先对录屏画面进行隐私处理,进而对录屏画面进行编码,生成数据流,传输给目的端设备,其中,隐私处理的方法包括但不限于对来电显示的号码进行马赛克处理。
步骤409,将屏幕亮度设置为第一亮度,并将亮度调节模式设置为第一调节模式。
由于在控制屏幕熄灭的过程中,在屏幕亮度调节模式为第一调节模式的情况下,源端设备对亮度调节模式以及屏幕亮度进行了调整,因此为了保证点亮屏幕后与屏幕熄灭前屏幕亮度以及亮度调节模式的一致性,源端设备将屏幕亮度设置为第一亮度,并将亮度调节模式重新设置为第一调节模式。
进一步的,源端设备亮屏后,继续执行上述步骤402。
步骤410,在退出投屏状态的情况下,将熄屏时长设置为第一时长。
由于设置第二时长是为了在投屏状态下,避免源端设备快速进入熄屏状态,因此在退出投屏状态的情况下,为了降低功耗,源端设备将熄屏时长由第二时长调整为第一时长,即恢复为正常使用状态下,源端设备自动进入熄屏状态的时长。需要说明的是,若在屏幕熄灭过程中退出投屏状态,源端设备需要恢复亮度调节模式以及屏幕亮度。
可选的,退出投屏状态可以由目的端设备触发,比如,当接收到目的端设备发送的退出投屏指令时,源端设备退出投屏状态;或者,退出投屏状态也可以由源端设备触发,比如,当接收到投屏退出操作时,源端设备退出投屏状态;或者,退出投屏状态可以在投屏链路断开时自动触发,比如,因网络原因导致投屏链路断开时,源端设备退出投屏状态。
上述实施例中,在投屏状态下,通过设置第三时长以及对目标事件进行监听,源端设备能够将控制屏幕熄灭的过程与进入熄屏状态时屏幕熄灭的过程表现一致,提升了用户的使用体验,并且在监听到亮屏事件的情况下,源端设备能够直接显示该亮屏事件所在界面,省略了解锁屏幕的步骤,方便用户及时进行后续处理。
需要说明的是,上述实施例仅为一种可能的控制逻辑,在其他可能的实施方式中,在控制屏幕熄灭之后,源端设备对亮屏事件的监听和接收目的端设备发送的反向控制指令可以同 时进行,本申请实施例并不对具体的控制逻辑构成限定。
根据上述实施例,如图6所示,其示出了本申请另一个示例性实施例提供的投屏状态下屏幕熄灭之后的工作流程图。在投屏状态下源端设备601控制屏幕熄灭之后,保持与目的端设备602之间的投屏数据流传输。在源端设备601将来电通知和对电源键的触发操作注册为亮屏事件的情况下,源端设备601依次对事件进行判断,首先判断是否接收到反向控制指令,在接收到反向控制指令的情况下,源端设备601执行反向控制指令所指示的反向控制操作,并保持屏幕熄灭;在没有接收到反向控制指令的情况下,继续判断是否监听到来电通知,在监听到来电通知的情况下,源端设备601点亮屏幕,显示来电通知;在没有监听到来电通知的情况下,继续判断是否监听到音量键触发操作,在监听到音量键触发操作的情况下,源端设备601根据音量键触发操作对音量进行调节,并保持屏幕熄灭;在没有监听到音量键触发操作的情况下,继续判断是否监听到电源键的触发操作,在监听到电源键的触发操作的情况下,源端设备601点亮屏幕,直接显示投屏画面,在没有监听到电源键的触发操作的情况下,源端设备601保持屏幕熄灭。
需要说明的是,上述实施例仅用于示意性说明,在其他可能的实施方式中,源端设备判断事件的过程中,可以同时对接收反向控制指令、监听来电操作、监听音量键触发操作以及监听电源键的触发操作进行判断,也可以按照不同于图6所示的判断顺序进行判断,本申请实施例对此并不构成限定。
不同于相关技术中,在投屏过程中,响应于源端设备的锁屏事件,目的端设备断开与源端设备的连接,退出投屏状态,再次投屏需要重新进行投屏连接。本申请实施例中,在源端设备响应于锁屏事件,进入熄屏状态的情况下,目的端设备保持与源端设备的连接状态,显示锁屏提示画面,用以提示用户源端设备处于锁屏熄屏状态。在源端设备解锁屏幕之后,目的端设备接口恢复显示投屏画面。
在目标时长内监听到锁屏事件的情况下,源端设备进入熄屏状态,其中,熄屏状态下源端设备与目的端设备之间的投屏数据流传输中断。
在一种可能的实施方式中,在目标时长内监听到锁屏事件的情况下,源端设备进入锁屏熄屏状态,停止对画面的录屏操作,中断与目的端设备之间的投屏数据流传输,并对后台运行的应用进行监听。
可选的,锁屏事件可以是由物理按键触发的事件(比如按压电源键),也可以是语音控制指令触发的事件等,本申请实施例对此并不进行限定。
如图7所示,该过程具体包括以下步骤:
步骤701,在目标时长内监听到锁屏事件的情况下,向目的端设备发送锁屏消息,以便目的端设备基于锁屏消息显示锁屏提示画面。
在一种可能的实施方式中,在目标时长内监听到锁屏事件的情况下,源端设备向目的端设备发送锁屏消息,提示目的端设备投屏数据流中断,即将进入锁屏熄屏状态。
其中,该锁屏消息可以是源端设备向目的端设备传输的投屏数据流中的一条指令,指示目的端设备显示预先设置的锁屏提示画面;也可以是投屏数据流中包含的锁屏提示图像,目的端设备基于该图像显示锁屏提示画面。在目的端设备对投屏数据流进行解码,生成投屏画面的过程中,当目的端设备监听到该指令或该锁屏提示图像时,即为接收到源端设备即将进入锁屏熄屏状态的锁屏消息。
步骤702,进入熄屏状态。
在一种可能的实施方式中,源端设备进入熄屏状态,并中断与目的端设备之间的投屏数据流传输,同时,目的端设备显示锁屏提示画面。
示意性的,如图8所示,源端设备801进入熄屏状态,中断与目的端设备802之间的投屏数据流传输,同时,目的端设备802显示锁屏提示画面。
步骤703,熄屏状态下,在监听到亮屏事件的情况下,点亮屏幕并显示锁屏界面,亮屏事件为触发屏幕亮屏的事件。
在一种可能的实施方式中,源端设备监听到亮屏事件后,点亮屏幕并显示锁屏待解锁界面,此时屏幕亮度设置为第一亮度,并且源端设备继续保持与目的端设备之间投屏数据流的中断。
在达到第四时长,且没有监听到解锁操作的情况下,源端设备将屏幕熄灭,继续保持熄屏状态,其中,该第四时长为等待用户进行解锁操作的亮屏时长。
示意性的,源端设备将来电通知注册为亮屏事件,在监听到来电通知的情况下,源端设备点亮屏幕,显示来电画面,在监听到解锁操作的情况下,来电结束后,源端设备保持亮屏;在来电结束之后且未监听到解锁操作的情况下,源端设备仍然保持熄屏状态。
步骤704,在解锁成功的情况下,恢复与目的端设备之间的投屏数据流传输。
在一种可能的实施方式中,在解锁成功的情况下,源端设备继续对屏幕画面进行录制,并采集设备音频,从而对录制画面和音频进行编码,生成音视频数据流,并将生成的音视频数据流传输给目的端设备。目的端设备在接收到音视频数据流的情况下,结束显示锁屏提示画面,重新对投屏画面进行显示。同时,源端设备接收来自目的端设备的反向控制指令,并执行该反向控制指令所指示的反向控制操作。
示意性的,如图8所示,在解锁成功的情况下,源端设备801继续对屏幕画面进行录制,并采集设备音频,并将生成的音视频数据流传输给目的端设备802,目的端设备802直接对投屏画面进行显示。
上述实施例中,在投屏过程中,源端设备进入锁屏熄屏状态后,能够保持与目的端设备的连接,并通过目的端设备对源端设备处于锁屏熄屏状态进行提示,有助于用户及时了解源端设备的状态。在解锁成功的情况下,源端设备能够直接恢复与目的端设备之间的投屏数据流传输,提高了投屏过程中操作的便捷度。
根据上述实施例,如图9所示,其示出了本申请另一个示例性实施例提供的投屏过程中锁屏熄屏状态下的工作流程图。在锁屏熄屏状态下,源端设备901中断与目的端设备902之间的投屏数据流传输,目的端设备902显示锁屏提示画面。在源端设备901将来电通知和对电源键的触发操作注册为亮屏事件的情况下,源端设备901依次对事件进行判断,在监听到来电通知的情况下,源端设备901点亮屏幕,在来电结束之后,若存在解锁成功操作,则源端设备901退出锁屏熄屏状态;若不存在解锁成功操作,则源端设备901恢复锁屏熄屏状态;在没有监听到来电通知的情况下,继续判断是否监听到电源键的触发操作,在监听到电源键的触发操作的情况下,源端设备901点亮屏幕,若存在解锁成功操作,源端设备901退出锁屏熄屏状态,恢复与目的端设备902之间的投屏数据流传输。在没有监听到电源键的触发操作的情况下,源端设备901保持锁屏熄屏状态。
需要说明的是,上述投屏过程中锁屏熄屏状态下,源端设备可以同时对监听来电通知和监听电源键的触发操作进行判断,本申请实施例对此并不对具体的执行顺序构成限定。
结合上述实施例,如图10所示,其示出了本申请另一个示例性实施例提供的进入投屏状态的总工作流程图。
步骤1001,投屏状态下,保持屏幕亮屏。
投屏状态下,源端设备保持亮屏,与目的端设备之间进行投屏数据流传输。
步骤1002,判断是否存在锁屏事件。
源端设备对锁屏事件进行监听,判断是否存在锁屏事件,若存在锁屏事件,则进入步骤1003;若不存在锁屏事件,则进入步骤1004。
步骤1003,进入锁屏熄屏状态。
在监听到锁屏事件的情况下,源端设备向目的端设备发送锁屏消息,目的端设备显示锁 屏提示画面,并且源端设备中断与目的端设备之间的投屏数据流传输。
步骤1004,判断是否存在来电通知或触屏操作。
源端设备对来电通知和触屏操作进行监听,判断是否存在来电通知或触屏操作,若存在来电通知或触屏操作,则返回步骤1001,保持屏幕亮屏状态;若不存在来电通知或触屏操作,则进入步骤1005。
步骤1005,调整屏幕亮度。
在达到第三时长的情况下,源端设备将屏幕亮度由第一亮度调整为第二亮度,在亮度调节模式为第一调节模式的情况下,将亮度调节模式调整为第二调节模式。
步骤1006,继续判断是否存在来电通知或触屏操作。
源端设备继续对来电通知和触屏操作进行监听,判断是否存在来电通知或触屏操作,若存在来电通知或触屏操作,则返回步骤1001,保持屏幕亮屏状态;若不存在来电通知或触屏操作,则进入步骤1007。
步骤1007,控制屏幕熄灭,监听来电通知和对电源键的触发操作。
在达到目标时长的情况下,源端设备控制屏幕熄灭,并对来电通知和对电源键的触发操作进行监听,同时,源端设备保持与目的端设备之间的投屏数据流传输,目的端设备保持对投屏画面进行显示。
请参考图11,其示出了本申请一个示例性实施例提供的投屏系统的结构框图,该投屏系统包括源端设备1101和目的端设备1102。
源端设备1101,用于在投屏状态下,将熄屏时长由第一时长设置为第二时长,熄屏时长是源端设备1101自动进入熄屏状态的时长,第二时长大于第一时长;在达到目标时长的情况下,控制屏幕熄灭,其中,屏幕熄灭后源端设备未进入熄屏状态,目标时长小于第二时长;在屏幕熄灭且未达到第二时长的情况下,保持与目的端设备1102之间的投屏数据流传输。
目的端设备1102,用于在与源端设备1101之间的投屏数据流保持传输的情况下,接收源端设备1101传输的音视频数据流;基于音视频数据流播放投屏内容。
在一种可能的实施方式中,源端设备1101与目的端设备1102之间传输的投屏数据流还包括反向控制指令。
目的端设备1102,用于在源端设备1101的屏幕熄灭且未达到第二时长的情况下,接收对投屏内容的反向控制操作;基于反向控制操作向源端设备1101发送反向控制指令。
在目的端设备1102接收到对投屏内容的反向控制操作的情况下,将该反向控制操作转化为对应的反向控制指令,其中,反向控制指令中包含操作类型以及对应的操作参数,从而目的端设备1102将反向控制指令发送给源端设备1101。
源端设备1101,用于执行反向控制指令所指示的反向控制操作。
在一种可能的实施方式中,源端设备1101进入锁屏熄屏状态,源端设备1101与目的端设备1102之间的投屏数据流传输中断。
源端设备1101,用于在目标时长内监听到锁屏事件的情况下,进入熄屏状态,并向目的端设备1102发送锁屏消息,其中,熄屏状态下源端设备1101与目的端设备1102之间的投屏数据流传输中断;
目的端设备1102,用于在源端设备1101进入熄屏状态的情况下,基于锁屏消息显示锁屏提示画面。
在源端设备1101进入熄屏状态的情况下,为了提示用户源端设备1101处于锁屏熄屏状态,目的端设备1102基于接收到的锁屏消息显示锁屏提示画面。
源端设备1101,还用于在熄屏状态下,在监听到亮屏事件的情况下,点亮屏幕并显示锁屏界面,亮屏事件为触发屏幕亮屏的事件;在解锁成功的情况下,恢复与目的端设备1102之间的投屏数据流传输。
请参考图12,其示出了本申请一个示例性实施例提供的投屏装置的结构框图,该装置可以包括如下结构:
时长设置模块1201,用于投屏状态下,将熄屏时长由第一时长设置为第二时长,所述熄屏时长是所述源端设备自动进入熄屏状态的时长,所述第二时长大于所述第一时长;
屏幕控制模块1202,用于在达到目标时长的情况下,控制屏幕熄灭,其中,屏幕熄灭后所述源端设备未进入所述熄屏状态,所述目标时长小于所述第二时长;
数据传输模块1203,用于在屏幕熄灭且未达到所述第二时长的情况下,保持与目的端设备之间的投屏数据流传输。
可选的,
屏幕控制模块1202,还用于在达到第三时长的情况下,将屏幕亮度由第一亮度调整为第二亮度,所述第三时长小于所述目标时长,所述第二亮度小于所述第一亮度。
可选的,所述屏幕控制模块1202,用于:
在亮度调节模式为第一调节模式的情况下,将所述亮度调节模式设置为第二调节模式,其中,所述第一调节模式下,基于环境光亮度自动调整屏幕亮度的功能开启,所述第二调节模式下,基于环境光亮度自动调整屏幕亮度的功能关闭;
在所述第二调节模式下,自动将所述屏幕亮度由所述第一亮度调整为所述第二亮度。
可选的,
屏幕控制模块1202,还用于在监听到亮屏事件的情况下,点亮屏幕,其中,点亮后屏幕显示的画面为非锁屏画面,所述亮屏事件为触发屏幕亮屏的事件;
将所述屏幕亮度设置为所述第一亮度,并将所述亮度调节模式设置为所述第一调节模式。
可选的,所述屏幕控制模块1202,用于:
在达到所述第三时长,且未监听到目标事件的情况下,将所述屏幕亮度由第一亮度调整为所述第二亮度,所述目标事件具有保持所述源端设备的屏幕处于亮屏状态的功能;
在未达到所述目标时长,且监听到所述目标事件的情况下,将所述屏幕亮度调整为所述第一屏幕亮度。
可选的,所述屏幕控制模块1202,用于:
在达到所述目标时长,且未监听到目标事件的情况下,控制屏幕熄灭,所述目标事件具有保持所述源端设备的屏幕处于亮屏状态的功能;
在所述目标时长内监听到所述目标事件的情况下,保持屏幕处于亮屏状态,并重置倒计时器,所述倒计时器的倒计时时长为所述目标时长。
可选的,所述装置还包括:
锁屏熄屏模块,用于在所述目标时长内监听到锁屏事件的情况下,进入所述熄屏状态,其中,所述熄屏状态下所述源端设备与所述目的端设备之间的投屏数据流传输中断。
可选的,所述锁屏熄屏模块,用于:
在所述目标时长内监听到所述锁屏事件的情况下,向所述目的端设备发送锁屏消息,以便所述目的端设备基于所述锁屏消息显示锁屏提示画面;
进入所述熄屏状态。
可选的,还用于所述熄屏状态下,在监听到亮屏事件的情况下,点亮屏幕并显示锁屏界面,所述亮屏事件为触发屏幕亮屏的事件;
数据传输模块1203,还用于在解锁成功的情况下,恢复与所述目的端设备之间的投屏数据流传输。
可选的,
数据传输模块1203,还用于在屏幕熄灭且未达到所述第二时长的情况下,接收所述目的端设备发送的反向控制指令,所述反向控制指令用于对所述源端设备进行反向控制;
操作执行模块,用于执行所述反向控制指令所指示的反向控制操作。
可选的,
屏幕控制模块1202,还用于在退出所述投屏状态的情况下,将所述熄屏时长设置为所述第一时长。
综上所述,本申请实施例中,投屏状态下,源端设备将自动进入熄屏状态的熄屏时长由第一时长延长为第二时长,并在达到目标时长的情况下,控制屏幕熄灭,该目标时长小于第二时长,由于在未达到第二时长的情况下,源端设备仅将屏幕熄灭而未进入熄屏状态,因此源端设备能够保持与目的端设备之间的投屏数据流传输。采用本申请实施例提供的方案,源端设备能够在投屏状态下,自动延长熄屏时长,在屏幕熄灭但未进入熄屏状态的情况下,保持与目的端设备之间的投屏数据流传输,既保证了源端设备与目的端设备之间的正常投屏,又能够避免源端设备因长时间亮屏造成的功耗增加,有助于降低投屏过程中源端设备的功耗。
并且,在投屏状态下,通过设置第三时长以及对目标事件进行监听,源端设备能够将控制屏幕熄灭的过程与进入熄屏状态时屏幕熄灭的过程表现一致,提升了用户的使用体验,并且在监听到亮屏事件的情况下,源端设备能够直接显示该亮屏事件所在界面,省略了解锁屏幕的步骤,方便用户及时进行后续处理。
需要说明的是:上述实施例提供的装置,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。另外,上述实施例提供的装置与方法实施例属于同一构思,其实现过程详见方法实施例,这里不再赘述。
请参考图13,其示出了本申请一个示例性实施例提供的计算机设备的结构方框图。计算机设备1300可以包括一个或多个如下部件:处理器1310、存储器1320和显示屏1330。
处理器1310可以包括一个或者多个处理核心。处理器1310利用各种接口和线路连接整个计算机设备1300内的各个部分,通过运行或执行存储在存储器1320内的指令、程序、代码集或指令集,以及调用存储在存储器1320内的数据,执行计算机设备1300的各种功能和处理数据。可选地,处理器1310可以采用数字信号处理(Digital Signal Processing,DSP)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)、可编程逻辑阵列(Programmable Logic Array,PLA)中的至少一种硬件形式来实现。处理器1310可集成中央处理器(Central Processing Unit,CPU)、图像处理器(Graphics Processing Unit,GPU)、神经网络处理器(Neural-network Processing Unit,NPU)和调制解调器等中的一种或几种的组合。其中,CPU主要处理操作系统、用户界面和应用程序等;GPU用于负责触摸显示屏所需要显示的内容的渲染和绘制;NPU用于实现人工智能(Artificial Intelligence,AI)功能;调制解调器用于处理无线通信。可以理解的是,上述调制解调器也可以不集成到处理器1310中,单独通过一块芯片进行实现。
存储器1320可以包括随机存储器(Random Access Memory,RAM),也可以包括只读存储器(Read-Only Memory,ROM)。可选地,该存储器1320包括非瞬时性计算机可读介质(non-transitory computer-readable storage medium)。存储器1320可用于存储指令、程序、代码、代码集或指令集。存储器1320可包括存储程序区和存储数据区,其中,存储程序区可存储用于实现操作系统的指令、用于至少一个功能的指令(比如触控功能、声音播放功能、图像播放功能等)、用于实现下述各个方法实施例的指令等;存储数据区可存储根据计算机设备1300的使用所创建的数据(比如音频数据、电话本)等。
显示屏1330是用于进行画面显示的组件。可选的,该显示屏1330还具有触控功能,用户可以通过在显示屏1330上进行触控操作,实现对显示内容的控制。比如,该显示屏1330为智能手机的触摸式显示屏,或者,显示屏1330为电视终端的非触摸式显示屏。
除此之外,本领域技术人员可以理解,上述附图所示出的计算机设备1300的结构并不构成对计算机设备的限定,计算机设备可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。比如,计算机设备1300中还包括摄像头、麦克风、扬声器、射频电路、 输入单元、传感器(比如加速度传感器、角速度传感器、光线传感器等等)、音频电路、WiFi模块、电源、蓝牙模块等部件,在此不再赘述。
本申请实施例还提供了一种计算机可读存储介质,该计算机可读存储介质存储有至少一条程序代码,所述程序代码由处理器加载并执行以实现如上各个实施例所述的投屏方法。
本申请实施例提供了一种计算机程序产品,该计算机程序产品包括计算机指令,该计算机指令存储在计算机可读存储介质中。计算机设备的处理器从计算机可读存储介质读取该计算机指令,处理器执行该计算机指令,使得该计算机设备执行上述方面的各种可选实现方式中提供的投屏方法。
应当理解的是,在本文中提及的“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。字符“/”一般表示前后关联对象是一种“或”的关系。另外,本文中描述的步骤编号,仅示例性示出了步骤间的一种可能的执行先后顺序,在一些其它实施例中,上述步骤也可以不按照编号顺序来执行,如两个不同编号的步骤同时执行,或者两个不同编号的步骤按照与图示相反的顺序执行,本申请实施例对此不作限定。
以上所述仅为本申请的可选实施例,并不用以限制本申请,凡在本申请的精神和原则之内,所作的任何修改、等同替换、改进等,均应包含在本申请的保护范围之内。

Claims (30)

  1. 一种投屏方法,所述方法由源端设备执行,所述方法包括:
    投屏状态下,将熄屏时长由第一时长设置为第二时长,所述熄屏时长是所述源端设备自动进入熄屏状态的时长,所述第二时长大于所述第一时长;
    在达到目标时长的情况下,控制屏幕熄灭,其中,屏幕熄灭后所述源端设备未进入所述熄屏状态,所述目标时长小于所述第二时长;
    在屏幕熄灭且未达到所述第二时长的情况下,保持与目的端设备之间的投屏数据流传输。
  2. 根据权利要求1所述的方法,其中,所述方法还包括:
    在达到第三时长的情况下,将屏幕亮度由第一亮度调整为第二亮度,所述第三时长小于所述目标时长,所述第二亮度小于所述第一亮度。
  3. 根据权利要求2所述的方法,其中,所述将屏幕亮度由第一亮度调整为第二亮度,包括:
    在亮度调节模式为第一调节模式的情况下,将所述亮度调节模式设置为第二调节模式,其中,所述第一调节模式下,基于环境光亮度自动调整屏幕亮度的功能开启,所述第二调节模式下,基于环境光亮度自动调整屏幕亮度的功能关闭;
    在所述第二调节模式下,自动将所述屏幕亮度由所述第一亮度调整为所述第二亮度。
  4. 根据权利要求3所述的方法,其中,所述方法还包括:
    在监听到亮屏事件的情况下,点亮屏幕,其中,点亮后屏幕显示的画面为非锁屏画面,所述亮屏事件为触发屏幕亮屏的事件;
    将所述屏幕亮度设置为所述第一亮度,并将所述亮度调节模式设置为所述第一调节模式。
  5. 根据权利要求2所述的方法,其中,所述在达到第三时长的情况下,将屏幕亮度由第一亮度调整为第二亮度,包括:
    在达到所述第三时长,且未监听到目标事件的情况下,将所述屏幕亮度由第一亮度调整为所述第二亮度,所述目标事件具有保持所述源端设备的屏幕处于亮屏状态的功能;
    所述方法还包括:
    在未达到所述目标时长,且监听到所述目标事件的情况下,将所述屏幕亮度调整为所述第一亮度。
  6. 根据权利要求1至5任一所述的方法,其中,所述在达到所述目标时长的情况下,控制屏幕熄灭,包括:
    在达到所述目标时长,且未监听到目标事件的情况下,控制屏幕熄灭,所述目标事件具有保持所述源端设备的屏幕处于亮屏状态的功能;
    所述方法还包括:
    在所述目标时长内监听到所述目标事件的情况下,保持屏幕处于亮屏状态,并重置倒计时器,所述倒计时器的倒计时时长为所述目标时长。
  7. 根据权利要求1至5任一所述的方法,其中,所述方法还包括:
    在所述目标时长内监听到锁屏事件的情况下,进入所述熄屏状态,其中,所述熄屏状态下所述源端设备与所述目的端设备之间的投屏数据流传输中断。
  8. 根据权利要求7所述的方法,其中,所述在所述目标时长内监听到锁屏事件的情况下, 进入所述熄屏状态,包括:
    在所述目标时长内监听到所述锁屏事件的情况下,向所述目的端设备发送锁屏消息,以便所述目的端设备基于所述锁屏消息显示锁屏提示画面;
    进入所述熄屏状态。
  9. 根据权利要求7所述的方法,其中,所述方法还包括:
    所述熄屏状态下,在监听到亮屏事件的情况下,点亮屏幕并显示锁屏界面,所述亮屏事件为触发屏幕亮屏的事件;
    在解锁成功的情况下,恢复与所述目的端设备之间的投屏数据流传输。
  10. 根据权利要求1至5任一所述的方法,其中,所述方法还包括:
    在屏幕熄灭且未达到所述第二时长的情况下,接收所述目的端设备发送的反向控制指令,所述反向控制指令用于对所述源端设备进行反向控制;
    执行所述反向控制指令所指示的反向控制操作。
  11. 根据权利要求1至5任一所述的方法,其中,所述方法还包括:
    在退出所述投屏状态的情况下,将所述熄屏时长设置为所述第一时长。
  12. 一种投屏装置,所述装置包括:
    时长设置模块,用于投屏状态下,将熄屏时长由第一时长设置为第二时长,所述熄屏时长是所述源端设备自动进入熄屏状态的时长,所述第二时长大于所述第一时长;
    屏幕控制模块,用于在达到目标时长的情况下,控制屏幕熄灭,其中,屏幕熄灭后所述源端设备未进入所述熄屏状态,所述目标时长小于所述第二时长;
    数据传输模块,用于在屏幕熄灭且未达到所述第二时长的情况下,保持与目的端设备之间的投屏数据流传输。
  13. 根据权利要求12所述的装置,其中,
    所述屏幕控制模块,还用于在达到第三时长的情况下,将屏幕亮度由第一亮度调整为第二亮度,所述第三时长小于所述目标时长,所述第二亮度小于所述第一亮度。
  14. 根据权利要求13所述的装置,其中,所述屏幕控制模块,用于:
    在亮度调节模式为第一调节模式的情况下,将所述亮度调节模式设置为第二调节模式,其中,所述第一调节模式下,基于环境光亮度自动调整屏幕亮度的功能开启,所述第二调节模式下,基于环境光亮度自动调整屏幕亮度的功能关闭;
    在所述第二调节模式下,自动将所述屏幕亮度由所述第一亮度调整为所述第二亮度。
  15. 根据权利要求14所述的装置,其中,
    所述屏幕控制模块,还用于在监听到亮屏事件的情况下,点亮屏幕,其中,点亮后屏幕显示的画面为非锁屏画面,所述亮屏事件为触发屏幕亮屏的事件;
    将所述屏幕亮度设置为所述第一亮度,并将所述亮度调节模式设置为所述第一调节模式。
  16. 根据权利要求13所述的装置,其中,所述屏幕控制模块,用于:
    在达到所述第三时长,且未监听到目标事件的情况下,将所述屏幕亮度由第一亮度调整为所述第二亮度,所述目标事件具有保持所述源端设备的屏幕处于亮屏状态的功能;
    在未达到所述目标时长,且监听到所述目标事件的情况下,将所述屏幕亮度调整为所述第一亮度。
  17. 根据权利要求12至16任一所述的装置,其中,所述屏幕控制模块,用于:
    在达到所述目标时长,且未监听到目标事件的情况下,控制屏幕熄灭,所述目标事件具有保持所述源端设备的屏幕处于亮屏状态的功能;
    在所述目标时长内监听到所述目标事件的情况下,保持屏幕处于亮屏状态,并重置倒计时器,所述倒计时器的倒计时时长为所述目标时长。
  18. 根据权利要求12至16任一所述的装置,其中,所述装置还包括:
    锁屏熄屏模块,用于在所述目标时长内监听到锁屏事件的情况下,进入所述熄屏状态,其中,所述熄屏状态下所述源端设备与所述目的端设备之间的投屏数据流传输中断。
  19. 根据权利要求18所述的装置,其中,所述锁屏熄屏模块,用于:
    在所述目标时长内监听到所述锁屏事件的情况下,向所述目的端设备发送锁屏消息,以便所述目的端设备基于所述锁屏消息显示锁屏提示画面;
    进入所述熄屏状态。
  20. 根据权利要求18所述的装置,其中,
    所述锁屏熄屏模块,用于所述熄屏状态下,在监听到亮屏事件的情况下,点亮屏幕并显示锁屏界面,所述亮屏事件为触发屏幕亮屏的事件;
    所述数据传输模块,用于在解锁成功的情况下,恢复与所述目的端设备之间的投屏数据流传输。
  21. 根据权利要求12至16任一所述的装置,其中,所述装置还包括:
    所述数据传输模块,用于在屏幕熄灭且未达到所述第二时长的情况下,接收所述目的端设备发送的反向控制指令,所述反向控制指令用于对所述源端设备进行反向控制;
    操作执行模块,用于执行所述反向控制指令所指示的反向控制操作。
  22. 根据权利要求12至16任一所述的装置,其中,
    所述屏幕控制模块,用于在退出所述投屏状态的情况下,将所述熄屏时长设置为所述第一时长。
  23. 一种投屏系统,所述投屏系统包括源端设备和目的端设备;
    所述源端设备,用于在投屏状态下,将熄屏时长由第一时长设置为第二时长,所述熄屏时长是所述源端设备自动进入熄屏状态的时长,所述第二时长大于所述第一时长;在达到目标时长的情况下,控制屏幕熄灭,其中,屏幕熄灭后所述源端设备未进入所述熄屏状态,所述目标时长小于所述第二时长;在屏幕熄灭且未达到所述第二时长的情况下,保持与目的端设备之间的投屏数据流传输;
    所述目的端设备,用于在与所述源端设备之间的投屏数据流保持传输的情况下,接收所述源端设备传输的音视频数据流;基于所述音视频数据流播放投屏内容。
  24. 根据权利要求23所述的投屏系统,其中,所述源端设备与所述目的端设备之间传输的投屏数据流还包括反向控制指令;
    所述目的端设备,还用于在所述源端设备的屏幕熄灭且未达到所述第二时长的情况下,接收对所述投屏内容的反向控制操作;基于所述反向控制操作向所述源端设备发送反向控制指令;
    所述源端设备,用于执行所述反向控制指令所指示的所述反向控制操作。
  25. 根据权利要求23所述的投屏系统,其中,
    所述源端设备,还用于在所述目标时长内监听到锁屏事件的情况下,进入所述熄屏状态,其中,所述熄屏状态下所述源端设备与所述目的端设备之间的投屏数据流传输中断;
    所述目的端设备,还用于在所述源端设备进入熄屏状态的情况下,显示锁屏提示画面。
  26. 根据权利要求25所述的投屏系统,其中,
    所述源端设备,还用于在所述目标时长内监听到所述锁屏事件的情况下,向所述目的端设备发送锁屏消息;
    所述目的端设备,用于基于所述锁屏消息显示所述锁屏提示画面。
  27. 根据权利要求25所述的投屏系统,其中,
    所述源端设备,还用于在熄屏状态下,在监听到亮屏事件的情况下,点亮屏幕并显示锁屏界面,所述亮屏事件为触发屏幕亮屏的事件;在解锁成功的情况下,恢复与所述目的端设备之间的投屏数据流传输。
  28. 一种计算机设备,所述计算机设备包括处理器和存储器;所述存储器存储有至少一条指令,所述至少一条指令用于被所述处理器执行以实现如权利要求1至11任一所述的投屏方法。
  29. 一种计算机可读存储介质,所述计算机可读存储介质中存储有至少一条程序代码,所述程序代码由处理器加载并执行以实现如权利要求1至11任一所述的投屏方法。
  30. 一种计算机程序产品,所述计算机程序产品包括计算机指令,所述计算机指令存储在计算机可读存储介质中;计算机设备的处理器从所述计算机可读存储介质读取所述计算机指令,所述处理器执行所述计算机指令,使得所述计算机设备实现如权利要求1至11任一所述的投屏方法。
PCT/CN2022/143554 2022-06-16 2022-12-29 投屏方法、装置、设备、系统及存储介质 WO2023241009A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210684186.1 2022-06-16
CN202210684186.1A CN115097926B (zh) 2022-06-16 2022-06-16 投屏方法、装置、设备、系统及存储介质

Publications (1)

Publication Number Publication Date
WO2023241009A1 true WO2023241009A1 (zh) 2023-12-21

Family

ID=83291453

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/143554 WO2023241009A1 (zh) 2022-06-16 2022-12-29 投屏方法、装置、设备、系统及存储介质

Country Status (2)

Country Link
CN (1) CN115097926B (zh)
WO (1) WO2023241009A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115097926B (zh) * 2022-06-16 2024-05-17 Oppo广东移动通信有限公司 投屏方法、装置、设备、系统及存储介质
CN117950612A (zh) * 2022-10-31 2024-04-30 荣耀终端有限公司 一种投屏方法和电子设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105426145A (zh) * 2015-11-06 2016-03-23 武汉卡比特信息有限公司 一种手机屏幕投射到计算机类终端的方法
US20170223543A1 (en) * 2016-02-03 2017-08-03 Kyocera Corporation Mobile terminal, display control method, and non-transitory computer-readable recording medium
CN109660665A (zh) * 2018-12-21 2019-04-19 Oppo广东移动通信有限公司 一种屏幕控制方法、屏幕控制装置及终端设备
CN112346685A (zh) * 2020-10-26 2021-02-09 努比亚技术有限公司 一种熄屏投屏控制方法、设备及计算机可读存储介质
CN113093898A (zh) * 2021-04-19 2021-07-09 Tcl通讯(宁波)有限公司 一种多屏互动场景下的省电方法、存储介质及系统
CN115097926A (zh) * 2022-06-16 2022-09-23 Oppo广东移动通信有限公司 投屏方法、装置、设备、系统及存储介质

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107968874A (zh) * 2016-10-19 2018-04-27 中兴通讯股份有限公司 屏幕控制方法、装置及终端
CN107450801B (zh) * 2017-07-26 2021-01-12 Oppo广东移动通信有限公司 一种屏幕显示的控制方法、装置、存储介质及移动终端
CN107734619A (zh) * 2017-11-27 2018-02-23 维沃移动通信有限公司 降低移动终端功耗的方法及移动终端
CN108446628A (zh) * 2018-03-19 2018-08-24 广东欧珀移动通信有限公司 屏幕控制方法、装置、移动终端及计算机可读存储介质
CN108574778B (zh) * 2018-04-19 2021-04-13 Oppo广东移动通信有限公司 投屏亮度调节方法以及相关产品
CN109788138A (zh) * 2019-02-01 2019-05-21 Oppo广东移动通信有限公司 屏幕控制方法、装置、终端及存储介质
CN110175479A (zh) * 2019-05-31 2019-08-27 努比亚技术有限公司 终端熄屏控制方法、装置、移动终端及可读存储介质
CN113760079A (zh) * 2020-06-02 2021-12-07 Oppo广东移动通信有限公司 屏幕控制方法、装置、移动终端及存储介质
CN114518854A (zh) * 2020-11-20 2022-05-20 华为技术有限公司 一种投屏方法及其设备
CN113889055A (zh) * 2021-09-30 2022-01-04 荣耀终端有限公司 一种屏幕亮度调节方法、电子设备及存储介质

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105426145A (zh) * 2015-11-06 2016-03-23 武汉卡比特信息有限公司 一种手机屏幕投射到计算机类终端的方法
US20170223543A1 (en) * 2016-02-03 2017-08-03 Kyocera Corporation Mobile terminal, display control method, and non-transitory computer-readable recording medium
CN109660665A (zh) * 2018-12-21 2019-04-19 Oppo广东移动通信有限公司 一种屏幕控制方法、屏幕控制装置及终端设备
CN112346685A (zh) * 2020-10-26 2021-02-09 努比亚技术有限公司 一种熄屏投屏控制方法、设备及计算机可读存储介质
CN113093898A (zh) * 2021-04-19 2021-07-09 Tcl通讯(宁波)有限公司 一种多屏互动场景下的省电方法、存储介质及系统
CN115097926A (zh) * 2022-06-16 2022-09-23 Oppo广东移动通信有限公司 投屏方法、装置、设备、系统及存储介质

Also Published As

Publication number Publication date
CN115097926A (zh) 2022-09-23
CN115097926B (zh) 2024-05-17

Similar Documents

Publication Publication Date Title
WO2023241009A1 (zh) 投屏方法、装置、设备、系统及存储介质
US20220342475A1 (en) Terminal control method and terminal
US10031575B2 (en) Method and device for waking up MCU chip
EP3136793B1 (en) Method and apparatus for awakening electronic device
US20190104469A1 (en) Method, device and system for reducing power consumption of mobile terminal
WO2021103920A1 (zh) 一种切换音频输出设备的方法及设备
US20170031640A1 (en) Method, device and system for starting target function
US10216248B2 (en) Method and device for controlling power consumption
EP3112979B1 (en) Method and device for waking up mcu
EP3282644B1 (en) Timing method and device
WO2024032144A1 (zh) 设备控制方法、装置、可穿戴设备及存储介质
WO2020142905A1 (zh) 带宽部分切换的方法及装置
US10693672B2 (en) Security and environmental control based on virtual reality headset usage
US11304143B2 (en) Terminal device, network device, frame format configuration method, and system
CN112860212A (zh) 一种音量调节方法及显示设备
CN110543333B (zh) 针对处理器的休眠处理方法、装置、移动终端和存储介质
CN112835506B (zh) 一种显示设备及其控制方法
CN113655984A (zh) 音频播放控制方法、音频播放控制装置及计算机存储介质
CN113282362A (zh) 应用程序管理方法、装置、存储介质以及终端
CN115129283A (zh) 屏幕显示的方法及装置、电子设备、计算机可读存储介质
WO2020186506A1 (zh) 拍摄装置的控制方法和拍摄装置
WO2023116236A1 (zh) 应用启动方法、装置、设备及存储介质
WO2023124554A1 (zh) 应用启动方法、装置、设备及存储介质
WO2024109290A1 (zh) 应用启动方法、装置、设备及存储介质
WO2023116237A1 (zh) 界面显示方法、装置、设备、存储介质及程序产品

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22946673

Country of ref document: EP

Kind code of ref document: A1