WO2023093778A1 - 一种截屏方法及相关装置 - Google Patents
一种截屏方法及相关装置 Download PDFInfo
- Publication number
- WO2023093778A1 WO2023093778A1 PCT/CN2022/133837 CN2022133837W WO2023093778A1 WO 2023093778 A1 WO2023093778 A1 WO 2023093778A1 CN 2022133837 W CN2022133837 W CN 2022133837W WO 2023093778 A1 WO2023093778 A1 WO 2023093778A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- screen
- electronic device
- screenshot
- instruction
- screen capture
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Definitions
- the present application relates to the field of electronic technology, and in particular to a screen capture method and related devices.
- the screen capture function is one of the most practical functions of mobile terminals. It meets the needs of users to capture current screen information in different scenarios. Users can save screen information for subsequent learning or memory through the screen capture function, and can also send screenshots to Other devices are used for sharing.
- the current screen capture technology can perform screen capture on the smart device itself through instructions or operations, but with the development of distributed scenarios, more and more video streaming scenarios (such as screen projection scenarios), the demand for screen capture across devices is also increasing. more.
- the embodiment of the present application provides a screen capture method and a related device, which can capture the screen content of the projected device in the case of screen projection, and directly store the screen capture image in the screen projection device, so as to improve the efficiency of screen capture.
- the present application provides a screen capture system, the system includes: a first electronic device and a second electronic device,
- the first electronic device is configured to display a first screen, where the first screen includes a screen projection screen projected by the second electronic device to the first electronic device;
- the first electronic device is further configured to receive a screenshot instruction for the first screen
- the first electronic device is further configured to take a screenshot of the first picture based on the screenshot instruction, and acquire a screenshot picture, where the screenshot picture includes all or part of the content of the first picture;
- the first electronic device is further configured to send the screenshot to the second electronic device;
- the second electronic device is used for saving screenshot pictures.
- the second electronic device may be called a screen-casting device (such as the electronic device 100 described below), and the second electronic device may be called a projected device ( as the display device 101 described below).
- the first electronic device displays the first screen projected by the second electronic device, and when the first electronic device receives a screenshot instruction for the first screen, the first electronic device acquires a screenshot of the first screen And send the screenshot of the first picture to the second electronic device, and the second electronic device saves the screenshot of the first picture. In this way, it is realized that in the case of screen projection, the screen capture image is directly stored in the screen projection device, and the screen capture efficiency of the screen projection device is improved.
- the screenshot instruction received by the first electronic device may be sent by the second electronic device.
- the first electronic device displays the first screen projected by the second electronic device, and when the second electronic device receives a screen capture command for the first screen, the second electronic device sends a screen capture command to the first electronic device, instructing the first electronic device to
- the device takes a screenshot of the first screen, the first electronic device acquires the screenshot of the first screen and sends the screenshot of the first screen to the second electronic device, and the second electronic device saves the screenshot of the first screen.
- the present application provides a screen capture method, the method includes: the first electronic device displays a first screen, and the first screen includes a screen projection screen projected by the second electronic device to the first electronic device; the first electronic device The device receives a screenshot instruction for the first picture; the first electronic device takes a screenshot of the first picture based on the screenshot instruction, and obtains a screenshot picture, and the screenshot picture includes all or part of the content of the first picture; the first electronic device sends the screenshot picture to second electronic device.
- the first electronic device displays the first screen projected by the second electronic device, and when the first electronic device receives a screenshot instruction for the first screen, the first electronic device obtains the screenshot of the first screen and The screenshot of the first screen is sent to the second electronic device, and the second electronic device saves the screenshot of the first screen.
- the screen capture image is directly stored in the screen projection device, and the screen capture efficiency of the screen projection device is improved.
- the screen capture instruction is sent by the second electronic device.
- the first electronic device receives a screen capture instruction for the first screen, and before that, the method further includes: the first electronic device determines a screen capture area in the first screen, and the screen capture instruction is for command in the screenshot area.
- the second electronic device projects the screen on the first electronic device, and the first electronic device displays the first screen, which is the entire display screen of the display device, and the first screen includes the screen projected by the second electronic device to the first electronic device on the screen.
- the first electronic device can display the projection screen in full screen, and at this time the first screen is the projection screen; the first electronic device can superimpose a window on the original display screen to display the projection screen, and at this time the first screen is the entire display screen , the first screen includes a projection screen; the first electronic device may also display video content in split screens with the original display screen, such as split screens left and right, split screens up and down, and the first screen is the entire display screen at this time, the first The screen includes a projection screen.
- the screenshot area may include the original display screen of the first electronic device itself, or a projected screen screen, or the entire display interface, or a custom area selected by the user, and so on.
- the determining the screenshot area in the first screen by the first electronic device includes: the first electronic device receives a screen capture trigger operation for the first screen; in response to the screen capture trigger operation, the first electronic device A screen capture area selection window is output, and the screen capture area selection window includes two or more screen capture area options; the first electronic device determines the first screen capture area option based on the received user operation for one of the screen capture area options in the screen capture area selection window.
- the screen capture area option includes taking a screen capture of the entire display screen, or entering a screen capture edit mode for the first screen, and taking a screen capture of any selected area.
- a screen capture area selection window may be output on the second electronic device, the user selects a screen capture area on the second electronic device, and the second electronic device sends a screen capture specific to the screen capture area to the first electronic device instruction.
- the second electronic device receives a screen capture trigger operation for the first screen; in response to the screen capture trigger operation, the second electronic device outputs a screen capture area selection window, and the first electronic device selects the screen capture area based on the received window
- the user operation of one of the screen capture area options in determines the screen capture area in the first screen.
- the second electronic device sends a screen capture instruction for the screen capture area to the first electronic device.
- the first electronic device takes a screenshot of the first screen based on the screenshot instruction, and obtains the screenshot picture, including: the first electronic device recognizes the first screen through image recognition technology based on the screenshot instruction.
- the screen includes a screen projection window or a screen projection image; the first electronic device acquires a screen capture picture, and the screen capture image includes a screen projection image or a screen in the screen projection window.
- the user does not need to make a selection, which improves the screen capture efficiency.
- the first electronic device takes a screenshot of the first screen based on the screenshot instruction, and obtains the screenshot image, including: based on the screenshot instruction, if the first electronic device detects that it is in the screen projection state , the first electronic device acquires a screen capture picture, where the screen capture picture includes a screen projection image or an image in a screen projection window. In this way, the user does not need to make a selection, which improves the screen capture efficiency.
- the first electronic device sends the screenshot to the second electronic device, and the method further includes: the first electronic device saves the screenshot; and the first electronic device displays the screenshot.
- storing the screenshot by the first electronic device includes: the first electronic device recognizes that the screenshot includes a projected screen through an image recognition technology, and the first electronic device saves the screenshot. In this way, screenshots of non-projection screens can be filtered out, saving storage resources.
- the present application provides a screen capture method, the method comprising: the second electronic device runs the first screen corresponding to the first activity in the background, and displays the second screen corresponding to the second activity on the display screen; the second electronic device A screen capture instruction for the first screen is received; in response to the screen capture instruction, the second electronic device acquires a screen capture picture, where the screen capture picture includes all or part of the content of the first screen.
- the second electronic device receives a screenshot instruction for the first screen, and the second electronic device may obtain the screenshot of the first screen running in the background.
- the first screen may be displayed on the second screen in a picture-in-picture format, and the second electronic device takes a screenshot of the first screen to obtain a screenshot of the first screen.
- the first screen is a screen projection screen projected on the first electronic device.
- the second electronic device projects a screen on the first electronic device, and the first electronic device displays a projected screen, and the first screen is the projected screen.
- the second electronic device can switch to another application interface (the second screen corresponding to the second activity), and the second electronic device can run the screen projection application in the background mode, that is, run the first activity corresponding to the screen through the background. first screen of .
- the second electronic device may also display a screen projection window in the form of a picture-in-picture, and the screen projection window is displayed on any application interface (the second screen corresponding to the second activity), and the screen projection window displays Screen projection, that is, run the first screen corresponding to the first activity in the form of picture-in-picture.
- the second electronic device may capture a screen capture of the first screen running in the background; or capture a screen capture of the first screen played in a picture-in-picture format; Or the second electronic device may instruct the first electronic device to take a screenshot of the first screen, and the second electronic device acquires the screenshot of the first screen captured by the first electronic device.
- the screen capture instruction is sent by the first electronic device.
- the second electronic device receives a screen capture instruction for the first screen, and before that, the method further includes: the second electronic device determines a screen capture area in the first screen, and the screen capture instruction is for command in the screenshot area.
- the screenshot area may include the entire projected screen (the first screen), or a part of the projected screen (partial content of the first screen), or a custom area selected by the user, and so on.
- the screenshot instruction includes a timestamp or a page identifier, and the page corresponding to the timestamp or the page identifier is the first screen.
- the screenshot instruction may include a time stamp to determine the captured video frame;
- the screen capture instruction may include a page identifier to determine the page to be captured.
- the method further includes: the second electronic device saves the screenshot; and the second electronic device displays the screenshot.
- the second electronic device saves the screenshot, including: after the second electronic device obtains the screenshot, outputs notification information, and the notification information is used to remind the user that the screenshot has been obtained;
- the second electronic device receives a user operation on the notification information; in response to the user operation, the second electronic device provides an editing method for the screenshot; the second electronic device saves the edited screenshot.
- the present application provides an electronic device, including: one or more processors, one or more memories; the one or more stores are coupled with one or more processors; the one or more memories are used For storing computer program codes, the computer program codes include computer instructions; when the computer instructions are run on the processor, the electronic device is made to execute the screen capture method in any possible implementation manner of any aspect above.
- the embodiment of the present application provides a computer storage medium, including computer instructions, which, when the computer instructions are run on the electronic device, cause the communication device to execute the screenshot method in any possible implementation of any one of the above aspects.
- an embodiment of the present application provides a computer program product, which, when the computer program product is run on a computer, causes the computer to execute the screen capture method in any possible implementation manner of any one of the above aspects.
- FIG. 1 is a schematic diagram of a system architecture of a screenshot method provided in an embodiment of the present application
- FIG. 2a is a schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present application.
- FIG. 2b is a schematic diagram of a hardware architecture of a display device provided by an embodiment of the present application.
- Figures 3a to 3f are schematic diagrams of a set of application interfaces provided by the embodiment of the present application.
- FIGS. 4a to 4f are schematic diagrams of another set of application interfaces provided by the embodiment of the present application.
- FIGS. 5a to 5c are schematic diagrams of another set of application interfaces provided by the embodiment of the present application.
- FIGS. 6a to 6c are schematic diagrams of another set of application interfaces provided by the embodiment of the present application.
- Fig. 7 is a software module diagram of a screen capture method provided by the embodiment of the present application.
- FIG. 8 is a method flowchart of a screen capture method provided in an embodiment of the present application.
- FIG. 9 is a software module diagram of another screen capture method provided in the embodiment of the present application.
- FIG. 10 is a method flowchart of another screenshot method provided in the embodiment of the present application.
- FIG. 11 is a technical schematic diagram of a screenshot method provided in the embodiment of the present application.
- FIG. 12 is a method flowchart of another screen capture method provided by the embodiment of the present application.
- first and second are used for descriptive purposes only, and cannot be understood as implying or implying relative importance or implicitly specifying the quantity of indicated technical features. Therefore, the features defined as “first” and “second” may explicitly or implicitly include one or more of these features.
- the “multiple” The meaning is two or more. The orientation or positional relationship indicated by the terms “middle”, “left”, “right”, “upper”, “lower” etc.
- the electronic equipment involved in the embodiment of the present application can be a mobile phone, a tablet computer, a desktop, a laptop, a notebook computer, an ultra-mobile personal computer (Ultra-mobile Personal Computer, UMPC), a handheld computer, a netbook, a personal digital assistant (Personal Digital Assistant, PDA), virtual reality equipment, PDA (Personal Digital Assistant, personal digital assistant, also known as handheld computer), portable Internet equipment, data storage equipment, car machine, vehicle terminal (such as smart screen, vehicle camera, display ), wearable devices (e.g., wireless earphones, smart watches, smart bracelets, smart glasses, head-mounted displays (HMDs), electronic clothing, electronic bracelets, electronic necklaces, electronic accessories, electronic tattoos and smart mirror) and so on.
- PDA Personal Digital Assistant
- portable Internet equipment data storage equipment
- car machine such as smart screen, vehicle camera, display
- vehicle terminal such as smart screen, vehicle camera, display
- wearable devices e.g., wireless earphones, smart watches, smart bracelets, smart glasses
- the user can use the mobile phone to cast the video he/she wants to watch to the computer to obtain a better viewing experience, and the user can use the mobile phone to perform other tasks during the screen casting process, such as Switch to chat software to chat with friends, make phone calls, etc.
- other tasks during the screen casting process such as Switch to chat software to chat with friends, make phone calls, etc.
- users can watch videos on their computers while using their mobile phones.
- the user wants to take a screenshot of the video screen being cast and share it with friends through the mobile phone, the user can take a screenshot of the video screen being cast on the computer to obtain the screenshot, and the screenshot will be saved locally on the computer. You need to send the screenshot on your computer to your mobile phone for sharing. This series of operations is less efficient.
- the user can screenshot the video screen on the mobile phone, but this requires switching the mobile phone from other application interfaces to the video playback interface, interrupting other tasks being performed by the mobile phone.
- the embodiment of the present application provides a screen capture method, which can capture the screen content of the projected device in the case of screen projection, and directly store the screen capture on the screen projection device, so as to improve the efficiency of screen capture.
- screen projection is a service or function provided by electronic devices, which can support electronic devices to transmit data to other devices.
- screen projection can support the electronic device to connect via Bluetooth, wireless fidelity direct (Wi-Fi direct), Wi-Fi software access point (software access point, softAP) or A number of other technologies transmit data to nearby devices.
- screen projection may support the electronic device to transmit data to devices (such as other electronic devices) in the same LAN as the electronic device through a local area network (LAN).
- LAN local area network
- the device in the same local area network as the electronic device may also be a device near the electronic device.
- the wireless projection protocols involved in this application include but are not limited to Digital Living Network Alliance (Digital Living Network Alliance, DLNA), AirPlay, Miracast, etc.
- Fig. 1 schematically shows a system diagram provided in this application.
- the system may include an electronic device 100 and a display device 101 .
- the electronic device 100 and the display device 101 can be connected by wired or wireless communication, and the wireless communication can include, for example, Bluetooth (blue tooth, BT), near field communication (near field communication, NFC), wireless fidelity (wireless fidelity, WiFi) , or WiFi Direct.
- the display device 101 includes electronic devices with display screens such as televisions, computers, tablets, iPads, mobile phones, car machines, vehicle terminals, and treadmills.
- the electronic device 100 and the display device 101 may perform data communication through a server, and the server may be an application server, a cloud server, a background server, and the like.
- the electronic device 100 and the display device 101 are devices logged in with the same account, or the accounts logged in by the electronic device 100 and the display device 101 are associated accounts, wherein the associated account may be an account authorized by the same account.
- the account here refers to an application account, a device account, an identity account, and the like.
- the electronic device 100 may be called a screen-casting device, and the electronic device 100 may be called a screen-projected device.
- the display device 101 displays the first screen projected by the electronic device 100.
- the display device 101 receives a screenshot instruction for the first screen
- the display device 101 acquires the screenshot of the first screen and saves the screenshot of the first screen.
- a screenshot of a frame is sent to the electronic device 100, and the electronic device 100 saves the screenshot of the first frame.
- the display device 101 displays the first screen projected by the electronic device 100.
- the electronic device 100 receives a screenshot instruction for the first screen
- the electronic device 100 sends an instruction to the display device 101, instructing the display device 101 to Taking a screenshot of the first frame
- the display device 101 acquires the screenshot of the first frame and sends the screenshot of the first frame to the electronic device 100, and the electronic device 100 saves the screenshot of the first frame.
- the screen capture image is directly stored in the screen projection device, and the screen capture efficiency of the screen projection device is improved.
- the electronic device 100 involved in the embodiment of the present application is first introduced below.
- FIG. 2a shows a schematic structural diagram of an exemplary electronic device 100 provided by an embodiment of the present application.
- the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2 , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and A subscriber identification module (subscriber identification module, SIM) card interface 195 and the like.
- SIM subscriber identification module
- the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, bone conduction sensor 180M, etc.
- the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100 .
- the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components.
- the illustrated components can be realized in hardware, software or a combination of software and hardware.
- the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
- application processor application processor, AP
- modem processor graphics processing unit
- GPU graphics processing unit
- image signal processor image signal processor
- ISP image signal processor
- controller memory
- video codec digital signal processor
- DSP digital signal processor
- baseband processor baseband processor
- neural network processor neural-network processing unit, NPU
- the controller may be the nerve center and command center of the electronic device 100 .
- the controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.
- a memory may also be provided in the processor 110 for storing instructions and data.
- the memory in processor 110 is a cache memory.
- the memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the system.
- processor 110 may include one or more interfaces.
- the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and /or universal serial bus (universal serial bus, USB) interface, etc.
- I2C integrated circuit
- I2S integrated circuit built-in audio
- PCM pulse code modulation
- PCM pulse code modulation
- UART universal asynchronous transmitter
- MIPI mobile industry processor interface
- GPIO general-purpose input and output
- subscriber identity module subscriber identity module
- SIM subscriber identity module
- USB universal serial bus
- the I2C interface is a bidirectional synchronous serial bus, including a serial data line (serial data line, SDA) and a serial clock line (derail clock line, SCL).
- processor 110 may include multiple sets of I2C buses.
- the processor 110 can be respectively coupled to the touch sensor 180K, the charger, the flashlight, the camera 193 and the like through different I2C bus interfaces.
- the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to realize the touch function of the electronic device 100 .
- the I2S interface can be used for audio communication.
- processor 110 may include multiple sets of I2S buses.
- the processor 110 can be coupled with the audio module 170 through an I2S bus to realize communication between the processor 110 and the audio module 170.
- the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface, so as to realize the function of answering calls through the Bluetooth headset.
- the PCM interface can also be used for audio communication, sampling, quantizing and encoding the analog signal.
- the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface.
- the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
- the UART interface is a universal serial data bus used for asynchronous communication.
- the bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication.
- a UART interface is generally used to connect the processor 110 and the wireless communication module 160 .
- the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to realize the Bluetooth function.
- the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface, so as to realize the function of playing music through the Bluetooth headset.
- the MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 .
- MIPI interface includes camera serial interface (camera serial interface, CSI), display serial interface (display serial interface, DSI), etc.
- the processor 110 communicates with the camera 193 through the CSI interface to realize the shooting function of the electronic device 100 .
- the processor 110 communicates with the display screen 194 through the DSI interface to realize the display function of the electronic device 100 .
- the GPIO interface can be configured by software.
- the GPIO interface can be configured as a control signal or as a data signal.
- the GPIO interface can be used to connect the processor 110 with the camera 193 , the display screen 194 , the wireless communication module 160 , the audio module 170 , the sensor module 180 and so on.
- the GPIO interface can also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, etc.
- the USB interface 130 is an interface conforming to the USB standard specification, specifically, it can be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like.
- the USB interface 130 can be used to connect a charger to charge the electronic device 100 , and can also be used to transmit data between the electronic device 100 and peripheral devices. It can also be used to connect headphones and play audio through them. This interface can also be used to connect other electronic devices, such as AR devices.
- the interface connection relationship between the modules shown in the embodiment of the present application is only a schematic illustration, and does not constitute a structural limitation of the electronic device 100 .
- the electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
- the charging management module 140 is configured to receive a charging input from a charger.
- the charger may be a wireless charger or a wired charger.
- the charging management module 140 can receive charging input from the wired charger through the USB interface 130 .
- the charging management module 140 may receive a wireless charging input through a wireless charging coil of the electronic device 100 . While the charging management module 140 is charging the battery 142 , it can also supply power to the electronic device through the power management module 141 .
- the power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 .
- the power management module 141 receives the input from the battery 142 and/or the charging management module 140 to provide power for the processor 110 , the internal memory 121 , the external memory, the display screen 194 , the camera 193 , and the wireless communication module 160 .
- the power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance).
- the power management module 141 may also be disposed in the processor 110 .
- the power management module 141 and the charging management module 140 may also be set in the same device.
- the wireless communication function of the electronic device 100 can be realized by the antenna 1 , the antenna 2 , the mobile communication module 150 , the wireless communication module 160 , a modem processor, a baseband processor, and the like.
- Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
- Each antenna in electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas.
- Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
- the antenna may be used in conjunction with a tuning switch.
- the mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied on the electronic device 100 .
- the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like.
- the mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation.
- the mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves and radiate them through the antenna 1 .
- at least part of the functional modules of the mobile communication module 150 may be set in the processor 110 .
- at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be set in the same device.
- a modem processor may include a modulator and a demodulator.
- the modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal.
- the demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator sends the demodulated low-frequency baseband signal to the baseband processor for processing.
- the low-frequency baseband signal is passed to the application processor after being processed by the baseband processor.
- the application processor outputs sound signals through audio equipment (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194 .
- the modem processor may be a stand-alone device.
- the modem processor may be independent from the processor 110, and be set in the same device as the mobile communication module 150 or other functional modules.
- the wireless communication module 160 can provide applications on the electronic device 100 including UWB, wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (wireless fidelity, WiFi) network), bluetooth (bluetooth, BT), global navigation satellite System (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
- the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
- the wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
- the wireless communication module 160 can also receive the signal to be sent from the processor 110 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
- the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
- the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC , FM, and/or IR techniques, etc.
- GSM global system for mobile communications
- GPRS general packet radio service
- code division multiple access code division multiple access
- CDMA broadband Code division multiple access
- WCDMA wideband code division multiple access
- time division code division multiple access time-division code division multiple access
- TD-SCDMA time-division code division multiple access
- the GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a Beidou navigation satellite system (beidou navigation satellite system, BDS), a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).
- GPS global positioning system
- GLONASS global navigation satellite system
- Beidou navigation satellite system beidou navigation satellite system
- BDS Beidou navigation satellite system
- QZSS quasi-zenith satellite system
- SBAS satellite based augmentation systems
- the electronic device 100 realizes the display function through the GPU, the display screen 194 , and the application processor.
- the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
- Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
- the display screen 194 is used to display images, videos and the like.
- the display screen 194 includes a display panel.
- the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc.
- the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.
- the display screen 194 displays interface content currently output by the system.
- the interface content is an interface provided by an instant messaging application.
- the electronic device 100 can realize the shooting function through the ISP, the camera 193 , the video codec, the GPU, the display screen 194 and the application processor.
- the ISP is used for processing the data fed back by the camera 193 .
- the light is transmitted to the photosensitive element of the camera through the lens, and the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.
- ISP can also optimize the algorithm for image noise and brightness.
- ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
- the ISP may be located in the camera 193 .
- Camera 193 is used to capture still images or video.
- the object generates an optical image through the lens and projects it to the photosensitive element.
- the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
- CMOS complementary metal-oxide-semiconductor
- the photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
- the ISP outputs the digital image signal to the DSP for processing.
- DSP converts digital image signals into standard RGB, YUV and other image signals.
- the electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.
- Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
- Video codecs are used to compress or decompress digital video.
- the electronic device 100 may support one or more video codecs.
- the electronic device 100 can play or record videos in various encoding formats, for example: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.
- MPEG moving picture experts group
- the NPU is a neural-network (NN) computing processor.
- NN neural-network
- Applications such as intelligent cognition of the electronic device 100 can be realized through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.
- the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the electronic device 100.
- the external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. Such as saving music, video and other files in the external memory card.
- the internal memory 121 may be used to store computer-executable program codes including instructions.
- the processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121 .
- the internal memory 121 may include an area for storing programs and an area for storing data.
- the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like.
- the storage data area can store data created during the use of the electronic device 100 (such as audio data, phonebook, etc.) and the like.
- the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.
- the electronic device 100 can implement audio functions through the audio module 170 , the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playback, recording, etc.
- the audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal.
- the audio module 170 may also be used to encode and decode audio signals.
- the audio module 170 can be set in the processor 110 , or some functional modules of the audio module 170 can be set in the processor 110 .
- Speaker 170A also referred to as a "horn" is used to convert audio electrical signals into sound signals.
- Electronic device 100 can listen to music through speaker 170A, or listen to hands-free calls.
- Receiver 170B also called “earpiece” is used to convert audio electrical signals into sound signals.
- the receiver 170B can be placed close to the human ear to receive the voice.
- the microphone 170C also called “microphone” or “microphone” is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can put his mouth close to the microphone 170C to make a sound, and input the sound signal to the microphone 170C.
- the electronic device 100 may be provided with at least one microphone 170C. In some other embodiments, the electronic device 100 may be provided with two microphones 170C, which may also implement a noise reduction function in addition to collecting sound signals. In some other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and realize directional recording functions, etc.
- the earphone interface 170D is used for connecting wired earphones.
- the earphone interface 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
- OMTP open mobile terminal platform
- CTIA cellular telecommunications industry association of the USA
- the pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal.
- pressure sensor 180A may be disposed on display screen 194 .
- the pressure sensor 180A can be used to capture the pressure value generated when the user's finger part touches the display screen, and transmit the pressure value to the processor, so that the processor can identify which finger part the user inputs user action.
- a capacitive pressure sensor may be comprised of at least two parallel plates with conductive material.
- the electronic device 100 determines the intensity of pressure according to the change in capacitance.
- the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A.
- the electronic device 100 may also calculate the touched position according to the detection signal of the pressure sensor 180A. In some embodiments, different touch positions may correspond to different operation instructions.
- the pressure sensor 180A can also calculate the number of touch points according to the detected signal, and transmit the calculated value to the processor, so that the processor can recognize that the user inputs a user operation with a single finger or multiple fingers.
- the gyro sensor 180B can be used to determine the motion posture of the electronic device 100 .
- the angular velocity of the electronic device 100 around three axes can be determined by the gyro sensor 180B.
- the gyro sensor 180B can be used for image stabilization. Exemplarily, when the shutter is pressed, the gyro sensor 180B detects the shaking angle of the electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and allows the lens to counteract the shaking of the electronic device 100 through reverse movement to achieve anti-shake.
- the gyro sensor 180B can also be used for navigation and somatosensory game scenes.
- the air pressure sensor 180C is used to measure air pressure.
- the electronic device 100 calculates the altitude based on the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
- the magnetic sensor 180D includes a Hall sensor.
- the electronic device 100 may use the magnetic sensor 180D to detect the opening and closing of the flip leather case.
- the electronic device 100 when the electronic device 100 is a clamshell machine, the electronic device 100 can detect opening and closing of the clamshell according to the magnetic sensor 180D.
- features such as automatic unlocking of the flip cover are set.
- the acceleration sensor 180E can detect the acceleration of the electronic device 100 in various directions (generally three axes). The magnitude and direction of gravity can be detected when the electronic device 100 is stationary. It can also be used to identify the posture of electronic devices, and can be used in applications such as horizontal and vertical screen switching, pedometers, etc. In some optional embodiments of the present application, the acceleration sensor 180E may be used to capture the acceleration value generated when the user's finger touches the display screen (or the user's finger taps the rear side frame of the electronic device 100), and store the acceleration value The data is transmitted to the processor, so that the processor identifies which finger part the user uses to input the user operation.
- the distance sensor 180F is used to measure the distance.
- the electronic device 100 may measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 may use the distance sensor 180F for distance measurement to achieve fast focusing.
- Proximity light sensor 180G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes.
- the light emitting diodes may be infrared light emitting diodes.
- the electronic device 100 emits infrared light through the light emitting diode.
- Electronic device 100 uses photodiodes to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it may be determined that there is an object near the electronic device 100 . When insufficient reflected light is detected, the electronic device 100 may determine that there is no object near the electronic device 100 .
- the electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to make a call, so as to automatically turn off the display screen to save power.
- the proximity light sensor 180G can also be used in leather case mode, automatic unlock and lock screen in pocket mode.
- the ambient light sensor 180L is used for sensing ambient light brightness.
- the electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness.
- the ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures.
- the ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in the pocket, so as to prevent accidental touch.
- the fingerprint sensor 180H is used to collect fingerprints.
- the electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access to application locks, take pictures with fingerprints, answer incoming calls with fingerprints, and the like.
- the temperature sensor 180J is used to detect temperature.
- the electronic device 100 uses the temperature detected by the temperature sensor 180J to implement a temperature treatment strategy. For example, when the temperature reported by the temperature sensor 180J exceeds the threshold, the electronic device 100 may reduce the performance of the processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection.
- the electronic device 100 when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 caused by the low temperature.
- the electronic device 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.
- Touch sensor 180K also known as "touch panel”.
- the touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”.
- the touch sensor 180K is used to detect a touch operation on or near it, and the touch operation refers to an operation in which the user's hand, elbow, stylus, etc. touch the display screen 194 .
- the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
- Visual output related to the touch operation can be provided through the display screen 194 .
- the touch sensor 180K may also be disposed on the surface of the electronic device 100 , which is different from the position of the display screen 194 .
- the bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human voice. The bone conduction sensor 180M can also contact the human pulse and receive the blood pressure beating signal. In some embodiments, the bone conduction sensor 180M can also be disposed in the earphone, combined into a bone conduction earphone.
- the audio module 170 can analyze the voice signal based on the vibration signal of the vibrating bone mass of the vocal part acquired by the bone conduction sensor 180M, so as to realize the voice function.
- the application processor can analyze the heart rate information based on the blood pressure beating signal acquired by the bone conduction sensor 180M, so as to realize the heart rate detection function.
- the keys 190 include a power key, a volume key and the like.
- the key 190 may be a mechanical key. It can also be a touch button.
- the electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100 .
- the motor 191 can generate a vibrating reminder.
- the motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback.
- touch operations applied to different applications may correspond to different vibration feedback effects.
- the motor 191 may also correspond to different vibration feedback effects for touch operations acting on different areas of the display screen 194 .
- Different application scenarios for example: time reminder, receiving information, alarm clock, games, etc.
- the touch vibration feedback effect can also support customization.
- the indicator 192 can be an indicator light, and can be used to indicate charging status, power change, and can also be used to indicate messages, missed calls, notifications, and the like.
- the SIM card interface 195 is used for connecting a SIM card.
- the SIM card can be connected and separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195 .
- Fig. 2b exemplarily shows a schematic structural diagram of a display device 101 provided in the present application.
- the display device 101 may include: a processor 122, a memory 123, a wireless communication processing module 124, a power switch 125, a wired LAN communication processing module 126, an HDMI communication processing module 127, a USB communication processing module 128 and a display screen 129. in:
- Processor 122 may be used to read and execute computer readable instructions.
- the processor 122 may mainly include a controller, an arithmetic unit, and a register.
- the controller is mainly responsible for instruction decoding, and sends out control signals for the operations corresponding to the instructions.
- the arithmetic unit is mainly responsible for performing fixed-point or floating-point arithmetic operations, shift operations, and logic operations, and can also perform address operations and conversions.
- the register is mainly responsible for saving the register operands and intermediate operation results temporarily stored during the execution of the instruction.
- the hardware architecture of the processor 122 may be an application specific integrated circuit (Application Specific Integrated Circuits, ASIC) architecture, a MIPS architecture, an ARM architecture, or an NP architecture, and the like.
- ASIC Application Specific Integrated Circuits
- the processor 122 can be used to analyze the signals received by the wireless communication processing module 124 and/or the wired LAN communication processing module 126, such as the detection request broadcast by the electronic device 100, the display request sent by the electronic device 100, the cloud The display instruction sent by the server of the projection service provider, etc.
- the processor 122 may be configured to perform corresponding processing operations according to the analysis results, such as generating a probe response, or driving a display screen to perform display according to the display request or display instruction, and so on.
- the processor 122 can also be used to generate a signal sent by the wireless communication processing module 124 and/or the wired LAN communication processing module 126, such as a Bluetooth broadcast signal, a beacon signal, or a user signal sent to an electronic device. Signals for feedback display status (such as connection success, connection failure, etc.).
- the memory 123 is coupled with the processor 122 for storing various software programs and/or sets of instructions.
- the memory 123 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices or other non-volatile solid-state storage devices.
- the memory 123 can store operating systems, such as embedded operating systems such as uCOS, VxWorks, and RTLinux.
- the memory 123 can also store a communication program that can be used to communicate with the electronic device 100, one or more servers, or nearby devices.
- the wireless communication processing module 124 may include one or more of a Bluetooth (BT) communication processing module 124A and a WLAN communication processing module 124B.
- BT Bluetooth
- WLAN WLAN
- one or more of the Bluetooth (BT) communication processing module and the WLAN communication processing module can monitor signals transmitted by other devices (such as the electronic device 100), such as detection requests, scanning signals, etc., and A response signal can be sent, such as a probe response, a scan response, etc., so that other devices (such as the electronic device 100) can discover the display device 101 and establish a wireless communication connection with other devices (such as the electronic device 100).
- the electronic device 100 communicates with other devices using one or more wireless communication technologies.
- one or more of the Bluetooth (BT) communication processing module and the WLAN communication processing module can also transmit signals, such as broadcasting Bluetooth signals and beacon signals, so that other devices (such as the electronic device 100) can Discover the display device 101, establish a wireless communication connection with other devices (such as the electronic device 100), and communicate with other devices (such as the electronic device 100) through one or more wireless communication technologies in Bluetooth or WLAN.
- signals such as broadcasting Bluetooth signals and beacon signals
- the wireless communication processing module 124 may also include a cellular mobile communication processing module (not shown).
- the cellular mobile communication processing module can communicate with other devices (such as servers) through cellular mobile communication technology.
- the power switch 125 can be used to control power supply to the display screen 129 .
- the wired LAN communication processing module 126 can be used to communicate with other devices in the same LAN through the wired LAN, and can also be used to connect to the WAN through the wired LAN, and can communicate with devices in the WAN.
- the HDMI communication processing module 127 can be used to communicate with other devices through an HDMI interface (not shown).
- the USB communication processing module 128 can be used to communicate with other devices through a USB interface (not shown).
- the display screen 129 can be used to display images, videos and the like.
- the display screen 129 can be a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (organic light-emitting diode, OLED) display screen, an active-matrix organic light-emitting diode (active-matrix organic light emitting diode, AMOLED) Display, flexible light-emitting diode (FLED) display, quantum dot light emitting diodes (QLED) display, etc.
- LCD liquid crystal display
- OLED organic light-emitting diode
- AMOLED active-matrix organic light-emitting diode
- FLED flexible light-emitting diode
- QLED quantum dot light emitting diodes
- the display device 101 may further include an audio module (not shown).
- the audio module can be used to output audio signals through the audio output interface, so that the display device 101 can support audio playback.
- the audio module can also be used to receive audio data through the audio input interface.
- the display device 101 may be a media playback device such as a television.
- the display device 101 may also include a serial interface such as an RS-232 interface.
- the serial interface can be connected to other devices, such as audio speakers and other external audio devices, so that the display and audio external devices cooperate to play audio and video.
- the structure shown in FIG. 2 b does not constitute a specific limitation on the display device 101 .
- the display device 101 may include more or fewer components than shown in the illustration, or combine certain components, or separate certain components, or arrange different components.
- the illustrated components can be realized in hardware, software or a combination of software and hardware.
- FIG. 3 a to 3 d are exemplary display interfaces of the electronic device 100 , showing the process of the electronic device 100 projecting a video on the display device 101 .
- FIG. 3 a exemplarily shows a main interface 310 of an electronic device 100 .
- the main interface 310 includes a status bar 311, a tray 312 with frequently used application icons, and other application icons (including a video application icon 313). in:
- Status bar 311 may include: one or more signal strength indicators for mobile communication signals (also referred to as cellular signals), one or more signal strength indicators for wireless high-fidelity (wireless fidelity, Wi-Fi) signals, Bluetooth indicator, battery status indicator, time indicator.
- a tray 312 with frequently used application icons may display, for example, a phone icon, a contacts icon, an SMS icon, a camera icon, and the like.
- the electronic device 100 When the electronic device 100 receives a user operation on the application program icon, the electronic device 100 starts the application program corresponding to the application program icon, and displays the corresponding application interface. Exemplarily, the user clicks the video application icon 313, the electronic device 100 starts the video application, and enters the video playback interface.
- the video playback interface 320 of the video application shown in FIG. 3b includes a display area 321, a video information area 322, a progress bar 323 and one or more controls (only the control 324 is marked in FIG. 3b). in,
- the display area 321 is used to display video images.
- the video information area 322 is used to indicate the relevant information of the video currently displayed in the display area 321 , such as name, introduction, rating, play times, leading role, episode number and so on.
- the progress bar 323 is used to indicate the video playing progress in the display area 321 .
- the progress bar 323 is in the playing state, indicating that the electronic device 100 is currently playing a video.
- the control 324 is used to implement screen projection.
- the electronic device 100 receives a user operation on the control 324, in response to the operation, the electronic device 100 queries a device capable of screen projection (such as the display device 101), and displays the display area 321 The video is cast to the screen-casting device.
- a device capable of screen projection such as the display device 101
- the electronic device 100 when the electronic device 100 receives a user operation on the control 324, and in response to the operation, the electronic device 100 finds one or more screen-casting devices, the electronic device 100 can display the user interface 330 as shown in FIG. 3c.
- the user interface 330 includes a device selection window 331 superimposed on the display area 321 .
- the device selection window 331 includes one or more device icons corresponding to screen-casting devices for the user to confirm and select a screen-casting device.
- FIG. 3 c includes an iPad device icon 332 , a bedroom TV device icon 333 , and a living room TV device icon 334 .
- the progress bar 323 in FIG. 3 c is in a paused playback state, indicating that the current electronic device 100 pauses to play the video.
- the electronic device 100 detects a user operation on any device icon (taking the living room TV device icon 334 as an example) in the device selection window 331, and the electronic device 100 projects the video to the living room TV.
- the electronic device 100 may not The video is displayed again, and the video application can be run in the background, and other applications can be run in the foreground, so that the video can be played through the display device 101 while using other applications through the electronic device 100 .
- the electronic device 100 may display an interface as shown in FIG. 3d.
- FIG. 341 prompts the user that the screen is currently being projected, and the display area 341 includes an exit screen projection button 342 for exiting the screen projection.
- the TV in the living room is playing a video.
- the progress bar 323 of the electronic device 100 is in the playing state, and the progress of the progress bar is synchronized with the video playback progress on the TV in the living room.
- the user can control the playback progress of the video on the TV in the living room by controlling the progress bar 323 .
- multiple controls may also be included in FIG. 3d, and the multiple controls may be used, for example, to adjust the resolution, switch the device to be projected (currently the display device 101), Controlling the volume, etc.
- 3 a to 3 d above show the process in which the electronic device 100 projects a video on the display device 101 .
- the electronic device 100 casts the video to the TV in the living room, the electronic device 100 can play the video in the form of picture-in-picture, and can run other applications synchronously.
- the electronic device 100 may display a user interface 350 as shown in FIG.
- the projection screen displayed in 101 is the same.
- the user can freely adjust the position and size of the screen projection window 351 .
- the screen projection window 351 is displayed on the application interface, and does not interfere with the application interface.
- FIG. 3e it is exemplary that the screen projection window 351 is displayed on the main interface, and the screen projection window 351 may be displayed on other application interfaces.
- FIG. 3f when the electronic device 100 receives a user operation for the memo application, the electronic device 100 runs the memo application, and displays the application interface 360 of the memo application, which includes a projection window 351 .
- Fig. 4a shows the implementation form of the display device 101 on the display interface after the electronic device 100 projects the video on the TV (display device 101) in the living room.
- FIG. 4a exemplarily shows a screen projection interface 410 of the display device 101.
- the display screen in the screen projection interface 410 is provided by the electronic device 100. It can be seen that the current display screen of the screen projection interface 410 is as shown in FIG. 3b The display screen in the middle display area 321.
- the screen projection interface 410 also includes a progress bar 401 and an exit screen projection button 402 .
- the progress bar 401 is currently in a playing state, and the user can control the progress of playing the video on the TV in the living room by controlling the progress bar 401 .
- the exit screen projection button 402 is used to exit screen projection.
- the display device 101 when the display device 101 receives a screen capture instruction for the display screen in the screen projection interface 410, the display device 101 takes a screen capture of the current display screen, and sends the screen capture picture to the electronic device 100, and the electronic device 100 Save the display of this screenshot.
- the above-mentioned screenshot instruction may be a user operation for taking a screenshot, such as a click operation on the screenshot control provided by the display device 101, or a voice instruction, a remote control instruction, a button instruction, a touch screen instruction (tap, two fingers, three-finger swipe) and so on.
- the display device 101 when the display device 101 receives a screen capture instruction for the display screen in the screen projection interface 410, the display device 101 enters the screen capture edit mode, and the user can determine the area where the screen capture is desired, and the display device 101 selects the screen capture area based on the user's selection. Get the screen under the screenshot area.
- the display device 101 receives a screenshot instruction for the display screen in the screen projection interface 410, and the display device 101 takes a screenshot based on the screenshot instruction, and the display interface 420 of the display device 101 displays that the screenshot is successful.
- Notification 421 may be "the screenshot of the screen projection has been completed, and the screenshot is saved to the screen projection device", indicating that the display device 101 has sent the screen capture to the electronic device 100 (screen projection device) .
- the electronic device 100 when the electronic device 100 receives the screenshot, the electronic device 100 outputs corresponding notification information, which is used to remind the user that the screenshot sent by the display device 101 has been received.
- FIG. 4c exemplarily shows a notification 431 displayed on the user interface 430 and a received screenshot thumbnail 432.
- the notification 431 may be "received Screenshot sent by TV).
- the screenshot thumbnail 432 shows the thumbnail of the received screenshot, and the screenshot can be edited by clicking on the screenshot thumbnail 432 .
- the electronic device 100 displays a user interface 440 as shown in FIG. 4d.
- the user interface 440 provides an edit function bar 441, a capture box 442, a save control 443, a delete control 444, and a cancel control 445 for screenshots. , more, etc. functional controls.
- the capture box 442 is used to capture screenshots.
- the electronic device 100 receives and saves the screenshot, and at this time, the electronic device 100 can view the screenshot in its own picture application.
- a main interface 450 of an electronic device 100 is shown in FIG. 4e.
- the electronic device 100 opens the gallery application, wherein the gallery application is used to view media files such as pictures and videos saved by the electronic device 100 .
- the application interface of the gallery application is shown in FIG. 4f.
- the application interface 460 includes one or more media files such as pictures and videos, wherein the picture 461 is the screenshot above.
- the electronic device 100 when the electronic device 100 receives a screenshot instruction for the display screen in the screen projection interface 340, the electronic device 100 instructs the display device 101 to take a screenshot of the current display screen, and the display device 101 sends the screenshot to the electronic device.
- the device 100 the electronic device 100 saves the displayed screen of the screenshot.
- FIG. 5a when the electronic device 100 is projecting a screen, if the user wants to take a screenshot of the projected display screen, the user triggers a screen capture instruction.
- the electronic device 100 receives the For the user operation of sliding down on the top of the interface 341 , the electronic device 100 outputs a drop-down function interface.
- the drop-down function interface provides a plurality of function options, and the plurality of function options include a function option of taking a screenshot of the projected display screen.
- the electronic device 100 may switch to application interfaces of other applications during the screen projection process to perform other tasks.
- the electronic device 100 displays any application interface, it can enter the pull-down function interface.
- FIG. 5b shows a drop-down function interface 520, which includes a function bar 521
- the function bar 521 includes a plurality of function controls (such as a screenshot control 521A, a large screen projection 521B control, a projection screen capture 521C controls, etc.).
- the screen capture control 521A is used to capture the screen of the pull-down function interface 520
- the large screen projection control 521B is used to realize the screen projection function
- the screen projection screen capture 521C control is used to capture the screen of the projected display screen.
- the electronic device 100 when the electronic device 100 receives a user operation on the screen projection 521C control, the electronic device 100 instructs the display device 101 to take a screenshot of the current display screen, and the display device 101 sends the screenshot to the electronic device 100, The electronic device 100 saves the screenshot.
- the display device 101 receives the screenshot instruction sent by the electronic device 100, the display device 101 enters the screenshot editing mode, and the user can determine the area where the screenshot is desired, and the display device 101 acquires the screenshot area under the screenshot area based on the screen capture area selected by the user. screen, the display device 101 sends the screenshot to the electronic device 100.
- the display device 101 may output a notification of a successful screenshot. Exemplarily, as shown in FIG. , Save the screenshot to the screen projection device", indicating that the display device 101 has sent the screenshot to the electronic device 100 (the screen projection device).
- the electronic device 100 when the electronic device 100 receives the screenshot, the electronic device 100 outputs corresponding notification information to remind the user that the screenshot sent by the display device 101 has been received.
- FIG. 5c exemplarily shows a notification 531 displayed on the user interface 530, and the notification 531 may be "received a screenshot sent by the screen projection device (living room TV), Click to view”.
- the electronic device 100 when the electronic device 100 receives a user operation on the control of the screen-casting screenshot 521C, the electronic device 100 controls the screen that is running in the background (such as shown in FIG. 3d ) or played in picture-in-picture (such as FIG. 3f) to take a screenshot of the projected screen, and obtain the screenshot of the projected screen.
- the electronic device 100 outputs corresponding notification information for prompting the user that the screen shot of the projected screen has been obtained.
- the notification may be "the screenshot of the screen projection has been completed, click to view”.
- the manner in which the display device 101 displays video images based on video information may be full-screen display (as shown in FIG. 4a ), split-screen display, or window display (such as floating window display), etc., This application does not limit this.
- Fig. 6a exemplarily shows a screen projection interface 610 in which a window displays a projection screen
- the display content in the screen projection interface 610 is the original display content 601 of the TV in the living room
- the display content of the screen projection window 602 is the screen projection video data provided by the electronic device 100
- the screen projection window 602 includes a progress bar 603 , an exit screen projection button 604 and a full screen display button 605 .
- the user can control the progress of the video playing on the TV in the living room by controlling the progress bar 603 , exit the screen projection by the exit projection button 604 , and display the projection screen of the projection window 602 in full screen by the full screen display button 605 .
- the display device 101 determines the content of the screen capture, for example, the screen capture content is the display screen of the display device 101 itself, or a screen projection, or the entire display interface (such as a screen projection interface 610), or a custom area selected by the user, and so on.
- the manner in which the display device 101 determines the content of the screenshot is described below with an example.
- the display device 101 determines that the content of the screen capture is the screen projection after receiving the screen capture instruction for the screen projection.
- the display device 101 receives the screenshot instruction for its own display screen, it determines that the content of the screen capture is its own display screen.
- the display device 101 receives the screenshot instruction for the entire display interface, it determines that the content of the screenshot is the entire display interface.
- the display device 101 when it detects that it is currently in a screen-casting state, it determines that the content of the screenshot is a screen-casting screen.
- the display device 101 determines that the content of the screen capture is a screen projection image.
- the display device 101 outputs a pop-up window to prompt the user to determine the content to be captured, and the display device 101 obtains the content determined by the user to capture the screen.
- the display device 101 outputs a selection window 621 as shown in FIG. A picture 623 , the entire display interface 624 and a self-selected area 625 .
- the display device 101 When the display device 101 receives a user operation on its own display screen 622, the display device 101 takes a screenshot of its current display screen to obtain a screenshot of the original display content 601; , the display device 101 takes a screenshot of the projected screen to obtain the screenshot of the projected screen window 602; the display device 101 receives a user operation on the entire display interface 624, and the display device 101 takes a screenshot of the currently displayed entire display interface to obtain the projected screen.
- a screenshot of the screen interface 610 A screenshot of the screen interface 610.
- FIG. 6c shows an interface 630 in a screenshot editing mode.
- the display device 101 provides a screenshot area selection window 631, and the screenshot area selection window 631 uses To determine the screen capture area, the user can move the position of the screen capture area selection window 631 and adjust the size of the screen capture area selection window 631 .
- the screen capture area selection window 631 also includes a cancel control 632 and a confirmation control 633, the cancel control 632 is used to exit the screen capture editing mode, and the confirmation control 633 is used to obtain the screen under the screen capture area based on the screen capture area selection window 631.
- FIG. 6b is optional.
- the display device 101 may directly enter a screen capture editing mode, and acquire images under the screen capture area based on the screen capture area selected by the user.
- the display device 101 when the display device 101 receives a screen capture instruction for the display screen in the screen projection interface 410, the display device 101 takes a screen capture of the current display screen, and sends the screen capture picture to the electronic device 100, and the electronic device 100 Save the display of this screenshot.
- the above-mentioned screenshot command may be a user operation for taking a screen capture, such as a click operation on a screen capture control provided by the display device 101 , or a voice command, a remote control command, a button command, and the like.
- the display device 101 receives a screenshot instruction for the display screen in the screen projection interface 410, the display device 101 takes a screenshot of the current display screen, and the screen capture is displayed on the display interface 420 of the display device 101.
- Success notification 421 may be "the screenshot of the screen projection has been completed, and the screenshot is saved to the screen projection device", indicating that the display device 101 has sent the screen capture to the electronic device 100 (the screen projection device ).
- the electronic device 100 can view the screenshot in its own picture application.
- FIG. 4e and FIG. 4f above when the electronic device 100 receives a user operation for the gallery application 451, the electronic device 100 opens the gallery application, wherein the gallery application includes a picture 461, which is the screenshot above.
- the above-mentioned examples are all exemplified by the screen-casting video. Further, the embodiment of the present application is not limited to the screen-casting video, and various application programs may also be screen-casting, and the application interface on the electronic device 100 may also be The screen is projected onto the display device 101.
- the software systems of the electronic device 100 and the display device 101 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture.
- the embodiment of the present application takes the Android system as an example to illustrate the software architecture of the electronic device 100 .
- the Android system is only a system example of the electronic device 100 or the display device 101 in the embodiment of the present application, and the present application can also be applied to other types of operating systems, such as ios, Windows, Hongmeng, etc. limit.
- the following only uses the Android system as an example of the operating system of the electronic device 100 .
- the electronic device 100 when the electronic device 100 is projecting a screen to the display device 101, the electronic device 100 is the screen-casting device, the display device 101 is the device to be projected, and the display device 101 displays the first screen projected by the electronic device 100, The electronic device 100 may perform other tasks and display the second screen during the screen projection process.
- the electronic device 100 or the display device 101 receives a screen capture instruction for the first screen, the electronic device 100 can acquire a screen capture picture of the content projected on the display device 101, so as to improve screen capture efficiency.
- the display device 101 can display the projected screen image (i.e.
- the display device 101 can also superimpose a screen projection window on its own original display image, and the screen projection window displays the screen projection image (i.e. the first image ), the display device 101 may also display the projected screen image and its own original display image in a split-screen manner, which is not limited in this embodiment of the present application.
- FIG. 7 exemplarily shows a software structure of an electronic device 100 and a display device 101
- the electronic device 100 is a screen projection device
- the display device 101 is a device to be screened.
- the device 100 includes a screenshot event management module and a storage module
- the display device 101 includes a receiving module, a screenshot event management module and a storage module.
- the screen capture event management module is used to process the triggered screen capture event.
- step 1 the display device 101 receives a screenshot instruction through the receiving module.
- Step 2 based on the screen capture instruction, the display device 101 determines the screen capture content and obtains the screen capture picture through the screen capture event management module.
- the display device 101 saves the screenshot through a storage module of the display device 101 .
- step 3 the display device 101 sends the screenshot to the electronic device 100 .
- Step 4 the electronic device 100 receives the screenshot, and saves the screenshot through the storage module of the electronic device 100 .
- the display device 101 can directly send and store the screenshot picture to the screen projection device (electronic device 100), which improves the The screen capture efficiency of the screen mirroring device.
- the specific steps may include:
- Step S101 the electronic device 100 projects a screen on the display device 101 .
- screen projection is a service or function provided by the electronic device 100, which can support the electronic device 100 to transmit data to other devices (such as the display device 101).
- screen projection can support the electronic device 100 to connect via Bluetooth, wireless fidelity direct (Wi-Fi direct), and Wi-Fi software access point (softAP) or multiple technologies to transmit data to nearby devices.
- screen projection may support the electronic device 100 to transmit data to a device (such as the display device 101 ) in the same LAN as the electronic device 100 via a local area network (LAN).
- LAN local area network
- the device in the same local area network as the electronic device 100 may also be a device near the electronic device.
- the wireless projection protocols involved in this application include but are not limited to Digital Living Network Alliance (Digital Living Network Alliance, DLNA), AirPlay, Miracast, etc.
- the electronic device 100 and the display device 101 may perform data communication through a server, and the server may be an application server, a cloud server, a background server, and the like.
- the electronic device 100 and the display device 101 are devices logged in with the same account, or the accounts logged in by the electronic device 100 and the display device 101 are associated accounts, wherein the associated account may be an account authorized by the same account.
- the account here refers to an application account, a device account, an identity account, and the like.
- Step S102 The display device 101 displays a first picture, where the first picture includes a picture projected by the electronic device 100 onto the display device 101 .
- the electronic device 100 projects a screen on the display device 101 , and the display device 101 displays a first picture, which is the entire display screen of the display device, and the first picture includes the screen projected by the electronic device 100 on the display device 101 .
- the display device 101 can display the projection screen in full screen, and at this time the first screen is the projection screen; the display device 101 can superimpose a window on the original display screen to display the projection screen, and at this time the first screen is the entire display screen, the The first picture includes the projected screen picture; the display device 101 can also display the video content in split screens with the original display picture, such as split screens left and right, split screens up and down, and the first picture is the entire display picture at this time, and the first picture includes Cast screen.
- the above-mentioned FIG. 4a is a full-screen display projection screen
- the above-mentioned FIG. 6a is a window display projection screen.
- the electronic device 100 projects a screen on the display device 101 , the electronic device 100 can switch to any application to execute a corresponding task, and the electronic device 100 displays the second screen. In this way, the user can use the mobile phone while viewing the projected screen content through the display device 101 .
- Step S103 the display device 101 receives a screenshot instruction.
- the screen capture instruction includes a user operation for instructing the display device 101 to perform a screen capture, such as a click operation on a screen capture control provided by the display device 101, and for example, a voice command, a remote control command, a button command, a gesture, a touch screen operation (such as double-click, two-finger, three-finger slide) and so on.
- a user operation for instructing the display device 101 to perform a screen capture, such as a click operation on a screen capture control provided by the display device 101, and for example, a voice command, a remote control command, a button command, a gesture, a touch screen operation (such as double-click, two-finger, three-finger slide) and so on.
- the screenshot instruction may include a set of instructions, for example, click to take a screenshot (instruction 1) and then confirm the screenshot (instruction 2); 3), and so on.
- the screen capture instruction can also be an instruction, for example, click to capture the screen and then confirm the command to confirm the screen capture in the screen capture, and for example, click to capture the screen and then select the screen capture area and then confirm the command to confirm the screen capture in the screen capture.
- the screenshot instruction may be triggered or sent by other devices (including the electronic device 100 ).
- Step S104 Based on the screen capture instruction, the display device 101 determines the content of the screen capture and acquires a screen capture picture, where the screen capture picture includes all or part of the content of the first screen.
- the screenshot content may include the original display screen of the display device 101 itself, or a projected screen screen, or the entire display interface, or a user-defined area selected by the user, and so on.
- the display device 101 displays the screen projection picture in full screen, that is, the entire display interface of the display device 101 displays the screen projection picture, and the first picture is the screen projection picture.
- the display device 101 receives a first screen capture instruction for the screen projection, based on the first screen capture instruction, the display device 101 determines that the screen capture content is a screen projection, and the display device 100 takes a screen capture of the projection screen, A screenshot of the first screen is obtained.
- the display device receives the second screen capture instruction, and the display device 101 enters the screen capture editing mode for the first screen, and the user can select the area to be screen captured in the entire display interface (first screen), and the display device 101 Obtain a screen under the screen capture area based on the screen capture area selected by the user, that is, the electronic device obtains a screen capture picture, and the screen capture picture is all or part of the content of the first screen.
- the entire display interface of the display device 101 includes the projected screen and the original display screen of the display device 101, that is, the first screen includes the projected screen and the display device 101 The original display screen.
- the display device 101 receives a third screen capture instruction for the screen projection, based on the third screen capture instruction, the display device 101 determines that the screen capture content is a screen projection, and the display device 100 takes a screen capture of the projection screen, Obtain a screenshot of the projected screen.
- the screenshot is part of the content of the first screen.
- the display device 101 receives the fourth screen capture instruction, and the display device 101 detects that it is currently in a screen-casting state, and then determines that the content of the screen capture is a screen-casting image.
- the display device 100 takes a screenshot of the projected screen, and obtains a screenshot of the projected screen. The screenshot is part of the content of the first screen.
- the display device 101 receives the fifth screenshot instruction, and the display device 101 detects that the current display interface (displaying the first screen) includes a screen projection window or a screen projection screen based on image recognition technology, then the display device 101 determines The content of the screenshot is the screen projection.
- the display device 100 takes a screenshot of the projected screen, and obtains a screenshot of the projected screen. The screenshot is part of the content of the first screen.
- the display device 101 receives a sixth screenshot instruction for the entire display interface (displaying the first picture), based on the sixth screenshot instruction, the display device 101 determines that the screenshot content is the first picture, and the display device 100 Take a screenshot of the first frame, and obtain a screenshot of the first frame.
- the display device 101 receives the seventh screen capture instruction, and the display device 101 enters the screen capture editing mode for the first screen, and the user can select the area where the screen capture is desired in the entire display interface (the first screen), and the display The device 101 acquires the screen under the screen capture area based on the screen capture area selected by the user, that is, the display device 100 acquires the screen capture picture, and the screen capture picture is all or part of the content of the first screen.
- the display device 101 receives the eighth screen capture instruction, and the display device 101 outputs a selection window, which is used to prompt the user to select the screen capture content.
- the display device 101 performs screen capture based on the screen capture content selected by the user, and acquires a screen capture picture, where the screen capture picture is part of the content of the first screen.
- the selection window is window 621. The user can choose to take a screenshot of the original display screen of the display device 101, or choose to take a screenshot of the projected screen, or choose to take a screenshot of the entire display screen. , you can also enter the screenshot editing mode for the first screen, and take a screenshot of any selected area.
- Step S105 the display device 101 sends the screenshot to the electronic device 100 .
- the display device 101 After the display device 101 acquires the screenshot, it sends the screenshot to the screen projection device (electronic device 100).
- the display device 101 when the display device 101 detects that it is currently being projected, the display device 101 sends the screenshot to the electronic device 100 .
- the display device 101 detects that the image content of the screen shot includes a projected screen image based on an image recognition technology, and then the display device 101 sends the screen shot to the electronic device 100 .
- the display device 101 sends the screen shot to the electronic device 100 .
- the screenshot is not sent to the electronic device 100 .
- the display device 101 after the display device 101 sends the screenshot to the electronic device 100, the display device 101 outputs notification information, prompting the user that the screenshot has been sent to the screen projection device (electronic device 100).
- the display device 101 stores the screenshot.
- Step S106 the electronic device 100 receives the screenshot, and saves the screenshot. Wherein, the user may view the picture in the picture application.
- the electronic device 100 detects that the image content of the screenshot includes a projected screen image based on image recognition technology, and the display device 101 saves the screenshot.
- the display device 101 saves the screenshot.
- it is detected that the image content of the screenshot image does not include the screen projection image it will not be saved.
- the electronic device 100 after receiving the screenshot, the electronic device 100 detects that the sender of the screenshot is the screen projection device (display device 101 ) of the electronic device 100 , and the display device 101 saves the screenshot. Optionally, if it is detected that the sender of the screenshot is not the screen projection device of the electronic device 100, it will not be saved.
- the electronic device 100 after the electronic device 100 receives the screenshot, the electronic device 100 outputs notification information to remind the user that the screenshot has been received.
- the user can view the screenshot.
- the user can edit and then save the received screenshot, and the editing method includes cutting, marking, rotating, adding text, etc. to the screenshot.
- the display device 101 when the electronic device 100 is projecting the screen to the display device 101, when the display device 101 receives a screen capture instruction, the display device 101 can directly send and store the screen capture picture to the screen projection device (electronic device 100) , which improves the screen capture efficiency of the screen mirroring device.
- FIG. 9 exemplarily shows another software structure of the electronic device 100 and the display device 101
- the electronic device 100 is a screen projection device
- the display device 101 is a screen-to-be-projected device.
- the electronic device 100 includes a receiving module, a screen capture event management module and a storage module
- the display device 101 includes a screen capture event management module and a storage module.
- the screen capture event management module is used to process the triggered screen capture event.
- Step 1 the electronic device 100 receives a screenshot instruction through the receiving module.
- Step 2 requesting a screen capture from the screen capture event management module.
- Step 3 based on the screen capture instruction, the electronic device 100 sends a screen capture request to the display device 101 through the screen capture event management module.
- Step 4 based on the screen capture request, the display device 101 determines the screen capture content and acquires the screen capture picture through the screen capture event management module.
- the display device 101 saves the screenshot through a storage module of the display device 101 .
- Step 5 the display device 101 sends the screenshot to the electronic device 100 .
- Step 6 the electronic device 100 receives the screenshot, and saves the screenshot through the storage module of the electronic device 100 .
- the electronic device 100 when the electronic device 100 is projecting the screen to the display device 101, when the electronic device 100 receives a screenshot instruction for the projected screen, it can instruct the display device 101 to take a screenshot, and the display device directly sends the screenshot to the display device. It is stored in the screen projection device (electronic device 100), which improves the screen capture efficiency of the screen projection device.
- the specific steps may include:
- Step S201 The electronic device 100 projects a screen on the display device 101 .
- Step S202 The display device 101 displays a first frame, where the first frame includes a frame projected by the electronic device 100 onto the display device 101 .
- step S201 and step S202 reference may be made to the relevant description of step S101 and step S102 above, and details are not repeated here.
- Step S203 the electronic device 100 receives a screenshot instruction.
- the screen capture instruction includes a user operation for instructing the electronic device 100 to take a screen capture, such as a click operation on a screen capture control provided by the electronic device 100 , and for example, a voice command, remote control command, button command, gesture, etc. for screen capture.
- Step S204 the electronic device 100 sends a screenshot request to the display device 101 .
- the screen capture instruction is a screen capture instruction for the display screen of the screen projection device, and is used to obtain a screenshot of the display screen of the screen projection device. Then the electronic device 100 sends a screenshot request to the display device 101 .
- the screen capture instruction is a screen capture instruction for the screen projection screen, and is used to obtain a screenshot of the screen projection screen of the screen projection device. Then the electronic device 100 sends a screenshot request to the display device 101 .
- the screen capture request includes a time stamp
- the electronic device 100 receives the screen capture instruction and records the current standard time as the first moment, then the electronic device 100 sends a time stamp with the time stamp of the first time to the display device 101.
- Screenshot request based on the first moment, the display device 101 may take a screenshot of the screen displayed by the display device 101 at the first moment.
- the electronic device 100 and the display device 101 may perform time calibration during screen projection, so as to confirm that the time of the electronic device 100 and the display device 101 are consistent.
- the time stamp is the current standard time.
- the time stamp may also be a video playback time point.
- the electronic device 100 receives the screen capture instruction, it determines that the current video playback time point is the first time point, and then the electronic device 100 sends a screen capture request with a time stamp of the first time point to the display device 101, and the display device 101 based on the first time point
- a screenshot may be taken of the video screen at the first point in time.
- the screenshot request may also include a page identifier, which indicates the specific content in the document. The number of pages, the number of pictures and other information.
- the electronic device 100 receives the screen capture instruction, it determines the page ID of the current screen projection, and the electronic device 100 sends a screen capture request with the page ID to the display device 101. Based on the page ID, the display device 101 can perform a screen capture on the screen corresponding to the page ID. screenshot.
- Step S205 Based on the received screen capture request, the display device 101 determines screen capture content and acquires a screen capture picture, where the screen capture picture includes all or part of the content of the first screen.
- Step S206 the display device 101 sends the screenshot to the electronic device 100 .
- Step S207 the electronic device 100 receives the screenshot, and saves the screenshot. Wherein, the user may view the picture in the picture application.
- steps S205 to S207 reference may be made to relevant descriptions of steps S104 to S106 above, which will not be repeated here.
- the electronic device 100 when the electronic device 100 is projecting the screen to the display device 101, when the electronic device 100 receives a screenshot instruction for the display screen of the projection device, the electronic device 100 can instruct the display device 101 to take a screenshot, Then the display device 101 sends and stores the screenshot picture to the screen projection device (electronic device 100 ), which improves the screen capture efficiency of the screen projection device.
- the user casts the video content on the mobile phone (electronic device 100) to the display device 101, and the display device 101 displays the projected screen.
- the user can use the mobile phone to exit the video playback interface , using other applications, such as using messaging software to chat with friends.
- the user can trigger a screenshot command on the display device 101, and the display device 101 takes a screenshot of the display interface and sends the screenshot to the electronic device; 100 triggers a screenshot instruction for the display interface of the display device 101, the electronic device 100 instructs the display device 101 to take a screenshot, and the display device 101 takes a screenshot of the display interface and sends the screenshot picture to the electronic device.
- the problem that the electronic device 100 cannot acquire the screenshot of the screen-casting screen during the screen-casting process is solved.
- the user can trigger a screen capture instruction for the screen projection screen on the electronic device 100, and the electronic device 100 takes a screen capture of the screen projection interface, acquires and saves the screen projection screen.
- the electronic device can keep the previously used application program in the multi-task queue as a background application program, and keep it in the multi-task queue. Background applications in the queue can remain running.
- Running an application on the electronic device 100 is to start a task, and a task includes one or more activities.
- an activity is an application program component for realizing the interaction between the electronic device 100 and the user, an activity provides an application interface, and the electronic device 100 can respond based on events triggered by the user in the application interface.
- a task stack includes one or more activities.
- the electronic device 100 runs an application program and starts the task stack of the application program.
- a new activity activity1
- Activity stack top activity1 is displayed at the forefront of the display screen and is at the top of the task stack (Activity stack top )
- activity1 is in an active state (active/running) that is visible and can interact with the user; as shown in Figure 11, when the electronic device 100 receives a user operation, it needs to display a new application interface, when the new activity ( When activity2) is started to be pushed into the stack, the activity1 that was originally at the top of the stack will be pushed into the second layer of the stack, and activity2 will be placed at the top of the task stack, and activity2 is now active.
- activity2 is a non-full-screen application interface or a transparent application interface, that is, activity2 does not completely cover activity1.
- activity1 is in a paused state (Paused), and activity1 still maintains all data and is visible on the display screen, but it can no longer communicate with it. The user interacts. If activity2 completely covers activity1, then activity1 is in a stopped state (Stopped), and activity1 keeps all data but is not visible on the display. Among them, the activity in the terminated state cannot be activated again. When an application is closed, all activities in the application's task stack are also terminated.
- the electronic device 100 projects the screen on the display device 101, and the electronic device 100 displays the screen projection interface.
- the electronic device 100 can switch to other application interfaces, and the electronic device 100 can run in the background mode.
- the electronic device 100 does not display the screen casting content.
- the activity corresponding to the screen projection interface is active. is paused or stopped. In this case, the electronic device 100 cannot obtain the playing progress of the projected screen in real time.
- the electronic device 100 may also display a screen projection window in the form of a picture-in-picture, and the screen projection window displays a screen projection image, and the screen projection window is displayed on any application interface without interfering with the application interface.
- the screen projection window 351 is displayed on any application interface.
- the screen projection window can be realized by a series of playback components (such as videoview components).
- the display interface of the screen projection window can also be referred to as an interface correspondingly implemented by an activity.
- the electronic device 100 can display the screen-casting picture in real time and acquire the playing progress of the screen-casting picture.
- step S301 the electronic device 100 projects a first picture on the display device 101 .
- the display device 101 displays a first picture, where the first picture includes a picture projected by the electronic device 100 onto the display device 101 .
- the first picture includes a picture projected by the electronic device 100 onto the display device 101 .
- Step S302 The electronic device 100 runs the first screen corresponding to the first activity in the background, and displays the second screen corresponding to the second activity on the display screen.
- the first picture and the second picture are different pictures.
- the electronic device 100 displays the first picture corresponding to the first activity in a picture-in-picture form, and displays the second picture corresponding to the second activity on the display screen. Wherein, the picture-in-picture window is displayed on the second picture.
- the electronic device 100 projects a screen on the display device 101, and the display device 101 displays a projected screen, and the first screen is the projected screen.
- the electronic device 100 can switch to another application interface (the second screen corresponding to the second activity), and the electronic device 100 can run the screen projection application in the background mode, that is, run the second screen application corresponding to the first activity in the background.
- the electronic device 100 does not display the screen projection screen.
- the electronic device 100 may also display a screen projection window in the form of a picture-in-picture.
- the screen projection window is displayed on any application interface (the second screen corresponding to the second activity).
- Screen image that is, run the first image corresponding to the first activity in the form of picture-in-picture, such as the interface shown in FIG. 3e or FIG. 3f above, and the screen projection window 351 is displayed on any application interface.
- Step S303 The electronic device 100 receives a screenshot instruction for the first frame.
- the screen capture instruction includes a user operation for instructing the electronic device 100 to perform a screen capture, such as a click operation of a screen capture control provided by the electronic device 100, and for example, a voice command, a remote control command, a button command, a gesture, a touch screen operation (such as double-click, two-finger, three-finger slide) and so on.
- a user operation for instructing the electronic device 100 to perform a screen capture, such as a click operation of a screen capture control provided by the electronic device 100, and for example, a voice command, a remote control command, a button command, a gesture, a touch screen operation (such as double-click, two-finger, three-finger slide) and so on.
- the screenshot instruction may include a set of instructions, for example, click to take a screenshot (instruction 1) and then confirm the screenshot (instruction 2); 3), and so on.
- the screen capture instruction can also be an instruction, for example, click to capture the screen and then confirm the command to confirm the screen capture in the screen capture, and for example, click to capture the screen and then select the screen capture area and then confirm the command to confirm the screen capture in the screen capture.
- the screenshot instruction may be triggered or sent by other devices (including the display device 101 ).
- Step S304 In response to the received screen capture instruction, the electronic device 100 obtains a screen capture picture, where the screen capture picture includes all or part of the content of the first screen.
- the electronic device 100 can control the playback progress, playback volume, etc. of the first video on the display device 101 in the screencasting interface.
- the electronic device 100 switches the screen projection interface to the application interface of other application programs, it does not affect the playing of the first video on the display device 101 .
- the electronic device 100 records the moment when the screen projection interface is switched to another application interface as the first moment, and the playing progress time point of the first video is the first time point.
- the electronic device 100 and the display device 101 may perform time calibration during screen projection, so as to confirm that the time of the electronic device 100 and the display device 101 are consistent.
- the electronic device 100 determines that the time when the screenshot instruction is received is the second moment, and the electronic device 100 determines that the second moment is the same as the first moment.
- the time difference of the moment based on the time difference and the first time point, it is determined that the current playback progress time point of the first video is the second time point.
- the electronic device 100 acquires the video frame of the first video at the second time point as a screenshot, and the electronic device 100 acquires the screenshot.
- the screen capture instruction received by the electronic device 100 includes a timestamp, and when the electronic device 100 receives the screen capture instruction for the projected screen when displaying the other application interface, the electronic device 100 determines the timestamp and the time stamp at the first moment. A time difference, based on the time difference and the first time point, it is determined that the current playback progress time point of the first video is the second time point. The electronic device 100 acquires the video frame of the first video at the second time point as a screenshot, and the electronic device 100 acquires the screenshot.
- the electronic device 100 determines the current playback progress of the first video, and the electronic device 100 obtains the current playback progress of the first video.
- the video image is used as a screenshot, and the electronic device 100 acquires the screenshot.
- the screenshot instruction received by the electronic device 100 includes a playback time point, the electronic device 100 determines the video frame of the first video at the playback time point as the screenshot based on the screenshot instruction, and the electronic device 100 obtains the screenshot.
- the electronic device 100 receives the screen capture instruction, and the electronic device 100 enters the screen capture editing mode for the screen projection screen, and the user can select the area where the screen capture is desired in the screen projection screen (the first screen), and the electronic device 100 The screen under the screen capture area is acquired based on the screen capture area selected by the user, that is, the electronic device 100 acquires a screen capture picture, and the screen capture picture is all or part of the content of the first screen.
- the screenshot instruction may also include a page identifier, which indicates the specific content in the document. The number of pages, the number of pictures and other information.
- the electronic device 100 receives the screenshot instruction, and based on the page identifier, may take a screenshot of the screen corresponding to the page identifier.
- the electronic device 100 can also directly take a screen capture.
- the electronic device 100 receives a screen capture operation for the screen projection , the electronic device 100 takes a screenshot of the screencasting image being played in the screencasting window, and obtains the screencasting image.
- the electronic device 100 may send a screenshot request to the display device 101 to instruct the display device 101 to take a screenshot of the first screen, so as to obtain the screenshot.
- the electronic device 100 may send a screenshot request to the display device 101 to instruct the display device 101 to take a screenshot of the first screen, so as to obtain the screenshot.
- Step S305 the electronic device 100 saves the screenshot. Wherein, the user may view the picture in the picture application.
- the electronic device 100 after the electronic device 100 receives the screenshot, the electronic device 100 outputs notification information to remind the user that the screenshot has been received.
- the user can view the screenshot.
- the user can edit and then save the received screenshot, and the editing method includes cutting, marking, rotating, adding text, etc. to the screenshot.
- all or part of them may be implemented by software, hardware, firmware or any combination thereof.
- software When implemented using software, it may be implemented in whole or in part in the form of a computer program product.
- the computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application will be generated in whole or in part.
- the computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable devices.
- the computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website, computer, server or data center Transmission to another website site, computer, server, or data center by wired (eg, coaxial cable, optical fiber, DSL) or wireless (eg, infrared, wireless, microwave, etc.) means.
- the computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server or a data center integrated with one or more available media.
- the available media may be magnetic media (eg, floppy disk, hard disk, magnetic tape), optical media (eg, DVD), or semiconductor media (eg, solid state hard disk), etc.
- the processes can be completed by computer programs to instruct related hardware.
- the programs can be stored in computer-readable storage media.
- When the programs are executed may include the processes of the foregoing method embodiments.
- the aforementioned storage medium includes: ROM or random access memory RAM, magnetic disk or optical disk, and other various media that can store program codes.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Telephone Function (AREA)
Abstract
公开了一种截屏方法及相关装置,其特征在于,所述方法包括:第一电子设备显示第二电子设备投屏的第一画面,当第一电子设备接收到针对于该第一画面的截屏指令,第一电子设备获取该第一画面的截图并将该第一画面的截图发送到第二电子设备,第二电子设备保存该第一画面的截图,其中,该截屏指令可以是第二电子设备发送给第一电子设备的。这样,实现了在投屏的情况下,直接将截屏画面存放到投屏设备(第二电子设备),提升了投屏设备的截屏效率。
Description
本申请要求于2021年11月25日提交中国专利局、申请号为202111418031.5、申请名称为“一种截屏方法及相关装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请涉及电子技术领域,尤其涉及一种截屏方法及相关装置。
截屏功能是移动终端最为实用的功能之一,其满足了用户在不同场景中截取当前屏幕信息的需求,用户通过截屏功能可以保存屏幕信息用于后续学习或便于记忆,也可以将截屏图片发送给其他设备用于分享。当前的截屏技术可以在智能设备自身通过指令或操作进行截屏,但是随着分布式场景的发展,越来越多的视频流转场景(例如投屏场景)下,跨设备间的截屏需求也越来越多。
因此,如何实现快速便捷的跨设备截屏以提升用户体验是本领域技术人员正在研究的问题。
发明内容
本申请实施例提供了一种截屏方法及相关装置,可以在投屏的情况下对被投屏设备的投屏内容截屏,并直接将截屏画面存放到投屏设备,提升截屏效率。
第一方面,本申请提供了一种截屏系统,该系统包括:第一电子设备和第二电子设备,
第一电子设备,用于显示第一画面,第一画面包括第二电子设备投屏到第一电子设备上的投屏画面;
第一电子设备,还用于接收到针对于第一画面的截屏指令;
第一电子设备,还用于基于截屏指令对第一画面进行截屏,获取截屏图片,截屏图片包括第一画面的全部或部分内容;
第一电子设备,还用于将截屏图片发送到第二电子设备;
第二电子设备,用于保存截屏图片。
本申请实施例,第二电子设备在第一电子设备上投屏,则第二电子设备可以称为投屏设备(如下述的电子设备100),第二电子设备可以称为被投屏设备(如下述的显示设备101)。在一些实施例中,第一电子设备显示第二电子设备投屏的第一画面,当第一电子设备接收到针对于该第一画面的截屏指令,第一电子设备获取该第一画面的截图并将该第一画面的截图发送到第二电子设备,第二电子设备保存该第一画面的截图。这样,实现了在投屏的情况下,直接将截屏画面存放到投屏设备,提升投屏设备的截屏效率。
在一些实施例中,第一电子设备接收到的截屏指令可以是第二电子设备发送的。第一电子设备显示第二电子设备投屏的第一画面,当第二电子设备接收到针对于该第一画面的截屏指令,第二电子设备向第一电子设备发送截屏指令,指示第一电子设备对第一画面进行截屏,第一电子设备获取该第一画面的截图并将该第一画面的截图发送到第二电子设备,第二电子 设备保存该第一画面的截图。这样,实现了在投屏的情况下,直接将截屏画面存放到投屏设备,提升投屏设备的截屏效率。
第二方面,本申请提供了一种截屏方法,该方法包括:第一电子设备显示第一画面,第一画面包括第二电子设备投屏到第一电子设备上的投屏画面;第一电子设备接收到针对于第一画面的截屏指令;第一电子设备基于截屏指令对第一画面进行截屏,获取截屏图片,截屏图片包括第一画面的全部或部分内容;第一电子设备发送截屏图片给第二电子设备。
本申请实施例,第一电子设备显示第二电子设备投屏的第一画面,当第一电子设备接收到针对于该第一画面的截屏指令,第一电子设备获取该第一画面的截图并将该第一画面的截图发送到第二电子设备,第二电子设备保存该第一画面的截图。这样,实现了在投屏的情况下,直接将截屏画面存放到投屏设备,提升投屏设备的截屏效率。
结合第二方面,在一种可能的实现方式中,截屏指令是第二电子设备发送的。
结合第二方面,在一种可能的实现方式中,第一电子设备接收到针对于第一画面的截屏指令,之前还包括:第一电子设备确定第一画面中的截屏区域,截屏指令为针对于截屏区域的指令。第二电子设备在第一电子设备上投屏,第一电子设备显示第一画面,该第一画面即为显示设备的整个显示画面,第一画面包括第二电子设备投屏到第一电子设备上的画面。其中,第一电子设备可以全屏显示投屏画面,此时第一画面为投屏画面;第一电子设备可以在原本显示画面上叠加一个窗口显示投屏画面,此时第一画面为整个显示画面,该第一画面中包括投屏画面;第一电子设备也可以是和原本显示画面分屏显示视频内容,例如左右分屏、上下分屏,此时第一画面为整个显示画面,该第一画面中包括投屏画面。
截屏区域可以包括第一电子设备自身的原本显示画面,或者是投屏画面,或者是整个显示界面,或者是用户选择的自定义区域,等等。
在一种可能的实现方式中,第一电子设备确定第一画面中的截屏区域,包括:第一电子设备接收到针对于第一画面的截屏触发操作;响应于截屏触发操作,第一电子设备输出截屏区域选择窗口,截屏区域选择窗口中包括两个或两个以上的截屏区域选项;第一电子设备基于接收到的针对于截屏区域选择窗口中其中一个截屏区域选项的用户操作,确定第一画面中的截屏区域。其中,截屏区域选项包括整个显示画面进行截屏,也可以进入针对于第一画面的截屏编辑模式,对选择任意区域进行截屏。
在一种可能的实现方式中,可以在第二电子设备上输出截屏区域选择窗口,用户在第二电子设备上选择截屏区域,第二电子设备向第一电子设备发送针对于该截屏区域的截屏指令。
可选的,第二电子设备接收到针对于第一画面的截屏触发操作;响应于截屏触发操作,第二电子设备输出截屏区域选择窗口,第一电子设备基于接收到的针对于截屏区域选择窗口中其中一个截屏区域选项的用户操作,确定第一画面中的截屏区域。第二电子设备向第一电子设备发送针对于该截屏区域的截屏指令。
结合第二方面,在一种可能的实现方式中,第一电子设备基于截屏指令对第一画面进行截屏,获取截屏图片,包括:第一电子设备基于截屏指令,通过图像识别技术识别出第一画面包括投屏窗口或投屏画面;第一电子设备获取截屏图片,截屏图片包括投屏画面或投屏窗口中的画面。这样无需用户进行选择,提高截屏效率。
结合第二方面,在一种可能的实现方式中,第一电子设备基于截屏指令对第一画面进行截屏,获取截屏图片,包括:基于截屏指令,若第一电子设备检测到自身处于投屏状态,第一电子设备获取截屏图片,截屏图片包括投屏画面或投屏窗口中的画面。这样无需用户进行选择,提高截屏效率。
结合第二方面,在一种可能的实现方式中,第一电子设备发送截屏图片给第二电子设备,之后还包括:第一电子设备保存截屏图片;第一电子设备显示截屏图片。
结合第二方面,在一种可能的实现方式中,第一电子设备保存截屏图片,包括:第一电子设备通过图像识别技术识别出截屏图片包括投屏画面,第一电子设备保存截屏图片。这样,可以过滤掉非投屏画面的截屏图片,节约存储资源。
第三方面,本申请提供了一种截屏方法,该方法包括:第二电子设备后台运行第一activity对应的第一画面,在显示屏上显示第二activity对应的第二画面;第二电子设备接收到针对于第一画面的截屏指令;响应于截屏指令,第二电子设备获取截屏图片,截屏图片包括第一画面的全部或部分内容。
本申请实施例,第二电子设备接收到针对于第一画面的截屏指令,第二电子设备可以获取到后台运行的第一画面的截屏图片。可选的,第一画面可以是以画中画形式显示在第二画面之上,第二电子设备对第一画面进行截屏,获取到该第一画面的截屏图片。
结合第三方面,在一种可能的实现方式中,第一画面为投屏到第一电子设备上的投屏画面。第二电子设备在第一电子设备上投屏,第一电子设备显示投屏画面,第一画面即为投屏画面。在投屏过程中,第二电子设备可以切换到其他应用界面(第二activity对应的第二画面),第二电子设备可以以后台运行的方式运行投屏应用,即通过后台运行第一activity对应的第一画面。可选的,第二电子设备还可以以画中画的形式显示一个投屏窗口,投屏窗口显示在任意的应用界面(第二activity对应的第二画面)之上,该投屏窗口中显示投屏画面,即通过画中画的形式运行第一activity对应的第一画面。
当第二电子设备接收到针对于第一画面的截屏指令,第二电子设备可以截取到后台运行的第一画面的截屏图片;或者截取到以画中画形式播放的第一画面的截屏图片;或者第二电子设备可以指示第一电子设备对第一画面进行截图,第二电子设备获取到第一电子设备截取到的第一画面的截屏图片。
结合第三方面,在一种可能的实现方式中,截屏指令是第一电子设备发送的。
结合第三方面,在一种可能的实现方式中,第二电子设备接收到针对于第一画面的截屏指令,之前还包括:第二电子设备确定第一画面中的截屏区域,截屏指令为针对于截屏区域的指令。截屏区域可以包括整个投屏画面(第一画面),或者是部分投屏画面(第一画面的部分内容),或者是用户选择的自定义区域,等等。
结合第三方面,在一种可能的实现方式中,截屏指令中包括时间戳或页面标识,时间戳或页面标识对应的页面为第一画面。示例性的,当第二电子设备在第一电子设备上投屏的内容为视频时,则截屏指令中可以包括时间戳以确定截取的视频画面;当第二电子设备在第一电子设备上投屏的内容为文档时,则截屏指令中可以包括页面标识以确定截取的页面。
结合第三方面,在一种可能的实现方式中,方法还包括:第二电子设备保存截屏图片;第二电子设备显示截屏图片。
结合第三方面,在一种可能的实现方式中,第二电子设备保存截屏图片,包括:第二电子设备获取到截屏图片之后,输出通知信息,通知信息用于提示用户已获取到截屏图片;第二电子设备接收到针对于通知信息的用户操作;响应于用户操作,第二电子设备提供针对于截屏图片的编辑方式;第二电子设备保存编辑后的截屏图片。
第四方面,本申请提供了一种电子设备,包括:一个或多个处理器、一个或多个存储器;该一个或多个存储与一个或多个处理器耦合;该一个或多个存储器用于存储计算机程序代码,该计算机程序代码包括计算机指令;当该计算机指令在该处理器上运行时,使得该电子设备 执行上述任一方面任一种可能的实现方式中的截屏方法。
第五方面,本申请实施例提供了一种计算机存储介质,包括计算机指令,当计算机指令在电子设备上运行时,使得通信装置执行上述任一方面任一项可能的实现方式中的截屏方法。
第六方面,本申请实施例提供了一种计算机程序产品,当计算机程序产品在计算机上运行时,使得计算机执行上述任一方面任一项可能的实现方式中的截屏方法。
图1为本申请实施例提供的一种截屏方法的系统架构示意图;
图2a为本申请实施例提供的一种电子设备的硬件结构示意图;
图2b为本申请实施例提供的一种显示设备的硬件架构示意图;
图3a~图3f为本申请实施例提供的一组应用界面示意图;
图4a~图4f为本申请实施例提供的又一组应用界面示意图;
图5a~图5c为本申请实施例提供的又一组应用界面示意图;
图6a~图6c为本申请实施例提供的又一组应用界面示意图;
图7为本申请实施例提供的一种截屏方法的软件模块图;
图8为本申请实施例提供的一种截屏方法的方法流程图;
图9为本申请实施例提供的又一种截屏方法的软件模块图;
图10为本申请实施例提供的又一种截屏方法的方法流程图;
图11为本申请实施例提供的一种截屏方法的技术原理图;
图12为本申请实施例提供的又一种截屏方法的方法流程图。
下面将结合附图对本申请实施例中的技术方案进行地描述。其中,在本申请实施例的描述中,除非另有说明,“/”表示或的意思,例如,A/B可以表示A或B;文本中的“和/或”仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况,另外,在本申请实施例的描述中,“多个”是指两个或多于两个。
以下,术语“第一”、“第二”仅用于描述目的,而不能理解为暗示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征,在本申请实施例的描述中,除非另有说明,“多个”的含义是两个或两个以上。术语“中间”、“左”、“右”、“上”、“下”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本申请和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本申请的限制。
本申请实施例中涉及的电子设备可以是手机、平板电脑、桌面型、膝上型、笔记本电脑、超级移动个人计算机(Ultra-mobile Personal Computer,UMPC)、手持计算机、上网本、个人数字助理(Personal Digital Assistant,PDA)、虚拟现实设备、PDA(Personal Digital Assistant,个人数字助手,又称为掌上电脑)、便携式互联网设备、数据存储设备、车机、车载终端(例如智慧屏、车载摄像头、显示屏)、可穿戴设备(例如,无线耳机、智能手表、智能手环、智能眼镜、头戴式设备(Head-mounted display,HMD)、电子衣物、电子手镯、电子项链、电子 配件、电子纹身和智能镜子)等等。
在本申请实施例涉及到的一些场景中,用户可以使用手机将想要观看的视频投屏到电脑端,以获取更佳的观看体验,并且投屏过程中用户可以使用手机执行其他任务,例如切换到聊天软件和朋友聊天,打电话等等。这样,用户可以一边通过电脑观看视频,一边使用手机。若用户想要对正在投屏的视频画面进行截屏并通过手机分享给朋友,用户可以在电脑端对投屏的视频画面进行截屏获取到截屏画面,此时该截屏画面会保存在电脑本地,用户需要在电脑上把该截屏画面发送给手机进行分享。这一系列操作效率较低。或者,用户可以在手机上对视频画面进行截屏,但这需要将手机从其他应用界面切换到视频播放界面,打断了手机正在执行的其他任务。
本申请实施例提供了一种截屏方法,可以在投屏的情况下对被投屏设备的投屏内容截屏,并直接将截屏画面存放到投屏设备,提升截屏效率。
其中,投屏是电子设备提供的一种服务或功能,可以支持电子设备传输数据至其他设备。在一些实施例中,投屏可支持该电子设备通过蓝牙、无线保真直连(wireless fidelity direct,Wi-Fi direct)、Wi-Fi软件接入点(software access point,softAP)中的一项或多项等技术传输数据至附近设备。在另一些实施例中,投屏可支持该电子设备通过局域网(LAN)传输数据至与该电子设备处于同一个局域网内的设备(例如其他电子设备)。其中,与该电子设备处于同一个局域网内的设备也可以是该电子设备附近的设备。其中,本申请涉及到的无线投屏协议包括但不限于数字生活网络联盟(Digital Living Network Alliance,DLNA)、AirPlay、Miracast等。
图1示例性示出了本申请提供的一种系统图。
如图1所示,该系统可以包括电子设备100和显示设备101。电子设备100和显示设备101可以通过有线或无线通信方式连接,无线通信方式例如可以包括蓝牙(blue tooth,BT)、近场通信(near field communication,NFC)、无线保真(wireless fidelity,WiFi)、或WiFi直连。其中,显示设备101包括电视、电脑、平板、iPad、手机、车机、车载终端、跑步机等具有显示屏的电子设备。
在一些实施例中,电子设备100和显示设备101可以通过服务器进行数据通信,服务器可以是应用服务器、云服务器、后台服务器等等。
在一些实施例中,电子设备100和显示设备101为登录了同一账号的设备,或者电子设备100和显示设备101登陆的账户互为关联账户,其中,关联账户可以为被同一账户授权的账户。可选的,这里的账户指的可以是应用账户、设备账户、身份账户等等。
本申请实施例,电子设备100在显示设备101上投屏,则电子设备100可以称为投屏设备,电子设备100可以称为被投屏设备。在一些实施例中,显示设备101显示电子设备100投屏的第一画面,当显示设备101接收到针对于该第一画面的截屏指令,显示设备101获取该第一画面的截图并将该第一画面的截图发送到电子设备100,电子设备100保存该第一画面的截图。这样,实现了在投屏的情况下,直接将截屏画面存放到投屏设备,提升投屏设备的截屏效率。
在一些实施例中,显示设备101显示电子设备100投屏的第一画面,当电子设备100接收到针对于该第一画面的截屏指令,电子设备100向显示设备101发送指令,指示显示设备101对第一画面进行截屏,显示设备101获取该第一画面的截图并将该第一画面的截图发送 到电子设备100,电子设备100保存该第一画面的截图。这样,实现了在投屏的情况下,直接将截屏画面存放到投屏设备,提升投屏设备的截屏效率。
下面首先介绍本申请实施例中涉及的电子设备100。
参见图2a,图2a示出了本申请实施例提供的示例性电子设备100的结构示意图。
电子设备100可以包括处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,传感器模块180,按键190,马达191,指示器192,摄像头193,显示屏194,以及用户标识模块(subscriber identification module,SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A,陀螺仪传感器180B,气压传感器180C,磁传感器180D,加速度传感器180E,距离传感器180F,接近光传感器180G,指纹传感器180H,温度传感器180J,触摸传感器180K,环境光传感器180L,骨传导传感器180M等。
可以理解的是,本申请实施例示意的结构并不构成对电子设备100的具体限定。在本申请另一些实施例中,电子设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
其中,控制器可以是电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了系统的效率。
在一些实施例中,处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。
I2C接口是一种双向同步串行总线,包括一根串行数据线(serial data line,SDA)和一根串行时钟线(derail clock line,SCL)。在一些实施例中,处理器110可以包含多组I2C总线。处理器110可以通过不同的I2C总线接口分别耦合触摸传感器180K,充电器,闪光灯,摄像头193等。例如:处理器110可以通过I2C接口耦合触摸传感器180K,使处理器110与触摸传感器180K通过I2C总线接口通信,实现电子设备100的触摸功能。
I2S接口可以用于音频通信。在一些实施例中,处理器110可以包含多组I2S总线。处理 器110可以通过I2S总线与音频模块170耦合,实现处理器110与音频模块170之间的通信。在一些实施例中,音频模块170可以通过I2S接口向无线通信模块160传递音频信号,实现通过蓝牙耳机接听电话的功能。
PCM接口也可以用于音频通信,将模拟信号抽样,量化和编码。在一些实施例中,音频模块170与无线通信模块160可以通过PCM总线接口耦合。在一些实施例中,音频模块170也可以通过PCM接口向无线通信模块160传递音频信号,实现通过蓝牙耳机接听电话的功能。所述I2S接口和所述PCM接口都可以用于音频通信。
UART接口是一种通用串行数据总线,用于异步通信。该总线可以为双向通信总线。它将要传输的数据在串行通信与并行通信之间转换。在一些实施例中,UART接口通常被用于连接处理器110与无线通信模块160。例如:处理器110通过UART接口与无线通信模块160中的蓝牙模块通信,实现蓝牙功能。在一些实施例中,音频模块170可以通过UART接口向无线通信模块160传递音频信号,实现通过蓝牙耳机播放音乐的功能。
MIPI接口可以被用于连接处理器110与显示屏194,摄像头193等外围器件。MIPI接口包括摄像头串行接口(camera serial interface,CSI),显示屏串行接口(display serial interface,DSI)等。在一些实施例中,处理器110和摄像头193通过CSI接口通信,实现电子设备100的拍摄功能。处理器110和显示屏194通过DSI接口通信,实现电子设备100的显示功能。
GPIO接口可以通过软件配置。GPIO接口可以被配置为控制信号,也可被配置为数据信号。在一些实施例中,GPIO接口可以用于连接处理器110与摄像头193,显示屏194,无线通信模块160,音频模块170,传感器模块180等。GPIO接口还可以被配置为I2C接口,I2S接口,UART接口,MIPI接口等。
USB接口130是符合USB标准规范的接口,具体可以是Mini USB接口,Micro USB接口,USB Type C接口等。USB接口130可以用于连接充电器为电子设备100充电,也可以用于电子设备100与外围设备之间传输数据。也可以用于连接耳机,通过耳机播放音频。该接口还可以用于连接其他电子设备,例如AR设备等。
可以理解的是,本申请实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对电子设备100的结构限定。在本申请另一些实施例中,电子设备100也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
充电管理模块140用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块140可以通过USB接口130接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块140可以通过电子设备100的无线充电线圈接收无线充电输入。充电管理模块140为电池142充电的同时,还可以通过电源管理模块141为电子设备供电。
电源管理模块141用于连接电池142,充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入,为处理器110,内部存储器121,外部存储器,显示屏194,摄像头193,和无线通信模块160等供电。电源管理模块141还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块141也可以设置于处理器110中。在另一些实施例中,电源管理模块141和充电管理模块140也可以设置于同一个器件中。
电子设备100的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。电子设备100中的每个天线可用于覆盖单 个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中,移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后,被传递给应用处理器。应用处理器通过音频设备(不限于扬声器170A,受话器170B等)输出声音信号,或通过显示屏194显示图像或视频。在一些实施例中,调制解调处理器可以是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器110,与移动通信模块150或其他功能模块设置在同一个器件中。
无线通信模块160可以提供应用在电子设备100上的包括UWB,无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,WiFi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
在一些实施例中,电子设备100的天线1和移动通信模块150耦合,天线2和无线通信模块160耦合,使得电子设备100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobile communications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),长期演进(long term evolution,LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system,GPS),全球导航卫星系统(global navigation satellite system,GLONASS),北斗卫星导航系统(beidou navigation satellite system,BDS),准天顶卫星系统(quasi-zenith satellite system,QZSS)和/或星基增强系统(satellite based augmentation systems,SBAS)。
电子设备100通过GPU,显示屏194,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏194和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像,视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode 的,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot light emitting diodes,QLED)等。在一些实施例中,电子设备100可以包括1个或N个显示屏194,N为大于1的正整数。
在本申请的一些实施例中,显示屏194中显示有系统当前输出的界面内容。例如,界面内容为即时通讯应用提供的界面。
电子设备100可以通过ISP,摄像头193,视频编解码器,GPU,显示屏194以及应用处理器等实现拍摄功能。
ISP用于处理摄像头193反馈的数据。例如,拍照时,打开快门,光线通过镜头被传递到摄像头感光元件上,光信号转换为电信号,摄像头感光元件将所述电信号传递给ISP处理,转化为肉眼可见的图像。ISP还可以对图像的噪点,亮度进行算法优化。ISP还可以对拍摄场景的曝光,色温等参数优化。在一些实施例中,ISP可以设置在摄像头193中。
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例中,电子设备100可以包括1个或N个摄像头193,N为大于1的正整数。
数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其他数字信号。例如,当电子设备100在频点选择时,数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。电子设备100可以支持一种或多种视频编解码器。这样,电子设备100可以播放或录制多种编码格式的视频,例如:动态图像专家组(moving picture experts group,MPEG)1,MPEG2,MPEG3,MPEG4等。
NPU为神经网络(neural-network,NN)计算处理器,通过借鉴生物神经网络结构,例如借鉴人脑神经元之间传递模式,对输入信息快速处理,还可以不断的自学习。通过NPU可以实现电子设备100的智能认知等应用,例如:图像识别,人脸识别,语音识别,文本理解等。
外部存储器接口120可以用于连接外部存储卡,例如Micro SD卡,实现扩展电子设备100的存储能力。外部存储卡通过外部存储器接口120与处理器110通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器121可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令,从而执行电子设备100的各种功能应用以及数据处理。内部存储器121可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储电子设备100使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器121可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。
电子设备100可以通过音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
音频模块170用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中,音频模块170可以设置于处理器110中,或将音频模块170的部分功能模块设置于处理器110 中。
扬声器170A,也称“喇叭”,用于将音频电信号转换为声音信号。电子设备100可以通过扬声器170A收听音乐,或收听免提通话。
受话器170B,也称“听筒”,用于将音频电信号转换成声音信号。当电子设备100接听电话或语音信息时,可以通过将受话器170B靠近人耳接听语音。
麦克风170C,也称“话筒”,“传声器”,用于将声音信号转换为电信号。当拨打电话或发送语音信息时,用户可以通过人嘴靠近麦克风170C发声,将声音信号输入到麦克风170C。电子设备100可以设置至少一个麦克风170C。在另一些实施例中,电子设备100可以设置两个麦克风170C,除了采集声音信号,还可以实现降噪功能。在另一些实施例中,电子设备100还可以设置三个,四个或更多麦克风170C,实现采集声音信号,降噪,还可以识别声音来源,实现定向录音功能等。
耳机接口170D用于连接有线耳机。耳机接口170D可以是USB接口130,也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform,OMTP)标准接口,美国蜂窝电信工业协会(cellular telecommunications industry association of the USA,CTIA)标准接口。
压力传感器180A用于感受压力信号,可以将压力信号转换成电信号。在一些实施例中,压力传感器180A可以设置于显示屏194。在本申请一些可选的实施例中,压力传感器180A可用于捕获用户手指部位接触显示屏时生成的压力值,并将该压力值传输给处理器,以使得处理器识别用户通过哪个手指部位输入用户操作。
压力传感器180A的种类很多,如电阻式压力传感器,电感式压力传感器,电容式压力传感器等。电容式压力传感器可以是包括至少两个具有导电材料的平行板。当有力作用于压力传感器180A,电极之间的电容改变。电子设备100根据电容的变化确定压力的强度。当有触摸操作作用于显示屏194,电子设备100根据压力传感器180A检测所述触摸操作强度。电子设备100也可以根据压力传感器180A的检测信号计算触摸的位置。在一些实施例中,作用于不同触摸位置,可以对应不同的操作指令。在一些可选的实施例中,压力传感器180A还可根据检测到的信号计算触摸点的数量,并将计算值传输给处理器,以使得处理器识别用户通过单指或多指输入用户操作。
陀螺仪传感器180B可以用于确定电子设备100的运动姿态。在一些实施例中,可以通过陀螺仪传感器180B确定电子设备100围绕三个轴(电子设备的X轴、Y轴和Z轴)的角速度。陀螺仪传感器180B可以用于拍摄防抖。示例性的,当按下快门,陀螺仪传感器180B检测电子设备100抖动的角度,根据角度计算出镜头模组需要补偿的距离,让镜头通过反向运动抵消电子设备100的抖动,实现防抖。陀螺仪传感器180B还可以用于导航,体感游戏场景。
气压传感器180C用于测量气压。在一些实施例中,电子设备100通过气压传感器180C测得的气压值计算海拔高度,辅助定位和导航。
磁传感器180D包括霍尔传感器。电子设备100可以利用磁传感器180D检测翻盖皮套的开合。在一些实施例中,当电子设备100是翻盖机时,电子设备100可以根据磁传感器180D检测翻盖的开合。进而根据检测到的皮套的开合状态或翻盖的开合状态,设置翻盖自动解锁等特性。
加速度传感器180E可检测电子设备100在各个方向上(一般为三轴)加速度的大小。当电子设备100静止时可检测出重力的大小及方向。还可以用于识别电子设备姿态,应用于横竖屏切换,计步器等应用。在本申请一些可选的实施例中,加速度传感器180E可用于捕获用户手指部位接触显示屏(或者用户手指敲击电子设备100的后壳后侧边框)时生成的加速度值, 并将该加速度值传输给处理器,以使得处理器识别用户通过哪个手指部位输入用户操作。
距离传感器180F,用于测量距离。电子设备100可以通过红外或激光测量距离。在一些实施例中,拍摄场景,电子设备100可以利用距离传感器180F测距以实现快速对焦。
接近光传感器180G可以包括例如发光二极管(LED)和光检测器,例如光电二极管。发光二极管可以是红外发光二极管。电子设备100通过发光二极管向外发射红外光。电子设备100使用光电二极管检测来自附近物体的红外反射光。当检测到充分的反射光时,可以确定电子设备100附近有物体。当检测到不充分的反射光时,电子设备100可以确定电子设备100附近没有物体。电子设备100可以利用接近光传感器180G检测用户手持电子设备100贴近耳朵通话,以便自动熄灭显示屏达到省电的目的。接近光传感器180G也可用于皮套模式,口袋模式自动解锁与锁屏。
环境光传感器180L用于感知环境光亮度。电子设备100可以根据感知的环境光亮度自适应调节显示屏194亮度。环境光传感器180L也可用于拍照时自动调节白平衡。环境光传感器180L还可以与接近光传感器180G配合,检测电子设备100是否在口袋里,以防误触。
指纹传感器180H用于采集指纹。电子设备100可以利用采集的指纹特性实现指纹解锁,访问应用锁,指纹拍照,指纹接听来电等。
温度传感器180J用于检测温度。在一些实施例中,电子设备100利用温度传感器180J检测的温度,执行温度处理策略。例如,当温度传感器180J上报的温度超过阈值,电子设备100执行降低位于温度传感器180J附近的处理器的性能,以便降低功耗实施热保护。在另一些实施例中,当温度低于另一阈值时,电子设备100对电池142加热,以避免低温导致电子设备100异常关机。在其他一些实施例中,当温度低于又一阈值时,电子设备100对电池142的输出电压执行升压,以避免低温导致的异常关机。
触摸传感器180K,也称“触控面板”。触摸传感器180K可以设置于显示屏194,由触摸传感器180K与显示屏194组成触摸屏,也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作,该触摸触控操作是指用户手部、手肘、触控笔等接触显示屏194的操作。触摸传感器可以将检测到的触摸操作传递给应用处理器,以确定触摸事件类型。可以通过显示屏194提供与触摸操作相关的视觉输出。在另一些实施例中,触摸传感器180K也可以设置于电子设备100的表面,与显示屏194所处的位置不同。
骨传导传感器180M可以获取振动信号。在一些实施例中,骨传导传感器180M可以获取人体声部振动骨块的振动信号。骨传导传感器180M也可以接触人体脉搏,接收血压跳动信号。在一些实施例中,骨传导传感器180M也可以设置于耳机中,结合成骨传导耳机。音频模块170可以基于所述骨传导传感器180M获取的声部振动骨块的振动信号,解析出语音信号,实现语音功能。应用处理器可以基于所述骨传导传感器180M获取的血压跳动信号解析心率信息,实现心率检测功能。
按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键。电子设备100可以接收按键输入,产生与电子设备100的用户设置以及功能控制有关的键信号输入。
马达191可以产生振动提示。马达191可以用于来电振动提示,也可以用于触摸振动反馈。例如,作用于不同应用(例如拍照,音频播放等)的触摸操作,可以对应不同的振动反馈效果。作用于显示屏194不同区域的触摸操作,马达191也可对应不同的振动反馈效果。不同的应用场景(例如:时间提醒,接收信息,闹钟,游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。
指示器192可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。
SIM卡接口195用于连接SIM卡。SIM卡可以通过插入SIM卡接口195,或从SIM卡接口195拔出,实现和电子设备100的接触和分离。
图2b示例性示出了本申请提供的显示设备101的结构示意图。
如图2b所示,显示设备101可包括:处理器122、存储器123、无线通信处理模块124、电源开关125、有线LAN通信处理模块126、HDMI通信处理模块127、USB通信处理模块128和显示屏129。其中:
处理器122可用于读取和执行计算机可读指令。具体实现中,处理器122可主要包括控制器、运算器和寄存器。其中,控制器主要负责指令译码,并为指令对应的操作发出控制信号。运算器主要负责执行定点或浮点算数运算操作、移位操作以及逻辑操作等,也可以执行地址运算和转换。寄存器主要负责保存指令执行过程中临时存放的寄存器操作数和中间操作结果等。具体实现中,处理器122的硬件架构可以是专用集成电路(Application Specific Integrated Circuits,ASIC)架构、MIPS架构、ARM架构或者NP架构等等。
在一些实施例中,处理器122可以用于解析无线通信处理模块124和/有线LAN通信处理模块126接收到的信号,如电子设备100的广播的探测请求,电子设备100发送的显示请求,云投屏服务提供商的服务器发送的显示指令,等等。处理器122可以用于根据解析结果进行相应的处理操作,如生成探测响应,又如根据该显示请求或显示指令驱动显示屏执行显示,等等。
在一些实施例中,处理器122还可以用于生成无线通信处理模块124和/有线LAN通信处理模块126向外发送的信号,如蓝牙广播信号、信标信号,又如向电子设备发送的用于反馈显示状态(如连接成功、连接失败等)的信号。
存储器123与处理器122耦合,用于存储各种软件程序和/或多组指令。具体实现中,存储器123可包括高速随机存取的存储器,并且也可包括非易失性存储器,例如一个或多个磁盘存储设备、闪存设备或其他非易失性固态存储设备。存储器123可以存储操作系统,例如uCOS、VxWorks、RTLinux等嵌入式操作系统。存储器123还可以存储通信程序,该通信程序可用于与电子设备100,一个或多个服务器,或附近设备进行通信。
无线通信处理模块124可以包括蓝牙(BT)通信处理模块124A、WLAN通信处理模块124B中的一项或多项。
在一些实施例中,蓝牙(BT)通信处理模块、WLAN通信处理模块中的一项或多项可以监听到其他设备(如电子设备100)发射的信号,如探测请求、扫描信号等等,并可以发送响应信号,如探测响应、扫描响应等,使得其他设备(如电子设备100)可以发现显示设备101,并与其他设备(如电子设备100)建立无线通信连接,通过蓝牙或WLAN中的一种或多种无线通信技术与其他设备(如电子设备100)进行通信。
在另一些实施例中,蓝牙(BT)通信处理模块、WLAN通信处理模块中的一项或多项也可以发射信号,如广播蓝牙信号、信标信号,使得其他设备(如电子设备100)可以发现显示设备101,并与其他设备(如电子设备100)建立无线通信连接,通过蓝牙或WLAN中的一种或多种无线通信技术与其他设备(如电子设备100)进行通信。
无线通信处理模块124还可以包括蜂窝移动通信处理模块(未示出)。蜂窝移动通信处理模块可以通过蜂窝移动通信技术与其他设备(如服务器)进行通信。
电源开关125可用于控制电源向显示屏129的供电。
有线LAN通信处理模块126可用于通过有线LAN和同一个LAN中的其他设备进行通信,还可用于通过有线LAN连接到WAN,可与WAN中的设备通信。
HDMI通信处理模块127可用于通过HDMI接口(未示出)与其他设备进行通信。
USB通信处理模块128可用于通过USB接口(未示出)与其他设备进行通信。
显示屏129可用于显示图像,视频等。显示屏129可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED)显示屏,有源矩阵有机发光二极体(active-matrix organic light emitting diode,AMOLED)显示屏,柔性发光二极管(flexible light-emitting diode,FLED)显示屏,量子点发光二极管(quantum dot light emitting diodes,QLED)显示屏等等。
在一些实施例中,显示设备101还可以包括音频模块(未示出)。音频模块可用于通过音频输出接口输出音频信号,这样可使得显示设备101支持音频播放。音频模块还可用于通过音频输入接口接收音频数据。显示设备101可以为电视机等媒体播放设备。
在一些实施例中,显示设备101还可以包括RS-232接口等串行接口。该串行接口可连接至其他设备,如音箱等音频外放设备,使得显示器和音频外放设备协作播放音视频。
可以理解的是图2b示意的结构并不构成对显示设备101的具体限定。在本申请另一些实施例中,显示设备101可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
下面结合应用场景,介绍本申请中提供的一种截屏方法在电子设备100和显示设备101的显示界面上的实现形式。
图3a~图3d为电子设备100的示例性的显示界面,示出了电子设备100将视频投屏在显示设备101上的过程。如图3a所示,图3a示例性的示出了一种电子设备100的主界面310。主界面310包括状态栏311,具有常用应用程序图标的托盘312,以及其他应用程序图标(包括视频应用图标313)。其中:
状态栏311可包括:移动通信信号(又可称为蜂窝信号)的一个或多个信号强度指示符、无线高保真(wireless fidelity,Wi-Fi)信号的一个或多个信号强度指示符,蓝牙指示符,电池状态指示符、时间指示符。具有常用应用程序图标的托盘312可展示例如电话图标、联系人图标、短信图标、相机图标等。
当电子设备100接收到针对于应用程序图标的用户操作,电子设备100启动该应用程序图标对应的应用程序,显示对应的应用界面。示例性的,用户点击视频应用图标313,电子设备100启动视频应用,进入视频播放界面。如图3b所示,图3b示出的视频应用的视频播放界面320包括显示区321、视频信息区322、进度条323以及一个或多个控件(图3b中只标注出了控件324)。其中,
显示区321用于显示视频画面。
视频信息区322用于指示当前显示区321显示的视频的相关信息,例如名称、简介、评分、播放次数、主演、集数等等。
进度条323用于指示显示区321中的视频播放进度。图3b中进度条323处于播放状态,指示了当前电子设备100正在播放视频。
控件324用于实现投屏,当电子设备100接收到针对于控件324的用户操作,响应于该操作,电子设备100查询到可投屏设备(例如显示设备101),将显示区321中显示的视频投屏到该可投屏设备上去。
其中,当电子设备100接收到针对于控件324的用户操作,响应于该操作,电子设备100查询到一个或多个可投屏设备,电子设备100可以显示如图3c所示的用户界面330。用户界面330中包括叠加在显示区321之上的设备选择窗口331。
该设备选择窗口331中包括一个或多个可投屏设备对应的设备图标,以供用户进行确认选择投屏设备,图3c中包括iPad设备图标332、卧室电视设备图标333、客厅电视设备图标334。其中,图3c中进度条323处于暂停播放状态,指示了当前电子设备100暂停播放视频。
图3c中,电子设备100检测到针对于设备选择窗口331中任一设备图标(以客厅电视设备图标334为例)的用户操作,电子设备100将视频投屏到客厅电视,电子设备100可以不再显示该视频,并且能够后台运行该视频应用,前台运行其他应用程序,实现一边通过电子设备100使用其他应用程序,一边通过显示设备101播放视频。
示例性的,投屏过程中电子设备100可以显示如图3d所示的界面,图3d示出了一种投屏界面340,该投屏界面340中的显示区341不再显示视频,显示区341提示用户当前处于投屏中的状态,并且显示区341包括退出投屏按钮342,该退出投屏按钮342用于退出投屏。此时,客厅电视正在播放视频。电子设备100进度条323处于播放状态,进度条的进度和客厅电视上视频播放进度是同步的,用户可以通过控制进度条323对客厅电视上视频播放进度进行控制。可选的,图3d中还可以包括多个控件(图中未示出),该多个控件可以用于例如对分辨率的调控,对被投屏设备(当前为显示设备101)的切换,对音量的调控,等等。
以上图3a~图3d示出了电子设备100将视频投屏在显示设备101上的过程。
在一些实施例中,电子设备100将视频投屏到客厅电视,电子设备100可以通过画中画的形式播放该视频,并且可以同步运行其他应用程序。示例性的,投屏过程中电子设备100可以显示如图3e所示的用户界面350,该用户界面350中包括投屏窗口351,该投屏窗口351的显示画面为投屏画面,与显示设备101中显示的投屏画面一致。可选的,用户可以自由调控投屏窗口351的位置、大小。其中,投屏窗口351显示在应用界面之上,和应用界面之间互不干扰。在图3e中,该投屏窗口351显示在主界面之上为示例性的,该投屏窗口351可以显示在其他应用界面之上。例如,如图3f所示,当电子设备100接收到针对于备忘录应用的用户操作,电子设备100运行备忘录应用,显示备忘录应用的应用界面360,在应用界面360中包括投屏窗口351。
图4a示出了电子设备100将视频投屏在客厅电视(显示设备101)上之后,显示设备101在显示界面上的实现形式。
图4a示例性的示出了显示设备101的一种投屏界面410,该投屏界面410中的显示画面为电子设备100提供的,可以看出,当前投屏界面410的显示画面为图3b中显示区321中的显示画面。
投屏界面410中还包括进度条401和退出投屏按钮402。其中,进度条401当前处于播放状态,用户可以通过控制进度条401对客厅电视上视频播放进度进行控制。退出投屏按钮402用于退出投屏。
在一些实施例中,当显示设备101接收到针对于投屏界面410中的显示画面的截屏指令,显示设备101将当前的显示画面进行截屏,并将截屏图片发送到电子设备100,电子设备100保存该截屏的显示画面。其中,上述截屏指令可以是用于进行截屏的用户操作,例如针对显示设备101提供的截屏控件的点击操作,又例如是语音指令,遥控指令,按键指令,触屏指令(敲击、双指、三指下滑)等等。
可选的,当显示设备101接收到针对于投屏界面410中的显示画面的截屏指令,显示设 备101进入截屏编辑模式,用户可以确定想要截屏的区域,显示设备101基于用户选择的截屏区域获取该截屏区域下的画面。
示例性的,如图4b所示,显示设备101接收到针对于投屏界面410中的显示画面的截屏指令,显示设备101基于该截屏指令进行截屏,显示设备101的显示界面420中显示截屏成功通知421,示例性的,该截屏成功通知421可以为“已对投屏画面完成截屏,截屏图片保存至投屏设备”,指示了显示设备101将截屏图片发送到了电子设备100(投屏设备)。
可选的,当电子设备100接收到截屏图片,电子设备100输出相应的通知信息,该通知信息用于提示用户已接收到显示设备101发送的截屏图片。
可选的,当电子设备100接收到截屏图片,电子设备100输出相应的通知信息,该通知信息用于对接收到的截屏图片提供编辑方式,编辑方式包括对截屏图片进行剪切、标记、旋转、添加文本等等。示例性的,如图4c所示,图4c示例性的示出了在用户界面430上显示的通知431以及接收到的截屏缩略图432,该通知431可以为“接收到被投屏设备(客厅电视)发送的截屏图片”。该截屏缩略图432示意出了接收到的截屏图片的缩略图,通过点击该截屏缩略图432可以对截屏图片进行编辑。示例性的,当电子设备100接收到针对于截屏缩略图432的用户操作,电子设备100显示如图4d所示的用户界面440。用户界面440提供了针对于截屏图片的编辑功能栏441、截取框442以及保存控件443、删除控件444和取消控件445,其中,编辑功能栏441中提供了包括分享、添加文本、标记、橡皮擦、更多等等功能控件。截取框442用于对截屏图片进行截取。
电子设备100接收并保存截屏图片,此时电子设备100可以在自身的图片类应用中查看截屏图片。示例性的,如图4e所示,图4e中示出了一种电子设备100的主界面450,该主界面450的具体描述可以参考上述图3a中的主界面310的相关描述,这里不再赘述。当电子设备100接收到针对于图库应用451的用户操作,电子设备100打开图库应用,其中图库应用用于查看电子设备100保存的图片、视频等媒体文件。示例性的,该图库应用的应用界面如图4f所示,该应用界面460中包括一个或多个图片、视频等媒体文件,其中,图片461为上述截屏图片。
在一些实施例中,当电子设备100接收到针对于投屏界面340中的显示画面的截屏指令,电子设备100指示显示设备101对当前的显示画面进行截屏,显示设备101将截屏图片发送到电子设备100,电子设备100保存该截屏的显示画面。示例性的,如图5a所示,电子设备100在投屏的过程中,用户想要对投屏的显示画面进行截屏,则用户触发截屏指令,例如图5a中,电子设备100接收到针对显示界面341顶部的向下滑动的用户操作,电子设备100输出下拉功能界面,该下拉功能界面提供了多个功能选项,该多个功能选项包括对投屏的显示画面进行截屏的功能选项。
其中,电子设备100在投屏的过程中,可以切换到其他应用的应用界面,执行其他的任务。电子设备100在显示任意应用界面时均可以进入下拉功能界面。
示例性的,图5b示出了一种下拉功能界面520,该下拉功能界面520中包括功能栏521,该功能栏521中包括多个功能控件(例如截屏控件521A、大屏投射521B控件、投屏截屏521C控件等)。其中,截屏控件521A用于对下拉功能界面520进行截屏,大屏投射521B控件用于实现投屏功能,投屏截屏521C控件用于对投屏的显示画面进行截屏。
在一些实施例中,当电子设备100接收到针对于投屏截屏521C控件的用户操作,电子设备100指示显示设备101对当前的显示画面进行截屏,显示设备101将截屏图片发送到电子设备100,电子设备100保存该截屏图片。可选的,当显示设备101接收到电子设备100 发送的截屏指令,显示设备101进入截屏编辑模式,用户可以确定想要截屏的区域,显示设备101基于用户选择的截屏区域获取该截屏区域下的画面,显示设备101将截屏图片发送到电子设备100。可选的,显示设备101对当前的显示界面进行截屏后,显示设备101可以输出截屏成功通知,示例性的,如图4b所示,该截屏成功通知421可以为“已对投屏画面完成截屏,截屏图片保存至投屏设备”,指示了显示设备101将截屏图片发送到了电子设备100(投屏设备)。
可选的,当电子设备100接收到截屏图片,电子设备100输出相应的通知信息,用于提示用户已接收到显示设备101发送的截屏图片。示例性的,如图5c所示,图5c示例性的示出了在用户界面530上显示的通知531,该通通知531可以为“接收到被投屏设备(客厅电视)发送的截屏图片,点击可查看”。
在一些实施例中,当电子设备100接收到针对于投屏截屏521C控件的用户操作,电子设备100对后台运行的(例如图3d所示)或者以画中画形式播放(例如图3e或图3f所示)的投屏画面进行截屏,获取到投屏画面的截屏图片。可选的,电子设备100对投屏画面进行截屏后,电子设备100输出相应的通知信息,用于提示用户已获取到投屏画面的截屏图片。例如该通知可以为“已对投屏画面完成截屏,点击可查看”。
在一些实施例中,显示设备101基于视频信息显示视频画面的方式可以是全屏显示(如图4a所示),也可以是分屏显示,也可以是窗口显示(例如浮窗显示)等等,本申请对此不做限制。
图6a示例性的示出了一种窗口显示投屏画面的投屏界面610,投屏界面610中的显示内容为客厅电视的原始显示内容601,以及在原始显示内容之上叠加显示的投屏窗口602。该投屏窗口602的显示内容为电子设备100提供的投屏视频数据,投屏窗口602中包括进度条603、退出投屏按钮604和全屏显示按钮605。用户可以通过控制进度条603对客厅电视上视频播放进度进行控制,通过退出投屏按钮604退出投屏,通过全屏显示按钮605使投屏窗口602的投屏画面全屏显示。
在一些实施例中,当显示设备101接收到截屏指令,显示设备101确定截屏的内容,例如截屏内容为显示设备101自身的显示画面,或者是投屏画面,或者是整个显示界面(例如投屏界面610),或者是用户选择的自定义区域,等等。
下面示例性说明显示设备101确定截屏内容的方式。
可选的,显示设备101接收到针对于投屏画面的截屏指令,则确定截屏的内容为投屏画面。显示设备101接收到针对于自身显示画面的截屏指令,则确定截屏的内容为自身的显示画面。显示设备101接收到针对于整个显示界面的截屏指令,则确定截屏的内容为整个显示界面。
可选的,显示设备101检测到当前自身处于被投屏状态,则确定截屏的内容为投屏画面。
可选的,显示设备101基于图像识别检测到当前的显示界面中包括投屏窗口或投屏画面,则显示设备101确定截屏的内容为投屏画面。
可选的,显示设备101输出弹窗,提示用户确定想要截屏的内容,显示设备101获取到用户确定的截屏内容进行截屏。示例性的,如图6b所示,显示设备101接收到截屏指令后,输出如图6b所示的选择窗口621,该选择窗口621提供了四种截屏选项,分别为自身显示画面622,投屏画面623,整个显示界面624和自选区域625。
显示设备101接收到针对于自身显示画面622的用户操作,显示设备101对当前自身的 显示画面进行截屏,获取原始显示内容601的截屏画面;显示设备101接收到针对于投屏画面623的用户操作,显示设备101对投屏画面进行截屏,获取投屏窗口602的截屏画面;显示设备101接收到针对于整个显示界面624的用户操作,显示设备101对当前显示的整个显示界面进行截屏,获取投屏界面610的截屏画面。
显示设备101接收到针对于自选区域625的用户操作,显示设备101进入截屏编辑模式,用户可以在整个显示界面中选择想要截屏的区域,显示设备101基于用户选择的截屏区域获取该截屏区域下的画面。示例性的,如图6c所示,图6c示出了一种截屏编辑模式下的界面630,在截屏编辑模式下,显示设备101提供了一个截屏区域选择窗口631,该截屏区域选择窗口631用于确定截屏区域,用户可以移动截屏区域选择窗口631的位置,调节截屏区域选择窗口631的大小。可选的,对于该截屏区域选择窗口631还包括取消控件632和确认控件633,取消控件632用于退出截屏编辑模式,确认控件633用于基于截屏区域选择窗口631获取该截屏区域下的画面。
可选的,图6b为可选的,当显示设备101接收到截屏指令,显示设备101可以直接进入截屏编辑模式,基于用户选择的截屏区域获取该截屏区域下的画面。
在一些实施例中,当显示设备101接收到针对于投屏界面410中的显示画面的截屏指令,显示设备101将当前的显示画面进行截屏,并将截屏图片发送到电子设备100,电子设备100保存该截屏的显示画面。其中,上述截屏指令可以是用于进行截屏的用户操作,例如针对显示设备101提供的截屏控件的点击操作,又例如是语音指令,遥控指令,按键指令等等。
示例性的,如图4b所示,显示设备101接收到针对于投屏界面410中的显示画面的截屏指令,显示设备101将当前的显示画面进行截屏,显示设备101的显示界面420中显示截屏成功通知421,示例性的,该截屏成功通知421可以为“已对投屏画面完成截屏,截屏图片保存至投屏设备”,指示了显示设备101将截屏图片发送到了电子设备100(投屏设备)。此时,电子设备100可以在自身的图片类应用中查看截屏图片。如上述图4e和图4f所示,当电子设备100接收到针对于图库应用451的用户操作,电子设备100打开图库应用,其中,图库应用中包括图片461,图片461即为上述截屏图片。
上述示例均是以投屏视频来进行示例性描述的,进一步的,本申请实施例不限于投屏视频,还可以是投屏各类应用程序,还可以是将电子设备100上的应用界面均投屏到显示设备101上。
基于上述系统架构以及各个设备的硬件结构,下面结合示例介绍本申请实施例提供的一种截屏方法的实现原理。
电子设备100和显示设备101的软件系统可以采用分层架构,事件驱动架构,微核架构,微服务架构,或云架构。本申请实施例以Android系统为例,示例性说明电子设备100的软件架构。其中,Android系统仅为本申请实施例中电子设备100或显示设备101的一种系统实例,本申请还可以适用于其他类型的操作系统,比如ios、Windows、鸿蒙等,本申请对此不加以限制。下述仅将Android系统作为电子设备100的操作系统的示例。
本申请实施例,电子设备100在投屏至显示设备101的情况下,电子设备100为投屏设备,显示设备101为被投屏设备,显示设备101显示电子设备100投屏的第一画面,电子设备100可以在投屏过程中执行其他任务,显示第二画面。当电子设备100或显示设备101接收到针对于第一画面的截屏指令,电子设备100可以获取到显示设备101中投屏内容的截屏图片,提升截屏效率。其中,显示设备101可以全屏显示投屏画面(即第一画面),显示设备 101也可以在自身的原本显示画面中叠加一个投屏窗口,该投屏窗口中显示投屏画面(即第一画面),显示设备101也可以采用分屏的方式显示投屏画面和自身的原本显示画面,本申请实施例对此不作限制。
在一些实施例中,如图7所示,图7示例性示出了电子设备100和显示设备101的一种软件结构,电子设备100为投屏设备,显示设备101为被投屏设备,电子设备100包括截屏事件管理模块和存储模块,显示设备101包括接收模块、截屏事件管理模块和存储模块。其中,截屏事件管理模块用于对触发的截屏事件进行处理。
步骤1,显示设备101通过接收模块接收到截屏指令。
步骤2,基于该截屏指令,显示设备101通过截屏事件管理模块确定截屏内容并获取截屏图片。
可选的,显示设备101通过显示设备101的存储模块保存该截屏图片。
步骤3,显示设备101将截屏图片发送给电子设备100。
步骤4,电子设备100接收到截屏图片,通过电子设备100的存储模块保存该截屏图片。
这样,实现了在电子设备100投屏至显示设备101的情况下,当显示设备101接收到截屏指令,显示设备101可以直接将截屏图片发送并存放到投屏设备(电子设备100),提升了投屏设备的截屏效率。
基于图7示出的软件结构,下面详细说明本申请实施例提供的一种截屏方法的步骤实现流程,如图8所示,具体步骤可包括:
步骤S101:电子设备100在显示设备101上投屏。
其中,投屏是电子设备100提供的一种服务或功能,可以支持电子设备100传输数据至其他设备(例如显示设备101)。在一些实施例中,投屏可支持该电子设备100通过蓝牙、无线保真直连(wireless fidelity direct,Wi-Fi direct)、Wi-Fi软件接入点(software access point,softAP)中的一项或多项等技术传输数据至附近设备。在另一些实施例中,投屏可支持该电子设备100通过局域网(LAN)传输数据至与该电子设备100处于同一个局域网内的设备(例如显示设备101)。其中,与该电子设备100处于同一个局域网内的设备也可以是该电子设备附近的设备。其中,本申请涉及到的无线投屏协议包括但不限于数字生活网络联盟(Digital Living Network Alliance,DLNA)、AirPlay、Miracast等。
在一些实施例中,电子设备100和显示设备101可以通过服务器进行数据通信,服务器可以是应用服务器、云服务器、后台服务器等等。
在一些实施例中,电子设备100和显示设备101为登录了同一账号的设备,或者电子设备100和显示设备101登陆的账户互为关联账户,其中,关联账户可以为被同一账户授权的账户。可选的,这里的账户指的可以是应用账户、设备账户、身份账户等等。
步骤S102:显示设备101显示第一画面,该第一画面包括电子设备100投屏到显示设备101上的画面。
电子设备100在显示设备101上投屏,显示设备101显示第一画面,该第一画面即为显示设备的整个显示画面,第一画面包括电子设备100投屏到显示设备101上的画面。其中,显示设备101可以全屏显示投屏画面,此时第一画面为投屏画面;显示设备101可以在原本显示画面上叠加一个窗口显示投屏画面,此时第一画面为整个显示画面,该第一画面中包括投屏画面;显示设备101也可以是和原本显示画面分屏显示视频内容,例如左右分屏、上下分屏,此时第一画面为整个显示画面,该第一画面中包括投屏画面。示例性的,上述图4a即为全屏显示投屏画面,上述图6a即为窗口显示投屏画面。
其中,电子设备100在显示设备101上投屏,电子设备100可以切换到任意应用执行相应的任务,电子设备100显示第二画面。这样,用户就可以一边通过显示设备101观看投屏内容,一边使用手机。
步骤S103:显示设备101接收到截屏指令。
该截屏指令包括用于指示显示设备101进行截屏的用户操作,例如显示设备101提供的截屏控件的点击操作,又例如是用于截屏的语音指令、遥控指令、按键指令、手势、触屏操作(如双击、两指、三指下滑)等等。
在一些实施例中,截屏指令可以包括一组指令,例如点击截屏(指令1)然后确认截屏(指令2),又例如点击截屏(指令1)然后选择截屏区域(指令2)然后确认截屏(指令3),等等。可选的,截屏指令也可以为一个指令,例如点击截屏然后确认截屏中确认截屏的指令,又例如点击截屏然后选择截屏区域然后确认截屏中确认截屏的指令。
在一些实施例中,该截屏指令可以是其他设备(包括电子设备100)触发或发送的。
步骤S104:基于该截屏指令,显示设备101确定截屏内容并获取截屏图片,该截屏图片包括第一画面的全部或部分内容。
其中,截屏内容可以包括显示设备101自身的原本显示画面,或者是投屏画面,或者是整个显示界面,或者是用户选择的自定义区域,等等。
在显示设备101全屏显示投屏画面的情况下,即显示设备101的整个显示界面显示投屏画面,第一画面为该投屏画面。
在一些实施例中,显示设备101接收到针对于投屏画面的第一截屏指令,基于该第一截屏指令,显示设备101确定截屏内容为投屏画面,显示设备100对投屏画面进行截屏,获取到第一画面的截屏图片。
在一些实施例中,显示设备接收到第二截屏指令,显示设备101进入针对于第一画面的截屏编辑模式,用户可以在整个显示界面(第一画面)中选择想要截屏的区域,显示设备101基于用户选择的截屏区域获取该截屏区域下的画面,即电子设备获取到截屏图片,该截屏图片为第一画面的全部或部分内容。
在显示设备101分屏显示或窗口显示投屏画面的情况下,显示设备101的整个显示界面中包括投屏画面和显示设备101原本的显示画面,即第一画面包括投屏画面和显示设备101原本的显示画面。
在一些实施例中,显示设备101接收到针对于投屏画面的第三截屏指令,基于该第三截屏指令,显示设备101确定截屏内容为投屏画面,显示设备100对投屏画面进行截屏,获取到投屏画面的截屏图片。该截屏图片为第一画面的部分内容。
在一些实施例中,显示设备101接收到第四截屏指令,显示设备101检测到当前自身处于被投屏状态,则确定截屏的内容为投屏画面。显示设备100对投屏画面进行截屏,获取到投屏画面的截屏图片。该截屏图片为第一画面的部分内容。
在一些实施例中,显示设备101接收到第五截屏指令,显示设备101基于图像识别技术检测到当前的显示界面(显示第一画面)中包括投屏窗口或投屏画面,则显示设备101确定截屏的内容为投屏画面。显示设备100对投屏画面进行截屏,获取到投屏画面的截屏图片。该截屏图片为第一画面的部分内容。
在一些实施例中,显示设备101接收到针对于整个显示界面(显示第一画面)的第六截屏指令,基于该第六截屏指令,显示设备101确定截屏内容为第一画面,显示设备100对第一画面进行截屏,获取到第一画面的截屏图片。
在一些实施例中,显示设备101接收到第七截屏指令,显示设备101进入针对于第一画面的截屏编辑模式,用户可以在整个显示界面(第一画面)中选择想要截屏的区域,显示设备101基于用户选择的截屏区域获取该截屏区域下的画面,即显示设备100获取到截屏图片,该截屏图片为第一画面的全部或部分内容。
在一些实施例中,显示设备101接收到第八截屏指令,显示设备101输出选择窗口,该选择窗口用于提示用户选择截屏内容。显示设备101基于用户选择的截屏内容进行截屏,获取到截屏图片,该截屏图片为第一画面的部分内容。这里可以参考上述图6b的相关描述,选择窗口即为窗口621,用户可以选择对显示设备101原本的显示画面进行截屏,也可以选择对投屏画面进行截屏,也可以选择对整个显示画面进行截屏,也可以进入针对于第一画面的截屏编辑模式,对选择任意区域进行截屏。
步骤S105:显示设备101将截屏图片发送给电子设备100。
显示设备101获取到截屏图片后,将该截屏图片发送给投屏设备(电子设备100)。
在一些实施例中,显示设备101检测到当前自身处于被投屏状态,则显示设备101将截屏图片发送给电子设备100。
在一些实施例中,显示设备101基于图像识别技术检测到截屏图片的图片内容中包括投屏画面,则显示设备101将截屏图片发送给电子设备100。可选的,若检测到截屏图片的图片内容中不包括投屏画面,即只包括显示设备101自身的原本显示画面,则不将该截屏图片发送给电子设备100。
可选的,显示设备101将截屏图片发送给电子设备100之后,显示设备101输出通知信息,提示用户已将截屏图片发送至投屏设备(电子设备100)。可选的,显示设备101存储该截屏图片。
步骤S106:电子设备100接收到该截屏图片,保存该截屏图片。其中,用户可以在图片类应用中查看该图片。
在一些实施例中,电子设备100接收到该截屏图片后,电子设备100基于图像识别技术检测到该截屏图片的图片内容中包括投屏画面,则显示设备101保存该截屏图片。可选的,若检测到截屏图片的图片内容中不包括投屏画面,则不保存。
在一些实施例中,电子设备100接收到该截屏图片后,检测到该截屏图片的发送方为电子设备100的投屏设备(显示设备101),则显示设备101保存该截屏图片。可选的,若检测到截屏图片的发送方不是电子设备100的投屏设备,则不保存。
在一些实施例中,电子设备100接收到截屏图片后,电子设备100输出通知信息,提示用户已接收到截屏图片。可选的,基于该通知信息,用户可以查看该截屏图片。可选的,基于该通知信息,用户可以对该接收到的截屏图片进行编辑再保存,编辑方式包括对截屏图片进行剪切、标记、旋转、添加文本等等。
本申请实施例,实现了在电子设备100投屏至显示设备101的情况下,当显示设备101接收到截屏指令,显示设备101可以直接将截屏图片发送并存放到投屏设备(电子设备100),这样提升了投屏设备的截屏效率。
在一些实施例中,如图9所示,图9示例性示出了电子设备100和显示设备101的又一种软件结构,电子设备100为投屏设备,显示设备101为被投屏设备,电子设备100包括接收模块、截屏事件管理模块和存储模块,显示设备101包括截屏事件管理模块和存储模块。其中,截屏事件管理模块用于对触发的截屏事件进行处理。
步骤1,电子设备100通过接收模块接收到截屏指令。
步骤2,向截屏事件管理模块请求截屏。
步骤3,基于该截屏指令,电子设备100通过截屏事件管理模块向显示设备101发送截屏请求。
步骤4,基于该截屏请求,显示设备101通过截屏事件管理模块确定截屏内容并获取截屏图片。
可选的,显示设备101通过显示设备101的存储模块保存该截屏图片。
步骤5,显示设备101将截屏图片发送给电子设备100。
步骤6,电子设备100接收到截屏图片,通过电子设备100的存储模块保存该截屏图片。
这样,实现了在电子设备100投屏至显示设备101的情况下,当电子设备100接收到针对于投屏画面的截屏指令,可以指示显示设备101进行截屏,并且显示设备直接将截屏图片发送并存放到投屏设备(电子设备100),提升了投屏设备的截屏效率。
基于图9示出的软件结构,下面详细说明本申请实施例提供的又一种截屏方法的步骤实现流程,如图10所示,具体步骤可包括:
步骤S201:电子设备100在显示设备101上投屏。步骤S202:显示设备101显示第一画面,该第一画面包括电子设备100投屏到显示设备101上的画面。其中步骤S201和步骤S202的具体描述可以参考上述步骤S101和步骤S102的相关描述,这里不再赘述。
步骤S203:电子设备100接收到截屏指令。
该截屏指令包括用于指示电子设备100进行截屏的用户操作,例如电子设备100提供的截屏控件的点击操作,又例如是用于截屏的语音指令、遥控指令、按键指令、手势等等。
步骤S204:电子设备100向显示设备101发送截屏请求。
在一些实施例中,该截屏指令为针对于投屏设备的显示画面的截屏指令,用于获取投屏设备的显示画面的截图。那么电子设备100向显示设备101发送截屏请求。
进一步的,该截屏指令为针对于投屏画面的截屏指令,用于获取投屏设备的投屏画面的截图。那么电子设备100向显示设备101发送截屏请求。
在一些实施例中,该截屏请求中包括时间戳,电子设备100接收到截屏指令,记录当前的标准时间为第一时刻,则电子设备100向显示设备101发送带有第一时刻的时间戳的截屏请求,显示设备101基于该第一时刻,可以对在第一时刻时显示设备101显示的画面进行截屏。
可选的,电子设备100和显示设备101在投屏时可以进行时间校准,以确认电子设备100和显示设备101的时间一致。
上述实施例中时间戳为当前的标准时间,在一些实施例中,若电子设备100投屏到显示设备101上的内容为视频流,则该时间戳还可以为视频播放时间点。电子设备100接收到截屏指令,则确定当前的视频播放时间点为第一时间点,则电子设备100向显示设备101发送带有第一时间点的时间戳的截屏请求,显示设备101基于该第一时间点,可以对在第一时间点的视频画面进行截屏。
在一些实施例中,若电子设备100投屏到显示设备101上的内容为文档类内容(例如PPT、Word、图片集等),截屏请求中还可以包括页面标识,页面标识指示了文档中具体的页数、图片张数等信息。电子设备100接收到截屏指令,则确定当前投屏的页面标识,电子设备100向显示设备101发送带有页面标识的截屏请求,显示设备101基于该页面标识,可以对该页面标识对应的画面进行截屏。
步骤S205:基于接收到的截屏请求,显示设备101确定截屏内容并获取截屏图片,该截屏图片包括第一画面的全部或部分内容。
步骤S206:显示设备101将截屏图片发送给电子设备100。
步骤S207:电子设备100接收到该截屏图片,保存该截屏图片。其中,用户可以在图片类应用中查看该图片。
其中步骤S205~步骤S207的具体描述可以参考上述步骤S104~步骤S106的相关描述,这里不再赘述。
本申请实施例,实现了在电子设备100投屏至显示设备101的情况下,当电子设备100接收到针对于投屏设备的显示画面的截屏指令,电子设备100可以指示显示设备101进行截屏,然后显示设备101将截屏图片发送并存放到投屏设备(电子设备100),这样提升了投屏设备的截屏效率。
基于本申请实施例,在一些应用场景中,用户将手机(电子设备100)上的视频内容投屏到显示设备101上,显示设备101显示投屏画面,此时用户可以使用手机退出视频播放界面,使用其他应用程序,例如使用通讯软件和朋友聊天等。当用户想要获取到显示设备101上显示界面的截屏图片,用户可以在显示设备101上触发截屏指令,显示设备101对显示界面进行截屏并将截屏图片发送给电子设备;或者用户可以在电子设备100上触发针对于显示设备101的显示界面的截屏指令,电子设备100指示显示设备101进行截屏,显示设备101对显示界面进行截屏并将截屏图片发送给电子设备。这样,解决了电子设备100在投屏过程中无法获取到投屏画面的截屏图片的问题。
基于上述应用场景,在一些实施例中,用户可以在电子设备100上触发针对于投屏画面的截屏指令,电子设备100对投屏界面进行截屏,获取并保存投屏画面。
其中,用户在使用某个应用程序时,若发生应用程序的切换或跳转至桌面进行操作,则电子设备可以将之前使用的应用程序作为后台应用程序保留在多任务队列中,保留在多任务队列中的后台应用程序可以保持运行状态。电子设备100运行一个应用程序,即为启动一个任务(task),一个任务中包括一个或多个activity。其中,activity是一个应用程序组件,用于实现电子设备100和用户的交互,一个activity提供了一个应用界面,电子设备100可以基于用户在应用界面中触发的事件作出响应。
每运行一个应用程序,电子设备100对应启动一个任务栈,一个任务栈中包括一个或多个activity。举例来说,电子设备100运行一个应用程序,启动该应用程序的任务栈,当一个新的activity(activity1)被建立,它显示在显示屏的最前端,处于任务栈的最顶端(Activity栈顶),此时activity1处于可见并可和用户交互的激活状态(active/running);如图11所示,当电子设备100接收到某一用户操作,需要显示新的应用界面,当新的activity(activity2)启动入栈时,原来处于栈顶的activity1会被压入到栈的第二层,activity2被放置在任务栈的最顶端,此时activity2为激活状态。若activity2为非全屏显示的应用界面或者为透明的应用界面,即activity2没有完全覆盖activity1,此时activity1为暂停状态(Paused),activity1依然保持所有的数据且在显示屏上可见,但已经不能与用户进行交互。若activity2完全覆盖activity1,此时activity1为停止状态(Stopped),activity1保持所有的数据但在显示屏上不可见。其中,终止状态的activity无法再次被激活。当应用程序被关闭时,该应用程序的任务栈中所有的activity也被终止了。
本申请实施例,电子设备100在显示设备101上投屏,电子设备100显示投屏界面,在投屏过程中,电子设备100可以切换到其他应用界面,电子设备100可以以后台运行的方式 运行投屏应用,例如上述图3d示出的投屏界面中,电子设备100不显示投屏内容。当电子设备100显示投屏界面,此时投屏界面对应的activity处于激活状态,当电子设备100切换到其他应用界面,此时其他应用界面对应的activity处于激活状态,而投屏界面对应的activity处于暂停或停止状态。这种情况下,电子设备100无法实时获取到投屏画面的播放进度。
可选的,电子设备100还可以以画中画的形式显示一个投屏窗口,该投屏窗口中显示投屏画面,该投屏窗口显示在任意应用界面之上,和应用界面互不干扰。例如上述图3e或图3f示出的界面,该投屏窗口351显示在任意的应用界面之上。该投屏窗口可以通过一系列的播放组件(例如videoview组件)来实现,本申请实施例也可以将投屏窗口的显示界面称为由activity对应实现的界面。这种情况下,电子设备100能够实时显示投屏画面并且获取到投屏画面的播放进度。
下面详细说明本申请实施例提供的又一种截屏方法的步骤实现流程,如图12所示,具体步骤可包括:
可选的,步骤S301:电子设备100在显示设备101上投屏第一画面。
显示设备101显示第一画面,该第一画面包括电子设备100投屏到显示设备101上的画面。其中步骤S301的具体描述可以参考上述步骤S101和步骤S102的相关描述,这里不再赘述。
步骤S302:电子设备100后台运行第一activity对应的第一画面,在显示屏上显示第二activity对应的第二画面。
第一画面和第二画面为不同画面。
在一些实施例中,电子设备100以画中画的形式显示第一activity对应的第一画面,在显示屏上显示第二activity对应的第二画面。其中,该画中画窗口显示在第二画面之上。
在一些实施例中,电子设备100在显示设备101上投屏,显示设备101显示投屏画面,第一画面即为投屏画面。在投屏过程中,电子设备100可以切换到其他应用界面(第二activity对应的第二画面),电子设备100可以以后台运行的方式运行投屏应用,即通过后台运行第一activity对应的第一画面,例如上述图3d示出的投屏界面中,电子设备100不显示投屏画面。可选的,电子设备100还可以以画中画的形式显示一个投屏窗口,投屏窗口显示在任意的应用界面(第二activity对应的第二画面)之上,该投屏窗口中显示投屏画面,即通过画中画的形式运行第一activity对应的第一画面,例如上述图3e或图3f示出的界面,该投屏窗口351显示在任意的应用界面之上。
步骤S303:电子设备100接收到针对于第一画面的截屏指令。
该截屏指令包括用于指示电子设备100进行截屏的用户操作,例如电子设备100提供的截屏控件的点击操作,又例如是用于截屏的语音指令、遥控指令、按键指令、手势、触屏操作(如双击、两指、三指下滑)等等。
在一些实施例中,截屏指令可以包括一组指令,例如点击截屏(指令1)然后确认截屏(指令2),又例如点击截屏(指令1)然后选择截屏区域(指令2)然后确认截屏(指令3),等等。可选的,截屏指令也可以为一个指令,例如点击截屏然后确认截屏中确认截屏的指令,又例如点击截屏然后选择截屏区域然后确认截屏中确认截屏的指令。
在一些实施例中,该截屏指令可以是其他设备(包括显示设备101)触发或发送的。
步骤S304:响应于接收到的截屏指令,电子设备100获取截屏图片,该截屏图片包括第一画面的全部或部分内容。
在一些实施例中,以投屏内容为第一视频为例,电子设备100可以在投屏界面中控制第 一视频在显示设备101上的播放进度、播放音量等等。当电子设备100切换投屏界面至其他应用程序的应用界面,不影响第一视频在显示设备101上的播放情况。此时电子设备100记录切换投屏界面至其他应用界面时的时刻为第一时刻,以及第一视频的播放进度时间点为第一时间点。可选的,电子设备100和显示设备101在投屏时可以进行时间校准,以确认电子设备100和显示设备101的时间一致。
可选的,当电子设备100显示该其他应用界面时接收到针对于投屏画面的截屏指令,电子设备100确定接收到截屏指令的时间为第二时刻,电子设备100确定第二时刻和第一时刻的时间差,基于该时间差和第一时间点确定第一视频当前的播放进度时间点为第二时间点。电子设备100获取在第二时间点上的第一视频的视频画面作为截屏画面,电子设备100获取截屏画面。
可选的,电子设备100接收到的截屏指令中包括时间戳,当电子设备100显示该其他应用界面时接收到针对于投屏画面的截屏指令,电子设备100确定该时间戳和第一时刻的时间差,基于该时间差和第一时间点确定第一视频当前的播放进度时间点为第二时间点。电子设备100获取在第二时间点上的第一视频的视频画面作为截屏画面,电子设备100获取截屏画面。
可选的,当电子设备100显示投屏界面时接收到针对于投屏画面的截屏指令,电子设备100确定第一视频的当前播放进度,电子设备100获取在当前播放进度上的第一视频的视频画面作为截屏画面,电子设备100获取截屏画面。可选的,电子设备100接收到的截屏指令中包括播放时间点,电子设备100基于该截屏指令确定在该播放时间点上的第一视频的视频画面作为截屏画面,电子设备100获取截屏画面。
在一些实施例中,电子设备100接收到截屏指令,电子设备100进入针对于投屏画面的截屏编辑模式,用户可以在投屏画面(第一画面)中选择想要截屏的区域,电子设备100基于用户选择的截屏区域获取该截屏区域下的画面,即电子设备100获取到截屏图片,该截屏图片为第一画面的全部或部分内容。
在一些实施例中,若电子设备100投屏到显示设备101上的内容为文档类内容(例如PPT、Word、图片集等),截屏指令中还可以包括页面标识,页面标识指示了文档中具体的页数、图片张数等信息。电子设备100接收到截屏指令,基于该页面标识,可以对该页面标识对应的画面进行截屏。
在一些实施例中,对于电子设备100以画中画的形式显示第一视频的投屏画面的情况,电子设备100还可以直接进行截屏,当电子设备100接收到针对于投屏画面的截屏操作,电子设备100对投屏窗口中正在播放的投屏画面进行截屏,获取到截屏画面。
在一些实施例中,当电子设备100接收到针对于投屏画面的截屏指令,电子设备100可以向显示设备101发送截屏请求以指示显示设备101对第一画面进行截屏,从而获取到截屏图片。这里可以参考上述步骤S205的相关描述,这里不再赘述。
步骤S305:电子设备100保存该截屏图片。其中,用户可以在图片类应用中查看该图片。
在一些实施例中,电子设备100接收到截屏图片后,电子设备100输出通知信息,提示用户已接收到截屏图片。可选的,基于该通知信息,用户可以查看该截屏图片。可选的,基于该通知信息,用户可以对该接收到的截屏图片进行编辑再保存,编辑方式包括对截屏图片进行剪切、标记、旋转、添加文本等等。
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当 使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线)或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如DVD)、或者半导体介质(例如固态硬盘)等。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,该流程可以由计算机程序来指令相关的硬件完成,该程序可存储于计算机可读取存储介质中,该程序在执行时,可包括如上述各方法实施例的流程。而前述的存储介质包括:ROM或随机存储记忆体RAM、磁碟或者光盘等各种可存储程序代码的介质。
Claims (18)
- 一种截屏系统,其特征在于,包括第一电子设备和第二电子设备,所述第一电子设备,用于显示第一画面,所述第一画面包括所述第二电子设备投屏到所述第一电子设备上的投屏画面;所述第一电子设备,还用于接收到针对于所述第一画面的截屏指令;所述第一电子设备,还用于基于所述截屏指令对第一画面进行截屏,获取截屏图片,所述截屏图片包括所述第一画面的全部或部分内容;所述第一电子设备,还用于将所述截屏图片发送到所述第二电子设备;所述第二电子设备,用于保存所述截屏图片。
- 一种截屏方法,其特征在于,所述方法包括:第一电子设备显示第一画面,所述第一画面包括第二电子设备投屏到所述第一电子设备上的投屏画面;所述第一电子设备接收到针对于所述第一画面的截屏指令;所述第一电子设备基于所述截屏指令对第一画面进行截屏,获取截屏图片,所述截屏图片包括所述第一画面的全部或部分内容;所述第一电子设备发送所述截屏图片给所述第二电子设备。
- 根据权利要求2所述的方法,其特征在于,所述截屏指令是所述第二电子设备发送的。
- 根据权利要求2所述的方法,其特征在于,所述第一电子设备接收到针对于所述第一画面的截屏指令,之前还包括:所述第一电子设备确定所述第一画面中的截屏区域,所述截屏指令为针对于所述截屏区域的指令。
- 根据权利要求4所述的方法,其特征在于,所述第一电子设备确定所述第一画面中的截屏区域,包括:所述第一电子设备接收到针对于所述第一画面的截屏触发操作;响应于所述截屏触发操作,所述第一电子设备输出截屏区域选择窗口,所述截屏区域选择窗口中包括两个或两个以上的截屏区域选项;所述第一电子设备基于接收到的针对于所述截屏区域选择窗口中其中一个截屏区域选项的用户操作,确定所述第一画面中的截屏区域。
- 根据权利要求2所述的方法,其特征在于,所述第一电子设备基于所述截屏指令对第一画面进行截屏,获取截屏图片,包括:所述第一电子设备基于所述截屏指令,通过图像识别技术识别出所述第一画面包括投屏窗口或投屏画面;所述第一电子设备获取截屏图片,所述截屏图片包括所述投屏画面或所述投屏窗口中的画面。
- 根据权利要求2所述的方法,其特征在于,所述第一电子设备基于所述截屏指令对第一画面进行截屏,获取截屏图片,包括:基于所述截屏指令,若所述第一电子设备检测到自身处于投屏状态,所述第一电子设备获取截屏图片,所述截屏图片包括所述投屏画面或所述投屏窗口中的画面。
- 根据权利要求2所述的方法,其特征在于,所述第一电子设备发送所述截屏图片给所述第二电子设备,之后还包括:所述第一电子设备保存所述截屏图片;所述第一电子设备显示所述截屏图片。
- 根据权利要求8所述的方法,其特征在于,所述第一电子设备保存所述截屏图片,包括:所述第一电子设备通过图像识别技术识别出所述截屏图片包括投屏画面,所述第一电子设备保存所述截屏图片。
- 一种截屏方法,其特征在于,所述方法包括:所述第二电子设备后台运行第一activity对应的第一画面,在显示屏上显示第二activity对应的第二画面;所述第二电子设备接收到针对于所述第一画面的截屏指令;响应于所述截屏指令,所述第二电子设备获取截屏图片,所述截屏图片包括所述第一画面的全部或部分内容。
- 根据权利要求10所述的方法,其特征在于,所述第一画面为投屏到第一电子设备上的投屏画面。
- 根据权利要求11所述的方法,其特征在于,所述截屏指令是所述第一电子设备发送的。
- 根据权利要求10所述的方法,其特征在于,所述第二电子设备接收到针对于所述第一画面的截屏指令,之前还包括:所述第二电子设备确定所述第一画面中的截屏区域,所述截屏指令为针对于所述截屏区域的指令。
- 根据权利要求10所述的方法,其特征在于,所述截屏指令中包括时间戳或页面标识,所述时间戳或所述页面标识对应的页面为第一画面。
- 根据权利要求10所述的方法,其特征在于,所述方法还包括:所述第二电子设备保存所述截屏图片;所述第二电子设备显示所述截屏图片。
- 根据权利要求15所述的方法,其特征在于,所述第二电子设备保存所述截屏图片, 包括:所述第二电子设备获取所述截屏图片之后,输出通知信息,所述通知信息用于提示用户已获取到所述截屏图片;所述第二电子设备接收到针对于所述通知信息的用户操作;响应于所述用户操作,所述第二电子设备提供针对于所述截屏图片的编辑方式;所述第二电子设备保存所述编辑后的截屏图片。
- 一种电子设备,其特征在于,包括:一个或多个处理器、一个或多个存储器;所述一个或多个存储器分别与所述一个或多个处理器耦合;所述一个或多个存储器用于存储计算机程序代码,所述计算机程序代码包括计算机指令;当所述计算机指令在所述处理器上运行时,使得所述电子设备执行如权利要求2-16所述的方法。
- 一种计算机可读介质,用于存储一个或多个程序,其中所述一个或多个程序被配置为被所述一个或多个处理器执行,所述一个或多个程序包括指令,所述指令用于执行如权利要求2-16所述的方法。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111418031.5 | 2021-11-25 | ||
CN202111418031.5A CN116166347A (zh) | 2021-11-25 | 2021-11-25 | 一种截屏方法及相关装置 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023093778A1 true WO2023093778A1 (zh) | 2023-06-01 |
Family
ID=86411959
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/133837 WO2023093778A1 (zh) | 2021-11-25 | 2022-11-23 | 一种截屏方法及相关装置 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN116166347A (zh) |
WO (1) | WO2023093778A1 (zh) |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104813679A (zh) * | 2012-10-08 | 2015-07-29 | 英特尔公司 | 屏幕截图抓取和共享的方法、设备和系统 |
CN108965961A (zh) * | 2018-09-05 | 2018-12-07 | 北京奇艺世纪科技有限公司 | 一种多媒体数据处理方法、装置及投屏设备 |
CN110647303A (zh) * | 2019-08-30 | 2020-01-03 | 北京文渊佳科技有限公司 | 一种多媒体播放方法、装置、存储介质及电子设备 |
US20210081160A1 (en) * | 2019-09-17 | 2021-03-18 | Aver Information Inc. | Image transmission device, image display system capable of remote screenshot, and remote screenshot method |
CN112770151A (zh) * | 2020-12-22 | 2021-05-07 | 深圳创维-Rgb电子有限公司 | 支持多人截取投屏播放画面的方法、装置和存储介质 |
CN112995721A (zh) * | 2019-12-02 | 2021-06-18 | 腾讯科技(深圳)有限公司 | 视频投放方法、富媒体内容的投放方法、装置和存储介质 |
CN113542841A (zh) * | 2021-06-16 | 2021-10-22 | 杭州当贝网络科技有限公司 | 投屏方法和投屏系统 |
-
2021
- 2021-11-25 CN CN202111418031.5A patent/CN116166347A/zh active Pending
-
2022
- 2022-11-23 WO PCT/CN2022/133837 patent/WO2023093778A1/zh unknown
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104813679A (zh) * | 2012-10-08 | 2015-07-29 | 英特尔公司 | 屏幕截图抓取和共享的方法、设备和系统 |
CN108965961A (zh) * | 2018-09-05 | 2018-12-07 | 北京奇艺世纪科技有限公司 | 一种多媒体数据处理方法、装置及投屏设备 |
CN110647303A (zh) * | 2019-08-30 | 2020-01-03 | 北京文渊佳科技有限公司 | 一种多媒体播放方法、装置、存储介质及电子设备 |
US20210081160A1 (en) * | 2019-09-17 | 2021-03-18 | Aver Information Inc. | Image transmission device, image display system capable of remote screenshot, and remote screenshot method |
CN112995721A (zh) * | 2019-12-02 | 2021-06-18 | 腾讯科技(深圳)有限公司 | 视频投放方法、富媒体内容的投放方法、装置和存储介质 |
CN112770151A (zh) * | 2020-12-22 | 2021-05-07 | 深圳创维-Rgb电子有限公司 | 支持多人截取投屏播放画面的方法、装置和存储介质 |
CN113542841A (zh) * | 2021-06-16 | 2021-10-22 | 杭州当贝网络科技有限公司 | 投屏方法和投屏系统 |
Also Published As
Publication number | Publication date |
---|---|
CN116166347A (zh) | 2023-05-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US12039144B2 (en) | Display information interaction method and related apparatus | |
WO2020259452A1 (zh) | 一种移动终端的全屏显示方法及设备 | |
WO2021017889A1 (zh) | 一种应用于电子设备的视频通话的显示方法及相关装置 | |
CN111316598B (zh) | 一种多屏互动方法及设备 | |
WO2020168965A1 (zh) | 一种具有折叠屏的电子设备的控制方法及电子设备 | |
WO2021213164A1 (zh) | 应用界面交互方法、电子设备和计算机可读存储介质 | |
EP4024168A1 (en) | Hand gesture interaction method and apparatus, and terminal device | |
WO2020134869A1 (zh) | 电子设备的操作方法和电子设备 | |
WO2022257977A1 (zh) | 电子设备的投屏方法和电子设备 | |
WO2020173370A1 (zh) | 一种应用图标的移动方法及电子设备 | |
WO2019072178A1 (zh) | 一种通知处理方法及电子设备 | |
WO2022100610A1 (zh) | 投屏方法、装置、电子设备及计算机可读存储介质 | |
US20230216990A1 (en) | Device Interaction Method and Electronic Device | |
JP7369281B2 (ja) | デバイス能力スケジューリング方法および電子デバイス | |
CN114040242B (zh) | 投屏方法、电子设备和存储介质 | |
WO2020221060A1 (zh) | 一种卡片处理方法及设备 | |
US12045446B2 (en) | Display interaction system, and display method and device | |
US20230117194A1 (en) | Communication Service Status Control Method, Terminal Device, and Readable Storage Medium | |
WO2020056684A1 (zh) | 通过转发模式连接的多tws耳机实现自动翻译的方法及装置 | |
CN114185503B (zh) | 多屏交互的系统、方法、装置和介质 | |
WO2022042326A1 (zh) | 显示控制的方法及相关装置 | |
WO2021031865A1 (zh) | 通话方法及装置 | |
EP4184905A1 (en) | Device recognition method and related apparatus | |
WO2024045801A1 (zh) | 用于截屏的方法、电子设备、介质以及程序产品 | |
CN115016697A (zh) | 投屏方法、计算机设备、可读存储介质和程序产品 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22897861 Country of ref document: EP Kind code of ref document: A1 |