WO2023078030A9 - Procédé et appareil de capture d'écran de terminal, support de stockage et dispositif électronique - Google Patents

Procédé et appareil de capture d'écran de terminal, support de stockage et dispositif électronique Download PDF

Info

Publication number
WO2023078030A9
WO2023078030A9 PCT/CN2022/124363 CN2022124363W WO2023078030A9 WO 2023078030 A9 WO2023078030 A9 WO 2023078030A9 CN 2022124363 W CN2022124363 W CN 2022124363W WO 2023078030 A9 WO2023078030 A9 WO 2023078030A9
Authority
WO
WIPO (PCT)
Prior art keywords
screen
area
screen capture
terminal
screenshot
Prior art date
Application number
PCT/CN2022/124363
Other languages
English (en)
Chinese (zh)
Other versions
WO2023078030A1 (fr
Inventor
秦晓东
Original Assignee
杭州逗酷软件科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 杭州逗酷软件科技有限公司 filed Critical 杭州逗酷软件科技有限公司
Publication of WO2023078030A1 publication Critical patent/WO2023078030A1/fr
Publication of WO2023078030A9 publication Critical patent/WO2023078030A9/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text

Definitions

  • the present disclosure relates to the technical field of electronic equipment, and in particular, to a terminal screen capture method, a terminal screen capture device, a computer-readable storage medium, and electronic equipment.
  • long screenshots can be used to take screenshots of pages for easy viewing.
  • the long screenshot operation is generally performed by acquiring a full-screen image, then comparing the images, and realizing splicing of the long screenshots.
  • a method for capturing a screen of a terminal including: determining an area to be captured on the screen of the terminal; responding to a long screen capture instruction for the area to be captured, acquiring at least two screenshots of the area to be captured Operating the generated at least two screen capture images; performing a splicing operation on the at least two screen capture images to obtain a long screen capture image corresponding to the area to be screen capture.
  • a screen capture device for a terminal including: a window determination module configured to determine an area to be captured on the terminal screen; an area determination module configured to respond to a long screen capture of the area to be captured An instruction to acquire at least two screen capture images generated by at least two screen capture operations on the area to be screen capture; the image acquisition module is configured to perform a splicing operation on the at least two screen capture images, and acquire the image corresponding to the area to be screen capture Long screenshot images.
  • a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the method for capturing a screen of a terminal according to any one of the above-mentioned terminals is implemented.
  • an electronic device including: a processor; and a memory configured to store executable instructions of the processor; wherein the processor is configured to execute the executable instructions to Execute the screen capture method of the terminal described in any one of the above.
  • FIG. 1 shows a schematic diagram of an application scenario in which a method for capturing a screen of a terminal or a device for capturing a screen of a terminal can be applied in an embodiment of the present disclosure
  • FIG. 2 shows a schematic structural diagram of an electronic device suitable for implementing an embodiment of the present disclosure
  • FIG. 3 schematically shows a flowchart of a method for capturing a screen of a terminal according to an exemplary embodiment of the present disclosure
  • Fig. 4 shows a schematic diagram of determining an area to be screen shot in an embodiment of the present disclosure
  • FIG. 5 shows a schematic flow chart of image comparison in an embodiment of the present disclosure
  • FIG. 6 shows a flow chart of determining a long screenshot image in an embodiment of the present disclosure
  • FIG. 7 shows a specific flow chart of taking a long screenshot in an embodiment of the present disclosure
  • Fig. 8 schematically shows a block diagram of an apparatus for capturing a screen of a terminal in an exemplary embodiment of the present disclosure.
  • Example embodiments will now be described more fully with reference to the accompanying drawings.
  • Example embodiments may, however, be embodied in many forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concept of example embodiments to those skilled in the art.
  • the described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
  • numerous specific details are provided in order to give a thorough understanding of embodiments of the present disclosure.
  • those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details being omitted, or other methods, components, devices, steps, etc. may be adopted.
  • well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.
  • FIG. 1 shows a schematic diagram of an application scenario in which a method for capturing a screen of a terminal or an apparatus for capturing a screen of a terminal in an embodiment of the present disclosure can be applied.
  • the screen capture method of the terminal can be applied to the application scenario of long screen capture of any terminal, as shown in FIG.
  • the terminal 101 may be various types of electronic devices capable of displaying content, such as smart phones, computers, tablet computers, etc., as long as the screen can be divided into regions.
  • the terminal may be in split-screen mode, and the terminal may be in left-right layout mode.
  • the terminal first detects whether it is in the split-screen mode, for example, it may detect whether it is in the left-right layout mode. If it is in the split-screen mode and a long screen capture instruction is received, a target split-screen is selected from multiple split-screens, and a target split-screen window corresponding to the target split-screen is determined. Further, an area to be captured is determined in the target split-screen window according to the interactive operation. In response to the long screen capture command, perform a long screen capture on the area to be screen capture, and obtain a screen capture result on one side as the processing result.
  • terminal screen capture method provided by the embodiments of the present disclosure may be completely executed by the terminal, and a corresponding terminal screen capture device may be set in the terminal.
  • FIG. 2 shows a schematic diagram of an electronic device suitable for implementing an exemplary embodiment of the present disclosure. It should be noted that the electronic device shown in FIG. 2 is only an example, and should not limit the functions and application scope of the embodiments of the present disclosure.
  • the electronic device of the present disclosure includes at least a processor and a memory, and the memory is used to store one or more programs, and when the one or more programs are executed by the processor, the processor can realize the screen capture method of the terminal according to the exemplary embodiment of the present disclosure .
  • the electronic device 200 may include: a processor 210, an internal memory 221, an external memory interface 222, a Universal Serial Bus (Universal Serial Bus, USB) interface 230, a charging management module 240, and a power management module 241, battery 242, antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, audio module 270, speaker 271, receiver 272, microphone 273, earphone interface 274, sensor module 280, display screen 290, camera module 291 , an indicator 292, a motor 293, a button 294, and a Subscriber Identification Module (Subscriber Identification Module, SIM) card interface 295, etc.
  • a processor 210 an internal memory 221, an external memory interface 222, a Universal Serial Bus (Universal Serial Bus, USB) interface 230, a charging management module 240, and a power management module 241, battery 242, antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, audio module 270, speaker 271, receiver 272, microphone 273, earphone interface 274, sensor module 280, display screen 290, camera module 291
  • the sensor module 280 may include a depth sensor, a pressure sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, and a bone conduction sensor.
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 200 .
  • the electronic device 200 may include more or fewer components than shown in the illustration, or combine certain components, or separate certain components, or arrange different components.
  • the illustrated components may be realized in hardware, software, or a combination of software and hardware.
  • the processor 210 may include one or more processing units, for example: the processor 210 may include an application processor (Application Processor, AP), a modem processor, a graphics processor (Graphics Processing Unit, GPU), an image signal processor (Image Signal Processor, ISP), controller, video codec, digital signal processor (Digital Signal Processor, DSP), baseband processor and/or neural network processor (Neural-network Processing Unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors. In addition, a memory may also be provided in the processor 210 for storing instructions and data.
  • the USB interface 230 is an interface conforming to the USB standard specification, specifically, it may be a MiniUSB interface, a MicroUSB interface, a USB Type C interface, and the like.
  • the USB interface 230 can be used to connect a charger to charge the electronic device 200, and can also be used to transmit data between the electronic device 200 and peripheral devices. It can also be used to connect headphones and play audio through them.
  • the interface can also be used to connect other electronic devices and the like.
  • the charging management module 240 is configured to receive charging input from the charger.
  • the charger may be a wireless charger or a wired charger.
  • the power management module 241 is used for connecting the battery 242 , the charging management module 240 and the processor 210 .
  • the power management module 241 receives the input of the battery 242 and/or the charging management module 240 to supply power for the processor 210 , the internal memory 221 , the display screen 290 , the camera module 291 and the wireless communication module 260 .
  • the wireless communication function of the electronic device 200 may be realized by the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, a modem processor, a baseband processor, and the like.
  • the mobile communication module 250 can provide wireless communication solutions including 2G/3G/4G/5G applied on the electronic device 200 .
  • the wireless communication module 260 can provide wireless local area network (Wireless Local Area Networks, WLAN) (such as wireless fidelity (Wireless Fidelity, Wi-Fi) network), bluetooth (Bluetooth, BT), global navigation satellite Wireless communication solutions such as Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), and Infrared (IR).
  • WLAN wireless Local Area Networks
  • WLAN wireless Local Area Networks
  • GNSS Global Navigation Satellite System
  • FM Frequency Modulation
  • NFC Near Field Communication
  • IR Infrared
  • the electronic device 200 realizes the display function through the GPU, the display screen 290 and the application processor.
  • the GPU is a microprocessor for blurring images, and is connected to the display screen 290 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 210 may include one or more GPUs that execute program instructions to generate or alter display information.
  • the electronic device 200 can realize the shooting function through the ISP, the camera module 291 , the video codec, the GPU, the display screen 290 and the application processor.
  • the electronic device 200 can include 1 or N camera modules 291, where N is a positive integer greater than 1. If the electronic device 200 includes N cameras, one of the N cameras is the main camera, and the others can be It is a secondary camera, such as a telephoto camera.
  • the internal memory 221 may be used to store computer-executable program codes including instructions.
  • the internal memory 221 may include an area for storing programs and an area for storing data.
  • the external memory interface 222 can be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the electronic device 200.
  • the electronic device 200 may implement audio functions through an audio module 270 , a speaker 271 , a receiver 272 , a microphone 273 , an earphone interface 274 , an application processor, and the like. Such as music playback, recording, etc.
  • the audio module 270 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal.
  • the audio module 270 may also be used to encode and decode audio signals.
  • the audio module 270 can be set in the processor 210 , or some functional modules of the audio module 270 can be set in the processor 210 .
  • the speaker 271 is used for converting audio electrical signals into sound signals.
  • the electronic device 200 can listen to music through the speaker 271, or listen to hands-free calls.
  • Receiver 272, also called “earpiece”, is used to convert audio electrical signals into audio signals.
  • the electronic device 200 receives a call or a voice message, the receiver 272 can be placed close to the human ear to listen to the voice.
  • the microphone 273, also called “microphone” or “microphone”, is used to convert sound signals into electrical signals.
  • the user can make a sound by approaching the microphone 273 with a human mouth, and input the sound signal to the microphone 273 .
  • the electronic device 200 may be provided with at least one microphone 273 .
  • the earphone interface 274 is used for connecting wired earphones.
  • the depth sensor is used to acquire depth information of a scene.
  • the pressure sensor is used to sense the pressure signal and convert the pressure signal into an electrical signal.
  • the gyro sensor can be used to determine the motion posture of the electronic device 200 .
  • the barometric pressure sensor is used to measure air pressure.
  • Magnetic sensors include Hall sensors.
  • the electronic device 200 may use a magnetic sensor to detect opening and closing of the flip leather case.
  • the acceleration sensor can detect the acceleration of the electronic device 200 in various directions (generally three axes).
  • Distance sensors are used to measure distance.
  • Proximity light sensors may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes.
  • the fingerprint sensor is used to collect fingerprints.
  • a temperature sensor is used to detect temperature.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 290 .
  • the ambient light sensor is used to sense the ambient
  • the keys 294 include a power key, a volume key and the like. Key 294 may be a mechanical key. It can also be a touch button.
  • the motor 293 can generate a vibrating prompt. The motor 293 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback.
  • the indicator 292 can be an indicator light, which can be used to indicate the charging status, the change of the battery capacity, and also can be used to indicate messages, missed calls, notifications and so on.
  • the SIM card interface 295 is used for connecting a SIM card. The electronic device 200 interacts with the network through the SIM card to implement functions such as calling and data communication.
  • the present application also provides a computer-readable storage medium.
  • the computer-readable storage medium may be included in the electronic device described in the above embodiments, or exist independently without being assembled into the electronic device.
  • a computer readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections with one or more wires, portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
  • a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.
  • the computer-readable storage medium may send, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
  • Program code embodied on a computer readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wires, optical cables, RF, etc., or any suitable combination of the foregoing.
  • the computer-readable storage medium bears one or more programs, and when the above one or more programs are executed by an electronic device, the electronic device is made to implement the methods described in the following embodiments.
  • each block in a flowchart or block diagram may represent a module, program segment, or portion of code that includes one or more logical functions for implementing specified executable instructions.
  • the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved.
  • each block in the block diagrams or flowchart illustrations, and combinations of blocks in the block diagrams or flowchart illustrations can be implemented by a dedicated hardware-based system that performs the specified function or operation, or can be implemented by a A combination of dedicated hardware and computer instructions.
  • the units described in the embodiments of the present disclosure may be implemented by software or by hardware, and the described units may also be set in a processor. Wherein, the names of these units do not constitute a limitation of the unit itself under certain circumstances.
  • Fig. 3 schematically shows a flow chart of a terminal screen capture method according to an exemplary embodiment of the present disclosure, and the terminal screen capture method may be applied to an application scenario of partitioning and long screen capture of a display screen of a terminal capable of area division.
  • the screen capture method of the terminal may include steps S310 to S330, which are described in detail as follows:
  • step S310 an area to be captured on the screen of the terminal is determined.
  • the terminal may be an electronic device that can be used for display, such as a smart phone, a computer, and a tablet computer.
  • the terminal may be in a normal browsing mode, for example, displaying a browser interface or a text interface, an application program interface, and the like.
  • the terminal may be a single-screen terminal or a multi-screen terminal such as a folding screen.
  • the area to be captured may be any one of multiple areas obtained by dividing a single screen, or may be an area corresponding to any screen of a multi-screen terminal such as a folding screen. Based on this, in the embodiment of the present disclosure, it is possible to perform partition screenshots on terminals capable of partitioning different regions. Dividing different areas may be splitting the screen of the folding screen terminal to obtain different areas or arbitrarily dividing the screen of the single-screen terminal to obtain multiple different areas, and the embodiments of the present disclosure are not limited thereto.
  • the terminal can be in single-screen mode or split-screen mode, which is determined according to actual needs.
  • Single screen mode means that the screen is a whole without any split screen. If the current state of the terminal only displays one display content, it can be in single-screen mode. If the current state of the terminal needs to display multiple display contents, it can be in a split-screen mode.
  • the terminal can be directly in split-screen mode, or switched from single-screen mode to split-screen mode. For example, if the terminal receives a message from an instant chat application while displaying a video image, the terminal may be switched from a single-screen mode to a split-screen mode.
  • the terminal may be a folding screen terminal, and the terminal is in a split-screen mode as an example for description.
  • the terminal can include multiple split screens, and the multiple split screens are independent of each other.
  • the split screen may be a part of the whole screen, and the number of split screens may be at least two, and two split screens are taken as an example for illustration here.
  • the content displayed on each split screen may be the same or different, which is not limited here.
  • the layout mode of the multiple split-screens may be a left-right layout mode, or a top-bottom layout mode, which is determined according to actual needs.
  • the screen ratios occupied by the split screens can be the same or different, and are set according to actual needs. Based on this, the area to be captured can be one of the multiple split screens.
  • one of the multiple split-screens of the terminal can be selected as the target split-screen, and the target split-screen window corresponding to the target split-screen can be further determined.
  • the area to be captured can be part or all of the target split-screen window.
  • the target split screen is determined according to the trigger operation, and the top-level main window of the target split screen is obtained from the window stack corresponding to the target split screen as the target split screen window.
  • the trigger operation may be a click operation, a press operation, or other types of touch operations acting on the terminal.
  • the trigger operation is a click operation as an example for illustration.
  • the position of the touch point that triggers the operation can be acquired, and it can be determined which split screen the position of the touch point that triggers the operation is within, so as to determine the target split screen.
  • the target split screen can also be a default split screen, and can also be determined according to actual needs, which is not specifically limited here.
  • the window stack refers to the storage location of the windows corresponding to different split screens.
  • the window stacks corresponding to different split screens are different and independent of each other, that is, the windows of different split screens are stored separately. For each split screen, it includes multiple windows, and the multiple windows are stored layer by layer.
  • the target split-screen window refers to the top-level main window corresponding to the target split-screen on the specified side.
  • a top-level main window represents a window that overlays other windows.
  • the target split-screen window corresponding to the target split-screen can be acquired according to the parameter corresponding to the acquisition request by calling the access interface. For example, in a terminal in the left-right layout mode, the top-level main window of the right split screen is obtained according to a click operation on the right split screen.
  • some terminals may not be suitable for long screenshots due to abnormal reasons. Therefore, after receiving the screenshot command, first check whether the terminal is in split-screen mode, and after the terminal is in split-screen mode, it is necessary to first obtain the target split-screen window, that is, the top-level main window on the specified side, to avoid invalid operations and improve long-screen capture operations effectiveness.
  • step S320 at least two screenshot images generated by at least two screenshot operations on the region to be captured are acquired in response to a long screenshot instruction on the region to be captured.
  • the long screen capture command means to perform a long screen capture operation on the content displayed on the terminal's operation interface, that is, to perform multiple screenshots on the terminal's operation interface by simulating the sliding operation interface, so as to form a single screen based on multiple screenshots. Full long screenshot.
  • the long screenshot command can be triggered by a button operation or a touch operation. For example, triggering the corresponding physical button, triggering the long screen capture button displayed on the screen capture interface, triggering the specified long screen capture gesture, etc. to trigger the long screen capture, in addition to triggering the long screen capture command in other ways.
  • the terminal When receiving the long screen capture instruction, the terminal can be switched from the current state to the long screen capture mode. Moreover, a prompt mark may be provided on the operation interface of the terminal, so as to display the range of the long screenshot through the prompt mark.
  • the long screen capture command can be triggered based on the screen capture command, or the long screen capture command can be directly triggered without enabling the screen capture command.
  • the long screen capture command before detecting the long screen capture command, it is also possible to detect whether the screen capture command is received, and then further detect whether the long screen capture command is received on the basis of receiving the screen capture command.
  • the screen capture command does not need to be enabled, it is not necessary to detect whether the screen capture command is received, but to directly detect whether the long screen capture command is received, and no special limitation is set here.
  • a screenshot instruction For example, it is first detected whether a screenshot instruction is received, and after the screenshot instruction is received and the terminal is in the split-screen mode, it may be further detected whether a long screenshot instruction is received. If a long screen capture instruction is received, responding to the long screen capture command triggers the terminal to enter the long screen capture mode. In the long screen capture mode, the user operation acting on the operation interface of the terminal can be received, and the content to be captured is determined on the operation interface according to the user operation. to take a screenshot.
  • the at least two screenshot images may be determined according to the operating position of the interactive operation of the area to be captured and the screen ratio of the area to be captured.
  • the interactive operation can be any type of operation acting on the area to be captured, as long as it can update the display content of the area to be captured in the current state.
  • the interactive operation may be a slide event, a slide press event, etc., or a button operation, etc.
  • the interactive operation is a slide event as an example for illustration.
  • the direction of the sliding event may be from bottom to top or from top to bottom.
  • the area to be captured can be increased; when the direction of the sliding event is from top to bottom, the area to be captured can be reduced.
  • the display screen of the operation interface is content A; after receiving the sliding event, the display screen of the operation interface is content B, and content A and content B may be partially the same or completely different.
  • the sliding event can be applied to any position of the area to be captured, as long as the display screen of the area to be captured can be updated.
  • the range of the area to be captured can be adjusted, that is, the image contrast area can be adjusted. Since the split screens on different sides are independent of each other, when one side split screen receives an interactive operation to update the display screen, the display screen of the other side split screen remains unchanged and will not be updated with the interactive operation, which may cause normal sliding and to splice.
  • at least two screenshot images may be determined in the following two ways.
  • Mode 1 Determine a reference area according to the operating position of the interactive operation, and perform at least two screen capture operations on the reference area to obtain at least two initial screen capture images; A cropping operation is performed on the initial screenshot images of the areas other than the area to be captured in the two initial screenshot images to obtain the at least two screenshot images.
  • the operation position refers to the bottom position of the operation interface where the interactive operation ends.
  • the bottom position can be obtained, and the reference area is determined according to the bottom position of the operation interface at the end of the interaction operation and the initial position of the operation interface.
  • the reference area refers to the entire area corresponding to the operation position of the interaction operation, including the area to be captured. and other areas.
  • the initial position of the operation interface refers to the top position of the operation interface of the terminal before an interactive operation is detected.
  • the area to be captured can be a rectangle or other shapes.
  • the width of the area to be captured can be consistent with the width of the target split-screen window, or can be different. For example, referring to diagram B in FIG.
  • both screen 403 and screen 404 are different split screens of the folding screen terminal 400 .
  • the area to be captured can be the entire screen area corresponding to the target split screen 403 . Based on this, the screen ratio of the area to be captured refers to the proportion of the split screen where the area to be captured is located.
  • images in other areas outside the area to be captured can be cropped.
  • initial screenshot images of other areas may be deleted.
  • the terminal is a folding screen terminal with a left-right layout mode
  • the target split screen is the right split screen
  • the initial screenshot image of the left split screen can be cropped and deleted to adjust the image comparison area, and then obtain at least Two screenshot images for improved accuracy.
  • Mode 2 Determine the reference area including the area to be captured according to the operation position of the interactive operation, delete the areas in the reference area except the area to be captured according to the screen ratio, and perform the screenshot The region performs at least two screenshot operations to acquire the plurality of at least two screenshot images. That is, firstly delete other areas other than the area to be captured according to the proportion of the screen, and then perform a long screenshot operation on the area to be captured after deletion, so as to obtain at least two screenshot images.
  • the terminal 400 is in a left-right layout mode, and the split screens of the terminal include a split screen 401 and a split screen 402 . If the trigger operation is within the range of the split screen 402, then the split screen 402 is determined as the target split screen. When the terminal used for the interactive operation of the target split screen is at position C, the area between the bottom position corresponding to position C and the initial position may be determined as the area to be captured.
  • the terminal 400 is a folding screen terminal in a left-right layout mode, and the split screens of the terminal include a split screen 403 and a split screen 404 .
  • the split screen 403 is determined as the target split screen.
  • the terminal used for the interactive operation of the target split screen is at the position D
  • the area between the bottom position corresponding to the position D and the initial position may be determined as the area to be captured.
  • other split screens other than the target split screen where the area to be captured can be deleted, and a long screen capture operation can be performed to obtain at least two screenshot images.
  • step S330 a splicing operation is performed on the at least two screenshot images to obtain a long screenshot image corresponding to the region to be screenshot.
  • the area to be screen-captured may include multiple display images, it is necessary to perform screen-capture operations on the multiple display images to implement a long screen-capture operation.
  • the screen capture operation of each display screen can obtain a screen capture image to obtain at least two screen capture images, and at least two screen capture images can be spliced to obtain a corresponding long screen capture image.
  • Fig. 5 schematically shows a flow chart of determining a long screenshot image, referring to Fig. 5, which mainly includes the following steps:
  • step S510 a screenshot image of the initial image corresponding to the region to be screenshot is acquired.
  • the initial image refers to the image corresponding to the display screen of the area to be captured before the interactive operation is received. That is, before the interactive operation is received, the image of the display screen between the top position and the bottom position of the target split-screen window where the area to be captured is located.
  • the initial image is equivalent to the image obtained by taking the first screenshot.
  • step S520 when the interactive operation ends, a screenshot image of the current image corresponding to the region to be screenshot is acquired.
  • the current image refers to the image corresponding to the display screen of the area to be captured when the interactive operation is received and the interactive operation ends. That is, the image between the top position and the bottom position of the target split-screen window when the interactive operation ends.
  • the current image is the image obtained from the last screenshot.
  • step S530 the screenshot image of the current image is compared with the screenshot image of the initial image, and the at least two screenshot images are spliced according to the comparison result to determine the long screenshot image.
  • the initial image may overlap with the current image.
  • the overlapping area and non-overlapping area may be determined as the comparison result.
  • stitching the comparison results the same image represented by the overlapping area of the initial image and the current image can be overlaid, while the different images represented by the non-overlapping area can be kept.
  • the overlaid same image and different images are further spliced according to the display sequence of all display images.
  • the interactive operation can be performed multiple times in a row, it is possible to compare all the screenshot images of the area to be captured corresponding to the interactive operation, cover the overlapping area between all the screenshot images, and splicing after covering, to get a long screenshot image of the area to be screenshotted.
  • screen capture parameters may be determined according to the screen size and screen mode of the terminal, and a long screen capture image may be acquired according to the screen capture parameters.
  • the screen size state is used to describe whether the operation interface of the terminal is in a large screen state.
  • the large-screen state may be that the size of the operation interface is larger than the general size. For example, it can be considered that a tablet computer and a folded mobile phone after unfolding are both in a large-screen state.
  • the screen mode is used to indicate whether the terminal splits the screen. Based on this, appropriate screen capture parameters can be selected in combination with the screen size status of the terminal and whether it is in the split screen mode to determine the long screen capture image of the area to be screen capture.
  • Fig. 6 schematically shows a flow chart of determining a long screenshot image of an area to be screen-shot according to the screenshot parameters, referring to Fig. 6, which mainly includes the following steps:
  • step S610 it is determined whether the screen size state of the terminal is a large screen state. If yes, go to step S620. If not, go to step S630.
  • step S620 it is determined whether the terminal is in a split-screen mode. If yes, go to step S640. If not, go to step S650.
  • the split-screen mode refers to the left-right layout mode, that is, when it is determined that the terminal is in a large-screen state, it is further determined whether the terminal is in the left-right layout mode.
  • step S630 if it is determined that the screen size state of the terminal does not belong to the large screen state, the screen capture parameter is determined according to the pixel parameter and the displacement parameter.
  • the long screenshot parameter can be used for long screenshot processing.
  • the long screenshot parameter is to ensure the normal response of the simulated interactive operation and the normal operation of image comparison and stitching.
  • the types of long screenshot parameters mainly include pixel parameters and displacement parameters.
  • Pixel parameters can include but are not limited to: maximum error tolerance rate of pixel comparison, minimum error tolerance rate of pixel comparison; displacement parameters can include but not limited to: displacement offset during comparison Amount (that is, the position offset of up, down, left, right, and overall indentation), the offset of cutting and splicing positions, whether to fix the sliding splicing area, and the distance of each sliding.
  • the long screenshot parameters are determined, according to the above long screenshot parameters, at least two screenshot images corresponding to the display screen of the area to be screenshot can be spliced according to the display order, so as to obtain an accurate long screenshot image.
  • the display order refers to the order in which at least two screenshots are displayed.
  • step S640 if it is determined that the screen size state of the terminal is a large screen state and the screen mode belongs to a split screen mode, determine the screenshot parameters according to the pixel parameters and the displacement parameters.
  • the screen capture parameters can be determined by using the vertical screen capture parameters, and the vertical screen capture parameters can be the same as the long screen capture parameters.
  • Types of vertical screen capture parameters mainly include pixel parameters and displacement parameters.
  • Pixel parameters can include but are not limited to: pixel comparison maximum error tolerance rate, pixel comparison minimum error tolerance rate; displacement parameters can include but are not limited to: displacement deviation during comparison The amount of displacement (that is, the position offset of up, down, left, right, and overall retraction), the offset of the cutting and splicing position, whether the sliding splicing area is fixed, and the distance of each sliding.
  • step S650 if it is determined that the screen size state of the terminal is a large screen state and the screen mode does not belong to the split screen mode, determine the screenshot parameters according to the pixel parameter, the displacement parameter and the horizontal axis parameter.
  • the large-screen screenshot parameters may be determined according to the vertical-screen screenshot parameters and the horizontal-axis parameters.
  • the horizontal axis parameter may include an interactive operation horizontal axis position parameter and a horizontal axis range of the area to be captured (that is, a horizontal axis range of the stitching area).
  • the layout of the terminal is a left-right layout mode, that is, there are two different split screens, in order to avoid the influence between different split screens, it is necessary to perform cropping operations on other split screens other than the target split screen. Therefore, the range of the horizontal axis of the area to be captured will change. Based on this, the horizontal axis parameters also need to be adjusted. Specifically, the position of the horizontal axis of the interactive operation can be fixed according to the interface of the screen-to-body area, and the range of the horizontal axis of the area to be captured can be adjusted according to the position of the horizontal axis of the interactive operation.
  • At least two screen capture images can be obtained by taking a screen capture of the area to be screen capture according to the vertical screen capture parameters and the horizontal axis parameters, and then splicing the at least two screen capture images according to the display order to obtain a long screen capture image in a large screen state.
  • the technical solution in Figure 6 determines the corresponding screen capture parameters according to the screen size and screen mode of the terminal in different application scenarios, and then can accurately determine the screen capture parameters corresponding to the area to be screen captured, and the display screen of the area to be screen captured At least two corresponding screenshot images are accurately spliced to obtain a long screenshot image in the left-right layout mode.
  • FIG. 7 schematically shows an overall flow chart of a long screen capture operation, which is specifically applied to an application scenario of performing a long screen capture on one side of a folding screen terminal.
  • FIG. 7 mainly includes the following steps:
  • step S701 screen capture is started.
  • step S702 it is determined whether the terminal is in a left-right layout mode. If yes, go to step S703.
  • step S703 the top-level main window on the specified side is acquired to accurately find the main window.
  • the specified side can be any side, such as left or right, depending on the trigger operation.
  • step S704 an interactive operation acting on the main window is detected.
  • An interactive operation may be, for example, a sliding event.
  • step S705 a long screenshot is started.
  • step S706 it is determined whether the screen size state of the terminal is a large screen state. If not, go to step S707. If yes, go to step S708.
  • step S707 the long screenshot parameter is maintained.
  • step S708 it is determined whether the terminal is in the left-right layout mode. If yes, go to step S709. If not, go to step S711.
  • step S709 the vertical screen screenshot parameters are loaded.
  • step S710 the horizontal axis interactive operation position is fixed according to the screen-to-body area interface, and the range of the horizontal axis of the splicing area is adjusted.
  • step S711 the parameters for large-screen screenshot are loaded. Wherein, the screenshot parameters of the large screen are determined according to step S712.
  • step S712 a horizontal-axis interactive operation position parameter and a horizontal-axis range of the splicing area are newly added on the basis of the vertical screen screenshot parameters.
  • the top-level window on the specified side is obtained, which is used to accurately distribute simulated interactive operations on the specified window, so that the interface can be scrolled, and it is convenient to obtain screenshots before and after scrolling.
  • different top-level windows can be optimized in a targeted manner.
  • the technical solution in FIG. 7 can accurately determine the target split-screen window because the target split-screen window is determined when sliding one side of the window respectively, improving the rationality and splicing accuracy. Since the terminal is in split-screen mode, different split-screens are independent of each other, so different split-screens will not interfere with the image comparison effect, improve the accuracy of image comparison, and enable precise long-screen capture operations. Since the long screen capture can be performed on one side of the split screen, the limitation of only taking long screen capture on the entire screen is avoided, the application range is increased, the convenience is improved, and the utility model has better versatility.
  • the technical solution in the embodiments of the present disclosure can ensure that, under a large screen, for the left and right layout of the operation interface, the normal splicing of long screenshots in the specified area to be screenshots can be successfully completed, and user experience can be improved. Through the expansion of system capabilities, it has better versatility. For split-screen display scenarios, adjust the image comparison method to optimize the splicing effect of long screenshots to meet the needs of long screenshots in left and right split-screen scenarios.
  • Fig. 8 schematically shows a block diagram of an apparatus for capturing a screen of a terminal according to an exemplary embodiment of the present disclosure.
  • the screen capture device 800 of the terminal may include the following modules:
  • the area determination module 801 is configured to determine an area to be captured on the terminal screen
  • the screenshot module 802 is configured to acquire at least two screenshot images generated by at least two screenshot operations on the region to be captured in response to a long screenshot instruction on the region to be captured;
  • the image acquiring module 803 is configured to perform a splicing operation on the at least two screenshot images, and acquire a long screenshot image corresponding to the area to be captured.
  • the area determination module includes: a split screen determination module configured to select a target split screen from multiple split screens of the terminal; a window acquisition module configured to select a target split screen from the target Obtain the top-level main window of the target split-screen in the window stack corresponding to the split-screen as the target split-screen window, the window stack is configured to represent the storage locations of windows corresponding to multiple split-screens; the region acquisition module is configured to The target split-screen window acquires the area to be captured.
  • the screen capture module includes: a screen capture control module configured to determine the at least Two screenshot images.
  • the screen capture control module includes: a first screen capture module, configured to determine a reference area containing the area to be screen captured according to the operation position of the interaction operation, and perform an operation on the reference area Performing at least two screen capture operations to obtain at least two initial screen capture images; the cropping module is configured to, according to the screen ratio, perform initial capture of other areas of the at least two initial screen capture images except the area to be screen capture A cropping operation is performed on the screenshot images to obtain the at least two screenshot images.
  • the screen capture control module includes: a second screen capture module configured to determine a reference area including an area to be screen captured according to the operation position of the interactive operation, and delete the screen capture area according to the screen ratio. other areas in the reference area except the area to be screen-captured, and perform at least two screen-capture operations on the area to be screen-captured to obtain the plurality of at least two screen-capture images.
  • the image acquisition module includes: an initial image screenshot module configured to acquire a screenshot image of an initial image corresponding to the region to be screenshot; a current image screenshot module configured to When the interactive operation ends, obtain the screenshot image of the current image corresponding to the area to be screen-captured; the comparison module is configured to compare the screenshot image of the current image with the screenshot image of the initial image, and compare the screenshot images according to the comparison result The at least two screenshot images are spliced to determine the long screenshot image.
  • the comparison module includes: an area division module configured to compare the screenshot image of the current image with the screenshot image of the initial image, and acquire the at least two screenshot images The overlapping area and the non-overlapping area; the splicing module is configured to cover the overlapping area, and perform splicing operation on the non-overlapping area except the overlapping area to obtain the long screenshot image.
  • the image acquisition module includes: a parameter determination module, configured to determine screen capture parameters according to the screen size state and screen mode of the terminal, and perform the at least two screen capture parameters according to the screen capture parameters.
  • the two screenshot images are spliced to obtain the long screenshot image.
  • the parameter determination module includes: a first determination module configured to, if it is determined that the screen size state of the terminal is a large screen state and the screen mode does not belong to the split screen mode, according to The pixel parameter, the displacement parameter, and the horizontal axis parameter determine the screen capture parameter; the second determination module is configured to determine that the screen size state of the terminal is a large screen state and the screen mode belongs to the split screen mode, or the terminal The screen size state does not belong to the large screen state, and the screenshot parameters are determined according to the pixel parameters and the displacement parameters.
  • each functional module of the screen capture device for a terminal in the embodiment of the present disclosure is the same as that in the above embodiment of the screen capture method for a terminal, it will not be repeated here.
  • the example implementations described here can be implemented by software, or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of the present disclosure can be embodied in the form of software products, and the software products can be stored in a non-volatile storage medium (which can be CD-ROM, U disk, mobile hard disk, etc.) or on the network , including several instructions to make a computing device (which may be a personal computer, a server, a terminal device, or a network device, etc.) execute the method according to the embodiments of the present disclosure.
  • a computing device which may be a personal computer, a server, a terminal device, or a network device, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention a trait au domaine technique des dispositifs électroniques et concerne un procédé et un appareil de capture d'écran de terminal, un support de stockage lisible par ordinateur et un dispositif électronique. Le procédé de capture d'écran de terminal selon l'invention consiste : à déterminer une zone à capturer sur un écran de terminal (S310) ; à obtenir, en réponse à une instruction de capture d'écran long par rapport à ladite zone, au moins deux images capturées générées par au moins deux opérations de capture d'écran sur ladite zone (S320) ; et à joindre lesdites deux images capturées au moins afin d'obtenir une image capturée longue correspondant à ladite zone (S330). Le procédé selon l'invention permet de réaliser une capture d'écran long sur ladite zone, et d'améliorer la précision et la polyvalence de capture d'écran.
PCT/CN2022/124363 2021-11-03 2022-10-10 Procédé et appareil de capture d'écran de terminal, support de stockage et dispositif électronique WO2023078030A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111294465.9A CN114020387A (zh) 2021-11-03 2021-11-03 终端的截屏方法及装置、存储介质和电子设备
CN202111294465.9 2021-11-03

Publications (2)

Publication Number Publication Date
WO2023078030A1 WO2023078030A1 (fr) 2023-05-11
WO2023078030A9 true WO2023078030A9 (fr) 2023-08-03

Family

ID=80060154

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/124363 WO2023078030A1 (fr) 2021-11-03 2022-10-10 Procédé et appareil de capture d'écran de terminal, support de stockage et dispositif électronique

Country Status (2)

Country Link
CN (1) CN114020387A (fr)
WO (1) WO2023078030A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114020387A (zh) * 2021-11-03 2022-02-08 杭州逗酷软件科技有限公司 终端的截屏方法及装置、存储介质和电子设备
CN114691007A (zh) * 2022-04-12 2022-07-01 Oppo广东移动通信有限公司 截屏方法、截屏系统、截屏装置、存储介质和电子设备

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017118391A1 (fr) * 2016-01-05 2017-07-13 腾讯科技（深圳）有限公司 Procédé de capture d'écran et dispositif de capture d'écran
KR20180017746A (ko) * 2016-08-10 2018-02-21 엘지전자 주식회사 이동 단말기 및 그 제어방법
CN107229401A (zh) * 2017-04-18 2017-10-03 硕诺科技（深圳）有限公司 一种移动终端长截屏方法
CN107765952B (zh) * 2017-11-07 2020-04-28 Oppo广东移动通信有限公司 截屏方法、装置及终端
CN109086113B (zh) * 2018-07-23 2021-06-15 Oppo（重庆）智能科技有限公司 截屏方法、装置以及移动终端
CN109144370B (zh) * 2018-09-30 2022-04-29 珠海豹趣科技有限公司 一种截屏方法、装置、终端及计算机可读介质
CN110032314B (zh) * 2019-03-12 2022-06-10 中国平安人寿保险股份有限公司 一种长截屏方法、装置、存储介质和终端设备
CN110297681B (zh) * 2019-06-24 2024-06-11 腾讯科技（深圳）有限公司 图像处理方法、装置、终端及存储介质
CN110658971B (zh) * 2019-08-26 2021-04-23 维沃移动通信有限公司 一种截屏方法及终端设备
CN113419655A (zh) * 2021-05-28 2021-09-21 广州三星通信技术研究有限公司 用于电子终端的应用截屏方法和装置
CN114020387A (zh) * 2021-11-03 2022-02-08 杭州逗酷软件科技有限公司 终端的截屏方法及装置、存储介质和电子设备

Also Published As

Publication number Publication date
WO2023078030A1 (fr) 2023-05-11
CN114020387A (zh) 2022-02-08

Similar Documents

Publication Publication Date Title
WO2021136268A1 (fr) Procédé de photographie et dispositif électronique
WO2023078030A9 (fr) Procédé et appareil de capture d'écran de terminal, support de stockage et dispositif électronique
US9514512B2 (en) Method and apparatus for laying out image using image recognition
CN109862267B (zh) 一种拍摄方法及终端设备
US20140149927A1 (en) Display device and method of controlling the same
CN111371949A (zh) 应用程序切换方法、装置、存储介质与触控终端
CN111065001B (zh) 视频制作的方法、装置、设备及存储介质
KR20130097605A (ko) 영상 통화 서비스 제공 방법 및 장치
KR102090948B1 (ko) 대화 기록 장치 및 그 방법
CN110109608B (zh) 文本显示方法、装置、终端及存储介质
WO2021083114A1 (fr) Procédé de visualisation de photo et dispositif électronique
CN115268738A (zh) 显示控制方法，电子设备及计算机存储介质
US20220413787A1 (en) Screenshot display method and apparatus, and terminal device
WO2019120190A1 (fr) Procédé de composition de numéro et terminal mobile
KR20150027934A (ko) 다각도에서 촬영된 영상을 수신하여 파일을 생성하는 전자 장치 및 방법
CN112383808A (zh) 视频播放方法、装置、终端及存储介质
CN111628925A (zh) 歌曲交互方法、装置、终端及存储介质
EP3979620A1 (fr) Procédé de photographie et terminal
CN109819314B (zh) 音视频处理方法、装置、终端及存储介质
KR102500145B1 (ko) 전자 장치 및 전자 장치의 컨텐트 전송 방법
KR20180017638A (ko) 이동단말기 및 그 제어방법
CN109189313B (zh) 移动装置及其控制方法
CN110366028B (zh) 屏幕视频获取方法及装置
KR20170108715A (ko) 이동 단말기 및 그 제어 방법
CN105975188A (zh) 图片位置调整方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22889056

Country of ref document: EP

Kind code of ref document: A1