WO2022052742A1 - 多终端屏幕组合方法、装置、设备和计算机存储介质 - Google Patents
多终端屏幕组合方法、装置、设备和计算机存储介质 Download PDFInfo
- Publication number
- WO2022052742A1 WO2022052742A1 PCT/CN2021/112678 CN2021112678W WO2022052742A1 WO 2022052742 A1 WO2022052742 A1 WO 2022052742A1 CN 2021112678 W CN2021112678 W CN 2021112678W WO 2022052742 A1 WO2022052742 A1 WO 2022052742A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- terminal
- display
- sub
- target terminal
- picture
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 67
- 238000012545 processing Methods 0.000 claims description 21
- 238000012360 testing method Methods 0.000 claims description 19
- 238000012790 confirmation Methods 0.000 claims description 17
- 238000004590 computer program Methods 0.000 claims description 14
- 230000001360 synchronised effect Effects 0.000 claims description 13
- 238000004891 communication Methods 0.000 claims description 10
- 230000011218 segmentation Effects 0.000 claims description 10
- 230000006835 compression Effects 0.000 claims description 5
- 238000007906 compression Methods 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 239000000523 sample Substances 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4092—Image resolution transcoding, e.g. by using client-server architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/045—Zooming at least part of an image, i.e. enlarging it or shrinking it
Definitions
- the present application relates to the field of communication technologies, and in particular, to a method, apparatus, device and computer storage medium for combining screens of multiple terminals.
- the main purpose of this application is to provide a multi-terminal screen combination method, device, device and computer storage medium, aiming to solve the technical problem that multiple smart devices cannot be combined and displayed together.
- the present application provides a multi-terminal screen combination method, and the multi-terminal screen combination method includes the following steps:
- the multi-terminal screen combining method is applied to a reference terminal, and the multi-terminal screen combining method includes the following steps:
- the step of acquiring the screen size of the reference terminal and the target terminal includes:
- the to-be-displayed picture is divided according to the screen size of the reference terminal and the screen size of the target terminal to generate a display sub-picture corresponding to the reference terminal and a display corresponding to the target terminal.
- the steps of the sprite including:
- the sub-picture corresponding to the reference terminal is processed according to the resolution of the reference terminal to generate a display sub-picture corresponding to the reference terminal, and the sub-picture corresponding to the target terminal is generated according to the resolution of the target terminal Perform processing to generate a display sub-screen corresponding to the target terminal.
- the sub-picture corresponding to the reference terminal is processed according to the resolution of the reference terminal to generate a display sub-picture corresponding to the reference terminal, and the sub-picture corresponding to the reference terminal is generated according to the resolution of the target terminal.
- the step of processing the sub-picture corresponding to the target terminal to generate a display sub-picture corresponding to the target terminal includes:
- the resolution of the sub-picture is smaller than the resolution of the corresponding reference terminal or the target terminal, performing interpolation processing on the sub-picture to generate a display sub-picture;
- the sub-picture is directly used as the display sub-picture.
- the method further includes:
- the method when receiving the display parameter adjustment instruction, adjust the display parameters of the reference terminal based on the display parameter adjustment instruction, and forward the display parameter adjustment instruction to the target terminal, so that the target terminal can adjust the display parameters based on the display parameter adjustment instruction.
- the method further includes:
- the display parameter adjustment instruction is forwarded to another target terminal, so that the other target terminal performs display parameter adjustment synchronized with the target terminal based on the display parameter adjustment instruction.
- the step includes:
- the notification message is a private message
- the notification message is simplified and displayed.
- the present application also provides a multi-terminal screen combination device, and the multi-terminal screen combination device includes:
- an acquisition module for acquiring the screen size of the reference terminal and the target terminal
- a segmentation module configured to segment the to-be-displayed picture according to the screen size of the reference terminal and the screen size of the target terminal, and generate a display sub-picture corresponding to the reference terminal and a display sub-picture corresponding to the target terminal;
- the execution module is configured to display the display sub-picture corresponding to the reference terminal, and send other display sub-pictures to the corresponding target terminal for display.
- the present application also provides a multi-terminal screen combination device
- the multi-terminal screen combination device includes: a memory, a processor, and a computer program stored on the memory and running on the processor, wherein:
- the present application also provides a computer computer storage medium
- a computer program is stored on the computer computer storage medium, and when the computer program is executed by the processor, the steps of the above-mentioned multi-terminal screen combining method are implemented.
- a method, device, device, and computer storage medium for combining a multi-terminal screen proposed by an embodiment of the present application acquire the screen sizes of the reference terminal and the target terminal; according to the screen size of the reference terminal and the screen size of the target terminal Divide the picture to be displayed to generate a display sub-picture corresponding to the reference terminal and a display sub-picture corresponding to the target terminal; display the display sub-picture corresponding to the reference terminal, and send other display sub-pictures to the corresponding display sub-pictures
- the target terminal is used for display, by taking a terminal as a benchmark, searching for a target terminal that can perform screen combination under the same network and obtaining the screen size of the target terminal, according to the screen size, the screen of the terminal is divided into respectively and the benchmark.
- the terminal and the target terminal correspond to sub-pictures, and are processed and displayed on the terminal according to the resolution of the corresponding reference terminal or target terminal and sent to the target terminal for display, thereby realizing the combined display of multiple terminals.
- FIG. 1 is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the present application;
- FIG. 2 is a schematic flowchart of the first embodiment of the multi-terminal screen combining method of the present application
- FIG. 3 is a first schematic diagram of display screen segmentation according to the first embodiment of the multi-terminal screen combining method of the present application
- FIG. 4 is a second schematic diagram of display screen segmentation according to the first embodiment of the multi-terminal screen combining method of the present application
- FIG. 5 is a third schematic diagram of display screen segmentation according to the first embodiment of the multi-terminal screen combining method of the present application.
- FIG. 6 is a schematic diagram of a multi-terminal screen combination device of the present application.
- the present application provides a solution to obtain the screen size of the reference terminal and the target terminal; according to the screen size of the reference terminal and the target terminal
- the screen size divides the picture to be displayed, and generates a display sub-picture corresponding to the reference terminal and a display sub-picture corresponding to the target terminal; displays the display sub-picture corresponding to the reference terminal, and sends other display sub-pictures To the corresponding target terminal for display, by taking a terminal as a benchmark, searching for a target terminal that can perform screen combination under the same network and obtaining the screen size of the target terminal, according to the screen size, the screen of the terminal is divided into
- the sub-picture corresponds to the reference terminal and the target terminal, and is processed and displayed on the target terminal according to the resolution of the corresponding reference terminal or target terminal, and is sent to the target terminal for display, thereby realizing the combined display of multiple terminals.
- FIG. 1 is a terminal (also called a multi-terminal screen combination device) of the hardware operating environment involved in the solution of the embodiment of the present application, wherein the multi-terminal screen combination device may be composed of a separate multi-terminal screen combination device, or It can be formed by combining other devices with a multi-terminal screen combination device) structural diagram.
- the multi-terminal screen combination device may be composed of a separate multi-terminal screen combination device, or It can be formed by combining other devices with a multi-terminal screen combination device) structural diagram.
- the terminal in this embodiment of the present application may be a fixed terminal or a mobile terminal, for example, a smart air conditioner with networking function, a smart lamp, a smart power supply, a smart speaker, an autonomous vehicle, a PC (personal computer) personal computer, smart phone, tablet computer, e-book reader, portable computer, etc.
- a smart air conditioner with networking function for example, a smart lamp, a smart power supply, a smart speaker, an autonomous vehicle, a PC (personal computer) personal computer, smart phone, tablet computer, e-book reader, portable computer, etc.
- the terminal may include: a processor 1001 , for example, a central processing unit (Central Processing Unit, CPU), a network interface 1004 , a user interface 1003 , a memory 1005 , and a communication bus 1002 .
- the communication bus 1002 is used to realize the connection and communication between these components.
- the user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface.
- the network interface 1004 may include a standard wired interface and a wireless interface (eg, wireless fidelity WIreless-FIdelity, WIFI interface).
- the memory 1005 may be a high-speed RAM memory or a non-volatile memory (non-volatile memory). memory), for example, disk storage.
- the memory 1005 may also be a storage device independent of the aforementioned processor 1001 .
- the terminal may also include a camera, an RF (Radio Frequency, radio frequency) circuit, a sensor, an audio circuit, and a WiFi module; an input unit, a display screen, and a touch screen; the optional network interfaces include WiFi, Bluetooth, Probes, etc.
- sensors such as light sensors, motion sensors and other sensors.
- the light sensor may include an ambient light sensor and a proximity sensor; of course, the mobile terminal may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which will not be repeated here.
- terminal structure shown in FIG. 1 does not constitute a limitation on the terminal, and may include more or less components than the one shown, or combine some components, or arrange different components.
- the computer software product is stored in a computer storage medium (computer storage medium: also called computer computer storage medium, computer medium, readable medium, readable computer storage medium, computer readable computer storage medium or directly called medium, etc.
- the computer storage medium can be a non-volatile readable computer storage medium, such as RAM, magnetic disk, optical disk, and includes several instructions to make a terminal device (can be a mobile phone, a computer, a server, an air conditioner, or network equipment, etc.) to execute the methods described in the various embodiments of this application
- the memory 1005 as a computer computer storage medium may include an operating system, a network communication module, a user interface module, and a computer program.
- the network interface 1004 is mainly used to connect to the background server and perform data communication with the background server;
- the user interface 1003 is mainly used to connect to the client (client) and perform data communication with the client;
- the processor 1001 can be used to call the computer program stored in the memory 1005, and execute the steps in the multi-terminal screen combination method provided by the following embodiments of the present application.
- the multi-terminal screen combination method includes:
- Step S10 acquiring the screen sizes of the reference terminal and the target terminal.
- the methods in this embodiment and subsequent embodiments are all executed on a reference terminal.
- the reference terminal acquires the screen sizes of the reference terminal itself and a target terminal in the same network.
- the reference terminal and the target terminal may be mobile phones, PDAs (Personal Digital Assistant, personal digital assistant), game consoles, smart TVs and other terminals, and the reference terminal and the target terminal may be products of the same type or products of different types.
- the number of the target terminal is at least one, and the reference terminal can be understood as the basis for combining display of different terminals, and the content displayed in combination is the content displayed by the reference terminal.
- the reference terminal still participates in the combined display and also serves as a data source, and the content includes but is not limited to pictures, videos, game screens, etc. It can be understood that the screen size is an inherent parameter of each terminal, This parameter can be read between different terminals under the same network.
- step S10 it may include:
- Step a1 detecting pending terminals in the same network.
- Step a2 sending a test instruction to the pending terminal.
- Step a3 Obtain the screen size of the reference terminal and the target terminal that returns confirmation information based on the test instruction.
- the benchmark terminal detects pending terminals in the same network, and the pending terminals are the terminals that the benchmark terminal can directly detect and capture. It is understandable that the pending terminals are not necessarily all smart devices with screens, but may also be Connect to terminals such as smart temperature and humidity meters and smart door locks under the unified network, and may also be terminals that are connected to the same network but in a dormant state.
- the benchmark terminal sends test instructions to all The pending terminal, the test instruction is an instruction to determine whether the pending terminal is in a dormant state, the benchmark terminal acquires the screen size of the benchmark terminal itself and the target terminal that returns confirmation information based on the test instruction, and the pending terminal receives the test
- the terminal to be determined is regarded as a target terminal that can be further combined, so as to further obtain the screen size and resolution parameters of the target terminal.
- the test instruction can also be sent by the benchmark terminal to the pending terminal, so as to display a confirmation interface in the pending terminal.
- the pending terminal returns confirmation information to the reference terminal after receiving the confirmation instruction input by the user, and then the pending terminal becomes the target terminal.
- Step S20 Divide the picture to be displayed according to the screen size of the reference terminal and the screen size of the target terminal to generate a display sub-picture corresponding to the reference terminal and a display sub-picture corresponding to the target terminal.
- the reference terminal divides the display screen according to the screen size of the terminal itself and the screen size of the target terminal, and generates sub-screens corresponding to the reference terminal and the target terminal.
- the reference terminal is used as a combined display content Therefore, the screen size parameters of the benchmark terminal and the target terminal will affect the segmentation of the displayed content (that is, the screen to be displayed), so the screen size of the benchmark terminal itself is also used as a guiding factor for screen segmentation.
- the display screen is the screen displayed by the terminal in real time, and this embodiment provides a specific implementation method for dividing the screen to be displayed according to the screen size of the reference terminal and the target terminal, that is, according to the screen size of the reference terminal and the target terminal.
- the screen size and the screen size of the target terminal divide the picture to be displayed, and the step of generating a display sub-picture corresponding to the reference terminal and a display sub-picture corresponding to the target terminal may include:
- Step b1 Divide the picture to be displayed according to the screen size of the reference terminal and the screen size of the target terminal, and generate sub-pictures corresponding to the reference terminal and the target terminal.
- the reference terminal divides the screen to be displayed according to the screen size of the reference terminal and the screen size of the target terminal, and generates sub-screens corresponding to the reference terminal and the target terminal.
- the step of dividing the picture to be displayed according to the screen size of the reference terminal and the screen size of the target terminal, and generating the sub-pictures corresponding to the reference terminal and the target terminal includes:
- Step b11 judging whether the screen size of the reference terminal and the screen size of the target terminal are the same.
- the reference terminal judges whether the screen size of the reference terminal itself is the same as the screen size of the target terminal. It can be understood that when the screen size of the reference terminal is the same as or different from the screen size of the target terminal, there will be a problem for the actual screen segmentation strategy. Significant difference.
- Step b12 if the screen size of the reference terminal is the same as the screen size of the target terminal, the display screen is divided into equal parts to generate sub-screens corresponding to the reference terminal and the target terminal.
- the reference terminal will divide the display screen into equal parts to generate sub-screens corresponding to the reference terminal and the target terminal.
- the user chooses, as with reference to Fig. 3, when the total number of reference terminals and target terminals is 4, the user can select the word "field" to split, and for example horizontal or vertical splitting, the number of splits depends on the number of benchmark terminals and target terminals,
- the equal division method can also be selected by the reference terminal from preset options. For example, referring to FIG. 4 , the generated sub-pictures correspond to the reference terminal or the target terminal one-to-one respectively.
- Step b13 if the screen size of the reference terminal is the same as the screen size of the target terminal, the display screen will be divided according to the preset rule, and the screen corresponding to the reference terminal and the terminal and the target terminal will be generated. subscreen.
- the display screen is divided according to preset rules to generate sub-screens corresponding to the reference terminal and the target terminal.
- the rules include the combination method of each terminal and the division method of the display screen.
- the combination methods are various. As shown in Figure 5, the reference terminal or target terminal with the largest screen size is used as the combination basis, and other terminals clockwise surround the combined reference terminal.
- the borders are arranged and combined into a virtual screen, the virtual screen is a regular rectangle or an irregular polygon, and the terminal divides the display screen according to the screen ratio at the composition position of the virtual screen by the terminal or the target terminal to generate multiple sub-pictures, and the generated sub-pictures are in one-to-one correspondence with the reference terminal or the target terminal.
- Step b2 acquiring the resolutions of the reference terminal and the target terminal.
- the reference terminal obtains the resolution of the reference terminal and the target terminal, and the resolution is an inherent parameter of each terminal, and the reading of this parameter can be realized between different terminals under the same network, and the reference terminal obtains the target terminal.
- the specific implementation manner of has been described in the foregoing steps, and will not be repeated here.
- Step b3 processing the sub-picture corresponding to the reference terminal according to the resolution of the reference terminal, generating a display sub-picture corresponding to the reference terminal, and corresponding to the target terminal according to the resolution of the target terminal.
- the sub-picture is processed to generate a display sub-picture corresponding to the target terminal.
- the reference terminal processes the sub-picture corresponding to the reference terminal according to the resolution of the reference terminal, generates a display sub-picture corresponding to the reference terminal, and performs the sub-picture corresponding to the target terminal according to the resolution of the target terminal.
- the sub-picture is processed to generate a display sub-picture corresponding to the target terminal. It can be understood that different terminals may have different resolutions even if they have the same screen size. If the resolution of the sub-picture is greater than that of the target terminal. The resolution will cause the sub-picture to be incompletely displayed on the target terminal. If the resolution of the sub-picture is smaller than that of the target terminal, the sub-picture will occupy only a small display area in the target terminal. In the actual screen combination, the above problems will be eliminated. The combination effect is affected. Therefore, when the display screen is divided into sub-pictures, the sub-pictures need to be processed according to the resolution of the reference terminal or the resolution of the target terminal.
- the step of generating and displaying the sub-picture by processing the sub-picture according to the resolution of the reference terminal or the resolution of the target terminal may specifically include:
- step c1 the resolutions of the sub-pictures corresponding to the reference terminal and the target terminal are acquired, and the relationship between the resolutions of the sub-pictures and the resolutions of the corresponding reference terminal or the target terminal is determined.
- the reference terminal obtains the resolution of the sub-picture corresponding to the reference terminal and the target terminal, and judges the relationship between the resolution of the sub-picture and the resolution of the corresponding reference terminal or target terminal. It can be understood that according to the foregoing steps When the screen size of each terminal is the same, there is a proportional relationship between the resolution of the sub-screen and the display screen, for example, the resolution of the sub-screen is 1/2, 1/3 of the display screen, etc., depending on the reference terminal and the display screen. The total number of target terminals, if not, needs to be determined according to the specific segmentation method. To determine the relationship between the resolution of the sub-picture and the resolution of the corresponding reference terminal or target terminal is to determine whether the resolution of the sub-picture is larger or smaller than The resolution of the base terminal or the target terminal resolution.
- Step c2 if the resolution of the sub-picture is smaller than the resolution of the corresponding reference terminal or the target terminal, perform interpolation processing on the sub-picture to generate a display sub-picture.
- the reference terminal performs interpolation processing on the sub-picture to generate a display sub-picture, and the resolution of the sub-picture is smaller than that of the corresponding reference terminal or target terminal.
- the sub-picture only occupies a part of the display area in the reference terminal or the target terminal, so it is necessary to expand the sub-picture.
- the expansion method is to perform interpolation processing on the sub-picture.
- the interpolation processing scheme may be a pixel interpolation algorithm, One or more combinations of bilinear interpolation algorithm, bicubic interpolation algorithm or fractal algorithm are processed to generate a display sub-picture corresponding to the terminal or the target terminal.
- Step c3 if the resolution of the sub-picture is greater than the resolution of the corresponding reference terminal or the target terminal, perform compression processing on the sub-picture to generate a display sub-picture.
- Step c4 if the resolution of the sub-picture is equal to the resolution of the corresponding reference terminal or the target terminal, the sub-picture is directly used as the display sub-picture.
- the reference terminal compresses the sub-picture to generate a display sub-picture, and the resolution of the sub-picture is greater than that of the corresponding reference terminal or target terminal.
- the resolution is used, the sub-picture is not fully displayed in the reference terminal or the target terminal, so it is necessary to reduce the sub-picture, use one or more of chroma sampling, transform coding or fractal compression algorithm to combine, and generate and The display sub-picture corresponding to the terminal or the target terminal, if the resolution of the sub-picture is equal to the resolution of the corresponding reference terminal or the target terminal, the reference terminal directly uses the sub-picture as the display sub-picture.
- Step S30 displaying the display sub-picture corresponding to the reference terminal, and sending other display sub-pictures to the corresponding target terminal for display.
- the reference terminal displays a display sub-picture corresponding to the reference terminal, and sends other display sub-pictures to the corresponding target terminal for display.
- the benchmark displays the display sub-picture corresponding to the benchmark terminal, and sends other display sub-pictures to the corresponding target terminal for display. Specifically, the following steps are included:
- a terminal is used as a reference terminal to search for a target terminal that can perform screen combination under the same network and obtain the screen size of the target terminal, and according to the screen size, the screen of the terminal is divided into the reference
- the terminal and the target terminal correspond to sub-screens, and after processing according to the resolution of the corresponding reference terminal or target terminal, they are directly displayed on the reference terminal and sent to the target terminal for display, realizing the combined display function of multiple terminals and making full use of the user's Smart terminals bring better user experience to users.
- Screen combination methods include:
- Step d1 when receiving the display parameter adjustment instruction, adjust the display parameters of the reference terminal based on the display parameter adjustment instruction, and forward the display parameter adjustment instruction to the target terminal, so that the target terminal adjusts the instruction based on the display parameter adjustment instruction A display parameter adjustment synchronized with the reference terminal is performed.
- the reference terminal When receiving the display parameter adjustment instruction, the reference terminal forwards the display parameter adjustment instruction to the target terminal for synchronous adjustment.
- the display parameter adjustment instruction includes display parameter adjustment instructions for parameters such as brightness adjustment and volume adjustment.
- This embodiment Taking brightness adjustment as an example, when the terminal receives the brightness display parameter adjustment instruction, for example, the brightness increases by 10%, in order to realize the unified display effect of each terminal, the terminal forwards the brightness display parameter adjustment instruction to the target terminal, so that the target terminal The brightness is synchronously adjusted.
- a step may be added: the reference terminal sends its own parameter settings to the target terminal, so that the target terminal can perform synchronous adjustment to achieve the best look and feel.
- step d1 can be replaced by the following steps:
- the target terminal when it is detected that the target terminal receives the display parameter adjustment instruction, acquire the display parameter adjustment instruction and adjust the display parameter of the reference terminal based on the display parameter adjustment instruction.
- the display parameter adjustment instruction is acquired to perform corresponding adjustment, and the display parameter adjustment instruction is forwarded to other target terminals for synchronous adjustment.
- Step d2 and d3 may be performed with Step d1 is implemented in combination, and can also be implemented independently.
- the display parameter adjustment instruction received by any one of the terminals performing screen combination is forwarded to other terminals, so that the display parameters of each terminal can be adjusted synchronously.
- the display parameters or other parameters achieves a better combined look and feel.
- a third embodiment of the multi-terminal screen combining method of the present application is further proposed.
- This embodiment is a post-step of step S30 in the first embodiment.
- the multi-terminal screen Combination methods include:
- Step e1 when a notification message is received or when the target terminal detects that the notification message is received, determine whether the notification message is a private message.
- Step e2 if the notification message is a private message, the notification message is simplified and displayed.
- the reference terminal When the reference terminal receives the notification message or detects that the target terminal receives the notification message, it determines whether the notification message is a private message, and the method for judging whether the notification message is a private message is to obtain the application program that issued the notification message. , judging whether the application program is in the preset program list, the program list can be set by the user's own choice or adopt the system default settings, the system default settings usually include instant chat software, payment software and other devices that pay more attention to privacy and security, If the notification message is a private message, the notification message is simplified and displayed. The simplified method may be to display only the icon of the application program that sent the notification message.
- the default display mode in this embodiment is to display the notification message on the reference terminal Display, at this time, in order to inform the user which terminal received the notification message, a pre-acquired terminal name may be added to the displayed notification message.
- the notification may be simplified only after the notification message is received. Display on the terminal or synchronous display on the terminal where the screen combination is performed.
- an embodiment of the present application also proposes a multi-terminal screen combination device.
- the multi-terminal screen combination device includes:
- an acquisition module 10 configured to acquire the screen size of the reference terminal and the target terminal
- the segmentation module 20 is configured to segment the to-be-displayed picture according to the screen size of the reference terminal and the screen size of the target terminal, and generate a display sub-picture corresponding to the reference terminal and a display sub-picture corresponding to the target terminal ;
- the execution module 30 is configured to display a display sub-picture corresponding to the reference terminal, and send other display sub-pictures to the corresponding target terminal for display.
- the present application also provides a multi-terminal screen combination device
- the multi-terminal screen combination device includes: a memory, a processor, and a computer program stored on the memory and running on the processor, wherein:
- embodiments of the present application also provide a computer storage medium.
- a computer program is stored on the computer computer storage medium, and when the computer program is executed by the processor, the operations in the multi-terminal screen combination method provided by the above embodiments are implemented.
- the description is relatively simple, and for related parts, please refer to the partial description of the method embodiment.
- the apparatus embodiments described above are merely illustrative, wherein units described as separate components may or may not be physically separate. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of the present application. Those of ordinary skill in the art can understand and implement it without creative effort.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Controls And Circuits For Display Device (AREA)
- Processing Or Creating Images (AREA)
- Digital Computer Display Output (AREA)
Abstract
Description
Claims (20)
- 一种多终端屏幕组合方法,其中,所述多终端屏幕组合方法应用于基准终端,所述多终端屏幕组合方法包括以下步骤:获取所述基准终端和目标终端的屏幕尺寸;根据所述基准终端的屏幕尺寸和所述目标终端的屏幕尺寸将待显示画面进行分割,生成与所述基准终端对应的显示子画面和所述目标终端对应的显示子画面;显示与所述基准终端对应的显示子画面,并将其他显示子画面发送至对应的目标终端以进行显示。
- 如权利要求1中所述的多终端屏幕组合方法,其中,所述获取所述基准终端和目标终端的屏幕尺寸的步骤,包括:检测与所述基准终端处于同一网络中的待定终端;发送测试指令至所述待定终端,并将基于所述测试指令返回确认信息的待定终端确定为目标终端;获取所述基准终端和所述目标终端的屏幕尺寸。
- 如权利要求1所述的多终端屏幕组合方法,其中,所述根据所述基准终端的屏幕尺寸和所述目标终端的屏幕尺寸将待显示画面进行分割,生成与所述基准终端对应的显示子画面和所述目标终端对应的显示子画面的步骤,包括:根据所述基准终端的屏幕尺寸和所述目标终端的屏幕尺寸将待显示画面进行分割,生成与所述基准终端和所述目标终端对应的子画面;获取所述基准终端和所述目标终端的分辨率;根据所述基准终端的分辨率对所述基准终端对应的子画面进行处理,生成与所述基准终端对应对应的显示子画面,根据所述目标终端的分辨率对所述目标终端对应的子画面进行处理,生成与所述目标终端对应的显示子画面。
- 如权利要求3所述的多终端屏幕组合方法,其中,所述根据所述基准终端的分辨率对所述基准终端对应的子画面进行处理,生成与所述基准终端对应对应的显示子画面,根据所述目标终端的分辨率对所述目标终端对应的子画面进行处理,生成与所述目标终端对应的显示子画面的步骤,包括:获取与所述基准终端和所述目标终端对应的子画面的分辨率,判断所述子画面的分辨率与对应的基准终端或目标终端的分辨率关系;若所述子画面的分辨率小于对应的基准终端或目标终端的分辨率,则对所述子画面进行插值处理生成显示子画面;若所述子画面的分辨率大于对应的基准终端或目标终端的分辨率,则对所述子画面进行压缩处理生成显示子画面;若所述子画面的分辨率等于对应的基准终端或目标终端的分辨率,则将所述子画面直接作为显示子画面。
- 如权利要求1所述的多终端屏幕组合方法,其中,所述显示与所述基准终端对应的显示子画面,并将其他显示子画面发送至对应的目标终端以进行显示的步骤之后,所述方法还包括:在接收到显示参数调节指令时,基于所述显示参数调节指令调节基准终端的显示参数,并将所述显示参数调节指令转发至目标终端,以使目标终端基于所述显示参数调节指令进行与所述基准终端同步的显示参数调节。
- 如权利要求1所述的多终端屏幕组合方法,其中,所述在接收到显示参数调节指令时,基于所述显示参数调节指令调节基准终端的显示参数,并将所述显示参数调节指令转发至目标终端,以使目标终端基于所述显示参数调节指令进行同步的显示参数调节的步骤之后,所述方法还包括:在检测到目标终端接收到显示参数调节指令时,获取所述显示参数调节指令并基于所述显示参数调节指令调节基准终端的显示参数;转发所述显示参数调节指令至其他的目标终端,以使所述其他的目标终端基于所述显示参数调节指令进行与所述目标终端同步的显示参数调节。
- 如权利要求1所述的多终端屏幕组合方法,其中,所述显示与所述基准终端对应的显示子画面,并将其他显示子画面发送至对应的目标终端以进行显示的步骤之后,包括:接收到通知消息时或检测到目标终端接收到通知消息时,判断所述通知消息是否为隐私消息;若所述通知消息为隐私消息,则将所述通知消息简化后进行显示。
- 如权利要求3所述的多终端屏幕组合方法,其中,所述根据所述基准终端的屏幕尺寸和所述目标终端的屏幕尺寸将待显示画面进行分割,生成与所述基准终端和所述目标终端对应的子画面的步骤包括:判断所述基准终端的屏幕尺寸与所述目标终端的屏幕尺寸是否均相同;若所述基准终端的屏幕尺寸与所述目标终端的屏幕尺寸相同则将显示画面进行等分分割,生成与所述基准终端和所述目标终端对应的子画面。
- 如权利要求2所述的多终端屏幕组合方法,其中,所述发送测试指令至所述待定终端,并将基于所述测试指令返回确认信息的待定终端确定为目标终端,包括:发送所述测试指令至所述待定终端,以在所述待确定终端中展示一确认界面,并将接收到用户输入的确认指令后返回确认信息的待定终端确定为所述目标终端。
- 一种多终端屏幕组合装置,其中,所述多终端屏幕组合装置包括:获取模块,用于获取所述基准终端和目标终端的屏幕尺寸;分割模块,用于根据所述基准终端的屏幕尺寸和所述目标终端的屏幕尺寸将待显示画面进行分割,生成与所述基准终端对应的显示子画面和所述目标终端对应的显示子画面;执行模块,用于显示与所述基准终端对应的显示子画面,并将其他显示子画面发送至对应的目标终端以进行显示。
- 一种多终端屏幕组合设备,其中,所述多终端屏幕组合设备包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,其中:所述计算机程序被所述处理器执行时,所述处理器执行:获取所述基准终端和目标终端的屏幕尺寸;根据所述基准终端的屏幕尺寸和所述目标终端的屏幕尺寸将待显示画面进行分割,生成与所述基准终端对应的显示子画面和所述目标终端对应的显示子画面;显示与所述基准终端对应的显示子画面,并将其他显示子画面发送至对应的目标终端以进行显示。
- 如权利要求11中所述的多终端屏幕组合设备,其中,在所述获取所述基准终端和目标终端的屏幕尺寸时,所述处理器执行:检测与所述基准终端处于同一网络中的待定终端;发送测试指令至所述待定终端,并将基于所述测试指令返回确认信息的待定终端确定为目标终端;获取所述基准终端和所述目标终端的屏幕尺寸。
- 如权利要求11所述的多终端屏幕组合设备,其中,所述根据所述基准终端的屏幕尺寸和所述目标终端的屏幕尺寸将待显示画面进行分割,生成与所述基准终端对应的显示子画面和所述目标终端对应的显示子画面时,所述处理器执行:根据所述基准终端的屏幕尺寸和所述目标终端的屏幕尺寸将待显示画面进行分割,生成与所述基准终端和所述目标终端对应的子画面;获取所述基准终端和所述目标终端的分辨率;根据所述基准终端的分辨率对所述基准终端对应的子画面进行处理,生成与所述基准终端对应对应的显示子画面,根据所述目标终端的分辨率对所述目标终端对应的子画面进行处理,生成与所述目标终端对应的显示子画面。
- 如权利要求13所述的多终端屏幕组合设备,其中,所述根据所述基准终端的分辨率对所述基准终端对应的子画面进行处理,生成与所述基准终端对应对应的显示子画面,根据所述目标终端的分辨率对所述目标终端对应的子画面进行处理,生成与所述目标终端对应的显示子画面时,所述处理器执行:获取与所述基准终端和所述目标终端对应的子画面的分辨率,判断所述子画面的分辨率与对应的基准终端或目标终端的分辨率关系;若所述子画面的分辨率小于对应的基准终端或目标终端的分辨率,则对所述子画面进行插值处理生成显示子画面;若所述子画面的分辨率大于对应的基准终端或目标终端的分辨率,则对所述子画面进行压缩处理生成显示子画面;若所述子画面的分辨率等于对应的基准终端或目标终端的分辨率,则将所述子画面直接作为显示子画面。
- 如权利要求11所述的多终端屏幕组合设备,其中,所述显示与所述基准终端对应的显示子画面,并将其他显示子画面发送至对应的目标终端以进行显示的步骤之后,所述处理器还执行:在接收到显示参数调节指令时,基于所述显示参数调节指令调节基准终端的显示参数,并将所述显示参数调节指令转发至目标终端,以使目标终端基于所述显示参数调节指令进行与所述基准终端同步的显示参数调节。
- 如权利要求11所述的多终端屏幕组合设备,其中,所述在接收到显示参数调节指令时,基于所述显示参数调节指令调节基准终端的显示参数,并将所述显示参数调节指令转发至目标终端,以使目标终端基于所述显示参数调节指令进行同步的显示参数调节的步骤之后,所述处理器还执行:在检测到目标终端接收到显示参数调节指令时,获取所述显示参数调节指令并基于所述显示参数调节指令调节基准终端的显示参数;转发所述显示参数调节指令至其他的目标终端,以使所述其他的目标终端基于所述显示参数调节指令进行与所述目标终端同步的显示参数调节。
- 如权利要求11所述的多终端屏幕组合设备,其中,所述显示与所述基准终端对应的显示子画面,并将其他显示子画面发送至对应的目标终端以进行显示的步骤之后,所述处理器执行:接收到通知消息时或检测到目标终端接收到通知消息时,判断所述通知消息是否为隐私消息;若所述通知消息为隐私消息,则将所述通知消息简化后进行显示。
- 如权利要求13所述的多终端屏幕组合设备,其中,所述根据所述基准终端的屏幕尺寸和所述目标终端的屏幕尺寸将待显示画面进行分割,生成与所述基准终端和所述目标终端对应的子画面时,所述处理器执行:判断所述基准终端的屏幕尺寸与所述目标终端的屏幕尺寸是否均相同;若所述基准终端的屏幕尺寸与所述目标终端的屏幕尺寸相同则将显示画面进行等分分割,生成与所述基准终端和所述目标终端对应的子画面。
- 如权利要求12所述的多终端屏幕组合设备,其中,所述发送测试指令至所述待定终端,并将基于所述测试指令返回确认信息的待定终端确定为目标终端时,所述处理器执行:发送所述测试指令至所述待定终端,以在所述待确定终端中展示一确认界面,并将接收到用户输入的确认指令后返回确认信息的待定终端确定为所述目标终端。
- 一种计算机存储介质,其中,所述计算机计算机存储介质上存储有计算机程序,所述计算机程序被处理器执行时实现如权利要求1至9中任一项所述的多终端屏幕组合方法的步骤。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
GB2304543.8A GB2623845A (en) | 2020-09-09 | 2021-08-16 | Multi-terminal screen combination method, apparatus and device, and computer storage medium |
US18/044,572 US20230333798A1 (en) | 2020-09-09 | 2021-08-16 | Multi-terminal screen combination method, device, and computer storage medium |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010945203.3 | 2020-09-09 | ||
CN202010945203.3A CN112328193A (zh) | 2020-09-09 | 2020-09-09 | 多终端屏幕组合方法、装置、设备和计算机存储介质 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022052742A1 true WO2022052742A1 (zh) | 2022-03-17 |
Family
ID=74303249
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/112678 WO2022052742A1 (zh) | 2020-09-09 | 2021-08-16 | 多终端屏幕组合方法、装置、设备和计算机存储介质 |
Country Status (4)
Country | Link |
---|---|
US (1) | US20230333798A1 (zh) |
CN (1) | CN112328193A (zh) |
GB (1) | GB2623845A (zh) |
WO (1) | WO2022052742A1 (zh) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112328193A (zh) * | 2020-09-09 | 2021-02-05 | 深圳Tcl新技术有限公司 | 多终端屏幕组合方法、装置、设备和计算机存储介质 |
CN113535105B (zh) * | 2021-06-30 | 2023-03-21 | 北京字跳网络技术有限公司 | 媒体文件处理方法、装置、设备、可读存储介质及产品 |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102222493A (zh) * | 2010-04-19 | 2011-10-19 | 英业达股份有限公司 | 扩大显示影像的方法及装置 |
CN103377025A (zh) * | 2013-05-30 | 2013-10-30 | 光宝电子(广州)有限公司 | 一种多媒体界面控制方法及装置 |
CN104375798A (zh) * | 2014-11-27 | 2015-02-25 | 中国科学技术大学 | 一种由多个移动智能设备屏幕组合显示多媒体的方法 |
CN104536714A (zh) * | 2015-01-07 | 2015-04-22 | 深圳市众进思创科技开发有限公司 | 一种设备间对显示信息分屏显示的方法及系统 |
CN104657101A (zh) * | 2015-02-12 | 2015-05-27 | 武汉新蜂乐众网络技术有限公司 | 一种图像拼接显示方法及系统 |
CN106293571A (zh) * | 2015-06-10 | 2017-01-04 | 宿迁淮海科技服务有限公司 | 一种手机屏幕的拼接显示系统 |
CN106775532A (zh) * | 2016-12-19 | 2017-05-31 | 宇龙计算机通信科技(深圳)有限公司 | 显示屏拓展方法、装置和移动终端 |
CN111163206A (zh) * | 2019-12-26 | 2020-05-15 | 上海传英信息技术有限公司 | 屏幕消息显示方法、终端及可读存储介质 |
CN112328193A (zh) * | 2020-09-09 | 2021-02-05 | 深圳Tcl新技术有限公司 | 多终端屏幕组合方法、装置、设备和计算机存储介质 |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6275075B2 (ja) * | 2015-04-02 | 2018-02-07 | キヤノン株式会社 | 投影装置、制御方法及びプログラム |
US11093197B2 (en) * | 2017-07-31 | 2021-08-17 | Stmicroelectronics, Inc. | System and method to increase display area utilizing a plurality of discrete displays |
JPWO2019138661A1 (ja) * | 2018-01-12 | 2020-11-19 | ソニー株式会社 | 情報処理装置および情報処理方法 |
CN113946301B (zh) * | 2020-07-16 | 2024-02-09 | 京东方科技集团股份有限公司 | 拼接显示系统及其图像处理方法 |
CN114095905A (zh) * | 2020-08-05 | 2022-02-25 | 华为技术有限公司 | 设备交互方法和电子设备 |
-
2020
- 2020-09-09 CN CN202010945203.3A patent/CN112328193A/zh active Pending
-
2021
- 2021-08-16 GB GB2304543.8A patent/GB2623845A/en active Pending
- 2021-08-16 US US18/044,572 patent/US20230333798A1/en active Pending
- 2021-08-16 WO PCT/CN2021/112678 patent/WO2022052742A1/zh active Application Filing
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102222493A (zh) * | 2010-04-19 | 2011-10-19 | 英业达股份有限公司 | 扩大显示影像的方法及装置 |
CN103377025A (zh) * | 2013-05-30 | 2013-10-30 | 光宝电子(广州)有限公司 | 一种多媒体界面控制方法及装置 |
CN104375798A (zh) * | 2014-11-27 | 2015-02-25 | 中国科学技术大学 | 一种由多个移动智能设备屏幕组合显示多媒体的方法 |
CN104536714A (zh) * | 2015-01-07 | 2015-04-22 | 深圳市众进思创科技开发有限公司 | 一种设备间对显示信息分屏显示的方法及系统 |
CN104657101A (zh) * | 2015-02-12 | 2015-05-27 | 武汉新蜂乐众网络技术有限公司 | 一种图像拼接显示方法及系统 |
CN106293571A (zh) * | 2015-06-10 | 2017-01-04 | 宿迁淮海科技服务有限公司 | 一种手机屏幕的拼接显示系统 |
CN106775532A (zh) * | 2016-12-19 | 2017-05-31 | 宇龙计算机通信科技(深圳)有限公司 | 显示屏拓展方法、装置和移动终端 |
CN111163206A (zh) * | 2019-12-26 | 2020-05-15 | 上海传英信息技术有限公司 | 屏幕消息显示方法、终端及可读存储介质 |
CN112328193A (zh) * | 2020-09-09 | 2021-02-05 | 深圳Tcl新技术有限公司 | 多终端屏幕组合方法、装置、设备和计算机存储介质 |
Also Published As
Publication number | Publication date |
---|---|
US20230333798A1 (en) | 2023-10-19 |
GB202304543D0 (en) | 2023-05-10 |
GB2623845A (en) | 2024-05-01 |
CN112328193A (zh) | 2021-02-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11100901B2 (en) | Method for controlling rendering of layers, terminal, and storage medium | |
WO2021047429A1 (zh) | 一种图像渲染方法、装置、设备及存储介质 | |
CN109831662B (zh) | Ar眼镜屏幕的实时画面投射方法、装置及控制器和介质 | |
CN106708452B (zh) | 一种信息共享方法及终端 | |
WO2021204296A1 (zh) | 三维模型远程展示方法、第一终端、电子设备及存储介质 | |
US11145238B2 (en) | Method for controlling image graphing of terminal, nontransitory computer-readable storage medium, and terminal | |
US9665247B2 (en) | Method and device for applying a new skin to a display environment | |
WO2022052742A1 (zh) | 多终端屏幕组合方法、装置、设备和计算机存储介质 | |
CN110569013B (zh) | 基于展示屏幕的图像展示方法以及装置 | |
CN107948724B (zh) | 视频传输控制方法、装置及存储介质和移动终端 | |
CN115600629B (zh) | 车辆信息二维码生成方法、电子设备和计算机可读介质 | |
WO2015110060A1 (en) | Filter realization method and apparatus of camera application | |
WO2022156703A1 (zh) | 一种图像显示方法、装置及电子设备 | |
CN113645476B (zh) | 画面处理方法、装置、电子设备及存储介质 | |
WO2024051639A1 (zh) | 图像处理方法、装置、设备及存储介质和产品 | |
WO2019020112A1 (zh) | 终端显示方法、终端及计算机可读存储介质 | |
WO2023125217A1 (zh) | 图像处理电路、方法和电子设备 | |
WO2023207912A1 (zh) | 分屏渲染方法、装置、设备及存储介质 | |
WO2023125273A1 (zh) | 电子设备的图像显示方法、图像处理电路和电子设备 | |
WO2023030292A1 (zh) | 多媒体文件的播放方法和装置 | |
US20210019030A1 (en) | Display interface switching method, display interface switching apparatus, and electronic device | |
CN111010528A (zh) | 视频通话方法、移动终端及计算机可读存储介质 | |
US20230088460A1 (en) | Display method and device | |
WO2019089398A1 (en) | Networked user interface back channel discovery via wired video connection | |
WO2023237016A1 (zh) | 折叠屏电子设备显示以及控制方法以及折叠屏电子设备 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21865798 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 202304543 Country of ref document: GB Kind code of ref document: A Free format text: PCT FILING DATE = 20210816 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21865798 Country of ref document: EP Kind code of ref document: A1 |