TWI825918B - Display control method and related display control apparatus and display device - Google Patents

Abstract

A display control method includes: receiving a first video signal provided by a first video source device, so as to display one or more first images in the first video signal on a display device; during a period that the display device displays the one or more first images, establishing a connection with a second video source device, and receiving a second video signal provided by the second video source device through the connection; without receiving a user's control input, generating one or more composite images according to one or more second images in the second video signal and one or more first images in the first video signal; and displaying the one or more composite images on the display device.

Description

Display control method and related display control device and display equipment

The present invention relates to the field of displays, and in particular, refers to a display control method, related display control device and display equipment that can automatically perform screen split display for wireless projection connections.

With the advancement and popularization of technology, there are many display devices on the market that support Picture-In-Picture mode, which can display images in different areas of the screen when connected to multiple different video source devices. The video content provided by these devices. Generally speaking, the user needs to open the on-screen display (OSD) of the display device to activate the picture-in-picture mode, and also needs to specify the main screen and sub-screen, and the corresponding video source device in the on-screen display. The display device will not correctly render picture-in-picture mode until these settings are complete. On the other hand, although many existing display devices support wireless projection, they are unable to display wirelessly projected content in picture-in-picture mode. Therefore, there are still many areas for improvement in this field.

In view of this, the present invention provides a display control method, related display control device and display equipment that can connect wireless projections and automatically perform screen split display. The display control device of the present invention will detect the newly added wired connection or wireless projection connection, and provide During the process of producing audio-visual content, once another video source device is connected to the operating display device through a wireless projection connection or a wired connection, the present invention will activate the split display mode or picture-in-picture mode to allow different video sources to The device's video content can be displayed on the screen at the same time. Since the present invention does not require user intervention, but automatically triggers the split display mode or picture-in-picture mode when a wireless projection connection is detected, eliminating the cumbersome operation of the picture-in-picture mode on traditional display devices, it can effectively Improve user experience of display devices.

Embodiments of the present invention provide a display control method. The display control method includes: receiving a first video signal provided from a first video source device, and displaying one of the first video signals on a display device. or multiple first images; in the process of the display device displaying the one or more first images, establish a connection with a second video source device and receive the second video through the connection A second video signal provided by the source device; without receiving control input from the user, based on one or more second images in the second video signal and one or more second images in the first video signal generating one or more composite images from the first image; and displaying the one or more composite images on the display device.

Embodiments of the present invention provide a display control device used in a display device. The display control device includes: a processing circuit and a network interface circuit. The processing circuit is used to receive a first video signal provided by a first video source device, so that one or more first images in the first video signal can be displayed on the display device. The network interface circuit is coupled to the processing circuit, and is used to establish a connection with a second video source device during the display device displaying the one or more first images, and through the The connection is connected to receive a second video signal provided by the second video source device. Wherein, the processing circuit performs a processing on one or more second images in the second video signal and one or more first images in the first video signal without receiving control input from the user. at processing, generating one or more composite images, and enabling the display device to display the one or more composite images.

An embodiment of the present invention provides a display device, which includes a display device and a display control module. The display control device is coupled to the display module and used to control the display of the display module. The display control device includes: a processing circuit and a network interface circuit. The processing circuit is used to receive a first video signal provided by a first video source device, so that one or more first images in the first video signal can be displayed on the display module. The network interface circuit is used to establish a connection with a second video source device during the display module displaying the one or more first images, and to receive the second video through the connection. A second video signal provided by the source device. Wherein, the processing circuit performs a processing on one or more second images in the second video signal and one or more first images in the first video signal without receiving control input from the user. Process, generate one or more composite images, and enable the display module to display the one or more composite images.

10: Display device

15:Display module

20_1~20_M: Cable video source device

30_1~30_O: Wireless video source device

100: Display control device

110: Processing circuit

120:Network interface circuit

130_1~130_O: Video port

140: Video transmission interface circuit

150: Short-range wireless communication interface circuit

S210~S240: steps

Figure 1 is a schematic structural diagram of a display device according to an embodiment of the present invention.

Figure 2 is a schematic structural diagram of a display control device according to an embodiment of the present invention.

Figure 3 illustrates the operation flow of the display control device according to one embodiment of the present invention.

FIG. 4 illustrates the operation flow of a display control device according to another embodiment of the present invention.

FIG. 5 illustrates the operation process of the display control device according to another embodiment of the present invention.

Figures 6A and 6B respectively illustrate examples of split display in embodiments of the present invention.

FIG. 7 illustrates a flow chart of a display control method according to an embodiment of the present invention.

In the following text, numerous specific details are described to provide the reader with a thorough understanding of embodiments of the invention. However, those skilled in the art will understand how to implement the present invention without one or more specific details, or using other methods or components or materials. In other instances, well-known structures, materials or operations are not shown or described in detail so as to avoid obscuring the core concepts of the invention.

Reference in the specification to "an embodiment" means that a particular feature, structure or characteristic described in the embodiment may be included in at least one embodiment of the present invention. Therefore, “in one embodiment” appearing in various places in this specification does not necessarily mean the same embodiment. Furthermore, the specific features, structures or characteristics described above may be combined in any suitable form in one or more embodiments.

Please refer to Figure 1, which is a schematic diagram of the display control device and display device of the present invention. As shown in the figure, the display control device 100 of the present invention is disposed in the display device 10 for receiving and processing video signals provided by different video source devices, and outputting image sequences to the display module in the display device 10 accordingly. 15 is displayed. The display module 15 may be composed of a display panel and a display panel driving circuit (not shown). The display panel driving circuit may drive the display panel based on the image sequence output by the display control device 100 . Furthermore, the display control device 100 detects the wireless projection connection and automatically triggers the split display mode or the picture-in-picture mode of the display device 10 accordingly.

Figure 2 shows a detailed structural diagram of a display control device according to an embodiment of the present invention. As shown in the figure, the display control device 100 includes a processing circuit 110, a network interface circuit 120, one or more video connection ports 130_1~130_N, a video transmission interface circuit 140 and a near-field communication (NFC) Interface circuit 150. Through wired transmission, the above-mentioned video port 130_1~130_N can be connected to one or more wired video source devices 20_1~20_M that can provide video content. In various embodiments of the present invention, the wired video source devices 20_1~20_M may be set-top boxes, game consoles, multimedia players, DVD players, Blu-ray players, notebook computers, desktop computers, and smart phones. , tablet computers, etc. These wired video source devices 20_1~20_M can communicate through High Definition Multimedia Interface (HDMI), DisplayPort (DP), Thunderbolt, or Universal Serial Bus (Universal Serial Bus) Type-C, etc. A type of video transmission interface provides video content to the display control device 100 for presentation on the display device 10 . On the other hand, the network interface circuit 120 is used to provide connection capabilities with other devices. For example, through the network interface circuit 120, the display control device 100 can be connected to a router or an access point (not shown) through a wireless or wired connection. When the network interface circuit 120 is connected to a router or access point, the wireless video source devices 30_1~30_O connected to the router or access point can provide video content to the display control device 100, thereby achieving wireless projection, for example, Wireless projection based on the Airplay protocol introduced by Apple. In addition, through the network interface circuit 120, the wireless video source devices 30_1~30_O can also provide video content to the display control device 100 in a Wi-Fi direct manner, thereby achieving wireless projection, for example, Realize wireless projection based on the Miracast protocol developed by the Wi-Fi Alliance. In various embodiments of the present invention, the wireless video source devices 30_1 ~ 30_M may be laptop computers, smart phones, tablet computers, or various electronic devices that support wireless projection functions.

Figure 3 further explains how the display control device 100 displays video content provided by different video source devices through screen segmentation. First, when one of the wired video source devices 20_1 ~ 20_M (eg, the wired video source device 20_k) is connected to the display control device 100 through one of the video connection ports 130_1 ~ 130_N, the video transmission interface circuit 140 will The video signal is received from the video connection port connected to the wired video source device 20_k, and the video signal is sent to the processing circuit 110 . Process electricity The path 110 will process the video signal and provide it to the display module 15 for display. At this time, if the user intends to watch the video content of other video source devices on the display device 10, the display device 10 can enter the split display mode or the picture-in-picture mode. Furthermore, the user can project the screen content of one of the wireless video source devices 30_1 to 30_M (eg, the wireless video source device 30_k) to the display device 10 (ie, screen mirroring). Or, specific media content on the wireless video source device 30_k (for example, audio and video files stored in the wireless video source device 30_k, media content played through a browser running on the wireless video source device 30_k, or The media content played by the application running on the wireless video source device 30_k) is projected to the display control device 100. Among them, the wireless video source devices 30_1 ~ 30_M can transmit the video content to the display control device 100 through a wireless connection based on the Airplay protocol or the Miracast protocol.

The display control device 100 can utilize the network interface circuit 120 to learn the wireless projection connection activated by the wireless video source device 30_k, and receive a video signal including the video content of the wireless video source device 30_k. After receiving the video signal from the wireless video source device 30_k, the processing circuit 110 will synthesize the video content respectively provided by the wired video source device 20_k and the wireless video source device 30_k for the display module 15 to display. In addition, if the user wants to display the video content of the second wireless video source device 30_1 on the display device 10. The user can selectively end the wired video signal transmission between the wired video source device 20_k and the display device 10, for example, turn off the wired video source device 20_k, or unplug the transmission line between the wired video source device 20_k and the display device 10. Then, the user can operate the second wireless video source device 30_l to cause the second wireless video source device 30_l to perform wireless projection, thereby simultaneously displaying the video contents of the wireless video source device 30_k and the wireless video source device 30_l on the display device 10 .

It is worth noting that the above process does not require user intervention at all. Furthermore, As long as the user activates the wireless projection connection on the wireless video source device 30_k or the wireless video source device 30_l, the processing circuit 110 can learn through the network interface circuit 120 that the wireless video source device 30_k or the wireless video source device 30_l activates the wireless projection connection. line, and instantly present video content provided by different video source devices in split display mode or picture-in-picture mode. When the wired video source device 20_k and the wireless video source device 30_k simultaneously provide video content to the display control device 100, the processing circuit 110 will combine one and multiple images in the video signal provided by the wired video source device 20_k with One of the video signals provided by the wireless video source device 30_k is synthesized with multiple images to obtain one or more composite images, and the one or more composite images are delivered to the display module 15 for display. Furthermore, when the wireless video source device 30_k and the wireless video source device 30_l provide video content to the display control device 100 at the same time, the processing circuit 110 will process the video signals respectively provided by the wireless video source device 30_k and the wireless video source device 30_l. One is combined with multiple images, and the resulting one or more composite images are delivered to the display module 15 for display. During the above process, the user does not need to issue operating commands to the display device 10 and the display control device 100, and the processing circuit 110 can automatically complete the process.

In another embodiment shown in FIG. 4 , the wireless video source devices 30_1 ~ 30_M can also trigger the wireless projection connection through short-range wireless communication with the display control device 100 . That is to say, the user does not need to perform operations on the wireless video source devices 30_1~30_M to activate wireless projection, but can activate wireless projection by moving the wireless video source devices 30_1~30_M to a distance where short-range wireless communication is effective. projection. Among them, the NFC interface circuit 150 in the display control device 100 can establish a wireless projection connection with one of the wireless video source devices 30_1 to 30_M (eg, the wireless video source device 30_k) through short-range wireless communication. Afterwards, the wireless video source device 30_k can use the wireless projection connection to transmit the video content to the display control device 100. The display control device 100 will also automatically enter the split display mode or picture-in-picture mode, allowing the display module 15 to display video content provided by multiple video source devices.

In another embodiment shown in FIG. 5 , the display control device 100 can also automatically enter the split display mode or the picture-in-picture mode when multiple wired video source devices are connected and started. As shown in the figure, when only one wired video source device 20_k is connected to one of the video connection ports 130_1 ~ 130_N of the display control device 100 through a wired connection, the display control device 100 will transmit the video provided by the wired video source device 20_k Content is displayed in full screen mode. However, when a second wired video source device 20_1 is connected to another one of the video ports 130_1~130_N, and the video transmission interface circuit 140 in the display control device 100 detects that the wired video source device 20_1 is connected through the video port When another one of 130_1~130_N provides a video signal, the display control device 100 automatically enters the split display mode or the picture-in-picture mode, so that the display module 15 simultaneously displays the signals provided by the wired video source device 20_l and the wired video source device 20_k. video content.

It can be seen from the above that the display control device 100 can not only automatically activate the split display mode or the picture-in-picture mode according to the newly connected wireless projection connection, but also can automatically activate the split display mode or the split display mode according to the newly connected wired connection. Picture-in-picture mode. Furthermore, when there is only one wired video source device or only one wireless video source device, the display control device 100 displays the video content provided by the device in full-screen mode. Afterwards, once another wired video source device establishes a wired connection with the display control device 100 (the input of the video signal can be detected through the video transmission interface circuit 140), or another wireless video source device establishes a wired connection with the display control device 100 When the wireless projection is connected (the wireless projection connection request can be detected through the network interface circuit 120), the display control device 100 automatically enters the split display mode or the picture-in-picture mode, so that the display module 15 displays two Video content provided by wireless/wired video source devices.

It is worth mentioning that although in the above embodiments, the display device 10 is in a split display mode, method to present the video content of different video source devices, but as shown in the example of FIG. 6B , the display control device 100 can also present the video content of different video source devices in a picture-in-picture mode. Furthermore, the present invention does not limit the size or number of split pictures or picture-in-picture pictures. In different embodiments of the present invention, the split display mode or picture-in-picture mode that the display control device 100 can implement may have more or less sub-pictures than the examples shown in FIGS. 6A and 6B. , or different screen ratios and sizes.

Figure 7 illustrates a flow chart of a display control method according to an embodiment of the present invention. The display control method of the present invention has the following steps: S210: Receive a first video signal provided by a first video source device, and perform the following steps: Display one or more first images in the first video signal on the display device; S220: During the process of displaying the one or more first images on the display device, establish a connection with a second video source device A connection, and receiving a second video signal provided by the second video source device through the connection; S230: Without receiving control input from the user, one or more of the second video signals The second image is processed with one or more first images in the first video signal to generate one or more composite images; and S240: display the one or more composite images on the display device .

Since the detailed principles, specific operations and related implementation changes of each step have been explained in detail in the aforementioned implementation description of the display control device, they will not be described repeatedly here. Persons skilled in the art to which the present invention belongs should be able to implement the display control method of the present invention based on the above steps after fully understanding the foregoing description. It should be noted that the above process may be able to better implement picture-in-picture mode or picture-in-picture mode on the display device by adding other additional steps or making appropriate changes and adjustments. The latter is a split display mode, thereby further improving the user experience, and such implementation changes also fall within the scope of the present invention.

To sum up, the characteristic of the present invention is that it can trigger the split display mode or picture-in-picture mode of the display device based on the wireless projection connection, thereby reducing the user's intervention and providing a better user experience. Moreover, the present invention also solves the problem that existing display devices do not support displaying wirelessly projected video content in picture-in-picture mode.

Embodiments of the present invention can be implemented using hardware, software, firmware, and related combinations thereof. Embodiments of the present invention can be implemented through an appropriate instruction execution system using software or firmware stored in a memory and a corresponding instruction execution processor. In terms of hardware, it can be accomplished by applying any of the following technologies or their related combinations: a separate operational logic with logic gates that can perform logical functions based on data signals, an application-specific integration with suitable combinational logic gates Circuit (application specific integrated circuit, ASIC), programmable gate array (programmable gate array, PGA) or a field programmable gate array (field programmable gate array, FPGA), etc.

The processes and blocks in the flowcharts in the description illustrate the architecture, functions and operations that can be achieved by systems, methods and computer software products based on various embodiments of the present invention. In this regard, each block in the flowchart or functional block diagram may represent a module, section, or portion of program code, which includes one or more executable instructions for implementing the specified logical function. In addition, each block in the functional block diagram and/or flowchart, and the combination of blocks, can basically be implemented by a dedicated hardware system that performs the specified function or action, or a combination of dedicated hardware and computer program instructions. . These computer program instructions can also be stored in a computer-readable medium, which can cause a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable medium implement the flow chart and the like. and/or the functions/actions specified by the blocks in the functional block diagram.

The above are only preferred embodiments of the present invention, and all equivalent changes and modifications made in accordance with the patentable scope of the present invention shall fall within the scope of the present invention.

Claims (9)

A display control method includes: receiving a first video signal provided from a first video source device to display one or more first images in the first video signal on a display device; on the In the process of displaying the one or more first images, the display device establishes a connection with a second video source device and receives a second video signal provided by the second video source device through the connection. ; Without receiving control input from the user, generate one or more second images based on one or more second images in the second video signal and one or more first images in the first video signal. Composite images; and displaying the one or more composite images on the display device, wherein each of the one or more composite images includes at least a first area and a second area, the first The area includes one of the one or more first images, and the second area includes one of the one or more second images. The display control method as described in claim 1, wherein the step of receiving the first video signal provided from the first video source device includes: receiving the first video signal from the first video source device through a wired connection. First video signal. The display control method as described in claim 2, wherein the wired connection is a High Definition Multimedia Interface (HDMI) connection or a DisplayPort (DP) connection. The display control method as described in request item 1, wherein receiving from the first video source The step of providing the first video signal by the device includes: receiving the first video signal from the first video source device through a wireless connection. The display control method as described in claim 1, wherein the wireless connection is a wireless connection based on Airplay protocol or Miracast protocol. The display control method of claim 1, wherein the step of establishing the wireless connection with the second video source device includes: using a Near Field Communication connection to establish the wireless connection with the second video source device. The wireless connection between video source devices. The display control method as claimed in claim 1, wherein the connection is a wired connection or a wireless connection. A display control device used in a display device, including: a processing circuit for receiving a first video signal provided by a first video source device, so that the display device can display the first video signal one or more first images; and a network interface circuit coupled to the processing circuit for communicating with a second video source device during the display device displaying the one or more first images A wireless connection is established between them, and a second video signal provided by the second video source device is received through the wireless connection; wherein, the processing circuit performs processing on the second video signal without receiving control input from the user. One or more second images in the video signal are processed with one or more first images in the first video signal to generate one or more composite images, and the display device can display the one or more second images. or a plurality of composite images, wherein each of the one or more composite images includes at least a first A region and a second region, the first region includes one of the one or more first images, and the second region includes one of the one or more second images. The display control device of claim 8 further includes: a video transmission interface circuit for receiving the first video signal from the first video source device through a wired connection.