CN110418429B

CN110418429B - Data display method, computing equipment and data display system

Info

Publication number: CN110418429B
Application number: CN201910675560.XA
Authority: CN
Inventors: 李鹤
Original assignee: Wuhan Deepin Technology Co ltd
Current assignee: Wuhan Deepin Technology Co ltd
Priority date: 2019-07-25
Filing date: 2019-07-25
Publication date: 2021-08-03
Anticipated expiration: 2039-07-25
Also published as: CN110418429A

Abstract

The invention discloses a data display method, which is executed in a control terminal and comprises the following steps: acquiring an IP address of a display terminal; according to the IP address, establishing TCP connection with the display terminal; sending the target file to a display terminal; and sending a control command to the display terminal to control the display condition of the target file on the display terminal. The invention also discloses corresponding computing equipment and a data display system.

Description

Data display method, computing equipment and data display system

Technical Field

The present invention relates to the field of data sharing and display technologies, and in particular, to a data sharing and display method between terminal devices, a computing device, and a data display system.

Background

The application of intelligent mobile terminals, such as mobile phones, tablet computers, intelligent wearable devices, etc., in daily life is becoming more and more widespread, and people gradually have generated a demand for data sharing and display between the intelligent mobile terminals and devices such as desktop computers (PCs), projectors, smart televisions, etc. For example, in some application scenarios, a user needs to share data on a mobile phone to a PC system for display, and control the display of the data on the PC by performing an interactive operation on the mobile phone.

Currently, the Android mobile phone can adopt the Miracast scheme to deliver the video/audio content on the mobile phone to the display of the PC for display. The scheme is based on a WFD (Wi-Fi Display) protocol to realize point-to-point connection among devices, special hardware support (such as a newer wireless network card) is needed, and for some older devices, the functions cannot be realized. In addition, the scheme only supports real-time transmission of video/audio data, the content displayed on the PC is a complete copy of the content displayed on the mobile phone, and the mobile phone of the user is always occupied and cannot perform other work in the data display process of the PC, so that the display content on the PC is difficult to be flexibly controlled through the mobile phone.

Disclosure of Invention

To this end, the present invention provides a data display method, a computing device and a data display system in an attempt to solve or at least alleviate the above-existing problems.

According to a first aspect of the present invention, there is provided a data display method, performed in a control terminal, comprising: acquiring an IP address of a display terminal; establishing TCP connection with the display terminal according to the IP address; sending the target file to a display terminal; and sending a control command to the display terminal to control the display condition of the target file on the display terminal.

Optionally, in the data display method according to the present invention, the step of obtaining the IP address of the display terminal includes: scanning a two-dimensional code, wherein the two-dimensional code comprises IP address information of a display terminal; and analyzing the two-dimensional code to obtain the IP address of the display terminal.

Optionally, in the data display method according to the present invention, the step of establishing a TCP connection with the display terminal includes: sending a TCP connection request to the display terminal so as to establish TCP connection with the display terminal; and sending a registration command to the display terminal so as to register as a client of the display terminal.

Optionally, in the data display method according to the present invention, the step of sending a control command to the display terminal to control a display condition of the target file on the display terminal includes: judging whether a display terminal runs a target application or not, wherein the target application is suitable for opening the target file; and if the display terminal runs the target application, setting the target application window as the current active window of the display terminal.

Optionally, in the data display method according to the present invention, the step of setting the target application window as a currently active window includes: and sending a window activation command to the display terminal so that the display terminal executes the window activation command to set the target application window as the current active window of the display terminal.

Optionally, in the data display method according to the present invention, the control terminal stores a correspondence between the interactive operation and the control command, and the method further includes: and receiving the interactive operation of the user on the control terminal, and determining the control command corresponding to the interactive operation of the user according to the preset corresponding relation between the interactive operation and the control command.

Optionally, in the data display method according to the present invention, the interactive operation includes at least one of a click, a long press, a swipe, and a text input, and the control command includes a keyboard key identification combination.

Optionally, in the data display method according to the present invention, further comprising: a logout command is transmitted to the display terminal in order to terminate the control process of the display terminal.

According to a second aspect of the invention, there is provided a computing device comprising: at least one processor; and a memory storing program instructions comprising a window management program that, when read and executed by the processor, causes the computing device to perform the data display method as described above.

According to a third aspect of the present invention, there is provided a readable storage medium storing program instructions which, when read and executed by a computing device, cause the computing device to perform the data display method as described above.

According to a fourth aspect of the present invention, there is provided a data display system, including a control terminal and a display terminal, wherein the control terminal is adapted to obtain an IP address of the display terminal, establish a TCP connection with the display terminal according to the IP address, send a target file to the display terminal, and send a control command to the display terminal; the display terminal is suitable for receiving and displaying the target file and controlling the display condition of the target file according to the control command.

According to the data display method, the TCP connection is established between the control terminal and the display terminal based on the TCP/IP protocol, so that data transmission can be carried out between the control terminal and the display terminal. Because the current devices capable of accessing the Internet all support the TCP/IP protocol, the data display method of the invention does not need to configure a newer wireless network card supporting the WFD protocol, reduces the hardware requirements on the control terminal and the display terminal, and has good adaptability in the aspects of hardware configuration and network environment.

In the TCP/IP connection, the control terminal corresponds to a client, and the display terminal corresponds to a server. After both establish a TCP connection, data (target file) and control commands can be transmitted. In the data display method, the control terminal firstly sends the target file to the display terminal, and then flexibly controls the display condition of the target file on the display terminal by sending the control command to the display terminal. Unlike the existing method of transmitting audio/video data streams in real time, in the data display method of the present invention, the contents displayed by the display terminal and the contents displayed by the control terminal are independent of each other, rather than a complete copy of the screen of the control terminal. In the process of displaying the target file by the display terminal, the user can perform other operations on the control terminal, so that the flexibility and the usability of the control terminal are improved.

The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.

Drawings

To the accomplishment of the foregoing and related ends, certain illustrative aspects are described herein in connection with the following description and the annexed drawings, which are indicative of various ways in which the principles disclosed herein may be practiced, and all aspects and equivalents thereof are intended to be within the scope of the claimed subject matter. The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description read in conjunction with the accompanying drawings. Throughout this disclosure, like reference numerals generally refer to like parts or elements.

FIG. 1 shows a schematic diagram of a data display system 100 according to one embodiment of the invention;

FIG. 2 shows a schematic diagram of a control terminal 200 according to one embodiment of the invention;

FIG. 3 illustrates a flow diagram of a data display method 300 according to one embodiment of the invention;

FIG. 4 shows a schematic diagram of an interactive interface on a control terminal 200 according to one embodiment of the present invention; and

FIG. 5 shows a schematic diagram of a data sharing display process according to one embodiment of the invention.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

Aiming at the problems in the prior art, the invention provides a data display method which can share data in a control terminal to a display terminal for displaying under the condition that the hardware of the terminal equipment is not required to be upgraded. The control terminal controls the display condition of the target file on the display terminal by sending a control command to the display terminal. The content displayed by the display terminal and the content displayed by the control terminal are independent of each other, rather than a complete copy of the control terminal screen. In the process of displaying the target file by the display terminal, the user can perform other operations on the control terminal, so that the flexibility and the usability of the control terminal are improved.

FIG. 1 shows a schematic diagram of a data display system 100 according to one embodiment of the invention. As shown in fig. 1, the data display system 100 includes a control terminal 200 and a display terminal 110.

The control terminal 200 is a portable mobile terminal, which may be, for example, a mobile phone, a tablet computer, a multimedia player, a smart wearable device, etc., but is not limited thereto.

The display terminal 110 is a terminal device having a display screen. In general, the screen size of the display terminal 110 is larger than that of the control terminal 110. The display terminal 110 may be, for example, a desktop Computer (abbreviated as PC), a notebook Computer, a smart tv, a projector, etc., but is not limited thereto.

In some scenarios, the display terminal 110 is connected to a display 120 with a larger screen size than the display terminal, and the data stored in the display terminal 110 can be displayed on the display 120 with the larger screen size, so as to achieve a better display effect. For example, the display terminal 110 is a notebook computer, and the screen size of the notebook computer is usually between 13 inches and 15 inches. The notebook computer is externally connected to the display 120, and the size of the display 120 can be 24 inches, 27 inches or even larger. By externally connecting the display 120, the data in the notebook computer 110 can be displayed on the display 120 in a single mode, a copy mode, an expansion mode, and the like.

In an embodiment of the present invention, the control terminal 200 may execute the data display method 300 of the present invention, and the specific steps of the method 300 will be described in detail below. By executing the data display method 300, the control terminal 200 establishes a wireless connection with the display terminal 110 based on the TCP/IP protocol, and sends the target file, i.e. the file to be displayed, to the display terminal 110 for storage, so that the target file is displayed on the screen of the display terminal 110 itself or the external display 120. In the display process of the object file, the control terminal 200 may send a control command to the display terminal 110 to control the display condition of the object file on the display terminal 110.

Fig. 2 shows a schematic diagram of a control terminal 200 according to an embodiment of the invention. It should be noted that the control terminal 200 shown in fig. 2 is only an example, and in practice, the control terminal for implementing the data display method of the present invention may be any type of terminal device, and the hardware configuration of the control terminal may be the same as or different from that of the control terminal shown in fig. 2. In practice, the control terminal for implementing the data display method of the present invention may add or delete hardware components of the control terminal 200 shown in fig. 2, and the present invention does not limit the specific hardware configuration of the control terminal.

As shown in fig. 2, control terminal 200 may include a memory interface 202, a multi-core processor 204, and a peripheral interface 206.

The memory interface 202, the multi-core processor 104, and/or the peripheral interface 206 may be discrete components or may be integrated in one or more integrated circuits. In the control terminal 200, the various elements may be coupled by one or more communication buses or signal lines. Sensors, devices, and subsystems can be coupled to peripheral interface 206 to facilitate a variety of functions.

For example, the acceleration sensor 210, the magnetic field sensor 212, and the gravity sensor 214 may be coupled to the peripheral interface 206, the acceleration sensor 210 may collect acceleration data in three coordinate axis directions of the body coordinate system, the magnetic field sensor 212 may collect magnetic field data (magnetic induction intensity) in three coordinate axis directions of the body coordinate system, the gravity sensor 214 may collect gravity data in three coordinate axes of the body coordinate system, and the above sensors may conveniently implement functions such as step counting, orientation, and intelligent horizontal and vertical screen switching. Other sensors 216 may also be coupled to the peripheral interface 206, such as a positioning system (e.g., a GPS receiver), a temperature sensor, a biometric sensor, or other sensing device, to facilitate related functions.

Camera subsystem 220 and optical sensor 222, which may be, for example, a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) optical sensor, may be used to facilitate implementation of camera functions such as recording photographs and video clips. Communication functions may be facilitated by one or more wireless communication subsystems 224, which may include radio frequency receivers and transmitters and/or optical (e.g., infrared) receivers and transmitters. The particular design and implementation of wireless communication subsystem 224 may depend on one or more communication networks supported by control terminal 200. For example, control terminal 200 may include a communication subsystem 224 designed to support an LTE, 3G, GSM network, a GPRS network, an EDGE network, a Wi-Fi or WiMax network, and a Bluetooth network.

The audio subsystem 226 may be coupled with a speaker 228 and a microphone 230 to facilitate voice-enabled functions, such as voice recognition, voice replication, digital recording, and telephony functions. The I/O subsystem 240 may include a touchscreen controller 242 and/or one or more other input controllers 244. The touch screen controller 242 may be coupled to a touch screen 246. For example, the touch screen 246 and touch screen controller 242 may detect contact and movement or pauses made therewith using any of a variety of touch sensing technologies, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies. One or more other input controllers 244 can be coupled to other input/control devices 248, such as one or more buttons, rocker switches, thumbwheels, infrared ports, USB ports, and/or pointing devices such as styluses. The one or more buttons (not shown) may include up/down buttons for controlling the volume of the speaker 228 and/or the microphone 230.

The memory interface 202 may be coupled with a memory 250. The memory 250 may include an internal memory such as, but not limited to, a Static Random Access Memory (SRAM), a non-volatile memory (NVRAM), and the like; the external memory may be, for example, a hard disk, a removable hard disk, a U disk, etc., but is not limited thereto. Memory 250 may store program instructions that may include, for example, an operating system 252 and applications 254. The operating system 252 may be, for example, Android, iOS, Windows Phone, etc., which includes program instructions for handling basic system services and for performing hardware-dependent tasks. The memory 250 may also store applications 254, which applications 254 may include program instructions for implementing various user-desired functions. The application 254 may be provided separately from the operating system or may be native to the operating system. In addition, when the application 254 is installed in the control terminal 200, a driver module may also be added to the operating system. While the mobile device is running, the operating system 252 is loaded from the memory 250 and executed by the processor 204. The application 254, when running, is also loaded from the memory 250 and executed by the processor 204. The application 254 runs on top of an operating system and uses the operating system and interfaces provided by the underlying hardware to implement various user-desired functions, such as hardware management, instant messaging, web browsing, and the like.

Among the various applications 254 described above, one of which is the data display application 256 according to the present invention, the data display application 256 includes instructions for executing the data display method 300 of the present invention, and when the instructions are read and executed by the processor 204, the control terminal 200 may be caused to execute the data display method 300 of the present invention, share the target file in the control terminal 200 onto the display terminal 110 for display, and may control the display of the target file on the display terminal 110 by sending a control command to the display terminal 110.

FIG. 3 shows a flow diagram of a data display method 300 according to one embodiment of the invention. The method 300 is performed in a control terminal, such as the control terminal 200 described above. As shown in fig. 3, the method 300 begins at step S310.

In step S310, the IP address of the display terminal is acquired.

According to one embodiment, the display terminal can acquire the IP address information of the display terminal and generate the two-dimensional code based on the IP address information. That is, the generated two-dimensional code includes IP address information of the display terminal. And then, the control terminal scans the two-dimensional code by adopting a camera and analyzes the two-dimensional code so as to obtain the IP address of the display terminal.

Subsequently, in step S320, a TCP connection is established with the display terminal according to the IP address.

According to an embodiment, step S320 further comprises: sending a TCP connection request to the display terminal so as to establish TCP connection with the display terminal; subsequently, a registration command is transmitted to the display terminal so as to register the client becoming the display terminal.

In the embodiment of the invention, the control terminal sends the TCP connection request to the display terminal based on the IP address of the display terminal. And finally, establishing TCP connection between the control terminal and the display terminal through a three-way handshake process of a TCP protocol. Specifically, the three-way handshake process for establishing the TCP connection between the control terminal and the display terminal is as follows:

1. first handshake: the control terminal transmits a TCP connection request segment including a synchronization bit SYN ═ 1 and an initial sequence number seq ═ x to the display terminal.

2. Second handshake: after receiving the TCP connection request segment from the control terminal, the display terminal sends a first acknowledgement segment to the control terminal, where the segment includes a synchronization bit SYN ═ 1, an acknowledgement bit ACK ═ 1, an acknowledgement number ACK ═ x +1, and an initial sequence number seq ═ y.

3. Third handshake: after receiving the first acknowledgement segment sent by the display terminal, the control terminal sends a second acknowledgement segment to the display terminal, where the segment includes an acknowledgement bit ACK-1, an acknowledgement number ACK-y +1, and a sequence number seq of itself-x + 1.

And after three-way handshake, the control terminal establishes TCP connection with the display terminal. Subsequently, data transmission can be performed between the two. The control terminal further transmits a registration command to the display terminal to register a Client (Client) that becomes the display terminal, and accordingly, the display terminal acts as a Server (Server). After registering as the client of the display terminal, the control terminal may send the target file and the control command to the display terminal in subsequent steps S330 and S340, so as to control the display condition of the target file on the display terminal.

In the embodiment of the invention, the control terminal and the display terminal establish wireless connection and carry out data transmission based on the TCP/IP protocol. The TCP/IP protocol was proposed in the 70's of the last century (twentieth century), and all the current devices capable of accessing the internet support the protocol, so that the current network devices have the hardware condition for implementing the data display method 300 of the present invention, in other words, the data display method 300 of the present invention does not need to specially upgrade or configure new hardware for the control terminal or the display terminal. The existing Miracast scheme realizes connection and data transmission between devices based on a WFD protocol, which was proposed in 2013, and old hardware (such as a wireless network card produced before 2013) cannot support the new protocol, so the Miracast data sharing scheme cannot be applied to old devices.

Compared with the existing Miracast data sharing display scheme, the data display scheme provided by the invention reduces the hardware requirements on the control terminal and the display terminal, can be universally applied to the existing terminal equipment, and has good hardware adaptability. In addition, the invention establishes the wireless connection between the control terminal and the display terminal based on the TCP/IP protocol, improves the reliability of data transmission and can adapt to complex network environment.

After the control terminal establishes the TCP connection with the display terminal, step S330 is executed.

In step S330, the target file is transmitted to the display terminal.

The control terminal may transmit the target file to the display terminal based on the TCP connection established with the display terminal. And the display terminal receives and stores the target file.

The target file is the file which needs to be shared and displayed on the display terminal. The target file can be of any type, and the type of the target file is not limited by the invention. For example, the target file may be an audio file (with an extension of. mp3,. wma,. wav, etc.), a video file (with an extension of. avi,. rm,. rmvb, etc.), a document file (with an extension of. doc,. txt, etc.), a table file (with an extension of. xls,. xlsx, etc.), a presentation file (with an extension of. ppt,. dps, etc.), etc., but is not limited thereto.

Subsequently, in step S340, a control command is sent to the display terminal to control the display of the target file on the display terminal.

According to one embodiment, in step S340, first, the control terminal determines whether the display terminal runs a target application, and the target application is suitable for opening a target file. For example, if the target file is a video file, the target application is a video player capable of opening the video file; and if the target file is dps presentation, the target application is WPS slide application. Specifically, the control terminal may obtain current process information of the display terminal by accessing a/proc directory of the display terminal, determine to start application programs of respective processes, and determine whether the application programs include a target application in which a target file is opened.

If the display terminal runs the target application, the target application window is set as the current active window, namely, the target application window is moved to the top end of the window stack, so that the target application window can be completely displayed on the screen and is not blocked by windows of other applications. According to one embodiment, the control terminal sends a window activation command to the display terminal so that the display terminal executes the window activation command to set the target application window as the currently active window of the display terminal. The window activation command may employ, for example, an ActivateWindow function, but is not limited thereto.

And if the display terminal does not run the target application, indicating that the target file is not opened. In this case, a prompt message may be issued on the control terminal to prompt the user to manually open the target file on the display terminal. Or, the control terminal may send a command to the display terminal to open the target file, so that the display terminal executes the command to start the target application to open the target file.

After the target application window is set as the current active window on the display terminal, the control terminal may further send a control command to the display terminal to control the display condition of the target file on the display terminal.

According to one embodiment, the control terminal stores the corresponding relationship between the interactive operation of the user and the control command. When a user carries out interactive operation on the control terminal, the control terminal can receive the interactive operation of the user, determine a control command corresponding to the interactive operation of the user according to the preset corresponding relation between the interactive operation and the control command, and send the control command to the display terminal.

It should be noted that the interactive operation may be any input operation of the user on the control terminal, and the type of the interactive operation is not limited in the present invention. According to an embodiment, the interactive operation may be, for example, a touch gesture input operation such as a click, a long press, a slide, or the like, or a text input operation, or the like, but is not limited thereto.

The control command is a command that can be recognized and executed by the display terminal. According to one embodiment, the control command may be, but is not limited to, a keyboard key identification combination.

The corresponding relationship between the interactive operation and the control command is set by the person skilled in the art, and the specific setting condition of the corresponding relationship is not limited by the invention.

For example, the target file is a presentation with an extension of.dps, which may be opened using a WPS slide application. The user sends a control command to the display terminal by inputting corresponding characters on the control terminal, namely, the interactive operation type of the user on the control terminal is text input. The control command is a keyboard key identification combination. The corresponding relationship between the interactive operation and the control command and the effect achieved by the display terminal executing the control command are shown in the following table:

TABLE 1

Interactive operation	Control command	Controlling the effect of execution of commands
			Inputting the text "Show"	F5	Showing from the beginning
Input text "ShowCurrent"	Shift+F5	Starting from the current slide show
			Inputting text "Next"	PageDown	Turn the page backward
Input text "Prev"	PageUp	Turn the page forward
			Input text "Exit”	Esc	Quit projection

When the user inputs 'Show' on the control terminal, the control terminal determines that the control command corresponding to the interactive operation of the text 'Show' input by the user is the F5 key according to the corresponding relation between the interactive operation and the control command shown in the table 1, and sends the identifier of the F5 key to the display terminal. After the display terminal receives the control command containing the identifier of the F5 key, the control command is executed, and the effect of pressing the F5 key on the keyboard of the display terminal is generated. Since the F5 key is a shortcut key for starting a slide show from the beginning in the WPS slide show application, the display terminal executing the control command will produce an execution effect of starting a slide show from the beginning.

When a user inputs 'ShowCurrent' on the control terminal, the control terminal determines that the control command corresponding to the interactive operation of the user input text 'ShowCurrent' is a Shift + F5 key according to the corresponding relation between the interactive operation and the control command shown in Table 1, and sends the identification of the Shift + F5 key to the display terminal. After the display terminal receives the control command containing the Shift + F5 identifier, the control command is executed, resulting in the effect of pressing the Shift and F5 keys simultaneously on the keyboard of the display terminal. Since the Shift + F5 key is a shortcut key for starting a show from the current slide in the WPS slide application, the display terminal executing the control command will produce an execution effect of starting a show from the current slide.

Similarly, when the user inputs "Next", "Prev" and "Exit" on the control terminal, the control terminal respectively sends control commands containing the identifications of the PageDown key, PageUp key and Esc key to the display terminal, and the display terminal respectively executes the control commands to generate the execution effects of turning back pages, turning forward pages and exiting the play.

For another example, for a presentation with an extension of.dps, the user may also send a control command to the display terminal by clicking a corresponding button control on an interactive interface of the control terminal, that is, the type of the interactive operation performed by the user on the control terminal is clicking. A schematic diagram of the interactive interface on the control terminal is shown in fig. 4. The control command is a keyboard key identification combination. The corresponding relationship between the interactive operation and the control command and the effect achieved by the display terminal executing the control command are shown in the following table:

TABLE 2

Interactive operation	Control command	Controlling the effect of execution of commands
			Clicking on button 410 in FIG. 4	F5	Showing from the beginning
Clicking on button 420 in FIG. 4	Shift+F5	Starting from the current slide show
			Clicking on button 430 in FIG. 4	PageUp	Turn the page forward
Clicking on button 440 in FIG. 4	PageDown	Turn the page backward
			Clicking on button 450 in FIG. 4	Esc	Quit projection

When the user clicks the button 410 on the interactive interface (screen) of the control terminal as shown in fig. 4, the control terminal determines that the control command corresponding to the operation of the user clicking the button 410 is the F5 key according to the correspondence between the interactive operation and the control command shown in table 2, and sends the identifier of the F5 key to the display terminal. After the display terminal receives the control command containing the identifier of the F5 key, the control command is executed, and the effect of pressing the F5 key on the keyboard of the display terminal is generated. Since the F5 key is a shortcut key for starting a slide show from the beginning in the WPS slide show application, the display terminal executing the control command will produce an execution effect of starting a slide show from the beginning.

When the user clicks the button 420 on the control terminal interactive interface shown in fig. 4, the control terminal determines that the control command corresponding to the interactive operation of the user clicking the button 420 is a Shift + F5 key according to the corresponding relationship between the interactive operation and the control command shown in table 1, and sends the identifier of the Shift + F5 key to the display terminal. After the display terminal receives the control command containing the Shift + F5 identifier, the control command is executed, resulting in the effect of pressing the Shift and F5 keys simultaneously on the keyboard of the display terminal. Since the Shift + F5 key is a shortcut key for starting a show from the current slide in the WPS slide application, the display terminal executing the control command will produce an execution effect of starting a show from the current slide.

Similarly, when the user clicks the

buttons

430, 440 and 450 on the interactive interface of the control terminal, the control terminal respectively sends control commands containing the identifications of the PageUp key, the PageDown key and the Esc key to the display terminal, and the display terminal respectively executes the control commands to generate the execution effects of turning the screen forward, turning the screen backward and exiting the showing.

It should be noted that, the above only takes the target file as the dps presentation as an example, and two examples of the correspondence relationship between the interactive operation and the control command are given. The number and the type of the control commands can be set by those skilled in the art according to the type of the target file, and the invention does not limit the specific setting conditions of the control commands, the number and the type of the interactive operation and the corresponding relationship between the interactive operation and the control commands.

In step S340, the user may send a control command to the display terminal by performing an interactive operation on the control terminal to flexibly control the display condition of the target file on the display terminal. Unlike the existing method of transmitting a data stream in real time, in the data display method of the present invention, the content displayed by the display terminal and the content displayed by the control terminal are independent of each other, rather than a complete copy of the screen of the control terminal. In the process of displaying the target file by the display terminal, the user can perform other operations on the control terminal except for the short moment of sending the control command to the display terminal by operating the control terminal, so that the flexibility and the usability of the control terminal are improved.

According to one embodiment, when the control terminal no longer needs to control the display terminal, the control terminal sends a logout command to the display terminal in order to terminate the control process of the display terminal.

The data display process of the present invention is described below with an embodiment shown in fig. 5.

In step S501, the display terminal 110 acquires the IP address information of the display terminal itself, and generates a two-dimensional code including the IP address information.

Subsequently, in step S502, control terminal 200 scans and parses the two-dimensional code, and acquires the IP address of display terminal 110 therefrom.

Subsequently, in step S503, the control terminal 200 sends a TCP connection request (first handshake) to the display terminal 110, and the control terminal 200 establishes a TCP connection with the display terminal 110 through the second and third handshake processes of steps S504 and S505.

Subsequently, in step S506, the control terminal 200 transmits a register controller registration command to the display terminal 110, registers itself as a client of the display terminal 110, so as to subsequently transmit the target file and the control command to the display terminal 110.

Subsequently, in step S507, the display terminal 110 returns a message that the registration is successful.

Subsequently, in step S508, the control terminal 200 uploads the target file to the display terminal 110. The target file may be, for example, a.dps type presentation.

Subsequently, in step S509, the display terminal 110 saves the received target file locally.

Subsequently, in steps S510 and S511, the control terminal 200 reads the/proc directory of the display terminal 110, and determines whether the display terminal 110 has a target application, i.e., a WPS slide application, in which the target file is opened running.

When the display terminal runs the WPS slide application with the target file opened, the control terminal 200 transmits a window activation command to the display terminal 110 to set a target application window with the target file displayed as a currently active window of the display terminal 110 in step S512. In step S513, the display terminal 110 returns a message that the setting is successful.

Subsequently, in step S514, the control terminal 200 receives the interactive operation of the user, and sends a corresponding control command to the display terminal 110 according to the interactive operation, so as to control the display condition of the target file on the display terminal 110.

For example, as shown in table 1, when the control terminal 200 receives an interactive operation of a text "Next" input by a user, it determines that the control command corresponding to the interactive operation is a PageDown key, and transmits a control command including an identifier of the PageDown key to the display terminal 110, and the display terminal 110 performs an operation of pressing the PageDown key based on the control command, thereby achieving a display effect of turning a page of the dps presentation backward.

Depending on the user' S requirement, step S514 may be executed multiple times, that is, the control terminal 200 may send different control commands to the display terminal 110 in advance.

When the control terminal 200 no longer needs to control the display terminal 110, the control terminal 200 performs step S515 to transmit a logout command to the display terminal 110 so as to terminate the control process for the display terminal 110. In step S516, the display terminal 110 returns a message that the logout is successful.

A11: a data display system comprises a control terminal and a display terminal;

the control terminal is suitable for acquiring the IP address of the display terminal, establishing TCP connection with the display terminal according to the IP address, sending a target file to the display terminal and sending a control command to the display terminal;

the display terminal is suitable for receiving and displaying the target file and controlling the display condition of the target file according to the control command.

The various techniques described herein may be implemented in connection with hardware or software or, alternatively, with a combination of both. Thus, the methods and apparatus of the present invention, or certain aspects or portions thereof, may take the form of program code (i.e., instructions) embodied in tangible media, such as removable hard drives, U.S. disks, floppy disks, CD-ROMs, or any other machine-readable storage medium, wherein, when the program is loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for practicing the invention.

In the case of program code execution on programmable computers, the computing device will generally include a processor, a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device. Wherein the memory is configured to store program code; the processor is configured to execute the data display method of the present invention according to instructions in the program code stored in the memory.

By way of example, and not limitation, readable media may comprise readable storage media and communication media. Readable storage media store information such as computer readable instructions, data structures, program modules or other data. Communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. Combinations of any of the above are also included within the scope of readable media.

In the description provided herein, algorithms and displays are not inherently related to any particular computer, virtual system, or other apparatus. Various general purpose systems may also be used with examples of this invention. The required structure for constructing such a system will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.

In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will appreciate that the modules or units or components of the devices in the examples disclosed herein may be arranged in a device as described in this embodiment or alternatively may be located in one or more devices different from the devices in this example. The modules in the foregoing examples may be combined into one module or may be further divided into multiple sub-modules.

Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.

Furthermore, some of the described embodiments are described herein as a method or combination of method elements that can be performed by a processor of a computer system or by other means of performing the described functions. A processor having the necessary instructions for carrying out the method or method elements thus forms a means for carrying out the method or method elements. Further, the elements of the apparatus embodiments described herein are examples of the following apparatus: the apparatus is used to implement the functions performed by the elements for the purpose of carrying out the invention.

As used herein, unless otherwise specified the use of the ordinal adjectives "first", "second", "third", etc., to describe a common object, merely indicate that different instances of like objects are being referred to, and are not intended to imply that the objects so described must be in a given sequence, either temporally, spatially, in ranking, or in any other manner.

While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this description, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as described herein. Furthermore, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter. Accordingly, many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the appended claims. The present invention has been disclosed in an illustrative rather than a restrictive sense with respect to the scope of the invention, as defined in the appended claims.

Claims

1. A data display method is executed in a control terminal, wherein the control terminal stores the corresponding relation between interactive operation and control command, and the method comprises the following steps:

acquiring an IP address of a display terminal;

according to the IP address, a TCP connection request is sent to the display terminal so as to establish TCP connection with the display terminal;

sending a registration command to a display terminal so as to register as a client of the display terminal;

sending the target file to a display terminal;

receiving interactive operation of a user on a control terminal, and determining a control command corresponding to the interactive operation of the user according to a preset corresponding relation between the interactive operation and the control command, wherein the interactive operation comprises text input, and the control command comprises a keyboard key identification combination;

sending a control command to a display terminal to control the display condition of a target file on the display terminal, wherein the content displayed by the display terminal and the content displayed by the control terminal are independent from each other and are not the complete copy of a screen of the control terminal, and the step of sending the control command to the display terminal to control the display condition of the target file on the display terminal comprises the steps of judging whether a target application runs on the display terminal or not, wherein the target application is suitable for opening the target file; and if the display terminal runs the target application, sending a window activation command to the display terminal so that the display terminal executes the window activation command and sets the target application window as the current active window of the display terminal.

2. The method of claim 1, wherein the step of acquiring the IP address of the display terminal comprises:

scanning a two-dimensional code, wherein the two-dimensional code comprises IP address information of a display terminal;

and analyzing the two-dimensional code to obtain the IP address of the display terminal.

3. The method of claim 1, wherein the interaction further comprises at least one of a click, a long press, and a slide.

4. The method of any one of claims 1-3, further comprising the step of:

a logout command is transmitted to the display terminal in order to terminate the control process of the display terminal.

5. A computing device, comprising:

at least one processor; and

a memory storing program instructions;

the program instructions, when read and executed by the processor, cause the computing device to perform the data display method of any of claims 1-4.

6. A readable storage medium storing program instructions that, when read and executed by a computing device, cause the computing device to perform the data display method of any of claims 1-4.

7. A data display system comprises a control terminal and a display terminal, wherein the control terminal stores the corresponding relation between interactive operation and a control command;

the control terminal is suitable for acquiring an IP address of the display terminal, establishing a TCP connection with the display terminal according to the IP address, sending a target file to the display terminal, receiving interactive operation of a user on the control terminal, determining a control command corresponding to the interactive operation of the user according to a preset corresponding relation between the interactive operation and the control command, wherein the interactive operation comprises text input, the control command comprises a keyboard key identifier combination, and sending the control command to the display terminal, the step of establishing the TCP connection with the display terminal comprises sending a TCP connection request to the display terminal so as to establish the TCP connection with the display terminal, and sending a registration command to the display terminal so as to register as a client of the display terminal, and the step of sending the control command to the display terminal so as to control the display condition of the target file on the display terminal comprises, judging whether a target application runs on the display terminal, wherein the target application is suitable for opening the target file, and if the target application runs on the display terminal, sending a window activation command to the display terminal so that the display terminal can execute the window activation command and set a target application window as a current active window of the display terminal;

the display terminal is suitable for receiving and displaying the target file and controlling the display condition of the target file according to the control command, wherein the content displayed by the display terminal and the content displayed by the control terminal are independent from each other and are not complete copies of the screen of the control terminal.