CN114915819B - Data interaction method, device and system based on interactive screen - Google Patents
Data interaction method, device and system based on interactive screen Download PDFInfo
- Publication number
- CN114915819B CN114915819B CN202210334674.XA CN202210334674A CN114915819B CN 114915819 B CN114915819 B CN 114915819B CN 202210334674 A CN202210334674 A CN 202210334674A CN 114915819 B CN114915819 B CN 114915819B
- Authority
- CN
- China
- Prior art keywords
- target
- interactive screen
- special effect
- data
- effect animation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/426—Internal components of the client ; Characteristics thereof
- H04N21/42653—Internal components of the client ; Characteristics thereof for processing graphics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
- H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
Abstract
The invention discloses a data interaction method, device and system based on an interactive screen, wherein the method comprises the following steps: transmitting sensor data to the receiving card through the target light sensor every time the light sensor on the interactive screen is triggered; converting the sensor data into preset fixed format data through a transmitting device, and uploading the preset fixed format data to the upper computer through the gigabit network cable; analyzing the preset fixed format data through an upper computer to obtain a target display area corresponding to the target light sensor on the interactive screen; the target special effect animation is transmitted to the transmitting equipment through the video line by the upper computer; and transmitting the target special effect animation to the receiving card through the transmitting equipment and playing the special effect animation in a target display area of the interactive screen so as to perform the data interaction process of the interactive screen in real time. The transmission efficiency of the hardware level can be improved through the gigabit network cable, the problem of delay in display is avoided, and meanwhile, the display efficiency of pictures is improved.
Description
Technical Field
The invention relates to the technical field of man-machine interaction, in particular to a data interaction method, device and system based on an interactive screen.
Background
Man-machine interaction means that people interact with a machine, the machine needs to collect interaction information of the people, and then corresponding interaction data is fed back through the interaction information. At present, in the process of using the interactive screen to perform interaction, data interaction is generally performed by means of a USB cable of the sending device (the USB cable is a bidirectional transmission line, and not only is a control instruction of the host computer required to be transmitted to the sending device, but also interaction information of the interactive screen is required to be fed back to the host computer through the sending device), however, the interaction mode has the following problems: the number of data interactions is limited by the USB cable transmission, and the transmission speed is not fast, which may cause a problem of display delay for real-time interactions.
Therefore, a new solution to the above-mentioned problems is needed for those skilled in the art.
Disclosure of Invention
In order to overcome the problems in the related art, the invention discloses a data interaction method, device and system based on an interactive screen.
According to a first aspect of the disclosed embodiments of the present invention, there is provided a data interaction method based on an interactive screen, applied to a data interaction system composed of an upper computer, a transmitting device, a receiving card and an interactive screen, wherein the upper computer and the transmitting device are connected through a gigabit network cable and a video cable, the transmitting device and the receiving card are connected, the receiving card is connected with the interactive screen, and a plurality of light sensors are arranged on the interactive screen, the method includes:
when the light sensor on the interactive screen is triggered, sensor data generated by the triggering action of a user is sent to the receiving card through the triggered target light sensor, so that the sensor data is sent to a sending device through the receiving card;
converting the sensor data into preset fixed format data through the sending equipment, and uploading the preset fixed format data to the upper computer through the gigabit network cable;
analyzing the preset fixed format data through the upper computer to obtain a target display area corresponding to the target light sensor on the interactive screen;
transmitting the target special effect animation corresponding to the target display area to the transmitting equipment through the video line by the upper computer;
and transmitting the target special effect animation to a receiving card through the transmitting equipment and playing the special effect animation in a target display area of the interactive screen so as to perform the data interaction process of the interactive screen in real time.
Optionally, each light sensor corresponds to one display area in the interactive screen, the analyzing, by the host computer, the preset fixed format data to obtain a target display area corresponding to the target light sensor on the interactive screen includes:
analyzing the preset fixed format data through the upper computer to obtain a target coordinate value corresponding to the target light sensor;
and determining a target display area on the interactive screen according to the target coordinate value.
Optionally, the interactive screen is connected with m Zhang Jieshou card, and every receiving card is connected with n light sensing sensors respectively, through the host computer is to the fixed format data that predetermines is parsed, obtain with the target coordinate value that the target light sensing sensor corresponds includes:
acquiring a receiving card number and a sensor number according to the sensor data;
determining a target receiving card in m Zhang Jieshou cards connected with the interactive screen according to the receiving card number;
determining the target light sensor in n light sensors connected with the target receiving card according to the sensor number;
and determining the target coordinate value according to the target light sensor.
Optionally, the preset fixed format data is UDP format data.
Optionally, the upper computer includes a display interface, each position in the display interface corresponds to a display area in the interactive screen one by one, and the transmitting, by the upper computer, the target special effect animation corresponding to the target display area to the transmitting device through the video line includes:
determining a target position on the display interface according to the target coordinate value;
simulating a mouse movement event on the display interface to determine a corresponding target special effect animation, wherein the simulated mouse movement event is as follows: after clicking a target position on the display interface by the simulation mouse, displaying the target special effect animation on the target position;
and transmitting a display picture containing the target special effect animation to the transmitting equipment through the video line, wherein the display picture is displayed on a display interface of the upper computer.
Optionally, the method further comprises:
determining a special effect animation and a display picture on the display interface;
binding each special effect animation with each position on the display interface, so that the upper computer displays the display picture, simultaneously displays the target special effect animation corresponding to the target position according to the clicked target position on the display interface when simulating a mouse moving event, and transmits the display picture containing the target special effect animation to the transmitting equipment.
According to a second aspect of the disclosed embodiments of the present invention, there is provided a data interaction device based on an interactive screen, applied to a data interaction system composed of a host computer, a transmitting device, a receiving card and an interactive screen, where the host computer and the transmitting device are connected by a gigabit network cable and a video cable, the transmitting device and the receiving card are connected, the receiving card is connected with the interactive screen, and a plurality of optical sensors are provided on the interactive screen, the device includes:
the sensor data generation module is used for transmitting sensor data generated by triggering actions of a user to the receiving card through the triggered target light sensor every time the light sensor on the interactive screen is triggered, so that the sensor data is transmitted to the transmitting device through the receiving card;
the sensor data conversion module is connected with the sensor data generation module, converts the sensor data into preset fixed format data through the sending equipment, and uploads the preset fixed format data to the upper computer through the gigabit network cable;
the sensor data analysis module is connected with the sensor data conversion module, and analyzes the preset fixed format data through the upper computer to obtain a target display area corresponding to the target light sensor on the interactive screen;
the special effect animation issuing module is connected with the sensor data analysis module and is used for issuing the target special effect animation corresponding to the target display area to the sending equipment through the video line;
and the data interaction module is connected with the special effect animation issuing module, and is used for sending the target special effect animation to the receiving card through the sending equipment and playing the special effect animation in a target display area of the interactive screen so as to perform the data interaction process of the interactive screen in real time.
Optionally, the sensor data analysis module includes:
the sensor data analysis unit analyzes the preset fixed format data through the upper computer to obtain a target coordinate value corresponding to the target light sensor;
and the target display area determining unit is connected with the sensor data analyzing unit and is used for determining a target display area on the interactive screen according to the target coordinate value.
Optionally, the upper computer includes a display interface, each position in the display interface corresponds to a display area in the interactive screen one by one, and the special effect animation issuing module includes:
a target position determining unit for determining a target position on the display interface according to the target coordinate value;
the special effect animation determining unit is connected with the target position determining unit, and is used for determining a corresponding target special effect animation by simulating a mouse moving event on the display interface, wherein the simulated mouse moving event is as follows: after clicking a target position on the display interface by the simulation mouse, displaying the target special effect animation on the target position;
and the special effect animation issuing unit is connected with the special effect animation determining unit and is used for issuing a display picture containing the target special effect animation to the sending equipment through the video line, wherein the display picture is displayed on a display interface of the upper computer.
According to a third aspect of the disclosed embodiments of the present invention, there is provided an interactive screen-based data interaction system, the system comprising: the data interaction system consists of an upper computer, a transmitting device, a receiving card and an interaction screen;
the upper computer is connected with the sending equipment through a gigabit network cable and a video cable; the transmitting device is connected with the receiving card, the receiving card is connected with the interactive screen, and a plurality of light sensing sensors are arranged on the interactive screen.
In summary, the present disclosure relates to a data interaction method, device and system based on an interactive screen, where the method includes: transmitting sensor data to the receiving card through the target light sensor every time the light sensor on the interactive screen is triggered; converting the sensor data into preset fixed format data through a transmitting device, and uploading the preset fixed format data to the upper computer through the gigabit network cable; analyzing the preset fixed format data through an upper computer to obtain a target display area corresponding to the target light sensor on the interactive screen; the target special effect animation is transmitted to the transmitting equipment through the video line by the upper computer; and transmitting the target special effect animation to the receiving card through the transmitting equipment and playing the special effect animation in a target display area of the interactive screen so as to perform the data interaction process of the interactive screen in real time. The transmission efficiency of the hardware level can be improved through the gigabit network cable, the problem of delay in display is avoided, and meanwhile, the display efficiency of pictures is improved.
In addition, in the process of carrying out data analysis on the sensor data by the upper computer, the data interaction efficiency is further improved through the processing of a software layer.
Additional features and advantages of the present disclosure will be set forth in the detailed description which follows.
Drawings
The accompanying drawings are included to provide a further understanding of the disclosure, and are incorporated in and constitute a part of this specification, illustrate the disclosure and together with the description serve to explain, but do not limit the disclosure. In the drawings:
FIG. 1 is a flowchart illustrating a method of interactive screen-based data interaction, according to an exemplary embodiment;
FIG. 2 is a flow chart of a method of sensor data resolution according to the illustration of FIG. 1;
FIG. 3 is a flow chart of a special effects animation delivery method according to the one shown in FIG. 1;
FIG. 4 is a block diagram illustrating a data interaction device based on an interactive screen, according to an exemplary embodiment;
FIG. 5 is a block diagram of a sensor data parsing module according to the embodiment shown in FIG. 4;
fig. 6 is a block diagram of a special effects animation delivery module according to the one shown in fig. 4.
Detailed Description
The following describes in detail the embodiments of the present disclosure with reference to the drawings. It should be understood that the detailed description and specific examples, while indicating and illustrating the disclosure, are not intended to limit the disclosure.
Fig. 1 is a flowchart of a data interaction method based on an interactive screen according to an exemplary embodiment, as shown in fig. 1, applied to a data interaction system composed of a host computer, a transmitting device, a receiving card and an interactive screen, wherein the host computer and the transmitting device are connected through a gigabit network cable and a video cable, the transmitting device is connected with the receiving card, the receiving card is connected with the interactive screen, and a plurality of light-sensitive sensors are arranged on the interactive screen, the method comprises:
in step 101, whenever a light sensor on the interactive screen is triggered, sensor data generated by a triggering action of a user is transmitted to the receiving card through the triggered target light sensor to transmit the sensor data to the transmitting device through the receiving card.
The data interaction method in the disclosed embodiment of the invention is applied to a data interaction system comprising an upper computer, a sending device, a receiving card and an interaction screen, and a gigabit network cable is added on the basis of connection between the upper computer and the sending device through a USB (universal serial bus) line for realizing data interaction between the upper computer and the sending device. In addition, the interactive screen is preferably a tile screen, and the interactive screen is connected to a plurality of light-sensitive sensors (it can be understood that each light-sensitive sensor is responsible for collecting light-sensitive information of a real area in the interactive screen), when a user stands in a certain display area (initial position) on the tile screen, the light-sensitive sensor corresponding to the display area is triggered due to the stepping of the tile screen by the user, so as to generate corresponding sensor data. The triggered light sensor is a target light sensor, the target light sensor can upload sensor data generated by triggering action to a receiving card of the interactive screen, and then the receiving card sends the sensor data to a sending device, wherein the sending device and the receiving card can be connected continuously through a network cable (comprising a gigabit network cable and a hundred mega network cable).
It should be noted that, the target light sensor sends the sensing data to the FPGA chip of the receiving card of the interactive screen, and the receiving card sends the sensor data to the FPGA chip of the sending device (including the sending card) after receiving the sensor data.
In addition, the host computer and the sending device are further connected through a USB cable, where the USB cable is used to transmit all instructions issued by the host computer to the sending device, including various preset display parameters and play instructions (the display parameters include a box parameter, a data routing manner, etc., where the play instruction is a video play in the box) before the display device (for example, an interactive screen) connected to the sending device plays the picture, where the play instruction is a video play instruction in the box), where the play instruction may further include a play instruction in step 1041-step 1043, where the play instruction is used to control the target special animation to play in the target display area on the interactive screen, correspondingly generated when the corresponding target special animation is determined by simulating a mouse movement event on the display interface.
In step 102, the sensor data is converted into preset fixed format data by the sending device, and the preset fixed format data is uploaded to the upper computer through the gigabit network cable.
Wherein, the preset fixed format data is UDP format data.
UDP (User Datagram Protocol ) is an example of a data message applied to the transport layer to support network applications that require data to be transferred between computers. In the embodiment of the invention, the sensor data is converted into the data in the UDP format and is uploaded to the upper computer, so that the upper computer software can conveniently obtain the display area corresponding to the target light sensor by analyzing the UDP data.
In step 103, the preset fixed format data is parsed by the upper computer, and a target display area corresponding to the target light sensor on the interactive screen is obtained.
Wherein each light sensor corresponds to a display area in the interactive screen.
For example, after analyzing the data in the UDP format, the upper computer may determine which light sensor on the interactive screen is triggered by the user, so as to determine a target display area corresponding to the target light sensor.
Specifically, fig. 2 is a flowchart of a method for analyzing sensor data according to the method shown in fig. 1, as shown in fig. 2:
in step 1031, the upper computer analyzes the preset fixed format data to obtain a target coordinate value corresponding to the target light sensor.
For example, when the upper computer analyzes the data in the UDP format (preset fixed format data), the target coordinate value corresponding to the target light sensor is determined first, where the target coordinate value may be used to locate the target display area on the interactive screen, or may be used to determine the target position on the display interface of the upper computer, that is, to play a role of connecting the link between the interactive screen and the display interface of the upper computer, so as to enhance the interactivity between the upper computer and the interactive screen.
It can be understood that the upper computer comprises a display interface, each position in the display interface corresponds to a display area in the interactive screen one by one, and a user performs certain operation on the display interface to enable a corresponding display effect to appear on the interactive screen.
Specifically, the interactive screen is connected with m Zhang Jieshou card, and each receiving card is connected with n light sensing sensors respectively, and the analyzing the preset fixed format data through the upper computer to obtain a target coordinate value corresponding to the target light sensing sensor comprises: acquiring a receiving card number and a sensor number according to the sensor data; determining a target receiving card in m Zhang Jieshou cards connected with the interactive screen according to the receiving card number; determining the target light sensor in n light sensors connected with the target receiving card according to the sensor number; and determining the target coordinate value according to the target light sensor.
Preferably, the value of m is 32, that is, the interactive screen is connected with 32 receiving cards, each receiving card is used for carrying 8 LED display modules, and 8 light sensors are arranged below each LED display module, that is, the value of n is 64. The upper computer analyzes the UDP format data to obtain the sensor number and the receiving card number in the sensor data, so as to determine the triggered target light sensor and the corresponding target receiving card, and then determine the corresponding target coordinate value according to the target light sensor.
Specifically, when analyzing the UDP format data, the data structure of the UDP data is shown in table 1:
TABLE 1
The response status of the UDP data is shown in table 2:
TABLE 2
The frame content in UDP format is shown in table 3:
TABLE 3 Table 3
In step 1032, a target display area on the interactive screen is determined based on the target coordinate values.
For example, each coordinate value corresponds to each display area on the interactive screen one by one, and a target display area can be determined according to the target coordinate value.
In step 104, the host computer transmits the target special effect animation corresponding to the target display area to the transmitting device through the video line.
For example, the video lines may be HDMI lines and DVI lines; after the upper computer determines the target display area according to the UDP data, the upper computer also needs to determine a target special effect animation corresponding to the target display area in a plurality of preset special effect animations (the target special effect animation is used for playing in the target display area), and send the target special effect animation to a sending device connected with the interactive screen receiving card through a video line. Therefore, the data to be interacted is transmitted through the gigabit network cable, and the corresponding target special effect animation is transmitted through the video cable, so that the data transmission efficiency can be improved on the hardware level, and the data interaction speed can be increased.
Specifically, fig. 3 is a flowchart of a specific animation delivery method according to the embodiment shown in fig. 1, where the host computer includes a display interface, and each position in the display interface corresponds to a display area in the interactive screen one by one, as shown in fig. 3:
in step 1041, a target location is determined on the display interface according to the target coordinate value.
For example, as shown in step 1031, the coordinate values are ties between the interactive screen and the host computer, and each coordinate value corresponds to a position on the display interface one by one, so that the target position on the display interface can be determined according to the target coordinate value.
In step 1042, a mouse movement event is simulated on the display interface to determine a corresponding target special effect animation.
The simulated mouse movement event is: and after the simulated mouse clicks the target position on the display interface, displaying the target special effect animation at the target position.
By way of example, a host computer is understood a computer device containing host computer software that includes a display interface on which a user can manipulate by moving a mouse or the like. Similarly, after the upper computer determines the target position in the display interface, the upper computer can simulate a mouse moving event on the display interface, form a mouse clicking effect at the target position, and play the target special effect animation at the target position after the mouse clicks.
In step 1043, the display frame containing the target special effect animation is transmitted to the transmitting device through a video line.
The display screen is displayed on a display interface of the upper computer.
For example, before displaying the target special effect animation, a display screen (which can be understood as a background screen) is usually displayed in the display interface of the upper computer, and a complete display screen (the display screen in the display interface and the display screen in the interactive screen are scaled in a certain proportion) which is the same as the content of the screen in the display interface is also displayed in the interactive screen. Therefore, after the target special effect animation is determined, the upper computer transmits the display picture containing the target special effect animation to the transmitting equipment together through the video line.
In addition, it can be appreciated that before performing the steps 1041 to 1043, it is further required to determine the special effect animation and the display screen on the display interface; binding each special effect animation with each position on the display interface so that the upper computer displays the display picture, simultaneously displaying the target special effect animation corresponding to the target position according to the clicked target position on the display interface when simulating a mouse moving event, and transmitting the display picture containing the target special effect animation to the transmitting equipment.
In step 105, the sending device sends the target special effect animation to the receiving card and plays the special effect animation in the target display area of the interactive screen, so as to perform the data interaction process of the interactive screen in real time.
For example, after receiving the target special effect animation, the transmitting device sends the target special effect animation to the receiving card (in addition, if the transmitting device receives the display screen including the target special effect animation, as shown in step 1043, the data sent by the transmitting device to the receiving card should also be the display screen including the target special effect animation), so that the receiving card controls the interactive screen to display the corresponding special effect animation in the target display area (it can be understood that, as shown in step 1043, the display screen including the target special effect animation is played on the interactive screen, and the target special effect animation is located in the target display area), so as to complete the data interaction process. In addition, because the user usually applies the trampling action on the interactive screen, the triggered target light sensor in the interactive screen also changes along with the trampling action (namely, the initial position changes continuously), so the data interaction process can be performed in real time, and the corresponding special effect animation is played on the interactive screen continuously in the target display area trampled by the user.
Fig. 4 is a block diagram of a data interaction device based on an interactive screen according to an exemplary embodiment, which is applied to a data interaction system composed of a host computer, a transmitting device, a receiving card and an interactive screen, wherein the host computer and the transmitting device are connected through a gigabit network cable and a video cable, the transmitting device is connected with the receiving card, the receiving card is connected with the interactive screen, and a plurality of light sensors are disposed on the interactive screen, the device 400 includes:
the sensor data generating module 410 transmits sensor data generated by a trigger action of a user to the receiving card through the triggered target light sensor whenever the light sensor on the interactive screen is triggered, so as to transmit the sensor data to the transmitting device through the receiving card;
the sensor data conversion module 420 is connected with the sensor data generation module 410, converts the sensor data into preset fixed format data through the sending equipment, and uploads the preset fixed format data to the upper computer through the gigabit network cable;
the sensor data analysis module 430 is connected with the sensor data conversion module 420, and analyzes the preset fixed format data through the upper computer to obtain a target display area corresponding to the target light sensor on the interactive screen;
the special effect animation issuing module 440 is connected with the sensor data analyzing module 430, and issues the target special effect animation corresponding to the target display area to the sending device through the video line by the upper computer;
the data interaction module 450 is connected to the special effect animation issuing module 440, and sends the target special effect animation to the receiving card through the sending device and plays the special effect animation in the target display area of the interactive screen, so as to perform the data interaction process of the interactive screen in real time.
Fig. 5 is a block diagram of a sensor data analysis module according to the one shown in fig. 4, and as shown in fig. 5, the sensor data analysis module 430 includes:
a sensor data analysis unit 431, which analyzes the preset fixed format data through the upper computer to obtain a target coordinate value corresponding to the target light sensor;
the target display area determining unit 432 is connected to the sensor data analyzing unit 431, and determines a target display area on the interactive screen according to the target coordinate value.
Fig. 6 is a block diagram of a special effect animation delivery module according to fig. 4, where, as shown in fig. 6, the host computer includes a display interface, each position in the display interface corresponds to a display area in the interactive screen one by one, and the special effect animation delivery module 440 includes:
a target position determining unit 441 that determines a target position on the display interface according to the target coordinate value;
the special effect animation determining unit 442, connected to the target position determining unit 441, determines a corresponding target special effect animation by simulating a mouse movement event on the display interface, where the simulated mouse movement event is: after clicking a target position on the display interface by the simulation mouse, displaying the target special effect animation at the target position;
the special effect animation issuing unit 443 is connected to the special effect animation determining unit 442, and issues a display screen containing the target special effect animation to the transmitting device through the video line, wherein the display screen is displayed on the display interface of the upper computer.
The embodiment of the invention also provides a data interaction system based on the interaction screen, which comprises: the data interaction system consists of an upper computer, a transmitting device, a receiving card and an interaction screen; the upper computer is connected with the sending equipment through a gigabit network cable and a video cable; the transmitting device is connected with a receiving card, the receiving card is connected with an interactive screen, and a plurality of light sensing sensors are arranged on the interactive screen.
In summary, the present disclosure relates to a data interaction method, device and system based on an interactive screen, where the method includes: transmitting sensor data to the receiving card through the target light sensor every time the light sensor on the interactive screen is triggered; converting the sensor data into preset fixed format data through a transmitting device, and uploading the preset fixed format data to the upper computer through the gigabit network cable; analyzing the preset fixed format data through an upper computer to obtain a target display area corresponding to the target light sensor on the interactive screen; the target special effect animation is transmitted to the transmitting equipment through the video line by the upper computer; and transmitting the target special effect animation to the receiving card through the transmitting equipment and playing the special effect animation in a target display area of the interactive screen so as to perform the data interaction process of the interactive screen in real time. The transmission efficiency of the hardware level can be improved through the gigabit network cable, the problem of delay in display is avoided, and meanwhile, the display efficiency of pictures is improved.
In addition, in the process of carrying out data analysis on the sensor data by the upper computer, the data interaction efficiency is further improved through the processing of a software layer.
The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the present disclosure is not limited to the specific details of the above embodiments, and various simple modifications may be made to the technical solutions of the present disclosure within the scope of the technical concept of the present disclosure, and all the simple modifications belong to the protection scope of the present disclosure.
In addition, the specific features described in the foregoing embodiments may be combined in any suitable manner, and in order to avoid unnecessary repetition, the present disclosure does not further describe various possible combinations.
Moreover, any combination between the various embodiments of the present disclosure is possible as long as it does not depart from the spirit of the present disclosure, which should also be construed as the disclosure of the present disclosure.
Claims (10)
1. The data interaction method based on the interactive screen is characterized by being applied to a data interaction system consisting of an upper computer, a sending device, a receiving card and the interactive screen, wherein the upper computer is connected with the sending device through a gigabit network cable and a video cable, the sending device is connected with the receiving card, the receiving card is connected with the interactive screen, and a plurality of light-sensitive sensors are arranged on the interactive screen, and the method comprises the following steps:
when the light sensor on the interactive screen is triggered, sensor data generated by the triggering action of a user is sent to the receiving card through the triggered target light sensor, so that the sensor data is sent to a sending device through the receiving card;
converting the sensor data into preset fixed format data through the sending equipment, and uploading the preset fixed format data to the upper computer through the gigabit network cable;
analyzing the preset fixed format data through the upper computer to obtain a target display area corresponding to the target light sensor on the interactive screen;
transmitting the target special effect animation corresponding to the target display area to the transmitting equipment through the video line by the upper computer;
and transmitting the target special effect animation to a receiving card through the transmitting equipment and playing the special effect animation in a target display area of the interactive screen so as to perform the data interaction process of the interactive screen in real time.
2. The interactive screen-based data interaction method according to claim 1, wherein each light sensor corresponds to one display area in the interactive screen, the analyzing the preset fixed format data by the upper computer to obtain a target display area corresponding to the target light sensor on the interactive screen comprises:
analyzing the preset fixed format data through the upper computer to obtain a target coordinate value corresponding to the target light sensor;
and determining a target display area on the interactive screen according to the target coordinate value.
3. The interactive screen-based data interaction method according to claim 2, wherein the interactive screen is connected with m Zhang Jieshou cards, each receiving card is connected with n photo sensors respectively, the analyzing the preset fixed format data by the upper computer, obtaining a target coordinate value corresponding to the target photo sensor comprises:
acquiring a receiving card number and a sensor number according to the sensor data;
determining a target receiving card in m Zhang Jieshou cards connected with the interactive screen according to the receiving card number;
determining the target light sensor in n light sensors connected with the target receiving card according to the sensor number;
and determining the target coordinate value according to the target light sensor.
4. The interactive screen-based data interaction method according to claim 1 or 2, wherein the preset fixed format data is UDP format data.
5. The interactive screen-based data interaction method according to claim 2, wherein the upper computer includes a display interface, each position in the display interface corresponds to a display area in the interactive screen one by one, and the issuing, by the upper computer, the target special effect animation corresponding to the target display area to the transmitting device through the video line includes:
determining a target position on the display interface according to the target coordinate value;
simulating a mouse movement event on the display interface to determine a corresponding target special effect animation, wherein the simulated mouse movement event is as follows: after clicking a target position on the display interface by the simulation mouse, displaying the target special effect animation on the target position;
and transmitting a display picture containing the target special effect animation to the transmitting equipment through the video line, wherein the display picture is displayed on a display interface of the upper computer.
6. The interactive screen-based data interaction method of claim 5, further comprising:
determining a special effect animation and a display picture on the display interface;
binding each special effect animation with each position on the display interface, so that the upper computer displays the display picture, simultaneously displays the target special effect animation corresponding to the target position according to the clicked target position on the display interface when simulating a mouse moving event, and transmits the display picture containing the target special effect animation to the transmitting equipment.
7. The utility model provides a data interaction device based on interactive screen, its characterized in that is applied to the data interaction system who comprises host computer, sending equipment, receiving card and interactive screen, wherein, connect through giga net twine and video line between host computer and the sending equipment, sending equipment and receiving card are connected, receiving card and interactive screen are connected, be provided with a plurality of light sensation sensors on the interactive screen, the device includes:
the sensor data generation module is used for transmitting sensor data generated by triggering actions of a user to the receiving card through the triggered target light sensor every time the light sensor on the interactive screen is triggered, so that the sensor data is transmitted to the transmitting device through the receiving card;
the sensor data conversion module is connected with the sensor data generation module, converts the sensor data into preset fixed format data through the sending equipment, and uploads the preset fixed format data to the upper computer through the gigabit network cable;
the sensor data analysis module is connected with the sensor data conversion module, and analyzes the preset fixed format data through the upper computer to obtain a target display area corresponding to the target light sensor on the interactive screen;
the special effect animation issuing module is connected with the sensor data analysis module and is used for issuing the target special effect animation corresponding to the target display area to the sending equipment through the video line;
and the data interaction module is connected with the special effect animation issuing module, and is used for sending the target special effect animation to the receiving card through the sending equipment and playing the special effect animation in a target display area of the interactive screen so as to perform the data interaction process of the interactive screen in real time.
8. The interactive screen-based data interaction device of claim 7, wherein the sensor data parsing module comprises:
the sensor data analysis unit analyzes the preset fixed format data through the upper computer to obtain a target coordinate value corresponding to the target light sensor;
and the target display area determining unit is connected with the sensor data analyzing unit and is used for determining a target display area on the interactive screen according to the target coordinate value.
9. The interactive screen-based data interaction device according to claim 8, wherein the upper computer comprises a display interface, each position in the display interface corresponds to a display area in the interactive screen one by one, and the special effect animation issuing module comprises:
a target position determining unit for determining a target position on the display interface according to the target coordinate value;
the special effect animation determining unit is connected with the target position determining unit, and is used for determining a corresponding target special effect animation by simulating a mouse moving event on the display interface, wherein the simulated mouse moving event is as follows: after clicking a target position on the display interface by the simulation mouse, displaying the target special effect animation on the target position;
and the special effect animation issuing unit is connected with the special effect animation determining unit and is used for issuing a display picture containing the target special effect animation to the sending equipment through the video line, wherein the display picture is displayed on a display interface of the upper computer.
10. An interactive screen-based data interaction system, the system comprising: the data interaction system is composed of an upper computer, a transmitting device, a receiving card and an interaction screen, and is used for realizing the data interaction method based on the interaction screen according to any one of claims 1-6;
the upper computer is connected with the sending equipment through a gigabit network cable and a video cable; the transmitting device is connected with the receiving card, the receiving card is connected with the interactive screen, and a plurality of light sensing sensors are arranged on the interactive screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210334674.XA CN114915819B (en) | 2022-03-30 | 2022-03-30 | Data interaction method, device and system based on interactive screen |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210334674.XA CN114915819B (en) | 2022-03-30 | 2022-03-30 | Data interaction method, device and system based on interactive screen |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114915819A CN114915819A (en) | 2022-08-16 |
| CN114915819B true CN114915819B (en) | 2023-09-15 |
Family
ID=82763662
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210334674.XA Active CN114915819B (en) | 2022-03-30 | 2022-03-30 | Data interaction method, device and system based on interactive screen |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114915819B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013138846A1 (en) * | 2012-03-22 | 2013-09-26 | Silverbrook Research Pty Ltd | Method and system of interacting with content disposed on substrates |
| CN104394324A (en) * | 2014-12-09 | 2015-03-04 | 成都理想境界科技有限公司 | Special-effect video generation method and device |
| CN105630787A (en) * | 2014-10-28 | 2016-06-01 | 腾讯科技（深圳）有限公司 | Animation implementation method and device based on dynamic portable network graphics |
| CN107197194A (en) * | 2017-06-27 | 2017-09-22 | 维沃移动通信有限公司 | A kind of video call method and mobile terminal |
| WO2017166622A1 (en) * | 2016-03-28 | 2017-10-05 | 乐视控股（北京）有限公司 | Video playing method, playing terminal and media server |
| CN111190565A (en) * | 2020-04-13 | 2020-05-22 | 延锋伟世通电子科技（南京）有限公司 | Multi-screen interaction system and method based on single host and single system |
| CN113014986A (en) * | 2020-04-30 | 2021-06-22 | 北京字节跳动网络技术有限公司 | Interactive information processing method, device, equipment and medium |
| CN113485617A (en) * | 2021-07-02 | 2021-10-08 | 广州博冠信息科技有限公司 | Animation display method and device, electronic equipment and storage medium |
| CN113658545A (en) * | 2021-08-19 | 2021-11-16 | 深圳市鼎力显示科技有限公司 | Interactive induction system and method for LED floor tile screen |
| CN113888677A (en) * | 2021-09-29 | 2022-01-04 | 广州歌神信息科技有限公司 | Interactive display method and device of virtual object |
| CN113891105A (en) * | 2021-09-28 | 2022-01-04 | 广州繁星互娱信息科技有限公司 | Picture display method and device, storage medium and electronic equipment |
| WO2022012182A1 (en) * | 2020-07-17 | 2022-01-20 | 北京字节跳动网络技术有限公司 | Special effect display method and apparatus, electronic device, and computer readable medium |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20070177576A1 (en) * | 2006-01-31 | 2007-08-02 | Niels Thybo Johansen | Communicating metadata through a mesh network |
| US9498711B2 (en) * | 2008-11-04 | 2016-11-22 | Quado Media Inc. | Multi-player, multi-screens, electronic gaming platform and system |
| WO2013023705A1 (en) * | 2011-08-18 | 2013-02-21 | Layar B.V. | Methods and systems for enabling creation of augmented reality content |
| CN108076379B (en) * | 2016-11-10 | 2021-04-30 | 阿里巴巴集团控股有限公司 | Multi-screen interaction realization method and device |
| CN109420338A (en) * | 2017-08-31 | 2019-03-05 | 腾讯科技（深圳）有限公司 | The mobile virtual scene display method and device of simulating lens, electronic equipment |
| CN110097428B (en) * | 2019-04-30 | 2021-08-17 | 北京达佳互联信息技术有限公司 | Electronic order generation method, device, terminal and storage medium |
-
2022
- 2022-03-30 CN CN202210334674.XA patent/CN114915819B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013138846A1 (en) * | 2012-03-22 | 2013-09-26 | Silverbrook Research Pty Ltd | Method and system of interacting with content disposed on substrates |
| CN105630787A (en) * | 2014-10-28 | 2016-06-01 | 腾讯科技（深圳）有限公司 | Animation implementation method and device based on dynamic portable network graphics |
| CN104394324A (en) * | 2014-12-09 | 2015-03-04 | 成都理想境界科技有限公司 | Special-effect video generation method and device |
| WO2017166622A1 (en) * | 2016-03-28 | 2017-10-05 | 乐视控股（北京）有限公司 | Video playing method, playing terminal and media server |
| CN107197194A (en) * | 2017-06-27 | 2017-09-22 | 维沃移动通信有限公司 | A kind of video call method and mobile terminal |
| CN111190565A (en) * | 2020-04-13 | 2020-05-22 | 延锋伟世通电子科技（南京）有限公司 | Multi-screen interaction system and method based on single host and single system |
| CN113014986A (en) * | 2020-04-30 | 2021-06-22 | 北京字节跳动网络技术有限公司 | Interactive information processing method, device, equipment and medium |
| WO2022012182A1 (en) * | 2020-07-17 | 2022-01-20 | 北京字节跳动网络技术有限公司 | Special effect display method and apparatus, electronic device, and computer readable medium |
| CN113485617A (en) * | 2021-07-02 | 2021-10-08 | 广州博冠信息科技有限公司 | Animation display method and device, electronic equipment and storage medium |
| CN113658545A (en) * | 2021-08-19 | 2021-11-16 | 深圳市鼎力显示科技有限公司 | Interactive induction system and method for LED floor tile screen |
| CN113891105A (en) * | 2021-09-28 | 2022-01-04 | 广州繁星互娱信息科技有限公司 | Picture display method and device, storage medium and electronic equipment |
| CN113888677A (en) * | 2021-09-29 | 2022-01-04 | 广州歌神信息科技有限公司 | Interactive display method and device of virtual object |
Non-Patent Citations (1)
| Title |
|---|
| 鲍豫鸿 ; 王吉 ; .基于人机交互技术的智能多媒体互动投影系统的开发和应用.煤炭技术.2013,(第07期),全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114915819A (en) | 2022-08-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102577327B (en) | Method, apparatus and system for realizing web browsing in remote desk environment | |
| JP5857443B2 (en) | Content sharing system | |
| CN105049747B (en) | A kind of system for identifying still image and being converted to Dynamic Announce | |
| CN107195210B (en) | Two-dimensional and three-dimensional combined remote teaching system and control method | |
| EP3998550A1 (en) | Scene interaction method and apparatus, electronic device, and computer storage medium | |
| JP2012238219A (en) | Information processing apparatus, server device, information processing method, computer program and content sharing system | |
| WO2023116653A1 (en) | Element display method and apparatus, and electronic device and storage medium | |
| CN109391848B (en) | Interactive advertisement system | |
| CN102339629B (en) | Immersive tunnel multimedia interactive display system and method thereof | |
| JP2012238218A (en) | Information processing apparatus, information processing method, and computer program | |
| CN103853518A (en) | Synchronous display system and method for multi-view pictures | |
| JP2022500795A (en) | Avatar animation | |
| CN103559809B (en) | Computer-based on-site interaction demonstration system | |
| CN110740285A (en) | telematics method and device | |
| CN110825224A (en) | Interaction method, interaction system and display device | |
| CN114915819B (en) | Data interaction method, device and system based on interactive screen | |
| CN114374853A (en) | Content display method and device, computer equipment and storage medium | |
| CN115914526B (en) | BIM model visualization method, device, equipment and medium based on cloud rendering | |
| CN202694624U (en) | Dynamic human-computer interface device for driving skill examination system | |
| AU2021102525A4 (en) | Virtuality and Reality Combination Remote Experiment Teaching Information Processing System, Method and Intelligent Terminal | |
| CN110794966B (en) | AR display system and method | |
| CN201698611U (en) | Virtual simulation flight simulator | |
| CN210807344U (en) | Remote FPGA experiment system | |
| CN220105543U (en) | Power plant intelligent exhibition hall system based on cloud internet technology | |
| CN203377913U (en) | Advertising machine player system having remote screen capturing function |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |