CN107480437B - Data transmission method and device - Google Patents

Data transmission method and device Download PDF

Info

Publication number
CN107480437B
CN107480437B CN201710648313.1A CN201710648313A CN107480437B CN 107480437 B CN107480437 B CN 107480437B CN 201710648313 A CN201710648313 A CN 201710648313A CN 107480437 B CN107480437 B CN 107480437B
Authority
CN
China
Prior art keywords
image data
end equipment
far
lossless
data stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710648313.1A
Other languages
Chinese (zh)
Other versions
CN107480437A (en
Inventor
周姣
王启付
苏睿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xian Wanxiang Electronics Technology Co Ltd
Original Assignee
Xian Wanxiang Electronics Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xian Wanxiang Electronics Technology Co Ltd filed Critical Xian Wanxiang Electronics Technology Co Ltd
Priority to CN201710648313.1A priority Critical patent/CN107480437B/en
Publication of CN107480437A publication Critical patent/CN107480437A/en
Application granted granted Critical
Publication of CN107480437B publication Critical patent/CN107480437B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks

Abstract

The invention discloses a data transmission method and a data transmission device. Wherein, the method comprises the following steps: transmitting lossy image data to a remote device for remote transmission, wherein the lossy image data is image data obtained by lossy coding; receiving reverse control information of a remote device; according to the reverse control information, operating lossless image data corresponding to the lossy image data to obtain a lossless image data stream; and transmitting the obtained lossless image data stream to the far-end equipment, wherein the lossless image data stream is used for lossless playback at the far-end equipment. The invention solves the technical problem of poor remote video effect caused by large influence of network resources when video interaction is carried out in the related technology, thereby improving the user experience.

Description

Data transmission method and device
Technical Field
The invention relates to the field of remote data transmission, in particular to a data transmission method and device.
Background
With the rapid development of computer network technology, shared medical resources will become a development trend of medical information, and the remote video consultation medical technology therein will become a hot problem in the development. At the present stage, the development of remote video medical technology is vigorously promoted by the country, the increasingly perfect mechanism of the technology improves the medical level of remote areas, and the interconnection and sharing of medical resources and the popularization of graded treatment according to the degree of difficulty of the disease, such as lightness, heaviness, slowness, urgency and treatment are realized. The key point in the remote video consultation lies in that all levels of medical units are interconnected, high-level medical care resource docking is realized, and an expert doctor only needs to use a remote medical video system and remote video interactive consultation to remotely call patient data, so that the cost is reduced, and the medical care level is improved. However, the technical deficiency is that when medical care and patient are in video interaction, the influence of network resources is large, if the current network resources are insufficient, the interactive video is blurred, and the remote patient data is not clear, which directly results in the effect of remote medical diagnosis and treatment.
Aiming at the problem that the remote video effect is poor due to the fact that the video interaction is greatly influenced by network resources in the related technology, an effective solution is not provided at present.
Disclosure of Invention
The embodiment of the invention provides a data transmission method and a data transmission device, which are used for at least solving the technical problem of poor remote video effect caused by large influence of network resources when video interaction is carried out in the related technology.
According to an aspect of the present invention, there is provided a data transmission method, including: transmitting lossy image data to a remote device for remote transmission, wherein the lossy image data is image data obtained by lossy coding; receiving reverse control information of the remote equipment; according to the reverse control information, operating lossless image data corresponding to the lossy image data to obtain a lossless image data stream; transmitting the obtained lossless image data stream to the remote device, wherein the lossless image data stream is used for lossless playback at the remote device.
Optionally, before receiving the reverse control information of the remote device, the method further includes: and collecting the lossless image data and storing the lossless image data to near-end equipment for remote transmission.
Optionally, before receiving the reverse control information of the remote device, the method further includes: and establishing a control channel for the remote control of the near-end equipment by the far-end equipment in a mode of simulating an input interface on the near-end equipment for remote transmission.
Optionally, according to the reverse control information, performing an operation on lossless image data corresponding to the lossy image data, and obtaining the lossless image data stream includes: analyzing operation steps and operation instructions for operating the lossless image data corresponding to the lossy image data from the reverse control information; and operating the lossless image data according to the operation steps and the operation instructions to obtain the lossless image data stream.
Optionally, the method further comprises: receiving a data stream after screen segmentation by a server for remote transmission, wherein the data stream after screen segmentation comprises: the method comprises the steps that when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the near-end equipment, when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the far-end equipment, and the near-end equipment displays data flow of content displayed on a screen; and displaying the received data stream after the screen segmentation.
According to another aspect of the present invention, there is provided a data transmission method, including: receiving lossy image data transmitted by near-end equipment for remote transmission, wherein the lossy image data is image data obtained by lossy coding; sending reverse control information to the near-end equipment according to the received lossy image data; receiving a lossless image data stream transmitted by the near-end device, wherein the lossless image data stream is obtained by operating lossless image data corresponding to the lossy image data according to the reverse control information; and carrying out lossless playback on the received lossless image data stream.
Optionally, the method further comprises: receiving a data stream after screen segmentation by a server for remote transmission, wherein the data stream after screen segmentation comprises: the method comprises the steps that when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the near-end equipment, when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the far-end equipment, and the near-end equipment displays data flow of content displayed on a screen; and displaying the received data stream after the screen segmentation.
According to another aspect of the present invention, there is provided a data transmission method for transmitting lossy image data transmitted by a near-end device performing remote transmission to a far-end device performing remote transmission, wherein the lossy image data is image data obtained by lossy encoding; receiving reverse control information used by the far-end equipment for controlling the near-end equipment, and sending the reverse control information to the near-end equipment; and forwarding a lossless image data stream transmitted by the near-end device to the far-end device, wherein the lossless image data stream is obtained by operating lossless image data corresponding to the lossy image data according to the reverse control information, and the lossless image data stream is used for lossless playback at the far-end device.
Optionally, the method further includes acquiring a camera video data stream of the near-end device when the near-end device and the far-end device perform remote video, acquiring a camera video data stream of the far-end device when the near-end device and the far-end device perform remote video, and displaying a data stream of content displayed on a screen by the near-end device; according to the camera video data stream of the near-end equipment, the camera video data stream of the far-end equipment and the data stream of the content displayed on the display screen of the near-end equipment, the display screen corresponding to the server for remote transmission is divided, and the camera video data stream of the near-end equipment, the camera video data stream of the far-end equipment and the data stream of the content displayed on the display screen of the near-end equipment are displayed in the divided areas.
Optionally, before transmitting the lossy image data transmitted by the remote transmitting near-end device to the remote transmitting far-end device, the method further includes: judging whether the network bandwidth for remote transmission is less than a preset threshold value; and if so, determining to transmit the lossy image data transmitted by the near-end device for remote transmission to the far-end device for remote transmission.
Optionally, the non-destructive image data is a test report, an examination report, a historical medical record for medical diagnosis.
According to an aspect of the present invention, there is provided a data transmission apparatus including: the system comprises a first transmission module, a second transmission module and a third transmission module, wherein the first transmission module is used for transmitting lossy image data to remote equipment for remote transmission, and the lossy image data is image data obtained by lossy coding; a first receiving module, configured to receive reverse control information of the remote device; the operation module is used for operating the lossless image data corresponding to the lossy image data according to the reverse control information to obtain a lossless image data stream; a second transmission module, configured to transmit the obtained lossless image data stream to the remote device, where the lossless image data stream is used in the remote device for lossless playback.
Optionally, the apparatus further comprises: and the acquisition module is used for acquiring the lossless image data before receiving the reverse control information of the far-end equipment and storing the lossless image data to the near-end equipment for remote transmission.
Optionally, the apparatus further comprises: the establishing module is used for establishing a control channel for the far-end equipment to remotely control the near-end equipment in a mode of simulating an input interface on the near-end equipment for remote transmission before the reverse control information of the far-end equipment is received.
Optionally, the operation module includes: the analysis unit is used for analyzing operation steps and operation instructions for operating the lossless image data corresponding to the lossy image data from the reverse control information; and the operation unit is used for operating the lossless image data according to the operation steps and the operation instructions to obtain the lossless image data stream.
Optionally, the apparatus further comprises: a second receiving module, configured to receive a data stream obtained by screen splitting performed by a server performing remote transmission, where the data stream obtained by screen splitting includes: the method comprises the steps that when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the near-end equipment, when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the far-end equipment, and the near-end equipment displays data flow of content displayed on a screen; and the first display module is used for displaying the received data stream after the screen segmentation.
According to another aspect of the present invention, there is provided a data transmission apparatus including: a third receiving module, configured to receive lossy image data transmitted by a near-end device performing remote transmission, where the lossy image data is image data obtained through lossy coding; a sending module, configured to send reverse control information to the near-end device according to the received lossy image data; a fourth receiving module, configured to receive a lossless image data stream transmitted by the near-end device, where the lossless image data stream is obtained by operating lossless image data corresponding to the lossy image data according to the reverse control information; and the playback module is used for carrying out lossless playback on the received lossless image data stream.
Optionally, the apparatus further comprises: a fifth receiving module, configured to receive a data stream obtained by screen splitting performed by a server performing remote transmission, where the data stream obtained by screen splitting includes: the method comprises the steps that when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the near-end equipment, when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the far-end equipment, and the near-end equipment displays data flow of content displayed on a screen; and the second display module is used for displaying the received data stream after the screen segmentation.
According to another aspect of the present invention, there is provided a data transmission apparatus, including a third transmission module, configured to transmit lossy image data transmitted by a near-end device performing remote transmission to a far-end device performing remote transmission, where the lossy image data is image data obtained through lossy coding; a sixth receiving module, configured to receive reverse control information that is used by the far-end device to control the near-end device, and send the reverse control information to the near-end device; a forwarding module, configured to forward a lossless image data stream transmitted by the near-end device to the far-end device, where the lossless image data stream is obtained by operating lossless image data corresponding to the lossy image data according to the reverse control information, and the lossless image data stream is used for lossless playback at the far-end device.
Optionally, the apparatus further comprises: an obtaining module, configured to obtain a camera video data stream of the near-end device when the near-end device performs remote video with the far-end device, obtain a camera video data stream of the far-end device when the near-end device performs remote video with the far-end device, and display a data stream of content displayed on a screen by the near-end device; and the third display module is used for dividing the display screen corresponding to the server for remote transmission according to the camera video data stream of the near-end equipment, the camera video data stream of the far-end equipment and the data stream of the content displayed by the display screen of the near-end equipment, and respectively displaying the camera video data stream of the near-end equipment, the camera video data stream of the far-end equipment and the data stream of the content displayed by the display screen of the near-end equipment in the divided areas.
Optionally, the apparatus further comprises: the device comprises a judging module, a judging module and a judging module, wherein the judging module is used for judging whether the network bandwidth for remote transmission is less than a preset threshold value before transmitting the lossy image data transmitted by the near-end device for remote transmission to the far-end device for remote transmission; and the determining module is used for determining that the lossy image data transmitted by the near-end equipment for remote transmission is transmitted to the far-end equipment for remote transmission under the condition that the judgment result of the judging module is yes.
Optionally, the non-destructive image data is a test report, an examination report, a historical medical record for medical diagnosis.
According to an aspect of the present invention, there is provided a remote transmission system including: the near-end equipment comprises the data transmission device, the far-end equipment comprises the data transmission device, and the server comprises the data transmission device, wherein the near-end equipment and the far-end equipment are interconnected with the server in a wired or wireless mode, and the near-end equipment comprises a host, a display used for displaying image data, a memory used for storing the lossless image data, and an input interface used for the far-end equipment to reversely control the near-end equipment.
According to an aspect of the present invention, a storage medium is provided, and the storage medium includes a stored program, wherein when the program runs, a device in which the storage medium is located is controlled to execute the data transmission method according to any one of the above.
According to an aspect of the present invention, there is provided a processor for executing a program, wherein the program executes to perform the data transmission method described in any one of the above.
In the embodiment of the invention, lossy image data is transmitted to a remote device for remote transmission, wherein the lossy image data is image data obtained by lossy coding; receiving reverse control information of a remote device; according to the reverse control information, operating lossless image data corresponding to the lossy image data to obtain a lossless image data stream; the obtained lossless image data stream is transmitted to the far-end equipment, wherein the lossless image data stream is used for lossless playback of the far-end equipment, so that the degree of dependence of a video conference on a network is effectively reduced, the purpose of transmitting lossless image data corresponding to lossy image data at the near end to the far end can be achieved, the effect of video interaction is further improved, the technical problem that the remote video effect is poor due to the fact that the influence of network resources is large when video interaction is carried out in the related art is further solved, and the user experience is improved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a flow chart of a data transmission method according to an embodiment of the present invention;
FIG. 2 is a preferred block diagram of a data transmission method according to an embodiment of the invention;
FIG. 3 is a preferred embodiment of a data transmission method according to an embodiment of the present invention;
FIG. 4 is a preferred embodiment of a data transmission method according to an embodiment of the present invention;
FIG. 5 is a preferred flow chart of a method of data transmission according to an embodiment of the invention;
FIG. 6 is a preferred flow chart of a method of data transmission according to an embodiment of the invention;
fig. 7 is an architecture diagram of a data transmission method according to an embodiment of the present invention;
FIG. 8 is a preferred architecture diagram of a data transmission method according to an embodiment of the present invention;
FIG. 9 is a schematic diagram of a data transmission device that is facilitated in accordance with the present invention;
FIG. 10 is a schematic diagram of an alternative data transmission arrangement according to an embodiment of the present invention; and
fig. 11 is a schematic diagram of an alternative data transmission arrangement according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In accordance with an embodiment of the present invention, there is provided a method embodiment of a data transmission method, it being noted that the steps illustrated in the flowchart of the figure may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowchart, in some cases, the steps illustrated or described may be performed in an order different than that presented herein.
Fig. 1 is a flowchart of a data transmission method according to an embodiment of the present invention, as shown in fig. 1, the method includes the following steps:
step S102, transmitting lossy image data to a remote device for remote transmission, where the lossy image data is image data obtained through lossy encoding.
Step S104, receiving the reverse control information of the remote device.
Step S106, according to the reverse control information, operating the lossless image data corresponding to the lossy image data to obtain a lossless image data stream;
step S108, transmitting the obtained lossless image data stream to the far-end equipment, wherein the lossless image data stream is used for lossless playback at the far-end equipment.
Through the steps, firstly lossy image data needs to be transmitted to the far-end equipment for remote transmission, after the reverse control information of the far-end equipment is received, the lossless image data stream corresponding to the lossy image is transmitted to the far-end equipment through the near-end equipment at the near end according to the reverse control information, so that the dependence degree of a video conference on a network is effectively reduced, the purpose of transmitting the lossless image data corresponding to the lossy image data at the near end to the far end can be achieved, the effect of video interaction is improved, the technical problem that the remote video effect is poor due to the fact that the influence of network resources is large when video interaction is carried out in the related technology is further solved, and user experience is improved.
In the above steps S102 to S108, by transmitting the lossy image data to the remote device for remote transmission, when receiving the reverse control information of the remote device, the lossless image data stream corresponding to the lossy image data is transmitted to the remote device according to the reverse control information, so that the disadvantage of insufficient bandwidth can be effectively reduced, and efficient remote video communication can be implemented.
In order to ensure that the near-end device can respond based on the reverse control information in time when receiving the reverse control information of the far-end device, before receiving the reverse control information of the far-end device, the data transmission method may further include: and acquiring the lossless image data, and storing the lossless image data to the near-end equipment for remote transmission. By adopting the processing, the efficiency of remote communication is effectively improved.
After receiving the reverse control information sent by the remote device, to ensure that the remote device can smoothly perform remote reverse control on the near-end device, before receiving the reverse control information of the remote device, the data transmission method may further include: a control channel for remote control of the near-end equipment by the far-end equipment is established in a mode of simulating an input interface on the near-end equipment for remote transmission. For example, the remote device may provide an application, and after receiving the application, the server may confirm the application, and after the confirmation is passed, the near-end device receives an instruction for applying reverse control and parses the content of the instruction (that is, the above-mentioned reverse control information), and establishes a reverse control channel between the remote device and the near-end device display card output computer, so as to implement a remote reverse control function of a Universal Serial Bus (USB) device of the near-end display card output computer by the remote device.
Optionally, when the lossless image data corresponding to the lossy image data is operated according to the reverse control information to obtain a lossless image data stream, the following method may be specifically adopted: firstly, analyzing operation steps and operation instructions for operating lossless image data corresponding to lossy image data from reverse control information; and then, operating the lossless image data according to the operation steps and the operation instructions to obtain a lossless image data stream. For example, the operation on the lossless image data includes three steps, and the operation instructions respectively correspond to: the lossless image is magnified once (or to a specific size) at the near-end device; the lossless image is stretched once at the near-end device, after which the lossless image is shortened once again.
Under the condition of lacking network resources, in order to integrate the traditional video conference function according to specific scenes and enable the traditional video conference function to display the video information of a camera of the near-end equipment on one display screen and display the computer screen information output by the near-end equipment clearly and losslessly, the data transmission method can further comprise the following steps: receiving a data stream after screen segmentation by a server performing remote transmission, where the data stream after screen segmentation may include: the method comprises the steps that camera video data flow of near-end equipment is carried out when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the far-end equipment is carried out when the near-end equipment and the far-end equipment carry out remote video, and data flow of content displayed on a screen is displayed by the near-end equipment; and displaying the received data stream after the screen segmentation.
A preferred embodiment of the present invention will be described in detail below with reference to the accompanying drawings.
Fig. 2 is a preferred block diagram of a data transmission method according to an embodiment of the present invention, and as shown in fig. 2, the data transmission method includes the following components:
part 101: the computer or the equipment with the display output function is mainly responsible for providing continuous computer image output and is provided with a USB interface so as to support the remote equipment terminal to perform reverse control function on the remote equipment terminal.
Parts 102 and 105: the computer output image acquisition is mainly responsible for carrying out clear and lossless acquisition on the output of a computer display card so as to adapt to the coding format of network transmission to carry out lossless coding and decoding on the image, send data to a cloud end, receive and send reverse control information from a terminal and record step information and instruction information of reverse control.
Part 103: the video conference terminal is mainly responsible for collecting audio and video, coding and decoding audio and video streams, dividing a screen into multiple sources, displaying an image output by a computer clearly and losslessly, displaying and playing far-end audio and video streams, reversely controlling a mouse and a keyboard of a display device and the like.
Part 104: the network server system corresponds to the functions of distribution of audio and video streams, image streams and control streams, screen segmentation, multi-source fusion display and the like.
The above preferred embodiment of the present invention mainly relates to the technical field of image and video transmission, and more specifically, includes video acquisition and reverse control of a computer image and a camera, supports connection with a computer display output port and transmission of an Internet Protocol (IP for short) interconnected between ethernet networks, and meets the user's video experience requirements for high-definition lossless image quality.
According to another aspect of the embodiments of the present invention, there is also provided a data transmission method, and fig. 3 is a preferred embodiment of the data transmission method according to the embodiments of the present invention, as shown in fig. 3, the data transmission method includes the following steps:
step S302, receiving lossy image data transmitted by a near-end device performing remote transmission, where the lossy image data is image data obtained through lossy encoding.
Step S304, sending reverse control information to the near-end device according to the received lossy image data.
Step S306, receiving a lossless image data stream transmitted by the near-end device, wherein the lossless image data stream is obtained by operating lossless image data corresponding to the lossy image data according to the reverse control information.
Step S308, lossless playback is performed on the received lossless image data stream.
Through the steps, lossy image data transmitted by the near-end equipment for remote transmission can be received, reverse control information is sent to the near-end equipment according to the received lossy image data, and under the condition that a lossless image data stream transmitted by the near-end equipment is received (wherein the lossless image data stream is obtained by operating lossless image data corresponding to the lossy image data according to the reverse control information), lossless playback is carried out on the received lossless image data stream, so that under the condition that network resources are insufficient, the lossless high-quality video transmission can be achieved by using the playback technology of lossless compression after lossy transmission, the technical problem that in the related technology, when video interaction is carried out, the remote video effect is poor due to the fact that the influence of the network resources is large is solved, and user experience is improved.
In the above steps S302 to S308, the remote device may send the reverse control information to the near-end device by receiving the lossy image data transmitted by the near-end device for performing remote transmission, and perform lossless playback on the received lossless image data when receiving the lossless image data corresponding to the lossy image data transmitted by the near-end device according to the reverse control information, so as to reduce the dependence on network resources to a certain extent.
In order to integrate the traditional video conference function according to a specific scene and enable the traditional video conference function to display the video information of a camera of the near-end equipment on one display screen and also display the computer screen information output by the near-end equipment clearly and losslessly, the data transmission method can further comprise the following steps: receiving a data stream after screen segmentation by a server performing remote transmission, where the data stream after screen segmentation may include: the method comprises the steps that camera video data flow of near-end equipment is carried out when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the far-end equipment is carried out when the near-end equipment and the far-end equipment carry out remote video, and data flow of content displayed on a screen is displayed by the near-end equipment; and displaying the received data stream after the screen segmentation.
According to another aspect of the embodiments of the present invention, there is also provided a data transmission method, and fig. 4 is a preferred embodiment of the data transmission method according to the embodiments of the present invention, as shown in fig. 4, the data transmission method includes the following steps:
step S402, transmitting the lossy image data transmitted by the near-end device performing remote transmission to the far-end device performing remote transmission, where the lossy image data is image data obtained through lossy coding.
Step S404, receiving reverse control information used by the far-end device to control the near-end device, and sending the reverse control information to the near-end device.
Step S406, forwarding the lossless image data stream transmitted by the near-end device to the far-end device, where the lossless image data stream is obtained by operating the lossless image data corresponding to the lossy image data according to the reverse control information, and the lossless image data stream is used for lossless playback at the far-end device.
Through the steps, the lossy image data transmitted by the remote transmission near-end equipment can be transmitted to the remote transmission far-end equipment, the reverse control information is sent to the near-end equipment after the reverse control information used for controlling the near-end equipment is received by the far-end equipment, the near-end equipment can forward the lossless image data stream transmitted by the near-end equipment to the far-end equipment, wherein the lossless image data stream is obtained by operating the lossless image data corresponding to the lossy image data according to the reverse control information, the lossless image data stream is used for lossless playback on the far-end equipment, so that the lossless playback on the lossless image can be realized by the far-end equipment, the lossless image quality can be directly watched under the condition of sufficient network resources, and the method of firstly transmitting the lossy image data and then carrying out the lossless playback under the condition of insufficient network resources is realized, high-definition image quality is obtained, so that network resources can be adapted.
In addition, the user may have higher requirements for information display of the mobile terminal, wherein the following information can be acquired to meet the information display requirements of the user on the multi-source split-screen mobile terminal: the method comprises the steps of obtaining a camera video data stream of a near-end device when the near-end device and a far-end device carry out remote video, obtaining a camera video data stream of a far-end device when the near-end device and the far-end device carry out remote video, and obtaining a data stream of content displayed on a display screen of the near-end device; according to the camera video data stream of the near-end equipment, the camera video data stream of the far-end equipment and the data stream of the content displayed on the display screen of the near-end equipment, the display screen corresponding to the server for remote transmission is divided, and the camera video data stream of the near-end equipment, the camera video data stream of the far-end equipment and the data stream of the content displayed on the display screen of the near-end equipment are respectively displayed in the divided areas.
Therefore, before transmitting the lossy image data transmitted by the remote transmission near-end device to the remote transmission far-end device, the data transmission method may further include: judging whether the network bandwidth for remote transmission is less than a preset threshold value; and if so, determining to transmit the lossy image data transmitted by the near-end device for remote transmission to the far-end device for remote transmission.
It should be noted that the non-destructive image data provided in the embodiment of the present invention is not particularly limited, and may be a detection report, an inspection report, and a history medical record for medical diagnosis.
For example, for a video medical consultation, the near end may be a remote town hospital, and the far end may be a provincial hospital, which requires an interactive video medical consultation of the near end patient and Computed Tomography (CT) data thereof. In the embodiment of the invention, self-adaptive selection is carried out according to network resources, on one hand, under the condition of sufficient network resources, lossless compression can be directly used; on the other hand, when network resources are insufficient, lossy compression and lossless playback technology can be combined, so that lossless high-quality video transmission is achieved. First, a near-end display device is connected to an S-end (source end, that is, the near end in the embodiments of the present invention) acquisition device through a video line, the S-end is connected to a server, and then a near-end mobile device is in video connection with a far-end mobile device through the server. When the near-end mobile device detects that the network resources are insufficient, firstly, the acquired video and the near-end CT film are transmitted to the remote-end device by utilizing lossy compression, so that a lossy video image is presented in the vision of a medical expert, and the medical expert can approximately see the approximately general outline of the patient of the near-end patient on a screen device of the remote end of the medical expert; in the process, the S-end acquisition equipment connected with the near-end display equipment performs lossless compression on the medical CT in the screen display, stores the lossless video stream in the S-end acquisition storage equipment and waits for calling; then, after the expert at the remote end observes the outline of the patient and the CT, the expert at the remote end operates the remote end to establish a reverse control channel, the remote end sends a control instruction to the near-end display equipment, the near-end equipment receives and analyzes the instruction and then directly collects information flow of high-definition lossless compression medical CT in the equipment from the S end according to the instruction content, the information flow is subjected to lossless return by a network server, the remote end recovers the lossless compression flow into video information to be displayed after acquiring the lossless compression flow, and at the moment, the attention area of the medical expert at the remote end is a high-definition lossless image quality image. Under the condition that the network bandwidth is favorable, the technology can directly see the lossless image quality; under the condition of insufficient network resources, the network resources are subjected to lossy transmission and then lossless playback to obtain high-definition image quality, and the network resources can be self-adapted. The method comprises the following specific implementation steps:
the method comprises the steps that video lines are utilized in near-end display equipment to connect S-end acquisition and storage equipment, the S-end is connected with a server in a wired/wireless mode, and the method is also used for connecting the near-end mobile equipment;
the system comprises a plurality of mobile equipment terminals, a plurality of mobile equipment terminals and a plurality of local equipment terminals, wherein the mobile equipment terminals are connected with a village and town hospital (near end) and a province and city hospital (remote end) in a wireless mode by utilizing the network resource condition, and the two mobile equipment terminals are interconnected.
Network conditions are detected using a near-end mobile device. When the equipment of the village and town hospital (near end) detects that the network resources are sufficient, the provincial and municipal hospital (remote end) can directly obtain a high-definition lossless picture from the village and town hospital (near end) in the medical video consultation, and the face-to-face consultation interaction is carried out;
and fourthly, if the equipment of the village and town hospital (the near end) detects that the network resources are insufficient, the village and town hospital (the near end) and the provincial and city hospital (the remote end) perform the following operation steps.
Fifthly, when the network resources are insufficient, the mobile equipment of the village and town hospital (near end) wirelessly encodes the images collected by the camera and the medical image resources collected from the display equipment in a lossy manner to form video streams, and transmits the video streams to the province and city hospital (remote end) through the network server for decoding and recovering to form lossy medical images, and the medical experts receive the lossy video data after decoding and recovering to check the basic overview of the image data;
in the process of transmitting the lossy video stream to a provincial hospital (a remote end) for processing, enabling medical image data in acquired display equipment to form a lossless image resource information stream through lossless compression by the end S, and placing the lossless compression image resource information stream in the end S acquisition and storage equipment for waiting to be called;
after the medical specialist in the provincial and municipal hospital (remote end) views and analyzes the basic overview of the lossy medical image data, the medical specialist in the provincial and municipal hospital (remote end) needs to browse the detail details of the medical image data, and then the medical specialist in the provincial and municipal hospital (remote end) can operate the medical image data of the near-end display equipment by building a reverse control channel;
after the reverse control channel is built, the remote end sends a reverse control instruction, records the operation steps of the instruction and the information operation content, feeds the instruction information back to display equipment of the township hospital through the network, and then transmits the reverse control flow to the township hospital through the network;
the self-checking system has the advantages that the self-checking system is simple in structure, convenient to use, simple in structure, convenient to operate, and the like. At the moment, the remote end starts to call the lossless image resource information flow in the storage equipment;
the provincial and municipal hospitals (remote end) receive the lossless image resource information flow, and the lossless playback display of the lossless medical image data is realized.
Through the steps, after a medical expert of a provincial and municipal hospital (a remote end) views and analyzes the basic overview of the lossy medical image data, the medical expert needs to browse the detail details of the medical image data, and then the medical expert of the provincial and municipal hospital (the remote end) can operate the medical image data of the near-end display equipment by building a reverse control channel; after the reverse control channel is built, the remote end sends a reverse control instruction, records the operation steps of the instruction and the information operation content (for example, amplifying once, lengthening once and shortening once), feeds the instruction information back to the display equipment of the township hospital through the network, and transmits the reverse control flow to the township hospital through the network; the village and town hospital (near-end) equipment receives the reverse control flow and carries out corresponding operation, the reverse control flow is amplified once, elongated once and shortened once on the near-end display equipment, corresponding acquisition is carried out on the S-end acquisition and storage equipment while the three operations are carried out (namely S-end acquisition and storage are carried out during the amplification operation, the storage operation is carried out while the elongation is carried out, after the instruction is finished, the S-end storage equipment carries out lossless compression and storage on the corresponding operation of the instruction content), and then the stored lossless high-definition video flow is transmitted back to the provincial hospital (remote end) through the network. At this time, the remote end starts to call the lossless image resource information stream placed in the storage device for playback.
The steps can be effectively realized: on the premise of ensuring the clear and lossless display of the video image, the network transmission bandwidth and the data coding and decoding workload are reduced. Aiming at the defects of network resources in remote rural hospital areas, the influence on remote video transmission is large, the treatment effect of provincial and urban hospitals in remote video consultation can be influenced, and the defects of related technologies can be made up by using a lossless playback technology based on the problem. Under the condition of insufficient network conditions, medical image data resources (such as CT, chest films and the like) of patients in village and town hospitals can be transmitted to equipment in province and city hospitals by a network server through equipment (iPad, a mobile phone, a personal computer and the like) by utilizing lossy compression; in the process, information such as CT, chest pictures and the like is stored in an S-end acquisition and storage device of a town hospital in a lossless compression mode, when the province and city hospital needs to see details after consulting lossy image data, the province and city hospital sends a reverse control instruction to the town hospital device, the town hospital receives the reverse control instruction, the province and city hospital is authorized to acquire lossless compression data of the S-end storage device, the S-end transmits the lossless compression data to the province and city hospital through a network server, and the detail high-definition lossless image medical data are displayed by the province and city hospital device. Through the final lossless playback display, the technology can perfectly solve the problem of insufficient bandwidth, not only can easily switch medical data at a town end or a remote province end, but also can connect experts inside and outside a hospital by itself to losslessly present medical images, and carry out on-site and efficient remote video consultation in a face-to-face mode. Thereby, the following defects in the related art can also be solved: the video conference quality has high network dependence, user experience is difficult to guarantee, and the influence of network bandwidth on the video conference quality is large; when the network bandwidth is insufficient, the presented video interaction effect is poor, and the user requirements of industries such as medical treatment and the like cannot be met.
Specifically, fig. 5 is a preferred flowchart of a data transmission method according to an embodiment of the present invention, as shown in fig. 5: the near-end mobile portable equipment can be divided into two conditions of sufficient network resources and insufficient network resources, wherein under the condition of sufficient network resources, the transmission can be directly carried out; in the case of insufficient network resources, a technology combining lossy transmission and lossless playback can be adopted to transmit the network data to the remote mobile portable device through the network server.
A full and enabling embodiment of the present invention is described in detail below with reference to the accompanying drawings.
Fig. 6 is a preferred flow chart of a data transmission method according to an embodiment of the present invention, as shown in fig. 6, which can be implemented by the following steps,
step 602: firstly, the display output end of the computer is connected with the video input end of the S end of the screen acquisition and storage device, specifically, the display output end of the computer is connected through a video connecting line, so that the image acquisition function of the device on the computer screen is realized (namely, the butt joint of the component 101 and the component 102 shown in fig. 2 is realized). The S end is connected with a USB interface of the computer, so that the remote portable computer can reversely control the USB equipment of the computer or the mouse and the keyboard of the display screen to build a control signal channel; meanwhile, the S-side acquisition and storage device of the screen acquisition and storage device acquires and compresses the picture in the screen of the display device and stores the compressed picture in the S-side, where the S-side may be in a software form or a hardware form, and fig. 7 is an architecture diagram of the data transmission method according to the embodiment of the present invention, specifically as shown in fig. 7.
Step S604: and the S-end screen acquisition and storage equipment is connected with a network server in a wired or wireless way, so that the coded computer image and the reverse control signal are sent to the server end in an IP (Internet protocol) packet way, and data and control channel preparation is prepared for the next screen segmentation and fusion and reverse control.
Step S606: the near-end equipment is connected to the network server, so that the audio and video stream of the near-end mobile equipment is sent to the server, and the data stream from the server after being divided by the screen is received, so that a clear and lossless computer image display function is integrated while a double-stream audio and video conference is realized.
Step S608: the remote mobile device is connected to the server, so that the audio and video stream of the remote mobile device is sent to the server, and the data stream from the network server after being divided and fused by the screen is received, so that a clear and lossless computer image display function is fused while a double-stream audio and video conference is realized.
Step S610: and according to the requirement of a video consultation scene, the remote mobile equipment sends a reverse control request signal to the server and records the request step of reverse control.
Step S612: the far-end mobile equipment applies for the reverse control command and analyzes the command content after the application is confirmed by the server, and a reverse control channel between the far-end mobile equipment and the near-end display card output computer is established, so that the remote reverse control function of the USB equipment of the near-end display card output computer by the far-end mobile equipment is realized.
Step S614: after the connection of the reverse control channel is established, the display equipment acquires a reverse control instruction from the remote end and analyzes the instruction content and the step information recorded by the instruction content;
step S616: and the S-terminal screen acquisition equipment plays back the information data stored at the self-terminal to the remote equipment terminal in a lossless manner through the network server through the instruction information.
Fig. 8 is a preferred architecture diagram of a data transmission method according to an embodiment of the present invention, and the following describes in detail the method for performing screen segmentation and blending display on multi-source input of audio-video and computer images provided by the above embodiment with reference to fig. 8 as follows:
the data transmission method provided by the embodiment of the invention can realize the screen capture and IP processing of the computer screen, so that the computer screen can be remotely displayed. Under the condition of network resource shortage, the traditional video conference function is integrated according to scenes, so that the video information of a camera of the near-far-end mobile equipment can be displayed on one display screen, and the computer screen information output by the near-end display equipment can be displayed clearly and nondestructively. Firstly, the loss transmission is carried out, camera information of the near-end mobile equipment and computer screen information of the near-end display equipment can be roughly obtained, meanwhile, lossless compression processing is carried out on a screen of the near-end display equipment through the S-computing screen acquisition and storage equipment, the compressed display equipment information is stored in the S end, and after the far-end mobile equipment is connected with a reverse control channel of the near-end equipment, detailed high-definition lossless screen information in the near-end display equipment is directly played back and obtained from the S end through a reverse control instruction. The data streams input to the server from multiple sources are data code streams output by each device actually, and the server performs screen segmentation according to the size of a display end window. And (4) adapting the size resolution of the actual display window to finish the effective compression and transmission of the data stream of the audio/video window. The computer screen information is more critical and important in meeting scenes, and lossless compression transmission is performed on the computer screen output and displayed by the display card, so that the definition and lossless of computer image display are ensured. After the fusion is displayed by the server, only the data code stream equivalent to one source is output. On the premise of ensuring that the key information is clear and lossless, the network transmission data code rate and the network bandwidth of the actual scene are reduced.
The following effects can be achieved by the above embodiments of the present invention:
the method has the advantages of good compatibility: the port equipment in the technology can support various types of terminals, including mobile phones, PCs, IPADs and other equipment.
The adaptability is wide: the technique can be used in all video transmission fields.
The experience is good: the technology can adapt to network conditions, is not influenced by network bandwidth, and can see high-definition lossless image quality.
The embodiment of the present application further provides a data transmission device, and it should be noted that the data transmission device in the embodiment of the present application may be used to execute the method for data transmission provided in the embodiment of the present application. The following describes a data transmission device provided in an embodiment of the present application.
Fig. 9 is a schematic diagram of a data transmission apparatus according to the present invention, as shown in fig. 9, the data transmission apparatus including: the first transmission module 91, the first receiving module 93, and the second transmission module 95 will be described in detail below.
The first transmission module 91 is configured to transmit lossy image data to a remote device for remote transmission, where the lossy image data is image data obtained through lossy encoding.
The first receiving module 93 is connected to the first transmitting module 91, and configured to receive the reverse control information of the remote device.
The operation module 95 is configured to operate on lossless image data corresponding to the lossy image data according to the reverse control information, so as to obtain a lossless image data stream.
And a second transmission module 97, connected to the operation module 95, for transmitting the obtained lossless image data stream to the remote device, wherein the lossless image data stream is used in the remote device for lossless playback.
The data transmission device provided by the embodiment of the invention effectively reduces the degree of dependence of a video conference on a network, can achieve the purpose of transmitting lossless image data corresponding to near-end lossy image data to a far end, further realizes the effect of improving video interaction, further solves the technical problem of poor remote video effect caused by large influence of network resources during video interaction in the related technology, and improves the user experience.
Optionally, the data transmission apparatus further includes: and the acquisition module is used for acquiring the lossless image data before receiving the reverse control information of the far-end equipment and storing the lossless image data to the near-end equipment for remote transmission.
Optionally, the data transmission apparatus further includes: the establishing module is used for establishing a control channel for the far-end equipment to remotely control the near-end equipment in a mode of simulating an input interface on the near-end equipment for remote transmission before receiving the reverse control information of the far-end equipment.
Optionally, the operation module includes: the analysis unit is used for analyzing operation steps and operation instructions for operating the lossless image data corresponding to the lossy image data from the reverse control information; and the operation unit is used for operating the lossless image data according to the operation steps and the operation instructions to obtain a lossless image data stream.
Optionally, the data transmission apparatus further includes: a second receiving module, configured to receive a data stream obtained by screen splitting performed by a server performing remote transmission, where the data stream obtained by screen splitting includes: the method comprises the steps that camera video data flow of near-end equipment is carried out when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the far-end equipment is carried out when the near-end equipment and the far-end equipment carry out remote video, and data flow of content displayed on a screen is displayed by the near-end equipment; and the first display module is used for displaying the received data stream after the screen segmentation.
Fig. 10 is a schematic diagram of an alternative data transmission apparatus according to an embodiment of the present invention, as shown in fig. 10, the data transmission apparatus including: a third receiving module 1001, a sending module 1002, a fourth receiving module 1003 and a playback module 1004. The data transmission apparatus will be described in detail below.
A third receiving module 1001, configured to receive lossy image data transmitted by a near-end device performing remote transmission, where the lossy image data is image data obtained through lossy coding.
A sending module 1002, connected to the third receiving module 1001, configured to send reverse control information to the near-end device according to the received lossy image data.
A fourth receiving module 1003, connected to the sending module 1002, configured to receive a lossless image data stream transmitted by the near-end device, where the lossless image data stream is obtained by operating on lossless image data corresponding to the lossy image data according to the reverse control information.
A playback module 1004, connected to the fourth receiving module 1003, for performing lossless playback on the received lossless image data stream.
The data transmission device provided by the embodiment of the invention can comprise: a third receiving module 1001, configured to receive lossy image data transmitted by a near-end device performing remote transmission, where the lossy image data is image data obtained through lossy coding; a sending module 1002, connected to the third receiving module 1001, configured to send reverse control information to a near-end device according to the received lossy image data; a fourth receiving module 1003, connected to the sending module 1002, configured to receive a lossless image data stream transmitted by the near-end device, where the lossless image data stream is obtained by operating on lossless image data corresponding to the lossy image data according to the reverse control information. A playback module 1004, connected to the fourth receiving module 1003, for performing lossless playback on the received lossless image data stream. Therefore, the dependence degree of the video conference on the network is effectively reduced, the purpose of transmitting the lossless image data corresponding to the lossy image data of the near end to the far end can be achieved, the effect of video interaction is further improved, the technical problem that the remote video effect is poor due to the fact that the influence of network resources is large when video interaction is carried out in the related art is further solved, and the user experience is improved.
Optionally, the data transmission apparatus further includes: a fifth receiving module, configured to receive a data stream obtained by screen splitting performed by a server performing remote transmission, where the data stream obtained by screen splitting includes: the method comprises the steps that camera video data flow of near-end equipment is carried out when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the far-end equipment is carried out when the near-end equipment and the far-end equipment carry out remote video, and data flow of content displayed on a screen is displayed by the near-end equipment; and the second display module is used for displaying the received data stream after the screen segmentation.
Fig. 11 is a schematic diagram of an alternative data transmission apparatus according to an embodiment of the present invention, as shown in fig. 11, the data transmission apparatus including: the third transmitting module 1101, the sixth receiving module 1102 and the forwarding module 1103 will be described in detail below.
A third transmission module 1101, configured to transmit lossy image data transmitted by a near-end device performing remote transmission to a far-end device performing remote transmission, where the lossy image data is image data obtained through lossy encoding.
A sixth receiving module 1102, connected to the third transmitting module 1101, configured to receive reverse control information used by the far-end device to control the near-end device, and send the reverse control information to the near-end device.
A forwarding module 1103, connected to the sixth receiving module 1102, configured to forward the lossless image data stream transmitted by the near-end device to the far-end device, where the lossless image data stream is obtained by operating the lossless image data corresponding to the lossy image data according to the reverse control information, and the lossless image data stream is used for lossless playback at the far-end device.
The data transmission device provided by the embodiment of the invention can comprise: a third transmission module 1101, configured to transmit lossy image data transmitted by a near-end device performing remote transmission to a far-end device performing remote transmission, where the lossy image data is image data obtained through lossy coding; a sixth receiving module 1102, connected to the third transmitting module 1101, configured to receive reverse control information used by the far-end device to control the near-end device, and send the reverse control information to the near-end device; a forwarding module 1103, connected to the sixth receiving module 1102, configured to forward the lossless image data stream transmitted by the near-end device to the far-end device, where the lossless image data stream is obtained by operating the lossless image data corresponding to the lossy image data according to the reverse control information, and the lossless image data stream is used for lossless playback at the far-end device. Therefore, the dependence degree of the video conference on the network is effectively reduced, the purpose of transmitting the lossless image data corresponding to the lossy image data of the near end to the far end can be achieved, the effect of video interaction is further improved, the technical problem that the remote video effect is poor due to the fact that the influence of network resources is large when video interaction is carried out in the related art is further solved, and the user experience is improved.
Optionally, the data transmission apparatus further includes: the acquisition module is used for acquiring a camera video data stream of the near-end equipment when the near-end equipment and the far-end equipment carry out remote video, a camera video data stream of the far-end equipment when the near-end equipment and the far-end equipment carry out remote video, and a data stream of content displayed on a display screen of the near-end equipment; and the third display module is used for dividing the display screen corresponding to the server for remote transmission according to the camera video data stream of the near-end equipment, the camera video data stream of the far-end equipment and the data stream of the content displayed by the display screen of the near-end equipment, and respectively displaying the camera video data stream of the near-end equipment, the camera video data stream of the far-end equipment and the data stream of the content displayed by the display screen of the near-end equipment in the divided areas.
Optionally, the data transmission apparatus further includes: the device comprises a judging module, a judging module and a judging module, wherein the judging module is used for judging whether the network bandwidth for remote transmission is less than a preset threshold value before transmitting the lossy image data transmitted by the near-end device for remote transmission to the far-end device for remote transmission; and the determining module is used for determining to transmit the lossy image data transmitted by the near-end equipment for remote transmission to the far-end equipment for remote transmission under the condition that the judgment result of the judging module is yes.
Optionally, the non-destructive image data is a test report, an examination report, a historical medical record for medical diagnosis.
According to another aspect of the embodiments of the present invention, there is also provided a remote transmission system including: the system comprises a near-end device comprising any one data transmission device, a far-end device comprising any one data transmission device, and a server comprising any one data transmission device, wherein the near-end device and the far-end device are interconnected with the server in a wired or wireless mode, and the near-end device comprises a host, a display for displaying image data, a memory for storing lossless image data, and an input interface for the far-end device to reversely control the near-end device.
According to another aspect of the embodiments of the present invention, there is also provided a storage medium, where the storage medium includes a stored program, and when the program runs, the apparatus on which the storage medium is located is controlled to execute the data transmission method of any one of the above.
According to another aspect of the embodiments of the present invention, there is also provided a processor, configured to execute a program, where the program executes a data transmission method in any one of the above.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, a division of a unit may be a division of a logic function, and an actual implementation may have another division, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or may not be executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.

Claims (23)

1. A method of data transmission, comprising:
transmitting lossy image data to a remote device for remote transmission, wherein the lossy image data is image data obtained by lossy coding;
receiving reverse control information of the remote equipment;
according to the reverse control information, operating lossless image data corresponding to the lossy image data to obtain a lossless image data stream;
transmitting the obtained lossless image data stream to the remote device, wherein the lossless image data stream is used at the remote device for lossless playback;
wherein, according to the reverse control information, operating on lossless image data corresponding to the lossy image data to obtain the lossless image data stream comprises:
analyzing operation steps and operation instructions for operating the lossless image data corresponding to the lossy image data from the reverse control information;
and operating the lossless image data according to the operation steps and the operation instructions to obtain the lossless image data stream.
2. The method of claim 1, further comprising, prior to receiving the reverse control information of the remote device:
and collecting the lossless image data and storing the lossless image data to near-end equipment for remote transmission.
3. The method of claim 1, further comprising, prior to receiving the reverse control information of the remote device:
and establishing a control channel for the remote control of the near-end equipment by the far-end equipment in a mode of simulating an input interface on the near-end equipment for remote transmission.
4. The method of claim 2 or 3, further comprising:
receiving a data stream after screen segmentation by a server for remote transmission, wherein the data stream after screen segmentation comprises: the method comprises the steps that when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the near-end equipment, when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the far-end equipment, and the near-end equipment displays data flow of content displayed on a screen;
and displaying the received data stream after the screen segmentation.
5. A method of data transmission, comprising:
receiving lossy image data transmitted by near-end equipment for remote transmission, wherein the lossy image data is image data obtained by lossy coding;
sending reverse control information to the near-end equipment according to the received lossy image data;
receiving a lossless image data stream transmitted by the near-end device, wherein the lossless image data stream is obtained by operating lossless image data corresponding to the lossy image data according to the reverse control information;
lossless playback of the received lossless image data stream;
the lossless image data stream is an operation step and an operation instruction for analyzing the lossless image data corresponding to the lossy image data from the reverse control information; and operating the lossless image data according to the operation steps and the operation instructions to obtain the lossless image data.
6. The method of claim 5, further comprising:
receiving a data stream after screen segmentation by a server for remote transmission, wherein the data stream after screen segmentation comprises: the method comprises the steps that when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the near-end equipment is carried out, when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the far-end equipment is carried out, and the near-end equipment displays data flow of content displayed on a screen;
and displaying the received data stream after the screen segmentation.
7. A method of data transmission, characterized in that,
transmitting lossy image data transmitted by near-end equipment for remote transmission to far-end equipment for remote transmission, wherein the lossy image data is image data obtained by lossy coding;
receiving reverse control information used by the far-end equipment for controlling the near-end equipment, and sending the reverse control information to the near-end equipment;
forwarding a lossless image data stream transmitted by the near-end device to the far-end device, wherein the lossless image data stream is obtained by operating lossless image data corresponding to the lossy image data according to the reverse control information, and the lossless image data stream is used for lossless playback at the far-end device;
the lossless image data stream is an operation step and an operation instruction for analyzing the lossless image data corresponding to the lossy image data from the reverse control information; and operating the lossless image data according to the operation steps and the operation instructions to obtain the lossless image data.
8. The method of claim 7,
acquiring a camera video data stream of the near-end device when the near-end device and the far-end device carry out remote video, acquiring a camera video data stream of the far-end device when the near-end device and the far-end device carry out remote video, and displaying a data stream of content displayed on a screen by the near-end device;
according to the camera video data stream of the near-end equipment, the camera video data stream of the far-end equipment and the data stream of the content displayed on the display screen of the near-end equipment, the display screen corresponding to the server for remote transmission is divided, and the camera video data stream of the near-end equipment, the camera video data stream of the far-end equipment and the data stream of the content displayed on the display screen of the near-end equipment are displayed in the divided areas.
9. The method of claim 7, further comprising, prior to transmitting the lossy image data transmitted by the remote transmitting near-end device to the remote transmitting far-end device:
judging whether the network bandwidth for remote transmission is less than a preset threshold value;
and if so, determining to transmit the lossy image data transmitted by the near-end device for remote transmission to the far-end device for remote transmission.
10. The method of any of claims 7 to 9, wherein the non-destructive image data is a test report, an examination report, a historical medical record for medical diagnosis.
11. A data transmission apparatus, comprising:
the system comprises a first transmission module, a second transmission module and a third transmission module, wherein the first transmission module is used for transmitting lossy image data to remote equipment for remote transmission, and the lossy image data is image data obtained by lossy coding;
a first receiving module, configured to receive reverse control information of the remote device;
the operation module is used for operating the lossless image data corresponding to the lossy image data according to the reverse control information to obtain a lossless image data stream;
a second transmission module, configured to transmit the obtained lossless image data stream to the remote device, where the lossless image data stream is used for lossless playback at the remote device;
wherein the operation module comprises:
the analysis unit is used for analyzing operation steps and operation instructions for operating the lossless image data corresponding to the lossy image data from the reverse control information;
and the operation unit is used for operating the lossless image data according to the operation steps and the operation instructions to obtain the lossless image data stream.
12. The apparatus of claim 11, further comprising:
and the acquisition module is used for acquiring the lossless image data before receiving the reverse control information of the far-end equipment and storing the lossless image data to the near-end equipment for remote transmission.
13. The apparatus of claim 11, further comprising:
the establishing module is used for establishing a control channel for the far-end equipment to remotely control the near-end equipment in a mode of simulating an input interface on the near-end equipment for remote transmission before the reverse control information of the far-end equipment is received.
14. The apparatus of any one of claims 12 or 13, further comprising:
a second receiving module, configured to receive a data stream obtained by screen splitting performed by a server performing remote transmission, where the data stream obtained by screen splitting includes: the method comprises the steps that when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the near-end equipment, when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the far-end equipment, and the near-end equipment displays data flow of content displayed on a screen;
and the first display module is used for displaying the received data stream after the screen segmentation.
15. A data transmission apparatus, comprising:
a third receiving module, configured to receive lossy image data transmitted by a near-end device performing remote transmission, where the lossy image data is image data obtained through lossy coding;
a sending module, configured to send reverse control information to the near-end device according to the received lossy image data;
a fourth receiving module, configured to receive a lossless image data stream transmitted by the near-end device, where the lossless image data stream is obtained by operating lossless image data corresponding to the lossy image data according to the reverse control information;
the playback module is used for carrying out lossless playback on the received lossless image data stream;
the lossless image data stream is an operation step and an operation instruction for analyzing the lossless image data corresponding to the lossy image data from the reverse control information; and operating the lossless image data according to the operation steps and the operation instructions to obtain the lossless image data.
16. The apparatus of claim 15, further comprising:
a fifth receiving module, configured to receive a data stream obtained by screen splitting performed by a server performing remote transmission, where the data stream obtained by screen splitting includes: the method comprises the steps that when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the near-end equipment is carried out, when the near-end equipment and the far-end equipment carry out remote video, camera video data flow of the far-end equipment is carried out, and the near-end equipment displays data flow of content displayed on a screen;
and the second display module is used for displaying the received data stream after the screen segmentation.
17. A data transmission apparatus, comprising:
a third transmission module, configured to transmit lossy image data transmitted by a near-end device performing remote transmission to a far-end device performing remote transmission, where the lossy image data is image data obtained through lossy coding;
a sixth receiving module, configured to receive reverse control information that is used by the far-end device to control the near-end device, and send the reverse control information to the near-end device;
a forwarding module, configured to forward a lossless image data stream transmitted by the near-end device to the far-end device, where the lossless image data stream is obtained by operating lossless image data corresponding to the lossy image data according to the reverse control information, and the lossless image data stream is used for lossless playback at the far-end device;
the lossless image data stream is an operation step and an operation instruction for analyzing the lossless image data corresponding to the lossy image data from the reverse control information; and operating the lossless image data according to the operation steps and the operation instructions to obtain the lossless image data.
18. The apparatus of claim 17, further comprising:
an obtaining module, configured to obtain a camera video data stream of the near-end device when the near-end device performs remote video with the far-end device, obtain a camera video data stream of the far-end device when the near-end device performs remote video with the far-end device, and display a data stream of content displayed on a screen by the near-end device;
and the third display module is used for dividing the display screen corresponding to the server for remote transmission according to the camera video data stream of the near-end equipment, the camera video data stream of the far-end equipment and the data stream of the content displayed by the display screen of the near-end equipment, and respectively displaying the camera video data stream of the near-end equipment, the camera video data stream of the far-end equipment and the data stream of the content displayed by the display screen of the near-end equipment in the divided areas.
19. The apparatus of claim 18, further comprising:
the device comprises a judging module, a judging module and a judging module, wherein the judging module is used for judging whether the network bandwidth for remote transmission is less than a preset threshold value before transmitting the lossy image data transmitted by the near-end device for remote transmission to the far-end device for remote transmission;
and the determining module is used for determining that the lossy image data transmitted by the near-end equipment for remote transmission is transmitted to the far-end equipment for remote transmission under the condition that the judgment result of the judging module is yes.
20. The apparatus of any one of claims 17 to 19, wherein the non-destructive image data is a test report, an examination report, a historical medical record for medical diagnosis.
21. A remote transmission system, comprising: a near-end device comprising the data transmission apparatus of any one of claims 11 to 14, a far-end device comprising the data transmission apparatus of any one of claims 15 or 16, a server comprising the data transmission apparatus of any one of claims 17 to 20, wherein the near-end device and the far-end device are interconnected with the server by wire or wirelessly, the near-end device comprising a host, a display for displaying image data, a memory for storing the lossless image data, and an input interface for the far-end device to perform reverse control of the near-end device.
22. A storage medium, characterized in that the storage medium comprises a stored program, wherein when the program runs, a device in which the storage medium is located is controlled to execute the data transmission method according to any one of claims 1 to 10.
23. A processor, characterized in that the processor is configured to run a program, wherein the program is configured to execute the data transmission method according to any one of claims 1 to 10 when running.
CN201710648313.1A 2017-08-01 2017-08-01 Data transmission method and device Active CN107480437B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710648313.1A CN107480437B (en) 2017-08-01 2017-08-01 Data transmission method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710648313.1A CN107480437B (en) 2017-08-01 2017-08-01 Data transmission method and device

Publications (2)

Publication Number Publication Date
CN107480437A CN107480437A (en) 2017-12-15
CN107480437B true CN107480437B (en) 2020-09-18

Family

ID=60598373

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710648313.1A Active CN107480437B (en) 2017-08-01 2017-08-01 Data transmission method and device

Country Status (1)

Country Link
CN (1) CN107480437B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112086184A (en) * 2020-07-31 2020-12-15 新视焰医疗科技(苏州)有限公司 Endogenous data remote monitoring system of clinical laboratory based on hospital information platform

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1694486A (en) * 2004-04-30 2005-11-09 微软公司 Adaptive compression of multi-level images
CN1859571A (en) * 2006-06-01 2006-11-08 上海交通大学 Screen coding method under low code rate
CN103577673A (en) * 2012-08-01 2014-02-12 艾康(上海)信息技术有限公司 Real-time interactive remote medicine system and real-time interactive remote medicine method
CN103619045A (en) * 2013-11-21 2014-03-05 中国科学院信息工程研究所 Route establishing method and system of low-consumption lossy network
CN105101140A (en) * 2015-06-30 2015-11-25 北京奇虎科技有限公司 Traffic-saving method for visiting network, proxy server and network access system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110033679A (en) * 2009-09-25 2011-03-31 삼성전자주식회사 Image transmission system of robot based on network and method thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1694486A (en) * 2004-04-30 2005-11-09 微软公司 Adaptive compression of multi-level images
CN1859571A (en) * 2006-06-01 2006-11-08 上海交通大学 Screen coding method under low code rate
CN103577673A (en) * 2012-08-01 2014-02-12 艾康(上海)信息技术有限公司 Real-time interactive remote medicine system and real-time interactive remote medicine method
CN103619045A (en) * 2013-11-21 2014-03-05 中国科学院信息工程研究所 Route establishing method and system of low-consumption lossy network
CN105101140A (en) * 2015-06-30 2015-11-25 北京奇虎科技有限公司 Traffic-saving method for visiting network, proxy server and network access system

Also Published As

Publication number Publication date
CN107480437A (en) 2017-12-15

Similar Documents

Publication Publication Date Title
CN102196243B (en) Video data processing method, device and system
US8976220B2 (en) Devices and methods for hosting a video call between a plurality of endpoints
CN100459711C (en) Video compression method and video system using the method
CN205336429U (en) Hospital's remote medical consultation with specialists and teaching system
US7996540B2 (en) Method and system for replacing media stream in a communication process of a terminal
CN102831305A (en) Auxiliary workstation for remote medical diagnosis
WO2018024231A1 (en) Method and apparatus for interconnecting spliced wall and mobile intelligent terminal
CN102158690A (en) Remote multichannel real-time video monitoring system
CN107357585B (en) Video acquisition method and device, video equipment and storage medium
CN101778285B (en) A kind of audio-video signal wireless transmitting system and method thereof
CN111124337B (en) Image display method and system
CN108040061A (en) A kind of cloud meeting live broadcasting method
CN101621654A (en) Household intelligent video gateway
CN103686049A (en) Home care terminal integrating health service, remote nursing, video calling and helping functions
CN102892032A (en) Real-time interactive high definition network video communication system
CN111107301A (en) Video conference platform and communication method based on video conference platform
CN107480437B (en) Data transmission method and device
CN110727485A (en) Screen interface selectable sharing method and system
CN101247490A (en) Portable off-site video relay broadcasting system
CN110868620A (en) Remote interaction system and method based on television
CN110895973A (en) Remote clinical consultation platform system
CN111653343A (en) Medical real-time image remote consultation system and method
CN111462923A (en) Remote intelligent medical treatment and intelligent education system
CN207802173U (en) One kind regarding networked devices
JP6361344B2 (en) Information processing system and information processing method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20230105

Address after: Room 740, No. 1256 and 1258, Wanrong Road, Jing'an District, Shanghai, 200072

Patentee after: Shanghai Jingda Xinlian Information Technology Co.,Ltd.

Address before: Room d102, building 4, Fengye Xindu District, hi tech Zone, Xi'an City, Shaanxi Province

Patentee before: XI'AN VANXVM ELECTRONICS TECHNOLOGY Co.,Ltd.

TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20230728

Address after: 710075, 2nd Floor, Building 5, Taiwei Zhilian Center, No. 8 Tangyan South Road, High tech Zone, Xi'an City, Shaanxi Province

Patentee after: XI'AN VANXVM ELECTRONICS TECHNOLOGY Co.,Ltd.

Address before: Room 740, No. 1256 and 1258, Wanrong Road, Jing'an District, Shanghai, 200072

Patentee before: Shanghai Jingda Xinlian Information Technology Co.,Ltd.

TR01 Transfer of patent right