CN116527783A - Information transmission method, information transmission device and chip - Google Patents
Information transmission method, information transmission device and chip Download PDFInfo
- Publication number
- CN116527783A CN116527783A CN202310406734.9A CN202310406734A CN116527783A CN 116527783 A CN116527783 A CN 116527783A CN 202310406734 A CN202310406734 A CN 202310406734A CN 116527783 A CN116527783 A CN 116527783A
- Authority
- CN
- China
- Prior art keywords
- image
- information
- image information
- fusion
- transmission method
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 122
- 238000000034 method Methods 0.000 title claims abstract description 63
- 230000004927 fusion Effects 0.000 claims abstract description 64
- 238000004891 communication Methods 0.000 claims description 35
- 238000004590 computer program Methods 0.000 claims description 8
- 238000012545 processing Methods 0.000 description 17
- 230000006870 function Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 9
- RZVHIXYEVGDQDX-UHFFFAOYSA-N 9,10-anthraquinone Chemical compound C1=CC=C2C(=O)C3=CC=CC=C3C(=O)C2=C1 RZVHIXYEVGDQDX-UHFFFAOYSA-N 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 230000009286 beneficial effect Effects 0.000 description 5
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000001514 detection method Methods 0.000 description 3
- 238000005259 measurement Methods 0.000 description 3
- 230000002457 bidirectional effect Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007499 fusion processing Methods 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000037361 pathway Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W80/00—Wireless network protocols or protocol adaptations to wireless operation
- H04W80/06—Transport layer protocols, e.g. TCP [Transport Control Protocol] over wireless
Abstract
The invention discloses an information transmission method, an information transmission device and a chip, relates to the technical field of information transmission, and aims to solve the problem that an information receiving end cannot receive telemetry information and task information obtained at the same moment at the same time in the prior art. The information transmission method comprises the following steps: acquiring image information and non-image information at the same moment; determining a fusion image according to the image information and the non-image information; transmitting the fusion image, and determining the fusion image after transmission; determining the transmitted image information and the transmitted non-image information according to the transmitted fusion image; wherein the transmitted image information and the transmitted non-image information are information at the same time. The invention also provides an information transmission device and a chip comprising the information transmission method.
Description
Technical Field
The present invention relates to the field of information transmission technologies, and in particular, to an information transmission method, an information transmission device, and a chip.
Background
Unmanned aerial vehicle systems generally include a ground station, a flight control module, and a radio communication module. The ground station and the flight control module are in communication connection through the radio communication module. Specifically, the main task of the radio communication module is to establish a space-to-ground bidirectional data transmission channel for completing remote control, remote measurement and task information transmission of the unmanned aerial vehicle by the ground station.
Telemetry information is mainly utilized in the telemetry process, and generally comprises GPS data, remote control command feedback, unmanned aerial vehicle flight position, unmanned aerial vehicle flight attitude and other state information. The task information generally includes pan-tilt pose information, camera image information, laser point cloud information, and the like.
Because the information quantity of the telemetry information and the task information is far from each other, the transmission speed is also different, and the problem of information asymmetry such as inconsistent information frequency, bandwidth and time stamp exists in the downlink wireless communication flow. At this time, the telemetry information and the task information obtained by the unmanned aerial vehicle at a certain moment cannot be transmitted to the ground station at the same moment, that is, the ground station cannot receive the telemetry information and the task information obtained at the same moment at the same time. Based on this, can influence the ground station to unmanned aerial vehicle's control to and the information that unmanned aerial vehicle gathered can not be known accurately.
Disclosure of Invention
The invention aims to provide an information transmission method, an information transmission device and a chip, which are used for enabling an information receiving end to receive telemetry information and task information obtained at the same moment at the same time so as to ensure control of an unmanned aerial vehicle and accurate acquisition of acquired information.
In order to achieve the above object, in a first aspect, the present invention provides an information transmission method. The information transmission method comprises the following steps:
acquiring image information and non-image information at the same moment;
determining a fusion image according to the image information and the non-image information;
transmitting the fusion image, and determining the fusion image after transmission;
determining the transmitted image information and the transmitted non-image information according to the transmitted fusion image;
wherein the transmitted image information and the transmitted non-image information are information at the same time.
Compared with the prior art, in the information transmission method provided by the invention, because the image information and the non-image information at the same moment are obtained, the condition of the acquisition module (such as the load on the unmanned aerial vehicle) and the environment in which the acquisition module is located at the same moment can be obtained. Then, a fused image is formed by fusing the image information and the non-image information, and the fused image is transmitted. In this process, the non-image information is changed from the conventional transmission mode to the transmission mode of the image information, and at this time, the transmission frequency of the non-image information is kept identical to the transmission frequency of the image information. Further, since the post-transmission image information and the post-transmission non-image information are information at the same time. Based on this, it can be ensured that the information within the same frame of image is consistent in time stamp during transmission. In summary, by using the information transmission method provided by the invention, the information receiving end can receive the image information and the non-image information obtained at the same time, so as to ensure the control of the acquisition module, accurately acquire the information acquired by the acquisition module, and further acquire the environment condition of the acquisition module.
In one implementation, when an image in the image information includes a channel;
determining a fused image from the image information and the non-image information, comprising:
acquiring a channel of an image in image information;
non-image information is embedded in a channel to determine a fused image.
Under the condition of adopting the technical scheme, the fusion of the image information and the non-image information can be realized by utilizing the channel of the image, and the introduction of a new structure on the image is avoided. The method is simple and convenient, meanwhile, the complexity of the image is prevented from being further increased, and the later analysis of the fusion image is facilitated.
In one implementation, when an image in the image information includes a plurality of channels;
determining a fused image from the image information and the non-image information, comprising:
acquiring a first channel and other channels of an image in image information;
and embedding the non-image information into the first channel, and setting preset values for the rest channels to determine the fusion image.
Under the condition of adopting the technical scheme, firstly, the fusion of the image information and the non-image information can be realized by utilizing the channel of the image, and the introduction of a new structure on the image is avoided. The method is simple and convenient, meanwhile, the complexity of the image is prevented from being further increased, and the later analysis of the fusion image is facilitated. Then, when the image has a plurality of channels, the non-image information is embedded only in the first channel, and the remaining channels are set to a preset value. At this time, the difficulty of fusion of the image information and the non-image information can be reduced, so as to improve the fusion speed. Further, when a problem occurs in one channel in the image, the rest channels can be used as standby channels so as to ensure the normal fusion of the image information and the non-image information.
In one implementation, when an image in the image information includes a plurality of channels;
determining a fused image from the image information and the non-image information, comprising:
acquiring a plurality of channels of images in the image information;
and embedding the non-image information into at least two channels, and setting preset values for the rest channels to determine the fusion image.
In the case of the above technical solution, it is known from the foregoing description that when the image in the image information includes a plurality of channels, the non-image information may be embedded in at least two channels, or may be embedded in one of the channels. At this time, the selectivity of embedding the non-image information into the image information is increased, and the application range and application scene of the information transmission method are enlarged.
In one implementation, the image in the image information has a height and a width;
embedding non-image information into a first channel, and setting preset values for the rest channels to determine a fusion image, wherein the method comprises the following steps:
embedding non-image information into a first channel along the width direction of an image, and setting preset values for the rest channels to determine a fusion image; and/or the number of the groups of groups,
and embedding non-image information into the first channel along the height direction of the image, and setting preset values for the rest channels to determine a fusion image.
With the adoption of the technical scheme, the non-image information can be embedded into the first channel along the width and/or height directions of the image. At this time, the selectivity of embedding the non-image information into the image information is further increased, and the application range and application scene of the information transmission method are further enlarged.
In one implementation, the image information has a larger amount of data than the non-image information.
With the above-described technique, the image information has a larger data amount than the non-image information, and therefore the image information is transmitted at a lower frequency than the non-image information. At this time, the transmission of the information is performed with the transmission frequency being the transmission reference which is small, so as to ensure the time consistency of the transmitted information. Based on this, non-image information is embedded in the image of the image information in the present invention to obtain a fused image that is subsequently transmitted.
In one implementation, the transmitting the fused image, determining the fused image after transmission includes: and transmitting the fusion image based on the 5G network, and determining the fusion image after transmission.
Under the condition of adopting the technical scheme, the 5G network has the characteristics of high bandwidth and high stability, so that high-definition transmission of the fusion image can be ensured, and distortion of the fusion image is reduced or avoided. Meanwhile, the real-time transmission of the fusion image can be ensured, and the probability of occurrence of problems in the transmission process of the fusion image is reduced or eliminated. Furthermore, the consistency of the time stamps of the information in the same frame of image in the transmission process can be ensured.
In one implementation, when the information transmission method is applied to unmanned aerial vehicle information transmission, the image information comprises camera image information, and the non-image information comprises cradle head posture information, unmanned aerial vehicle position information and unmanned aerial vehicle posture information; the camera and the cradle head are arranged on the unmanned aerial vehicle.
In a second aspect, the invention further provides an information transmission device. The information transmission device includes: the processor is coupled with the communication interface, and the processor is used for running a computer program or instructions to realize the information transmission method.
In a third aspect, the invention also provides a chip. The chip stores instructions that, when executed, cause the information transmission method described above to be performed.
Compared with the prior art, the beneficial effects of the second aspect and the third aspect are the same as the beneficial effects of the information transmission method described in the above technical solution, and are not described in detail herein.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the invention and do not constitute a limitation on the invention. In the drawings:
fig. 1 is a flow chart of an information transmission method in an embodiment of the invention;
fig. 2 is a schematic functional block diagram of an information transmission device according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of an image information structure according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a fused image obtained by fusing image information and non-image information in an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an information transmission device according to an embodiment of the present invention;
fig. 6 is a schematic diagram of a hardware structure of a terminal device in an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a chip according to an embodiment of the invention.
Reference numerals:
the system comprises a 10-acquisition module, a 11-fusion module, a 12-transmission module and a 13-analysis module;
14-R channel, 15-G channel, 16-B channel;
17-image information, 18-non-image information;
20-information transmission means, 21-processing unit, 22-communication unit, 23-storage unit,
30-terminal equipment, 31-first processor, 32-communication interface, 33-communication line,
34-a first memory, 35-a second processor;
40-chip, 41-processor, 42-communication interface, 43-second memory,
44-bus system.
Detailed Description
In order to make the technical problems, technical schemes and beneficial effects to be solved more clear, the invention is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
It will be understood that when an element is referred to as being "mounted" or "disposed" on another element, it can be directly on the other element or be indirectly on the other element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or be indirectly connected to the other element.
Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more such feature. In the description of the present invention, the meaning of "a plurality" is two or more, unless explicitly defined otherwise. The meaning of "a number" is one or more than one unless specifically defined otherwise.
In the description of the present invention, it should be understood that the directions or positional relationships indicated by the terms "upper", "lower", "front", "rear", "left", "right", etc., are based on the directions or positional relationships shown in the drawings, are merely for convenience of describing the present invention and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as limiting the present invention.
In the description of the present invention, it should be noted that, unless explicitly specified and limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be either fixedly connected, detachably connected, or integrally connected, for example; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communicated with the inside of two elements or the interaction relationship of the two elements. The specific meaning of the above terms in the present invention can be understood by those of ordinary skill in the art according to the specific circumstances.
Unmanned aerial vehicle systems generally include a ground station, a flight control module, and a radio communication module. The ground station and the flight control module are in communication connection through the radio communication module. Specifically, the main task of the radio communication module is to establish a space-to-ground bidirectional data transmission channel for completing remote control, remote measurement and task information transmission of the unmanned aerial vehicle by the ground station.
The remote control can realize the remote operation of the task equipment of the unmanned aerial vehicle, and the remote measurement can realize the monitoring of the unmanned aerial vehicle state. The task information transmission is to transmit information such as video and image acquired by an onboard task sensor to a ground station through a downlink wireless channel, which is the key of the unmanned aerial vehicle to complete task planning, and the quality is directly related to the capability of finding and identifying targets.
The load that sets up on the unmanned aerial vehicle is numerous in general, can include cloud platform, visible light camera, infrared camera, laser radar etc. for example. At this time, the task information generally includes pan-tilt attitude information, camera image information, laser point cloud information, and the like. The task information acquired by the different loads has different data magnitudes and different transmission data rates. In the practical application process, the task information is generally transmitted to the ground station in real time by using the image transmission station, and a stable video picture is displayed on the ground station. The transmission frequency in the transmission process is generally 2.4GHZ or 5.8GHZ, and the communication interface protocol includes HDMI or ethernet interface protocol.
Telemetry information is mainly utilized in the telemetry process, and generally comprises GPS data, remote control command feedback, unmanned aerial vehicle flight position, unmanned aerial vehicle flight attitude and other state information. The information security requirement of the state information is high, a data transmission station is generally used for transmitting telemetry information to a ground station, and the adopted communication interface protocol comprises TTL, RS485 or RS232 interfaces, and the frequencies comprise 2.4GHZ, 900MHZ, 800MHZ or 433MHZ and the like. Through the communication between unmanned aerial vehicle and the ground station of final realization of above-mentioned transmission method, ground station gives unmanned aerial vehicle task, and unmanned aerial vehicle real-time fly height, many data such as speed all can be transmitted through it to make things convenient for us to monitor unmanned aerial vehicle condition constantly, revise unmanned aerial vehicle course and mission planning at any time as required.
Because the information quantity of the telemetry information and the task information is far from each other, the transmission speed is also different, and the problem of information asymmetry such as inconsistent information frequency, bandwidth and time stamp exists in the downlink wireless communication flow. At this time, the telemetry information and the task information obtained by the unmanned aerial vehicle at a certain moment cannot be transmitted to the ground station at the same moment, that is, the ground station cannot receive the telemetry information and the task information obtained at the same moment at the same time. Based on this, can influence the ground station to unmanned aerial vehicle's control to and the information that unmanned aerial vehicle gathered can not be known accurately.
In order to solve the technical problems described above, in a first aspect, an embodiment of the present invention provides an information transmission method. The following description is given by way of example of a drone, it being understood that the following description is for understanding only and is not intended to be limiting in detail.
The steps executed by the acquisition module in the method provided by the embodiment of the invention can also be executed by a chip applied to the acquisition module; the steps performed by the fusion module may also be performed by a chip applied in the fusion module; the steps performed by the transmission module may also be performed by a chip applied in the transmission module; the steps performed by the parsing module may also be performed by a chip applied in the parsing module. The following embodiments take the acquisition module, the fusion module, the transmission module, and the analysis module as execution subjects, respectively.
Referring to fig. 1 and 2, the information transmission method includes:
step 101: the acquisition module 10 acquires image information and non-image information at the same moment;
the above-mentioned acquisition module for acquiring image information may be, for example, an optical detection device such as a visible light camera or an infrared camera. It should be understood that the image in the image information is not limited to the three-channel image directly acquired by the optical detection device, but may be an image processed by the three-channel image directly acquired by the optical detection device, such as a gray-scale image, a four-channel image formed by processing the three-channel image, or a two-channel image formed by processing the three-channel image.
In the embodiment of the invention, when the information transmission method is applied to unmanned aerial vehicle information transmission, the image information comprises camera image information, and the non-image information comprises cradle head posture information, unmanned aerial vehicle position information and unmanned aerial vehicle posture information; the camera and the cradle head are arranged on the unmanned aerial vehicle. The unmanned aerial vehicle position information and the unmanned aerial vehicle gesture information are mainly provided by a flight control, and the flight control of the unmanned aerial vehicle can comprise a gyroscope, an accelerometer, geomagnetic induction, an air pressure sensor, a GPS module, a control circuit and the like. The main function of the flight control is to automatically maintain and record the normal flight position and attitude of the unmanned aerial vehicle. The acquisition module is used for acquiring the return values of the various sensors and sorting and screening useful information in the return values.
Step 102: the fusion module 11 determines a fusion image according to the image information and the non-image information;
step 103: the transmission module 12 transmits the fusion image and determines the fusion image after transmission;
illustratively, the transmission module synchronizes the camera images of the unmanned aerial vehicle to the ground station in real time, so that the ground station knows the flight environment of the unmanned aerial vehicle in real time.
Step 104: the analysis module 13 determines the transmitted image information and the transmitted non-image information according to the transmitted fusion image; wherein the transmitted image information and the transmitted non-image information are information at the same time.
The method for determining the transmitted image information and the transmitted non-image information by the analyzing module after the ground station receives the transmitted fused image through the image transmission station can be referred to as a method for extracting and separating image features or image data in the prior art, and is not particularly limited herein. And then, monitoring the state of the unmanned aerial vehicle by using the position information and the posture information of the unmanned aerial vehicle in the transmitted non-image information, positioning a target in real time by using the posture information of the cradle head in the transmitted non-image information, and displaying other related information of the unmanned aerial vehicle by using the transmitted image information.
In the information transmission method provided by the embodiment of the invention, because the image information and the non-image information at the same moment are obtained, the condition of the acquisition module (such as the load on the unmanned aerial vehicle) and the environment where the acquisition module is located at the same moment can be obtained. Then, a fused image is formed by fusing the image information and the non-image information, and the fused image is transmitted. In this process, the non-image information is changed from the conventional transmission mode to the transmission mode of the image information, and at this time, the transmission frequency of the non-image information is kept identical to the transmission frequency of the image information. Further, since the post-transmission image information and the post-transmission non-image information are information at the same time. Based on this, it can be ensured that the information within the same frame of image is consistent in time stamp during transmission. In summary, by using the information transmission method provided by the embodiment of the invention, the information receiving end can receive the image information and the non-image information obtained at the same time, so as to ensure the control of the acquisition module, accurately acquire the information acquired by the acquisition module, and further acquire the environment condition of the acquisition module.
The image may include one channel or a plurality of channels, and the channels used in determining the fused image based on the image information and the non-image information may be different in the case where the number of channels included in the image is different. The following description is given by way of example of three possible implementations, it being understood that the following description is for understanding only and is not intended to be limiting in any way.
Example one: when the image in the image information includes a channel;
determining a fused image from the image information and the non-image information, comprising:
acquiring a channel of an image in image information;
non-image information is embedded in a channel to determine a fused image.
Under the condition of adopting the technical scheme, the fusion of the image information and the non-image information can be realized by utilizing the channel of the image, and the introduction of a new structure on the image is avoided. The method is simple and convenient, meanwhile, the complexity of the image is prevented from being further increased, and the later analysis of the fusion image is facilitated.
Example two: when the image in the image information includes a plurality of channels;
determining a fused image from the image information and the non-image information, comprising:
acquiring a first channel and other channels of an image in image information;
and embedding the non-image information into the first channel, and setting preset values for the rest channels to determine the fusion image.
Under the condition of adopting the technical scheme, firstly, the fusion of the image information and the non-image information can be realized by utilizing the channel of the image, and the introduction of a new structure on the image is avoided. The method is simple and convenient, meanwhile, the complexity of the image is prevented from being further increased, and the later analysis of the fusion image is facilitated. Then, when the image has a plurality of channels, the non-image information is embedded only in the first channel, and the remaining channels are set to a preset value. At this time, the difficulty of fusion of the image information and the non-image information can be reduced, so as to improve the fusion speed. Further, when a problem occurs in one channel in the image, the rest channels can be used as standby channels so as to ensure the normal fusion of the image information and the non-image information. The preset value may be any one of 8-bit gray values (i.e. 0 to 255) in the image, for example: 0,18,30,56,253 or 255, etc. In the embodiment of the present invention, the preset value is 0.
Example three: when the image in the image information includes a plurality of channels;
determining a fused image from the image information and the non-image information, comprising:
acquiring a plurality of channels of images in the image information;
and embedding the non-image information into at least two channels, and setting preset values for the rest channels to determine the fusion image.
In the case of the above technical solution, it is known from the foregoing description that when the image in the image information includes a plurality of channels, the non-image information may be embedded in at least two channels, or may be embedded in one of the channels. At this time, the selectivity of embedding the non-image information into the image information is increased, and the application range and application scene of the information transmission method are enlarged. The foregoing preset values may be referred to in the foregoing description, and are not described herein. In the embodiment of the present invention, the preset value is 0.
For example, when the image includes three channels, i.e., an R channel, a G channel, and a B channel, respectively, non-image information may be embedded in the R channel and the G channel, and the B channel sets a preset value. Non-image information may also be embedded in the R and B channels, where the G channel sets a preset value. The non-image information may also be embedded in the G-channel and the B-channel, where the R-channel sets a preset value. Non-image information may also be embedded in the R, G, and B channels.
In an alternative, referring to fig. 3 and 4, the image in the image information 17 has a height H and a width W; embedding non-image information 18 into a first channel, the remaining channels each having a preset value to determine a fused image, comprising: embedding non-image information into a first channel along the width direction of an image, and setting preset values for the rest channels to determine a fusion image; and/or embedding non-image information into the first channel along the height direction of the image, and setting preset values for the rest channels to determine the fusion image.
With the adoption of the technical scheme, the non-image information can be embedded into the first channel along the width and/or height directions of the image. At this time, the selectivity of embedding the non-image information into the image information is further increased, and the application range and application scene of the information transmission method are further enlarged.
In the embodiment of the present invention, referring to fig. 3 and 4, the image includes three channels, namely, an R channel 14 (i.e., a first channel), a G channel 15, and a B channel 16. In the actual fusion process, the non-image information 18 is embedded in the R channel 14 along the width W direction of the image, and the G channel 15 and the B channel 16 are both set to zero.
As a possible implementation, the amount of data of the image information is larger than the amount of data of the non-image information.
With the above-described technique, the image information has a larger data amount than the non-image information, and therefore the image information is transmitted at a lower frequency than the non-image information. At this time, the transmission of the information is performed with the transmission frequency being the transmission reference which is small, so as to ensure the time consistency of the transmitted information. Based on this, non-image information is embedded in the image of the image information in the present invention to obtain a fused image that is subsequently transmitted.
As a possible implementation manner, the transmitting the fused image, determining the fused image after transmission includes: and transmitting the fusion image based on the 5G network, and determining the fusion image after transmission.
Under the condition of adopting the technical scheme, compared with the prior art that the image transmission station adopts 4G network signals, the 5G network has the characteristics of high bandwidth and high stability, so that high-definition transmission of the fusion image can be ensured, and distortion of the fusion image is reduced or avoided. Meanwhile, the real-time transmission of the fusion image can be ensured, and the probability of occurrence of problems in the transmission process of the fusion image is reduced or eliminated. Furthermore, the consistency of the time stamps of the information in the same frame of image in the transmission process can be ensured.
In a second aspect, an embodiment of the present invention further provides an information transmission apparatus. The information transmission device includes: the processor is coupled with the communication interface, and the processor is used for running a computer program or instructions to realize the information transmission method.
In a third aspect, the embodiment of the invention further provides a chip. The chip stores instructions that, when executed, cause the information transmission method described above to be performed.
In the embodiment of the present invention, the beneficial effects of the second aspect and the third aspect are the same as the beneficial effects of the information transmission method described in the foregoing technical solution, and are not described herein in detail.
The scheme provided by the embodiment of the invention is mainly described from the perspective of the terminal equipment. It will be appreciated that, in order to implement the above-mentioned functions, the terminal device includes corresponding hardware structures and/or software modules for performing the respective functions. Those of skill in the art will readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is implemented as hardware or computer software driven hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The embodiment of the invention can divide the functional modules of the terminal equipment and the like according to the method example, for example, each functional module can be divided corresponding to each function, and two or more functions can be integrated in one processing module. The integrated modules may be implemented in hardware or in software functional modules. It should be noted that, in the embodiment of the present invention, the division of the modules is schematic, which is merely a logic function division, and other division manners may be implemented in actual implementation.
In the case of adopting the corresponding integrated unit, fig. 5 shows a schematic structural diagram of the information transmission device provided in the embodiment of the present invention. The information transmission device 20 may be a terminal device or a chip applied to the terminal device.
Referring to fig. 5, the information transmission apparatus 20 may further include: a processing unit 21 and a communication unit 22. Optionally, the information transmission device 20 may further include a storage unit 23 for storing program codes and data of the information transmission device 20.
In one example, referring to fig. 5, the communication unit 22 is configured to support the information transmission device 20 to perform steps 101 and 103 in the foregoing embodiment.
Referring to fig. 5, the processing unit 21 is configured to support the information transmission device 20 to perform step 102 and step 104 in the above-described embodiment.
Wherein referring to fig. 5, the processing unit 21 may be a processor or controller, for example, may be a central processing unit (Central Processing Unit, CPU), a general purpose processor, a digital signal processor (Digital Signal Processor, DSP), an Application-specific integrated circuit (ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic device, a transistor logic device, a hardware component, or any combination thereof. Which may implement or perform the various exemplary logic blocks, modules and circuits described in connection with this disclosure. The processor described above may also be a combination that performs the function of a computation, e.g., a combination comprising one or more microprocessors, a combination of a DSP and a microprocessor, and so on. The communication unit 22 may be a transceiver, a transceiver circuit, a communication interface, or the like. The storage unit 23 may be a memory.
Referring to fig. 5, when the processing unit 21 is a processor, the communication unit 22 is a transceiver, and the storage unit 23 is a memory, the information transmission apparatus 20 according to the embodiment of the present invention may be a hardware structure diagram of the terminal device of fig. 6.
Referring to fig. 6, a terminal device 30 provided in an embodiment of the present invention includes a first processor 31 and a communication interface 32. The communication interface 32 is coupled to the first processor 31.
Referring to fig. 6, the first processor 31 may be a general-purpose central processing unit (central processing unit, CPU), microprocessor, application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program according to the present invention. The communication interface 32 may be one or more. The communication interface 32 may use any transceiver-like device for communicating with other devices or communication networks.
Referring to fig. 6, the terminal device 30 may further include a communication line 33. Communication line 33 may include a pathway to transfer information between the aforementioned components.
Optionally, referring to fig. 6, the terminal device 30 may further comprise a first memory 34. The first memory 34 is used for storing computer instructions for executing the inventive arrangements and is controlled for execution by the first processor 31. The first processor 31 is configured to execute computer instructions stored in the first memory 34, thereby implementing the information transmission method provided by the embodiment of the present invention.
Referring to fig. 6, the first memory 34 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (random access memory, RAM) or other type of dynamic storage device that can store information and instructions, or an electrically erasable programmable read-only memory (electrically erasable programmable read-only memory, EEPROM), a compact disc read-only memory (compact disc read-only memory) or other optical disk storage, optical disk storage (including compact disc, laser disc, optical disc, digital versatile disc, blu-ray disc, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer, but is not limited thereto. The first memory 34 may be stand alone and be connected to the first processor 31 by a communication line 33. The first memory 34 may also be integrated with the first processor 31.
Alternatively, the computer instructions in the embodiments of the present invention may be referred to as application program codes, which are not limited in particular.
In a specific implementation, as an embodiment, referring to fig. 6, the first processor 31 may include one or more CPUs, referring to CPU0 and CPU1 in fig. 6.
In a specific implementation, as an embodiment, referring to fig. 6, the terminal device 30 may include a plurality of first processors 31, referring to the first processor 31 and the second processor 35 in fig. 6. Each of these processors may be a single-core processor or a multi-core processor.
Fig. 7 is a schematic structural diagram of a chip according to an embodiment of the present invention. Referring to fig. 7, the chip 40 includes one or more (including two) processors 41 and a communication interface 42.
Optionally, referring to fig. 7, the chip 40 further includes a second memory 43, and the second memory 43 may include a read only memory and a random access memory, and provides operation instructions and data to the processor 41. A portion of the memory may also include non-volatile random access memory (non-volatile random access memory, NVRAM).
In some embodiments, referring to FIG. 7, the second memory 43 stores elements, execution modules or data structures, or a subset thereof, or an extended set thereof.
In an embodiment of the present invention, referring to fig. 7, processor 41 performs the corresponding operation by calling the operation instruction stored in the memory (which may be stored in the operating system).
Referring to fig. 7, the processor 41 controls the processing operation of any one of the terminal devices, and the processor 41 may also be referred to as a central processing unit (central processing unit, CPU).
Referring to fig. 7, the second memory 43 may include a read only memory and a random access memory, and provides instructions and data to the processor 41. A portion of the second memory 43 may also include NVRAM. Such as a memory, a communication interface, and a memory coupled together by a bus system that may include a power bus, a control bus, a status signal bus, etc., in addition to a data bus. But for clarity of illustration the various buses are labeled as bus system 44 in fig. 7.
The method disclosed by the embodiment of the invention can be applied to a processor or realized by the processor. The processor may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware in a processor or by instructions in the form of software. The processor may be a general purpose processor, a digital signal processor (digital signal processing, DSP), an ASIC, an off-the-shelf programmable gate array (field-programmable gate array, FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components. The disclosed methods, steps, and logic blocks in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be embodied directly in the execution of a hardware decoding processor, or in the execution of a combination of hardware and software modules in a decoding processor. The software modules may be located in a random access memory, flash memory, read only memory, programmable read only memory, or electrically erasable programmable memory, registers, etc. as well known in the art. The storage medium is located in a memory, and the processor reads the information in the memory and, in combination with its hardware, performs the steps of the above method.
The embodiment of the invention also provides a computer readable storage medium. The computer readable storage medium has stored therein instructions which, when executed, implement the functions performed by the terminal device in the above-described embodiments.
In the above embodiments, it may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product described above includes one or more computer programs or instructions. When the above-described computer program or instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present invention are performed in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, a terminal, a user equipment, or other programmable device. The computer program or instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center by wired or wireless means. The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that integrates one or more available media. The usable medium may be a magnetic medium such as a floppy disk, hard disk, magnetic tape; optical media, such as digital video discs (digital video disc, DVD); but also semiconductor media such as solid state disks (solid state drive, SSD).
Although the invention is described herein in connection with various embodiments, other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps, and the "a" or "an" does not exclude a plurality. A single processor or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
Although the invention has been described in connection with specific features and embodiments thereof, it will be apparent that various modifications and combinations can be made without departing from the spirit and scope of the invention. Accordingly, the specification and drawings are merely exemplary illustrations of the present invention as defined in the appended claims and are considered to cover any and all modifications, variations, combinations, or equivalents that fall within the scope of the invention. It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Thus, it is intended that the present invention also include such modifications and alterations insofar as they come within the scope of the appended claims or the equivalents thereof.
Claims (10)
1. An information transmission method, comprising:
acquiring image information and non-image information at the same moment;
determining a fusion image according to the image information and the non-image information;
transmitting the fusion image, and determining the fusion image after transmission;
determining the transmitted image information and the transmitted non-image information according to the transmitted fusion image;
wherein the transmitted image information and the transmitted non-image information are information at the same time.
2. The information transmission method according to claim 1, wherein when the image in the image information includes one channel;
the determining a fusion image according to the image information and the non-image information comprises the following steps:
acquiring a channel of an image in the image information;
the non-image information is embedded in the one channel to determine the fused image.
3. The information transmission method according to claim 1, wherein when an image in the image information includes a plurality of channels;
the determining a fusion image according to the image information and the non-image information comprises the following steps:
acquiring a first channel and other channels of an image in the image information;
and embedding the non-image information into the first channel, wherein the rest channels are all set with preset values so as to determine the fusion image.
4. The information transmission method according to claim 1, wherein when an image in the image information includes a plurality of channels;
the determining a fusion image according to the image information and the non-image information comprises the following steps:
acquiring a plurality of channels of images in the image information;
and embedding the non-image information into at least two channels, and setting preset values for the rest channels so as to determine the fusion image.
5. The information transmission method according to claim 3, wherein the image in the image information has a height and a width;
the embedding the non-image information into the first channel, the remaining channels each set a preset value to determine the fused image, includes:
embedding the non-image information into the first channel along the width direction of the image, wherein the rest channels are all set with preset values so as to determine the fusion image; and/or the number of the groups of groups,
and embedding the non-image information into the first channel along the height direction of the image, wherein the rest channels are all set with preset values so as to determine the fusion image.
6. The information transmission method according to claim 1, wherein the image information has a larger amount of data than the non-image information.
7. The information transmission method according to claim 1, wherein the transmitting the fused image, determining the fused image after transmission, comprises:
and transmitting the fusion image based on a 5G network, and determining the fusion image after transmission.
8. The information transmission method according to claim 1, wherein when the information transmission method is applied to unmanned aerial vehicle information transmission, the image information includes camera image information, and the non-image information includes pan-tilt attitude information, unmanned aerial vehicle position information, and unmanned aerial vehicle attitude information; the camera and the cradle head are both arranged on the unmanned aerial vehicle.
9. An information transmission apparatus, characterized in that the information transmission apparatus comprises: a processor and a communication interface coupled to the processor for executing a computer program or instructions to implement the information transmission method according to any one of claims 1 to 8.
10. A chip having stored therein instructions which, when executed, cause the information transmission method of any one of claims 1 to 8 to be performed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310406734.9A CN116527783A (en) | 2023-04-17 | 2023-04-17 | Information transmission method, information transmission device and chip |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310406734.9A CN116527783A (en) | 2023-04-17 | 2023-04-17 | Information transmission method, information transmission device and chip |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116527783A true CN116527783A (en) | 2023-08-01 |
Family
ID=87405744
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310406734.9A Pending CN116527783A (en) | 2023-04-17 | 2023-04-17 | Information transmission method, information transmission device and chip |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116527783A (en) |
-
2023
- 2023-04-17 CN CN202310406734.9A patent/CN116527783A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10366548B2 (en) | Unmanned aerial vehicle communications methods and systems | |
| US10755498B2 (en) | Drive recorder | |
| CN107924636B (en) | Moving object recognition system and recognition method | |
| CN106650705B (en) | Region labeling method and device and electronic equipment | |
| US20190369613A1 (en) | Electronic device and method for controlling multiple drones | |
| US11394917B2 (en) | Image processing method and device for aerial camera, and unmanned aerial vehicle | |
| CN109817022B (en) | Method, terminal, automobile and system for acquiring position of target object | |
| JP6073951B2 (en) | Drive recording system having communication module and drive recording method | |
| EP3681129A1 (en) | Fpga based data acquisition card, data acquisition system and data acquisition method | |
| WO2020259524A1 (en) | Robot obstacle avoidance method, apparatus, and system | |
| US20210117107A1 (en) | Method for storing uav system log and uav image transmission system | |
| CN109871385B (en) | Method and apparatus for processing data | |
| KR20200063136A (en) | Planning methods for mapping sample points, devices, control terminals and storage media | |
| WO2020155037A1 (en) | Multi-load multi-path image transmission method, control system and terminal, and unmanned aerial vehicle and server | |
| US20210373556A1 (en) | Method and apparatus for data transmission | |
| CN106394918A (en) | Unmanned aerial vehicle carried panorama camera system and operation method thereof | |
| CN116527783A (en) | Information transmission method, information transmission device and chip | |
| US11620913B2 (en) | Movable object application framework | |
| US11431255B2 (en) | Analysis system, analysis method, and program storage medium | |
| CN110967036A (en) | Test method and device for navigation product | |
| CN112586007B (en) | Data processing method and device, vehicle-side equipment, cloud server and electronic equipment | |
| EP4054172A1 (en) | Zoom method and device, aircraft, flight system and storage medium | |
| KR20210066042A (en) | Drone based aerial photography measurement device | |
| KR101611789B1 (en) | Road surface visualization by motion parameter analysis | |
| CN107247463A (en) | A kind of unmanned aerial vehicle station system for supporting self-defined map to access |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |