WO2018222094A1 - Procédé et système de surveillance de la fonctionnalité d'une liaison vidéo d'un aéronef à un objet - Google Patents

Procédé et système de surveillance de la fonctionnalité d'une liaison vidéo d'un aéronef à un objet Download PDF

Info

Publication number
WO2018222094A1
WO2018222094A1 PCT/SE2017/050577 SE2017050577W WO2018222094A1 WO 2018222094 A1 WO2018222094 A1 WO 2018222094A1 SE 2017050577 W SE2017050577 W SE 2017050577W WO 2018222094 A1 WO2018222094 A1 WO 2018222094A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
region
aircraft
image
video image
Prior art date
Application number
PCT/SE2017/050577
Other languages
English (en)
Original Assignee
Saab Ab
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Saab Ab filed Critical Saab Ab
Priority to PCT/SE2017/050577 priority Critical patent/WO2018222094A1/fr
Publication of WO2018222094A1 publication Critical patent/WO2018222094A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/89—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/214—Specialised server platform, e.g. server located in an airplane, hotel, hospital
    • H04N21/2146—Specialised server platform, e.g. server located in an airplane, hotel, hospital located in mass transportation means, e.g. aircraft, train or bus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41422—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance located in transportation means, e.g. personal vehicle
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • H04N7/185—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control

Definitions

  • the present invention relates to a method and a system for surveying the functionality of a video link from an aircraft to an object.
  • the present invention further relates to a computer program product and to a computer-readable storage medium.
  • Unmanned aerial vehicles UAV
  • UAV Unmanned aerial vehicles
  • a way to operate aerial vehicles is to equip the aerial vehicle with a camera arrangement or any other image sensor(s).
  • the images from the aerial vehicle are then transferred to an object at a remote place which is not aboard the vehicle via a video link.
  • This allows operating the aerial vehicle from the remote place, or any other remote place, based on the images from the aircraft received via the video link.
  • a person on the ground can act as a remote pilot for the aerial vehicle and control the vehicle based on the received images.
  • the video link comprises a video compression and transmission system aboard the aircraft.
  • the video compression and transmission system is arranged to provide and/or receive video images, to compress the provided and/or received video images, and to transmit the compressed video images to the object via the video link.
  • the object is equipped with a video decoder system which is arranged to decode the compressed video images which are transmitted from the aircraft.
  • the method comprises the following step of transmitting an uncompressed region of a video image from the aircraft to the object.
  • the method further comprises the step of comparing the transmitted uncompressed region of the video image with a corresponding decoded region of the video image, wherein the decoded region has been compressed and transmitted via the compression and transmission system aboard the aircraft.
  • the method even further comprises the step of deciding whether the video link functions properly based on the result of said comparing.
  • the video link is a FPV video link.
  • the step of comparing comprises the step of determining whether the uncompressed region and the corresponding decoded region show the same picture. This further increases the safety as a wrong picture might cause the operator to base decisions on wrong facts without realising it.
  • the step of comparing the transmitted uncompressed region of the video image with a corresponding decoded region of the video image comprises the step of determining a difference map between the uncompressed region and the corresponding decoded region.
  • the step of comparing the transmitted uncompressed region of the video image with a corresponding decoded region of the video image further comprises the step of determining whether the sum of all differences of the difference map is below a predetermined threshold. This allows for a relatively easy implementation of the comparison step. Further such an implementation can be performed comparably fast.
  • the step of comparing the transmitted uncompressed region of the video image with a corresponding decoded region of the video image further comprises the step of determining whether the number of pixels that differ more than a pre-determined noise level from the original image is less than a pre-defined threshold. This also allows for a relatively easy implementation of the comparison step. Further such an implementation can also be performed comparably fast.
  • the uncompressed region is transmitted via the video link. This also allows for an easy implementation as no additional link is needed.
  • the steps of the method are repeated after each n:th video image, wherein n is a natural number larger than one, preferably larger than five, even more preferably larger than ten. This allows for saving bandwidth, while at the same time not negatively affecting safety too much.
  • the position of the region of the video image differs when the steps of the method are repeated. This further increases the safety.
  • the deciding whether the video link functions properly is also based on whether the sum of all differences of the difference map is below a pre-determined threshold for a pre-determined number of repetitions of the steps of the method, and potentially whether the number of pixels that differ more than a pre-determined noise level from the original image is less than a pre-defined threshold for a pre-determined number of repetitions of the steps of the method. This provides avoiding or at least reducing false alarms.
  • the region of the video image is smaller than a quarter of the video image, preferably smaller than a tenth of the video image. This allows for saving bandwidth.
  • the method further comprises the step of indicating to an operator the result of deciding whether the video link functions properly. This further increases the safety.
  • the uncompressed region of the video image corresponds to an integer number of codeblock sizes of the compressed video image. This allows for an easy
  • a system for surveying the functionality of a video link from an aircraft to an object comprises a video compression and transmission system aboard the aircraft.
  • the video compression and transmission system is arranged to provide and/or receive video images, to compress the provided and/or received video images, and to transmit the compressed video images to the object via the video link.
  • the object is equipped with a video decoder system which is arranged to decode the compressed video images which are transmitted from the aircraft.
  • the system for surveying comprises a transmission circuit adapted to transmit an uncompressed region of a video image from the aircraft to the object.
  • the system further comprises a comparator circuit adapted to compare the transmitted uncompressed region of the video image with a corresponding decoded region of the video image, wherein the decoded region has been compressed and transmitted via the compression and transmission system aboard the aircraft.
  • the system even further comprises a decision circuit adapted to decide whether the video link functions properly based on the result of the comparing.
  • the system further comprises an indicator unit adapted to indicate to an operator the result of deciding whether the video link functions properly.
  • At least some of the objects are also achieved by a computer program product comprising instructions which, when the program is executed by a computer, cause the computer to carry out the method according to the present disclosure.
  • At least some of the objects are also achieved by a computer-readable storage medium comprising instructions which, when executed by a computer, cause the computer to carry out the method of the present disclosure.
  • the system, the computer program product, and the computer-readable storage medium show the advantages which are described in relation to the method of the present disclosure.
  • Fig. 1 depicts schematically a situation in which the present disclosure can be used.
  • Fig. 2 depicts schematically an embodiment of a system according to the present disclosure.
  • Fig. 3a depicts schematically an image which might be provided from an imaging system aboard an aerial vehicle.
  • Fig. 3b, 4a, and 4b each schematically explains an aspect of an example of the present disclosure.
  • Fig. 5a, b schematically explains how the safety can be improved by the present disclosure.
  • Fig. 6 shows schematically a flowchart of a method according to the present disclosure.
  • video or “image” can refer to the representation of the video or image in a data format. Thus the video or image does not need to be visible but can as well refer to data which can be converted into a video or an image.
  • Fig. 1 depicts schematically a situation in which the present disclosure can be used.
  • An aerial vehicle 10 is depicted.
  • the aerial vehicle can be any kind of aerial vehicles, such as, for example, an aeroplane, a helicopter, an unmanned aerial vehicle, UAV, a missile, a rocket, a glider, or the like.
  • UAV aeroplane
  • UAV unmanned aerial vehicle
  • UAV missile
  • rocket rocket
  • glider a glider
  • the aircraft 10 can be manned or unmanned.
  • advantages of the present disclosure regarding safety for unmanned aerial vehicles might be easy to understand from the present disclosure, the same advantages will apply for manned aircrafts.
  • the aerial vehicle 10 is arranged to send data 30 via a video link to an object 20.
  • the object 20 is at a remote place from the aircraft 10.
  • the object 20 can be land-borne, sea-based, or air- based.
  • the object 20 can be any object being arranged to receive data 30 from the video link. Examples of the object 20 are a second aircraft, different from aircraft 10, a ground control station, an airport tower, a vessel, a land-based vehicle, a wearable or movable operator device, or the like.
  • the data 30 comprises video data, i.e. data representing video images.
  • the video data can comprise plain video images.
  • the video data can comprise any kind of data which can be converted into video images.
  • the video data can comprise any kind of encoded and/or compressed video data.
  • the data 30 can also comprise additional data, such as control data or any other kind of data.
  • the video link is depicted as a one-way video link from the aircraft 10 to the object 20. This is, however, not a prerequisite.
  • the video link can equally well be, for example, two-ways, broadcast, or the like.
  • the aircraft 10 is replaced by a remote object, such as a remote tower or the like.
  • a remote object such as a remote tower or the like.
  • the remote object is placed at a distance of more than 100 m, more than 1 km, or more than 10 km from the object 20.
  • Fig. 2 depicts schematically embodiments of a system 100 according to the present disclosure. It should be noted that not all depicted components are necessary for all embodiments of the system.
  • the system 100 is a system for surveying the functionality of a video link from an aircraft to an object.
  • the system 100 can comprise an imaging system 110.
  • the imaging system 110 is preferably aboard the aircraft.
  • the imaging system 110 can be arranged to provide images from the surrounding of the aircraft.
  • the imaging system 110 can comprise a camera arrangement.
  • the camera arrangement can comprise one or several cameras.
  • the imaging system 110 can comprise at least one sensor.
  • the at least one sensor can be arranged to provide images.
  • the imaging system 110 can operate at any wavelength, such as visible light, infrared, ultraviolet, or the like.
  • the imaging system 110 is arranged to provide the images in a data format or to convert the images in a data format.
  • the imaging system 110 is arranged to provide said images repeatedly.
  • the rate at which the images are provided repeatedly can vary. In one example the rate is several times per second. In one example the rate is around once per second.
  • the system 100 comprises a video compression and transmission system 120.
  • the video and transmission system 120 is arranged aboard the aircraft 10.
  • the video compression and transmission system 120 is arranged to provide and/or receive video images.
  • the video images are received from the imaging system 110.
  • the video compression and transmission system 120 is arranged to compress the provided and/or received video images. Compressing video images is well known in the art and therefore not discussed any further here. It should, however, be stressed that the present disclosure in principle works with any kind of compression for images or video images.
  • An example of a possible compression is a video compression algorithm based on H.264.
  • An example of a possible compression is a video compression algorithm based on intra frames, l-frames, such as H.264 l-frames.
  • the compression is a lossy compression. This is especially advantageous if the data bandwidth for video links from the aircraft to the ground typically does not allow transmitting video images at a desired rate with a desired resolution at lossless compression. However, under certain circumstances or with further technical developments regarding data transmission in the future the compression can be lossless in one example.
  • the video compression and transmission system 120 can comprise a processing unit (not shown in the figure). In one example, the processing unit performs the compression.
  • the video compression and transmission system 120 is part of a video link 190 between the aircraft and the object.
  • the video compression and transmission system 120 is arranged to transmit the compressed video images to the object via the video link 190.
  • the video compression and transmission system 120 comprises a transmitter (not shown in the figure).
  • the transmitter can be a data transmitter.
  • said transmitter is arranged to transmit the compressed video image via the video link 190.
  • the system 100 further comprises a video decoder system 130.
  • the video decoder system 130 is arranged at the object 20.
  • the video decoder system 130 is arranged to decode the compressed video images which are transmitted from the aircraft.
  • the video decoder system 130 can comprise a processing unit (not shown). In one example the processing performs the decoding.
  • the video link 190 can comprise a receiving unit (not shown).
  • the receiving unit can be a separate unit or being comprised in the video decoder system 130.
  • the receiving unit and/or the video decoder system 130 can be arranged to receive the compressed video images from the video compression and transmission system 120.
  • the system 100 further comprises a transmission circuit adapted to transmit an uncompressed region of a video image from the aircraft to the object.
  • the uncompressed region of a video image is an uncompressed region of one of the video images which are transmitted from the aircraft to the object via the video link 190. How the region can be chosen and how the video image can be chosen will be explained in further detail in relation to Fig. 3b and Fig. 6.
  • the transmission circuit can be located outside the video link 190, such as in the form of an additional transmitter (not shown in the figure).
  • the transmission circuit adapted to transmit an uncompressed region can be the video compression and transmission system 120.
  • the transmission circuit adapted to transmit an uncompressed region is a transmitter of the video compression and transmission system 120.
  • the transmission of the uncompressed region is depicted by an extra line outside the video link 190, as will be further explained in relation to Fig.
  • the system 100 further comprises a comparator circuit 140 adapted to compare the transmitted uncompressed region of the video image with a corresponding decoded region of the video image, wherein the decoded region has been compressed and transmitted via the compression and transmission system 120 aboard the aircraft 10.
  • the comparator circuit 140 can, for example, comprise a processing unit.
  • the comparator circuit 140 is arranged to receive the transmitted uncompressed region of the video image.
  • the comparator circuit 140 is arranged to receive the corresponding decoded region of the video image.
  • the corresponding decoded region is preferably received from the decoder system 130. More details regarding the comparing are explained in relation to the following figures.
  • the system 100 further comprises a decision circuit adapted to decide whether the video link functions properly based on the result of said comparing (not shown in the figure). How the deciding is performed is explained in more detail in relation to Fig. 6.
  • the decision circuit adapted to decide whether the video link functions properly based on the result of said comparing can comprise a processing unit.
  • the decision circuit adapted to decide whether the video link functions properly and the comparator circuit 140 can be comprised in a common unit, such as a common processing unit.
  • the system 100 can comprise an indicator unit 150 adapted to indicate to an operator the result of deciding whether the video link functions properly. In one embodiment the indicator unit 150 indicates the result visually. In one embodiment the indicator unit 150 indicates the result acoustically. In one embodiment the indicator unit 150 is a tactile circuit for indicating the result.
  • the indicator unit 150 can comprise any of a display, a lamp, a speaker, a vibrating element, a screen, or the like.
  • Fig. 3a depicts schematically an image 200 which might be provided from an imaging system aboard an aerial vehicle.
  • the image 200 will usually be coloured.
  • any kind of images is possible, such as black/white images, grey-scale images, or images with any other colour coding.
  • the shown example indicates the lights of a runway as they might be seen from a pilot when trying to approach the runway for landing.
  • the image 200 is an example of what kind of images might be provided from the aircraft and transmitted via the video link.
  • the lights of a runway are depicted for explaining the principle of the invention in a manner easily understandable even in a black/white representation. It should, however, be emphasised that the present disclosure easily well can be applied when flying the aircraft without being involved in a start and/or landing process.
  • Fig. 3b depicts the same image 200 as in Fig. 3a. Further, a region 210 of the image is depicted.
  • This is an example of an uncompressed region of the image which is transmitted from the aircraft to the object in connection with the present disclosure.
  • the uncompressed region is a different section of the image in consecutive runs of a method according to the present disclosure. This is indicated by the arrow 220, indicating that the region 210 is swept over the image 200 on consecutive runs of the method according to the present disclosure. It should, however, be emphasised that any other sweeping path than the indicated arrow 220 is possible as well. It is also possible to make the uncompressed region "jump" through the image 200.
  • Fig. 4a depicts the same image 200 as in Fig.
  • an example of an uncompressed region 240 is depicted in the figure. As can be seen, the example of an uncompressed region shows two lights in connection to the runway, one approximately in the middle of the uncompressed region and one close to the right border of the uncompressed region, however placed in the middle of the region in the vertical direction.
  • Fig. 4b depicts a second image 201 which differs from the image 200.
  • the second image 201 is an image as might be provided from the imaging system aboard an aerial vehicle at a later moment of time compared to the image 200. This might, for example, be the case when the aircraft has approached the runway a little bit further compared to the situation in the Fig. 3a- 4a.
  • An example of a second uncompressed region 241 is depicted in the figure. As can be seen, the example of an uncompressed region shows one light in connection to the runway, placed approximately in the lower left corner of the uncompressed region.
  • the uncompressed regions 240 and 241 show the same section of the images 200 and 201, respectively. However, due to the fact that the images scenery of the images 200 and 201 differs, also the scenery in the uncompressed regions 240 and 241 differs in the shown example.
  • Fig. 5a, b schematically explains how the safety can be improved by the present disclosure.
  • the second image 201 as depicted in relation to Fig. 4b is provided aboard the aircraft and intended to be transmitted via the video link to an object.
  • the second image 201 is compressed at the video compression and transmission system 120.
  • the second image 201 is further decoded at the video decoder system 130.
  • an uncompressed region of the second image 201 is transmitted.
  • the uncompressed region is shown in Fig. 5a.
  • the uncompressed region is the second uncompressed region 241 as shown in Fig. 4b.
  • the region of the image which has been decoded by the video decoder system 130 and which corresponds to the uncompressed region is also extracted.
  • the comparator circuit 140 do then compare the transmitted uncompressed region of the video image with a corresponding decoded region of the video image. As sketched in Fig. 5a, the transmitted uncompressed region of the video image and the corresponding decoded region of the video image are basically the same. It can then be decided that the video link functions properly since the comparison reveals that the transmitted uncompressed region of the video image and the corresponding decoded region of the video image are basically the same.
  • the second image 201 is provided aboard the aircraft as in the previous figure. As in the previous picture, the second uncompressed region 241 of that second image is transmitted. However, in the situation of Fig. 5b the video compression and transmission system 120 does not work properly. As an example, the part of the compression and transmission system 120 responsible for the compression has been "frozen", i.e. no longer the actual image is compressed, but instead a previous image. In the shown example, the previous image 200 as shown in Fig. 3a-4a is compressed and transmitted instead of the actual second image 201. Consequently, the previous image 200 will also be decoded at the video decoder system 130.
  • the comparator circuit 140 does then compare the transmitted uncompressed region of the video image with a corresponding decoded region of the video image. However, since the decoded image is a different image than the image from which the uncompressed region of the video image 201 has been transmitted, the corresponding decoded region differs from the uncompressed region 241 of the video image. In the shown example, since the image which actually has been compressed is the image 200, the corresponding decoded region will be the region 240 which has been described in relation to Fig. 4a. The comparator circuit 140 does then compare the transmitted uncompressed region of the video image with the corresponding decoded region of the video image. As sketched in Fig.
  • the transmitted uncompressed region of the video image 241 and the corresponding decoded region 240 of the video image are not the same. It can then be decided that the video link does not function properly since the comparison reveals that the transmitted uncompressed region of the video image and the corresponding decoded region of the video image are not the same.
  • Fig. 6 shows schematically a flowchart of a method 600 according to the present disclosure.
  • the method 600 is a method for surveying the functionality of a video link from an aircraft to an object.
  • the video link comprises a video compression and transmission system aboard the aircraft.
  • the video compression and transmission system is arranged to provide and/or receive video images, to compress the provided and/or received video images, and to transmit the compressed video images to the object via the video link. This is described in further detail in relation to Fig. 2.
  • the compression used by the video compression and transmission system can be any kind of compression method, for example a compression method based on code-blocks.
  • the object is equipped with a video decoder system which is arranged to decode the compressed video images which are transmitted from the aircraft. This is also described in further detail in relation to Fig. 2.
  • the method starts with step 610.
  • step 610 an uncompressed region of a video image is transmitted from the aircraft to the object.
  • This transmission is in one example via the video link.
  • the transmission is performed via a different link.
  • the region of the video image is smaller than a quarter of the video image, preferably smaller than a tenth of the video image. Such an example is depicted in Fig. 3b-4b. It might often happen that the bandwidth of the video link is the limiting factor, which often is the reason why video compression is used.
  • uncompressed region of a video image is thus preferably not too big in data size in relation to the compressed video for not counteracting the savings achieved due to compression.
  • uncompressed region can be transmitted as a separate data stream and/or be integrated in the stream of the compressed video images, for example in the headers, or the like.
  • the uncompressed region of the video image corresponds to an integer number of codeblock sizes of the compressed video image.
  • This is especially advantageous in case the video images are compressed based on codeblock schemes. Since the decoding in this case usually is performed in codeblocks as well, having the uncompressed region of the video image corresponding to an integer number of codeblock sizes of the compressed video image allows later on comparing the uncompressed region with full codeblock(s), which facilitates comparison.
  • the method 600 can be repeated. When repeating the method, it is not necessary to perform step 610 for every video image which is transmitted via the video link. Instead, it might be advantageous to perform step 610 and the following steps only every n:th time a video image is transmitted. This allows saving bandwidth.
  • the position of the uncompressed region of the video image preferably differs when step 610 is repeated.
  • the position of the uncompressed region is swept over the video image, for example such as shown in Fig. 3b.
  • the next uncompressed region overlaps partly with the previous region.
  • the sweeping direction can be any kind of sweeping direction.
  • the position of the uncompressed region "jumps" over the video image.
  • Differing the uncompressed region has at least two advantages.
  • One advantage is that even failures of the video compression and transmission system 120 which only apply to a specific region of the video image can be detected. By moving the region this or these affected code- blocks will be detected.
  • parts of video images might look the same between consecutive video images for quite a long time.
  • region 210 in Fig. 3a-4b when kept at that place, might look the same for quite some time.
  • region will likely be completely black for quite some time, as indicated by the fact that this region still would be black when taken in Fig. 4b which is a video image later than Fig. 4a.
  • step 610 the method continues with step 620.
  • step 620 the transmitted uncompressed region of the video image is compared with a corresponding decoded region of the video image.
  • the decoded region has been compressed and transmitted via the compression and transmission system aboard the aircraft.
  • the comparison can be performed by the comparator circuit 140 which is described in relation to Fig. 2.
  • step 620 comprises step 621.
  • Step 622 comprises determining a difference map between the uncompressed region and the corresponding decoded region.
  • the concept of determining a difference map between two images is well known in the art and thus not described any further here.
  • the decoded region will nearly always look at least slightly different than the uncompressed region. This is due to the fact that some colour and/or detail information will usually get lost during lossy compression.
  • a difference map can indicate how much the uncompressed region and the decoded compressed region differ from each other. If the uncompressed region and the decoded compressed region represent the same video image the differences which appear in the difference map should be rather small.
  • step 620 comprises step 622.
  • step 622 it is determined whether the sum of all differences of the difference map is below a first pre-determined threshold.
  • the first predetermined threshold can be set depending on the compression method, compression settings, resolution, bandwidth of the video link, accuracy of compression and decoding, or the like.
  • step 620 comprises step 623.
  • step 623 it is determined whether the number of pixels that differ more than a pre-determined noise level from the original image are less than a second pre-defined threshold.
  • the second pre-determined threshold and/or the pre-determined noise level can be set depending on the compression method, compression settings, resolution, bandwidth of the video link, accuracy of compression and decoding, or the like.
  • step 620 comprises step 624.
  • step 624 it is determined whether the uncompressed region and the corresponding decoded region show the same picture. In one example it is concluded that the same picture is shown when the sum of all differences of the difference map is below the first pre-determined threshold. In case the same picture is shown the differences between the corresponding regions should be rather small and thus the sum of all differences in the difference map. In one example it is concluded that the regions show the same picture in case the sum of all differences is below the first threshold. In one example it is concluded that the regions do not show the same picture in case the sum of all differences is above the first threshold.
  • the same picture is shown based on whether the number of pixels that differ more than a pre-determined noise level from the original image are less than a second pre-defined threshold. If the same picture is shown, the number of pixels differing more than the pre-determined noise level from the original image should be rather limited. In one example it is concluded that the regions show the same picture in case the number of pixels that differ more than a pre-determined noise level from the original image is less than the second pre-defined threshold. In one example it is concluded that the regions do not show the same picture in case the number of pixels that differ more than a predetermined noise level from the original image is more than the second pre-defined threshold.
  • Difference maps are only examples of comparing images in step 620. Other methods are known in the art and might be applied additionally to any of steps 621-624 or instead of any of steps 621-624.
  • the method continues with step 630.
  • step 630 it is decided whether the video link functions properly based on the result of step 620. In one example it is concluded that the video link is not functioning properly if it has been concluded that the uncompressed region and the corresponding decoded region do not show the same picture. In one example it is concluded that the video link is not functioning properly if any of the compressed video image or the uncompressed region could not be received at comparison in step 620. In one example it is concluded that the video link is not functioning properly if any other error occurred during video compression, transmission, and/or decoding.
  • checksum(s) and/or sequence numbers can be applied to the transmitted video image, and/or the uncompressed region of the video image, and/or the compressed and/or decoded region of the video image. This assures that the correct images and/or regions thereof are compared and/or can be used to detect and/or identify additional errors in the functionality of the video link.
  • the advantage of the present disclosure is that not only the functioning of every component itself is monitored as in prior art, but also the interaction of all components. As an example, in case of "freezing", the compression itself, the transmission itself, and the decoding itself could still work properly. Thus monitoring the compression itself, the transmission itself, and the decoding itself, would not reveal an error.
  • the method according to the present disclosure would reveal such a "freezing", thereby increasing safety.
  • An operator usually immediately realises that a video link is not functioning properly in case no video is transmitted.
  • the video link does not functions properly even if images are still transmitted, for example as would be the case with "freezing".
  • Step 640 comprises indicating to an operator the result of deciding whether the video link functions properly. That indication can be acoustically, visually, via a tactile circuit, or via any combination thereof. In one example the indicating is performed via a warning sound. In one example the indicating is performed via a warning lamp, or a warning message, or any other warning indication on a screen or a display, which, for example, can be lighted permanently or in a blinking manner. In one example the video image from the aircraft can be shut off at a screen and/or display for an observer outside the aircraft when it is decided that the video link is not working properly. This has the advantage that an observer is not trying to rely on outdated images anyhow.
  • the latest available image for which it was concluded that the video link functions properly is displayed continuously, possible with an indication of time how old that image is. This has the advantage that an observer can try to perform security actions based on the latest available information which was concluded to be transmitted on a properly functioning video link.
  • the method ends after the optional step 640.
  • the method 600 can be repeated and is preferably performed repeatedly.
  • the steps of the method 600 are repeated after each n:th video image which is transmitted via the video link.
  • the number n is a natural number larger than one, preferably larger than five, even more preferably larger than ten. As discussed before, bandwidth constraints might limit the performance of the method to every n:th image.
  • the deciding whether the video link functions properly in step 640 is also based on whether the sum of all differences of the difference map is below a pre-determined threshold for a pre-determined number of repetitions of the steps of the method. In one example, the deciding whether the video link functions properly in step 640 is whether the number of pixels that differ more than a pre-determined noise level from the original image is less than a pre-defined threshold for a pre-determined number of repetitions of the steps of the method.
  • a single deviation such as a single occurrence of a value or a number being on the side of a threshold which indicates that the video link is not functioning properly, will not lead to the conclusion that the video link is not functioning properly.
  • the pre-determined number of repetitions can be determined based on the parameters of the system in use, especially on how often the parameters are expected to cause a false indication or the like.
  • the present disclosure also relates to a computer program product comprising instructions which, when the program is executed by a computer, cause the computer to carry out the method 600.
  • Said execution on a computer can be distributed among several physical units, such as the elements described in relation to Fig. 2.
  • the instructions of the computer program product might be executed by any of the processing units described in relation to Fig. 2.
  • the present disclosure also relates to a computer-readable storage medium comprising instructions which, when executed by a computer, cause the computer to carry out the method 600.
  • the computer-readable storage medium can be a non-volatile medium.
  • the corresponding elements of the system 100 can be arranged to perform any of the steps described in relation to the method 600.
  • the method 600 can also comprise any of the actions described in relation to the system 100.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Databases & Information Systems (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

La présente invention concerne un procédé (600) permettant de surveiller la fonctionnalité d'une liaison vidéo d'un aéronef à un objet. La liaison vidéo comprend un système de compression et de transmission vidéo à bord de l'aéronef. Le système de compression et de transmission vidéo est conçu pour fournir et/ou recevoir des images vidéo, pour compresser les images vidéo fournies et/ou reçues, et pour transmettre les images vidéo compressées à l'objet par l'intermédiaire de la liaison vidéo. L'objet est équipé d'un système de décodeur vidéo qui est conçu pour décoder les images vidéo compressées qui sont transmises à partir de l'aéronef. Le procédé comprend l'étape consistant à transmettre (610) une région non compressée d'une image vidéo de l'aéronef à l'objet. Le procédé comprend en outre l'étape consistant à comparer (620) la région non compressée transmise de l'image vidéo à une région décodée correspondante de l'image vidéo, la région décodée ayant été comprimée et transmise par l'intermédiaire du système de compression et de transmission à bord de l'aéronef. Le procédé comprend en outre l'étape consistant à décider (630) si la liaison vidéo fonctionne correctement sur la base du résultat de la comparaison. La présente invention concerne également un système, un produit-programme d'ordinateur et un support de stockage lisible par ordinateur.
PCT/SE2017/050577 2017-05-31 2017-05-31 Procédé et système de surveillance de la fonctionnalité d'une liaison vidéo d'un aéronef à un objet WO2018222094A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/SE2017/050577 WO2018222094A1 (fr) 2017-05-31 2017-05-31 Procédé et système de surveillance de la fonctionnalité d'une liaison vidéo d'un aéronef à un objet

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/SE2017/050577 WO2018222094A1 (fr) 2017-05-31 2017-05-31 Procédé et système de surveillance de la fonctionnalité d'une liaison vidéo d'un aéronef à un objet

Publications (1)

Publication Number Publication Date
WO2018222094A1 true WO2018222094A1 (fr) 2018-12-06

Family

ID=64455997

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SE2017/050577 WO2018222094A1 (fr) 2017-05-31 2017-05-31 Procédé et système de surveillance de la fonctionnalité d'une liaison vidéo d'un aéronef à un objet

Country Status (1)

Country Link
WO (1) WO2018222094A1 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6246435B1 (en) * 1998-09-08 2001-06-12 Tektronix, Inc. In-service realtime picture quality analysis
US6823009B1 (en) * 1997-10-06 2004-11-23 Teledifusion De France Method for evaluating the degradation of a video image introduced by a digital transmission and/or storage and/or coding system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6823009B1 (en) * 1997-10-06 2004-11-23 Teledifusion De France Method for evaluating the degradation of a video image introduced by a digital transmission and/or storage and/or coding system
US6246435B1 (en) * 1998-09-08 2001-06-12 Tektronix, Inc. In-service realtime picture quality analysis

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
BROWN M ET AL.: "Low-bit rate video codec parameter evaluation and optimization", MILITARY COMMUNICATIONS CONFERENCE, 18 October 2009 (2009-10-18), Piscataway, NJ, USA, pages 1 - 20, XP055558067, ISBN: 978-1-4244-5238-5 *
GUNAWAN I P ET AL.: "Efficient Reduced-Reference Video Quality Meter", IEEE TRANSACTIONS ON BROADCASTING, vol. 54, no. 3, 1 September 2008 (2008-09-01), PISCATAWAY, NJ, US, pages 669 - 679, XP055558062, ISSN: 0018-9316 *
WANG M ET AL.: "A very low complexity reduced reference video quality metric based on spatio-temporal information selection", IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP, 2015, pages 571 - 575, XP032826485, ISBN: 978-1-4799-8339-1 *
YAMADA T ET AL.: "Reduced-reference based video quality- metrics using representative-luminance values", January 2007 (2007-01-01), pages 1 - 5, XP055558072, Retrieved from the Internet <URL:https://www.researchgate.net/publication/228727048> [retrieved on 20180323] *

Similar Documents

Publication Publication Date Title
US10616480B2 (en) Method, system, device for video data transmission and photographing apparatus
US10571933B2 (en) Unmanned aerial vehicles
US10466697B2 (en) Monitoring control system, monitoring control device, and monitoring control method
US10338581B2 (en) Unmanned aerial vehicle, flight control method, non-transitory computer-readable recording medium, and control device
US10911750B2 (en) System and methods for feedback-based data transmission
US20200280698A1 (en) Image transmission method and apparatus for unmanned aerial vehicle
US20150139500A1 (en) Method and System for Optimizing Image Processing in Driver Assistance Systems
CN105144265A (zh) 滑行飞行器附近可视化系统和方法
US11511849B2 (en) Method of preparing a drone for takeoff, and an associated drone and preparation system
CN112703727A (zh) 具有监视数据管理的栓系无人机系统
WO2018222094A1 (fr) Procédé et système de surveillance de la fonctionnalité d&#39;une liaison vidéo d&#39;un aéronef à un objet
KR102056854B1 (ko) 아이피(ip) 비디오 월 시스템 및 이의 구동방법
KR101671641B1 (ko) Vr 기기를 이용한 원격 제어 시스템 및 방법
KR102056858B1 (ko) 아이피(ip) 비디오 월 시스템 및 이의 구동방법
EP3029942A1 (fr) Procédé et dispositif permettant d&#39;insérer une superposition graphique dans un flux vidéo
KR102140291B1 (ko) 자폭형 무인기의 제어를 위한 지상통제장비
KR101547927B1 (ko) 정찰 영상 공유 시스템
US20230066765A1 (en) Controlling devices in operations areas based on environmental states detected using machine learning
US10291878B2 (en) System and method for optical and laser-based counter intelligence, surveillance, and reconnaissance
EP4262222A1 (fr) Horodatage compressé dans un flux vidéo
CN114217631A (zh) 一种基于无人机的智能巡查系统、方法及存储介质
US20220176820A1 (en) Method for securing a vehicle comprising a display, electronic security device and associated computer program product
US20110276268A1 (en) Apparatus for Determining the Orientation of Vehicles
EP3244622A1 (fr) Système, codeur et décodeur pour la vérification de séquences d&#39;images
US11970285B2 (en) On-board emergency remote assistance and data retrievable system for an aerial vehicle

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17911588

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17911588

Country of ref document: EP

Kind code of ref document: A1