GB2500296A - Determining intended aspect ratio for display of video - Google Patents

Determining intended aspect ratio for display of video Download PDF

Info

Publication number
GB2500296A
GB2500296A GB1300733.1A GB201300733A GB2500296A GB 2500296 A GB2500296 A GB 2500296A GB 201300733 A GB201300733 A GB 201300733A GB 2500296 A GB2500296 A GB 2500296A
Authority
GB
United Kingdom
Prior art keywords
ratio
detected
image
video
block
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB1300733.1A
Other versions
GB2500296B (en
GB201300733D0 (en
Inventor
Michael James Knee
Maurice Snell
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Snell Advanced Media Ltd
Original Assignee
Snell Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Snell Ltd filed Critical Snell Ltd
Publication of GB201300733D0 publication Critical patent/GB201300733D0/en
Publication of GB2500296A publication Critical patent/GB2500296A/en
Application granted granted Critical
Publication of GB2500296B publication Critical patent/GB2500296B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/01Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0112Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level one of the standards corresponding to a cinematograph film standard
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/003Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
    • G09G5/005Adapting incoming signals to the display format of the display terminal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/01Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • H04N7/0117Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
    • H04N7/0122Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal the input and the output signals having different aspect ratios

Abstract

The intended display aspect-ratio for video is determined automatically by analyzing an image to identify image blocks resulting from prior block-based processing of the video; comparing horizontal and vertical dimensions of those image blocks with horizontal and vertical dimensions of the image, with black border regions excluded as necessary; and determining from that comparison a display aspect ratio for the video.

Description

-1 -
DETERMINING ASPECT RATIO FOR DISPLAY OF VIDEO FIELD OF INVENTION
This invention concerns analysis of digitally coded television images. BACKGROUND OF THE INVENTION
Most standard interfaces for digital television signals do not require that the aspect-5 ratio (width to height ratio) of the displayed image is directly specified. In the absence of such a specification the aspect ratio is usually inferred from the context in which the data is presented, or from the spatial resolution of the image. For example, 'standard-definition' television is often assumed to have an aspect-ratio of 4:3; and, 'high-definition' television is often assumed to have an aspect-ratio of 10 16:9. Some image coding standards avoid this ambiguity by specifying that 'the pixels are square'. That is to say that the horizontal and vertical spatial sampling frequencies are equal, and so the aspect ratio is equal to the ratio of the number of samples per active television line to the number of active lines per frame.
It is common for television images to be modified in 'aspect-ratio conversion' 15 devices during the video production and editing process; this can give rise to ambiguity as to the intended ratio. These devices typically apply spatial scaling to the image. When an image is to be displayed on a display device that has an aspect-ratio different from that intended for the image data, there are two common alternative procedures that can be applied:
20 Blank pixels, comprising a 'black-band' or other uniform blank border (or two bands at opposite edges of the image), can be added to increase the image width or height so that the size of the image is increased (in one direction) to match the size of the display.
Pixels can be removed, or 'cropped' from one edge (or two opposite edges) of the 25 image to reduce the image width or height to match the size of the display.
A number of methods of including an aspect-ratio definition in a video data-stream are in common use and have been standardized by bodies such as the SMPTE and ETSI. The inclusion of this 'metadata' with the image data enables processing equipment and display devices to adapt their mode of operation according to the 30 aspect-ratio of the images being displayed or processed. However, the complexity of many image processing, video content production and distribution processes is
-2-
such that errors can occur, leading to incorrect processing; and, such errors are often introduced by incorrect metadata.
Of course images can be checked by human observation, but this is neither economic nor practical in typical, large-scale television playout centers. There is 5 thus a need for an automatic means of verifying that image data is appropriately scaled for the intended display, and that any aspect-ratio metadata associated with a video data stream accurately reflects the actual aspect-ratio of the respective image data. Where black-bands have been introduced, it can be inferred that the intended display has a different aspect ratio from the one for which the image data 10 was originally intended. The position of the band, or bands, indicates the direction of aspect-ratio change. Measurement of the width of bands enables the magnitude of the change to be calculated.
European patent application EP 2107 521 discloses how a border region in an image can be identified; and, European patent EP 1 744 565 discloses how image 15 data can be analyzed to detect black areas. These methods can be used to detect the presence of black-bands automatically, and this information can compared with metadata accompanying image data to assess the likely accuracy of that metadata.
However, where the image has been cropped in order to change its aspect-ratio these methods cannot be used. The present invention addresses this problem.
20 In this specification two exemplary aspect ratios -16:9 and 4:3 - will be considered; the skilled reader will, of course, appreciate that there are other aspect ratios in use, and that the concepts described here are applicable to other ratios and combinations of ratios.
SUMMARY OF THE INVENTION 25 The invention consists in a method and apparatus for determining the intended display aspect-ratio for video data, in which the said video data is analyzed to detect the block dimensions used in prior block-based processing of that data, and the result of said analysis is used to determine the said intended display aspect-ratio.
30 Suitably, the detected block dimensions are compared with expected block dimensions for the said video data and: a narrower intended aspect-ratio is determined when the detected blocks are wider than expected; and, a wider
-3-
intended aspect-ratio is determined when the detected blocks are higher than expected.
In some embodiments an original image spatial sampling format is detected: the number of samples per active line of the said original image format may be 5 detected; or the number of television lines per frame of the said original image may be detected.
In some embodiments the said image data is analyzed to detect the presence of one or more blank borders and a detected border parameter is used to determine the said intended display aspect ratio.
10 Metadata may be derived from the video data and, in a preferred embodiment, derived metadata is compared with other metadata associated with the said video data.
In another aspect, the invention consists in a method of determining a display aspect ratio for video, comprising the steps of analyzing an image to identify image 15 blocks resulting from prior block-based processing of the video; comparing horizontal and vertical dimensions of said image blocks with horizontal and vertical dimensions of the image; and determining from said comparison a display aspect ratio for the video.
BRIEF DESCRIPTION OF THE DRAWINGS 20 An example of the invention will now be described with reference to the drawings in which:
Figure 1 shows a block diagram of a video process.
Figure 2 shows aspect-ratio conversion of images by cropping Figure 3 shows a block diagram of a video monitoring process according to 25 an embodiment of the invention.
DETAILED DESCRIPTION OF THE INVENTION
In modern video production and distribution, images are handled as compressed data streams wherever possible. Figure 1 shows a small part of a typical video process. Compressed video data (1) is to be modified in a process (2) that converts 30 it to a different format. This may include aspect-ratio conversion or standards conversion, and may be part of live playout operation, or a non-real-time "re-purposing" process that will create a video file for subsequent distribution. These re-scaling and re-sampling processes are virtually impossible to carry out in the
-4-
compressed video domain, and so a compression decoder (3) converts the compressed video data (1) to a conventionally-sampled stream of pixel values prior to the process (2). The output (4) from the process is typically compressed again in a compression coder (5), to give a compressed video output for distribution (6). 5 This output may be sent to a transmission network or a video file server.
Typically, block-based transform coding according to one of the MPEG family of standards is used for the compression. In block-based processing each frame is divided into equally sized rectangular regions, or blocks. Different coding decisions, for example different quantizations of transform coefficients, are applied to different 10 blocks of the same frame. These different coding decisions lead to different coding artifacts in different blocks. Although these artifacts are usually imperceptibly small, the resulting changes in video quality between adjacent blocks can be detected by analysis of the decoded video signal.
US Patent No. 8,094,967 and International Patent Application W02007/125286 15 disclose methods and apparatus for determining the horizontal and vertical block size corresponding to earlier block-based processing of video signals or data by detecting the transitions between the blocks. In the present invention block size measurement, such as described in this prior patent, is used to infer the intended aspect-ratio of an image. In the system of Figure 1 a block size measurement 20 carried out on the uncompressed video output (4) from the conversion process (2) can be used to determine how the aspect-ratio has been modified in the process (2). And, as will be explained below, additional information about the image format of the compressed video data (1) can be obtained.
Figure 2a shows how a 16:9 aspect-ratio image (21) can be converted to a 4:3 25 aspect-ratio image (22) by the removal of image-edge regions (23) and (24).
Figure 2b shows how a 4:3 aspect-ratio image (25) can be converted to a 16:9 aspect-ratio image (26) by the removal of image-edge regions (27) and (28).
When images are compression coded the active image area is divided into a number of equally sized blocks; typically the blocks are eight pixels wide and eight 30 television lines high. In the examples shown in Figure 2, the images are sampled at a spatial resolution of 720 pixels per active picture width and 576 lines per active picture height.
In Figure 2a, the 16:9 image (21) is 90 blocks wide because 720 h- 8 is 90. In the aspect-ratio conversion process the edge regions (23) and (24), which together
-5-
comprise one quarter of the blocks on each line, are removed; the remaining image (22) comprises 67.5 blocks per line. This is re-scaled in the aspect ratio conversion process to an active picture width of 720 pixels. Thus the block width in the 4:3 image (22) is 720 -h 67.5, that is to say 10.667 pixels.
5 In Figure 2b, the 4:3 image (25) is 72 blocks high because 576 -e- 8 is 72. In the aspect-ratio conversion process the edge regions (27) and (28), which together comprise one quarter of the rows of blocks, are removed; the remaining image (26) comprises 54 rows of blocks. This is re-scaled in the aspect ratio conversion process to an active picture height of 576 lines. Thus the block height in the 16:9 10 image (26) is 576 + 54, that is to say 10.667 lines. Note that the cropping of the images has led to an increase in the block size in the direction of crop.
As mentioned previously, the conversion process (2) of Figure 1 is likely to include standards conversion, which will typically involve spatial re-sampling of the image. At a point of measurement the spatial sampling structure of the image being 15 measured is known, but the sampling structure at the point of compression coding may be unknown. However, because there are only a limited number of commonly-used combinations of aspect-ratio and sampling format, the block-size measurement usually enables both the original spatial sampling format and the original aspect-ratio to be determined.
20 The following tables show, for four common image formats, how a measured block height and block width can be used to infer the format and aspect ratio at the point of compression.
Table 1 applies to (nominally) 525-line standard definition images, spatially sampled with 480 active lines per frame, each active line comprising 720 pixels. 25 This image format was historically defined to have an aspect ratio of 4:3, but is also now used to carry 16:9 images.
Table 2 applies to (nominally) 625-line standard definition images, spatially sampled with 576 active lines per frame, each active line comprising 720 pixels. This image format was historically defined to have an aspect ratio of 4:3, but is also 30 now used to carry 16:9 images.
Table 3 applies to 720-active-line per frame high-definition images, each active line comprising 1280 pixels. This image format is conventionally defined to have an aspect ratio of 16:9.
-6-
Table 4 applies to 1080-active-line per frame high-definition images, each active line comprising 1920 pixels. This image format is conventionally defined to have an aspect ratio of 16:9.
Table 1 - Measurement of 480 Active Line, 720 Pixels per Active Line Images 5 (Note this table typically applies to '525-line' standard-definition images)
Measured Block Width (pixel pitches)
Measured Block
Height
(TV lines)
Conclusion (Aspect-Ratio)
10.667
[67.5 blocks per line]
8
[60 blocks per picture height]
4:3
[16:9 Source with 480 active lines of 720 pixels]
10.667
[67.5 blocks per line]
6.667
[72 blocks per picture height]
4:3
[16:9 Source with 576 active lines of 720 pixels]
8
[90 blocks per line]
10.667
[45 blocks per picture height]
16:9
[4:3 source with 480 active lines of 720 pixels]
8
[90 blocks per line]
8.889
[54 blocks per picture height]
16:9
[4:3 source with 576 active lines of 720 pixels]
8
[90 blocks per line]
6.667
[72 blocks per picture height]
Unknown, but same as source [Source had 576 active lines of 720 pixels]
8
[90 blocks per line]
8
[60 blocks per picture height]
Unknown, but same as source [Source had 480 active lines of 720 pixels]
6
[120 blocks per line]
5.333
[90 blocks per picture height]
4:3
[16:9 Source had 1280 active lines of 720 pixels]
5.333
[135 blocks per line]
3.556
[135 blocks per picture height]
4:3
[16:9 Source had 1080 active lines of 1440 pixels]
4.5
[160 blocks per line]
5.333
[90 blocks per picture height]
16:9
[16:9 Source had 1280 active lines of 720 pixels]
4
[180 blocks per line]
3.556
[135 blocks per picture height]
Unknown
[16:9 Source had 1080 active lines, either 1440 pixels or 1920 pixels]
3
[240 blocks per line]
3.556
[135 blocks per picture height]
16:9
[16:9 Source had 1080 active lines of 1920 pixels]
-7-
Table 2 - Measurement of 576 Active Line, 720 Pixels per Active Line Images (Note this table typically applies to '625-line' standard-definition images)
Measured Block Width (pixel pitches)
Measured Block
Height
(TV lines)
Conclusion (Aspect-Ratio)
10.667
[67.5 blocks per line]
9.60
[60 blocks per picture height]
4:3
[16:9 Source with 480 active lines of 720 pixels]
10.667
[67.5 blocks per line]
8
[72 blocks per picture height]
4:3
[16:9 Source with 576 active lines of 720 pixels]
8
[90 blocks per line]
12.80
[45 blocks per picture height]
16:9
[4:3 source with 480 active lines of 720 pixels]
8
[90 blocks per line]
10.67
[54 blocks per picture height]
16:9
[4:3 source with 576 active lines of 720 pixels]
8
[90 blocks per line]
9.60
[60 blocks per picture height]
Unknown, but same as source [Source had 480 active lines of 720 pixels]
8
[90 blocks per line]
8
[72 blocks per picture height]
Unknown, but same as source [Source had 576 active lines of 720 pixels]
6
[120 blocks per line]
6.40
[90 blocks per picture height]
4:3
[16:9 Source had 1280 active lines of 720 pixels]
5.333
[135 blocks per line]
4.27
[135 blocks per picture height]
4:3
[16:9 Source had 1080 active lines of 1440 pixels]
4.5
[160 blocks per line]
6.40
[90 blocks per picture height]
16:9
[16:9 Source had 1280 active lines of 720 pixels]
4
[180 blocks per line]
4.267
[135 blocks per picture height]
Unknown
[16:9 Source had 1080 active lines of 1440 or 1920 pixels]
3
[240 blocks per line]
4.267
16:9
[16:9 Source had 1080 active lines of 1920 pixels]
-8-
Table 3 - Measurement of 720 Active Line, 1280 Pixels per Active Line Images (Note that this is a high-definition format, and so a 16:9 aspect-ratio can be assumed. The measurement characterizes the source.)
Measured Block Width (pixel pitches)
Measured Block
Height
(TV lines)
Conclusion
(Source Aspect-Ratio)
14.222
[90 blocks per line]
16
[45 blocks per picture height]
4:3
[Source had 480 active lines of 720 pixels]
14.222
[90 blocks per line]
13.333
[54 blocks per picture height]
4:3
[Source had 576 active lines of 720 pixels]
14.222
[90 blocks per line]
12
[60 blocks per picture height]
16:9
[Source had 480 active lines of 720 pixels]
14.222
[90 blocks per line]
10
[72 blocks per picture height]
16:9
[Source had 576 active lines of 720 pixels]
8
[160 blocks per line]
8
[60 blocks per picture height]
16:9
[Source had 720 active lines of 1280 pixels]
7.111
[180 blocks per line]
5.33
[135 blocks per picture height]
16:9
[Source had 1080 active lines of 1440 pixels]
5.333
[240 blocks per line]
5.333
[135 blocks per picture height]
16:9
[Source had 1080 active lines of 1920 pixels]
-9-
Table 4 - Measurement of 1080 Active Line, 1920 Pixels per Active Line Images (Note that this is a high-definition format, and so a 16:9 aspect-ratio can be assumed. The measurement characterizes the source.)
Measured Block Width (pixel pitches)
Measured Block
Height
(TV lines)
Conclusion
(Source Aspect-Ratio)
21.333
[90 blocks per line]
24
[45 blocks per picture height]
4:3
[Source had 480 active lines of 720 pixels]
21.333
[90 blocks per line]
20
[54 blocks per picture height]
4:3
[Source had 576 active lines of 720 pixels]
21.333
[90 blocks per line]
18
[60 blocks per picture height]
16:9
[Source had 480 active lines of 720 pixels]
21.333
[90 blocks per line]
15
[72 blocks per picture height]
16:9
[Source had 576 active lines of 720 pixels]
12
[160 blocks per line]
12
[90 blocks per picture height]
16:9
[Source had 720 active lines of 1280 pixels]
10.667
[180 blocks per line]
8
[135 blocks per picture height]
16:9
[Source had 1080 active lines of 1440 pixels]
8
[240 blocks per line]
8
[135 blocks per picture height]
16:9
[Source had 1080 active lines of 1920 pixels]
5 The above tables make use of the standardized characteristics of commonly-used image formats to infer the intended aspect-ratio from the measured block size. The tables assume that any aspect ratio conversion has been achieved by cropping the image in the manner illustrated in Figure 1.
It is assumed that the source was processed with a blocks eight source pixels wide 10 and eight source lines high. Detection of the positions of the edges of these blocks in the measured image enables vertical and horizontal re-scaling to be detected, because re-scaled blocks will not be both eight pixels wide and eight lines high in the rescaled image. Where the same sampling structure can be used with different aspect ratios, as is the case for standard-definitions formats, there can be 15 ambiguity. In these cases some other information is required in order to determine the aspect ratio.
Where the measured block width corresponds to more than eight pixels, it can be concluded that the image has been horizontally enlarged. If the number of pixels
- 10-
per active line has not been increased in proportion to the enlargement then some part(s) of the image will have been lost. This is indicative of cropping of the image to fit a narrower intended aspect-ratio.
Where the measured block width corresponds to less than eight pixels, it can be 5 concluded that the image has been horizontally reduced. If the image still fills the frame horizontally, then the rescaling factor and hence the original number of pixels per line can be computed.
Where the measured block height corresponds to more than eight lines, it can be concluded that the image has been vertically enlarged. If the number of lines per 10 frame has not been increased in proportion to the enlargement then some part(s) of the image will have been lost. This is indicative of cropping of the image to fit a wider intended aspect-ratio.
Where the measured block height corresponds to less than eight lines, it can be concluded that the image has been vertically reduced. If the image still fills the 15 frame vertically, then the rescaling factor, and hence the original number of lines per frame can be computed.
A broadcast-plant monitoring system according to an embodiment of the invention is shown in Figure 3. Uncompressed video data (300), and associated metadata (301) that describes, at least, the intended display aspect ratio of the video data 20 (300), are input to the system. A format detection block (302) determines the width of the image represented by the video data (300) in pixels, and its height in television lines. As the skilled reader will appreciate, if the image data (300)
contains timing reference signals according to one the well-known family of digital video interface standards such as ITU-R Recommendation 656, the width of the 25 image may be determined by counting the number of samples between digital horizontal blanking (H) transitions, and the height of the image may be determined by counting the number of lines between the digital vertical blanking (V) transitions.
A block width measurement process (303) determines the block width, and a block height measurement process (304) determines the block height, of prior block-30 based processing of the video data (300). These measurements may use the method described in International Patent Application W02007/125286, or some other method that detects the residue of block-based processing. One alternative is to calculate differences between pixels and then to sum those differences over the height and width of the image or a region of the image. An artifact of block based
-11 -
processing is that a pixel difference taken across two blocks is likely to be higher than that taken within a block. By looking for maxima in these sums of pixel differences and fitting those maxima to a regular array, measurements of block width and block height can be generated.
5 A left/right border measurement process (305) detects any blank borders at the side, and a top/bottom border measurement process (306) detects any blank borders at the top or bottom, of the image represented by the video data (300). These measurements may use one or both of the methods described in European patent application EP 2 107 521 and European Patent EP 1 744 565 or some other 10 method that identifies blank regions at the edge of an image.
An aspect-ratio look-up-table (307) uses the image height and width outputs from the format detection block (32), the block size measurements from the block width measurement (303) and the block height measurement (304) to determine the likely intended display aspect-ratio of the video data (300). This image height and width 15 enable one of the above Tables relating block size to aspect ratio to be selected, and the aspect-ratio corresponding to the measured block-size is then input to an aspect-ratio logic block (308), which determines the correct aspect ratio for the video data (300).
The aspect-ratio logic block (308) makes use of information about blank borders 20 from the border measurement processes (305) and (306), and the output of the aspect-ratio look-up-table (307) to determine the intended aspect ratio. If there are no blank borders the aspect ratio output from the aspect-ratio look-up-table (307) will correspond to the intended ratio for the image. However, if any blank side borders are detected, the intended aspect-ratio can be assumed to be 16:9; and, if 25 any top or bottom borders are detected the intended aspect-ratio can be assumed to be 4:3.
The intended aspect ratio from the aspect-ratio logic block (308) is expressed in a suitable metadata format and compared, in a metadata comparison block (309),
with the input metadata (301) associated with the image data (300). If a difference 30 is found between the aspect ratio determined by aspect-ratio logic block (308) and the aspect-ratio described by the metadata (301), a warning or alarm (310) is output from the metadata comparison block (309).
The above description of the operation of the aspect-ratio logic block (308), in which the information from block size measurement is not used if borders are
- 12-
detected, represents the simplest implementation. However, if resources permit, it can be helpful to check that the block size measurement is consistent with the aspect-ratio determined from border detection.
If one or both top/bottom borders are detected, the block width should be eight 5 pixels if there has been no change to the number of pixels per active line.
If one or both left/right borders are detected, the block height should be eight lines if there has been not change to the number of lines per frame.
If one or both of the above bulleted paragraphs is found to be untrue, then an alarm or warning could be output to indicate that incorrect aspect-ratio modification may 10 have been applied.
Image parameters other than the intended aspect-ratio can be determined. It can be seen from the above Tables 1 to 4 that the original number of samples per active line and number of active lines per frame can often be determined from the block size measurement, and this additional metadata can be output.
15 In the above description it has been assumed that the measurements are made at the uncompressed output from a format and/or aspect ratio conversion process, e.g. the point (4) in Figure 1. It may also be necessary to determine the intended aspect ratio at a later point in a transmission or distribution chain where the modified video data has been compressed, i.e. the compressed video distribution 20 (6) from the system of Figure 1.
In this case, block edge detection systems will locate the blocks of the (second) compression coder (5). However, if the original coder's blocks are not aligned with those of the compression coder (5), two sets of block edges will be found. Fortunately, because the compressed data is available, the locations of the 'new' 25 blocks will be known and these block edges can be ignored in the block size measurement. Of course, due allowance must be made for the possibility that some block edges due to the two compression (or other block-based) processes may coincide.
Note that any convenient method of measuring block size can be used. The block 30 edges may be detected, or the horizontal and vertical spatial frequency components of the block structure may be detected and used to compute the distance, in pixels or lines, between adjacent blocks.
-13-
Images may be up- or down-sampled for analysis and the measured block or border sizes scaled to compensate for this up- or down-sampling.
It will be understood that this invention has been described by way of example only and that a wide variety of modifications or substitutions are possible without 5 departing from the scope of the invention as claimed are possible. The use of a block size of 8 by 8 is commonplace but the skilled man will understand that this invention can by implemented with logic representing other block sizes. Such logic will readily be derived by analogy with the tables and other discussions above.

Claims (11)

- 14- C LAI MS
1. A method for determining the intended display aspect-ratio for video data in which the said video data is analysed to detect the block size used in prior block-based processing of that data and the result of said analysis is used to determine the said intended display aspect-ratio.
2. A method according to Claim 1 in which the detected block width is compared with an expected block width for the said video data.
3. A method according to Claim 2 in which a narrower intended aspect-ratio is determined when the detected blocks are wider than expected.
4. A method according to Claim 1 in which the detected block height is compared with an expected block height for the said video data.
5. A method according to Claim 4 in which a wider intended aspect-ratio is determined when the detected blocks are higher than expected.
6. A method according to any previous claim in which an original image spatial sampling format is detected.
7. A method according to Claim 6 in which the number of samples per active line of the said original image format is detected.
8. A method according to Claim 6 in which the number of television lines per frame of the said original image is detected.
9. A method according to any preceding claim in which the said image data is analysed to detect the presence of one or more blank borders and a detected border parameter is used to determine the said intended display aspect ratio.
10. A method of monitoring a video process in which metadata derived according to any preceding claim is output.
11. A method of monitoring a video process in which metadata derived according to any preceding claim is compared with other metadata associated with the said video data.
12
13
14
15
16
17
18
19
20
21
22
23
24
-15-
Apparatus for determining the intended display aspect-ratio for video data in which the said video data is analysed to detect the block size used in prior block-based processing of that data and the result of said analysis is used to determine the said intended display aspect-ratio.
Apparatus according to Claim 12 in which the detected block width is compared with an expected block width for the said video data.
Apparatus according to Claim 13 in which a narrower intended aspect-ratio is determined when the detected blocks are wider than expected.
Apparatus according to Claim 12 in which the detected block height is compared with an expected block height for the said video data.
Apparatus according to Claim 15 in which a wider intended aspect-ratio is determined when the detected blocks are higher than expected.
Apparatus according to any of Claims 12 to 16 in which an original image format is detected.
Apparatus according to Claim 17 in which the number of samples per active line of the said original image format is detected.
Apparatus according to Claim 17 in which the number of television lines per frame of the said original image is detected.
Apparatus according to any of Claim 12 to 19 in which the said image data is analysed to detect the presence of one or more blank borders and a detected border parameter is used to determine the said intended display aspect ratio.
Apparatus for monitoring a video process in which metadata derived according to any of Claims 12 to 20 is output.
Apparatus for monitoring a video process in which metadata derived according to any of Claims 12 to 20 is compared with other metadata associated with the said video data.
Programmable apparatus programmed to implement a method according to any one of Claims 1 to 11.
A computer program product adapted to cause programmable apparatus to implement a method according to any one of Claims 1 to 11.
-16-
A method for determining in a video processor a display aspect-ratio for video in the form of a sequence of images, comprising the steps of analyzing an image to identify image blocks resulting from prior block-based processing of the video; comparing horizontal and vertical dimensions of said image blocks with horizontal and vertical dimensions of the image; and determining from said comparison a display aspect ratio for the video.
GB1300733.1A 2012-01-16 2013-01-15 Determining aspect ratio for display of video Active GB2500296B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GBGB1200654.0A GB201200654D0 (en) 2012-01-16 2012-01-16 Determining aspect ratio for display of video

Publications (3)

Publication Number Publication Date
GB201300733D0 GB201300733D0 (en) 2013-02-27
GB2500296A true GB2500296A (en) 2013-09-18
GB2500296B GB2500296B (en) 2018-10-31

Family

ID=45814047

Family Applications (2)

Application Number Title Priority Date Filing Date
GBGB1200654.0A Ceased GB201200654D0 (en) 2012-01-16 2012-01-16 Determining aspect ratio for display of video
GB1300733.1A Active GB2500296B (en) 2012-01-16 2013-01-15 Determining aspect ratio for display of video

Family Applications Before (1)

Application Number Title Priority Date Filing Date
GBGB1200654.0A Ceased GB201200654D0 (en) 2012-01-16 2012-01-16 Determining aspect ratio for display of video

Country Status (2)

Country Link
US (1) US8908093B2 (en)
GB (2) GB201200654D0 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104113745A (en) * 2013-04-17 2014-10-22 咏传电子科技(上海)有限公司 Display device and image display method thereof
AU2018217336A1 (en) * 2018-08-17 2020-03-05 Canon Kabushiki Kaisha Method, apparatus and system for encoding and decoding a transformed block of video samples
CN112135057B (en) * 2020-09-28 2021-09-21 北海天下为星科技有限公司 Video image processing method and system

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040114049A1 (en) * 2002-12-12 2004-06-17 Jitesh Arora System for detecting aspect ratio and method thereof
US20070201833A1 (en) * 2006-02-17 2007-08-30 Apple Inc. Interface for defining aperture

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5699123A (en) * 1993-10-20 1997-12-16 Victor Company Of Japan, Ltd. Television receiver with an adjustable frame size
US20040071211A1 (en) * 1997-04-07 2004-04-15 Kinya Washino Video production system with mixed frame removal
US20060017843A1 (en) * 2004-07-20 2006-01-26 Fang Shi Method and apparatus for frame rate up conversion with multiple reference frames and variable block sizes
JP4859219B2 (en) * 2006-09-07 2012-01-25 キヤノン株式会社 Video output apparatus and control method thereof
US8843983B2 (en) * 2009-12-10 2014-09-23 Google Inc. Video decomposition and recomposition
US8873642B2 (en) * 2010-12-22 2014-10-28 Verizon Patent And Licensing Inc. Video content analysis methods and systems

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040114049A1 (en) * 2002-12-12 2004-06-17 Jitesh Arora System for detecting aspect ratio and method thereof
US20070201833A1 (en) * 2006-02-17 2007-08-30 Apple Inc. Interface for defining aperture

Also Published As

Publication number Publication date
US20130194493A1 (en) 2013-08-01
US8908093B2 (en) 2014-12-09
GB2500296B (en) 2018-10-31
GB201200654D0 (en) 2012-02-29
GB201300733D0 (en) 2013-02-27

Similar Documents

Publication Publication Date Title
KR101725167B1 (en) Methods and systems for image registration
EP2107521B1 (en) Detecting a border region in an image
EP2105023A2 (en) Banding artifact detection in digital video content
US8023765B2 (en) Block noise removal device
US7869665B2 (en) Composite method and apparatus for adjusting image resolution
KR101156117B1 (en) Apparatus and method for detecting video
US8908093B2 (en) Determining aspect ratio for display of video
EP2137977A2 (en) Systems and methods for measuring loss of detail in a video codec block
US9818178B1 (en) Method and system for detection of ghosting artifact in a video
CN101815222B (en) Video color bar detecting method and device
US20100246990A1 (en) System and method for measuring blockiness level in compressed digital video
EP2226761B1 (en) Methods and systems for filtering a digital signal
US20060218619A1 (en) Block artifacts detection
US20070040944A1 (en) Apparatus and method for correcting color error by adaptively filtering chrominance signals
EP2599311B1 (en) Block compression artifact detection in digital video signals
US20070160301A1 (en) Method and apparatus for spatial compression scheme
US20040037361A1 (en) Video block error sensing by detection of shapes in output
WO2015059782A1 (en) Image inspection method and sound inspection method
KR100689890B1 (en) method for detecting defects in a light-related plate element for a flat panel
JPH0383474A (en) Car detector
Hurst I Can See Clearly Now: A New Test Pattern for the Digital Age
CN1902927A (en) Arrangement for generating a 3:2 pull-down switch-off signal for a video compression encoder
CN115063399A (en) Image mosaic detection method based on double rectangular characteristic analysis
JP2001326869A (en) Device simultaneously displaying video signal and analysis result of the video signal
KR20120027630A (en) Method for measuring movement speed of interlace image format