TW201244486A - Video coding and decoding devices and methods preserving PPG relevant information - Google Patents

Abstract

The present invention relates to a video encoding device (10, 10', 10'') and method for encoding video data and to a corresponding video decoding device (60, 60') and method. To preserve PPG relevant information after encoding without requiring a large amount of additional data for the video encoder output stream, the proposed video encoding device comprises a selection unit (20, 20') for selecting a region of interest (101) in input video data (100) providing a strong PPG signal, a first encoding unit (30, 30') for encoding said selected region of interest (101) of said input video data (100) according to a predetermined encoding scheme with a first setting of the encoding to preserve PPG-relevant information in the encoded region of interest, a second encoding unit (40, 40') for encoding remaining parts (103) of said input video data (100) according to said predetermined encoding scheme with a second setting of the encoding, and an encoder combination unit (50) for combining the encoded region of interest (102) and the encoded remaining parts (104) of said input video data into an encoder output video stream (105).

Description

201244486 VI. Description of the invention: [Technical field to which the invention pertains] A video encoding apparatus and method for storing PPG (light body corresponding video coding method, the present invention relates to a method for compiling video image description) The present invention relates to a video decoding device and a corresponding video decoding method for decoding encoded video data. Further, the present invention is directed to a video encoding system for encoding and decoding video data and to a computer program for implementing the methods. [Prior Art] The demand for technology solutions that provide powerful continuous monitoring of human physiological signals has increased. This demand is one of the reasons why younger generations are increasingly aware of the importance of a healthy and active lifestyle. In addition, the aging of the population due to the increase in average life expectancy has made it extremely urgent to have a health monitoring system that minimizes the disruption of a person's usual living activities. Non-interference monitoring of physiologically measured signals can be used to provide virtually instantaneous feedback to one of the physical and mental conditions at any time' and to assess changes in the health status of the person as quickly as possible. Conventional devices and methods for measuring physiological measurement signals (e.g., heart rate, respiration rate, blood pressure, skin oxygenation, etc.) require the user to wear an annoying body sensor' which may cause inconvenience to people's normal living activities. Therefore, in recent years, attempts have been made to develop a non-contact technique for remotely monitoring human life signals. Recently developed, it has been shown to implement interference-free remote monitoring by imaging sensors (network cameras) or broadcast video designed for users. In December 2008 Optics Express Volume 16 No. 20 ' Wim 161403.doc 201244486

A method for measuring skin color changes (referred to as light volume description imaging (PPG)) is described in "Remote pUthysmographic imaging using ambient Ught" by Verkruysse, Lars 〇. Svaasand and j stuart Nels〇n. This method is based on the principle that temporal changes in blood volume in the skin result in changes in light absorption by the skin. The video camera can record such changes by one of the images of a skin area (eg, face), while processing the average of the pixels of a manually selected area (usually the portion of the cheek in the system) by viewing the average The periodic changes in the signal can capture the heart rate and respiration rate. Known systems for remotely measuring heart rate or respiration rate signals are based on direct analysis of uncompressed, unprocessed video sequences following image sensing. In most "real life" applications, video sequences are stored or transmitted in a compressed form. The compression of the video signal assumes that some redundant (self-visual perception) information is removed. Unfortunately, information that is not important to video perception may be important for detecting physiological measurements. For example, the MPEG compression standard uses inter-frame predictions to slightly change the temporal information of a video signal. These changes make it more difficult or even impossible to detect temporal physiological measurements. However, the application of the video capture signal from a video is performed after the application of the video recording. In such cases, the compressed video will be processed. If a video is compressed at a high bit rate, the PPG related information can be stored in a coded bit stream. However, compressing a video with a low compression ratio will increase the size of a storage file or increase the transmission bandwidth. Therefore, it is necessary to save the information required for offline sampling of physiological signals during video recording and compression, in particular, according to one of the conventional video coding standards. 161403.doc 201244486 The mind-based video editing technology (such as MPEG2, MPEG4, H.264) achieves effective compression of video information by applying temporal prediction. Most of the frames in a video sequence (types B and P, B means that the "bidirectional prediction frame" 'P means "forward prediction frame") is encoded into an original frame and a motion compensated frame. The quantization difference between the frames (type B or P). Loss of some visual information due to quantification and motion prediction. Although this information is inconsequential from the visual perception, this information contains information that is important for taking physiological measurements (such as the heart 5^). Right, the video is compressed at a bit rate without applying temporal prediction and/or deblocking filter (H 264), then the ppG information can be saved in a video sequence. For example, 'only based on intra-frame coding. MjpEG or MJpEG2K can be applied to compress a video and save the PPG signal. However, coding within all frames does not provide a compression ratio for most multimedia applications. Therefore, there is a need in particular for a method and apparatus for permitting the use of standard lossy video compression techniques to compress video and to preserve the video information required to retrieve the ppG signal after decoding a video. [Invention] It is an object of the present invention to provide a method for A video encoding device and a corresponding video encoding method for encoding video data to save ppG related information without requiring a large amount of additional data. It is a further object of the present invention to provide a corresponding video decoding apparatus and method, a video encoding system, and a computer program for implementing the methods. In a first aspect of the present invention, a video encoding apparatus is provided, the video encoding apparatus comprising: 16I403.doc 201244486 • a selecting unit for selecting a region of interest in the input video material to provide a strong ppG signal; a first encoding unit for encoding the selected region of interest of the input video material (1〇〇) with a first encoding setting according to a predetermined encoding scheme to save PPG related information in the encoded region of interest a second encoding unit for encoding the remaining portion of the input video material with a second encoding setting according to the predetermined encoding scheme; and an encoder combining unit for the input video material The encoded region of interest and the encoded portions are combined into an encoder output video stream. In a further aspect of the present invention, a video decoding apparatus for decoding an encoded video stream is provided, the encoded video stream comprising encoded video data, which has been encoded according to a coding scheme. Setting to encode a region of interest of the input video material to store the ppG related information in the encoded region of interest, and encoding the remaining portion of the input video material with a second encoding setting according to the predetermined encoding scheme, the video decoding The apparatus comprises: a decoding unit for decoding the encoded region of interest according to a decoding scheme complementary to one of the encoding schemes used to encode the region of interest, and

The PPG is used to retrieve the PPG signal from the decoded region of interest. In the gait aspect of the present invention, a corresponding video encoding method, a corresponding bribery code method, a video encoding system, and a computer program including a code component are provided, the computer program causing the computer program to be executed on a computer 161403.doc 201244486 When the computer implements the proposed method step β defines a preferred embodiment of the present invention in the subsidiary technical solution. It should be understood that the claimed video decoding device, video coding system 'method and computer program have the claimed Video coding apparatus and similar and/or identical preferred embodiments as defined in the accompanying technical solutions. The present invention is based on the concept of encoding a selected region of interest containing one of the regions with PPG related information in order to store the ppG related information in the encoded video signal, the selected region of interest allowing the derivation of a strong PPG signal (specifically the 'strongest PPG') Signal), other areas of video data that are (ie, have no substantial loss of information about the pPG), should not (or even be) extract PPG signals from such other areas. Specifically, the local encoding parameter (generally 'one specific setting of the encoder') is set to encode the selected region of interest' and the one-bit budget can be allocated to one or more spatial images that are used to capture a PPG signal. The region (i.e., 'one or more regions of interest) provides an optimal compromise between the encoding (e.g., a compression ratio) and quality of the PPG signal captured from (at least in part) the decoded signal. The physiological measurement signal can be detected from the video sequence using the principle of optical volume description (PPG). For example, the video sequences are streamed or recorded as uncompressed from a video camera. As mentioned above, this observation is not always supported in practical applications. The present invention achieves the preservation of PPG visual information to capture PPG/physiometric signals' during a video compression (e.g., by a standard video encoder) while allowing compression at a low bit rate. Preferably, the present month allows a standard compatible coded bitstream to be generated 'for example, to be stored on a data carrier or on a transmission line (e.g., the Internet) or via a line 161403.doc 201244486 The system passes. In this context, the wording "PPG related information" should be understood as information relating to the acquisition of the - PPG signal. This ppG phase (4) message can be included in the human eye: information contained in the unrecognizable original video material, for example, a slight skin tone change in the human skin. In this context, the word "depression" generally means any (four) that can be obtained by analytic method analysis, such as temporal physiometry U, such as heart rate, cardiac cycle, respiratory rate, depth of anesthesia or hypovolemia. And high blood volume. . In the preferred embodiment, the 'encoding device further comprises: a region selection unit for selecting an area (10) in the input video material, - a skin region, as the region of interest, wherein the video material comprises a sequence of video a frame, the frames are divided into spatial blocks; and a block selection unit for determining; t the spatial blocks of the selected region, the determined spatial blocks representing the region of interest. In general, video data can be used as a sequence of video frames' and each frame is divided into (e.g., including 4x4U6xi6 pixel size) spatial blocks. Therefore, subsequent coding is performed according to this embodiment to find the best inter-block that is encoded by the coding unit. According to a step _step embodiment, the area selection unit includes: a detecting unit for detecting a potential useful area in the input video material as a group of interest areas, in particular, a skin area; An analysis unit for analyzing the set of detected potential useful areas and selecting an area as the area of interest based on one or more predetermined selection criteria. For example, the analysis unit can include a face and/or a skin detector for detecting video data (specifically, or multiple video frames 161403. Doc 201244486) The face and / or skin area. Therefore, preferably, the face or skin area is potentially useful. Preferably, the most stable (temporarily most stable) face and/or skin area is selected as the region of interest, but other selection criteria such as spatial size, illumination stability, and/or skin tone stability may also be used. For example, 'Robust Real-time Object Detection' by Paul Viola and Michael Jones (2nd Intern. Workshop 〇n Statistical and

This debt detector is described in Computational Theories of Vision, Vancouver, Canada, 2 0 01). In another embodiment, the analysis unit includes a PPG acquisition unit for extracting a ppG signal from the detected potentially useful regions and based on the quality of the retrieved PPG signals and / or content and select an area as the area of interest. Thus, the analysis unit can more fully anticipate which of these potentially useful areas will provide a strong PPG signal and will therefore select the region of interest accordingly. Preferably, the PPG capture unit is adapted to determine one or more parameters of the first encoding to be used by the first encoding unit to encode the selected region of interest based on the manipulated PPG signal and the first The coding unit is adapted to use the one or more parameters of the first coding setting for encoding the selected region of interest. Therefore, the result of the PPG capture will be used to control the encoding process for the selected region of interest to use the optimal encoder settings to achieve the best possible pp (3 signal) coding unit in the decoder. The parameters of the first setting may include a compression ratio, a block/field/frame block/field/frame or block/map/inter-frame coding mode, AC used One or more of the number of coefficients, the quantizer scale, the intra-frame coding Dc accuracy, and the I61403.doc -10- 201244486 custom quantizer matrix, etc. In an embodiment, the first coding unit is adapted to encode At least a chrominance component of the selected region of interest, in particular, only the chrominance components, and the second coding unit is adapted to encode the luma component of the selected region of interest and encode the chrominance of the remainder of the input video material Component and lightness component. This helps to reduce the amount of data used to encode the video data of the area of interest. Preferably, but not in general, only the chrominance component is selected and encoded. According to another embodiment, the first mother unit Adapted to borrow Encoding within the block to encode the selected region of interest, and the second coding unit is adapted to encode the remainder of the input video material by inter-block coding and/or intra-block coding. This provision is substantially lossless. In the case of coding the region of interest. Intra-block coding and inter-block coding are generally known techniques and are used, for example, in MPEG encoders for coding. Therefore, further details will not be described here, as this is familiar with The details are known to the skilled person. Further, in an embodiment, the first coding unit is adapted to encode only the regions of at least the chrominance components (specifically, only the chrominance components) of the selected region of interest. The inter-block coding block or the DC component of the intra-block coding block. In particular, if only the inter-block coding block of the chroma component or the DC component of the intra-block coding block is encoded, this further contributes Reduce the amount of data used to encode the region of interest. PPG-related information is generally carried by all pixels, but generally does not pay much attention to spatial information. Conversely, to improve the PPG signal in individual pixels (for example The heartbeat ratio is only required to obtain the average of as many pixels. The PPG related information/PPG signal is usually even smaller than the quantization step of an uncompressed 8-bit video signal. This average can be based on the DC component, 161403.doc - 11 - 201244486 and it is not absolutely necessary to know the individual pixel values, but this can be helpful in blocks containing skin and some other image parts (eg at the border of a face). Furthermore, in an embodiment, The selection unit is adapted to select two or more regions of interest in the input video material that provide a strong PPG signal (specifically, the strongest PPG signal), and the first coding unit is adapted to encode the selected regions of interest. Not only a single area of interest but also several areas of interest are available for evaluating and extracting ppG signals during decoding, which increases reliability. For example, in an embodiment, the PPG signal can be retrieved from each of the regions of interest, and thereafter it can be evaluated which ppG signal has the highest reliability or an average of all of the PPG signals can be obtained.

In an embodiment, in particular, a R〇I information may be generated by the selection unit, the ROI information including information about the location of the region of interest and which may be included in the output video data of the encoder. The decoding device can then use this ROI information to easily find the area of interest to decode and retrieve signals therefrom. During decoding, the video decoding device is capable of decoding at least the encoded region of interest from the decoder input view data and extracting a PPG signal from the decoded region of interest. For this purpose, the PPG capture uses, for example, as above about ppG. The generally known methods described in the papers mentioned herein or as described in other citations describing the basis of PPG. In a further embodiment, however, the decoding unit may also be adapted to, in particular, decode the complete video material in accordance with one of the encoding schemes complementary to the encoding scheme used during encoding. Because &, the encoding performed in the video encoding device must be adapted to ensure this decoding. I61403.doc 12 201244486 [Embodiment] These and other aspects of the present invention will be apparent from and elucidated with reference to the embodiments described below. BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a block diagram showing one of the first embodiment of a video encoding apparatus 1 according to the present invention. According to this embodiment, an original video stream 100 (also referred to as input video material) is provided to a selection unit 2, which selects one of the strong ppG signals in the input video data 1〇〇. The selected region of interest 101 is provided to a first encoding unit 30 for encoding the selected region of interest 101 with a first encoding in accordance with a predetermined encoding scheme. In parallel, a second encoding unit 4 编码 encodes the remaining portion 103 of the input video material 1 by a second encoding setting in accordance with the predetermined encoding scheme. In the encoder-combining unit 5, the encoded region of interest 1 〇 2 and the encoded remainder 丨〇 4 of the input video material (10) are encoded into an encoder output video stream 105.

Setting to encode the selected region of interest 101, substantially equal to the PPG included in the selected region of interest 101, by using the first aspect, to substantially encode the selected region of interest 101' without loss of at least related information This makes it possible to take a strong PPG signal from the selected area of interest in the decoding device. The remaining portion 输入3 of the input video material 1 is encoded separately by a second encoding setting (e.g., at a low bit rate or at least for the perception but at a bit rate that is less than one bit rate for the PPG). Figure 2 is a block diagram showing a first embodiment of a video decoding apparatus in accordance with the present invention. According to this embodiment, the decoded video stream 16 解码 is decoded. The encoded video stream 16〇 (in addition to the disturbance introduced during storage and/or 161403.doc •13-201244486 transmission) shall correspond to the encoder output video stream 105 and include the encoded video protocol a | ° The tribute 'the encoded video data includes the input video data 100, the level of the Ha 匕 匕 3 object eight area of interest 161 and the remaining part of the coded 162 ° video decoding device 60 sentence cup · ^ λ, ~ ~ first decoding unit 7 That is, it is used to decompress the encoded attention area 161 according to a decoding partner group 161 complementary to the coding scheme of the attention area 1 〇1 already encoded in the video coding system; and a PPG capture The unit 80 is configured to capture and decode the region of interest 163 to retrieve a ppG signal 164. For example, it is preferable to read the R〇I information contained in the video decoder input string 丨 丨 巟 160 or by image analysis (for example, # by inspection) The coordinates of the region of interest are obtained from the corresponding (10) information by discriminating the quantized level of the encoded region of interest and the encoded remaining region. Optionally, a separate unit 9 can be provided for separating the encoded region of interest 161 from the encoded remainder (8) or at least for inputting the video data from the decoder 16_ to the encoded region of interest (6). In addition, as needed, a second decoding unit 75 can be provided for decoding the encoded remainder 162 of the input video material in accordance with the decoding scheme, and then a decoder combining unit 95 can be provided for decoding the region of interest. 63 and the remaining portion of decoding 165 are combined into a decoder output video stream 66. Figure 6 shows a schematic block diagram of a second, simpler embodiment of a video decoding device 60 in accordance with the present invention. According to this embodiment, the input video stream 160 is not segmented as in the embodiment shown in FIG. First, in a common decoding unit 71, the decoded input video stream is then decoded at 161403.doc • 14-201244486. In the fl U67, the attention area i68 is selected in the -selection unit 72, and the -ppG signal 164 is taken from the "off" main area 168 by the PPG acquisition unit (10). Figure 3 shows a schematic block diagram of a second, more detailed embodiment of a video encoding device, in accordance with one of the present invention, including a selection unit 2, a preferred embodiment. Specifically, the selection unit 2 includes a region selection unit 21 for selecting a region 123 (specifically, a skin region) in the input video material 100 as a region of interest, where The video material includes a sequence of video frames that are divided into spatial blocks. Further, the menu TC2G includes a block selecting unit 24 for judging the space block 1G1 of the selected area 123, and the determined space block 101 represents the area of interest. In a further modification, as shown in FIG. 3, the region selection unit 21 includes a detection unit 22 for detecting a group of potential available regions 122 that are available as one of the regions of interest in the input video data (specific a skin area, and an analysis unit 23 for analyzing the set of detected potential useful areas 122 and selecting a region 123 as the region of interest 4 based on one or more predetermined selection criteria, followed by The block selection unit 24 determines the corresponding spatial block 101, which is then deducted by the first coding unit, and encodes the corresponding spatial blocks 1〇1 as described above. The detection of potentially useful areas is preferably adapted (in particular) to one of the available sides of the skin (4) and the face or skin area. Depending on a particular video content, the detected skin area may occupy a small portion of the video frame or an entire video frame. In the second case, for example, the use of intra-block coding to encode the entire detected skin area will result in a significant reduction in compression efficiency, I61403.doc •15·201244486. Furthermore, it is generally not the entire skin area that can be used to capture a PPG signal. For example, in a particular time period, only a small portion of one skin region is stable in time β so that only this portion of a skin region is applied to the PPG number capture. Therefore, the analysis unit 23 analyzes the detection unit. 22 selects the best portion of all skin regions detected in the videogram pivot and based on one or more of a number of criteria including spatial size 'temporal stability, illumination stability, and/or skin tone stability. Therefore, the 'analysis unit 23 preferably searches for the most stable face and/or skin area' because the stable areas should generally provide the strongest PPG signal. The unit 23 can select a minimum ROI that can provide a ppG signal. The expected intensity of a pPG signal can be analyzed by analyzing a spatial pixel uniformity within the ROI or by detecting a preferred facial region (e.g., forehead, cheek). The output of the analyzing unit 23 is information about one of the positions of the region of interest (for example, 'in the form of a ROI message'), and the information is supplied to the block selecting unit 24 to select the space region of the input video data belonging to the selected region of interest. Piece.

This information is especially needed when the video frame of the right input video material 100 is divided into spatial blocks (depending on the size of each of the 4 I 4 to 16 X16 pixels). The coordinates of the optimal skin area 123 are then provided by the analysis unit 23 to the block selection unit 24, which selects the block 101 having the best skin area, i.e., the block representing the selected area of interest. If several regions of interest are used, this provides the option to improve the ability to select the best PPG signal during PPG signal acquisition or the PPG I6I403.doc •16·201244486 signal average obtained from different regions. The compression of the selected skin region is accomplished in a manner that ensures that one of the PPG related information is saved after (and later) following the decoding/decompression. Most of the chrominance channels from a video stream capture the PPG signal 164 (see Figure 2). Therefore, in order to save the PPG related information, the block 1 〇 1 will be encoded into the intra-block coding block by the first coding unit 30'. For example, depending on the setting and type of the first encoding unit 40', other frame blocks 1 〇 3 (i.e., the remaining blocks) are encoded into inter-block encoding by the second encoding unit 40' by a standard encoder. Block or block intra-block coding, the video coding standard allows for intra-block or inter-block coding mode to be selected on a block basis. Therefore, the proposed algorithm will allow the generation of a standard compatible encoded bit stream 105 with saved PPG related information. The analysis unit 23 and the block selection unit 24 will find that the size of the desired skin region of the reliable ppG signal is between one of the large bit budgets of one of the intra-block codes attributed to the allocated skin region. The best compromise. In another embodiment, the analysis unit 23 may (optionally) include a clear signal 25 and possibly a PPG (four) metric to guide the selection of the skin region. An error-free temporal chromaticity is required to capture a PPG signal, as is provided in yet another embodiment, which can be achieved by encoding a chrominance block with a higher bit rate. Specifically, 'in the video encoding installation shown in FIG. 4', in another embodiment, the 'numbering code' (four) is adapted to at least (preferably only) encode the color of the selected area of interest ι〇ι Degree component 101a, and the second coding unit 40" is adapted to encode the selected region of interest 17 161403.doc

S 201244486 The luminance component of field 101 is 10 lb and is used to encode the chrominance component and the luma component of the remaining portion 103 of the input video material 1〇〇. In principle, inter-block coding can be used for chroma coding of selected blocks as long as the DC component is compressed without loss of information (no loss) and the quantization of the ac component introduces artifacts. The luma block can be encoded with loss of information because it contributes significantly less to the PPG acquisition process than the chroma component. According to yet another embodiment, only the chrominance components of the selected region of interest are encoded into intra-block coding blocks, or both chrominance components and luma components associated with the selected region of interest are encoded into intra-block coding blocks. In this embodiment, if a selected skin region (i.e., region of interest) does not move, then more bits will not need to be used to encode the block into intra-block coded blocks. However, if a skin area is selected for movement, no artifacts will be introduced to make this embodiment more effective. The proposed decoding procedure not only allows reconstruction of a video stream, e.g., according to a video encoding standard, but also captures a PPG signal from a portion of the decoded video stream (specifically, from the decoding region of interest). Figure 5 shows a second, more detailed embodiment of a video decoding device 6 in accordance with the present invention, which substantially corresponds to the complementary video encoding device 1' shown in Figure 3. In this embodiment, the decoder input video data 16 is provided to the first decoding unit 70 and the second decoding unit 75, both. Although the first decoding unit is substantially identical to the first decoding unit 7 described above and outputs the decoded off/main area 163, the second decoding unit 75 not only decodes the remaining area, but also decodes the meta-integrated decoder to input video data. 160 and the output complete lexicon 161403.doc -18· 201244486 outputs the video material 166, that is, all video data is decoded (eg, conventionally) in the second decoding unit 75'. Therefore, the standard procedure used to first decode the input bit stream is applied to the level captured by the coded block. Thereafter, the entire bit stream and/or intra-block coded blocks are further decoded. The coded blocks within these blocks correspond to the optimal skin area selected at the encoder side. In order to obtain the PPG signal 164, the PPG signal capturing unit 8A includes a block capturing unit 81. The block capturing unit 81 retrieves the first encoding unit 3 of the video encoding device 10 from the decoding attention area 163. The block of the area of interest coded by 〇ι. Then, by using a block information 181 provided by the block capture unit, the reconstruction unit 82 reconstructs the region of interest (e.g., one or more skin regions) from the intra-block coded block of the decoded region of interest. For example, if at least (preferably only) the chrominance component of the region of interest is decoded in the first decoding unit 70, the chrominance component of the region of interest is reconstructed in the reconstruction unit 82. The 'PPG signal manipulation algorithm is applied to the reconstructed region of interest 182 in a PPG number extraction unit 83 (for example, as long as the chrominance component is encoded without loss of ppG related information), the PPG signal acquisition algorithm The method applies only to the chrominance component) to finally obtain the desired PPG signal 164. In another embodiment of the video decoding device, if both the chrominance and the luma component have been encoded by the video encoding device into, for example, an intra-block coding block, the chrominance channel, the luma channel, or both may be used. The PPG signal 164 is taken. Therefore, the selection of the preferred embodiment of the video encoding device and the video decoding device can be completed based on the method for reconstructing the ppG signal. As mentioned, the PPG signal acquisition unit 83 detects and retrieves the PPG signal 164 from the reconstructed region of interest (e. g., 'reconstructed skin region). In principle, only re-constructed areas of interest are used to capture PPG signals. Therefore, it is not mandatory to decode a video sequence based on a full original resolution, but generally only the region of interest (e.g., the intra-block coding block) is sufficient to obtain the ppG k number. Therefore, if only the PPG signal needs to be captured but the video data is not completely decoded, the motion compensation of the coded blocks between all the blocks can be saved and the computational power originally required can be reconstructed.

The particular method and parameters used to retrieve the pPG k number can be defined and modified during decoding and acquisition of the PPG signal. In other words, the proposed video encoding device neither limits the selection of a PPG signal acquisition method nor limits the selection of the monitoring body to the β-denier encoding, and may process one by different PPG acquisition methods during or after decoding. Video sequences, and can capture different signs of life (eg, heart rate, heart rate variability, Sp〇2, respiration, ppG imaging, etc.) can be upgraded by the new PPG capture algorithm to promote video decoding devices that are advantageous for ppG, This will allow the PPG signal to be encoded in the encoded video sequence in a better manner. A standard video decoding device can also decode the same encoded video sequence without the embedded algorithm for capturing the PPG signal, thus maintaining the video with the existing video. Backtracking compatibility of the decoding device. If the standard codec used in the proposed scheme contains an in-loop deblocking filter to reduce coding artifacts, then at least the block associated with the selected region of interest should be Chroma component, disconnect this deblocking filter 161403.doc 201244486. Otherwise 'the in-loop deblocking filter can suppress the capture of the PPG signal to One of the necessary visual information. Using manual tuning parameters, the PPG capture algorithm can be immediate or non-instant. In addition, the present invention generally allows any particular method of selecting a physiological metering signal to be taken depending on the particular application after the video data has been recorded. Thus, the same video can be used to extract different physiological metering signals (eg, heart rate, heart rate variability, Sp02, respiration, ppg imaging). A video encoding device i〇m according to the present invention is schematically depicted in FIG. Yet another embodiment. This embodiment is quite similar to the embodiment of the video encoding device 10 shown in the figure, but further provides a decoding unit 35 in a feedback loop formed by the first encoding unit 3&quot; And a PPG signal acquisition list/0 36. The feedback loop controls the number of bits allocated to the selected attention area ι〇ι, that is, controls the encoding setting used to encode the selected attention area 1〇1 to ensure PPG related information It is stored in the encoded attention area 丨〇 2. Therefore, the decoding unit 35 decodes the encoded attention area 1〇2 (the application is complementary to the coding unit 30&quot; a decoding scheme of the first coding scheme), and the PPG signal acquisition unit 36 retrieves the _ppG signal 107 from the decoding region of interest 1〇6. Then, the first coding unit 30&quot; determines whether the PPG signal has sufficient quality or Whether it is necessary to change the settings used for encoding (for example, whether more bits need to be assigned to the encoded region of interest, and/or whether the compression ratio needs to be reduced) to improve the quality of the captured PPG signal. Therefore, a decoding can be ensured. One of the devices can capture a ppG signal of sufficient quality. Therefore, 'S is able to take life signs and clarify the known concept of modifying the SNR or quality scalability during video compression. The invention can be used to view 161403.doc -21 - 201244486 Streaming and compressing video material storage. Normally, a bit stream including only encoded video data will be transmitted or decompressed to obtain video data according to one of the basic qualities, in the same manner (ie, using a single-encoding scheme and the same encoding parameters) Set) encode all video data. According to the present invention, the additional data is included in the encoded bit string 8 of the ppG necessary information to be extracted from the physiological metering signal, and the encoded bit stream is transmitted or decompressed. In the way of Shibugu 4 -T and soil r~, the best compromise between compression efficiency and preservation of physiological measurement information in compressed video can be achieved. The invention of & and = allows the capture of the PPG signal following video compression (decompression). The complexity and accuracy of the PPG couching algorithm can be chosen based on the specific application. For example, some applications may need to only listen to heart rate information, while other applications may require a heartbeat intermittent accurate heartbeat signal, or/and a breath or/and Sp〇2 (oxygenation). In addition, the present invention allows for self-compressing video offline (non-immediate) couching of PPG signals, possibly with manual selection and tuning of optimal parameters. In general, the invention is not limited to a particular encoding/decoding scheme. In general, the loss of the first code used to encode one or more selected regions of interest is less than the second code used to encode the remaining data. In a particular embodiment, intra-block and/or inter-block coding is used to encode ppG-related visual information, while inter-frame coding is used to encode other visual information (which is not necessary for physiological metering signals). Therefore, it is achieved that the PPG information is quickly and cost-effectively captured from the intra-frame coding block during video decoding without decoding the complete video frame. The present invention has been illustrated and described in the drawings and the foregoing description, and the description and description are to be construed as illustrative or exemplary It is not limited to the disclosed embodiments. Other variations to the disclosed embodiments can be understood and effected by those skilled in the <RTIgt; </RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; In the context of the patent application, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude the plural. A single element or other unit may fulfill the functions of several items listed in the scope of the patent application. The mere fact that certain measures are recited in mutually different sub-claims does not mean that one of these measures may not be used in combination. A computer program can be stored/distributed on a non-transitory medium (such as an optical storage medium or a solid-state medium supplied from other hardware or as part of other hardware), i can also be distributed in other forms. Such as via a weekly network or other wired or wireless telecommunications system. Any reference signs in the scope of the claimed patent should not be construed as limiting. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a schematic block diagram showing one of the first embodiment of a video encoding apparatus according to the present invention, and FIG. 1 is not one of the first embodiment of a video decoding apparatus according to the present invention. FIG. 3 is a block diagram showing a second embodiment of a video encoding device according to the present invention. FIG. 4 is a block diagram of a video encoding device according to the present invention. Figure 3 shows a schematic block diagram of a second embodiment of a video decoding device according to the present invention, and Figure 6 shows a video decoding device according to the present invention. Figure 6 is a block diagram showing a second embodiment of a video decoding device according to the present invention. A schematic block diagram of one of the third embodiments, and FIG. 7 is a schematic block diagram showing a fourth embodiment of a video encoding apparatus according to the present invention. [Description of main component symbols] 10 video encoding device 10' video encoding device 10&quot; video encoding device 10&quot; 'video encoding device 20 selecting unit 20, selecting unit 21 region selecting unit 22 detecting unit 23 analyzing unit 24 block selecting unit 25 Optical Volume Description Imaging (PPG) Capture Unit 30 First Encoding Unit 30' First Encoding Unit 30&quot; First Encoding Unit 30'&quot; First Encoding Unit 35 Decoding Unit 36 Optical Volume Description Imaging (PPG) Signal Acquisition Unit 161403.doc • 24-201244486 40 second coding unit 40' second coding unit 40&quot; second coding unit 50 encoder combining unit 60 video decoding device 60' video decoding device 60&quot; video decoding device 70 first decoding unit 71 common Decoding unit 72 Selection unit 75 Second decoding unit 75' Second decoding unit 80 Optical volume description imaging (PPG) signal capturing unit 80' Light volume description imaging (PPG) signal capturing unit 81 Block capturing unit 82 Reconstruction Unit 83 Light Volume Description Imaging (PPG) Signal Capture Unit 90 Separate Single The element 95 decoder combination unit 100 inputs the video data 101, selects the selected area of interest 101a of the video data, selects the chrominance component of the area of interest 101b, selects the brightness component of the area of interest 102, inputs the encoded area of interest of the video material 161403.doc -25- 201244486 103 The remaining portion 104 of the input video data is input to the encoded remainder of the video data. 105 Encoder Output Video Stream 106 Decoded Region of Interest 122 Potentially Useful Region 123 Region 160 Encoded Video Stream 161 Encoded Region of Interest 162 Input Video Data Encoded Remaining portion 163 Decoded Region of Interest 164 Optical Volume Description Imaging (PPG) Signal 165 Decoded Remaining portion 166 Decoder Output Video Stream 167 Decoded Video Stream 168 Region of Interest 181 Block Information 182 Reconstructed Region of Interest 161403.doc -26-

Claims (1)

201244486 VII. Patent application scope · Video coding device for encoding video data (10, 10', 1〇|, 10'&quot;)' includes: day selection unit (20, 20,), which is used One of the strong PPG (Light Volume Description Imaging) signals is provided in the selected input video data (1〇〇) (101), = the first coding unit (3〇, 3〇', 3〇,,, 3〇 t,,) for encoding the selected attention area (1G1) of the input video data with a first encoding setting according to a coding scheme to save the PPG related information in the encoded attention area a second coding unit (40, 4, 40, 40) for encoding the remaining portion (103) of the input video material ((10)) with the second encoding setting according to the predetermined coding scheme, and The encoder combining unit (50) is configured to combine the encoded region of interest (102) of the input video material and the remaining portion of the code (1〇4) into an encoder output video stream (1〇5). 2. The video encoding device (丨〇1) of claim 1, wherein the selecting unit (20') comprises: a region selecting unit (21) for selecting one of the input video materials (100) ( Specifically, a skin region is used as a region of interest, wherein the video material includes a sequence of video frames, the frames are divided into spatial blocks, and a block selection unit (24) is configured to determine the selected region. The spatial blocks (123), the determined spatial blocks represent the region of interest 161403.doc 201244486. 3. The video encoding device ("〇") of claim 2, wherein the region selecting unit (21) comprises: a predicate unit (22) 'for <> (measuring that the input video material is available as a region of interest) A set of potentially useful areas (丨22), in particular, a skin area, and an analysis unit (23) 'which is used to analyze the set of detected potential useful areas (122) and based on one or more predetermined selection criteria And selecting an area (123) as the area of interest. 4. The video coding apparatus (1) of claim 3, wherein the analysis unit (23) is adapted to achieve spatial size, temporal stability, illumination stability, and / or skin color stability is used as a selection criterion. 5. The video encoding device (ι) of claim 3, wherein the analyzing unit (23) comprises a PPG capturing unit (25), the PPG capturing unit (25) And selecting a region (123) as the region of interest based on the detected potential useful region from the PPG signal (180) and based on the quality and/or content of the retrieved ppG signal. Video coding device of item 5 (1〇,), The PPG capture unit (25) is adapted to determine the one or more parameters of the first encoding setting for use by the first encoding unit (30, 30) to encode the captured PPG signal based on the first encoding unit (30, 30) Selecting a region of interest, and wherein the first coding unit (3〇, 30·) is adapted to use the one or more parameters of the first encoding setting to encode the selected region of interest. 7. Video of claim 1 Encoding apparatus (1〇,,), 161403.doc 201244486 wherein the first coding unit (30) is adapted to encode at least a chrominance component (101a) of the selected region of interest (101), in particular, the same color a component (101a), and wherein the second coding unit is adapted to encode the luma component (1〇 lb) of the selected region of interest (101) and encode the remaining portion of the input video material (1〇〇) a chrominance component and a luminosity component. 8. The video coding apparatus of claim 1 (丨〇, 1 〇, '丨〇M), wherein the first coding unit (30, 30) is adapted to use the zone Intra-block coding to encode the selected region of interest (i 〇丨), The second coding unit (4〇, 40') is adapted to encode the remaining portion (103) of the input video material (1) by inter-block coding and/or intra-block coding. a video encoding device (1〇m) of claim 1 wherein the first coding unit (3〇) is adapted to encode only at least the chrominance components (1〇la) of the selected region of interest (101) (specifically The DC component of the inter-block or intra-block coding block of the chrominance component (101 a) only. 1 〇. A video coding method for encoding video data, the video coding method includes the following steps : selecting a region of interest (101) of a strong PPG signal in the input video data (1〇〇), and encoding the selected region of interest of the input video material (100) with a first encoding setting according to a predetermined encoding scheme ( 101) storing the PPG related information in the encoded attention area, and encoding the remaining portion of the input data (100) with a second encoding setting according to the predetermined encoding scheme (103) and inputting the input Depending on the sfl data The attention area (1 〇 2) and the coded remaining part (104) are combined into an encoder output video stream (105) 〇11 · a video decoding apparatus for decoding an encoded video stream (6〇, 60, 60) The encoded video stream ("6") includes encoded video data, wherein a region of interest of the input video material (1 〇〇) has been encoded with a first encoding setting according to a predetermined encoding scheme (丨〇丨) storing the ppG related information in the encoded attention area (丨〇2), and encoding the remaining portion of the input video material (丨〇〇) with a second encoding setting according to the predetermined encoding scheme (103) The video decoding apparatus includes: a first decoding unit (70) for decoding the encoded attention area (161) according to a decoding scheme complementary to the encoding scheme that has been used to encode the region of interest, and A PPG capture unit (8A, 80') is used to retrieve a ppg signal (164) from the decoded region of interest (163). 12. The video decoding device of claim 11, wherein the video decoding device further comprises: a second decoding unit (75) for decoding the encoded video data according to the decoding scheme The remaining portion (丨62), and the decoder combining unit (95) 'is used to combine the decoded region of interest (163) and the remaining portions of the decoding (165) into a decoder output scrambling stream (166). 13. A video decoding method for decoding an encoded video stream, the encoded video stream (160) comprising 161 403.doc 201244486 comprising encoded video data, wherein a first encoding setting has been used according to a predetermined encoding scheme Encoding an area of interest (101) of the input video material (100) to store ppG related information in the encoded attention area (102), and encoding the input video data with a second encoding setting according to the predetermined encoding scheme The remaining portion (1 〇 3) of the video decoding method includes the following steps: decoding the encoded attention area (161) according to a decoding scheme complementary to one of the coding schemes used to encode the region of interest, And extracting a PPG signal (164) from the decoding region of interest (163). 14. A video encoding system for encoding and decoding video data, the video encoding system comprising: a video encoding device (10, 10, 10&quot;) for encoding input video data according to claim 1, and as requested Item 11 is a video decoding device (60, 60, p 15.) for decoding video data encoded by the video encoding device, which is a computer program including a code component, which is implemented when the computer program is executed on a computer The computer implements the steps of the method of claim 10 or 13. 161403.doc