KR20090125556A - Method, apparatus and system for coding video data - Google Patents

Abstract

PURPOSE: A method and an apparatus for coding video and a service system thereof are provided to encode an area which has great influence on video quality and an area which does not have great influence on video quality at respective different bit rates, thereby improving video quality. CONSTITUTION: An image obtaining unit(110) obtains video data. An image dividing unit(120) divides the obtained video data into a preset interest area and a non-interest area. An image encoding unit(130) respectively encodes video data of the interest area and video data of the non-interest area by preset area bit rate information. An image combining unit(140) combines the encoded video data of the interest area with the video data of the non-interest area.

Description

Video codec method, video codec device and video service system {Method, Apparatus and System for Coding Video Data}

The present invention relates to a video codec method, a video codec device and a video service system thereof. More specifically, the present invention relates to an image codec method, an image codec device, and an image service system for improving image quality in a region where attention is focused and dominates overall image quality without wasting bandwidth of a wired / wireless communication network.

Codec, a technology that combines the function of a coder that converts audio or video signals into digital signals, and vice versa, allows the computer to process audio or video data digitally. It is software or hardware that converts and replays the data on a monitor so that the computer user can see it. In particular, it bundles large files such as videos and allows them to be played back. Making a file smaller is called Encoding, and playing it back intact is called decoding.

In particular, video data having a large capacity places a heavy load on a wired / wireless communication network or a device for reproducing, and reduces the amount of bits by encoding it at a predetermined bit rate by using the above-described codec technology. It can reduce the load.

There is an area in which the amount of bits suddenly increases, such as an area of interest, an area with a lot of movement in the image screen, and such an area may have a great influence on the overall image quality.

The conventional video codec technology of encoding one frame unit uniformly encodes an area having a great influence on the image quality existing in one frame and an area that is not, thereby reducing the bandwidth of the wired / wireless communication network when providing a video service or It causes a problem that a sudden deterioration of image quality occurs when the output data of a sudden encoded image increases. In particular, this problem may occur more seriously in a wireless mobile environment with limited and variable bandwidth.

It is an object of the present invention to solve the above-mentioned problems, by focusing attention and overall image quality without wasting bandwidth of wired / wireless communication networks by encoding at different bit rates for regions having a great influence on image quality and regions not having image quality. The present invention provides a video codec device that improves image quality of a region in which the dominant region is affected.

According to an aspect of the present invention for achieving the above object, an image codec device comprising: an image acquisition unit for acquiring image data; An image separator for dividing the acquired image data into a preset region of interest and a non-interest region; An image encoder which encodes image data of the ROI and image data of the non-ROI using preset bit rate information for each region; And an image combiner for combining the encoded image data of the ROI and the image data of the non-ROI, respectively.

According to another aspect of the present invention for achieving the above object, an image codec method comprising the steps of: (a) obtaining image data; (b) confirming whether a region of interest is set; (c) separating the acquired image data into the ROI and the non-ROI when the ROI is set; (d) encoding image data of the ROI and image data of the non-ROI by using bit rate information for each region; And (e) combining the encoded image data of the region of interest and the image data of the non-interest region, respectively.

According to another aspect of the present invention for achieving the above object, in the video service system, the obtained image data is divided into a predetermined region of interest and a non-interest region, and using the predetermined bit rate information for each region Encode the image data of the ROI and the image data of the non-ROI, respectively, and generate the combined image data by combining the encoded image data of the ROI and the image data of the non-ROI, and transmit the combined image data. A first terminal; Receiving the combined image data from the first terminal, decoding the divided region into the ROI and the non-ROI, respectively, and combining and displaying the image data of the decoded ROI and the non-ROI, respectively. A second terminal; And a wired or wireless communication network for transmitting the combined image data between the first terminal and the second terminal.

According to another aspect of the present invention for achieving the above object, in the video service system, by separating the image data into a predetermined region of interest and non-interest of region, by using the predetermined bit rate information or image quality information for each region The image data of the ROI and the image data of the non-ROI are respectively encoded, and the combined image data is generated by combining the encoded image data of the ROI and the image data of the non-ROI, and the combined image data is generated. Providing image providing server; A terminal configured to receive the combined image data from the image providing server, separate the image into the ROI and the non-ROI, and decode each of them, and display the image data of the decoded ROI and the image data of the non-ROI; And a wired or wireless communication network for transmitting the combined image data between the image providing server and the terminal.

As described above, according to the present invention, by encoding at different bit rates for areas that have a great influence on video quality and areas that do not, the interest is concentrated and the overall picture quality is determined without wasting the bandwidth of the wired / wireless communication network. Has the effect of providing an image codec device for improving the image quality of a region.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. First of all, in adding reference numerals to the components of each drawing, it should be noted that the same reference numerals are used as much as possible even if displayed on different drawings. In addition, in describing the present invention, detailed descriptions of related well-known structures or functions will be apparent to those skilled in the art or may obscure the subject matter of the present invention, and detailed descriptions thereof will be omitted.

First, the video codec device 100 according to the present invention will be briefly described. The video codec device 100 according to the present invention is provided for providing a video service such as a video call service, a video conference service, and a video providing service through a wired or wireless communication network. It is provided in communication devices and divides the input image data into the ROI and the non-ROI, and assigns and encodes a relatively larger amount of bits than the image data encoding of the ROI to encode the image data of the ROI. It is a device that provides a technique related to an image codec that can provide an improved subjective image quality by encoding a high quality image of a region of interest, which is mainly focused when received.

In the present invention, the "region of interest" may be defined as an image region in which relatively attention is focused, an area with a lot of movement in the image screen, an image region containing the most content of the image, or an image region which determines the quality of the entire image. have. For example, in the case of a video call, an image region corresponding to the face of the user may be a region of interest.

Encoding of image data by the image codec device 100 according to the present invention is different from the conventional image data encoding in the following points.

The video codec device 100 according to the present invention is similar to the encoding in the conventional video codec device in that it encodes the image data in units of frames. However, the conventional video codec device encodes the image data in one frame regardless of the method. Although the image data included in the video data is encoded at the same bit rate, the image codec device 100 according to the present invention may use image data of the ROI and non-ROI included in one frame at different bit rates, even if one frame is used. There is a significant difference in that it can be encoded.

The image codec device 100 according to the present invention described above will be described with reference to FIG. 1, which is a schematic block diagram of the device.

As illustrated in FIG. 1, the image codec device 100 according to the present invention may include an image acquisition unit 110, an image separation unit 120, an image encoding unit 130, an image combining unit 140, and the like. Include. However, although the image codec device 100 according to the present invention may perform both encoding and decoding, the image acquisition unit 110, the image separation unit 120, the image encoding unit 130, and the image illustrated in FIG. 1 may be performed. The combiner 140 is an encoding block that encodes image data.

The image acquisition unit 110 acquires corresponding image data through an image acquisition device such as a camera or the like from an image data storage.

The image separator 120 separates the image data acquired by the image acquirer 110 into a predetermined ROI and a non-ROI.

The image encoding unit 130 encodes the image data of the ROI separated from the image separation unit 120 and the image data of the non-ROI by using predetermined bit rate information for each region. Here, the bit rate information for each region includes a first bit rate for the ROI and a second bit rate for the non-ROI, but the first bit rate has a relatively higher value than the second bit rate.

The image combiner 140 combines the image data of the ROI encoded by the image encoder 130 and the image data of the non-ROI, respectively.

In addition, the image combiner 140 may combine the image data of the ROI and the image data of the non-ROI, respectively, while monitoring or recovering the error of the image data of the ROI. This allows for more robust coupling to errors, which can improve image quality.

The video codec device 100 according to the present invention described above may be applied to communication devices related to a video call service, a video conferencing service, a video providing service, etc. That is, the video codec device 100 may be a wired and / or wireless interface. It may be included in a computer, a mobile terminal and a server having a.

If the video codec device 100 is included in a communication device such as a computer or a mobile terminal for a two-way video service such as a video call service or a video conference service in which video data is transmitted and received in both directions, a communication device such as a computer and a mobile terminal The image codec device 100 included in the image coder divides the image data into regions of interest and non-interests, and encodes and combines the image data encoded and combined for each region of interest and non-interests, respectively, as well as the encoding function for encoding and combining the data at different bit rates. It should be possible to perform a decoding function that separates the region of interest and the non-interest of interest, and decodes and combines them again.

However, if the video codec device 100 is provided in a communication device such as a content server for a one-way video service such as a video providing service in which the video data is transmitted in one direction, the video codec device 100 may include the image data in the ROI and the region of interest. It is only necessary to perform an encoding function of dividing into uninterested regions, encoding each at a different bit rate, and combining them.

When the image codec device 100 performs both an encoding function and a decoding function, the image codec device 100 may be divided into an encoding block that performs an encoding function and a decoding block that performs a decoding function. The video codec device 100 according to the present invention including both of these blocks is shown in FIG. 2.

Referring to FIG. 2, the encoding block in the image codec device 100 according to the present invention may include an image acquisition unit 110 for acquiring image data from an image acquisition apparatus and image data acquired by the image acquisition unit 110. The image separation unit 120 separating the predetermined ROI and the non-ROI, and the image data of the ROI separated from the image separation unit 120 and the image data of the non-ROI using the predetermined bit rate information for each region, respectively. The image combiner 140 and the image combiner 140 which combine the image data of the ROI encoded by the image encoder 130 and the image data of the non-ROI, respectively, are encoded. And an image transmitter 150 for transmitting the image data to the receiving terminal.

2, the decoding block in the image codec apparatus 100 according to the present invention includes an image receiving unit 180 which receives image data encoded and combined for each ROI and non-ROI, from a calling terminal, The image separator 120 that separates the image data received by the image receiver 180 into the ROI and the non-ROI, and the image data of the ROI separated by the image separator 120 and the image data of the non-ROI, respectively The image decoding unit 190 to decode, the image decoding unit 190 and the image combiner 140 for combining the image data of the region of interest and the non-interest region, respectively, and to display the combined image data on the screen And an image display unit 200.

However, in the foregoing description of the decoding block and the encoding block, although the separation of the image data into the ROI and the non-ROI is performed by one image separation unit 120, the image data separation in the decoding block and the encoding block is performed. It may be performed by a separate image separator.

In addition, in the foregoing description of the decoding block and the encoding block, although the combination of the image data of the ROI and the image data of the non-ROI is performed in one image combiner 140, the image in the decoding block and the encoding block is performed. Data combining may be performed in a separate image combiner.

On the other hand, the image data obtained from the image acquisition unit 110 or the image data received from the image receiving unit 110, the image data received from the image receiving unit 180 (image data that is separately encoded and combined again with respect to the region of interest and uninterested region) The ROI should be set in advance in order to separate it into the ROI and the non-ROI.

Accordingly, as shown in FIG. 2, the image codec device 100 according to the present invention further includes a region setting unit 160 for setting a region of interest. However, the non-interested area may be automatically set to other parts except the set ROI, or may be explicitly set by the area setting unit 160. However, in the following description, it is assumed that when only the ROI is set, the non-ROI is automatically set to other areas except the ROI.

According to the subject of interest setting, the region of interest may be set using a preset basic setting value, may be set according to a user input value, or may be automatically set according to the movement or appearance of an object.

Also, depending on the region of interest variability, the region of interest may be fixed or variable. Accordingly, the region setting unit 160 may set the region of interest to "fixed" or "variable" according to whether the region of interest is fixed or variable after the region of interest is set once. The fixed setting means that the region of interest once set continues without change for a predetermined time, and the variable setting means that the region of interest may move, enlarge or shrink due to the movement and appearance of an object.

When the above-described region setting unit 160 sets the region of interest fixedly, the region setting unit 160 may set the region of interest fixedly by using a default setting value, or may set the region of interest fixedly by using user input information. Can be set. For example, in the case of a video call, since the human face is generally located at the center of the screen, the center portion of the screen may be set as the default setting value, and it may be set to the region of interest by using it or the center portion of the screen. .

In addition, when the area setting unit 160 variably sets the ROI, the area setting unit 160 sets the ROI while changing the ROI automatically based on the object detection result using the object detection algorithm. For example, in the case of a video call, when a face of a person moves or newly appears, the ROI may be set to move, enlarge or reduce based on the result detected by the object detection algorithm, or may be set to change to another ROI. .

On the other hand, when the region setting unit 160 has not set the ROI, the image separator 120 may care about the entirety of the image data acquired by the image acquirer 110 or the image data received by the image receiver 180. Treat it as an area.

In addition, when the region setting unit 160 does not set an ROI, the image separator 120 may process a particular type of region defined as a default as the ROI. Here, the specific form may be a form of a box, a circle, or the like. For example, if a specific shape defined as a default is a box, and the area setting unit 160 has not set an ROI and obtains the image data from the image acquisition unit 110 or the image receiving unit 180, the image data. A portion of image data corresponding to a box defined as a default may be regarded as data of a region of interest, and may be separated by regions.

Referring to FIG. 2, the image codec apparatus 100 according to the present invention adjusts and sets bit rate information for each region including a first bit rate for a region of interest and a second bit rate for an uninterested region. It may further include.

The bit rate setting unit 170 sets the first bit rate and the second bit rate based on the target total bit rate. At this time, the first bit rate is set relatively higher than the second bit rate. For example, assuming that the target total bit rate of the image data to be transmitted is 1 Mbps, the image data of the region of interest is transmitted with high quality while maintaining the total bit rate that can be calculated using the first bit rate and the second bit rate at 1 Mbps. If desired, the first bit rate for the region of interest is set to 700 Kbps and the second bit rate for the region of interest is set to 300 Kbps. That is, when the first bit rate for the ROI encoding is determined, the second bit rate for the non-ROI encoding may be assigned the remaining bit rate obtained by subtracting the first bit rate from the target bit rate.

The bit rate setting unit 170 may set area-specific bit rate information including the first bit rate and the second bit rate by a user input, or may automatically set the bit rate information based on the obtained quality of service (QoS). have. The service quality information may include image data transmission state information, image data reproduction state information, wired / wireless communication network state information, and the like.

When the bit rate setting unit 170 automatically sets the bit rate using the quality of service information, the video codec device 100 monitors or receives a service from an image data receiving device such as a communication system or a mobile terminal or a computer. The quality information can be obtained and set while adjusting the first bit rate and the second bit rate based on the quality information. For example, if the obtained quality of service information includes one or more wired / wireless network state information in available bandwidth, bandwidth variation, delay, delay deviation, data loss, etc., the wired / wireless network state information allows the transmission environment to be limited in bandwidth and variable. It may be confirmed that the wireless mobile environment may be, and the first bit rate and the second bit rate may be adjusted and set to suit the transmission environment. For example, if there is available bandwidth information in the wired / wireless network state information and the available bandwidth is 800 Kbps, the total target bit rate may be set to about 800 Kbps, and the first bit rate and the second bit rate may be set based on this.

Meanwhile, the above-described image encoder 130 may encode the image data of the ROI and the image data of the non-ROI by using the first bit rate and the second bit rate set by the bit rate setting unit 160, and set the bit rate. The image data of the ROI and the non-ROI may be encoded by changing one or more of the first bit rate and the second bit rate set in the unit 160, respectively. Here, the first bit rate may have a value larger than the second bit rate so that the image data of the ROI may be encoded at a higher bit rate (high definition) than the image data of the non-ROI.

Encoding at such a different bit rate for each region, that is, encoding video data of the ROI at a high bit rate (first bit rate) and encoding video data of a non-ROI at a low bit rate (second bit rate), By encoding the image data at a low bit rate, the amount of generated bits is reduced, and such a decrease in the amount of generated bits is achieved at a high bit rate to generate a large bit amount of image data of the region of interest, which is relatively focused and can influence the overall image quality. It can make room for coding. As a result, the target overall bit rate can be properly maintained or reduced while improving the image quality of the region of interest in which a relatively high concentration of attention is required to show good image quality.

In addition, the image encoder 130 may adjust the bit amount of the encoded image data by using one or more of adjusting a quantization parameter value, skipping encoding on the image frame, and skipping encoding on the image data of the uninterested region. .

In addition, when transmitting the coded image (region of interest and region of interest) data, the region of interest data is used for error in the region of interest using the Unequal Error Protection technique, in order to withstand the transmission error. Strong protection is applied and relatively weak error protection is applied to uninterested region data. In this case, the amount of additionally generated data increases according to the degree of protection against errors, which may be taken into account by the bit rate setting unit 170 when allocating the first bit rate to the ROI encoding and the second bit rate to the non-ROI encoding. Non-uniform error protection techniques may use convolutional code or turbo code.

Summarizing the video codec device 100 according to the present invention described above, the video codec device 100 is a communication device for providing a video service, such as a video call service, a video conference service, a video providing service through a wired or wireless communication network Provided to the user to divide the input image data into a region of interest and an uninterested region, and provide a video service by allocating a relatively larger amount of bits to encode the image data of the region of interest than the image data encoding of the uninterested region. It is a device that provides a technique related to an image codec that can provide an improved subjective image quality by encoding a high quality image of a region of interest, which is mainly the subject of attention when receiving.

The image quality improvement provided by the image codec device 100 according to the present invention can be obtained in both wired and wireless communication network environments, but it is relatively limited and variable bandwidth and delay variation compared to the wired environment. In a wireless mobile environment with Jitter Delay, the effect is more pronounced.

This is because the amount of output bits may increase rapidly due to the movement of a corresponding object or video screen, and the amount of output bits increases rapidly in a wireless mobile environment with limited and variable bandwidth. Since there is less bandwidth to cover than the wired environment, the quantization parameter value is increased to reduce the amount of bits generated further or to skip more encoding processes of the image to be encoded by skipping more frames. This can cause more serious degradation of image quality.

However, the image codec device 100 according to the present invention reduces the amount of generated bits by encoding the image data of the non-interested region at a low bit rate, and the reduction of the amount of generated bits is relatively concentrated to influence the overall image quality. This makes it possible to encode video data of a region of interest that can be encoded at a high bit rate that generates a large amount of bits. As a result, the target overall bit rate can be properly maintained or reduced while improving the image quality of the region of interest in which a relatively high concentration of attention is required to show good image quality.

3 is a flowchart illustrating an image codec method according to the present invention.

As shown in FIG. 3, the image codec method may include obtaining image data (S300), checking whether the ROI is set, and when the ROI is set as a result of the checking, sets the acquired image data to the ROI and the non-ROI. Separating the image data of the region of interest and the image data of the non-interest region using the bit rate information of each region (S302), and encoding the image data of the region of interest and the image of the non-interest region, respectively. Combining the data (S306) or the like.

 Before step S304, adjusting and setting the bit rate information for each region including the first bit rate for the ROI and the second bit rate for the non-ROI. Here, the first bit rate is set to be adjusted higher than the second bit rate.

The region-specific bit rate information setting in the above-described region-specific bit rate information setting step may be set by user input or may be automatically set by using quality of service (QoS).

When the bit rate information for each area is automatically set using quality of service (QoS), the bit rate information for each area includes one or more of video data transmission status information, video data playback status information, and wired / wireless network status information. The quality of service (QoS) can be adjusted and set in consideration of the information.

In this case, the service quality information may be obtained by monitoring by the image codec device 100 or may be obtained from an image data receiving apparatus such as a communication system or a mobile terminal or a computer to which the service codec interoperates.

In operation S302, when the ROI is not set as the result of checking whether the ROI is set, the entire acquired image data may be processed as the ROI. In this case, the entire image data is divided into the ROI, and the image data of the non-ROI does not exist.

In addition, in operation S302, when the ROI is not set as the result of checking whether the ROI is set, a region of a specific type defined as a default may be processed and separated as the ROI. In this case, image data corresponding to a region of a specific type defined as a default is divided into a region of interest, and image data corresponding to a region except a region of a specific form defined as a default is processed and separated as a region of interest.

Prior to checking whether the ROI is set in operation S302, the method may further include setting the ROI fixedly or variably.

When the ROI is fixedly set, the ROI may be set using a preset basic setting value or may be set using user input information.

When the ROI is variably set, the ROI is set while automatically changing the ROI based on an object detection result using an object detection algorithm.

4 is a diagram of an image service system to which an image codec method according to the present invention can be applied.

The video service type that can be provided by applying the video codec technology according to the present invention includes a video call service in which video data is transmitted and received in both directions, a video conference service, and a video providing service in which video data is transmitted in one direction. There is the same one-way video service. Communication devices such as terminals, servers, etc. that receive video services should be provided with the video codec device 100 according to the present invention.

FIG. 4A is a diagram illustrating a two-way video service such as a video call service and a video conference service. As shown in FIG. 4A, a two-way video service is provided by a computer or mobile device through a wired / wireless communication network 40. It is made between the first terminal 41 and the second terminal 42 such as a terminal. Accordingly, the video codec device 100 according to the present invention is provided in the first terminal 41 and the second terminal 42, and is provided in the first terminal 41 and the second terminal 42. 100 should include both an encoding block and a decoding block.

Referring to FIG. 4A, according to an embodiment of the video service system according to the present invention, the obtained image data is divided into a predetermined region of interest and a non-interest region, and using predetermined bit rate information for each region. A first terminal for encoding the image data of the ROI and the non-ROI, respectively, combining the encoded image data of the ROI and the image data of the non-ROI, and generating combined image data and transmitting the combined image data as combined image data; (41) receives the combined image data from the first terminal 41, decodes each of the ROI and the non-ROI, and decodes the image data of the decoded ROI and the image data of the non-ROI, respectively. A wired / wireless communication network 40 including a second terminal 42 and transmitting combined image data between the first terminal 41 and the second terminal 42. It includes.

Here, the first terminal 41 and the second terminal 42 should be a computer or mobile terminal that performs a video call function or a video conference function, and should be able to perform encoding and decoding.

4B is a diagram illustrating a unidirectional video service such as an image providing service. As illustrated in FIG. 4B, a unidirectional video service is connected to a terminal (eg, a server) from a server 43 through a wired / wireless communication network 40. 44) provides video data.

In this case, the server 43 should include the video codec device 100 according to the present invention, but only provide the encoding block in the video codec device 100 because it only provides the image data. The video codec device 100 according to the present invention should be provided, but only the decoding block of the video codec device 100 is included since only the image data is provided. Of course, the image codec device 100 included in the server 43 and the terminal 44 may include both an encoding block and a decoding block.

Referring to (b) of FIG. 4, according to another embodiment of the video service system according to the present invention, image data is divided into a predetermined region of interest and a non-interest region, and predetermined bit rate information or image quality information for each region is set. By encoding the image data of the region of interest and the image data of the non-interest region, respectively, by using the combined image data of the region of interest and the image data of the non-interest region to generate a combined image data, and providing the combined image data Receives combined image data from the image providing server 43 and the image providing server 43, separates them into regions of interest and uninterested regions, and decodes them respectively to combine the image data of the decoded regions of interest and the image data of non-interest regions. And a terminal 44 for displaying and displaying the combined image data between the image providing server 43 and the terminal 44. And a wireless communication network 40.

The wired / wireless communication network 40 illustrated in FIGS. 4A and 4B may include the Internet or a mobile communication network.

5 is a flowchart illustrating a video service providing method using a video codec technology according to the present invention, wherein the video service refers to a two-way video service such as a video call service and a video conferencing service as shown in FIG. do.

As shown in FIG. 5, in the video service providing method using the video codec technology according to the present invention, the method for obtaining a video data and separating the data into regions of interest and uninterested regions by the calling terminal (S500), and by calling regions, Encoding, combining, and transmitting the image data of the ROI and the non-ROI using the bit rate information, respectively (S502), and the receiving terminal receives the transmitted image data to determine the image data of the ROI and the non-ROI Separating the image data into the image data (S504), and decoding, combining and displaying the image data of the separated ROI and the non-ROI, respectively (S506).

The region of interest mentioned above is fixedly preset based on a basic setting value or user input information or variably based on an object detection result using an object detection algorithm.

The above-mentioned bit rate information for each region includes a first bit rate for the region of interest and a second bit rate for the uninterested region, but generally the first bit rate has a value larger than the second bit rate. However, when the size of the ROI is set very small, the second bit rate may have a larger value than the first bit rate.

The above description is merely illustrative of the technical idea of the present invention, and those skilled in the art to which the present invention pertains may make various modifications and changes without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

As described above, the present invention is applied to a video codec technology and a video service providing technology, and has an effect of improving image quality in areas where attention is focused and influences overall image quality without wasting bandwidth of wired and wireless communication networks. It is a very useful invention.

1 is a schematic block diagram of an image codec device according to the present invention;

2 is a detailed block diagram of an image codec device according to the present invention;

3 is a flowchart of an image codec method according to the present invention;

4 is a diagram of an image service system to which an image codec method according to the present invention can be applied;

5 is a flowchart illustrating a video service providing method applying the video codec method according to the present invention.

<Description of Symbols for Main Parts of Drawings>

100: image codec device 110: image acquisition unit

120: image separation unit 130: image encoding unit

140: video combiner 150: video transmitter

160: area setting unit 170: bit rate setting unit

Claims (19)

In the video codec device, An image obtaining unit obtaining image data; An image separator for dividing the acquired image data into a preset region of interest and a non-interest region; An image encoder which encodes image data of the ROI and image data of the non-ROI using preset bit rate information for each region; And An image combiner configured to combine the encoded image data of the ROI and the non-ROI, respectively; Image codec device comprising a. The method of claim 1, Further comprising a region setting unit for setting the region of interest, The area setting unit, The image codec device, characterized in that the region of interest is fixedly set or variably set. The method of claim 2, The area setting unit, When the ROI is fixedly set, it is set using a preset default setting value or is set using user input information. And setting the ROI variably while changing the ROI based on an object detection result using an object detection algorithm. The method of claim 2, If the ROI is not set by the region setting unit, And the image separation unit processes the entire image data acquired by the image acquisition unit as the ROI or processes a region of a specific type defined by default as the ROI. The method of claim 1, And a bit rate setting unit configured to adjust and set bit rate information for each area including a first bit rate for the ROI and a second bit rate for the non-ROI, The bit rate setting unit, And setting the first bit rate and the second bit rate while adjusting the first bit rate based on the target total bit rate, wherein the first bit rate is set higher than the second bit rate. The method of claim 5, The bit rate setting unit, Setting on the basis of the target total bit rate, adjusting the first bit rate and the second bit rate, In order to make the region of interest encoded data more resistant to transmission errors than the region of interest, the first bit rate and the second bit rate are set in consideration of the application of an uneven error protection scheme. The non-uniform error protection technique is applied to the image codec device, characterized in that using a convolutional code or turbo code (Turbo code). The method of claim 5, The bit rate setting unit, On the basis of the service quality information including at least one of video data transmission status information, video data reproduction status information, and wired / wireless communication network status information, the first bit rate and the second bit rate are adjusted while being set. The video codec device is obtained by monitoring in the video codec device, or obtained from a communication system or an image data receiving device. The method of claim 5, The video encoding unit, The image data of the ROI and the non-ROI are respectively encoded using the set first bit rate and the second bit rate, or one or more of the set first bit rate and the second bit rate are changed. And image data of the region of interest and image data of the non-interest region, respectively. The method of claim 1, The video encoding unit, And adjusting the bit amount of the encoded image data by using at least one of adjusting a quantization parameter value, skipping encoding for the image frame, and skipping encoding for the image data of the non-interested region. The method of claim 1, The image combiner, And a video codec of the encoded region of interest and image data of a non-interest region, respectively, while monitoring an error of the image data of the region of interest or recovering the monitored error. The method of claim 1, An image receiving unit receiving image data encoded and combined for each region of interest and the non-interest region; An image decoding unit decoding the image data of the separated ROI and the non-ROI after the image data received by the image receiver is separated into the ROI and the non-ROI by the image separator; And An image display unit which displays the combined image data after the image data of the ROI and the non-ROI, respectively decoded by the image decoding unit, are combined by the image combiner; The video codec device, characterized in that it further comprises. In the video codec method, (a) obtaining image data; (b) confirming whether a region of interest is set; (c) separating the acquired image data into the ROI and the non-ROI when the ROI is set; (d) encoding image data of the ROI and image data of the non-ROI by using bit rate information for each region; And (e) combining the image data of each region of interest encoded with the image data of the non-interest region; Image codec method comprising a. The method of claim 12, Prior to step (d), The bit rate information for each area including a first bit rate for the region of interest and a second bit rate for the non-interest region is adjusted and set, And the first bit rate is adjusted and set higher than the second bit rate. The method of claim 13, The bit rate information for each region is adjusted and set based on service quality information including at least one of image data transmission state information, image data reproduction state information, and wired / wireless communication network state information. Image codec method, characterized in that obtained by monitoring or from a communication system or an image data receiving device. The method of claim 12, Step (c) is, As a result of the checking in step (b), if the ROI is not set, The image codec method according to claim 1, wherein the obtained image data is processed as a region of interest or a region of a specific type defined as a region of interest is processed by default. The method of claim 12, Before step (b) above, Setting the area of interest fixedly or variably; When the ROI is fixedly set, it is set using a preset default setting value or is set using user input information. And setting the ROI variably while changing the ROI based on an object detection result using an object detection algorithm. In the video service system, The obtained image data is divided into a predetermined region of interest and a non-interest region, and the image data of the region of interest and the image data of the non-interest region are respectively encoded using predetermined bit rate information for each region, and the respective encoded regions of interest. A first terminal for combining the image data of the region and the image data of the non-interest region to generate combined image data and transmitting the combined image data; Receiving the combined image data from the first terminal, and separately decoding the combined image data into the ROI and the non-ROI, and combining and displaying the image data of the decoded ROI and the non-ROI, respectively. 2 terminal devices; And Wired and wireless communication network for transmitting the combined image data between the first terminal and the second terminal Image service system comprising a. The method of claim 17, The first terminal and the second terminal is a computer or mobile terminal that performs a video call function or a video conferencing function, wherein the first terminal and the second terminal performs encoding and decoding. In the video service system, The image data is divided into a predetermined region of interest and a non-interest region, and the image data of the region of interest and the image data of the non-interest region are respectively encoded using predetermined bit rate information or image quality information for each region, and each encoded. An image providing server which combines the image data of the ROI and the image data of the non-ROI to generate combined image data, and provides the combined image data; A terminal configured to receive the combined image data from the image providing server, separate the image into the ROI and the non-ROI, and decode each of them, and display the image data of the decoded ROI and the image data of the non-ROI; And A wired / wireless communication network for transmitting the combined image data between the image providing server and the terminal. Image service system comprising a.

Images