KR100925976B1 - Method for adjusting the video quality of video call using of mobile terminal and thereof mobile terminal - Google Patents

Abstract

The present invention provides a method of controlling the image quality of a specific area in a counterpart image displayed on a first mobile communication terminal and a second mobile communication terminal during a video call, the second mobile communication terminal displaying a user image of the first mobile communication terminal. When the image quality control menu is selected, the image segmentation line is displayed on the displayed first mobile communication terminal user image, and when the key assigned to the ROI is selected from the image divided by the displayed image segmentation line, the selected key Generate and transmit a picture quality control request message including information to the first mobile communication terminal, and the first mobile communication terminal divides the photographed image according to the image segmentation information included in the message, and in the divided image. Determine a region of interest corresponding to the key information, and receive an uninterested interest in the determined region of interest And by changing the quantization coefficient to adjust the image quality as of transmitting to the second mobile communication terminal, a specific part of the other image is output by using the mobile communication terminal in a video call may be such that the image quality.

Video call, mobile communication terminal, region of interest, image quality control

Description

Method for adjusting the video quality of video call using of mobile terminal and about mobile terminal}

The present invention relates to a video call quality control method using a mobile communication terminal to make a specific portion of the other party's image output to the mobile communication terminal during a video call, and the terminal.

A mobile communication terminal having a video call function performs video call transmission and reception together with audio transmission and reception, transmitting video data of the user, that is, video data, and receiving and displaying video data of the other party.

That is, when a video call is attempted from an originating terminal, a call attempt message is transmitted to the exchange through the base station / base station controller, and the exchange acquires routing information to the called terminal through the home location register. Session with the called terminal through the called exchange.

According to this process, the calling terminal and the called terminal can perform a video call while watching each other's video through voice and video transmission and reception.

In making a video call, due to different terminal capabilities and network conditions, it is inefficient to transmit a mobile communication terminal in a video call after compressing using the same encoding scheme.

In addition, if video is encoded at a single communication speed without considering the encoding and decoding performance of the mobile communication terminal, it is impossible to make the most of available resources.

In order to overcome this problem, various optimization methods have been proposed, but most of them are designed around server encoding, and it is difficult to achieve optimal performance for transmitting temporary streaming video such as a video call.

In addition, when a real-time video call is implemented, a terminal having a relatively low processing power cannot use an encoder with high complexity, and when the complexity increases, the computation time and terminal power are consumed so that the image quality does not come out as desired and the network cannot be used. There is a disadvantage that it is difficult for the user to satisfy the picture quality because of insufficient resources.

Accordingly, an object of the present invention is to provide a video call quality control method using a mobile communication terminal and a terminal for making a specific portion of the counterpart image output to a mobile communication terminal in a video call high quality.

Another object of the present invention is to select a region to be viewed in high-definition in the mobile communication terminal in the video call, the area information is transmitted to the counterpart terminal, the video call quality control method for the other terminal to make the image of the selected area in high quality And to provide the terminal.

It is still another object of the present invention to provide a video call quality control method and a terminal capable of obtaining an optimum picture quality from the standpoint of receiving a separate encoding time without consuming a limited resource.

It is still another object of the present invention to provide a video call quality control method and a terminal capable of increasing a receiver's satisfaction by selecting a region of interest and adding a bit allocation to the region of interest during a video call.

According to an aspect of the present invention to achieve the above object, in the method for adjusting the image quality of a specific area in the counterpart image displayed on the first mobile communication terminal and the second mobile communication terminal during the video call, the first mobile communication If an image quality control menu is selected in the second mobile communication terminal on which the terminal user image is displayed, displaying an image segmentation line on the displayed first mobile communication terminal user image, and displaying the displayed video segmentation line in the second mobile communication terminal. If a key assigned to the region of interest is selected from the image divided by, generating a quality control request message including the selected key information and transmitting the generated image quality request message to the first mobile communication terminal, and adjusting the image quality in the first mobile communication terminal. When the request message is received, the image segmentation information included in the captured image to the message Determining the region of interest corresponding to the key information in the divided image, and adjusting the image quality by changing an uninterested region and a quantization coefficient with respect to the determined region of interest in the first mobile communication terminal. Provided are a video call quality control method using a mobile communication terminal, the method comprising transmitting to a mobile communication terminal.

The image segmentation line is displayed in a semi-transparent form on the first mobile communication terminal user image, and divides the first mobile communication terminal user image, and is divided into a number set or set by default by the user. The area divided by is mapped to a key.

The image quality control request message includes second mobile communication terminal identification information, key information, and image segmentation information.

According to another aspect of the present invention, in the method for adjusting the image quality of the ROI using a mobile communication terminal in a video call, (a) receiving a quality control request message including key information and image segmentation information from a counterpart terminal; And dividing the photographed image according to the image segmentation information, and determining a region of interest corresponding to the key information in the segmented image. (B) by changing the uninterested region and the quantization coefficient with respect to the determined region of interest After controlling the transmission to the counterpart terminal, and determining whether the movement of the region of interest is detected with respect to the captured image, (c) If the movement of the region of interest is detected as a result of the determination of step (b), the region of interest Predicts a motion vector due to the movement of, and adds the predicted motion vector values to change the ROI over a predetermined threshold. And determining the region of interest based on the movement information according to the predicted motion vector value if the region of interest has not changed more than a predetermined threshold as a result of the determination of (d) and (d). Provided is a method for controlling video call quality using a mobile communication terminal, comprising performing step b).

The method may further include encoding and transmitting the captured image to the counterpart terminal when the region of interest has changed by more than a predetermined threshold as a result of the determination of step (c).

In step (c), when the movement is detected in comparison with the region of interest of the previous frame with respect to the determined region of interest, predicting a motion vector due to the movement of the region of interest, predicting each frame in units of macroblocks. And determining whether the ROI has changed by more than a predetermined threshold by adding the calculated motion vector values.

According to another aspect of the present invention, a method for adjusting the image quality of a region of interest using a mobile communication terminal in a video call, the method comprising the steps of: When the image quality control information is input, storing the image quality control information, (b) determining a region of interest mapped to the key information according to the stored image quality control information with respect to a counterpart image transmitted from a counterpart terminal; (c) determining whether the determined ROI is moved by comparing with the ROI of the previous frame, and (d) if the movement of the ROI is detected as a result of the determination of step (c), motion by movement of the ROI Predicting a vector and adding the predicted motion vector values to determine whether the region of interest has changed by more than a predetermined threshold, (e) If the region of interest has changed by more than a predetermined threshold as a result of step (d), determining whether to reset the region of interest by displaying an image segmentation line on the counterpart image, and (f) If it is determined that the ROI is not requested, the method of controlling a video call quality using a mobile communication terminal is provided.

The image quality control information includes key information, image segmentation information, and image quality control ratio information.

In the step (a), when the image quality control menu is selected during a video call, displaying a video segmentation line on the displayed counterpart image; when a key assigned to the region of interest is selected in the image divided by the displayed video segmentation line And receiving and storing image quality control information including the selected key information and image segmentation information.

In step (d), when the movement is detected in comparison with the region of interest of the previous frame with respect to the determined region of interest, predicting a motion vector due to the movement of the region of interest, predicting each frame in units of macroblocks. And determining whether the ROI has changed by more than a predetermined threshold by adding the calculated motion vector values.

If the movement of the region of interest is not detected as a result of step (c), adjusting and displaying the image quality of the region of interest.

If the region of interest does not change more than a predetermined threshold as a result of the determination in step (d), the region of interest is determined based on the movement information according to the predicted motion vector value, and the image quality of the region of interest is adjusted and displayed. It includes a step.

If it is determined in step (e) that the ROI is requested, the method includes performing step (a).

According to another aspect of the present invention, in the mobile communication terminal for controlling the quality of the region of interest in the other party image transmitted from the other terminal in the video call is provided with a wireless transceiver, input unit, display unit and the photographing unit, the transmission from the other party terminal A region of interest setting module for storing image quality control information including key information assigned to the selected region of interest or generating a quality control request message for the region of interest when the region of interest is selected from the other party's image; When the image quality control request message is received from the region of interest setting module, the region of interest corresponding to the key information included in the received message is determined, and includes a region of interest quality control module for adjusting the image quality of the determined region of interest. For video call quality control The same communication terminal is provided.

When the image quality adjustment menu is selected, the ROI setting module generates a semi-transparent image segmentation line dividing the counterpart image displayed on the display into one or more regions, and mixes the image with the caller image to display the image segmentation line generation unit. A region of interest setter configured to store image quality control information including the selected key information when a key allocated to the region of interest is selected from the image divided by the image segmentation line displayed by the image segmentation line generator, the region of interest setting When the image quality control information is received from the unit, the image quality control request message including the image quality control information is generated and transmitted to the counterpart terminal.

Each region separated by the image segmentation line is mapped to an arbitrary key of the input unit, respectively.

The ROI setting unit transmits the image quality control information to the image quality control request message generation unit when the image quality control of the ROI is set to 'the other terminal', and the image quality control of the ROI is set on the own terminal. ', The image quality control request message is transmitted to the region of interest quality control module so as to adjust the image quality of the selected region of interest in the image transmitted from the other terminal.

When the image quality control request message is received from the counterpart terminal or the region of interest setting module, the ROI segmentation module divides the other party's image according to the video segmentation information included in the message and maps the corresponding key information to the corresponding key information. And a region of interest determiner configured to determine the region of interest as a region of interest, and an image quality controller configured to adjust an image quality of the region of interest by different quantization coefficients of the region of interest and the uninterested region determined by the region of interest determiner.

The ROI image quality adjusting module is configured to generate a motion vector prediction request message when the ROI is moved by comparing the ROI determined by the ROI with the ROI of a previous frame, and detects the ROI movement. When the motion vector prediction request message is received from the unit, the motion vector predicted by the movement of the region of interest is added, and if the region of interest changes by more than a predetermined threshold by adding the predicted motion vector value in each macro block unit for one frame. The controller may further include a motion vector predictor configured to transmit an image segmentation line generation request message to the image segmentation line generator when the region of interest has changed by more than a predetermined threshold.

If the motion vector value does not change by more than a threshold value, the motion vector predictor transmits motion information according to the motion vector value to the ROI determiner so that the ROI is determined based on the motion information.

Accordingly, the present invention can provide a video call quality control method and a terminal capable of making a specific portion of the counterpart image outputted by using a mobile communication terminal in a video call in high quality.

In addition, when a mobile communication terminal in a video call selects an area to be viewed in high quality, the area information is transmitted to the other terminal, and the other terminal makes the video of the selected area high quality, so that a separate device is not required. An image quality adjusting method and a terminal thereof can be provided.

In addition, since the image quality of the region of interest can be adjusted using a mobile communication terminal, a video call image quality adjusting method and a terminal capable of obtaining an optimal image quality from the standpoint of receiving without using a separate encoding time within a limited resource limit are provided. Can provide.

In addition, when the video call is in progress, the receiver selects a region of interest and adds a bit allocation to the region of interest, thereby providing a video call quality control method and a terminal for improving the receiver's satisfaction.

Details of the above-described objects and technical configurations of the present invention and the effects thereof according to the present invention will be more clearly understood by the following detailed description based on the accompanying drawings.

1 is a view showing a quality control system using a mobile communication terminal during a video call according to the present invention, Figure 2 is a block diagram schematically showing the configuration of a mobile communication terminal for controlling the image quality of a specific area of the other party's image according to the present invention, FIG. 3 is a block diagram showing the configuration of the ROI setting module shown in FIG. 2, FIG. 4 is a block diagram showing the configuration of the ROI quality adjusting module shown in FIG. 2, and FIG. 5 is a counterpart image and an image according to the present invention. An example of a screen on which division lines are displayed.

Referring to FIG. 1, the image quality control system using a mobile communication terminal during a video call includes a base station 110a and 110b for transmitting and receiving a wireless section signal with the mobile communication terminals 100a and 100b and a switch 120a that provides a video call path. 120b), a home location register 130 that manages subscriber location information and additional service information.

Hereinafter, a case in which the called terminal user selects an ROI to be viewed in high quality in the caller image will be described as an example.

When the ROI is desired in the caller image displayed during the video call, the called terminal 100b transmits a picture quality control request message including the selected ROI information to the calling terminal 100a.

When the caller terminal 100a receives the image quality control request message from the called terminal 100b, the calling terminal 100a checks the region of interest in the captured image and adjusts the image quality of the image corresponding to the checked region of interest.

In addition, when a region of interest is desired in the caller image displayed during the video call, the called terminal 100b stores image quality control information for the selected region of interest. Then, the called terminal 100b adjusts and displays the image quality of the set ROI with respect to a caller image received thereafter.

A detailed description of the mobile communication terminal performing the above role will be given with reference to FIG. 2.

Referring to FIG. 2, a mobile communication terminal for controlling a specific area image quality of a counterpart image includes a wireless transceiver 200 for transmitting and receiving a radio signal with a base station, an input unit 210 for receiving a user command, and storing various data. The unit 220, the display unit 230 for receiving and displaying the key data and various information signals generated from the input unit 210, the audio unit 240 for outputting a voice signal, shooting for taking a picture of the user's face during a video call The unit 250 includes a video call processing module 260 for a video call, a region of interest setting module 270 for setting a region of interest, and a region of interest quality control module 280 for adjusting the image quality of a selected region of interest. do.

The video call processing module 260 sets up a video call path with a video call counterpart terminal and transmits and receives video call traffic including voice and video.

The ROI setting module 270 transmits an image quality control request message for the selected ROI to the counterpart terminal when the ROI selected for better image quality is selected from the counterpart image transmitted from the counterpart terminal in the video call. To perform.

The ROI setting module 270 may store the image quality control information including the ROI information after receiving the ROI when the ROI selected for better image quality is selected from the other party image transmitted from the other party in the video call. The picture quality of the corresponding ROI may be adjusted according to the picture quality control information on the counterpart image.

Referring to FIG. 3, the ROI setting module 270 that performs the above role, the ROI setting module 270, the image segmentation line generator 272, the ROI setting unit 274, and the image quality control request The message generator 276 is included.

When the image quality adjustment menu is selected by the user, the image segmentation line generator 272 generates a semi-transparent image segmentation line for dividing the counterpart image displayed on the display unit 230 into one or more regions and mixes the image with the counterpart image. To be output as shown in FIG. 5.

Referring to FIG. 5, an image segmentation line for dividing a counterpart image into five regions is displayed. The number of image split lines may be a number preset by a user or a number set by default. Each region separated by the image segmentation line is mapped to an arbitrary key of the input unit 210, respectively.

The image quality control menu is selected by the input unit 210 and may be input by using a menu or by using a pre-assigned hot key.

The ROI setting unit 274 may select the ROI information when the ROI is selected by the user from the counterpart image divided into one or more areas by the image division line generated by the image division line generator 272. Save it.

Each area separated by the image dividing line is mapped to a key of the input unit 210, so that the user can select a desired ROI by selecting a key mapped with the corresponding area.

The ROI setting unit 274 transmits the image quality control information to the image quality control request message generator 276 when the image quality control for the ROI is set to 'the other terminal'.

In addition, when the image quality control for the ROI is set to 'the terminal', the ROI setting unit 274 adjusts the ROI image quality to adjust the image quality of the selected ROI in an image transmitted from the other terminal. The image quality control request message is transmitted to the adjustment module 280.

When the image quality control information is received from the ROI setting unit 274, the image quality control request message generator 276 generates a quality control request message including the image quality control information and transmits the image quality control request message to the counterpart terminal. The image quality control request message may include counterpart terminal identification information, ROI information, image segmentation information, and the like. Here, the ROI information refers to key information mapped to the selected ROI, and the image segmentation information refers to the number of divisions of a corresponding counterpart image.

In addition, the image quality control request message may include counterpart terminal identification information and location information assigned to a key selected from the corresponding video.

When the image quality control request message is received from the counterpart terminal or the ROI setting unit 274, the ROI quality control module 280 determines an ROI corresponding to key information included in the received message, and determines the determined ROI. It controls the quality of the ROI.

Referring to FIG. 4, the ROI image quality adjusting module 280 that performs the above-described role includes the ROI determining unit 282, the image quality adjusting unit 284, and the moving of the ROI. The detector 286 and the motion vector predictor 288 are included.

When the image quality control request message is received from the counterpart terminal or the region of interest setting unit 274, the ROI determiner 282 divides the other party's image according to the image segmentation information included in the message, and the corresponding image is included in the divided image. Determine the area mapped to the key. Then, the ROI determiner 282 determines the determined region as the ROI.

In addition, the ROI determiner 282 determines the ROI by calculating a start address, a length of the width and the length of the block, etc. using the location information assigned to the corresponding key.

The image quality controller 284 encodes the quantization coefficients of the ROI and the uninterested region determined by the ROI determiner 282.

That is, the image quality controller 284 adjusts the image quality of the region of interest by using a principle of allocating more bits to the region of interest than the uninterested region. Here, if the quantization coefficient is large, the compression rate is high but the image quality is low. If the quantization coefficient is small, the compression rate is low, but the image quality is improved.

The region of interest movement detector 286 transmits a motion vector prediction request message to the motion vector predictor 288 when the region of interest determined by the region of interest determiner 282 is moved in comparison with the region of interest of a previous frame. send.

When the motion vector prediction request message is received, the motion vector predictor 288 predicts a motion vector due to the movement of the ROI, and adds the motion vector value predicted in units of macroblocks for one frame to the interest. It is determined whether the area has changed by more than a predetermined threshold. As a result of the determination, when the region of interest changes by more than a predetermined threshold value, the motion vector predictor 288 transmits an image split line generation request message to the image split line generator 272. Then, the image segmentation line generation unit 272 generates a semi-transparent image segmentation line for dividing the counterpart image displayed on the display unit 230 into one or more areas and displays the image segmentation line together with the counterpart image.

If, as a result of the determination, the motion vector value does not change by more than a threshold value, the motion vector predictor 288 transmits the motion information according to the motion vector value to the ROI determiner 284 based on the motion information. To determine the region of interest.

6 is a flowchart illustrating a method of adjusting, by the calling terminal, the image quality of the ROI selected by the called party according to the present invention.

Referring to FIG. 6, when the calling terminal sends a video call (S600), the calling exchange transmits an incoming request message including caller information and called party information to the called exchange (S602).

That is, when the calling terminal sends a video call, the calling exchange requests the subscriber location information (location information and additional service information) of the calling and destination terminals to the home location register, and the home location register requests the incoming routing to the destination exchange. Receive incoming routing information from the destination exchange, and transmit the incoming routing information received from the destination exchange to the originating exchange.

The originating exchange transmits an incoming request message including caller information and called party information to the destination exchange by using the incoming routing information.

Then, the destination exchange requests the incoming by paging the destination terminal, and when the destination terminal accepts the call for the incoming request transmitted from the destination exchange (S604), the originating terminal, the originating exchange, the destination exchange, and the destination terminal. Setup of the video call path is performed (S606).

After the video call path is set between the calling terminal and the called terminal as described above, the calling terminal and the called terminal perform a video call through the set video call path.

The calling terminal transmits video call traffic to the called terminal using the set video call path (S608), and the called terminal displays the calling image of the video call traffic transmitted from the calling terminal (S610).

Then, when the quality control menu is selected by the user (S612), the called terminal displays a semi-transparent image segmentation line on the displayed caller image (S614). The video dividing line is divided into a number set or defaulted by the called party and is mapped with a numeric key.

The called party looks at the displayed image segmentation line and the caller's image, and if a desired region of interest exists, selects a key assigned to the region of interest (S616).

Then, the called terminal generates a quality control request message including the selected key information and transmits it to the calling terminal (S618). The image quality control request message includes key information allocated to the ROI, image segmentation information, and the like.

When the image quality control request message is received from the called terminal, the calling terminal divides the photographed image according to the image segmentation information included in the message and determines a region of interest corresponding to the key information (S620).

That is, the calling terminal divides the captured caller image according to the image segmentation information included in the picture quality control request message, and determines the region corresponding to the key information in the divided caller image as the region of interest.

For example, if the image segmentation information is 4 and the key information is 3, the calling terminal divides the photographed caller image into four, and determines an area corresponding to key 3 among the divided four regions as the region of interest.

After the execution of S620, the calling terminal adjusts image quality by changing the uninterested region and the quantization coefficient with respect to the determined region of interest (S622), and transmits video call traffic including the adjusted image to the called terminal. (S624).

That is, the calling terminal adjusts the image quality by changing the quantization coefficient with respect to the ROI, encodes the image whose quality is adjusted, and transmits the image to the called terminal.

Then, the called terminal displays the caller image transmitted from the calling terminal (S626). In this case, the displayed caller image is an image in which the image quality of the ROI selected by the called party is adjusted.

That is, when the called terminal receives the video call traffic from the calling terminal, the called terminal decodes and outputs the caller image among the video call traffic. The output caller image may be an image in which the image quality of the ROI is adjusted.

7 is a flowchart illustrating a method in which a mobile communication terminal adjusts the image quality of an ROI selected by a counterpart terminal according to the present invention.

Referring to FIG. 7, when the calling terminal receives a video quality control request message from the called terminal (S702) during a video call (S700), the calling terminal divides the photographed image according to the video segmentation information included in the message and the key information. A region of interest corresponding to the determined is determined (S704).

Then, the calling terminal adjusts image quality by changing the uninterested region and the quantization coefficient with respect to the determined region of interest (S706), and transmits video call traffic including the adjusted image to the called terminal (S708). .

Here, the calling terminal encodes the picture quality control for the region of interest requested by the called terminal by applying the same to the next video frame.

After performing S708, the calling terminal determines whether the movement of the ROI is detected (S710).

When the movement of the ROI is detected as a result of the determination of S710, the originating terminal predicts a motion vector due to the movement of the ROI (S412), and adds the motion vector value predicted in units of macroblocks for one frame to the ROI. It is determined whether the area has changed by more than a predetermined threshold (S714).

If the ROI is changed by more than a predetermined threshold as a result of the determination of S714, the calling terminal terminates the step.

If the region of interest does not change more than a predetermined threshold as a result of the determination of S714, the calling terminal determines the region of interest based on the movement information according to the predicted motion vector value (S716), and performs S706. do.

8 is a flowchart illustrating a method in which a called terminal adjusts the image quality of an ROI with respect to a caller image according to the present invention.

Referring to FIG. 8, when the calling terminal transmits a video call (S800), the calling exchange transmits an incoming request message including caller information and called party information to the called exchange (S802).

Then, the destination exchange requests the incoming by paging the destination terminal, and when the destination terminal accepts the call for the incoming request transmitted from the destination exchange (S804), the originating terminal, the originating exchange, the destination exchange, the destination terminal. Setup of the video call path is performed (S806).

After the video call path is set between the calling terminal and the called terminal as described above, the calling terminal and the called terminal perform a video call through the set video call path.

The calling terminal transmits video call traffic to the called terminal using the set video call path (S808), and the called terminal displays the calling image of the video call traffic transmitted from the calling terminal (S810).

Then, when the image quality control menu is selected by the user (S812), the called terminal displays a semi-transparent image segmentation line on the displayed caller image (S814). The video dividing line is divided into a number set or defaulted by the called party and is mapped with a numeric key.

The called party looks at the displayed image segmentation line and the caller's image, and if a desired region of interest exists, selects a key assigned to the region of interest and sets image quality control information (S816).

Then, the called terminal checks the region of interest according to the set image quality control information for the caller image received thereafter, and adjusts and displays the quality of the identified region of interest (S818).

That is, the called terminal identifies the ROI included in the image quality control information in the caller image, and adjusts and displays the image quality of the checked ROI according to the image quality ratio included in the image quality control information.

9 is a flowchart illustrating a method of adjusting, by a mobile communication terminal, an image quality of a region of interest with respect to an image transmitted from a counterpart terminal according to the present invention.

Referring to FIG. 9, when the video communication call is input by the user during the video call (S900), the mobile communication terminal sets the quality control information (S902).

When the quality control information is set as described above, the mobile communication terminal subsequently performs quality control on the ROI of the image transmitted from the counterpart terminal.

When S902 is performed, the mobile communication terminal checks the region of interest in the received caller image (S904). That is, when the counterpart image is received from the counterpart terminal, the mobile terminal decodes the counterpart image and identifies the ROI set in the quality control information in the decoded counterpart image.

After performing S904, the mobile communication terminal determines whether the region of interest is moved by comparing the region of interest with the region of interest of the previous frame (S906).

When the movement of the ROI is detected as a result of the determination of S906, the mobile communication terminal predicts a motion vector due to the movement of the ROI (S908), and adds the motion vector values predicted in units of macroblocks for one frame. It is determined whether the ROI is changed by more than a predetermined threshold (S910).

As a result of the determination in S910, when the region of interest changes by more than a predetermined threshold, the mobile communication terminal displays a semi-transparent image segmentation line on the received image (S912) to determine whether the ROI is requested to be reset by the user. (S914).

As a result of the determination of S914, if the ROI is requested, the mobile terminal performs S902.

If it is determined in S914 that the ROI is not requested, the mobile terminal displays the counterpart image from which the displayed image segmentation line is deleted (S916).

If the movement of the region of interest is not detected as a result of the determination of S906, the mobile communication terminal displays the adjusted region of the region of interest in the received counterpart image (S918).

If, as a result of the determination in S910, the motion vector value does not change more than a threshold value, the mobile communication terminal checks the region of interest based on the moved information (S920) and performs S918.

As such, those skilled in the art will appreciate that the present invention can be implemented in other specific forms without changing the technical spirit or essential features thereof. Therefore, the above-described embodiments are to be understood as illustrative in all respects and not as restrictive. The scope of the present invention is shown by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

The video call quality control method using the mobile communication terminal and the terminal according to the present invention can be applied to a technique for improving the quality of the video call.

1 is a view showing a picture quality control system using a mobile communication terminal during a video call according to the present invention.

2 is a block diagram schematically illustrating a configuration of a mobile communication terminal for controlling image quality of a specific area of a counterpart image according to the present invention.

3 is a block diagram illustrating a configuration of an ROI setting module illustrated in FIG. 2.

4 is a block diagram illustrating a configuration of a region of interest quality adjustment module illustrated in FIG. 2.

5 is an exemplary view showing a counterpart image and an image segmentation line according to the present invention;

6 is a flowchart illustrating a method for adjusting, by the calling terminal, the image quality of the ROI selected by the called party according to the present invention;

7 is a flowchart illustrating a method of adjusting, by a mobile communication terminal, an image quality of a region of interest selected by a counterpart terminal according to the present invention.

8 is a flowchart illustrating a method in which a called terminal according to the present invention adjusts an image quality of a region of interest with respect to a caller image.

9 is a flowchart illustrating a method of controlling, by a mobile communication terminal, image quality of a region of interest with respect to an image transmitted from a counterpart terminal according to the present invention.

<Explanation of symbols for the main parts of the drawings>

100: mobile communication terminal 110: base station

120: exchange 130: home location register

200: wireless transceiver 210: input unit

220: storage unit 230: display unit

240: audio unit 250: recording unit

260: video call processing module 270: region of interest setting module

272: Image segmentation line generator 274: ROI setting unit

276: Image quality control request message generation unit 280: Region of interest quality control module

282: region of interest determiner 284: image quality adjuster

286: region of interest movement detection unit 288: motion vector prediction unit

Claims (24)

In the method of controlling the image quality of a specific area in the video of the other party displayed on the first mobile communication terminal and the second mobile communication terminal in the video call, Displaying an image segmentation line on the displayed first mobile terminal user image when a quality control menu is selected in the second mobile communication terminal on which the first mobile terminal user image is displayed; When a key assigned to the ROI is selected from the image divided by the image dividing line in the second mobile communication terminal, a quality control request message including the selected key information is generated and transmitted to the first mobile communication terminal. step; When the image quality control request message is received at the first mobile communication terminal, dividing the photographed image according to image segmentation information included in the message and determining a region of interest corresponding to the key information in the segmented image; Transmitting, by the first mobile communication terminal, the image quality by adjusting an uninterested region and a quantization coefficient with respect to the determined region of interest and transmitting the image quality to the second mobile communication terminal; and When the second mobile communication terminal detects that the image of the ROI is moved, it predicts the motion vector by the movement of the image of the ROI and displays the image differently depending on whether the sum of the predicted motion vectors is greater than or equal to a predetermined threshold. Making; Video call quality control method using a mobile communication terminal comprising a. The method of claim 1, Displaying the image differently, If the threshold value is greater than or equal to the threshold value, the first mobile communication terminal displays and displays an image segmentation line on the image whose quality is adjusted. If not more than a threshold value video quality control method using a mobile communication terminal, characterized in that for displaying the image adjusted in the first mobile communication terminal. The method of claim 1, The video segmentation line divides the user image of the first mobile communication terminal and is divided into a number set or defaulted by a user. The method of claim 1, And a region divided by the video dividing line is mapped to a key. The method of claim 1, The image quality control request message includes a second mobile communication terminal identification information, key information, video segmentation information, characterized in that the video communication using a mobile communication terminal. The method of claim 1, The second mobile communication terminal further includes decoding and displaying the received video data when the image data of which the image quality of the ROI is adjusted is received from the first mobile communication terminal. How to adjust video call quality. In the method of controlling the image quality of the region of interest using a mobile communication terminal in the video call, (a) When a picture quality control request message including key information and image segmentation information is received from a counterpart terminal, the photographed image is divided according to the image segmentation information, and a region of interest corresponding to the key information is determined from the segmented image. Making; (b) adjusting an image quality by varying an uninterested region and a quantization coefficient with respect to the determined region of interest and transmitting the image quality to the counterpart terminal and determining whether a movement of the region of interest is detected with respect to the captured image; (c) If the movement of the image of the ROI is detected as a result of the determination of step (b), the motion vector is predicted by the movement of the image of the ROI, and the image of the ROI is added by adding the predicted motion vector values. Determining whether a change has occurred over a predetermined threshold; and (d) If the image of the region of interest does not change more than a predetermined threshold as a result of the determination of the step (c), after determining the region of interest based on the movement information according to the predicted motion vector value, the operation (b) Steps to perform Video call quality control method using a mobile communication terminal comprising a. The method of claim 7, wherein If the image of the region of interest has changed by more than a predetermined threshold as a result of the determination of step (c), the method further comprises: encoding the photographed image and transmitting the encoded image to the counterpart terminal. How to adjust the quality. The method of claim 7, wherein In step (c), Predicting a motion vector due to movement of an image of the ROI when the movement of the determined ROI is detected in comparison with the ROI of a previous frame; And determining whether the image of the ROI is changed by more than a predetermined threshold by adding the motion vector values predicted in units of macroblocks for one frame. In the method of controlling the image quality of the region of interest using a mobile communication terminal in the video call,  (a) storing image quality control information when image quality control information including key information and image segmentation information of a region of interest in a counterpart video is input by a user of a terminal displaying the counterpart video during a video call; (b) determining a region of interest mapped with the key information according to the stored image quality control information with respect to the counterpart image transmitted from the counterpart terminal; (c) comparing the determined region of interest with the region of interest of a previous frame to determine whether an image of the region of interest has moved; (d) If the movement of the image of the ROI is detected as a result of the determination of step (c), the motion vector is predicted by the movement of the image of the ROI, and the image of the ROI is added by adding the predicted motion vector values. Determining whether a change has occurred over a predetermined threshold; (e) determining that the ROI is requested by displaying an image segmentation line on the counterpart image when the image of the ROI is changed by more than a predetermined threshold as a result of the determination of step (d); and (f) if the ROI is not requested as a result of the determination of step (e), displaying the counterpart image from which the displayed image segmentation line is deleted; Video call quality control method using a mobile communication terminal comprising a. The method of claim 10, The video quality control information includes key information, video segmentation information, video quality control ratio information, characterized in that the mobile communication terminal. The method of claim 10 In step (a), Displaying a video segmentation line on a displayed counterpart image when a video quality control menu is selected during a video call; And receiving and storing image quality control information including the selected key information and the image segmentation information when a key allocated to the region of interest is selected from the image divided by the displayed image segmentation line. Video call quality control method using the terminal. The method of claim 10 In step (d), Predicting a motion vector due to movement of an image of the ROI when the movement of the determined ROI is detected in comparison with the ROI of a previous frame; And determining whether the image of the ROI is changed by more than a predetermined threshold by adding the motion vector values predicted in units of macroblocks for one frame. The method of claim 10 And if the movement of the image of the ROI is not detected as the result of the determination of step (c), adjusting and displaying the image of the ROI. The method of claim 10 If the image of the region of interest is not changed by more than a predetermined threshold as a result of the determination in step (d), the region of interest is determined based on the movement information according to the predicted motion vector value, and the quality of the determined region of interest is adjusted. And displaying the video call quality using a mobile communication terminal. The method of claim 10 If the ROI is requested as a result of the determination of step (e), performing the step (a), characterized in that the video call quality control method using a mobile communication terminal. In the mobile communication terminal which is provided with a wireless transceiver, input unit, display unit and the photographing unit to adjust the image quality of the region of interest in the counterpart image transmitted from the counterpart terminal in the video call, A region of interest setting module configured to store image quality control information including key information assigned to the selected region of interest or to generate a quality control request message for the region of interest when the region of interest is selected from the counterpart image transmitted from the counterpart terminal; When the image quality control request message is received from the counterpart terminal or the ROI setting module, the ROI image quality control for determining the ROI corresponding to the key information included in the received message and adjusting the image quality of the determined ROI Contains modules, The region of interest quality control module, When a picture quality control request message is received from the counterpart terminal or the interested area setting module, the counterpart image is divided according to the video segmentation information included in the message, and the region mapped with the corresponding key information is determined as the region of interest in the divided image. A region of interest determiner; An image quality controller configured to control an image quality of the ROI by changing quantization coefficients of the ROI and the uninterested region determined by the ROI determiner; A region of interest movement detector configured to generate a motion vector prediction request message when the region of interest is moved by comparing the region of interest determined by the region of interest determiner with a region of interest of a previous frame; When the motion vector prediction request message is received from the region of interest movement detection unit, the motion vector by the movement of the image of the region of interest is predicted, and the motion vector value predicted by each macroblock unit for one frame is added to the region of interest. A motion vector predictor configured to determine whether an image of the image has changed by more than a predetermined threshold value, and if the image of the ROI is changed by more than a predetermined threshold value, transmitting an image segmentation line generation request message to the image segmentation line generator; Mobile communication terminal for adjusting the video call image quality comprising a. The method of claim 17, The ROI setting module may include: an image division line generation unit configured to generate a semi-transparent image division line for dividing the counterpart image displayed on the display into at least one area when the image quality adjustment menu is selected, and display the mixed image with the counterpart image; A region of interest setting unit configured to store image quality control information including the selected key information when a key assigned to the region of interest is selected from the image divided by the image segmentation line displayed by the image segmentation line generator; When the image quality control information is received from the region of interest setter, the image quality control request message generating unit for generating a quality control request message including the image quality control information and transmitting to the counterpart terminal, characterized in that for Mobile terminal. The method of claim 17, Each area separated by the video dividing line is mapped to an arbitrary key of the input unit, respectively. The method of claim 18, The ROI setting unit transmits the image quality control information to the image quality control request message generation unit when the image quality control of the ROI is set to 'the other terminal', and the image quality control of the ROI is set on the own terminal. ', Then the image quality control request message is transmitted to the ROI quality control module to control the image quality of the selected ROI in the image transmitted from the other party's terminal. The method of claim 18, The image quality control request message includes a counterpart terminal identification information, key information mapped to the selected region of interest, and image segmentation information. delete delete The method of claim 17, If the motion vector predictor does not change more than a threshold value, the motion vector predictor transmits motion information based on the motion vector value to the ROI determiner so that the ROI is determined based on the motion information. Mobile communication terminal for video call quality control.

Images