KR101172268B1

KR101172268B1 - Method and System for providing service to hide object during video call

Info

Publication number: KR101172268B1
Application number: KR20070078435A
Authority: KR
Inventors: 김진식
Original assignee: 에스케이텔레콤 주식회사
Priority date: 2007-08-06
Filing date: 2007-08-06
Publication date: 2012-08-08
Also published as: KR20090014465A

Abstract

The present invention provides an object hiding service providing method in a system comprising a switch for performing a video call exchange between the calling terminal and the called terminal, and a video call object hiding server performing an object hiding function. When the object hiding function setting request signal is received from the calling terminal or the called terminal, the session between the video call object hiding server and the calling terminal and the session between the video call object hiding server and the called terminal are set, and (b) the object. And a fixed object hiding request message including location information on the object to be hidden by the terminal generating the hidden function setting request signal to the video call object hiding server, and (c) the hidden object hiding request message from the video call object hiding server. Objects to hide through pattern recognition around the location information contained in It determines the area and generates the object hidden image of the determined hidden object area in the same color as the surroundings and transmits it to the counterpart terminal, and deletes unnecessary background objects or images of people around during the video call and transfers it to the video call path. Therefore, it is possible to maximize the effect of transferring the face of the caller and the necessary video in the bandwidth of the fixed video call path.

Video call, object hidden, background, pattern recognition

Description

Method and System for providing service to hide object during video call

The present invention relates to a method and a system for providing an object hiding service during a video call, which selectively removes unnecessary video traffic captured in the background of the caller during the video call.

A mobile communication terminal having a video call function performs video call transmission and reception together with audio transmission and reception, transmitting video data of the user, that is, video data, and receiving and displaying video data of the other party.

That is, when a video call is attempted from an originating terminal, a call attempt message is transmitted to the exchange through the base station / base station controller, and the exchange acquires routing information to the called terminal through the home location register. Session with the called terminal through the called exchange.

According to this process, the calling terminal and the called terminal can perform a video call while watching each other's video through voice and video transmission and reception.

However, in the conventional video call as described above, since an unnecessary object taken by the camera of the mobile communication terminal or an image of a surrounding person is transmitted to the counterpart terminal, unnecessary traffic is caused, resulting in deterioration of the image quality of the caller during the video call. For this reason, there is a problem in that the caller's face image or important background image cannot be properly delivered.

Accordingly, it is an object of the present invention to provide a method and system for providing an object hiding service during a video call by deleting an unnecessary background object or an image of a neighboring person from his or her video image or a video image of the other party during a video call. have.

Another object of the present invention is to provide a method and system for providing an object hiding service during a video call to solve the problem of the infringement of the rights of others who are invaded during the video call by removing the appearance of another person unnecessarily taken during the video call. have.

It is still another object of the present invention to provide a method and system for providing an object hiding service during a video call by removing unnecessary images during a video call, thereby reducing the amount of video information and improving the quality of the video call image in the upload and download intervals of the video traffic.

According to an aspect of the present invention to achieve the above object, a method for providing an object hiding service in a system comprising a switch for performing a video call exchange between the calling terminal and the called terminal, a video call object hiding server performing an object hiding function (A) When an object hiding function setting request signal is received from the calling terminal or the called terminal in the video call at the exchange, the session between the video call object hiding server and the calling terminal and the video call object hiding server and the called terminal are received. Set a duration session, and (b) transmit a fixed object hiding request message including location information on the object to be hidden by the terminal that has generated the object hiding function setting request signal to the video call object hiding server, and (c) the video. The call object hiding server hides the fixed object in the corresponding video traffic. The image is characterized by determining the object area to be hidden by pattern recognition based on the location information included in the blue message, and generating an object hidden image of the determined hidden object area in the same color as the surroundings and transmitting the image to the counterpart terminal. A method of providing an object hiding service during a call is provided.

In the step (a), when an originating exchange transmits an incoming request message to a destination exchange according to a video call origination from an originating terminal, and the terminating exchange pages the called terminal and the called terminal accepts the call, the originating call is transmitted. When a video call path is set between a terminal, an originating exchange, a destination exchange, and a destination terminal, and an object hiding function setting request signal is received from an originating terminal or a destination terminal in a video call at the exchange, the video call path is released. And a session between the video call object hiding server and the calling terminal and a session between the video call object hiding server and the called terminal.

In the step (b), when the object designation pointer is displayed on the display unit of the corresponding terminal, and the object to be hidden is selected using the displayed object designation pointer, the fixed object hiding request message including the location information on the selected object to be hidden is displayed. It generates and transmits to the video call object hiding server.

According to another aspect of the present invention, a method for providing an object hiding service in a system including a switch for performing a video call exchange between a calling terminal and a called terminal, and a video call object hiding server performing an object hiding function, (a) When the object exchange function setting request signal is received from the calling terminal or the called terminal during the video call at the exchange, the session between the video call object hiding server and the calling terminal and the session between the video call object hiding server and the called terminal are set; (b) the terminal generating the object hiding function setting request signal transmits a floating object hiding request message including a reference call video to the video call object hiding server, and (c) hides the floating object in the video call object hiding server. By using the base call video included in the request message, If there is an area where the RGB value differs from the reference background image by comparing the background image in the received video traffic with the reference background image, an object hiding image having the same color as the surroundings is generated and Provided is a method for providing an object hiding service during a video call.

In the step (b), the reference call image is received from the user by at least one of an image photographed when there is no moving object passing in the background, an image stored in the corresponding terminal, and an image of the same region using the location information of the corresponding terminal. Selected, and transmits a moving object hiding request message including the selected reference call video to the video call object hiding server.

In step (c), the reference call image included in the floating object hiding request message is divided into a caller image and a background image, the separated background image is registered as a reference background image, and the received video traffic is called by the caller image. The image is separated into a background image, and the separated background image is compared with the reference background image to determine whether there is an area where the RGB value differs by more than a threshold value. The object hidden image of the same color is generated and transmitted to the counterpart terminal.

According to still another aspect of the present invention, in a method for providing an object hiding service by a mobile communication terminal in a video call, when a fixed object hiding function setting command is input during a video call, an object designation pointer is displayed and the object designation pointer is provided. When an object to be hidden is selected using the object, the location information about the selected object to be hidden is stored, and the object to be hidden using pattern recognition based on the stored location information in the corresponding video traffic photographed by the photographing unit or transmitted from the counterpart terminal. Determine an area, generate an object hidden image by setting the determined object area to be the same color as the surroundings, and transmit video call traffic including the generated object hidden image to the counterpart terminal; A method of providing a hidden service is provided.

According to another aspect of the present invention, in a method for providing an object hiding service by a mobile communication terminal in a video call, when a floating object hiding function setting command including a reference call video during a video call is input, the floating object hiding function is input. Register the reference background image using the reference call image included in the setting command, and compare the background image in the corresponding video traffic taken by the photographing unit or transmitted from the counterpart terminal with the reference background image, and the RGB value is different from the threshold value. Determines whether there is an area, and if there is an area that differs from the threshold as a result of the determination, an object hiding service during a video call, which generates an object hiding image having the same color as the surrounding area and transmits it to the counterpart terminal. A provision method is provided.

Registering a reference background image using the reference call image is characterized by separating the reference call image into a caller image and a background image, and registering the separated background image as a reference background image.

According to another aspect of the present invention, in a system for providing an object hiding service during a video call between the calling terminal and the called terminal, when a video call is sent from the calling terminal, a video call path setup process between the calling terminal and the called terminal is performed. When the object hiding function setting request signal is received from the calling terminal or the called terminal, a switch for allowing each terminal to establish a session with the video call object hiding server, and a fixed object hiding request message transmitted from the calling terminal or the called terminal. Alternatively, a system for providing an object hiding service during a video call is provided, including a video call object hiding server that performs a fixed object hiding function or a floating object hiding function by operating a corresponding module according to a floating object hiding request message.

When the video call object hiding server receives the fixed object hiding request message from the terminal, the video call object hiding server determines the object area to be hidden through pattern recognition based on the location information included in the fixed object hiding request message, and determines the hidden object area to be determined. Creates a hidden object image with the same color as the surroundings and sends it to the other terminal.

In addition, when the video call object hiding server receives a floating object hiding request message from the terminal, the video call object hiding server registers a reference background image by using the reference call image included in the floating object hiding request message, and the background of the received video traffic. If there is an area where the RGB value differs from the reference background image by more than a threshold value, an object hidden image having the same color as the surrounding area is generated and transmitted to the counterpart terminal.

According to another aspect of the present invention, in a video call object hiding server providing an object hiding service during a video call in conjunction with a mobile communication network, when a fixed object hiding request message or a floating object hiding request message is received from the mobile communication terminal, The object hiding function setting unit for setting the fixed object hiding function setting or the floating object hiding function according to the corresponding message, operates when the fixed object hiding function is set in the object hiding function setting unit, and receives through the session set with the corresponding mobile communication terminal Based on the location information of the object to be hidden in the fixed object hiding request message transmitted from the mobile communication terminal in the received video traffic, the object area to be hidden is determined through pattern recognition, and then the object area to be hidden is set to the same color as the surroundings. Fixed object hiding module and the object hider This function operates when the hidden object hiding function is set in the function setting unit, and there exists an area where the RGB value differs by more than a threshold value by comparing the background image of the video traffic received through the session set with the mobile terminal and a pre-registered reference background image. If so, a system for providing an object hiding service during a video call is provided, including a floating object hiding module for generating an object hiding image having the same color as the surrounding area.

The fixed object hiding module may include a position determination unit determining position information on an object to be hidden included in the fixed object hiding request message in corresponding video traffic transmitted and received during a video call, and position information on an object to be hidden determined by the position recognition unit. A pattern recognition unit for determining an object region to be hidden using at least one of contour recognition, pattern recognition by a predetermined pattern, and pattern recognition by at least one of shadow recognition, and a color of the object region to be hidden as determined by the pattern recognition unit. Including the object hidden image generating unit for generating an object hidden image.

When the floating object hiding request message including the reference call image is received, the floating object hiding module divides the reference call image into a caller image and a background image, and registers the separated background image as a reference background image. Image setting unit, a background image comparison unit for comparing the background image of the corresponding video traffic transmitted and received during the video call with the reference background image to determine whether there is an area that differs by more than the threshold value, the background image comparison unit, the background image comparison unit And an object hidden image generation unit generating an object hidden image by using an area different from the threshold as the same color as the surroundings.

According to another aspect of the present invention, in a system for providing an object hiding service during a video call, when a video call is sent from the originating terminal, the exchange, the user performs a video call path setup process between the calling terminal and the called terminal; The object hidden during a video call comprising a mobile communication terminal that performs a fixed object hiding function or a floating object hiding function by operating the module according to the fixed object hiding function setting command or the floating object hiding function setting command inputted by the user. A service provision system is provided.

According to another aspect of the present invention, in a mobile communication terminal provided with a wireless transceiver, input unit, storage unit, display unit, audio unit, recording unit to provide an object hiding service during a video call, the video call counterpart terminal and the video call path A video call processing module for setting up the device and transmitting / receiving video call traffic, if a fixed object hiding function setting command is input from the user, displays an object designation pointer, and stores the location information on the object to be hidden using the object designation pointer. Then, in the corresponding video traffic taken by the photographing unit or transmitted from the counterpart terminal, the object region to be hidden is determined using pattern recognition based on the stored location information, and the object is hidden by the same color as the surroundings. Fixed object that creates an image and sends it to the other terminal Kim module, when a floating object hiding function setting command is input from the user, registers a reference background image using the reference call image included in the floating object hiding function setting command, and is taken by the photographing unit or transmitted from the counterpart terminal If there is an area where the RGB value is different than the threshold value by comparing the background image of the corresponding video traffic with the reference background image, the floating object hidden which generates an object hidden image having the same color as the surroundings and transmits it to the other terminal Provided is a system for providing an object hiding service during a video call, including the module.

As described above, according to the present invention, since unnecessary background objects or images of people around them are removed from the video image of the user or the video image of the other party during the video call, the image is transferred to the video call route. It is possible to provide a method and a system for providing an object hiding service during a video call to maximize the effect of delivering a face and necessary video.

In addition, it is possible to provide a method and system for providing an object hiding service during a video call to solve the problem of the infringement of the rights of others who are invaded during the video call by removing the appearance of the other person unnecessarily taken during the video call.

In addition, since unnecessary images are removed during the video call, it is possible to provide a method and system for providing an object hiding service during the video call, which reduces the amount of video information and improves the quality of the video call image in the upload and download intervals of the video traffic.

The foregoing and other objects, features, and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: FIG.

1 is a diagram illustrating a system for providing an object hiding service during a video call according to the present invention.

Referring to FIG. 1, an object hiding service providing system during a video call includes a base station / base station controller 110a and 110b for transmitting and receiving a wireless section signal with the mobile communication terminals 100a and 100b, and a switch 120a that provides a video call path. 120b), a home location register 130 that manages subscriber location information and additional service information, and a video call object hiding server 140 that performs a video call object hiding function in association with the exchangers 120a and 120b.

After setting the object hiding function, the mobile communication terminal user designates an unnecessary background object or an image of a neighboring person in his or her video image or the counterpart's video image during a video call, and the specified video is deleted from the video image and output. .

The object hiding function is a fixed object hiding function to hide (or delete) unwanted objects or people when making a call in a static background such as a room or an office, and when making a call in a dynamic background such as a street or a public place. Includes hidden object hiding to hide unwanted objects or people.

In more detail, when the user requests the setting of the fixed object hiding function, an object designation pointer for designating an object to be hidden is displayed on the display unit of the mobile communication terminals 100a and 100b, and the user uses the object designation pointer. Object to hide (delete).

Then, the mobile communication terminal (100a, 100b) transmits a fixed object hiding request message including the location information of the specified object to hide to the video call object hiding server 140.

In addition, if the user wants to set the floating object hiding function, the user selects the reference call video and transmits the floating object hiding request message to the video call object hiding server 140.

The switch 120a or 120b serves to set a video call path between the mobile communication terminals 100a and 100b, and when the object hiding function setting request signal is received from the calling terminal 100a or the called terminal 100b. The sessions between the calling terminal 100a and the called terminal 100b are released, and the calling terminal 100a and the called terminal 100b are set up with the video call object hiding server 140. .

The video call object hiding server 140 operates the corresponding module according to the fixed object hiding request message or the floating object hiding request message transmitted from the calling terminal 100a or the called terminal 100b, thereby fixing the fixed object hiding function or the floating object. Perform the hiding function.

In more detail, the video call object hiding server 140 operates the fixed object hiding module when a fixed object hiding request message is received from the originating or receiving terminal 100a or 100b.

Then, the video passing object hiding server 140 determines the object area to be hidden by pattern recognition based on the positional information on the object to be hidden included in the fixed object hiding request message, and surrounds the determined object area to be hidden with the surroundings. Create a hidden object image of the same color and send it to the other terminal.

In addition, when the video call object hiding server 140 receives the floating object hiding request message from the source or destination terminal 100a or 100b, the video call object hiding server 140 operates the floating object hiding module, and the background image of the video call traffic received during the call. Compares the pre-registered reference background image and the area where the RGB value differs by more than the threshold value is the same color as the surroundings to create an object hidden image.

The video call object hiding server then transmits the generated object hidden image to the counterpart terminal.

Detailed description of the video call object hiding server 140 performing the above role will be described with reference to FIGS. 2 to 4.

2 is a block diagram schematically showing the configuration of a video call object hiding server according to the present invention, FIG. 3 is a block diagram showing in detail the fixed object hiding module shown in FIG. 2, FIG. 4 is a floating object hiding shown in FIG. A block diagram detailing the module.

Referring to FIG. 2, the video call object hiding server includes an object hiding function setting unit 210, a fixed object hiding module 220, a floating object hiding module 230, and a communication unit 240.

When the fixed object hiding request message or the floating object hiding request message is received from the mobile communication terminal through the communication unit, the object hiding function setting unit 210 sets the fixed object hiding function or the floating object hiding function according to the corresponding message. .

Also, when the object hiding function setting unit 210 sets the fixed object hiding function, the fixed object hiding module operates, and when the object hiding function setting function is set, the floating object hiding module operates.

The fixed object hiding module 220 performs pattern recognition based on the location information on the object to be hidden in the fixed object hiding request message transmitted from the mobile communication terminal in the video traffic received through the session established with the mobile communication terminal. After determining the object area to hide through, make the object area to be hidden the same color as the surroundings.

Referring to FIG. 3 with respect to the fixed object hiding module 220 to perform the above role, the fixed object hiding module 220 is a position determining unit 222, pattern recognition unit 224, object hidden image generation unit ( 226).

The location determiner 222 determines the location information on the object to be hidden in the fixed object hiding request message transmitted from the mobile terminal in the video image received during the video call. The fixed object hiding request message includes location information on an object to be hidden, which is specified by the mobile terminal user using an object designation pointer.

The pattern recognizing unit 224 may use a pattern recognition method including contour recognition, recognition by a predetermined pattern, shadow recognition, and the like based on the positional information on the object to be determined determined by the position determining unit 222. Determine the object area to hide.

The object hidden image generator 226 generates an object hidden image by setting the object area to be hidden determined by the pattern recognition unit 224 to have the same color as the surroundings.

The floating object hiding module 230 compares a background image of video traffic received through a session established with a corresponding mobile communication terminal with a pre-registered reference background image, and if there is an area where the RGB value differs by more than a threshold, the corresponding area. It creates a hidden object image with the same color as the surroundings.

The floating object hiding module 230 performing the above role includes a reference background image setting unit 232, a background image comparing unit 234, and an object hiding image generating unit 236 as shown in FIG. 4.

When the reference background image setting unit 232 receives a fluid object hiding request message including a reference call image selected by the corresponding mobile communication terminal user, the reference background image setting unit 232 divides the reference call image into a caller image and a background image, and separates the separation. A registered background image as a reference background image.

The reference call image may refer to a picture taken when there is no moving object in the background, a background picture stored in the mobile communication terminal in advance, and a background picture of the same area using location information of the corresponding mobile communication terminal.

The background image comparison unit 234 compares the background image in the corresponding video traffic photographed by the photographing unit or transmitted from the counterpart terminal with the reference background image set by the reference background image setting unit, and an area where the RGB value differs by more than a threshold value. If present, it is determined as the object area to hide the area.

The object hidden image generator 236 generates an object hidden image by setting the object area to be hidden determined by the background image comparator 234 to have the same color as the surroundings.

5 is a flowchart illustrating a method of performing a fixed object hiding function during a video call according to the present invention, FIG. 6 is a view illustrating an object designation screen to be hidden using an object designation pointer during a video call, and FIG. 6 is a diagram illustrating a screen in which an object to be hidden specified in FIG. 6 is deleted.

Referring to FIG. 5, when the calling terminal sends a video call (S500), the calling exchange transmits an incoming request message including caller information and called party information to the called exchange (S502).

That is, when the calling terminal sends a video call, the calling exchange requests the subscriber location information (location information and additional service information) of the calling and destination terminals to the home location register, and the home location register requests the incoming routing to the destination exchange. Receive incoming routing information from the destination exchange, and transmit the incoming routing information received from the destination exchange to the originating exchange.

Then, the originating exchange transmits the incoming request message including the calling party information and the called party information to the destination exchange by using the incoming routing information.

Then, the destination exchange requests the incoming by paging the destination terminal, and when the destination terminal accepts the call for the incoming request transmitted from the destination exchange (S504), the originating terminal, the originating exchange, the destination exchange, the destination terminal. Setup of the video call path is performed between the steps (S506).

After the video call path is set between the calling terminal and the called terminal as described above, the calling terminal and the called terminal perform a video call through the set video call path.

During the video call between the calling terminal and the called terminal, when the calling terminal user inputs an object hiding function setting command (S508), the calling terminal transmits an object hiding function setting request signal to the calling exchange (S510).

The calling terminal user may input an object hiding function setting command using a predetermined key or the like.

When step 510 is performed, the originating exchange transmits an object hiding function setting request signal to the called exchange (S512) and simultaneously establishes a session between the calling terminal and the video call object hiding server (S514a). The exchange allows a session between the called terminal and the video call object hiding server to be established (S514b).

At this time, the session set in step 506 is released, and the calling terminal and the called terminal are established with the video call object hiding server, respectively.

When step 514 is performed, an object designation pointer for designating an object to be hidden is displayed on the originating terminal, and the originating terminal user designates an object to be hidden as shown in area A of FIG. 6 using the displayed object designation pointer (S516). ). The object designating pointer is for displaying an area or a point, and coordinate information is set.

When step 516 is performed, the calling terminal transmits a fixed object hiding request message including location information of the designated object to be hidden to the video call object hiding server (S518).

Then, the video call object hiding server determines the object area to be hidden by pattern recognition based on the location information included in the fixed object hiding request message in the video image during the video call (S520). That is, the video call object hiding server determines the object area to be hidden using shadow recognition, contour recognition, pattern recognition using pre-registered pattern information, etc. based on the location information.

After performing step 520, the video call object hiding server generates an object hidden image by using the determined object area to be the same color as the surroundings (S522), and generates the video call traffic including the generated object hidden image. It transmits to the called terminal (S524). Then, as shown in FIG. 7, the called terminal displays a video image from which the object to be hidden is deleted.

In the above description, the calling terminal sets the object hiding function as an example, but the object hiding function may be set to both the calling terminal and the called terminal.

8 is a flowchart illustrating a method of performing a floating object hiding function during a video call according to the present invention, FIGS. 9A and 9B are screens illustrating a method of registering a reference background image according to the present invention, and FIG. 10 is a floating object according to the present invention. FIG. 11 is a diagram illustrating a screen during a video call when FIG. 11 is present. FIG. 11 is a diagram illustrating a video image from which a floating object existing in FIG.

Referring to FIG. 8, when the calling terminal transmits a video call (S800), the calling exchange transmits an incoming request message including caller information and called party information to the called exchange (S802).

Then, the destination exchange requests the incoming by paging the destination terminal, and when the destination terminal accepts the call for the incoming request transmitted from the destination exchange (S804), the originating terminal, the originating exchange, the destination exchange, the destination Video call paths are set up between terminals (S806).

During the video call between the calling terminal and the called terminal, when the calling terminal user inputs an object hiding function setting command (S808), the calling terminal transmits an object hiding function setting request signal to the calling exchange (S810).

When step 810 is performed, the originating exchange transmits an object hiding function setting request signal to the called exchange (S812) and simultaneously establishes a session between the calling terminal and the video call object hiding server (S814a). The exchange allows a session between the called terminal and the video call object hiding server to be established (S814b).

At this time, the session established in step 806 is released, and the calling terminal and the called terminal are established with the video call object hiding server, respectively.

After performing step 814, when the calling terminal user selects a reference call video and inputs a floating object hiding request command (S816), the calling terminal sends a floating object hiding request message including the selected reference call video to the video call object. Send to the hidden server (S818).

That is, the calling terminal user requests a floating object hiding function setting using a predetermined key as a reference call image, which is a registered background image or an image photographed when there is no current moving object.

Then, the calling terminal transmits a floating object hiding request message including the selected reference call video to the video call object hiding server.

Then, the video call object hiding server registers the reference background image using the reference call image included in the floating object hiding request message transmitted from the calling terminal, and sets the floating object hiding function (S820).

That is, the video call object hiding server separates the caller image B and the background image from the reference call image transmitted from the calling terminal as shown in FIG. 9A, and then registers the background image as shown in FIG. 9B as the reference background image.

At this time, the video call object hiding server separates the caller image and the background image by extracting the face contour from the reference call image, and registers the separated background image as the reference background image.

After performing step 820, the video call object hiding server receives the video call traffic from the calling terminal (S822), and separates the video traffic of the video call traffic into a caller image and a background image to separate the separated background image. The image is compared with the registered reference background image (S824).

Then, the video call object hiding server determines whether there is an area in which the RGB values of the separated background image and the reference background image differ by more than a threshold (S826).

As a result of the determination in step 826, if there is an area that is different from the reference background image by more than a threshold value, the video call object hiding server generates an object hiding image using the same color as the surrounding area (S828), and hides the generated object. The video call traffic including the image is transmitted to the called terminal (S830).

That is, if there is an area where a color change of more than a threshold occurs, the video call object hiding server determines that a floating object is inserted into the corresponding area and replaces the RGB value of the reference background image.

For example, if the video traffic transmitted from the calling terminal is shown in FIG. 10, the video call object hiding server separates the video traffic into a caller image and a background image, and previews the separated background image as shown in FIG. 9B. Compare with the registered reference background image.

Since the area C is different as a result of the comparison, the video call object hiding server causes the image C as shown in FIG. 11 to be output to the counterpart terminal using the same color as the surroundings.

If, as a result of the determination in step 826, there is no region that differs from the reference background image by more than a threshold value, the video call object hiding server transmits video call traffic including the corresponding video traffic to the called terminal (S832).

12 is a block diagram schematically illustrating a configuration of a mobile communication terminal performing an object hiding function during a video call according to the present invention.

Referring to FIG. 12, a mobile communication terminal performing an object hiding function during a video call includes a wireless transceiver 1200 for transmitting and receiving a wireless signal with a base station, an input unit 1210 for receiving a user command, and storing various data. 1212, a display unit 1230 for receiving and displaying key data and various information signals generated by the input unit 1210, an audio unit 1240 for outputting a voice signal, and recording for photographing a user's face during a video call The unit 1250 includes a fixed object hiding module 1260 that performs a fixed object hiding function, a floating object hiding module 1270 that performs a floating object hiding function, and a video call processing module 1280 for a video call.

The video call processing module 1280 sets up a video call path with a video call counterpart terminal and transmits and receives video call traffic including voice and video.

The fixed object hiding module 1260 determines an object area to be hidden by pattern recognition based on the position information on the object to be hidden selected by the user in the corresponding video traffic photographed through the photographing unit 1250 or transmitted from the counterpart terminal. After that, the role of the object area to be hidden to have the same color as the surrounding, and corresponding to the fixed object hiding module shown in Figure 3 will be omitted.

The floating object hiding module 1270 compares a background image in a corresponding video traffic photographed by the photographing unit 1250 or transmitted from a counterpart terminal with a pre-registered reference background image, and an area in which RGB values differ by more than a threshold value. If present, it plays a role of generating an object hidden image having the same color as the surrounding area, which corresponds to the floating object hiding module shown in FIG. 4, and thus a detailed description thereof will be omitted.

13 is a flowchart illustrating a method of performing a fixed object hiding function by a mobile communication terminal according to the present invention.

Referring to FIG. 13, when the calling terminal transmits a video call (S1300), the calling exchange transmits an incoming request message including caller information and called party information to the called exchange (S1302).

Then, the destination exchange requests the incoming by paging the destination terminal, and when the destination terminal accepts the call for the incoming request transmitted from the destination exchange (S1304), the originating terminal, the originating exchange, the destination exchange, and the destination terminal. Setup of the video call path is performed between the steps (S1306).

During the video call between the calling terminal and the called terminal, when the calling terminal user inputs a fixed object hiding function setting command (S1308), the calling terminal displays an object designation pointer for designating an object to hide (S1310).

That is, the user may input a fixed object hiding function setting command by using a predetermined key, and the object designating pointer may be in a form mapped with a position coordinate. Therefore, when the user designates an object to be hidden using the object designation pointer, location information about the specified object to be hidden is stored together.

If step 1310 is performed, the calling terminal user designates an object to be hidden using the displayed object designation pointer (S1312).

Then, the calling terminal determines the object area to be hidden using pattern recognition based on the location information on the designated object to be hidden in the corresponding video traffic photographed by the photographing unit or transmitted from the counterpart terminal (S1314). An object hiding image is generated by setting the object area to be hidden to the same color as the surroundings (S1316).

Then, the calling terminal transmits the video call traffic including the generated object hidden image to the called terminal (S1318).

14 is a flowchart illustrating a method in which a mobile communication terminal performs a floating object hiding function according to the present invention.

Referring to FIG. 14, when the calling terminal transmits a video call (S1400), the calling exchange transmits an incoming request message including caller information and called party information to the called exchange (S1402).

Then, the destination exchange requests the incoming by paging the destination terminal, and when the destination terminal accepts the call for the incoming request transmitted from the destination exchange (S1404), the originating terminal, the originating exchange, the destination exchange, and the destination terminal. Setup of the video call path is performed between the steps (S1406).

After the execution of step 1406, when the calling terminal user selects the reference call image and inputs the floating object hiding function setting command (S1408), the calling terminal uses the reference call image included in the floating object hiding function setting command as a reference. The background image is registered (S1410). That is, the calling terminal separates the caller image and the background image from the reference call image and registers the separated background image as the reference background image.

After performing step 1410, the calling terminal separates the corresponding video traffic shot or transmitted from the other party's terminal into a calling party image (or called party image) and a background image, and compares the separated background image with a pre-registered reference background image. In operation S1412, it is determined whether there is an area in which the reference background image and the RGB value differ by more than a threshold value (S1414).

If there is an area that differs from the reference background image by more than a threshold as a result of the determination in step 1414, the calling terminal generates an object hidden image by using the area as the same color as the surroundings (S1416), and includes the generated object hidden image. The transmitted video call traffic is transmitted to the called terminal (S1418). That is, if there is an area where a color change of more than a threshold occurs, the video call object hiding server determines that a floating object is inserted into the corresponding area and replaces the RGB value of the reference background image.

If, as a result of the determination in step 1414, there is no region that differs from the reference background image by more than a threshold value, the calling terminal transmits video call traffic including the corresponding video traffic to the called terminal (S1420).

Thus, those skilled in the art will appreciate that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. Therefore, the above-described embodiments are to be understood as illustrative in all respects and not as restrictive. The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

As described above, the method and system for providing an object hiding service in a video call according to the present invention can be applied to the overall technology for improving the service quality of a video call.

1 is a view showing a system for providing an object hiding service during a video call according to the present invention.

Figure 2 is a block diagram schematically showing the configuration of the video call object hiding server according to the present invention.

3 is a block diagram showing in detail the fixed object hiding module shown in FIG.

4 is a block diagram showing in detail the floating object hiding module shown in FIG.

5 is a flowchart illustrating a method of performing a fixed object hiding function during a video call according to the present invention.

FIG. 6 is a diagram illustrating an object designating screen to be hidden using an object designating pointer during a video call according to the present invention; FIG.

FIG. 7 is a diagram illustrating a screen in which an object to be hidden specified in FIG. 6 is deleted according to the present invention; FIG.

8 is a flowchart illustrating a method of performing a hidden object hiding function during a video call according to the present invention.

9A and 9B are screens illustrating a method of registering a reference background image according to the present invention.

10 is a view showing a screen during a video call when there is a floating object according to the present invention.

FIG. 11 is a view showing an image image in which the floating object existing in FIG. 10 is deleted according to the present invention. FIG.

100: mobile communication terminal 110: base station / base station controller

120: exchange 130: home location register

140: video call object hiding server 210: object hiding function setting unit

220: fixed object hiding module 222: position determination unit

224: pattern recognition unit 226, 236: object hidden image generation unit

230: fluid object hiding module 232: reference background image setting unit

234: background image comparison unit 240: communication unit

1200: wireless transceiver 1210: input unit

1220: storage unit 1230: display unit

1240: audio unit 1250: recording unit

1260: fixed object hiding module 1270: floating object hiding module

1280: video call processing module

Claims

A method for providing an object hiding service in a system including a switch for performing a video call exchange between an originating terminal and a called terminal and a video call object hiding server performing an object hiding function,

(a) When an object hiding function setting request signal is received from the calling terminal or the called terminal during the video call at the exchange, the session between the video call object hiding server and the calling terminal and the session between the video call object hiding server and the called terminal are disconnected. Setting up;

(b) transmitting, to the video call object hiding server, a fixed object hiding request message including location information on an object to be hidden by the terminal that has generated the object hiding function setting request signal; and

(c) The video call object hiding server determines an object area to be hidden by pattern recognition based on the location information included in the fixed object hiding request message in the corresponding video traffic during the video call, and determines the determined object area to be hidden. Generating an object hidden image in the same color as the surroundings and transmitting it to the other terminal

Method for providing an object hiding service during a video call comprising a.

The method of claim 1,

The counterpart terminal displays an object hiding image transmitted from the video call object hiding server.

The method of claim 1,

In step (a),

In response to a video call origination from an originating terminal, when an originating exchange transmits an incoming request message to a terminating exchange, and the terminating exchange pages the called terminal and the called terminal accepts the call, the originating terminal, the originating exchange, the incoming call Establishing a video call path between the exchange and the called terminal;

When the object exchange function setting request signal is received from the calling terminal or the called terminal during the video call at the exchange, the video call path is released, the session between the video call object hiding server and the calling terminal, and the video call object hiding server are checked. Method for providing an object hiding service during a video call, characterized in that it comprises the step of setting the session between the destination terminal.

The method of claim 1,

In step (b),

Displaying an object designation pointer on an image displayed by the video call;

If an object to be hidden is selected using the displayed object designation pointer, generating a fixed object hiding request message including location information on the selected object to be transmitted and transmitting the generated object hidden request message to the video call object hiding server. Method of providing an object hiding service during a video call.

5. The method of claim 4,

The method of providing an object hiding service during a video call, characterized in that the object designation pointer is mapped with a location coordinate.

The method of claim 1,

The pattern recognition refers to at least one of contour recognition, shadow recognition, and recognition using a predetermined pattern.

(b) transmitting, by the terminal which generated the object hiding function setting request signal, a floating object hiding request message including a reference call video to the video call object hiding server; and

(c) the video call object hiding server registers a reference background image using the reference call image included in the floating object hiding request message, and compares the background image in the corresponding video traffic transmitted and received with the reference background image. If there is an area whose value differs from the threshold, generating an object hidden image having the same color as the surrounding area and transmitting it to the counterpart terminal.

Method for providing an object hiding service during a video call comprising a.

The method of claim 7, wherein

When the object hiding function setting request signal is received at the exchange, the call path between the calling terminal, the calling exchange, the called exchange, and the called terminal is released, and the session between the video call object hiding server and the calling terminal and the video call object hiding server are released. Method for providing an object hiding service during a video call, characterized in that for setting up a session between the terminal and the called terminal.

The method of claim 7, wherein

In step (b),

Selecting a reference call image from the user by at least one of an image photographed when there is no moving object passing in the background, an image stored in the terminal in advance, and an image of the same region using location information of the terminal;

And transmitting a moving object hiding request message including the selected reference call video to the video call object hiding server.

The method of claim 7, wherein

Step (c) is,

Separating the reference call image included in the floating object hiding request message into a caller image and a background image, and registering the separated background image as a reference background image;

Dividing the received video traffic into a caller image and a background image and comparing the separated background image with the reference background image to determine whether there is an area in which RGB values differ by more than a threshold; and

If there is an area that is different from the threshold as a result of the determination, generating a hidden object image having the same color as the surrounding area and transmitting the hidden object image to the counterpart terminal.

The method of claim 10,

If there is no region that differs from the threshold as a result of the determination, the object hiding service providing method during the video call, characterized in that for transmitting the video traffic to the counterpart terminal.

In the mobile communication terminal in the video call to provide an object hiding service,

Displaying an object designation pointer when a fixed object hiding function setting command is input during a video call;

Storing position information on the selected object to be hidden when the object to be hidden is selected using the object designation pointer;

Based on the stored location information, the object region to be hidden is determined by pattern recognition in the corresponding video traffic captured by the photographing unit or transmitted from the counterpart terminal, and the object hidden image is made by using the determined object region to be the same color as the surroundings. Generating; and

Transmitting video call traffic including the generated object hidden image to a counterpart terminal;

Method for providing an object hiding service during a video call comprising a.

The method of claim 12,

The object designation pointer is a method of providing an object hiding service during a video call, characterized in that the mapping is set with the location coordinates.

Registering a reference background image using a reference call image included in the floating object hiding function setting command when a floating object hiding function setting command including a reference call image is input during a video call;

Comparing the background image in the corresponding video traffic captured by the photographing unit or transmitted from the counterpart terminal with the reference background image to determine whether there is an area where the RGB value differs by more than a threshold; and

If there is an area that is different from the threshold as a result of the determination, generating an object hidden image having the same color as the surrounding area and transmitting it to the counterpart terminal.

Method for providing an object hiding service during a video call comprising a.

The method of claim 14,

If there is no region that differs by more than the threshold value as a result of the determination, the object hiding service providing method of the video call, characterized in that for transmitting the corresponding video traffic.

The method of claim 14,

Registering a reference background image by using the reference call image hides an object during a video call, wherein the reference call image is separated into a caller image and a background image, and the separated background image is registered as a reference background image. How we deliver the service.

The method of claim 14,

Comparing the background image in the corresponding video traffic taken by the photographing unit or transmitted from the counterpart terminal with the reference background image to determine whether there is an area where the RGB value differs by more than a threshold,

Separating the received video traffic into a caller image and a background image;

And comparing the separated background image with the reference background image to determine whether there is an area in which RGB values differ by more than a threshold value.

delete

When the video call is sent from the calling terminal, the video call path setup procedure is performed between the calling terminal and the called terminal. When an object hiding function setting request signal is received from the calling terminal or the called terminal, each terminal is connected to the video call object hiding server. An exchange for establishing a session; And

And a video call object hiding server configured to perform a fixed object hiding function or a floating object hiding function by operating the corresponding module according to the fixed object hiding request message or the floating object hiding request message transmitted from the calling terminal or the called terminal.

When the video call object hiding server receives the fixed object hiding request message from the terminal, the video call object hiding server determines the object area to be hidden by pattern recognition based on the location information included in the fixed object hiding request message in the corresponding video traffic, and the determination. A system for providing an object hiding service during a video call, characterized by generating an object hiding image having an object area to be hidden in the same color as the surroundings and transmitting the same to an opposite terminal.

When the video call object hiding server receives a floating object hiding request message from the terminal, the video call object hiding server registers a reference background image using the reference call image included in the floating object hiding request message, and registers the background image in the received video traffic. If there is an area where the RGB value differs from the reference background image by more than a threshold value, an object hiding service is provided during the video call, which generates an object hiding image having the corresponding color as the surrounding color and transmits it to the counterpart terminal. system.

21. The method according to claim 19 or 20,

The exchanger,

An originating exchange for transmitting an incoming request message to a terminating exchange according to an originating video call from an originating terminal and establishing a session between the originating terminal and the video call object hiding server;

Paging to the destination terminal, and if a paging response, the object hiding service providing system for a video call comprising a call exchanger for setting a session between the video call object hiding server and the called terminal.

21. The method according to claim 19 or 20,

The fixed object hiding request message or the floating object hiding request message is an object hiding service providing system during a video call, characterized in that transmitted through a control logical channel in a session established with the terminal.

In the video call object hiding server providing an object hiding service during a video call in conjunction with a mobile communication network,

An object hiding function setting unit configured to set a fixed object hiding function or a floating object hiding function according to the corresponding message when a fixed object hiding request message or a floating object hiding request message is received from the mobile communication terminal;

It operates when the fixed object hiding function is set in the object hiding function setting unit, and in the object to be hidden included in the fixed object hiding request message transmitted from the mobile communication terminal in the video traffic received through the session established with the mobile communication terminal. A fixed object hiding module which determines an object area to be hidden by pattern recognition based on the position information of the object, and makes the corresponding object area the same color as the surroundings; and

It operates when the floating object hiding function is set in the object hiding function setting unit, and compares the background image of the video traffic received through the established session with the corresponding mobile communication terminal with a pre-registered reference background image, and the RGB value is different from the threshold value. A floating object hiding module that creates an object hiding image with the area the same color as the surroundings, if present.

Video call object hiding server comprising a.

24. The method of claim 23,

The fixed object hiding module,

A position determination unit determining position information on an object to be hidden included in the fixed object hiding request message in corresponding video traffic transmitted and received during a video call;

A pattern recognition unit determining a region of an object to be hidden using pattern recognition based on at least one of contour recognition, recognition by a predetermined pattern, and shadow recognition based on the position information on the object to be determined determined by the position recognition unit;

The video call object hiding server, characterized in that it comprises an object hidden image generation unit for generating an object hidden image to the object area to be hidden as determined by the pattern recognition unit the same color as the surroundings.

24. The method of claim 23,

The floating object hiding module,

A reference background image setting unit that separates the reference call image into a caller image and a background image and registers the separated background image as a reference background image when a fluid object hiding request message including a reference call image is received;

A background image comparison unit which compares a background image of a corresponding video traffic transmitted / received during a video call with the reference background image to determine whether there is an area in which RGB values differ by more than a threshold value;

The video call object hiding server, characterized in that it comprises an object hidden image generation unit for generating an object hidden image by using the background image comparison unit is determined to be the same color as the surrounding area different from the threshold.

delete

A switch for performing a video call path setup process between the calling terminal and the called terminal when the video call is sent from the calling terminal; And

And a mobile communication terminal operating according to a fixed object hiding function setting command or a floating object hiding function setting command input by a user to perform a fixed object hiding function or a floating object hiding function.

When the fixed object hiding function setting command is input, the mobile communication terminal displays an object designation pointer, stores location information on an object to be hidden using the object designation pointer, and then captures the image by the photographing unit or from the counterpart terminal. Based on the stored position information in the transmitted video traffic, the object region to be hidden is determined by using pattern recognition, and the object hidden image is generated by transmitting the determined object region to be the same color as the surroundings and transmitted to the counterpart terminal. System for providing object hiding service during video call.

When the mobile object hiding function setting command is input, the mobile communication terminal registers a reference background image using the reference call image included in the floating object hiding function setting command, and the corresponding photograph is transmitted by the photographing unit or transmitted from the counterpart terminal. If there is an area where the RGB value is different than the threshold value by comparing the background image of the video traffic with the reference background image, an object hiding image having the same color as the surrounding area is generated and transmitted to the counterpart terminal. System to provide object hiding service during video call.

In the mobile communication terminal provided with a wireless transceiver, input unit, storage unit, display unit, audio unit, recording unit to provide an object hiding service during a video call,

A video call processing module for setting up a video call path with a video call counterpart terminal and transmitting and receiving video call traffic;

When a fixed object hiding function setting command is input from a user, an object designation pointer is displayed, the location information on the object to be hidden is stored using the object designation pointer, and the corresponding object transmitted by the photographing unit or taken from the counterpart terminal is stored. A fixed object hiding module configured to determine an object area to be hidden using pattern recognition based on the stored location information in the video traffic, and to generate an object hidden image by transmitting the determined object area to be the same color as the surroundings and to transmit it to the counterpart terminal; And

If a user inputs a floating object hiding function setting command from the user, the reference background image is registered by using the reference call image included in the floating object hiding function setting command, and the corresponding video traffic is taken by the photographing unit or transmitted from the counterpart terminal. A moving object hiding module for generating a hidden object image having the same color as the surroundings and transmitting it to the counterpart terminal when there is an area where the RGB value differs from the reference background image by comparing the background image of Esau to the reference background image.

Mobile communication terminal comprising a.