KR20090026372A

KR20090026372A - System and method for extracting product information in video communication

Info

Publication number: KR20090026372A
Application number: KR20070088068A
Authority: KR
Inventors: 김진식
Original assignee: 에스케이 텔레콤주식회사
Priority date: 2007-08-31
Filing date: 2007-08-31
Publication date: 2009-03-13

Abstract

A product information extraction system during a video call capable of purchasing a product through a mobile communication terminal is provided to extract the image of the product from a video call image of the other party terminal by transmitting the extracted image to the mobile communication terminal of the user. A user designates coordinate value of a product image from image call image of the other party through a keypad. A transceiver(31) of a product information extraction server(30) receives the designated coordinate. A transceiver delivers the coordinate which transceiver receives to an image extraction part(32). The image extraction part extracts the image of the product positioned at the corresponding coordinate from the video call image of the calling/called party. An image synthesis unit synthesizes the extracted image of the product in the video call image of the received user.

Description

System information extraction system and method during video call {SYSTEM AND METHOD FOR EXTRACTING PRODUCT INFORMATION IN VIDEO COMMUNICATION}

The present invention relates to a system and method for extracting product information during a video call. Specifically, an image of an accessory or a garment worn by the other party or a product located in the background of the other party is extracted from the video call image of the other party during the video call. A product information extraction system for synthesizing and displaying the extracted image on a user's video call image or transmitting product information of the corresponding product to the user's mobile communication terminal, and allowing the mobile terminal to purchase the corresponding product if desired. It is about a method.

Recently, with the development of mobile communication technology, a video call capable of making a call while looking at the other party's face has been widely used. When a video call is made, the user makes a call while looking at the other party's face through the video call image displayed on his mobile terminal, so that the product is located in an environment such as an accessory worn by the other party, clothing, or a household of the other party. You will have a chance to observe them.

At this time, the user may want to wear the accessory or the clothing worn by the other party, or may check the detailed information on the corresponding products and have a desire to purchase the user if he / she likes it. In addition, as well as accessories and clothes worn by the call counterpart, detailed product information is also provided for the goods shown in the home or the surrounding indoor wallpaper of the call counterpart, and may have a desire to purchase it if they like it.

However, most of the services currently provided in relation to the video call in the mobile communication terminal are concentrated on the functions for the video call itself. There is no service that provides or facilitates purchase of the product on a mobile communication terminal.

The present invention for solving the problems of the prior art, the user virtually wearing a product such as accessories or clothes worn by the call partner during a video call, or provides detailed product information of the goods located in the environment of the call partner It is an object of the present invention to provide a system and method for extracting product information, which can be purchased on a mobile communication terminal if the corresponding product is liked by a user.

Product information extraction system according to an embodiment of the present invention for achieving the above object, a mobile communication terminal of the user receiving a coordinate value on the video call image of the call partner during the video call; And receiving a coordinate value input to the user's mobile communication terminal, extracting an image of a product located at the received coordinate value from a video call image of a call counterpart, and synthesizing the extracted product image to a video call image of the user. It may be configured to include a product information extraction server for transmitting the image to the user's mobile communication terminal.

Product information extraction system according to another embodiment of the present invention, the mobile communication terminal of the user receiving a coordinate value on the video call image of the call counterpart during the video call; A home network server for storing location information and product information of goods located in a call partner's environment; And receiving a coordinate value input to the mobile communication terminal of the user, receiving product information corresponding to the image of the product located at the received coordinate value from the home network server, and transmitting the received product information to the mobile communication terminal of the user. It may be configured to include an information extraction server.

The product information extraction server according to an embodiment of the present invention receives a coordinate value on a video call image of a call counterpart from a mobile communication terminal of a user during a video call, and transmits and receives a synthesized image to the mobile communication terminal of the user. part; An image extraction unit which extracts an image of a product located at a coordinate value received from the transceiver unit from a video call image of a call counterpart; And an image synthesizing unit which synthesizes the extracted merchandise image into a video call image of the user and transmits the image commodity to the transceiver.

The product information extraction server according to another embodiment of the present invention, a video transmission and reception unit for receiving a coordinate value on the video call image of the call counterpart from the mobile communication terminal of the user, and transmits and receives the product information to the mobile communication terminal of the user ; And a product recognition unit receiving product information corresponding to an image of a product located at a coordinate value received from the transceiver unit from a home network server and transmitting the product information to the transceiver unit.

According to an aspect of the present invention, there is provided a method of extracting product information, the method comprising: receiving a coordinate value on a video call image of a call counterpart by a mobile communication terminal of a user during a video call; Extracting, by the product information extraction server, an image of a product located at a coordinate value input to the user's mobile communication terminal from a video call image of a call counterpart and synthesizing the video call image of the user; And transmitting, by the product information extraction server, the synthesized image to the mobile communication terminal of the user.

According to another aspect of the present invention, there is provided a method of extracting product information, the method comprising: receiving a coordinate value on a video call image of a call counterpart to a mobile communication terminal of a user during a video call; Receiving, by a product information extraction server, product information corresponding to an image of a product located at a coordinate value input to the mobile communication terminal from a home network server; And transmitting, by the product information extraction server, the received product information to the mobile communication terminal of the user.

According to still another aspect of the present invention, there is provided a product information extraction method comprising: receiving, by a product information extraction server, a coordinate value on a video call image of a call counterpart from a mobile communication terminal of a user during a video call; Extracting an image of a product located at a received coordinate value from a video call image of a call counterpart; Synthesizing the extracted product image into a video call image of the user; And transmitting, by the product information extraction server, the synthesized image to the mobile communication terminal of the user.

According to still another aspect of the present invention, there is provided a product information extraction method comprising: receiving, by a product information extraction server, a coordinate value on a video call image of a call counterpart from a mobile communication terminal of a user during a video call; Receiving product information corresponding to an image of a product located at the received coordinate value from a home network server; And transmitting, by the product information extraction server, the product information received from the home network server to the user's mobile communication terminal.

Using the product information extraction system and method according to the present invention, from the video call image of the call counterpart during the video call, the image of the goods worn by the call counterpart or a product located in the environment of the call counterpart is extracted, and the extracted image is By synthesizing the video call image and displaying the product information of the corresponding product to the user's mobile communication terminal, the user may virtually wear the product or receive detailed information of the product. In addition, if you like the product has the advantage that you can purchase the product on the mobile communication terminal.

Hereinafter, with reference to the accompanying drawings looks at in detail with respect to the preferred embodiment of the present invention.

1 is a block diagram showing the configuration of a product information extraction system according to a first embodiment of the present invention. As shown in FIG. 1, the product information extraction system according to the embodiment extracts and extracts an image of a product located at a specified coordinate from a mobile communication terminal 10 of a user, to which a coordinate value of a product image is input during a video call. A commodity information extraction server 30 for synthesizing the commodity image to a video call image of the user and transmitting the commodity image to the user's mobile communication terminal 10 and a commodity purchase server 40 for purchasing the product online. Can be.

The mobile communication terminal 10 of the user is a terminal for making a video call with the mobile communication terminal 20 of the call counterpart via the user side exchange 11 and the exchange 21 of the call counterpart. The user inputs a coordinate value in which the goods of interest are located in the video call image of the other party in the video call to the mobile communication terminal 10, and the input coordinate value is transmitted to the product information extraction server 30.

The product information extraction server 30 may include a transceiver 31, an image extractor 32, and an image synthesizer 33. The transceiver 31 relays video calls between the mobile communication terminals 10 and 20 of the user and the call counterpart, and receives coordinate values on the video call image from the mobile communication terminal 10. The image extractor 32 extracts an image of a product located at a corresponding coordinate, and the image synthesizer 33 synthesizes the extracted product image to a video call image of the user. The synthesized image is transmitted to the user's mobile communication terminal 10 through the transceiver 31.

In addition, in one embodiment of the present invention, the transmission and reception unit 31 of the product information extraction server 30 receives the address of the product purchase server 40 for the purchase of the product and transmits to the user's mobile communication terminal 10 By doing so, it is also possible for the user to purchase the corresponding product in the mobile communication terminal 10 if desired.

2 is a flowchart showing each step of the product information extraction method according to a first embodiment of the present invention. As shown in FIG. 2, in the product information extraction method according to the embodiment, the product information extraction server 30 connects a video call between the user's mobile communication terminal 10 and the call counterpart's mobile communication terminal 20. Beginning to do (S11). In a general video call, the exchange 11 of the user side connects the session with the exchange 21 of the call counterpart to advance the video call.

In the state of making a video call as described above, when a user inputs a specific input key or a predetermined function code to his mobile communication terminal 10, the product information extraction function operates, and the product information extraction server ( In the transmission / reception unit 31 of 30, a video call session is connected to the mobile communication terminals 10 and 20 of the user and the call counterpart, respectively, to proceed with the video call. The user may proceed with the video call as before, except that the video call is performed via the product information extraction server 30.

During a video call, if a product of interest is found in the video call image of the call counterpart, the user uses the input key of the mobile communication terminal 10 to display the corresponding product on the video call image of the other party displayed on his mobile communication terminal 10. The coordinate value is located (S12). For example, a user may designate a coordinate value at which a product of interest is located by moving a cursor displayed on a video call image using an arrow input key of the mobile communication terminal 10.

3A illustrates a mobile communication terminal 10 displaying a video call image of a user and a call counterpart during a video call. Referring to FIG. 3A, the video call image 110 of the other party and the video call image 120 of the user may be simultaneously displayed on the screen 100 of the mobile communication terminal 10. In this case, the user designates a coordinate value on the image where the earring 111, which is an item of interest, is located in the video call image 110 of the counterpart by an input through a keypad of the mobile communication terminal 10. The designated coordinate value is transmitted to the transmission / reception unit 31 of the product information extraction server 30.

The transmitter / receiver 31 transmits the received coordinate values to the image extractor 32, and the image extractor 32 extracts an image of a product located at a corresponding coordinate from the video call image of the call counterpart by pattern recognition. (S13). The extracted product image is transmitted to the image synthesizer 33 of the product information extraction server 30.

The image synthesizing unit 33 synthesizes the commodity image extracted by the image extracting unit 32 to the video call image of the user received by the transmitting and receiving unit 31 for the video call. The synthesized image is transmitted to the user's mobile communication terminal 10 through the transceiver 31 (S15). For example, the transceiver 31 may transmit the synthesized image to the mobile communication terminal 10 of the user through the video logical channel during the video call. The synthesized image may be generated in the form of a still image, or may be synthesized into a video image of a user for a video call and generated in the form of a video image.

3B shows a user's mobile communication terminal 10 displaying a synthesized image according to the first embodiment. Referring to FIG. 3B, the earring 111 seen through the video call image 110 of the call counterpart is synthesized with the image of the user, so that the image 120 in which the user wears the earring 121 is the mobile communication terminal 10. Are shown in.

3A and 3B illustrate still images obtained by synthesizing a product image extracted by the image extracting unit 32 with one video call image stopped during the video call. However, as described above, the extracted merchandise image may be synthesized into a video image for a video call, and the synthesized video image may be transmitted to the user's mobile communication terminal 10. The user may check his or her image wearing virtually the corresponding product by using a still image or a moving image displayed on the mobile communication terminal 10 of the user.

In addition, in an embodiment of the present invention, if the user likes the product, the user may access the web page for purchasing the product directly from the mobile communication terminal 10 and purchase the product. When a specific input key or a predetermined function code for a product purchase is input from the user to the mobile communication terminal 10, the transceiver 31 of the product information extraction server 30 may purchase a product purchase server 40 to purchase the corresponding product. ) Is received from the product purchase server 40 and transmitted to the user's mobile communication terminal 10 (S16). For example, the address of the product purchase server 40 is transmitted to the user's mobile communication terminal 10 through the data logical channel during the video call.

The user may purchase the corresponding product by accessing the product purchase server 40 from his mobile communication terminal 10 using the received product purchase server 40 address (S17). In addition, instead of purchasing the corresponding product immediately, it is also possible to store the product in the purchase wish list in the product purchase server 40 and then purchase the product by accessing the product purchase server 40 at a desired time after the end of the video call.

4 is a block diagram showing the configuration of a product information extraction system according to a second embodiment of the present invention. Compared to the product information extraction system according to the first embodiment of the present invention shown in Figure 1, the product information extraction system according to the second embodiment of the configuration of the product information extraction server 30 and the home network server 50 Only the points which are further included are different.

In the product information extraction system according to the second embodiment, the mobile communication terminal 10 of the user makes a video call with the mobile communication terminal 20 of the call counterpart via the transceiver 31 of the product information extraction server 30. This is the same as the first embodiment described above with reference to FIG. 1 and a detailed description thereof will be omitted.

In the second embodiment, the product information extraction server 30 is configured to include a transceiver 31, an image extraction unit 32 and a product recognition unit 34. Since the functions and operations of the transceiver 31 and the image extractor 32 are the same as those of the first embodiment described above with reference to FIG. 1, a detailed description thereof will be omitted. However, in the second embodiment, the transmitting and receiving unit 31 includes terminal location information including information such as the location of the mobile communication terminal 20 from the mobile communication terminal 20 of the call counterpart and the direction of the camera of the terminal. May be received.

The product recognition unit 34 of the product information extraction server 30 inquires the product information corresponding to the product image extracted by the image extraction unit 32 and transmits the information to the user's mobile communication terminal 10. At this time, the product recognition unit 34 retrieves the product information corresponding to the product image extracted by the image extraction unit 32 from the home network server 50, or receives it from the mobile communication terminal 20 of the call counterpart. The product information may be received from the home network server 50 using the terminal location information.

5 is a flowchart showing each step of the product information extraction method according to a second embodiment of the present invention. Referring to FIG. 5, when a product information extraction function is requested to be performed by the user's mobile communication terminal 10, the transceiver 31 is connected between the mobile communication terminal 10 of the user and the mobile communication terminal 20 of the call counterpart. The video call of the user is relayed (S21). If a product is found that is of interest to an image of the background other than the call partner in the video call image of the call counterpart during the video call, the user may use the input key of the mobile communication terminal 10 to display the corresponding product on the video call image of the call partner. Specify the located coordinate value (S12).

6A illustrates a mobile communication terminal 10 displaying a video call image of a user and a call counterpart. Referring to FIG. 6A, the video call image 110 of the other party and the video call image 120 of the user are simultaneously displayed on the screen 100 of the mobile communication terminal 10. In this case, the user designates a coordinate value at which the refrigerator 112 which is a product of interest is located among the products displayed on the background part of the video call image 110 of the other party by an input through the keypad of the mobile communication terminal 10. The designated coordinate value is transmitted to the transmission / reception unit 31 of the product information extraction server 30.

When the coordinate value on the video call image is received from the mobile communication terminal 10 of the user by the transmitting / receiving unit 31, the image extracting unit 32 displays an image of a product located at the coordinates received from the video call image. The pattern recognition confirms that the product image exists on the background rather than on the background. When it is confirmed that the product located at the designated coordinates is a product located in the background, the product information extraction server 30 may receive the corresponding product information by using the image extracted from the corresponding coordinates or by using the location information of the terminal of the call counterpart. Can be.

First, a case of receiving product information using the extracted image will be described. In this case, the image extracting unit 32 extracts the image of the product located at the coordinate value received by the transmitting and receiving unit 31 from the video call image of the call counterpart, as in the first embodiment described above (S23). The extracted product image is transferred to the product recognition unit 34, and the product recognition unit 34 accesses the home network server 50 of the call counterpart and receives product information corresponding to the extracted image (S24). The home network server 50 of the call counterpart stores product information located in the environment of the call counterpart, and the product recognition unit 34 stores the images extracted by the image extractor 32 in the home network server 50. In comparison with the image of the product, the product information having the closest image may be determined and received as the corresponding product information.

On the other hand, in another embodiment of the present invention, the product information extraction server 30 may recognize the product using the terminal location information of the call counterpart. In this case, the transmitter / receiver 31 of the product information extraction server 30 is located in the room of the mobile communication terminal 20 of the call counterpart and the camera of the mobile communication terminal 20 from the user's mobile communication terminal 30. Terminal location information including the heading direction is received (S23). The received terminal position information is transmitted to the product recognition unit 34, and the product recognition unit 34 connects to the home network server 50 to display the terminal position information and the coordinate values received from the user's mobile communication terminal 10. By using the received information of the goods located at the point corresponding to the coordinate value received in the environment of the other party (S24).

The product information received by the product recognition unit 34 using the extracted image or the terminal location information is transmitted to the transceiver unit 31, and the transceiver unit 31 transmits the product information to the user's mobile communication terminal 10. (S25). For example, the transceiver 31 may transmit product information to the user's mobile communication terminal 10 through a data logical channel during a video call.

6B illustrates a mobile communication terminal in which product information is displayed according to the second embodiment. Referring to FIG. 6B, product information including an enlarged image 112 of a product designated by the user is displayed on the screen 100 of the user's mobile communication terminal 10, so that the user can easily access the environment of the call counterpart. You can check the detailed information of the product located.

In addition, in an embodiment of the present invention, if the user likes the product, the user may access the web page where the product can be purchased from the mobile communication terminal 10 and purchase the product. In this case, the transceiver 31 of the product information extraction server 30 receives the address of the product purchase server 40 for the purchase of the corresponding product and transmits it to the user's mobile communication terminal 10 (S26). In operation S27, the mobile communication terminal 10 accesses the product purchase server 40 and purchases the corresponding product. Steps S26 and S27 are the same as steps S16 and S17 of the method for extracting product information according to the first embodiment described above with reference to FIG.

Using the product information extraction system and method according to the present invention, by showing the image of the user's appearance and accessories or clothing worn by the other party during the video call in real time, the virtual appearance of the user wearing the product Can be observed and purchased on the mobile communication terminal if the product is satisfactory. In addition, when selecting a product located in the environment of the other party of the call, in conjunction with the home network server of the other party, there is an advantage that you can receive the product information of the selected product in the user's mobile communication terminal and purchase on the mobile communication terminal if you like.

While specific embodiments of the present invention have been illustrated and described, the technical spirit of the present invention is not limited to the accompanying drawings and the above description, and various modifications can be made without departing from the spirit of the present invention. It will be apparent to those skilled in the art, and variations of this form will be regarded as belonging to the claims of the present invention without departing from the spirit of the present invention.

1 is a block diagram showing the configuration of a product information extraction system according to a first embodiment of the present invention.

2 is a flowchart showing each step of the product information extraction method according to a first embodiment of the present invention.

3A is a schematic diagram illustrating a mobile communication terminal displaying a video call image of a user and a call counterpart.

3B is a schematic diagram showing a mobile communication terminal on which a synthesized image is displayed according to the first embodiment of the present invention.

4 is a block diagram showing the configuration of a product information extraction system according to a second embodiment of the present invention.

5 is a flowchart showing each step of the product information extraction method according to a second embodiment of the present invention.

6A is a schematic diagram illustrating a mobile communication terminal displaying a video call image of a user and a call counterpart.

6B is a schematic diagram illustrating a mobile communication terminal displaying product information according to a second embodiment of the present invention.

Claims

A mobile communication terminal of a user receiving a coordinate value on a video call image of a call counterpart during a video call; And

Receives the coordinate value input to the user's mobile communication terminal, extracts the image of the product located at the received coordinate value from the video call image of the other party, and synthesizes the extracted product image to the video call image of the user And a product information extraction server for transmitting the image to the mobile communication terminal of the user.

The method of claim 1,

The mobile communication terminal further includes a product purchase server for purchasing a product,

The product information extraction server, product information extraction system, characterized in that for transmitting the product purchase server address corresponding to the product located in the received coordinate value to the mobile communication terminal of the user.

A mobile communication terminal of a user receiving coordinate values on a video call image of a call counterpart during a video call;

A home network server for storing location information and product information of goods located in a call partner's environment; And

A product information extraction server for receiving a coordinate value input to the user's mobile communication terminal, receiving product information corresponding to an image of a product located at the received coordinate value from the home network server and transmitting the product information to the user's mobile communication terminal. Product information extraction system comprising a.

The method of claim 3, wherein

Further comprising a mobile communication terminal of the call counterpart for transmitting the terminal location information including the position of the mobile communication terminal of the call counterpart and the direction of the camera to the product information extraction server,

The product information extraction server, product information extraction system, characterized in that to receive the product information from the home network server using the transmitted terminal location information.

The method of claim 3, wherein

The product information extraction server extracts an image of a product located at a coordinate value received from the user's mobile communication terminal, and compares the extracted product image with product information stored in a home network server to receive corresponding product information. Product information extraction system characterized in that.

The method of claim 3, wherein

A transmitting / receiving unit which receives coordinate values on a video call image of a call counterpart from a mobile communication terminal of a user during a video call and transmits the synthesized image to the mobile communication terminal of the user;

An image extraction unit which extracts an image of a product located at a coordinate value received from the transceiver unit from a video call image of a call counterpart; And

And an image synthesizing unit which synthesizes the extracted merchandise image to the user's video call image and transmits the image to the transceiver.

The method of claim 7, wherein

The transceiver unit,

And a product purchase server address for purchasing a product located at a received coordinate value in the mobile communication terminal of the user to the mobile communication terminal of the user.

A transmission / reception unit for receiving a coordinate value on a video call image of a call counterpart from a mobile communication terminal of a user during a video call and transmitting product information to the mobile communication terminal of the user; And

And a product recognition unit configured to receive product information corresponding to an image of a product located at a coordinate value received from the transceiver unit from a home network server and transmit the product information to the transceiver unit.

The method of claim 9,

The transceiver unit receives terminal location information including a location of a mobile communication terminal of a call counterpart and a camera direction,

The product recognition unit, product information extraction server, characterized in that for receiving the product information from the home network server using the terminal location information received from the transceiver.

The method of claim 9,

The apparatus may further include an image extractor configured to extract an image of a product located at a coordinate value received from the transceiver to a video call image of a call counterpart.

The product recognition unit, product information extraction server, characterized in that to receive the corresponding product information by comparing the product image extracted by the image extraction unit with the product information stored in the home network server.

The method of claim 9,

The transceiver unit,

Receiving a coordinate value on a video call image of a call counterpart by a mobile communication terminal of a user during a video call;

Extracting, by the product information extraction server, an image of a product located at a coordinate value input to the user's mobile communication terminal from a video call image of a call counterpart and synthesizing the video call image of the user; And

And transmitting, by the product information extraction server, the synthesized image to the user's mobile communication terminal.

The method of claim 13,

And transmitting, by the product information extraction server, a product purchase server address for purchasing a product located at a coordinate value input to the user's mobile communication terminal to the user's mobile communication terminal. Way.

Receiving coordinate values on a video call image of a call counterpart to a mobile communication terminal of a user during a video call;

Receiving, by a product information extraction server, product information corresponding to an image of a product located at a coordinate value input to the mobile communication terminal from a home network server; And

And transmitting the received product information to the mobile communication terminal of the user by the product information extraction server.

The method of claim 15,

Prior to the receiving from the home network server, the product information extraction server further comprises the step of receiving the terminal location information, including the location of the mobile communication terminal of the call counterpart and the direction of the camera from the mobile communication terminal of the call counterpart ,

The receiving of the product information from the home network server may include: receiving, by the product information extraction server, the product information from the home network server using the received terminal location information.

The method of claim 15,

Before receiving from the home network server, the product information extraction server extracts the image of the product located at the coordinate value input to the mobile communication terminal of the user from the video call image of the other party,

The receiving from the home network server may include comparing the extracted product image with the product information stored in the home network server, and receiving the corresponding product information from the home network server. How to extract product information.

The method of claim 15,

Receiving, by the product information extraction server, the video call image from the mobile communication terminal of the video call on the video call image of the call counterpart;

Extracting an image of a product located at a received coordinate value from a video call image of a call counterpart;

Synthesizing the extracted product image into a video call image of the user; And

The method of claim 19,

And transmitting, by the product information extraction server, a product purchase server address for purchasing a product located at a received coordinate value to the user's mobile communication terminal.

Receiving product information corresponding to an image of a product located at the received coordinate value from a home network server; And

And transmitting, by the product information extraction server, the product information received from the home network server to the user's mobile communication terminal.

The method of claim 21,

Before receiving from the home network server, further comprising the step of receiving the terminal location information including the location of the mobile communication terminal of the call counterpart and the direction of the camera from the mobile communication terminal of the call counterpart,

Receiving from the home network server, Product information extraction method comprising the step of receiving product information from the home network server using the received terminal location information.

The method of claim 21,

Before the step of receiving from the home network server, extracting an image of a product located at a coordinate value input to the user's mobile communication terminal from a video call image of a call counterpart;

Receiving from the home network server, Product information extraction method comprising the step of receiving the corresponding product information from the home network server by comparing the extracted product image with the product information stored in the home network server.

The method of claim 21,