KR20190103786A - Device, method and computer program for providing shopping service in response to voice command - Google Patents

Abstract

A media reproduction device providing a voice-based shopping service includes: a voice shopping section setting part receiving a first command corresponding to the beginning of shopping from a user during the broadcasting of a broadcast program and receiving a second command corresponding to the termination of shopping to set a voice shopping section; a search condition input part receiving at least one product search condition from the user during the set voice shopping section; an object detection part detecting at least one object corresponding to the product search condition from a screen broadcasting the broadcast program; and a product information output part outputting product information corresponding to the detected object received from a commerce server. The information of the detected object can include at least one among position information of the object, identification information of the object, image information of the object and attribute information of the object from the broadcasting screen. The present invention is capable of providing corresponding product information at a desired moment.

Description

DEVICE, METHOD AND COMPUTER PROGRAM FOR PROVIDING SHOPPING SERVICE IN RESPONSE TO VOICE COMMAND}

The present invention relates to an apparatus, a method and a computer readable medium for providing a voice-based shopping service.

T-Commerce is a word that combines TV and commerce. It is a service that allows you to conduct commercial transactions such as searching for product information, purchasing, and paying with only TV and remote control through digital data broadcasting.

When the user inputs the T-commerce button on the remote control to search for or purchase a product worn by the performer who appeared in the broadcast program, the media player outputs a search result for the product and displays a T-commerce search screen. When an input for purchasing the corresponding product is received from the product, the product is purchased.

When using the conventional T-commerce service as described above, there is a problem that viewing of the broadcast program is temporarily inconvenient because the product search and purchase page must be displayed on the broadcast screen, and the user desires through the conventional T-commerce service. The disadvantage is that it is difficult to search or purchase different products at the same time.

Korean Patent Publication No. 2015-0100583 (2015.09.02.published)

The present invention is to solve the above-mentioned problems of the prior art, and detects at least one object according to a voice command for at least one product search condition received from the user during the broadcast of the broadcast program, the at least one object detected We want to output the product information corresponding to the broadcast screen. However, the technical problem to be achieved by the present embodiment is not limited to the technical problems as described above, and other technical problems may exist.

As a technical means for achieving the above-described technical problem, the media playback apparatus for providing a voice-based shopping service according to the first aspect of the present invention receives a first command corresponding to the start of shopping from the user during the broadcast program, A voice shopping section setting unit configured to set a voice shopping section by receiving a second command corresponding to the end of shopping; A search condition input unit which receives at least one product search condition from the user during the set voice shopping section; An object detector for detecting at least one object corresponding to the at least one product search condition from a broadcast screen of the broadcast program; And a product information output unit configured to output product information corresponding to the detected object received from a commerce server, wherein the detected object information includes location information of the object on the broadcast screen, identification information of the object, and It may include at least one of image information and attribute information of the object.

 In the method for providing a voice-based shopping service in a media playback apparatus according to the second aspect of the present invention, a user receives a first command corresponding to a start of shopping and a second command corresponding to a stop of shopping while the broadcast program is being broadcast. Receiving and setting a voice shopping section; Receiving at least one product search condition from the user during the set voice shopping period; Detecting at least one object corresponding to the at least one product search condition from a broadcast screen of the broadcast program; And outputting commodity information corresponding to the detected object received from a commerce server, wherein the detected object information includes location information of the object on the broadcast screen, identification information of the object, and It may include at least one of image information and attribute information.

A computer readable medium comprising a sequence of instructions for providing a voice-based shopping service according to a third aspect of the present invention, when executed by a computing device mounted to a media playback device, wherein the computing device is a user during the broadcast of a broadcast program. Receiving a first command corresponding to the start of shopping from the user, receiving a second command corresponding to the end of shopping, setting a voice shopping section, receiving at least one product search condition from the user during the set voice shopping section, And a sequence of instructions for detecting at least one object corresponding to the at least one product search condition from the broadcast screen of the broadcast program and outputting product information corresponding to the detected object received from a commerce server. Information of the detected object is the broadcast screen Of the location information of the object, the identification of the object information, image information and attribute information of the object in the document may include at least one.

The above-mentioned means for solving the problems are merely exemplary, and should not be construed to limit the present invention. In addition to the exemplary embodiments described above, there may be additional embodiments described in the drawings and detailed description of the invention.

According to any one of the above-described problem solving means of the present invention, the present invention can detect the merchandise object in real time according to the user's voice command and output the information on the merchandise object on the broadcast screen while watching the user's broadcast program .

In addition, while watching a broadcast program, a user inputs a command for starting shopping and ending shopping to set a voice shopping section, and the voice command received from the user in the corresponding voice shopping section is regarded as a voice command related to shopping. This saves users the hassle of having to call a caller.

In addition, the present invention applies a product search condition input from the user during the voice shopping interval to a plurality of broadcast screens (scenes) of the broadcast program to detect the object corresponding to the product search conditions from the plurality of broadcast screens, and to the detected object Since the corresponding product information is overlaid and provided on the broadcast screen, product information of different products desired by the user may be provided without disturbing the user's viewing of the broadcast program.

In addition, the present invention can receive the input for the product search conditions at the time when the user wants to search for the product, the user can immediately provide the corresponding product information at the desired time.

1 is a block diagram of a voice-based shopping service providing system according to an embodiment of the present invention.
FIG. 2 is a block diagram of the media playback device shown in FIG. 1 according to an embodiment of the present invention.
3A to 3G are diagrams for describing a method of providing a voice-based shopping service while broadcasting a broadcast program according to an embodiment of the present invention.
4 is a flowchart illustrating a voice-based shopping service providing method according to an embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is "connected" to another part, this includes not only "directly connected" but also "electrically connected" with another element in between. . In addition, when a part is said to "include" a certain component, which means that it may further include other components, except to exclude other components unless otherwise stated.

In the present specification, the term 'unit' includes a unit realized by hardware, a unit realized by software, and a unit realized by both. In addition, one unit may be realized using two or more pieces of hardware, and two or more units may be realized by one piece of hardware.

Some of the operations or functions described as being performed by a terminal or a device in the present specification may instead be performed in a server connected to the terminal or device. Similarly, some of the operations or functions described as being performed by the server may be performed by a terminal or a device connected to the server.

Hereinafter, with reference to the accompanying configuration diagram or processing flow chart, it will be described in detail for the practice of the present invention.

1 is a block diagram of a voice-based shopping service providing system according to an embodiment of the present invention.

Referring to FIG. 1, a voice-based shopping service providing system may include a media playback device 100 and a commerce server 110. However, since the voice-based shopping service providing system of FIG. 1 is only an embodiment of the present invention, the present invention is not limitedly interpreted through FIG. 1 and may be configured differently from FIG. 1 according to various embodiments of the present invention. It may be.

In general, each component of the voice-based shopping service providing system of FIG. 1 is connected through a network (not shown). A network refers to a connection structure capable of exchanging information between nodes such as terminals and servers, and includes a local area network (LAN), a wide area network (WAN), and the Internet (WWW: World). Wide Web), wired / wireless data communication network, telephone network, wired / wireless television communication network, and the like. Examples of wireless data networks include 3G, 4G, 5G, 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), World Interoperability for Microwave Access (WIMAX), Wi-Fi, Bluetooth communication, Infrared communication, Ultrasound Communication, visible light communication (VLC), liFi (LiFi), and the like, but are not limited thereto.

The media player 100 may set a voice shopping section by receiving a command corresponding to a shopping start and a shopping end from the user while the broadcast program is being broadcast.

The media playback apparatus 100 may detect at least one object corresponding to the at least one product search condition from the broadcast screen of the broadcast program when the user receives the at least one product search condition during the set voice shopping period.

The media playback apparatus 100 may request product information corresponding to at least one object detected from the commerce server 110, and receive and output product information corresponding to the object from the commerce server 110. Here, an example of the media playback apparatus 100 may include a smart TV, an IPTV set top box, and the like.

Hereinafter, the operation of each component of the voice-based shopping service providing system of FIG. 1 will be described in more detail.

2 is a block diagram of the media playback apparatus 100 shown in FIG. 1 according to an embodiment of the present invention.

Referring to FIG. 2, the media playback apparatus 100 includes a voice shopping section setting unit 200, a search condition input unit 210, an object detector 220, a product information output unit 230, an attribute information input unit 240, and the like. The storage unit 250 may be included. However, the media reproducing apparatus 100 shown in FIG. 2 is just one implementation example of the present invention, and various modifications are possible based on the components shown in FIG. 2. Hereinafter, a description will be given with reference to FIGS. 3A to 3G together with FIG. 2.

The voice shopping section setting unit 200 may receive a first command corresponding to the start of shopping from the user while the broadcast program is being broadcast, and set the voice shopping section by receiving a second command corresponding to the end of shopping. At this time, when the first command corresponding to the start of shopping is received from the user, a voice shopping section for providing a voice-based shopping service may be set until the second command corresponding to the end of shopping is input.

The search condition inputter 210 may receive at least one product search condition from the user during the set voice shopping section.

The object detector 220 may detect at least one object corresponding to at least one product search condition from the broadcast screen of the broadcast program.

The storage unit 250 may map identification information of the broadcast screen including the detected object and information of the detected object and store the mapping information in the shopping cart database.

The product information output unit 230 may output an edge image of the detected object by overlaying it on the screen of the broadcast program.

The product information output unit 230 may output product information corresponding to the detected object received from the commerce server 110.

3A to 3D as a first embodiment, if a voice shopping section is set after a user receives a first command corresponding to the start of shopping while watching a broadcast program, the search condition input unit 210 displays the user. A first product search condition (eg, “Find That T-Shirt”) may be input from the user.

When the object detector 220 receives a voice command corresponding to the first product search condition, the object detector 220 may capture the first broadcast screen 300 of the broadcast program that is being streamed at the time when the voice command is received.

Thereafter, the object detector 220 may detect the first object 31, the second object 33, and the third object 35 corresponding to the first product search condition on the captured first broadcast screen 300. have. In this case, the object detector 220 may determine an image of an object of each of the first object 31, the second object 33, and the third object 35 and coordinates of the object on the first broadcast screen 300. Information may be detected from the first broadcast screen 300.

Thereafter, the object detector 220 may detect the first object 31, the second object 33, and the third object 35 from the detected first object 31, the second object 33, and the third object 35. Edge images 37, 39, and 41 for each of the plurality of edge edges. In this case, the object detector 220 may display edge images of each of the first object 31, the second object 33, and the third object 35 and coordinate information where the edges of the respective objects are located on the first broadcast screen ( 300).

Subsequently, the object detector 220 only uses edge images 37, 39, and 41 of the first object 31, the second object 33, and the third object 35 detected on the first broadcast screen 300. Include the edge screen 302 which is transparent to the remaining part, and based on the coordinate information of each of the first object 31, the second object 33, and the third object 35, the first object ( 31), the object numbering 308 may be assigned to each of the second object 33 and the third object 35. The first numbering is given to the edge image 37 of the first object 31, the second numbering is given to the edge image 39 of the second object 33, and the edge image (of the third object 35) 41) may be given a third numbering.

The storage unit 250 may store the detected information of each of the detected first object 31, the second object 33, and the third object 35 in the object database 312. Here, the object information stored in the object database 312 includes identification information of the broadcast screen on which the object is detected, identification information of the object, image of the object, position information (coordinate information) of the object on the broadcast screen, and edge of the object. Information, object numbering, and category information of the object (corresponding to information contained in the product search condition input from the user. For example, if the product search condition is "Find that T-shirt", the category information is "T-shirt"), Property information of the object (eg, including the detected color and design of the object), person property information, and the like may be included.

The product information output unit 230 may display edge images 37, 39, and 41 of each of the first object 31, the second object 33, and the third object 35 detected on the first broadcast screen 300. The second broadcast screen 310 of the broadcast program (the next scene of the first broadcast screen 300) may be overlaid and output. Here, the numbering corresponding to each edge image 37, 39, 41 and each edge image 37, 39, 41 may be output on the second broadcast screen 310.

Subsequently, the product information output unit 230 does not receive a user input voice command related to shopping (for example, purchase, shopping cart storage, list search), etc. from the user for a preset time, the edge image ( 37, 39, 41) can be removed from the broadcast screen.

Among the edge images 37, 39, 41 output on the second broadcast screen 310, a user receives a first user action voice command (eg, purchase 2 times) related to an object corresponding to at least one edge image. In this case, the product information output unit 230 may receive product information 43 and 45 corresponding to the selected object from the commerce server 110 and output the product information 43 to the third broadcast screen 314. In this case, the product information 43 and 45 corresponding to the object may include an image, a product name, and price information of the product.

Select and input a second user action voice command related to an object corresponding to at least one edge image from the edge images 37, 39, and 41 output on the second broadcast screen 310 (eg, store shopping cart 2). When received, the storage unit 250 may extract the identification information of the broadcast screen including the object selected by the user and the object identification information from the object database 312 and store the identification information of the object in the shopping cart database 318.

Among the edge images 37, 39, and 41 output on the second broadcast screen 310, a user receives a third user action voice command (eg, shopping cart list inquiry) related to an object corresponding to at least one edge image. In this case, the product information output unit 230 may induce the purchase by overlaying the edge image of at least one object included in the shopping cart database 318 on the fourth broadcast screen 316 and outputting the edge image. At this time, in the case where at least one edge image output on the fourth broadcast screen 316 receives a position condition (eg, find a bustshot t-shirt located in the middle) of the edge image that the user wants to purchase, the corresponding condition ( For example, a product corresponding to an edge image that satisfies "middle" and "bust shot" may be exposed on the fourth broadcast screen 316.

Referring to FIG. 3E as a second embodiment, the search condition input unit 210 inputs a product search condition of a first product (eg, a T-shirt) from a user during a set voice shopping section (section between shopping start and shopping end). And a product search condition of the second product (eg, sneakers) can be continuously input.

At this time, when a voice command (eg, find the first product) for a product search condition of the first product is input from the user during the voice shopping section, the voice shopping section setting unit 200 is configured to search for the first product. The temporary search section 40 of the first product may be set.

The object detector 220 may detect at least one object 403 corresponding to a product search condition of the first product on the first broadcast screen 401 of the broadcast program during the temporary search period 40 of the first product. . At this time, the information 415 for at least one object 403 corresponding to the first product detected on the first broadcast screen 401 may be stored in the object database 407.

The product information output unit 230 overlays the edge image 405 of the at least one object 403 corresponding to the first product detected on the first broadcast screen 401 on the next screen of the first broadcast screen 401. Can be output.

Subsequently, when a voice command (eg, find a second product) for a product search condition of the second product is input from the user, the voice shopping section setting unit 200 temporarily stores the second product for searching for the second product. The search section 42 may be set.

Thereafter, the object detector 220 detects at least one object 411 corresponding to a product search condition of the second product on the second broadcast screen 407 of the broadcast program during the temporary search section 42 of the second product. Can be. At this time, the information 417 of the at least one object 411 corresponding to the second product detected on the second broadcast screen 407 may be stored in the object database 312.

The product information output unit 230 overlays an edge image 413 of at least one object 411 corresponding to the second product detected on the second broadcast screen 407 on the next screen of the second broadcast screen 407. Can be output.

The storage unit 250 may extract identification information of a broadcast screen including an object corresponding to each of the first product and the second product and object identification information from the object database 312 and store the identification information of the object in the shopping cart database 419.

Subsequently, when the search condition inputter 210 further receives a voice command for at least one detailed search condition from the user, the voice shopping section setting unit 200 sets the detailed search condition application section 44 for the detailed search. Can be.

When the user receives a voice command for the first detailed search condition (add the first detailed search condition for the property of the object, for example, a T-shirt worn by a specific person), the object detector 220 applies the detailed search condition. During the section 44, the object corresponding to the first detailed search condition is extracted from the shopping cart database 419, and the product information output unit 230 displays the edge image 423 of the extracted object on the third broadcast screen 421. Can be output by overlaying.

Subsequently, when a voice command for the second detailed search condition is additionally input from the user (eg, a second detailed search condition for an object's attribute, for example, a product of a specific color), the object detector 220 may add a shopping cart database 419. Finally, the object corresponding to the second detail search condition is finally selected from the object corresponding to the first detail search condition extracted from), and the product information output unit 230 removes the edge image 427 of the finally selected object. 4 may be output by overlaying on the broadcast screen 425.

Referring to FIG. 3F as a third embodiment, the search condition input unit 210 may receive a voice command for an automatic search condition of at least one specific product from a user before viewing a broadcast program of the user.

The search condition inputter 210 may further receive a voice command for at least one detailed search condition from the user in relation to the automatic search condition.

The search condition input unit 210 receives a voice command (eg, T-shirt auto search) for the automatic search condition of the first product from the user, and receives a voice command (eg, auto search for sneakers) for the automatic search condition of the second product. Can be input.

The voice shopping section setting unit 200 may set at least one search section in the broadcast program based on an automatic search condition of at least one specific product.

The voice shopping section setting unit 200 sets the automatic search section 501 for the first product in the broadcast program based on the automatic search condition of the first product, and broadcast program based on the automatic search condition for the second product. The automatic search section 503 for the second product may be set within the network.

The voice shopping section setting unit 200 may set the detailed search condition application section 505 in the broadcast program based on the detailed search condition related to the automatic search condition of the first product and the second product.

The object detector 220 may detect an object corresponding to the automatic search condition of the specific product for each of at least one set search period.

The object detector 220 may automatically detect at least one object corresponding to the first product on the plurality of broadcast screens during the automatic search section 501 for the first product in the broadcast program.

The object detector 220 may automatically detect at least one object corresponding to the second product on the plurality of broadcast screens during the automatic search section 503 for the second product in the broadcast program.

The storage unit 250 may detect information about at least one object corresponding to the first product detected during the automatic search section 501 for the first product and the second detected during the automatic search section 503 for the second product. Information about at least one object corresponding to a product may be stored in the object database 507.

The storage unit 250 may extract identification information of a broadcast screen including an object corresponding to each of the first product and the second product and object identification information from the object database 507, and store the identification information of the object in the shopping cart database 509.

Thereafter, the object detector 220 performs a shopping cart based on at least one detailed search condition (eg, adding a specific color and a detailed search of a specific person) during the detailed search condition application period 505 related to the automatic search condition in the broadcast program. The final object is selected from the database 509, and the product information output unit 230 may output an edge image of the selected final object by overlaying it on the broadcast screen.

Referring to FIG. 3G as a fourth embodiment, when there are a plurality of objects detected according to at least one product search condition on a specific screen of a broadcast program, the attribute information input unit 240 determines an object attribute based on the attribute dialog rule 600. At least one object may receive attribute information from the user through a dialog.

For example, when two or more objects corresponding to a specific product (for example, a sofa) are detected on a plurality of specific screens of a broadcast program, the property information input unit 240 may perform a property dialog rule 600 on a product category to which the object belongs. At least one query message (eg, a query message for at least one of material, color, and size of a product desired by the user) may be delivered to the user based on the based on the received query.

The attribute information input unit 240 may receive the attribute information of the object (eg, product location, color size, etc.) from the user in response to at least one query message.

The object detector 220 may detect an object desired by a user from among a plurality of objects detected by using attribute information of at least one object input from an object database storing the object information and a shopping cart database.

The product information output unit 230 may output the edge image of the object desired by the user and the product information corresponding to the object (including recommended product information similar to the object) on the broadcast screen.

On the other hand, those skilled in the art, the voice shopping section setting unit 200, the search condition input unit 210, the object detector 220, the product information output unit 230, the attribute information input unit 240 and the storage unit 250 are each separated It will be fully understood that one or more of these may be implemented in combination.

4 is a flowchart illustrating a voice-based shopping service providing method according to an embodiment of the present invention.

Referring to FIG. 4, in step S401, the media reproducing apparatus 100 receives a first command corresponding to a start of shopping from a user while receiving a broadcast program and receives a second command corresponding to the end of shopping from a user while broadcasting a broadcast program. Can be set.

In operation S403, the media playback apparatus 100 may receive at least one product search condition from the user during the set voice shopping section.

In operation S405, the media playback apparatus 100 may detect at least one object corresponding to at least one product search condition from the broadcast screen of the broadcast program. Here, the detected object information may include at least one of location information of the object on the broadcast screen, identification information of the object, image information, and property information of the object.

In operation S407, the media playback apparatus 100 may output commodity information corresponding to the detected object received from the commerce server 110.

Although not shown in FIG. 4, before the operation S405, the media reproducing apparatus 100 may further receive a voice command for at least one detailed search condition from the user, and at least one detected based on the at least one detailed search condition in step S405. The final object can be selected from one object.

Although not shown in FIG. 4, after step S405, when the media playback apparatus 100 detects a plurality of objects detected according to at least one product search condition on a specific screen of the broadcast program, the media playback apparatus 100 may display at least one object from the user through the object property dialog. Can receive the property information of the object.

In the above description, steps S401 to S407 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. In addition, some steps may be omitted as necessary, and the order between the steps may be changed.

An embodiment of the present invention may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by the computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer readable media may include all computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

The foregoing description of the present invention is intended for illustration, and it will be understood by those skilled in the art that the present invention may be easily modified in other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is shown by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. .

100: media playback device
110: commerce server
200: voice shopping section setting unit
210: search condition input unit
220: object detection unit
230: product information output unit
240: attribute information input unit
250: storage

Claims (18)

In the media playback device that provides a voice-based shopping service,
A voice shopping section setting unit configured to receive a first command corresponding to a start of shopping from a user while broadcasting a broadcast program, and set a voice shopping section by receiving a second command corresponding to a shopping end;
A search condition input unit which receives at least one product search condition from the user during the set voice shopping section;
An object detector for detecting at least one object corresponding to the at least one product search condition from a broadcast screen of the broadcast program; And
Product information output unit for outputting product information corresponding to the detected object received from the commerce server
Including,
The detected object information includes at least one of position information of the object on the broadcast screen, identification information of the object, image information, and attribute information of the object.
The method of claim 1,
The search condition input unit further receives a voice command for at least one detailed search condition from the user,
And the object detector selects a final object from the detected at least one object based on the at least one detailed search condition.
The method of claim 1,
The search condition input unit receives a voice command for an automatic search condition of at least one specific product from the user,
And the voice shopping section setting unit sets at least one search section in the broadcast program based on an automatic search condition of the specific product.
The method of claim 3, wherein
And the object detecting unit detects an object corresponding to an automatic search condition of the specific product every at least one search period.
The method of claim 4, wherein
The search condition input unit may further receive a voice command for at least one detailed search condition from the user in relation to the automatic search condition.
And the voice shopping section setting unit sets a search section of the detailed search condition in the broadcast program based on the detailed search condition.
The method of claim 5,
And the object detector selects a final object from the detected object based on the at least one detailed search condition during the search period of the set detailed search condition.
The method of claim 1,
And a plurality of objects detected according to the at least one product search condition on a specific screen of a broadcast program, the media playing apparatus further comprising an attribute information input unit configured to receive attribute information of at least one object from a user through an object attribute dialog. .
The method of claim 7, wherein
And the object detecting unit detects an object desired by the user from among the plurality of objects by using attribute information of the input at least one object.
The method of claim 1,
A storage unit for mapping the identification information of the broadcast screen including the detected object and the information of the detected object to store in the shopping cart database
The media playback device further comprising.
The method of claim 1,
And the product information output unit overlays and outputs the product information corresponding to the detected object on the screen of the broadcast program.
The method of claim 10,
And the product information outputting unit overlays an edge image of the detected object on the screen of the broadcasting program and outputs the edge image.
A method of providing a voice-based shopping service in a media playback device,
Setting a voice shopping section by receiving a first command corresponding to the start of shopping from a user while broadcasting the broadcast program, and receiving a second command corresponding to the end of shopping;
Receiving at least one product search condition from the user during the set voice shopping period;
Detecting at least one object corresponding to the at least one product search condition from a broadcast screen of the broadcast program; And
Outputting commodity information corresponding to the detected object received from a commerce server;
The detected object information includes at least one of location information of the object on the broadcast screen, identification information of the object, image information, and attribute information of the object.
The method of claim 12,
Prior to detecting the at least one object
Further receiving a voice command for at least one detailed search condition from the user;
Detecting the at least one object
Selecting a final object from the detected at least one object based on the at least one detailed search condition.
The method of claim 12,
After detecting the at least one object
If a plurality of objects detected according to the at least one product search condition on a specific screen of the broadcast program, further comprising the step of receiving the property information of the at least one object from the user through the object properties dialog, voice-based How to provide shopping service.
A computer readable medium comprising a sequence of instructions for providing a voice based shopping service,
When executed by a computing device mounted to a media playback device, the computing device,
While the broadcast program is aired, the user receives a first command corresponding to the start of shopping, receives a second command corresponding to the end of shopping, sets a voice shopping section,
Receiving at least one product search condition from the user during the set voice shopping interval,
Detecting at least one object corresponding to the at least one product search condition from a broadcast screen of the broadcast program;
Including a sequence of instructions for outputting product information corresponding to the detected object received from a commerce server,
And the information of the detected object includes at least one of position information of the object on the broadcast screen, identification information of the object, image information, and attribute information of the object.
The method of claim 15,
When executed by the computing device, the computing device is
Receiving a voice command for an automatic search condition for at least one specific product from a user,
And a sequence of instructions for setting at least one search interval in the broadcast program based on the automatic search condition of the particular product.
The method of claim 16,
When executed by the computing device, the computing device is
And a sequence of instructions for detecting an object corresponding to an automatic search condition of the specific product every at least one set search period.
The method of claim 15,
When executed by the computing device, the computing device is
And a sequence of instructions for overlaying and outputting product information corresponding to the detected object on a screen of the broadcast program.

Images