KR101899597B1 - Method for searching object information and dispaly apparatus thereof - Google Patents

Abstract

The present invention relates to a method of retrieving information about objects included in content and an image display apparatus using the same, the method comprising: receiving an object from a content being reproduced; A step of tracking an object selected in the content being reproduced for a predetermined time to acquire an image in which the motion of the object is recorded; Acquiring identification information on an object using an object image; And displaying detailed information about the retrieved object according to the identification information.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an object information retrieval method,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for searching for information about a specific object using content reproduced in an image display apparatus.

Digital TV and wired / wireless network technologies with superior signal processing and storage capabilities than conventional analog TVs have been developed and commercialized. In addition to the existing broadcasting media, real-time broadcast, COD (Contents on Demand) , Games, news, video communication, and the like.

An example of content service provision using the Internet network is IPTV (Internet Protocol TV). The IPTV refers to transmitting various information services, moving picture contents, broadcasting, and the like to a user's television using a high-speed Internet network.

In recent years, the concept of broadband TV, web TV, etc. has been suggested as a form of network TV that has advanced further in IPTV. Unlike the conventional IPTV, a broadband TV or a web TV has a plurality of content providers, and a user accesses a plurality of content providers individually to receive contents such as various VODs and games provided by a content provider.

An object of the present invention is to provide an object information search method and an image display apparatus using the object information, which can easily search and provide information about various objects in content reproduced in a video display device.

According to an aspect of the present invention, there is provided an object information retrieving method including retrieving information on a specific object using content reproduced in an image display apparatus, and selecting an object from the content being reproduced; A step of tracking the selected object for a predetermined time within the content being reproduced to acquire an image in which the motion of the object is recorded; Obtaining identification information on the object using the object image; And displaying detailed information about the object searched according to the identification information.

According to another aspect of the present invention, there is provided an image display apparatus including: a user interface unit for selecting an object from content being reproduced; A control unit for tracking the selected object for a predetermined time in the reproduced content to obtain an image in which the motion of the object is recorded and identifying the object using the obtained object image; A network interface unit transmitting identification information on the object to a first server and receiving detailed information on the object searched according to the identification information from the first server; And a display unit for displaying object detailed information received from the server.

Meanwhile, the object information retrieval method may be embodied as a computer-readable recording medium on which a program for execution in a computer is recorded.

According to an embodiment of the present invention, an image in which a motion of a specific object is recorded is retrieved from the content being played back in the video display device and used to retrieve information about the object, Product detailed information on the object in the content, and the like.

In addition, since the object images obtained from the contents include the shapes of the objects viewed from different angles, the accuracy of recognition for identifying the objects included in the contents can be improved.

1 is a block diagram showing a configuration of a display system according to an embodiment of the present invention.
2 is a block diagram showing a configuration of a video display device according to an embodiment of the present invention.
3 is a view showing an embodiment of a method of controlling the operation of the image display apparatus using the remote control apparatus.
4 is a block diagram showing a configuration of a remote control apparatus according to an embodiment of the present invention.
5 is a flowchart illustrating an object information search method according to an embodiment of the present invention.
FIGS. 6 to 9 are views showing embodiments of a method of selecting an object from contents to be reproduced.
10 is a diagram illustrating an embodiment of a method of capturing an object image by capturing a part of a content image for a predetermined period of time.
11 to 14 are views showing embodiments of a method of displaying identification information for an object.
15 to 17 are views showing a first embodiment of a method of displaying detailed information on an object.
18 is a diagram showing an embodiment of a method of purchasing a product corresponding to an object.
19 to 22 are views showing a second embodiment of a method of displaying detailed information on an object.

Hereinafter, an object information search method and an image display apparatus using the same according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings and accompanying drawings, but the present invention is not limited to or limited by the embodiments.

As used herein, terms used in the present invention are selected from general terms that are widely used in the present invention while taking into account the functions of the present invention, but these may vary depending on the intention or custom of a person skilled in the art or the emergence of new technologies. Also, in certain cases, there may be a term chosen arbitrarily by the applicant, in which case the meaning thereof will be described in the description of the corresponding invention. Therefore, it is intended that the terminology used herein should be interpreted based on the meaning of the term rather than on the name of the term, and on the entire contents of the specification.

FIG. 1 is a block diagram illustrating the configuration of a display system according to an embodiment of the present invention. The system shown in FIG. 1 may include an image display device 100, a remote control device 200, and a server 300 .

Referring to FIG. 1, the video display device 100 is an intelligent video display device that adds a computer support function to a broadcast receiving function. The video display device 100 includes a handwriting input device, a touch screen Or an interface that is more convenient to use than a space remote controller or the like. Also, it can be connected to the Internet and a computer by the support of a wired or wireless Internet function, and can perform functions such as e-mail, web browsing, banking or game. A standardized general-purpose OS can be used for these various functions.

Therefore, the video display device 100 according to the embodiment of the present invention can freely add or delete various applications, for example, on a general-purpose OS kernel, so that various user-friendly functions can be performed. More specifically, the video display device may be, for example, a network TV, an HBBTV, a smart TV, or the like, and may be applied to a smartphone according to circumstances.

The remote control device 200 may be a device for controlling the operation of the image display device 100. However, the present invention is not limited thereto, and may be applied to various portable devices such as a mobile communication terminal such as a smart phone, a tablet PC, .

For example, the remote control apparatus 200 may control not only the image display apparatus 100 but also various electronic apparatuses located nearby.

The video display apparatus 100 may be connected to the Internet server 300 using a wired or wireless network such as the Internet to receive various contents such as movies, music, games, and applications from a contents provider (CP) .

The video display device 110 and the external electronic devices can be connected to each other via a wired / wireless network, and can transmit / receive data, thereby sharing / controlling contents with each other.

For example, the image display apparatus 110 and the electronic apparatuses may be connected to each other through a cable using a wired communication method such as HDMI (High Definition Multimedia Interface), DLNA (Digital Living Network Alliance), WiFi Various wireless communication methods such as Wi-HD (Wireless HD), Wireless Home Digital Interface (WHDi), Blutooth, ZigBee, binary Code Division Multiple Access (CDMA), DiiVA (Digital Interactive Interface for Video & Can be connected to each other to transmit and receive data.

According to an embodiment of the present invention, the image display apparatus 110 may search the server 300 for product information about a specific object in the reproduced content, and provide the retrieved object information to the user.

The image display apparatus 100 includes a broadcast receiver 130, an external device interface 135, a storage unit 140, and a display unit 140. [ A user input interface unit 150, a control unit 170, a display unit 180, an audio output unit 185, and a power supply unit 190. The broadcast receiver 130 may include a tuner 131, a demodulator 132, and a network interface 133.

Referring to FIG. 2, the tuner 131 selects an RF broadcast signal corresponding to a channel selected by the user or all previously stored channels among RF (Radio Frequency) broadcast signals received through an antenna, Intermediate frequency signal, baseband image or voice signal.

For example, the tuner 131 may convert a selected RF broadcast signal into a digital IF signal (DIF) if it is a digital broadcast signal and convert it into an analog baseband image or an audio signal (CVBS / SIF) if it is an analog broadcast signal .

That is, the tuner 131 can process both the digital broadcast signal and the analog broadcast signal, and the analog baseband video or audio signal (CVBS / SIF) output from the tuner 131 can be directly input to the controller 170 have.

Also, the tuner 131 can receive an RF broadcast signal of a single carrier according to an Advanced Television System Committee (ATSC) scheme or an RF broadcast signal of a plurality of carriers according to a DVB (Digital Video Broadcasting) scheme.

Meanwhile, the tuner 131 sequentially selects RF broadcast signals of all the broadcast channels stored through the channel memory function among the RF broadcast signals received through the antenna, and converts the RF broadcast signals into an intermediate frequency signal, a baseband image, or a voice signal .

The demodulator 132 can receive the digital IF signal DIF converted by the tuner 131 and perform a demodulation operation. For example, when the digital IF signal output from the tuner 131 is of the ATSC scheme, the demodulation unit 132 may perform 8-VSB (8-Vestigal Side Band) demodulation.

In addition, the demodulator 132 may perform channel decoding, and a trellis decoder, a de-interleaver, and a Reed Solomon decoder may be used for the channel decoding. It is possible to perform lyher decoding, deinterleaving, and reed solomon decoding.

For example, when the digital IF signal output from the tuner 131 is a DVB scheme, the demodulator 132 can perform CODDMA (Coded Orthogonal Frequency Division Modulation) demodulation.

The demodulator 132 may perform channel decoding, and a convolution decoder, a deinterleaver, and a reed-solomon decoder may be used to perform convolutional decoding, deinterleaving, and reed solomon decoding. Can be performed.

The demodulator 132 may perform demodulation and channel decoding and then output a stream signal TS. The stream signal may be a signal in which a video signal, a voice signal, or a data signal is multiplexed.

For example, the stream signal may be an MPEG-2 TS (Transport Stream) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, or the like. Specifically, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

Meanwhile, the demodulator 132 may separately include the ATSC demodulator and the DVB demodulator according to the ATSC scheme and the DVB scheme.

The stream signal output from the demodulation unit 132 may be input to the control unit 170. The control unit 170 performs demultiplexing, video / audio signal processing, and the like, and then outputs an image to the display unit 180 , And output audio to the audio output unit 185.

The external device interface unit 135 can connect the external device and the video display device 100 and may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 135 may be connected to an external device such as a DVD (Digital Versatile Disk), a Blu ray, a game device, a camera, a camcorder, a computer (notebook)

The external device interface unit 135 transmits external video, audio, or data signals to the controller 170 of the video display device 100 through a connected external device, Voice or data signals can be output to a connected external device.

The A / V input / output unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), a DVI (Digital Visual Interface) terminal, an HDMI (High Definition Multimedia Interface) terminal, an RGB terminal, a D-SUB terminal, and the like.

Meanwhile, the wireless communication unit can perform short-range wireless communication with other electronic devices. For example, the image display device 100 may be a Bluetooth (registered trademark), a radio frequency identification (RFID), an infrared data association (IrDA), an ultra wideband (UWB), a ZigBee, ) According to the communication standard.

Also, the external device interface unit 135 may be connected to various set-top boxes via at least one of the various terminals described above to perform input / output operations with the set-top box.

Meanwhile, the external device interface unit 135 may receive an application or application list in an adjacent external device, and may transmit the received application or application list to the control unit 170 or the storage unit 140.

The network interface unit 133 may provide an interface for connecting the video display device 100 to a wired / wireless network including the Internet network. For example, the network interface unit 133 may include an Ethernet terminal or the like for connection with a wired network, and may be a WLAN (Wi-Fi), a Wibro (wireless broadband) Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) communication standards, and the like.

On the other hand, the network interface unit 133 can transmit or receive data with other users or other electronic devices via the connected network or another network linked to the connected network.

In addition, it is possible to transmit some content data stored in the video display device 100 to another user registered in the video display device 100 or to a selected user or selected one of the other electronic devices.

The network interface unit 133 can access a predetermined web page through the connected network or another network linked to the connected network. That is, it is possible to access a predetermined web page through a network and transmit or receive data with the server.

The network interface unit 133 may receive content or data provided by the content provider or the network operator. That is, the network interface unit 133 can receive contents such as a movie, an advertisement, a game, a VOD, a broadcast signal, and related information provided from a content provider or a network provider through a network.

In addition, the network interface unit 133 can receive update information and an update file of the firmware provided by the network operator, and can transmit data to the Internet or a content provider or a network operator.

The network interface unit 133 can select and receive a desired application among applications open to the public via the network.

The storage unit 140 may store a program for each signal processing and control in the controller 170, and may store the processed video, audio, or data signals.

The storage unit 140 may perform a function for temporarily storing video, audio, or data signals input from the external device interface unit 135 or the network interface unit 133, Information about the broadcast channel may be stored.

The storage unit 140 may store a list of applications or applications input from the external device interface unit 135 or the network interface unit 133. [

The storage unit 140 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, an SD or XD memory Etc.), RAM, ROM (EEPROM, etc.), and the like.

The image display apparatus 100 may reproduce and provide a content file (a moving image file, a still image file, a music file, a document file, an application file, etc.) stored in the storage unit 140 to a user.

The user input interface unit 150 may transmit a signal input by the user to the control unit 170 or may transmit a signal from the control unit 170 to the user. For example, the user input interface unit 150 may be configured to turn on / off the power from the remote control device 200, select a channel, set a screen (for example, Or the like, or to transmit a control signal from the control unit 170 to the remote control device 200. [0064]

The user input interface unit 150 may transmit a control signal input from a local key (not shown) such as a power key, a channel key, a volume key, and a set value to the controller 170.

For example, the user input interface unit 150 may transmit a control signal input from a sensing unit (not shown) that senses a user's gesture to the control unit 170, or may transmit a signal from the control unit 170 to a sensing unit Quot;). ≪ / RTI > The sensing unit (not shown) may include a touch sensor, a voice sensor, a position sensor, a motion sensor, and the like.

The control unit 170 demultiplexes the streams input from the tuner 131 or the demodulation unit 132 or the external device interface unit 135 or processes the demultiplexed signals to generate and output signals for video or audio output. Can be output.

The video signal processed by the controller 170 may be input to the display unit 180 and displayed as an image corresponding to the video signal. The video signal processed by the controller 170 may be input to the external output device through the external device interface 135. [

The audio signal processed by the control unit 170 may be output to the audio output unit 185 through audio. The voice signal processed by the control unit 170 may be input to the external output device through the external device interface unit 135.

Although not shown in FIG. 2, the control unit 170 may include a demultiplexing unit, an image processing unit, and the like.

In addition, the control unit 170 can control the overall operation in the video display device 100. [ For example, the controller 170 controls the tuner 131 to control the tuner 131 to select an RF broadcast corresponding to a channel selected by the user or a previously stored channel.

In addition, the controller 170 can control the image display apparatus 100 through a user command or an internal program input through the user input interface unit 150, and can connect to the network to display a list of applications or applications desired by the user And can be downloaded into the display device 100.

For example, the control unit 170 controls the tuner 131 to input a signal of a selected channel according to a predetermined channel selection command received through the user input interface unit 150, Lt; / RTI >

The control unit 170 can output the video or audio signal processed through the channel information selected by the user through the display unit 180 or the audio output unit 185.

The control unit 170 controls the operation of the external device through the external device interface unit 135 according to an external device video playback command received through the user input interface unit 150. For example, So that a video signal or a voice signal can be output through the display unit 180 or the audio output unit 185.

The control unit 170 may control the display unit 180 to display an image and may output the broadcast image input through the tuner 131 or the external input through the external device interface unit 135, The image input through the network interface unit or the image stored in the storage unit 140 may be displayed on the display unit 180. [ In this case, the image displayed on the display unit 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

Also, the controller 170 may control the content stored in the video display device 100, the received broadcast content, and the external input content input from the outside to be reproduced, and the content may be a broadcast video, an external input video, Files, still images, connected web screens, and document files.

FIG. 3 shows an embodiment of a method of controlling the operation of the image display apparatus using the remote control apparatus.

3 (a), it is illustrated that the pointer 205 corresponding to the remote control device 200 is displayed on the display unit 180. As shown in Fig.

The user can move the remote control device 200 up and down, right and left, back and forth, and rotate. The pointer 205 displayed on the display unit 180 of the video display device corresponds to the motion of the remote control device 200. [ In this remote control device 200, as shown in the figure, since the pointer 205 is moved according to the movement in the 3D space, it can be called a space remote controller.

3B illustrates that when the user moves the remote control device 200 to the left, the pointer 205 displayed on the display unit 180 of the video display device moves to the left correspondingly.

Information on the motion of the remote control device 200 sensed through the sensor of the remote control device 200 is transmitted to the image display device. The video display device can calculate the coordinates of the pointer 205 from the information on the motion of the remote control device 200. [ The video display device can display the pointer 205 so as to correspond to the calculated coordinates.

3C illustrates a case where the user moves the remote control device 200 away from the display unit 180 while the specific button in the remote control device 200 is depressed. Thereby, the selected area in the display unit 180 corresponding to the pointer 205 can be zoomed in and displayed.

Conversely, when the user moves the remote control apparatus 200 close to the display unit 180, the selection area within the display unit 180 corresponding to the pointer 205 may be zoomed out and displayed.

On the other hand, when the remote control device 200 moves away from the display unit 180, the selected area is zoomed out, and when the remote control device 200 approaches the display unit 180, the selected area may be zoomed in.

Further, the recognition of the upward, downward, and leftward / rightward movement can be excluded when a specific button in the remote control device 200 is pressed. That is, when the remote control device 200 moves away from or approaches the display unit 180, it is not recognized that the up, down, left, and right movements are recognized, and only the forward and backward movements are recognized. Only the pointer 205 is moved in accordance with the upward, downward, leftward, and rightward movement of the remote control device 200 in a state where the specific button in the remote control device 200 is not pressed.

On the other hand, the moving speed and moving direction of the pointer 205 may correspond to the moving speed and moving direction of the remote control device 200.

The pointer in the present specification means an object displayed on the display unit 180 in correspondence with the operation of the remote control device 200. [ Therefore, various shapes of objects other than the arrow shapes shown in the drawings are possible with the pointer 205. [ For example, it can be a concept that includes points, cursors, prompts, thick outlines, and so on. The pointer 205 may be displayed corresponding to a point on a horizontal axis or a vertical axis on the display unit 180 or may be displayed corresponding to a plurality of points such as a line or a surface Do.

4 is a block diagram illustrating a configuration of a remote control apparatus according to an embodiment of the present invention. The remote control apparatus 200 includes a wireless communication unit 225, a user input unit 235, a sensor unit 240, A power supply unit 260, a storage unit 270, and a control unit 280. The power supply unit 260 may include a power supply unit 250, a power supply unit 260, a storage unit 270,

Referring to FIG. 4, the wireless communication unit 225 transmits / receives signals to / from any one of the video display devices according to the embodiments of the present invention described above.

The remote control apparatus 200 includes an RF module 221 capable of transmitting and receiving signals to and from the image display apparatus 100 according to an RF communication standard and transmits and receives signals to and from the image display apparatus 100 according to the IR communication standard An IR module 223 may be provided.

The remote control apparatus 200 transmits a signal containing information on the motion of the remote control apparatus 200 to the image display apparatus 100 through the RF module 221.

The remote control device 200 can receive a signal transmitted from the video display device 100 through the RF module 221 and transmit the signal to the video display device 100 through the IR module 223, On / off, channel change, volume change, and the like.

The user input unit 235 may include a keypad, a button, a touch pad, or a touch screen. The user can input a command related to the image display apparatus 100 to the remote control apparatus 200 by operating the user input unit 235. [ When the user input unit 235 has a hard key button, the user can input a command related to the image display device 100 to the remote control device 200 through the push operation of the hard key button.

When the user input unit 235 includes a touch screen, the user can touch a soft key of the touch screen to input a command related to the image display apparatus 100 to the remote control apparatus 200. [ In addition, the user input unit 235 may include various types of input means such as a scroll key, a jog key, and the like that can be operated by the user, and the present invention does not limit the scope of the present invention.

According to an embodiment of the present invention, the remote control device 200 may include a camera 236 and a microphone 237. [

The camera 236 processes an image frame such as a still image or a moving image obtained by the image sensor in a video communication mode or a shooting mode, and the processed image can be displayed through the display module 257.

The image obtained by the camera 236 may be stored in the storage unit 270 or transmitted to an external device such as the image display device 100 through the RF module 221. [ Also, two or more cameras 236 may be provided according to the configuration of the terminal.

On the other hand, the microphone 237 recognizes and acquires the voice of the user, for example, a user, by a microphone in a communication mode, a recording mode, a voice recognition mode, etc., and processes the voice as electrical voice data.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243 and the gyro sensor 241 may sense information on the motion of the remote control device 200. [

For example, the gyro sensor 241 may sense information about the operation of the remote control device 200 on the basis of the x, y, and z axes, and the acceleration sensor 243 may sense the movement speed of the remote control device 200 And the like can be sensed. The remote control device 200 may further include a distance measuring sensor to sense a distance to the display unit 180 of the image display device 100. [

The output unit 250 may output an image or a voice signal corresponding to the operation of the user input unit 235 or corresponding to the signal transmitted from the image display apparatus 100. [ The user can recognize whether the user input unit 235 is operated or whether the image display apparatus 100 is controlled through the output unit 250.

For example, the output unit 250 may include an LED module 251 that is turned on when a user input unit 235 is operated or a signal is transmitted to or received from the image display apparatus 100 through the wireless communication unit 225, An audio output module 255 for outputting sound, or a display module 257 for outputting an image.

In addition, the power supply unit 260 supplies power to the remote control device 200, and if the remote control device 200 is not moved for a predetermined time, the power supply is interrupted to reduce power consumption. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 270 may store various types of programs, application data, and the like necessary for the control or operation of the remote control apparatus 200. [ If the remote control device 200 wirelessly transmits and receives signals through the image display device 100 and the RF module 221, the remote control device 200 and the image display device 100 transmit signals through a predetermined frequency band Send and receive.

The control unit 280 of the remote control device 200 stores information on a frequency band and the like capable of wirelessly transmitting and receiving a signal with the video display device 100 paired with the remote control device 200 in the storage unit 270 Can be referenced.

The control unit 280 controls various matters related to the control of the remote control device 200. [ The control unit 280 transmits a signal corresponding to a predetermined key operation of the user input unit 235 or a signal corresponding to the motion of the remote control device 200 sensed by the sensor unit 240, (100).

4 shows an embodiment of the configuration of the remote control device 200, the present invention is not limited thereto, and if necessary, some of the components shown in Fig. 4 may be omitted or one or more components Can be added.

For example, when the remote control apparatus 200 is a mobile communication terminal, the wireless communication unit 225 may include a broadcast receiving module (not shown), a mobile communication module (not shown), a wireless Internet module (not shown) A module (not shown) or a position information module (not shown).

Hereinafter, an object information search method according to an embodiment of the present invention will be described in detail with reference to FIG. 5 to FIG.

5 is a flowchart illustrating an object information search method according to an embodiment of the present invention. The search method shown in FIG. 5 is a block diagram showing a configuration of an image display apparatus 100 according to an embodiment of the present invention shown in FIG. Will be described.

5, the display unit 180 and the audio output unit 185 of the image display apparatus 100 reproduce contents (step S500), and the controller 170 determines whether an object is selected from the contents being reproduced (Step S510).

For example, the display unit 180 displays images of broadcast signals input through the broadcast receiving unit 130, images input from an external device through the external device interface unit 135, The input image or the image stored in the storage unit 140 can be displayed on the screen under the control of the control unit 170. [

Meanwhile, the image displayed on the screen through the display unit 180 may include a plurality of objects, and the object may refer to all objects constituting the image.

In this case, while the content is being reproduced on the video display device 100, the user can select an object to be provided with information among the objects in the content displayed on the screen.

When a specific object existing on the screen of the video display device 100 is selected by the user, the controller 170 tracks the selected object for a predetermined time in the content being reproduced, (Step S520).

For example, the control unit 170 captures an area including the selected object among images displayed on the screen for a predetermined time t, and stores the captured object in the storage unit 140, thereby obtaining information about the three- You can create a video that contains.

That is, the object image obtained as described above may include the shapes of the object shown at different angles, and accordingly, the still image of the instantaneously captured object (which includes only the shape of the object shown at an angle And may have more information about the selected object.

On the other hand, the time t at which the object is tracked and captures an image may have a predetermined value, or may vary depending on the content to be reproduced, the selected object, or the identification result of the object.

In this case, as the image capturing time t increases, more information about the three-dimensional shape of the object can be obtained through the object image. For example, when the object image is viewed at various angles And may include shapes of the object.

Thereafter, the controller 170 identifies the selected object using the obtained object image (step S530).

In step S530, the controller 170 acquires identification information on the object searched from the server 300 using the obtained object image, for example, a product name or a thumbnail image corresponding to the object .

For example, the network interface unit 133 of the image display apparatus 100 transmits the obtained object image to the server 300, and the server 300 analyzes the transmitted object image, The feature information may be extracted and a product corresponding to the extracted feature information may be searched from a database (DB).

The server 300 may identify the object according to the search result and transmit identification information, for example, a product name or a thumbnail image, to at least one product corresponding to the object, to the image display apparatus 100.

The display unit 180 of the image display apparatus 100 displays detailed information about the object searched according to the identification information of the object in operation S540.

For example, when the user confirms the identification information obtained in step S530 and then confirms detailed information on the object, the network interface unit 133 may transmit the identification information of the object to the server 300 .

On the other hand, the server 300 searches the database for detailed information on the product corresponding to the object using the transmitted object identification information (for example, a product name corresponding to the object), and then, And can be transmitted to the display device 100.

In addition, the detailed information on the object may include a product name, a selling price, a maker, a seller, a size, a color, and an enlarged image.

In the above description, the object identification process using the object image and the detailed information search using the identification information are performed in the server 300. For example, the object information search method according to the embodiment of the present invention has been described. However, No.

For example, when a database for object identification and a database for object detailed information search are separately configured, an object identification process using the object image and a detailed information search process using the identification information are performed in separate servers Respectively.

Hereinafter, embodiments of a method for selecting an object from content to be reproduced will be described in detail with reference to FIGS. 6 to 9. FIG.

6, the user selects an area 700R in which the first object 700 is displayed in the content image being reproduced on the screen 600 of the image display device 100, thereby selecting an object to search for information .

Referring to FIG. 7, the controller 170 of the image display apparatus 100 may capture a screen 600 to detect a plurality of objects 700 to 730 included in the content image being reproduced.

For example, when the user presses the 'capture' button provided on the remote control apparatus 200, all objects in the image being reproduced on the screen 600 at the point of time are detected, (Not shown).

The object selected by the controller 170 may be a specific object intended by the content provider, or an object that satisfies conditions preset by the user.

The user may move the pointer 205 displayed on the screen 600 using the remote control device 200 to detect any one of the detected plurality of objects 700 to 730, 700) can be selected.

According to another embodiment of the present invention, a content image reproduced on the screen 600 of the video display device 100 is transmitted to an external device, so that an object is selected using an external device that displays the transmitted content image It is possible.

8, the remote control apparatus 200 includes a display unit (not shown) capable of displaying an image, so that the content image transmitted from the image display apparatus 100 can be displayed on the screen 800 have.

Accordingly, the content image being reproduced in the image display apparatus 100 can be simultaneously displayed on the screen 800 provided in the remote control apparatus 200, and the user can view the content image on the screen 800 of the remote control apparatus 200 An object to be searched for information can be selected using the displayed image.

According to another embodiment of the present invention, the user can select an object by enlarging or reducing the content image being reproduced in the image display apparatus 100. [

When the user presses the 'capture' button provided on the remote control apparatus 200, the image displayed on the screen 600 of the image display apparatus 100 is temporarily stopped and can be switched to a screen mode that can be enlarged or reduced have.

For example, if the user moves the remote control device 200 close to the screen 600 while the image is temporarily stopped, the image displayed on the screen 600 is enlarged and the remote control device 200 is displayed on the screen 600. [ The image displayed on the screen 600 can be reduced.

9, the user adjusts the remote control device 200 so that the first object 700 is displayed in a position and size that is easy to select on the screen 600 of the image display device 100, 1 object 700 as an object to be searched for information.

When the object selection process as described with reference to FIGS. 6 to 9 is completed, a process of acquiring an image in which the motion of the object is recorded by tracking the selected object for a predetermined time may be performed.

FIG. 10 shows an embodiment of a method of capturing an object image by capturing a part of a content image for a predetermined time.

10, the controller 170 captures an area 700R in which the selected first object 700 is displayed in the image displayed on the screen 600 for a predetermined time t, A moving picture including shapes of the first object 700 to be displayed can be generated.

For example, when a region 700R in which the first object 700 is displayed is captured for 10 seconds, a progressive bar for visually displaying the capturing process is displayed in the lower region 610 of the screen 600 progressive bar 611 is displayed. When capturing for 10 seconds is completed, an object image including various stereoscopic shapes of the first object 700 may be stored in the storage unit 140. FIG.

In this case, as the movement of the first object 700 during the capturing time increases, the generated object image may include more stereoscopic shape information for the first object 700.

The obtained object image is transmitted to the server 300 through the network interface unit 133. The server 300 searches for a product corresponding to the first object 700 using the transmitted object image (For example, a product name and a thumbnail image) of the searched product to the image display apparatus 100. [0064]

The object identification information transmitted from the server 300 may be provided to the user through the screen 600 of the image display apparatus 100 as described above.

FIG. 11 shows an embodiment of a method for displaying identification information for an object.

11, 'Clara ABC2' and a thumbnail image 621, which are the product names of the first object 700 retrieved from the server 300, are displayed in the identification information display area (FIG. 11) of the screen 600 of the image display apparatus 100 620 < / RTI >

In this case, the user can request detailed information about the first object 700 by selecting the identification information display area 620 or the thumbnail image 621 of the product.

According to another embodiment of the present invention, the product 300 may be searched by the server 300 according to the object image, and the first object 700 is displayed in the identification information display area 620 of the screen 600, May be sorted and displayed.

On the other hand, as the time for which the first object 700 is tracked increases, more information about the shape of the first object 700 can be obtained, and thereby, the product displayed in the identification information display region 620 Can be reduced.

This is because as the information about the shape of the first object 700 is increased, the range of products having a shape similar to that of the first object 700 is narrowed.

12, when the first object 700 starts to be tracked and the first time t1 elapses, the server 300 corresponds to the shape of the first object 700 tracked during the time t1, A plurality of products retrieved in the identification information display area 620 may be displayed.

Meanwhile, the identification information display area 620 may include thumbnail images 622 corresponding to the searched products.

In addition, the order in which the thumbnail images of the products are arranged in the identification information display area 620 may depend on the degree of similarity with the shape of the obtained first object 700. For example, The thumbnail image corresponding to the product most similar to the shape of the thumbnail image may be located on the uppermost side.

13, when the first object 700 starts to be tracked and the second time (t2, t2> t1) has elapsed, a plurality of pieces corresponding to the shape of the first object 700 tracked during the t2 time Products can be displayed in the identification information display area 620. [

In this case, the number of products displayed in the identification information display area 620 may be reduced as compared with the case shown in FIG. 12, and information on the shape of the first object 700 may be additionally provided during a period from t1 to t2 It is because it was acquired.

Referring to FIG. 14, when the first object 700 is tracked and the third time t3, t3> t12 elapses, the product 300 corresponding to the shape of the first object 700, Only one thumbnail image 623 may be included in the identification information display area 620. [

For example, the predetermined time t for tracking an object in step S520 shown in FIG. 5 may be a time consumed when a product searched for by the obtained object image is specified as one, as shown in FIG.

If the identification information (for example, product name and thumbnail image) of the first object 700 is displayed in the identification information display area 620 as described above, the user can display the identification information display area 620 or the inside thereof And request detailed information about the object.

In this case, the network interface unit 133 of the image display apparatus 100 transmits the identification information (e.g., product name) of the first object 700 to the server 300 in response to the user's detailed information request. And the server 300 may search the database for detailed information on the product corresponding to the first object 700 using the transmitted identification information and transmit the retrieved detailed information to the image display apparatus 100. [

For example, the detailed information to be searched may be purchase information for a product corresponding to the first object 700, and more specifically, a product name, a selling price, a manufacturer, a seller, a size, .

15 to 17 illustrate a first embodiment of a method for displaying detailed information about an object.

15, the identification information about the first object 700 is transmitted to the server 300, and while the detailed information search is performed by the server 300, the product information about the first object 700 A message indicating that the search is in progress may be displayed in the detailed information display area 630 of the screen 600.

16, after the detailed information search in the server 300 is completed, the display unit 180 of the image display apparatus 100 displays detailed information on the first object 700 transmitted from the server 300 Can be displayed in the detailed information display area 630 of the screen 600. [

For example, in the detailed information display area 630, a product name 'Clara ABC2' for a product corresponding to the first object 700, a thumbnail image, and a sales price '35,000 won' may be displayed.

In addition, the detailed information display area 630 includes a 'More ..' button 631 for displaying more various information in addition to the displayed information, a 'shopping' button 632 for purchasing the corresponding product, A 'Scrap' button 633 for scrapping, an 'SNS' button 634 for sharing a captured image of the product using the social network service, and a 'Close' button for ending the display of the detailed information display area 630 (635).

Referring to FIG. 17, two or more different detailed information about a product corresponding to the first object 700 may be displayed in the detailed information display area 630, and the detailed information may be displayed on a product Information (e. G., Selling price).

On the other hand, after confirming the sales prices of products corresponding to the first object 700 in the detailed information display area 630, the user selects a desired seller using a pointer, the user can request a movement to a shopping site.

FIG. 18 shows an embodiment of a method for purchasing a product corresponding to an object.

18, when the user confirms detailed information on the first object 700 through the detailed information display area 630 and then requests purchase of the corresponding product, the network interface unit of the video display device 100 133 may connect to a server at a shopping site where the product can be purchased and a web page of a shopping site from which a product corresponding to the first object 700 can be purchased may be displayed on the screen 600.

According to another embodiment of the present invention, object detailed information retrieved from the server 300 may be provided to the user through the remote control device 200 as described above.

The image display apparatus 100 may transmit the object detailed information received from the server 300 to the remote control apparatus 200 through the user interface unit 150 or the network interface unit 133. [

On the other hand, the remote control device 200 can display the object detailed information transmitted from the video display device 100 on the screen by using the display module 257.

19 to 22 illustrate a second embodiment of a method for displaying detailed information about an object.

The image display apparatus 100 displays the object image obtained by capturing the object in the reproduced content and the object identification information (e.g., product name and thumbnail image) obtained using the obtained object image to the remote controller 200 ).

19, the first object image 821 captured by the image display apparatus 100 is displayed in the captured image area 820 of the screen 800 of the remote control apparatus 200, and the product information area 830 The thumbnail images 831 of the products corresponding to the object can be displayed.

20, the second object image 822, which is further transmitted from the image display apparatus 100, is displayed together with the first object image 821 in the captured image area 820, And the number of products displayed in the product information area 830 can be reduced.

Meanwhile, the first object image 821 and the second object image 822 may include object shapes that are viewed at different angles.

21, the third object image 823, which is further transmitted from the image display apparatus 100, is captured together with the first and second object images 821 and 822, Area 820, and the number of products displayed in the product information area 830 can be further reduced as compared with the case shown in Fig.

The third object image 823 may include an object shape that is different from each of the first and second object images 821 and 822.

The user selects any one of the thumbnail images of the products displayed in the product information area 830, for example, the first product image 832, and obtains details of the product corresponding to the selected first product image 822 Information can be requested.

22, the fourth object image 824, which is further transmitted from the image display apparatus 100, is transmitted to the first, second, and third object images 821, 822, and 823, And the product information area 830 displays detailed information about any one of the products retrieved using the first through fourth object images 821, 822, 823, and 824, A product name, a selling price, a manufacturer, a seller, a size, a color, and an enlarged image may be displayed.

On the other hand, the user can select the 'SHOP' button 840 displayed on the screen 800 and display a web page of the shopping site for purchasing the product displayed in the product information area 830 on the screen 800 .

In addition, the user can select the 'scrap' button 841 to scrap and save detailed information on the product, and select the 'close' button 842 to close the product search result window.

The object information retrieval method according to the present invention may be stored in a computer-readable recording medium. The computer readable recording medium may be a ROM, a RAM, a CD-ROM , A magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave (for example, transmission over the Internet).

The computer readable recording medium may be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. And, functional programs, codes and code segments for implementing the above method can be easily inferred by programmers of the technical field to which the present invention belongs.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (22)

delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete 1. An image display apparatus for searching for information on objects included in contents,
A user interface unit for selecting an object from content being reproduced;
A controller for tracking the selected object for a predetermined time in the reproduced content to obtain an image in which the motion of the object is recorded and identifying the object using the obtained object image;
A network interface unit transmitting identification information on the object to a first server and receiving detailed information on the object searched according to the identification information from the first server; And
And a display unit for displaying object detail information received from the server,
Wherein,
Capturing an area of the image displayed on the screen for a predetermined period of time to acquire shapes of the object viewed at different angles. delete 18. The apparatus of claim 17, wherein the network interface unit
And transmits the obtained object image to a second server and receives identification information about the object retrieved using the object image from the second server. 18. The method according to claim 17,
And at least one of a product name and a thumbnail image for the object. 18. The method of claim 17,
And at least one of a product name, a selling price, a manufacturer, a seller, a size, a color, and an enlarged image for the object. delete

Images