KR20070122310A - Television system with pattern cognitive faculty and method for control by using the same - Google Patents

Abstract

A television system having a pattern recognizing function and a control method thereof are provided to compare a pattern of an image obtained from a user with a preset pattern to determine a state of the pattern obtained from the user, thereby inducing right motion of the user by determining whether the motion of the user is right. A television main body has a display unit(110) and an audio output unit(120). A camera unit is installed in a side of the main body to obtain an image. An image processor(140) processes photographed images, obtained by the camera unit, and received broadcasting images and displays the processed images on the display unit. A pattern recognizing unit(150) compares a pattern model extracted from the photographed images, obtained by the camera unit, with pattern data of the broadcasting image.

Description

Television system with pattern cognitive faculty and method for control by using the same

1 is an exemplary view showing an example of a television system provided with a pattern recognition function according to the present invention.

2 is a block diagram showing a television system provided with a pattern recognition function according to the present invention.

3 is a block diagram showing a pattern recognition unit in a television system provided with a pattern recognition function according to the present invention.

4 is a flowchart illustrating the operation of a television system provided with a pattern recognition function according to the present invention.

5A to 5C are simplified views illustrating a display screen of a television system provided with a pattern recognition function according to the present invention.

** Description of the symbols for the main parts of the drawings **

100: television

11O: display unit

130: camera unit

140: image processing unit

150: pattern recognition unit

180: control unit

The present invention relates to a television system provided with a pattern recognition function and a control method thereof, and more particularly, to a television system provided with a pattern recognition function capable of capturing a user's motion and reading the user's motion. It is about.

In recent years, with the development of technology, functional complex electronic products, which have given various functions to one electronic product and improved convenience and functionality, have been introduced. In particular, technology for adding Internet functions to electronic products is becoming common due to the development of network infrastructure and Internet informatization.

Accordingly, televisions, refrigerators, microwave ovens, and the like, which are connected to the Internet, have emerged. Among such functional complex electronic products, televisions are provided with Internet access functions, and products that can access the Internet through televisions are being introduced.

In general, a television receives a broadcast signal transmitted from each broadcasting station through an antenna so that a broadcast corresponding to the screen is displayed. The image of an object photographed by a camera at the broadcasting station is converted into an image signal, and the image signal is transmitted at a constant high frequency. On the other hand, the transmission is transmitted through a transmission antenna, and the transmitted high frequency signal is received through the reception antenna of the television and applied to the television.

The high frequency received by the television is converted into a predetermined frequency through a tuner circuit, and then divided into image signals and audio signals, and after a predetermined step, the image signals are displayed on the screen, and the audio signals are output through the speaker.

At this time, when the user selects a broadcast channel to receive through a television by using a channel conversion switch, a program of a corresponding broadcasting station is displayed on the screen.

As described above, such a television basically has a characteristic of a display medium. Therefore, in addition to the display function of the television, a television capable of making a video call by providing a camera function and a telephone function has been introduced (see Korean Patent Application Laid-Open No. 102-2004-24368). When not using a television, a television has been introduced that allows a television to be used as a frame (see Korean Utility Model Publication No. 20-312352).

However, the above-described prior arts merely use the display function of the television, which does not satisfy the needs of modern users pursuing various display needs. Therefore, the development of a television with various functions added to satisfy various needs of modern users has emerged.

Recently, according to the trend of well-being, there are a lot of video materials such as yoga, health, aerobics, etc. that can be watched and followed at home. However, in case of exercising through video data on a general television, the user who does the exercise cannot see his or her exercise state, so the exercise posture on the television screen cannot be compared with the exercise posture, and thus the exercise effect cannot be exerted smoothly. There is this.

Disclosure of Invention The present invention has been made to solve the above problems, and provides a television system and a control method thereof having a pattern recognition function for determining the state of the acquired image by acquiring and comparing the user's image. There is this.

In addition, the present invention provides a television system equipped with a pattern recognition function that allows the user to form a correct exercise posture by comparing the image pattern acquired from the user who performs the exercise with a predetermined image pattern, and a control method thereof. There is another purpose.

A television system provided with a pattern recognition function according to the present invention for achieving the above object comprises a television main body provided with a display unit and an audio output unit; A camera unit provided on one side of the main body to acquire an image; An image processing unit processing the photographed image acquired by the camera unit and the received broadcast image and displaying the same on the display unit; And a pattern recognition unit for comparing and reading the pattern model extracted from the captured image acquired by the camera unit and the pattern data of the broadcast image.

The main body is provided with a signal processor for receiving a broadcast signal and converting it into the broadcast video, and the broadcast signal is loaded with pattern data of the broadcast video.

The main body includes an interface unit connected to a communication network, and the pattern data of the broadcast video is transmitted through the interface unit.

The image processor displays the captured image and the broadcast image on the display unit by using a picture in picture (PIP) method.

If the pattern model extracted from the captured image by the pattern recognition unit deviates from the effective range of the pattern data of the broadcast image, a warning message is displayed to the user through the display unit.

The pattern recognition unit may include: an acquired image processing unit configured to preprocess the captured image photographed by the camera unit; And a pattern extracting unit extracting the pattern model from the pre-processed photographed image; a pattern comparing unit comparing the extracted pattern model and the predetermined pattern data with each other.

According to an aspect of the present invention, there is provided a control method of a television provided with a pattern recognition function, the operation of which is switched to a pattern recognition mode by a user's operation; Receiving an image signal including a broadcast image and pattern data as the operation is switched; Converting the video signal into the broadcast video and displaying the video signal as the video signal is received; Photographing the user following a pattern of the displayed broadcast image; Comparing the photographed image photographing the user with the broadcast image; And displaying a guide message to the user according to the pattern of the captured image and the broadcast image.

Comparing the photographed image and the broadcast image, the preprocessing step of removing unnecessary image information or noise of the photographed image; Extracting a pattern model according to the posture of the user from the photographed image; Comparing the pattern model with the pattern of the broadcast video.

The broadcast image includes pattern data for comparison with the pattern model extracted from the captured image.

After the photographing of the user, the method further includes converting and displaying the broadcast image and the captured image by a PIP method.

Hereinafter, a television system provided with a pattern recognition function and a control method thereof according to the present invention will be described in detail with reference to the accompanying drawings.

In the description of the present invention, the names of the elements defined are defined in consideration of functions in the present invention, and should not be understood as meanings that limit the technical elements of the present invention. May be referred to by other names in the art.

 In addition, the code added to each component is described for convenience of description, and the contents shown in the drawings in which these codes are described do not limit each component to the range in the drawing. In addition, if the functional similarity and the same, even if the modified embodiment is adopted as an equivalent configuration, even if some embodiments of the configuration in the drawings can be seen as an equivalent configuration if the functional similarity and identity.

First, a brief description will be given of a television system provided with a pattern recognition function according to the present invention.

1 is an exemplary view showing an example of a television system provided with a pattern recognition function according to the present invention, Figure 2 is a block diagram showing a television system provided with a pattern recognition function according to the present invention, Figure 3 is a pattern according to the present invention It is a block diagram which shows the pattern recognition part in the television system provided with the recognition function.

1 to 2, a television system provided with a pattern recognition function according to the present invention includes a television main body 100 including a display unit 110 and an audio output unit 120, and one side of the television main body 100. Is provided in the camera unit 130 for photographing the user's exercise posture, the image processing unit 140 for processing the photographed image and the broadcast image received by the camera unit 130, and photographed by the camera unit 130 The pattern recognition unit 150 for comparing and reading the pattern of the image to be provided is provided.

In addition, the television main body 100 includes an antenna 162 for receiving a broadcast signal transmitted from a broadcasting station or a base station, a signal processor 160 for processing a broadcast signal received from the antenna 162, and a communication network 200 such as the Internet. The interface unit 170 is connected to each other, and a controller 180 for controlling each component is provided in cooperation with each component.

The display unit 110 is for displaying a broadcast image received by the television 100 and / or a captured image captured by the camera unit 130, and includes a cathode-ray tube (CRT), a liquid crystal digital (LCD), A display device selected from a plasma display panel (PDP) or the like may be used. The broadcast image received by the display unit 110 and / or the captured image of the user captured by the camera unit 130 may be displayed by various PIP methods.

The camera unit 130 is for capturing a user's motion and may be provided as a compact camera using a conventional charge-coupled device (CCD). The camera unit 130 may be provided integrally with the television main body 100, but may also be provided in an independent and separated form with respect to the television main body 100. In addition, when mounted on the television main body 100, it is preferable to be provided so that a photography angle can be changed. The photographed image photographed by the camera unit 130 is compared with the pattern data preset by the pattern recognition unit 150 to be described later and read.

The signal processor 160 converts a broadcast signal received from the antenna 162 into a broadcast image, and is provided as a tuner (not shown), a PS separator (not shown), or the like. The signal processor 160 transmits the video signal separated by the control of the controller 180 to the display 110, and the audio signal to the audio output unit 120.

Meanwhile, the broadcast signal received by the signal processor 160 may further include pattern data to be compared with the captured image when the pattern recognition of the captured image acquired by the camera unit 130 is performed. However, such pattern data may be transmitted through a communication network (for example, the Internet) through the interface unit 170.

The image processor 140 converts or modulates each image so that the broadcast image received from the signal processor 160 and the captured image acquired by the camera unit 130 are displayed on the display 110. The broadcast image received by the signal processor 160 by the image processor 140 and the captured image acquired by the camera 130 are displayed on the display 110 in a PIP manner.

In the PIP display method, the broadcast image received by the signal processor 160 is included in the captured image acquired by the camera unit 130, or vice versa, or divided into the same area. Two images may be displayed or overlapped and displayed (see FIGS. 5A to 5C).

The pattern recognition unit 150 is for comparing and reading the photographed image acquired by the camera unit 130 with the pattern data. As shown in FIG. 3, the pattern recognition unit 150 acquires a preprocessed photographed image photographed by the camera unit 130. The image processor 152, a pattern extractor 154 that extracts a pattern model from a preprocessed photographed image, and a pattern comparator 156 that compares the extracted pattern model with preset pattern data are provided.

Here, the acquisition image processing unit 152 removes unnecessary elements such as noise of the captured image captured by the camera unit 130 and extracts sample data to be formed in a pattern. The pattern extractor 154 selects a feature of the pattern formed from the sample data as the sample data is extracted by the acquisition image processor 152, and selects a pattern model from the selected pattern feature to extract the pattern model.

In addition, the pattern comparison unit 156 is provided to compare the pattern model extracted by the pattern extraction unit 154 and the predetermined pattern data with each other and transmit the compared information to the controller 180. Since the pattern reading process of the pattern recognition unit 150 as described above is variously known and used, the pattern recognition method used in the present invention will not be described in detail.

The controller 180 is provided to control each component by organically interlocking with each component as described above. In addition, as described above, a separate database 190 for storing pattern data received through the signal processing unit 160 or the interface unit 170 is further provided.

The operation of the television system provided with the pattern recognition function according to the present invention as described above will be described. Each element mentioned below should be understood with reference to the above description and drawings.

4 is a flowchart illustrating the operation of a television system provided with a pattern recognition function according to the present invention.

First, in describing an operation of a television system provided with a pattern recognition function according to the present invention, an example is a method of extracting a pattern model by photographing a user's exercise position and comparing the extracted pattern model with preset pattern data. I will explain.

In addition, when the use state of the television 100 according to the present invention is used as a television (when set to receive only a broadcast signal) of a general function, a configuration related to pattern recognition such as the camera unit 130 and the pattern recognition unit 150 The parts are set to be inoperative. At this time, since the operation of the television 100 according to the present invention operates in the same manner as that of a normal television, detailed description thereof will be omitted.

On the other hand, when the television 100 according to the present invention is operated in the pattern recognition mode receives a video signal for the exercise to be performed by the user through the signal processor 160, the camera unit 130 to the received broadcast signal The pattern data for comparison with the pattern model extracted from the captured image photographed by the camera is loaded and received.

The pattern data may be received through the separate communication network 200 by the interface unit 170 and the pattern data received in this way is stored in the database 190.

Accordingly, when the television 100 according to the present invention is switched to the pattern recognition mode according to the user's setting, the controller 180 displays the broadcast image received from the signal processor 160 on the display 110, and the user displays the display. Follow the movement motion shown in the unit (110). Accordingly, the camera unit 130 provided in the television body 100 displays the photographed image photographed by photographing the user's exercise motion on the display unit 110 and simultaneously acquires the user's exercise position (step S110).

Here, the broadcast image and the captured image displayed on the display 110 are selectively displayed by the image processor 140 by the PIP method, which is selected according to the user's setting.

On the other hand, the photographed image of the exercise posture of the user photographed by the camera unit 130 is pre-processed by the acquisition image processing unit 152 of the pattern recognition unit 150. That is, unnecessary image information or noise included in the photographed image photographed by the camera unit 130 is removed, and the pattern extracting unit 154 of the pattern recognition unit 150 pattern of the photographed image according to the user's exercise posture. The model extracts (step S120).

Subsequently, the pattern model of the user extracted from the pattern comparison unit 156 of the pattern recognition unit 150 and the pattern data of the broadcast image displayed on the display 110 (for example, are received through the signal processing unit 160 or And pattern data transmitted through the interface unit 170) (step S130).

When the pattern model and the preset pattern data obtained by photographing the user's operation are included in the effective range according to the comparison result of the user's pattern model and the pattern data, the next step is performed (step S140).

If the pattern model obtained by photographing the user's operation and the preset pattern data are not included in the effective range, the user is informed that the posture is incorrect (step S150). In this case, the message guided to the user may display a specific image through the display 110 or output audio through the audio output unit 120.

Subsequently, the controller 180 detects the maintenance state of the pattern recognition mode, and if the pattern recognition mode is maintained, repeatedly repeats the above-described process and receives pattern data such as a pattern model and a broadcast image of the user, which are photographed and extracted. Are compared with each other, and when the pattern recognition mode is finished, the mode is switched to the normal television mode (step S160).

Accordingly, as described above, as the user performs an operation shown on the display unit 110 of the television 100, the user's operation and the displayed operation can be compared with each other to induce the user's correct movement. have.

Although described in detail with respect to preferred embodiments of the present invention as described above, those of ordinary skill in the art, without departing from the spirit and scope of the invention as defined in the appended claims Various modifications may be made to the invention. However, all other modified embodiments include the essential elements of the present invention should be considered to be included in the technical scope of the present invention.

As described above, according to the television system provided with the pattern recognition function and the control method thereof according to the present invention, by comparing the pattern of the image obtained from the user with the predetermined pattern, by reading the state of the pattern obtained by the user, By determining whether the motion is the correct motion, there is an effect that can induce the correct motion of the user.

Claims (10)

A television main body provided with a display unit and an audio output unit; A camera unit provided on one side of the main body to acquire an image; An image processing unit processing the photographed image acquired by the camera unit and the received broadcast image and displaying the same on the display unit; And a pattern recognition unit for comparing and reading the pattern model extracted from the captured image acquired by the camera unit and the pattern data of the broadcast image. The method of claim 1, wherein the main body, A signal processor for receiving a broadcast signal and converting it into the broadcast video is provided. And the pattern signal of the broadcast image is loaded on the broadcast signal and transmitted. The method of claim 1, wherein the main body, An interface portion connected to the communication network is provided, And a pattern recognition function characterized in that the pattern data of the broadcast video is transmitted through the interface unit. The image processing apparatus of claim 1, wherein the image processor comprises: And a pattern recognition function for displaying the photographed image and the broadcast image on the display unit by a picture in picture (PIP) method. The method of claim 1, When the pattern model extracted from the photographed image by the pattern recognition unit deviates from the effective range of the pattern data of the broadcast image, a TV with a pattern recognition function, which displays a warning message to the user through the display unit. system. The method of claim 1, wherein the pattern recognition unit, An acquisition image processing unit which preprocesses the captured image photographed by the camera unit; A pattern extracting unit extracting the pattern model from the preprocessed photographed image; And a pattern comparison unit for comparing the extracted pattern model and the predetermined pattern data with each other. Switching the operation to the pattern recognition mode by a user's operation; Receiving an image signal including a broadcast image and pattern data as the operation is switched; Converting the video signal into the broadcast video and displaying the video signal as the video signal is received; Photographing the user following a pattern of the displayed broadcast image; Comparing the photographed image photographing the user with the broadcast image; And displaying a guide message to the user according to the pattern of the photographed image and the broadcast image. The method of claim 7, wherein the comparing of the captured image and the broadcast image comprises: A preprocessing step of removing unnecessary image information or noise of the captured image; Extracting a pattern model according to the posture of the user from the photographed image; And a step of comparing the pattern model with a pattern of the broadcast video. The method of claim 8, wherein the broadcast video, And a pattern data for comparison with the pattern model extracted from the photographed image. The method of claim 7, wherein after photographing the user, And converting and displaying the broadcast image and the captured image by a PIP method.

Images